2024-09-15T21:56:39.016 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T21:56:39.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T21:56:39.133 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906231 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/norstats}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906231' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 8921c8ef947807b717db041d85f0761b7914d5fc subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync rbytes: false syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+ulJ+eyEtOTGCOfPiBCR0JCJnribDINXyepU2eI0r79JNeKZ7bcaHF2exdrY9DVt7Pm1wNPy+R8Gahel+r2Ng= smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLcadzt6/Yz5grQFQcdG0ZdbX0O89/cPCPispoTs8YZ3J9zhlMDi/2Xlt0Mr62H/tydgHOPvLa7tS9y5B0xFgfg= smithi165.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5GX6+xRck3oEt+WD+hoGoWtZwdyG8JBAXd8BRkgsF0HTBnSu4KQVXYBl3ZhFww9KUMBKGkEGcZ1QO1/bvI6kU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T21:56:39.133 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T21:56:39.134 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T21:56:39.134 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T21:56:39.135 INFO:teuthology.task.internal:Checking packages... 2024-09-15T21:56:39.157 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T21:56:39.157 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T21:56:39.157 INFO:teuthology.packaging:ref: None 2024-09-15T21:56:39.157 INFO:teuthology.packaging:tag: None 2024-09-15T21:56:39.157 INFO:teuthology.packaging:branch: squid 2024-09-15T21:56:39.158 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T21:56:39.158 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-15T21:56:39.390 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-326.g8921c8ef 2024-09-15T21:56:39.392 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T21:56:39.400 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T21:56:39.400 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T21:56:39.414 INFO:teuthology.task.internal:Saving configuration 2024-09-15T21:56:39.436 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T21:56:39.447 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T21:56:39.475 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906231', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 21:51:38.930872', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+ulJ+eyEtOTGCOfPiBCR0JCJnribDINXyepU2eI0r79JNeKZ7bcaHF2exdrY9DVt7Pm1wNPy+R8Gahel+r2Ng='} 2024-09-15T21:56:39.496 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906231', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 21:51:38.927700', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLcadzt6/Yz5grQFQcdG0ZdbX0O89/cPCPispoTs8YZ3J9zhlMDi/2Xlt0Mr62H/tydgHOPvLa7tS9y5B0xFgfg='} 2024-09-15T21:56:39.520 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi165.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906231', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 21:51:38.929398', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5GX6+xRck3oEt+WD+hoGoWtZwdyG8JBAXd8BRkgsF0HTBnSu4KQVXYBl3ZhFww9KUMBKGkEGcZ1QO1/bvI6kU='} 2024-09-15T21:56:39.520 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T21:56:39.531 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-15T21:56:39.531 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-15T21:56:39.531 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-15T21:56:39.531 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T21:56:39.628 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f91f14cfbe0>, signals=[15]) 2024-09-15T21:56:39.628 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T21:56:39.637 INFO:teuthology.task.internal:Opening connections... 2024-09-15T21:56:39.637 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2024-09-15T21:56:39.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:56:39.720 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-09-15T21:56:39.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:56:39.797 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi165.front.sepia.ceph.com 2024-09-15T21:56:39.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:56:39.873 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T21:56:39.881 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2024-09-15T21:56:39.900 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2024-09-15T21:56:39.900 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2024-09-15T21:56:39.958 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2024-09-15T21:56:39.958 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2024-09-15T21:56:39.958 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2024-09-15T21:56:39.958 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2024-09-15T21:56:39.958 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2024-09-15T21:56:39.958 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2024-09-15T21:56:39.958 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T21:56:39.959 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2024-09-15T21:56:39.959 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2024-09-15T21:56:39.959 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T21:56:39.959 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2024-09-15T21:56:39.959 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T21:56:39.959 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T21:56:39.959 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T21:56:39.960 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2024-09-15T21:56:39.984 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-09-15T21:56:40.002 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-09-15T21:56:40.002 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-09-15T21:56:40.060 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-09-15T21:56:40.060 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-09-15T21:56:40.060 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-09-15T21:56:40.060 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-09-15T21:56:40.060 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-09-15T21:56:40.061 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-09-15T21:56:40.061 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T21:56:40.061 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-09-15T21:56:40.061 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-09-15T21:56:40.061 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T21:56:40.061 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-09-15T21:56:40.061 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T21:56:40.061 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T21:56:40.061 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T21:56:40.061 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-09-15T21:56:40.084 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2024-09-15T21:56:40.102 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2024-09-15T21:56:40.103 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2024-09-15T21:56:40.160 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2024-09-15T21:56:40.160 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="9" 2024-09-15T21:56:40.160 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2024-09-15T21:56:40.160 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2024-09-15T21:56:40.160 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="9" 2024-09-15T21:56:40.160 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el9" 2024-09-15T21:56:40.160 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T21:56:40.161 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2024-09-15T21:56:40.161 INFO:teuthology.orchestra.run.smithi165.stdout:LOGO="fedora-logo-icon" 2024-09-15T21:56:40.161 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T21:56:40.161 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2024-09-15T21:56:40.161 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T21:56:40.161 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T21:56:40.161 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T21:56:40.161 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2024-09-15T21:56:40.184 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T21:56:40.196 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T21:56:40.206 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T21:56:40.207 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2024-09-15T21:56:40.209 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-09-15T21:56:40.211 DEBUG:teuthology.orchestra.run.smithi165:> test '!' -e /home/ubuntu/cephtest 2024-09-15T21:56:40.228 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T21:56:40.238 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T21:56:40.238 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2024-09-15T21:56:40.267 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-09-15T21:56:40.270 DEBUG:teuthology.orchestra.run.smithi165:> test -z $(ls -A /var/lib/ceph) 2024-09-15T21:56:40.411 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T21:56:40.497 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T21:56:40.513 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-15T21:56:40.514 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-15T21:56:40.514 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-15T21:56:40.514 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T21:56:40.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:56:40.531 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2024-09-15T21:56:40.588 INFO:teuthology.orchestra.run.smithi045.stdout:5.14.0-503.el9.x86_64 2024-09-15T21:56:40.588 INFO:teuthology.task.kernel:Running kernel on smithi045: 5.14.0-503.el9.x86_64 2024-09-15T21:56:40.589 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum install -y kernel 2024-09-15T21:56:43.824 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.2 MB 00:01 2024-09-15T21:56:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-15T21:56:50.034 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-15T21:56:51.709 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-15T21:56:52.813 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-15T21:56:58.435 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-09-15T21:57:00.534 INFO:teuthology.orchestra.run.smithi045.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T21:57:00.534 INFO:teuthology.orchestra.run.smithi045.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T21:57:00.626 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-15T21:57:00.630 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-15T21:57:00.630 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-09-15T21:57:00.630 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-15T21:57:00.631 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-15T21:57:00.631 INFO:teuthology.orchestra.run.smithi045.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T21:57:00.631 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-09-15T21:57:00.631 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T21:57:00.631 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T21:57:00.631 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T21:57:00.631 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T21:57:00.631 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-15T21:57:00.631 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-09-15T21:57:00.631 INFO:teuthology.orchestra.run.smithi045.stdout:Install 4 Packages 2024-09-15T21:57:00.631 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T21:57:00.632 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 79 M 2024-09-15T21:57:00.632 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 126 M 2024-09-15T21:57:00.632 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-15T21:57:00.745 INFO:teuthology.orchestra.run.smithi045.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 342 kB/s | 23 kB 00:00 2024-09-15T21:57:01.237 INFO:teuthology.orchestra.run.smithi045.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 58 MB/s | 29 MB 00:00 2024-09-15T21:57:02.304 INFO:teuthology.orchestra.run.smithi045.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 21 MB/s | 35 MB 00:01 2024-09-15T21:57:02.504 INFO:teuthology.orchestra.run.smithi045.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 8.6 MB/s | 16 MB 00:01 2024-09-15T21:57:02.505 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-15T21:57:02.505 INFO:teuthology.orchestra.run.smithi045.stdout:Total 42 MB/s | 79 MB 00:01 2024-09-15T21:57:03.212 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-15T21:57:03.621 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-15T21:57:03.621 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-15T21:57:04.625 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-15T21:57:04.626 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-15T21:57:07.221 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-15T21:57:07.901 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T21:57:07.981 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T21:57:10.769 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T21:57:10.908 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T21:57:16.033 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T21:57:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T21:57:21.214 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T21:58:00.289 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T21:58:00.330 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T21:58:00.688 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T21:58:00.688 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T21:58:00.688 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T21:58:00.688 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T21:58:01.542 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T21:58:01.542 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T21:58:01.542 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-15T21:58:01.543 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T21:58:01.543 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T21:58:01.543 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T21:58:01.543 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T21:58:01.543 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T21:58:01.543 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-15T21:58:01.886 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T21:58:01.974 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T21:58:01.975 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T21:58:01.975 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T21:58:01.976 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T21:58:01.976 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T21:58:01.976 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-15T21:58:01.976 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi045.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T21:58:01.977 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T21:58:02.036 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T21:58:02.037 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T21:58:02.037 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -qi grub2-tools 2024-09-15T21:58:02.076 INFO:teuthology.orchestra.run.smithi045.stdout:Name : grub2-tools 2024-09-15T21:58:02.076 INFO:teuthology.orchestra.run.smithi045.stdout:Epoch : 1 2024-09-15T21:58:02.077 INFO:teuthology.orchestra.run.smithi045.stdout:Version : 2.06 2024-09-15T21:58:02.077 INFO:teuthology.orchestra.run.smithi045.stdout:Release : 82.el9 2024-09-15T21:58:02.077 INFO:teuthology.orchestra.run.smithi045.stdout:Architecture: x86_64 2024-09-15T21:58:02.077 INFO:teuthology.orchestra.run.smithi045.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T21:58:02.077 INFO:teuthology.orchestra.run.smithi045.stdout:Group : Unspecified 2024-09-15T21:58:02.078 INFO:teuthology.orchestra.run.smithi045.stdout:Size : 8274670 2024-09-15T21:58:02.078 INFO:teuthology.orchestra.run.smithi045.stdout:License : GPLv3+ 2024-09-15T21:58:02.078 INFO:teuthology.orchestra.run.smithi045.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T21:58:02.078 INFO:teuthology.orchestra.run.smithi045.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T21:58:02.078 INFO:teuthology.orchestra.run.smithi045.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T21:58:02.078 INFO:teuthology.orchestra.run.smithi045.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T21:58:02.079 INFO:teuthology.orchestra.run.smithi045.stdout:Packager : builder@centos.org 2024-09-15T21:58:02.079 INFO:teuthology.orchestra.run.smithi045.stdout:Vendor : CentOS 2024-09-15T21:58:02.079 INFO:teuthology.orchestra.run.smithi045.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T21:58:02.079 INFO:teuthology.orchestra.run.smithi045.stdout:Summary : Support tools for GRUB. 2024-09-15T21:58:02.079 INFO:teuthology.orchestra.run.smithi045.stdout:Description : 2024-09-15T21:58:02.079 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T21:58:02.080 INFO:teuthology.orchestra.run.smithi045.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T21:58:02.080 INFO:teuthology.orchestra.run.smithi045.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T21:58:02.080 INFO:teuthology.orchestra.run.smithi045.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T21:58:02.080 INFO:teuthology.orchestra.run.smithi045.stdout:hardware devices. 2024-09-15T21:58:02.080 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T21:58:02.080 INFO:teuthology.orchestra.run.smithi045.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T21:58:02.082 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T21:58:02.082 INFO:teuthology.task.kernel:Updating grub on smithi045 to boot 5.14.0-505.el9.x86_64 2024-09-15T21:58:02.082 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T21:58:02.706 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2024-09-15T21:58:04.042 INFO:teuthology.orchestra.run.smithi045.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T21:58:04.080 INFO:teuthology.orchestra.run.smithi045.stderr:done 2024-09-15T21:58:04.082 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2024-09-15T21:58:04.097 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.6cURNAK7J1 2024-09-15T21:58:04.097 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6cURNAK7J1 2024-09-15T21:58:04.164 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.6cURNAK7J1 2024-09-15T21:58:04.305 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.6cURNAK7J1 is 6KB 2024-09-15T21:58:04.353 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.6cURNAK7J1 2024-09-15T21:58:04.367 DEBUG:teuthology.orchestra.run.smithi045:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T21:58:04.430 INFO:teuthology.orchestra.run.smithi045.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T21:58:04.431 INFO:teuthology.orchestra.run.smithi045.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T21:58:04.431 INFO:teuthology.orchestra.run.smithi045.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T21:58:04.431 INFO:teuthology.orchestra.run.smithi045.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T21:58:04.432 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T21:58:04.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo shutdown -r now 2024-09-15T21:58:34.604 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-15T21:58:34.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-09-15T21:58:34.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:58:52.993 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-09-15T21:59:01.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-09-15T21:59:01.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:59:05.053 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-09-15T21:59:17.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-09-15T21:59:17.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T21:59:48.889 DEBUG:teuthology.orchestra.run.smithi045:> true 2024-09-15T21:59:49.381 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-09-15T21:59:49.381 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-15T21:59:49.381 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2024-09-15T21:59:49.434 INFO:teuthology.orchestra.run.smithi045.stdout:5.14.0-505.el9.x86_64 2024-09-15T21:59:49.435 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T21:59:49.435 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T21:59:49.435 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T21:59:50.436 DEBUG:teuthology.parallel:result is None 2024-09-15T21:59:50.436 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T21:59:50.444 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T21:59:50.445 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T21:59:50.447 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T21:59:50.450 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T21:59:50.469 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T21:59:50.475 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T21:59:50.485 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T21:59:50.486 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T21:59:50.504 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T21:59:50.509 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T21:59:50.588 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T21:59:50.595 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T21:59:50.595 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T21:59:50.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:59:50.612 DEBUG:teuthology.orchestra.run.smithi165:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T21:59:50.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:59:50.629 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T21:59:50.632 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T21:59:50.654 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T21:59:50.689 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:59:50.696 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:59:50.706 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:59:50.709 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:59:50.733 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:59:50.748 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T21:59:50.749 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T21:59:50.756 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T21:59:50.756 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T21:59:50.759 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T21:59:50.761 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T21:59:50.817 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T21:59:50.827 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T21:59:50.827 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T21:59:50.829 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T21:59:50.831 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T21:59:50.874 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:59:50.927 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:59:50.976 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:59:51.057 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:59:51.099 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T21:59:51.099 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T21:59:51.164 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:59:51.205 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:59:51.277 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:59:51.321 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:59:51.359 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-15T21:59:51.359 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T21:59:51.424 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:59:51.471 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T21:59:51.529 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:59:51.612 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T21:59:51.657 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-15T21:59:51.657 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T21:59:51.724 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2024-09-15T21:59:51.727 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-09-15T21:59:51.729 DEBUG:teuthology.orchestra.run.smithi165:> sudo service rsyslog restart 2024-09-15T21:59:51.760 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T21:59:51.774 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T21:59:51.806 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T21:59:52.277 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T21:59:52.285 INFO:teuthology.task.internal:Starting timer... 2024-09-15T21:59:52.285 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T21:59:52.296 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T21:59:52.303 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-15T21:59:52.304 DEBUG:teuthology.orchestra.run.smithi045:> sudo service auditd rotate 2024-09-15T21:59:52.385 INFO:teuthology.orchestra.run.smithi045.stdout:Rotating logs: 2024-09-15T21:59:52.387 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-09-15T21:59:52.443 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-09-15T21:59:52.445 DEBUG:teuthology.orchestra.run.smithi165:> sudo service auditd rotate 2024-09-15T21:59:52.489 INFO:teuthology.orchestra.run.smithi165.stdout:Rotating logs: 2024-09-15T21:59:52.491 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T21:59:52.492 DEBUG:teuthology.orchestra.run.smithi045:> /usr/sbin/getenforce 2024-09-15T21:59:52.518 INFO:teuthology.orchestra.run.smithi045.stdout:Permissive 2024-09-15T21:59:52.518 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-09-15T21:59:52.544 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-09-15T21:59:52.545 DEBUG:teuthology.orchestra.run.smithi165:> /usr/sbin/getenforce 2024-09-15T21:59:52.571 INFO:teuthology.orchestra.run.smithi165.stdout:Permissive 2024-09-15T21:59:52.571 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi045.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi165.front.sepia.ceph.com': 'permissive'} 2024-09-15T21:59:52.571 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T21:59:52.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:59:52.601 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T21:59:52.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:59:52.627 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T21:59:52.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T21:59:52.654 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T21:59:52.655 DEBUG:teuthology.orchestra.run.smithi045:> sudo /usr/sbin/setenforce permissive 2024-09-15T21:59:52.691 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-09-15T21:59:52.727 DEBUG:teuthology.orchestra.run.smithi165:> sudo /usr/sbin/setenforce permissive 2024-09-15T21:59:52.776 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T21:59:52.786 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T21:59:52.801 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T21:59:52.802 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi100.front.sepia.ceph.com,smithi165.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T22:03:52.089 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi165.front.sepia.ceph.com')] 2024-09-15T22:03:52.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-09-15T22:03:52.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:03:52.168 DEBUG:teuthology.orchestra.run.smithi045:> true 2024-09-15T22:03:52.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-09-15T22:03:52.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-15T22:03:52.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:03:52.335 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-09-15T22:03:52.412 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-09-15T22:03:52.413 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-15T22:03:52.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:03:52.490 DEBUG:teuthology.orchestra.run.smithi165:> true 2024-09-15T22:03:52.574 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2024-09-15T22:03:52.574 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T22:03:52.584 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T22:03:52.584 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:03:52.585 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:03:52.587 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:03:52.587 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:03:52.589 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:03:52.590 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:03:52.618 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:03:52.618 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:03:52.632 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:03:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:03:52.648 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T22:03:52.657 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-09-15T22:03:52.660 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: ntpd: command not found 2024-09-15T22:03:52.664 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T22:03:52.669 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-09-15T22:03:52.671 INFO:teuthology.orchestra.run.smithi045.stdout:506 Cannot talk to daemon 2024-09-15T22:03:52.683 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:03:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:03:52.690 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: ntpd: command not found 2024-09-15T22:03:52.697 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:03:52.702 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:03:52.702 INFO:teuthology.orchestra.run.smithi165.stdout:506 Cannot talk to daemon 2024-09-15T22:03:52.718 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T22:03:52.732 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T22:03:52.754 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:03:52.758 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:03:52.758 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-15T22:03:52.758 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:03:52.758 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:03:52.758 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:03:52.759 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:03:52.764 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:03:52.767 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:03:52.768 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-09-15T22:03:52.768 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:03:52.768 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:03:52.768 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:03:52.768 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:03:52.788 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:03:52.791 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:03:52.792 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-15T22:03:52.792 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:03:52.792 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:03:52.792 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:03:52.792 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:03:52.793 INFO:teuthology.run_tasks:Running task install... 2024-09-15T22:03:52.801 DEBUG:teuthology.task.install:project ceph 2024-09-15T22:03:52.801 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T22:03:52.801 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T22:03:52.802 INFO:teuthology.task.install:Using flavor: default 2024-09-15T22:03:52.807 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T22:03:52.807 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T22:03:52.808 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:03:52.809 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:03:52.812 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:03:52.812 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:03:52.813 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T22:03:52.813 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:03:52.974 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:03:52.975 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:03:52.979 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:03:52.979 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:03:52.980 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T22:03:52.980 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T22:03:53.084 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:03:53.084 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:03:53.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:03:53.092 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:03:53.093 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-15T22:03:53.093 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:03:53.097 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T22:03:53.097 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-15T22:03:53.097 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T22:03:53.112 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:03:53.113 DEBUG:teuthology.orchestra.run.smithi045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:03:53.118 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:03:53.118 DEBUG:teuthology.orchestra.run.smithi165:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:03:53.123 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T22:03:53.123 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T22:03:53.180 DEBUG:teuthology.orchestra.run.smithi045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:03:53.183 DEBUG:teuthology.orchestra.run.smithi165:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:03:53.189 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T22:03:53.258 DEBUG:teuthology.orchestra.run.smithi045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:03:53.259 DEBUG:teuthology.orchestra.run.smithi165:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:03:53.264 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T22:03:53.323 INFO:teuthology.orchestra.run.smithi165.stdout:check_obsoletes = 1 2024-09-15T22:03:53.324 INFO:teuthology.orchestra.run.smithi045.stdout:check_obsoletes = 1 2024-09-15T22:03:53.325 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum clean all 2024-09-15T22:03:53.326 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum clean all 2024-09-15T22:03:53.328 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-09-15T22:03:53.330 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-09-15T22:03:53.551 INFO:teuthology.orchestra.run.smithi165.stdout:45 files removed 2024-09-15T22:03:53.556 INFO:teuthology.orchestra.run.smithi100.stdout:45 files removed 2024-09-15T22:03:53.562 INFO:teuthology.orchestra.run.smithi045.stdout:45 files removed 2024-09-15T22:03:53.578 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:03:53.583 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:03:53.589 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T22:03:54.125 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 315 kB/s | 83 kB 00:00 2024-09-15T22:03:54.126 INFO:teuthology.orchestra.run.smithi165.stdout:ceph packages for x86_64 308 kB/s | 83 kB 00:00 2024-09-15T22:03:54.158 INFO:teuthology.orchestra.run.smithi045.stdout:ceph packages for x86_64 312 kB/s | 83 kB 00:00 2024-09-15T22:03:54.409 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-15T22:03:54.409 INFO:teuthology.orchestra.run.smithi165.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-15T22:03:54.442 INFO:teuthology.orchestra.run.smithi045.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-15T22:03:54.676 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-15T22:03:54.677 INFO:teuthology.orchestra.run.smithi165.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-15T22:03:54.718 INFO:teuthology.orchestra.run.smithi045.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-15T22:03:55.119 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-15T22:03:55.651 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - BaseOS 9.2 MB/s | 8.2 MB 00:00 2024-09-15T22:03:57.153 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-15T22:03:57.910 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-15T22:03:59.653 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 1.7 MB/s | 8.2 MB 00:04 2024-09-15T22:04:01.679 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - CRB 8.9 MB/s | 6.5 MB 00:00 2024-09-15T22:04:02.353 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-15T22:04:02.720 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-15T22:04:03.038 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS Stream 9 - Extras packages 114 kB/s | 19 kB 00:00 2024-09-15T22:04:03.996 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 19 kB 00:00 2024-09-15T22:04:04.101 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-15T22:04:04.991 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-15T22:04:08.211 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.5 MB 00:01 2024-09-15T22:04:09.582 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-15T22:04:09.737 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-15T22:04:10.639 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-15T22:04:10.757 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-15T22:04:11.841 INFO:teuthology.orchestra.run.smithi165.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:04:11.842 INFO:teuthology.orchestra.run.smithi165.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:04:11.853 INFO:teuthology.orchestra.run.smithi165.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:04:11.853 INFO:teuthology.orchestra.run.smithi165.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:04:11.854 INFO:teuthology.orchestra.run.smithi165.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:04:11.855 INFO:teuthology.orchestra.run.smithi165.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:04:11.857 INFO:teuthology.orchestra.run.smithi165.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:04:11.859 INFO:teuthology.orchestra.run.smithi165.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:04:11.860 INFO:teuthology.orchestra.run.smithi165.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:04:11.924 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2024-09-15T22:04:11.942 INFO:teuthology.orchestra.run.smithi165.stdout:====================================================================================== 2024-09-15T22:04:11.942 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2024-09-15T22:04:11.942 INFO:teuthology.orchestra.run.smithi165.stdout:====================================================================================== 2024-09-15T22:04:11.942 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2024-09-15T22:04:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:04:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:04:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:04:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:04:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:04:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:04:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:04:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:04:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:04:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:04:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:04:11.943 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:04:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:04:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:04:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:04:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:04:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:04:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:04:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:04:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:04:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:04:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:04:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:04:11.944 INFO:teuthology.orchestra.run.smithi165.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:04:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:04:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:04:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:04:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:04:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:04:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:04:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:04:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:04:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:04:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:04:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:04:11.945 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:04:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:04:11.946 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrading: 2024-09-15T22:04:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:04:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:04:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:04:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:04:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:04:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:04:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:04:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:04:11.946 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2024-09-15T22:04:11.946 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:04:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:04:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:04:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:04:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:04:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:04:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:04:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:04:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:04:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:04:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:04:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:04:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:04:11.947 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:04:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:04:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:04:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:04:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:04:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:04:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:04:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:04:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:04:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:04:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:04:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:04:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:04:11.948 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:04:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:04:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:04:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:04:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:04:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:04:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:04:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:04:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:04:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:04:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:04:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:04:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:04:11.949 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:04:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:04:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:04:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:04:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:04:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:04:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:04:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:04:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:04:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:04:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:04:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:04:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:04:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:04:11.951 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:04:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:04:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:04:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:04:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:04:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:04:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:04:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:04:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:04:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:04:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:04:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:04:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:04:11.952 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:04:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:04:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:04:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:04:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:04:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:04:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:04:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:04:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:04:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:04:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:04:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:04:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:04:11.953 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:04:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:04:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:04:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:04:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:04:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:04:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:04:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:04:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:04:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:04:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:04:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:04:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:04:11.954 INFO:teuthology.orchestra.run.smithi165.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:04:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:04:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:04:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:04:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:04:11.955 INFO:teuthology.orchestra.run.smithi165.stdout:Installing weak dependencies: 2024-09-15T22:04:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:04:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:04:11.955 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2024-09-15T22:04:11.955 INFO:teuthology.orchestra.run.smithi165.stdout:====================================================================================== 2024-09-15T22:04:11.955 INFO:teuthology.orchestra.run.smithi165.stdout:Install 148 Packages 2024-09-15T22:04:11.955 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrade 8 Packages 2024-09-15T22:04:11.955 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:04:11.956 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 226 M 2024-09-15T22:04:11.956 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2024-09-15T22:04:12.875 INFO:teuthology.orchestra.run.smithi165.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-15T22:04:13.086 INFO:teuthology.orchestra.run.smithi045.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:04:13.087 INFO:teuthology.orchestra.run.smithi045.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:04:13.101 INFO:teuthology.orchestra.run.smithi045.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:04:13.102 INFO:teuthology.orchestra.run.smithi045.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:04:13.103 INFO:teuthology.orchestra.run.smithi045.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:04:13.104 INFO:teuthology.orchestra.run.smithi045.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:04:13.106 INFO:teuthology.orchestra.run.smithi045.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:04:13.109 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:04:13.110 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:04:13.116 INFO:teuthology.orchestra.run.smithi165.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 3.6 MB/s | 896 kB 00:00 2024-09-15T22:04:13.177 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-09-15T22:04:13.200 INFO:teuthology.orchestra.run.smithi165.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.7 MB/s | 145 kB 00:00 2024-09-15T22:04:13.202 INFO:teuthology.orchestra.run.smithi045.stdout:====================================================================================== 2024-09-15T22:04:13.202 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-09-15T22:04:13.202 INFO:teuthology.orchestra.run.smithi045.stdout:====================================================================================== 2024-09-15T22:04:13.202 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-09-15T22:04:13.202 INFO:teuthology.orchestra.run.smithi045.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:04:13.202 INFO:teuthology.orchestra.run.smithi045.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:04:13.203 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:04:13.203 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:04:13.203 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:04:13.203 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:04:13.203 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:04:13.203 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:04:13.203 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:04:13.203 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:04:13.203 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:04:13.203 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:04:13.203 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:04:13.203 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi045.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi045.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:04:13.204 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:04:13.205 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:04:13.205 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:04:13.205 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:04:13.205 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:04:13.205 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:04:13.205 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:04:13.205 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:04:13.205 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:04:13.205 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:04:13.205 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:04:13.205 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2024-09-15T22:04:13.205 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:04:13.205 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:04:13.206 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:04:13.206 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:04:13.206 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:04:13.206 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:04:13.206 INFO:teuthology.orchestra.run.smithi045.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:04:13.206 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:04:13.206 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-09-15T22:04:13.206 INFO:teuthology.orchestra.run.smithi045.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:04:13.206 INFO:teuthology.orchestra.run.smithi045.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:04:13.207 INFO:teuthology.orchestra.run.smithi045.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:04:13.207 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:04:13.207 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:04:13.207 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:04:13.207 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:04:13.207 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:04:13.207 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:04:13.207 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:04:13.207 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:04:13.207 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:04:13.207 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:04:13.207 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:04:13.208 INFO:teuthology.orchestra.run.smithi045.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:04:13.208 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:04:13.208 INFO:teuthology.orchestra.run.smithi045.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:04:13.208 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:04:13.208 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:04:13.208 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:04:13.208 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:04:13.208 INFO:teuthology.orchestra.run.smithi045.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:04:13.208 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:04:13.208 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:04:13.208 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:04:13.208 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:04:13.209 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:04:13.210 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:04:13.210 INFO:teuthology.orchestra.run.smithi045.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:04:13.210 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:04:13.210 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:04:13.210 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:04:13.210 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:04:13.210 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:04:13.210 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:04:13.210 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:04:13.210 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:04:13.210 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:04:13.210 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:04:13.211 INFO:teuthology.orchestra.run.smithi045.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:04:13.211 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:04:13.211 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:04:13.211 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:04:13.211 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:04:13.211 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:04:13.211 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:04:13.211 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:04:13.211 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:04:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:04:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:04:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:04:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:04:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:04:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:04:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:04:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:04:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:04:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:04:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:04:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:04:13.212 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:04:13.213 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:04:13.213 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:04:13.213 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:04:13.213 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:04:13.213 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:04:13.213 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:04:13.213 INFO:teuthology.orchestra.run.smithi045.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:04:13.213 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:04:13.213 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:04:13.214 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:04:13.214 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:04:13.214 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:04:13.214 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:04:13.214 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:04:13.214 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:04:13.214 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:04:13.214 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:04:13.214 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:04:13.214 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:04:13.214 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:04:13.215 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:04:13.215 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:04:13.215 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:04:13.215 INFO:teuthology.orchestra.run.smithi045.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:04:13.215 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:04:13.215 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:04:13.215 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:04:13.215 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:04:13.215 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:04:13.215 INFO:teuthology.orchestra.run.smithi045.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:04:13.215 INFO:teuthology.orchestra.run.smithi045.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:04:13.216 INFO:teuthology.orchestra.run.smithi045.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:04:13.216 INFO:teuthology.orchestra.run.smithi045.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:04:13.216 INFO:teuthology.orchestra.run.smithi045.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:04:13.216 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:04:13.216 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:04:13.216 INFO:teuthology.orchestra.run.smithi045.stdout:Installing weak dependencies: 2024-09-15T22:04:13.216 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:04:13.216 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:04:13.216 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-09-15T22:04:13.216 INFO:teuthology.orchestra.run.smithi045.stdout:====================================================================================== 2024-09-15T22:04:13.216 INFO:teuthology.orchestra.run.smithi045.stdout:Install 148 Packages 2024-09-15T22:04:13.216 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 8 Packages 2024-09-15T22:04:13.217 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:04:13.217 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 226 M 2024-09-15T22:04:13.217 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-09-15T22:04:13.292 INFO:teuthology.orchestra.run.smithi165.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 10 MB/s | 5.4 MB 00:00 2024-09-15T22:04:13.359 INFO:teuthology.orchestra.run.smithi165.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 15 MB/s | 2.4 MB 00:00 2024-09-15T22:04:13.410 INFO:teuthology.orchestra.run.smithi165.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 13 MB/s | 1.5 MB 00:00 2024-09-15T22:04:13.760 INFO:teuthology.orchestra.run.smithi165.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-15T22:04:13.952 INFO:teuthology.orchestra.run.smithi165.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 18 MB/s | 21 MB 00:01 2024-09-15T22:04:13.986 INFO:teuthology.orchestra.run.smithi165.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 760 kB/s | 25 kB 00:00 2024-09-15T22:04:14.040 INFO:teuthology.orchestra.run.smithi045.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 48 kB/s | 6.5 kB 00:00 2024-09-15T22:04:14.469 INFO:teuthology.orchestra.run.smithi165.stdout:(10/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 16 MB/s | 17 MB 00:01 2024-09-15T22:04:14.586 INFO:teuthology.orchestra.run.smithi165.stdout:(11/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 13 MB/s | 11 MB 00:00 2024-09-15T22:04:14.611 INFO:teuthology.orchestra.run.smithi165.stdout:(12/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 1.6 MB/s | 228 kB 00:00 2024-09-15T22:04:14.616 INFO:teuthology.orchestra.run.smithi045.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 1.5 MB/s | 896 kB 00:00 2024-09-15T22:04:14.636 INFO:teuthology.orchestra.run.smithi165.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 542 kB/s | 27 kB 00:00 2024-09-15T22:04:14.662 INFO:teuthology.orchestra.run.smithi165.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 630 kB/s | 32 kB 00:00 2024-09-15T22:04:14.699 INFO:teuthology.orchestra.run.smithi045.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.7 MB/s | 145 kB 00:00 2024-09-15T22:04:14.720 INFO:teuthology.orchestra.run.smithi165.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 8.8 MB/s | 751 kB 00:00 2024-09-15T22:04:14.746 INFO:teuthology.orchestra.run.smithi165.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 1.9 MB/s | 163 kB 00:00 2024-09-15T22:04:14.804 INFO:teuthology.orchestra.run.smithi165.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.1 MB/s | 127 kB 00:00 2024-09-15T22:04:14.838 INFO:teuthology.orchestra.run.smithi165.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 5.4 MB/s | 506 kB 00:00 2024-09-15T22:04:14.922 INFO:teuthology.orchestra.run.smithi165.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 541 kB/s | 45 kB 00:00 2024-09-15T22:04:14.997 INFO:teuthology.orchestra.run.smithi165.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.8 MB/s | 136 kB 00:00 2024-09-15T22:04:15.081 INFO:teuthology.orchestra.run.smithi165.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.9 MB/s | 161 kB 00:00 2024-09-15T22:04:15.156 INFO:teuthology.orchestra.run.smithi165.stdout:(22/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-15T22:04:15.181 INFO:teuthology.orchestra.run.smithi165.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 3.1 MB/s | 320 kB 00:00 2024-09-15T22:04:15.215 INFO:teuthology.orchestra.run.smithi165.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.0 MB/s | 300 kB 00:00 2024-09-15T22:04:15.240 INFO:teuthology.orchestra.run.smithi165.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.7 MB/s | 99 kB 00:00 2024-09-15T22:04:15.266 INFO:teuthology.orchestra.run.smithi165.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:04:15.291 INFO:teuthology.orchestra.run.smithi045.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 3.9 MB/s | 5.4 MB 00:01 2024-09-15T22:04:15.324 INFO:teuthology.orchestra.run.smithi165.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-15T22:04:15.408 INFO:teuthology.orchestra.run.smithi165.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 19 MB/s | 3.1 MB 00:00 2024-09-15T22:04:15.433 INFO:teuthology.orchestra.run.smithi165.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 294 kB/s | 32 kB 00:00 2024-09-15T22:04:15.467 INFO:teuthology.orchestra.run.smithi165.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.4 MB/s | 146 kB 00:00 2024-09-15T22:04:15.525 INFO:teuthology.orchestra.run.smithi045.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 6.5 MB/s | 1.5 MB 00:00 2024-09-15T22:04:15.775 INFO:teuthology.orchestra.run.smithi165.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 10 MB/s | 3.6 MB 00:00 2024-09-15T22:04:15.868 INFO:teuthology.orchestra.run.smithi165.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.7 MB/s | 249 kB 00:00 2024-09-15T22:04:15.993 INFO:teuthology.orchestra.run.smithi165.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 14 MB/s | 7.4 MB 00:00 2024-09-15T22:04:16.018 INFO:teuthology.orchestra.run.smithi165.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 328 kB/s | 49 kB 00:00 2024-09-15T22:04:16.043 INFO:teuthology.orchestra.run.smithi165.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 328 kB/s | 16 kB 00:00 2024-09-15T22:04:16.067 INFO:teuthology.orchestra.run.smithi045.stdout:(6/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 1.7 MB/s | 2.4 MB 00:01 2024-09-15T22:04:16.077 INFO:teuthology.orchestra.run.smithi165.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.8 MB/s | 285 kB 00:00 2024-09-15T22:04:16.119 INFO:teuthology.orchestra.run.smithi165.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 10 MB/s | 765 kB 00:00 2024-09-15T22:04:16.121 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-15T22:04:16.144 INFO:teuthology.orchestra.run.smithi165.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 273 kB/s | 18 kB 00:00 2024-09-15T22:04:16.217 INFO:teuthology.orchestra.run.smithi045.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 6.8 MB/s | 4.7 MB 00:00 2024-09-15T22:04:16.693 INFO:teuthology.orchestra.run.smithi045.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 7.6 MB/s | 21 MB 00:02 2024-09-15T22:04:16.728 INFO:teuthology.orchestra.run.smithi165.stdout:(39/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 18 MB/s | 49 MB 00:02 2024-09-15T22:04:16.743 INFO:teuthology.orchestra.run.smithi045.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 508 kB/s | 25 kB 00:00 2024-09-15T22:04:16.753 INFO:teuthology.orchestra.run.smithi165.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 126 kB/s | 80 kB 00:00 2024-09-15T22:04:16.870 INFO:teuthology.orchestra.run.smithi165.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-15T22:04:16.896 INFO:teuthology.orchestra.run.smithi165.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-15T22:04:16.963 INFO:teuthology.orchestra.run.smithi165.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.2 MB 00:00 2024-09-15T22:04:16.988 INFO:teuthology.orchestra.run.smithi165.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-15T22:04:17.013 INFO:teuthology.orchestra.run.smithi165.stdout:(45/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 976 kB/s | 253 kB 00:00 2024-09-15T22:04:17.040 INFO:teuthology.orchestra.run.smithi165.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.7 MB/s | 135 kB 00:00 2024-09-15T22:04:17.089 INFO:teuthology.orchestra.run.smithi165.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-15T22:04:17.114 INFO:teuthology.orchestra.run.smithi165.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-09-15T22:04:17.176 INFO:teuthology.orchestra.run.smithi045.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 11 MB/s | 11 MB 00:00 2024-09-15T22:04:17.190 INFO:teuthology.orchestra.run.smithi165.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 4.5 MB/s | 689 kB 00:00 2024-09-15T22:04:17.215 INFO:teuthology.orchestra.run.smithi165.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-15T22:04:17.226 INFO:teuthology.orchestra.run.smithi045.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 4.5 MB/s | 228 kB 00:00 2024-09-15T22:04:17.248 INFO:teuthology.orchestra.run.smithi165.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-15T22:04:17.277 INFO:teuthology.orchestra.run.smithi045.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 541 kB/s | 27 kB 00:00 2024-09-15T22:04:17.299 INFO:teuthology.orchestra.run.smithi165.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 4.4 MB/s | 943 kB 00:00 2024-09-15T22:04:17.324 INFO:teuthology.orchestra.run.smithi165.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-15T22:04:17.327 INFO:teuthology.orchestra.run.smithi045.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 637 kB/s | 32 kB 00:00 2024-09-15T22:04:17.354 INFO:teuthology.orchestra.run.smithi165.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-09-15T22:04:17.379 INFO:teuthology.orchestra.run.smithi165.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 334 kB/s | 18 kB 00:00 2024-09-15T22:04:17.404 INFO:teuthology.orchestra.run.smithi165.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-15T22:04:17.430 INFO:teuthology.orchestra.run.smithi165.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-15T22:04:17.436 INFO:teuthology.orchestra.run.smithi045.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 6.8 MB/s | 751 kB 00:00 2024-09-15T22:04:17.455 INFO:teuthology.orchestra.run.smithi165.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-09-15T22:04:17.486 INFO:teuthology.orchestra.run.smithi045.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 3.2 MB/s | 163 kB 00:00 2024-09-15T22:04:17.497 INFO:teuthology.orchestra.run.smithi165.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-15T22:04:17.530 INFO:teuthology.orchestra.run.smithi165.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 7.6 MB/s | 581 kB 00:00 2024-09-15T22:04:17.536 INFO:teuthology.orchestra.run.smithi045.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T22:04:17.549 INFO:teuthology.orchestra.run.smithi165.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 490 kB/s | 24 kB 00:00 2024-09-15T22:04:17.564 INFO:teuthology.orchestra.run.smithi165.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-15T22:04:17.590 INFO:teuthology.orchestra.run.smithi165.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2024-09-15T22:04:17.603 INFO:teuthology.orchestra.run.smithi045.stdout:(17/156): libradosstriper1-19.1.1-326.g8921c8ef 7.4 MB/s | 506 kB 00:00 2024-09-15T22:04:17.615 INFO:teuthology.orchestra.run.smithi165.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-15T22:04:17.632 INFO:teuthology.orchestra.run.smithi165.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 914 kB/s | 38 kB 00:00 2024-09-15T22:04:17.691 INFO:teuthology.orchestra.run.smithi165.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.6 MB/s | 3.0 MB 00:00 2024-09-15T22:04:17.783 INFO:teuthology.orchestra.run.smithi165.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-15T22:04:17.841 INFO:teuthology.orchestra.run.smithi165.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-09-15T22:04:17.908 INFO:teuthology.orchestra.run.smithi165.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-15T22:04:17.933 INFO:teuthology.orchestra.run.smithi165.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-15T22:04:17.967 INFO:teuthology.orchestra.run.smithi165.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-15T22:04:18.009 INFO:teuthology.orchestra.run.smithi165.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-15T22:04:18.034 INFO:teuthology.orchestra.run.smithi165.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-15T22:04:18.076 INFO:teuthology.orchestra.run.smithi165.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-15T22:04:18.152 INFO:teuthology.orchestra.run.smithi165.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-09-15T22:04:18.177 INFO:teuthology.orchestra.run.smithi165.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-15T22:04:18.202 INFO:teuthology.orchestra.run.smithi165.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-15T22:04:18.212 INFO:teuthology.orchestra.run.smithi045.stdout:(18/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 8.8 MB/s | 5.3 MB 00:00 2024-09-15T22:04:18.228 INFO:teuthology.orchestra.run.smithi165.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-09-15T22:04:18.253 INFO:teuthology.orchestra.run.smithi165.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-15T22:04:18.262 INFO:teuthology.orchestra.run.smithi045.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 907 kB/s | 45 kB 00:00 2024-09-15T22:04:18.278 INFO:teuthology.orchestra.run.smithi165.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-15T22:04:18.303 INFO:teuthology.orchestra.run.smithi165.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 690 kB/s | 35 kB 00:00 2024-09-15T22:04:18.313 INFO:teuthology.orchestra.run.smithi045.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 2.7 MB/s | 136 kB 00:00 2024-09-15T22:04:18.354 INFO:teuthology.orchestra.run.smithi045.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 3.8 MB/s | 161 kB 00:00 2024-09-15T22:04:18.379 INFO:teuthology.orchestra.run.smithi165.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-15T22:04:18.392 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:04:18.393 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T22:04:18.407 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T22:04:18.408 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T22:04:18.409 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T22:04:18.409 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T22:04:18.412 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T22:04:18.412 INFO:teuthology.orchestra.run.smithi165.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-15T22:04:18.414 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T22:04:18.415 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T22:04:18.421 INFO:teuthology.orchestra.run.smithi045.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 4.7 MB/s | 320 kB 00:00 2024-09-15T22:04:18.438 INFO:teuthology.orchestra.run.smithi165.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-15T22:04:18.463 INFO:teuthology.orchestra.run.smithi165.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-15T22:04:18.472 INFO:teuthology.orchestra.run.smithi045.stdout:(23/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.9 MB/s | 300 kB 00:00 2024-09-15T22:04:18.479 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-09-15T22:04:18.489 INFO:teuthology.orchestra.run.smithi165.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 838 kB/s | 42 kB 00:00 2024-09-15T22:04:18.499 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-15T22:04:18.500 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-09-15T22:04:18.500 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-15T22:04:18.500 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-09-15T22:04:18.500 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T22:04:18.500 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T22:04:18.500 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T22:04:18.500 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T22:04:18.500 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T22:04:18.500 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T22:04:18.500 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T22:04:18.500 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T22:04:18.500 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T22:04:18.501 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T22:04:18.501 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T22:04:18.501 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T22:04:18.501 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T22:04:18.501 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T22:04:18.501 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T22:04:18.501 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T22:04:18.501 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T22:04:18.501 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T22:04:18.501 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T22:04:18.501 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T22:04:18.501 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T22:04:18.502 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T22:04:18.502 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T22:04:18.502 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T22:04:18.502 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T22:04:18.502 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T22:04:18.502 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T22:04:18.502 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T22:04:18.502 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T22:04:18.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T22:04:18.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T22:04:18.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T22:04:18.502 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T22:04:18.503 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-09-15T22:04:18.504 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T22:04:18.504 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T22:04:18.504 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T22:04:18.504 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T22:04:18.504 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T22:04:18.504 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T22:04:18.504 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T22:04:18.504 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T22:04:18.504 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T22:04:18.504 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T22:04:18.504 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T22:04:18.504 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T22:04:18.504 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T22:04:18.505 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T22:04:18.505 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T22:04:18.505 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T22:04:18.505 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T22:04:18.505 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T22:04:18.505 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T22:04:18.505 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T22:04:18.505 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T22:04:18.505 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T22:04:18.505 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T22:04:18.505 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T22:04:18.505 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T22:04:18.505 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T22:04:18.506 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T22:04:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T22:04:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T22:04:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T22:04:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T22:04:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T22:04:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T22:04:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T22:04:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T22:04:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T22:04:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T22:04:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T22:04:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T22:04:18.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T22:04:18.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T22:04:18.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T22:04:18.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T22:04:18.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T22:04:18.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T22:04:18.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T22:04:18.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T22:04:18.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T22:04:18.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T22:04:18.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T22:04:18.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T22:04:18.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T22:04:18.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T22:04:18.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T22:04:18.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T22:04:18.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T22:04:18.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T22:04:18.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T22:04:18.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T22:04:18.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T22:04:18.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T22:04:18.512 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T22:04:18.512 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T22:04:18.512 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T22:04:18.512 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T22:04:18.512 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T22:04:18.512 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T22:04:18.512 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T22:04:18.512 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T22:04:18.512 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T22:04:18.512 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-09-15T22:04:18.512 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T22:04:18.512 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:04:18.512 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-09-15T22:04:18.513 INFO:teuthology.orchestra.run.smithi100.stdout:====================================================================================== 2024-09-15T22:04:18.513 INFO:teuthology.orchestra.run.smithi100.stdout:Install 148 Packages 2024-09-15T22:04:18.513 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 8 Packages 2024-09-15T22:04:18.513 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:04:18.513 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 226 M 2024-09-15T22:04:18.513 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-09-15T22:04:18.522 INFO:teuthology.orchestra.run.smithi165.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-15T22:04:18.522 INFO:teuthology.orchestra.run.smithi045.stdout:(24/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T22:04:18.556 INFO:teuthology.orchestra.run.smithi165.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-09-15T22:04:18.572 INFO:teuthology.orchestra.run.smithi045.stdout:(25/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:04:18.581 INFO:teuthology.orchestra.run.smithi165.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-15T22:04:18.606 INFO:teuthology.orchestra.run.smithi165.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-15T22:04:18.632 INFO:teuthology.orchestra.run.smithi165.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-15T22:04:18.699 INFO:teuthology.orchestra.run.smithi165.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-15T22:04:18.724 INFO:teuthology.orchestra.run.smithi165.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-15T22:04:18.749 INFO:teuthology.orchestra.run.smithi165.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-09-15T22:04:18.782 INFO:teuthology.orchestra.run.smithi165.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-15T22:04:18.799 INFO:teuthology.orchestra.run.smithi165.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-15T22:04:18.817 INFO:teuthology.orchestra.run.smithi165.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-15T22:04:18.823 INFO:teuthology.orchestra.run.smithi045.stdout:(26/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 12 MB/s | 3.1 MB 00:00 2024-09-15T22:04:18.842 INFO:teuthology.orchestra.run.smithi165.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-15T22:04:18.859 INFO:teuthology.orchestra.run.smithi165.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 58 kB 00:00 2024-09-15T22:04:18.865 INFO:teuthology.orchestra.run.smithi045.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 4.0 MB/s | 170 kB 00:00 2024-09-15T22:04:18.884 INFO:teuthology.orchestra.run.smithi165.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-15T22:04:18.901 INFO:teuthology.orchestra.run.smithi165.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-15T22:04:18.915 INFO:teuthology.orchestra.run.smithi045.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 639 kB/s | 32 kB 00:00 2024-09-15T22:04:18.918 INFO:teuthology.orchestra.run.smithi165.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-15T22:04:18.965 INFO:teuthology.orchestra.run.smithi045.stdout:(29/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.9 MB/s | 146 kB 00:00 2024-09-15T22:04:19.010 INFO:teuthology.orchestra.run.smithi165.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-15T22:04:19.219 INFO:teuthology.orchestra.run.smithi165.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-15T22:04:19.241 INFO:teuthology.orchestra.run.smithi045.stdout:(30/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 13 MB/s | 3.6 MB 00:00 2024-09-15T22:04:19.253 INFO:teuthology.orchestra.run.smithi165.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.2 MB/s | 548 kB 00:00 2024-09-15T22:04:19.273 INFO:teuthology.orchestra.run.smithi100.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 55 kB/s | 6.5 kB 00:00 2024-09-15T22:04:19.278 INFO:teuthology.orchestra.run.smithi165.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 844 kB/s | 19 kB 00:00 2024-09-15T22:04:19.328 INFO:teuthology.orchestra.run.smithi165.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-15T22:04:19.362 INFO:teuthology.orchestra.run.smithi165.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-09-15T22:04:19.387 INFO:teuthology.orchestra.run.smithi165.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-09-15T22:04:19.421 INFO:teuthology.orchestra.run.smithi165.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-09-15T22:04:19.454 INFO:teuthology.orchestra.run.smithi165.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 527 kB/s | 49 kB 00:00 2024-09-15T22:04:19.480 INFO:teuthology.orchestra.run.smithi165.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-09-15T22:04:19.523 INFO:teuthology.orchestra.run.smithi100.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 3.5 MB/s | 896 kB 00:00 2024-09-15T22:04:19.555 INFO:teuthology.orchestra.run.smithi165.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-15T22:04:19.572 INFO:teuthology.orchestra.run.smithi165.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-15T22:04:19.581 INFO:teuthology.orchestra.run.smithi100.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 2.4 MB/s | 145 kB 00:00 2024-09-15T22:04:19.606 INFO:teuthology.orchestra.run.smithi165.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-09-15T22:04:19.622 INFO:teuthology.orchestra.run.smithi165.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-15T22:04:19.640 INFO:teuthology.orchestra.run.smithi165.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 420 kB/s | 14 kB 00:00 2024-09-15T22:04:19.673 INFO:teuthology.orchestra.run.smithi165.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-15T22:04:19.724 INFO:teuthology.orchestra.run.smithi165.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-15T22:04:19.748 INFO:teuthology.orchestra.run.smithi100.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 9.1 MB/s | 5.4 MB 00:00 2024-09-15T22:04:19.749 INFO:teuthology.orchestra.run.smithi165.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-15T22:04:19.808 INFO:teuthology.orchestra.run.smithi165.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-09-15T22:04:19.833 INFO:teuthology.orchestra.run.smithi165.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.0 MB/s | 220 kB 00:00 2024-09-15T22:04:19.849 INFO:teuthology.orchestra.run.smithi045.stdout:(31/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 16 MB/s | 49 MB 00:03 2024-09-15T22:04:19.858 INFO:teuthology.orchestra.run.smithi165.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-15T22:04:19.874 INFO:teuthology.orchestra.run.smithi100.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 1.5 MB 00:00 2024-09-15T22:04:19.883 INFO:teuthology.orchestra.run.smithi165.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-15T22:04:19.909 INFO:teuthology.orchestra.run.smithi165.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-15T22:04:19.934 INFO:teuthology.orchestra.run.smithi165.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-15T22:04:19.958 INFO:teuthology.orchestra.run.smithi045.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.3 MB/s | 249 kB 00:00 2024-09-15T22:04:19.959 INFO:teuthology.orchestra.run.smithi165.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-15T22:04:19.985 INFO:teuthology.orchestra.run.smithi165.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-15T22:04:20.008 INFO:teuthology.orchestra.run.smithi100.stdout:(6/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 5.6 MB/s | 2.4 MB 00:00 2024-09-15T22:04:20.010 INFO:teuthology.orchestra.run.smithi165.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T22:04:20.025 INFO:teuthology.orchestra.run.smithi045.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 743 kB/s | 49 kB 00:00 2024-09-15T22:04:20.052 INFO:teuthology.orchestra.run.smithi165.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-09-15T22:04:20.086 INFO:teuthology.orchestra.run.smithi165.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-15T22:04:20.109 INFO:teuthology.orchestra.run.smithi045.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 197 kB/s | 16 kB 00:00 2024-09-15T22:04:20.111 INFO:teuthology.orchestra.run.smithi165.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 984 kB/s | 58 kB 00:00 2024-09-15T22:04:20.153 INFO:teuthology.orchestra.run.smithi165.stdout:(133/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.0 MB/s | 2.0 MB 00:00 2024-09-15T22:04:20.178 INFO:teuthology.orchestra.run.smithi165.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 244 kB/s | 16 kB 00:00 2024-09-15T22:04:20.220 INFO:teuthology.orchestra.run.smithi165.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-15T22:04:20.242 INFO:teuthology.orchestra.run.smithi045.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 7.4 MB/s | 7.4 MB 00:01 2024-09-15T22:04:20.246 INFO:teuthology.orchestra.run.smithi165.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-15T22:04:20.262 INFO:teuthology.orchestra.run.smithi165.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 337 kB/s | 28 kB 00:00 2024-09-15T22:04:20.267 INFO:teuthology.orchestra.run.smithi045.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 1.8 MB/s | 285 kB 00:00 2024-09-15T22:04:20.279 INFO:teuthology.orchestra.run.smithi165.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 524 kB/s | 31 kB 00:00 2024-09-15T22:04:20.296 INFO:teuthology.orchestra.run.smithi165.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-15T22:04:20.310 INFO:teuthology.orchestra.run.smithi045.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 439 kB/s | 18 kB 00:00 2024-09-15T22:04:20.316 INFO:teuthology.orchestra.run.smithi165.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-09-15T22:04:20.339 INFO:teuthology.orchestra.run.smithi165.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-15T22:04:20.349 INFO:teuthology.orchestra.run.smithi100.stdout:(7/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 18 MB/s | 21 MB 00:01 2024-09-15T22:04:20.352 INFO:teuthology.orchestra.run.smithi045.stdout:(38/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 6.9 MB/s | 765 kB 00:00 2024-09-15T22:04:20.364 INFO:teuthology.orchestra.run.smithi165.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-15T22:04:20.389 INFO:teuthology.orchestra.run.smithi165.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-15T22:04:20.414 INFO:teuthology.orchestra.run.smithi165.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-15T22:04:20.417 INFO:teuthology.orchestra.run.smithi100.stdout:(8/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 8.7 MB/s | 4.7 MB 00:00 2024-09-15T22:04:20.432 INFO:teuthology.orchestra.run.smithi165.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 476 kB/s | 20 kB 00:00 2024-09-15T22:04:20.457 INFO:teuthology.orchestra.run.smithi165.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.4 MB/s | 191 kB 00:00 2024-09-15T22:04:20.475 INFO:teuthology.orchestra.run.smithi100.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 434 kB/s | 25 kB 00:00 2024-09-15T22:04:20.482 INFO:teuthology.orchestra.run.smithi165.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-15T22:04:20.582 INFO:teuthology.orchestra.run.smithi165.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-15T22:04:20.585 INFO:teuthology.orchestra.run.smithi045.stdout:(39/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 3.7 MB/s | 17 MB 00:04 2024-09-15T22:04:20.619 INFO:teuthology.orchestra.run.smithi045.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 258 kB/s | 80 kB 00:00 2024-09-15T22:04:20.719 INFO:teuthology.orchestra.run.smithi045.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-15T22:04:20.769 INFO:teuthology.orchestra.run.smithi045.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-15T22:04:20.783 INFO:teuthology.orchestra.run.smithi100.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 24 MB/s | 11 MB 00:00 2024-09-15T22:04:20.803 INFO:teuthology.orchestra.run.smithi045.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 801 kB 00:00 2024-09-15T22:04:20.853 INFO:teuthology.orchestra.run.smithi045.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-09-15T22:04:20.858 INFO:teuthology.orchestra.run.smithi100.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.0 MB/s | 228 kB 00:00 2024-09-15T22:04:20.879 INFO:teuthology.orchestra.run.smithi045.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 977 kB/s | 106 kB 00:00 2024-09-15T22:04:20.904 INFO:teuthology.orchestra.run.smithi045.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-09-15T22:04:20.907 INFO:teuthology.orchestra.run.smithi165.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 7.6 MB/s | 3.4 MB 00:00 2024-09-15T22:04:20.917 INFO:teuthology.orchestra.run.smithi100.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 464 kB/s | 27 kB 00:00 2024-09-15T22:04:20.937 INFO:teuthology.orchestra.run.smithi045.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-15T22:04:20.976 INFO:teuthology.orchestra.run.smithi100.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 543 kB/s | 32 kB 00:00 2024-09-15T22:04:20.988 INFO:teuthology.orchestra.run.smithi045.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-15T22:04:21.135 INFO:teuthology.orchestra.run.smithi100.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 4.6 MB/s | 751 kB 00:00 2024-09-15T22:04:21.163 INFO:teuthology.orchestra.run.smithi045.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 611 kB/s | 107 kB 00:00 2024-09-15T22:04:21.189 INFO:teuthology.orchestra.run.smithi045.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-15T22:04:21.202 INFO:teuthology.orchestra.run.smithi100.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.4 MB/s | 163 kB 00:00 2024-09-15T22:04:21.213 INFO:teuthology.orchestra.run.smithi045.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-15T22:04:21.247 INFO:teuthology.orchestra.run.smithi045.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-15T22:04:21.273 INFO:teuthology.orchestra.run.smithi045.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 556 kB/s | 33 kB 00:00 2024-09-15T22:04:21.285 INFO:teuthology.orchestra.run.smithi100.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 1.5 MB/s | 127 kB 00:00 2024-09-15T22:04:21.306 INFO:teuthology.orchestra.run.smithi045.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 2.5 MB/s | 943 kB 00:00 2024-09-15T22:04:21.324 INFO:teuthology.orchestra.run.smithi165.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 3.1 MB/s | 2.3 MB 00:00 2024-09-15T22:04:21.331 INFO:teuthology.orchestra.run.smithi045.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-15T22:04:21.357 INFO:teuthology.orchestra.run.smithi045.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-15T22:04:21.392 INFO:teuthology.orchestra.run.smithi165.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 3.7 MB/s | 1.8 MB 00:00 2024-09-15T22:04:21.407 INFO:teuthology.orchestra.run.smithi045.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-09-15T22:04:21.408 INFO:teuthology.orchestra.run.smithi165.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 487 kB/s | 41 kB 00:00 2024-09-15T22:04:21.432 INFO:teuthology.orchestra.run.smithi045.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-15T22:04:21.475 INFO:teuthology.orchestra.run.smithi165.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.9 MB/s | 249 kB 00:00 2024-09-15T22:04:21.486 INFO:teuthology.orchestra.run.smithi100.stdout:(17/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 11 MB/s | 17 MB 00:01 2024-09-15T22:04:21.511 INFO:teuthology.orchestra.run.smithi100.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 2.2 MB/s | 506 kB 00:00 2024-09-15T22:04:21.524 INFO:teuthology.orchestra.run.smithi045.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-15T22:04:21.550 INFO:teuthology.orchestra.run.smithi045.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-09-15T22:04:21.553 INFO:teuthology.orchestra.run.smithi100.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 1.1 MB/s | 45 kB 00:00 2024-09-15T22:04:21.575 INFO:teuthology.orchestra.run.smithi045.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 486 kB/s | 24 kB 00:00 2024-09-15T22:04:21.600 INFO:teuthology.orchestra.run.smithi045.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 937 kB/s | 47 kB 00:00 2024-09-15T22:04:21.645 INFO:teuthology.orchestra.run.smithi100.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.5 MB/s | 136 kB 00:00 2024-09-15T22:04:21.659 INFO:teuthology.orchestra.run.smithi045.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-15T22:04:21.667 INFO:teuthology.orchestra.run.smithi165.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 5.2 MB/s | 1.4 MB 00:00 2024-09-15T22:04:21.701 INFO:teuthology.orchestra.run.smithi045.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 926 kB/s | 38 kB 00:00 2024-09-15T22:04:21.729 INFO:teuthology.orchestra.run.smithi100.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.9 MB/s | 161 kB 00:00 2024-09-15T22:04:21.743 INFO:teuthology.orchestra.run.smithi045.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-09-15T22:04:21.809 INFO:teuthology.orchestra.run.smithi165.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.2 MB/s | 2.4 MB 00:00 2024-09-15T22:04:21.820 INFO:teuthology.orchestra.run.smithi100.stdout:(22/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-15T22:04:21.846 INFO:teuthology.orchestra.run.smithi100.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 2.7 MB/s | 320 kB 00:00 2024-09-15T22:04:21.859 INFO:teuthology.orchestra.run.smithi165.stdout:(156/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 2.3 MB/s | 3.2 MB 00:01 2024-09-15T22:04:21.865 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:04:21.865 INFO:teuthology.orchestra.run.smithi165.stdout:Total 23 MB/s | 226 MB 00:09 2024-09-15T22:04:21.879 INFO:teuthology.orchestra.run.smithi100.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.0 MB/s | 300 kB 00:00 2024-09-15T22:04:21.905 INFO:teuthology.orchestra.run.smithi100.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.7 MB/s | 99 kB 00:00 2024-09-15T22:04:21.930 INFO:teuthology.orchestra.run.smithi100.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T22:04:22.005 INFO:teuthology.orchestra.run.smithi100.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.2 MB/s | 170 kB 00:00 2024-09-15T22:04:22.064 INFO:teuthology.orchestra.run.smithi100.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-15T22:04:22.089 INFO:teuthology.orchestra.run.smithi100.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 382 kB/s | 32 kB 00:00 2024-09-15T22:04:22.114 INFO:teuthology.orchestra.run.smithi100.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.8 MB/s | 146 kB 00:00 2024-09-15T22:04:22.365 INFO:teuthology.orchestra.run.smithi100.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 13 MB/s | 3.6 MB 00:00 2024-09-15T22:04:22.452 INFO:teuthology.orchestra.run.smithi045.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 6.6 MB/s | 4.9 MB 00:00 2024-09-15T22:04:22.510 INFO:teuthology.orchestra.run.smithi045.stdout:(67/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.4 MB/s | 3.0 MB 00:01 2024-09-15T22:04:22.552 INFO:teuthology.orchestra.run.smithi045.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-15T22:04:22.619 INFO:teuthology.orchestra.run.smithi045.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-15T22:04:22.753 INFO:teuthology.orchestra.run.smithi045.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 3.7 MB/s | 910 kB 00:00 2024-09-15T22:04:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:(32/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 21 MB/s | 49 MB 00:02 2024-09-15T22:04:22.828 INFO:teuthology.orchestra.run.smithi045.stdout:(71/156): postgresql-server-13.16-1.el9.x86_64. 28 MB/s | 5.8 MB 00:00 2024-09-15T22:04:22.878 INFO:teuthology.orchestra.run.smithi045.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-15T22:04:22.901 INFO:teuthology.orchestra.run.smithi100.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 9.4 MB/s | 7.4 MB 00:00 2024-09-15T22:04:22.918 INFO:teuthology.orchestra.run.smithi100.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 455 kB/s | 49 kB 00:00 2024-09-15T22:04:22.943 INFO:teuthology.orchestra.run.smithi100.stdout:(35/156): ceph-mgr-modules-core-19.1.1-326.g892 432 kB/s | 249 kB 00:00 2024-09-15T22:04:22.960 INFO:teuthology.orchestra.run.smithi100.stdout:(36/156): ceph-prometheus-alerts-19.1.1-326.g89 280 kB/s | 16 kB 00:00 2024-09-15T22:04:22.985 INFO:teuthology.orchestra.run.smithi100.stdout:(37/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.2 MB/s | 285 kB 00:00 2024-09-15T22:04:23.002 INFO:teuthology.orchestra.run.smithi100.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 436 kB/s | 18 kB 00:00 2024-09-15T22:04:23.036 INFO:teuthology.orchestra.run.smithi100.stdout:(39/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 8.1 MB/s | 765 kB 00:00 2024-09-15T22:04:23.054 INFO:teuthology.orchestra.run.smithi045.stdout:(73/156): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-09-15T22:04:23.087 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2024-09-15T22:04:23.104 INFO:teuthology.orchestra.run.smithi045.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-15T22:04:23.111 INFO:teuthology.orchestra.run.smithi100.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 636 kB/s | 80 kB 00:00 2024-09-15T22:04:23.163 INFO:teuthology.orchestra.run.smithi045.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-15T22:04:23.172 INFO:teuthology.orchestra.run.smithi100.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-15T22:04:23.195 INFO:teuthology.orchestra.run.smithi100.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-15T22:04:23.220 INFO:teuthology.orchestra.run.smithi100.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-15T22:04:23.221 INFO:teuthology.orchestra.run.smithi045.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-15T22:04:23.243 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2024-09-15T22:04:23.243 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2024-09-15T22:04:23.245 INFO:teuthology.orchestra.run.smithi100.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-15T22:04:23.262 INFO:teuthology.orchestra.run.smithi100.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-15T22:04:23.271 INFO:teuthology.orchestra.run.smithi045.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-15T22:04:23.287 INFO:teuthology.orchestra.run.smithi100.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-15T22:04:23.297 INFO:teuthology.orchestra.run.smithi045.stdout:(78/156): protobuf-3.14.0-13.el9.x86_64.rpm 1.9 MB/s | 1.0 MB 00:00 2024-09-15T22:04:23.313 INFO:teuthology.orchestra.run.smithi100.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-15T22:04:23.322 INFO:teuthology.orchestra.run.smithi045.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-15T22:04:23.355 INFO:teuthology.orchestra.run.smithi100.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 6.6 MB/s | 1.2 MB 00:00 2024-09-15T22:04:23.372 INFO:teuthology.orchestra.run.smithi045.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-15T22:04:23.406 INFO:teuthology.orchestra.run.smithi045.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-15T22:04:23.480 INFO:teuthology.orchestra.run.smithi100.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 855 kB/s | 107 kB 00:00 2024-09-15T22:04:23.514 INFO:teuthology.orchestra.run.smithi100.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-15T22:04:23.523 INFO:teuthology.orchestra.run.smithi045.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 5.1 MB 00:00 2024-09-15T22:04:23.539 INFO:teuthology.orchestra.run.smithi100.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 371 kB/s | 22 kB 00:00 2024-09-15T22:04:23.548 INFO:teuthology.orchestra.run.smithi045.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-09-15T22:04:23.564 INFO:teuthology.orchestra.run.smithi100.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-15T22:04:23.582 INFO:teuthology.orchestra.run.smithi045.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-15T22:04:23.589 INFO:teuthology.orchestra.run.smithi100.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-09-15T22:04:23.632 INFO:teuthology.orchestra.run.smithi045.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 924 kB/s | 77 kB 00:00 2024-09-15T22:04:23.639 INFO:teuthology.orchestra.run.smithi100.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-15T22:04:23.665 INFO:teuthology.orchestra.run.smithi100.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-15T22:04:23.690 INFO:teuthology.orchestra.run.smithi100.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-15T22:04:23.691 INFO:teuthology.orchestra.run.smithi045.stdout:(86/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 4.4 MB 00:01 2024-09-15T22:04:23.707 INFO:teuthology.orchestra.run.smithi100.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 160 kB 00:00 2024-09-15T22:04:23.716 INFO:teuthology.orchestra.run.smithi045.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 316 kB/s | 42 kB 00:00 2024-09-15T22:04:23.732 INFO:teuthology.orchestra.run.smithi100.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-15T22:04:23.774 INFO:teuthology.orchestra.run.smithi100.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-15T22:04:23.775 INFO:teuthology.orchestra.run.smithi045.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-15T22:04:23.809 INFO:teuthology.orchestra.run.smithi045.stdout:(89/156): python3-protobuf-3.14.0-13.el9.noarch 1.5 MB/s | 269 kB 00:00 2024-09-15T22:04:23.833 INFO:teuthology.orchestra.run.smithi100.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-15T22:04:23.834 INFO:teuthology.orchestra.run.smithi045.stdout:(90/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-15T22:04:23.858 INFO:teuthology.orchestra.run.smithi100.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-15T22:04:23.859 INFO:teuthology.orchestra.run.smithi045.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 607 kB/s | 51 kB 00:00 2024-09-15T22:04:23.883 INFO:teuthology.orchestra.run.smithi100.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-15T22:04:23.884 INFO:teuthology.orchestra.run.smithi045.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-09-15T22:04:23.909 INFO:teuthology.orchestra.run.smithi100.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-15T22:04:23.910 INFO:teuthology.orchestra.run.smithi045.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-09-15T22:04:23.934 INFO:teuthology.orchestra.run.smithi100.stdout:(64/156): libtool-2.4.6-46.el9.x86_64.rpm 2.8 MB/s | 581 kB 00:00 2024-09-15T22:04:23.935 INFO:teuthology.orchestra.run.smithi045.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 877 kB/s | 44 kB 00:00 2024-09-15T22:04:23.959 INFO:teuthology.orchestra.run.smithi100.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-15T22:04:23.969 INFO:teuthology.orchestra.run.smithi045.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-15T22:04:23.985 INFO:teuthology.orchestra.run.smithi100.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-15T22:04:23.994 INFO:teuthology.orchestra.run.smithi045.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 613 kB/s | 36 kB 00:00 2024-09-15T22:04:24.019 INFO:teuthology.orchestra.run.smithi045.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-15T22:04:24.052 INFO:teuthology.orchestra.run.smithi100.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-15T22:04:24.097 INFO:teuthology.orchestra.run.smithi045.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 743 kB/s | 58 kB 00:00 2024-09-15T22:04:24.110 INFO:teuthology.orchestra.run.smithi100.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2024-09-15T22:04:24.153 INFO:teuthology.orchestra.run.smithi045.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.7 MB/s | 96 kB 00:00 2024-09-15T22:04:24.177 INFO:teuthology.orchestra.run.smithi100.stdout:(69/156): openblas-openmp-0.3.26-2.el9.x86_64.r 20 MB/s | 4.9 MB 00:00 2024-09-15T22:04:24.179 INFO:teuthology.orchestra.run.smithi045.stdout:(100/156): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-15T22:04:24.203 INFO:teuthology.orchestra.run.smithi100.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-15T22:04:24.204 INFO:teuthology.orchestra.run.smithi045.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-15T22:04:24.229 INFO:teuthology.orchestra.run.smithi045.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-15T22:04:24.236 INFO:teuthology.orchestra.run.smithi100.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-15T22:04:24.278 INFO:teuthology.orchestra.run.smithi100.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-15T22:04:24.303 INFO:teuthology.orchestra.run.smithi100.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-15T22:04:24.312 INFO:teuthology.orchestra.run.smithi045.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-15T22:04:24.337 INFO:teuthology.orchestra.run.smithi100.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-15T22:04:24.380 INFO:teuthology.orchestra.run.smithi045.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.0 MB/s | 548 kB 00:00 2024-09-15T22:04:24.405 INFO:teuthology.orchestra.run.smithi045.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-09-15T22:04:24.412 INFO:teuthology.orchestra.run.smithi100.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-15T22:04:24.438 INFO:teuthology.orchestra.run.smithi100.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-15T22:04:24.438 INFO:teuthology.orchestra.run.smithi045.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 5.1 MB/s | 308 kB 00:00 2024-09-15T22:04:24.455 INFO:teuthology.orchestra.run.smithi045.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 389 kB/s | 19 kB 00:00 2024-09-15T22:04:24.463 INFO:teuthology.orchestra.run.smithi100.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-15T22:04:24.480 INFO:teuthology.orchestra.run.smithi100.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 612 kB/s | 26 kB 00:00 2024-09-15T22:04:24.481 INFO:teuthology.orchestra.run.smithi045.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-15T22:04:24.497 INFO:teuthology.orchestra.run.smithi100.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 571 kB/s | 19 kB 00:00 2024-09-15T22:04:24.506 INFO:teuthology.orchestra.run.smithi045.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-15T22:04:24.523 INFO:teuthology.orchestra.run.smithi100.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-15T22:04:24.541 INFO:teuthology.orchestra.run.smithi045.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-15T22:04:24.541 INFO:teuthology.orchestra.run.smithi100.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 830 kB/s | 35 kB 00:00 2024-09-15T22:04:24.573 INFO:teuthology.orchestra.run.smithi045.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-15T22:04:24.614 INFO:teuthology.orchestra.run.smithi100.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-15T22:04:24.639 INFO:teuthology.orchestra.run.smithi100.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-15T22:04:24.665 INFO:teuthology.orchestra.run.smithi100.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-15T22:04:24.674 INFO:teuthology.orchestra.run.smithi045.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-15T22:04:24.690 INFO:teuthology.orchestra.run.smithi100.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-15T22:04:24.715 INFO:teuthology.orchestra.run.smithi100.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 42 kB 00:00 2024-09-15T22:04:24.741 INFO:teuthology.orchestra.run.smithi100.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-15T22:04:24.741 INFO:teuthology.orchestra.run.smithi045.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-15T22:04:24.766 INFO:teuthology.orchestra.run.smithi100.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-15T22:04:24.766 INFO:teuthology.orchestra.run.smithi045.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T22:04:24.791 INFO:teuthology.orchestra.run.smithi100.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-15T22:04:24.792 INFO:teuthology.orchestra.run.smithi045.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-15T22:04:24.816 INFO:teuthology.orchestra.run.smithi100.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-15T22:04:24.817 INFO:teuthology.orchestra.run.smithi045.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 562 kB/s | 14 kB 00:00 2024-09-15T22:04:24.842 INFO:teuthology.orchestra.run.smithi100.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-15T22:04:24.842 INFO:teuthology.orchestra.run.smithi045.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-15T22:04:24.901 INFO:teuthology.orchestra.run.smithi045.stdout:(118/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.6 MB/s | 4.4 MB 00:00 2024-09-15T22:04:24.925 INFO:teuthology.orchestra.run.smithi100.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-15T22:04:24.934 INFO:teuthology.orchestra.run.smithi045.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-15T22:04:24.950 INFO:teuthology.orchestra.run.smithi100.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-15T22:04:24.959 INFO:teuthology.orchestra.run.smithi045.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-15T22:04:24.976 INFO:teuthology.orchestra.run.smithi100.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-15T22:04:24.985 INFO:teuthology.orchestra.run.smithi045.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-15T22:04:25.001 INFO:teuthology.orchestra.run.smithi100.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-15T22:04:25.019 INFO:teuthology.orchestra.run.smithi045.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-15T22:04:25.026 INFO:teuthology.orchestra.run.smithi100.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-15T22:04:25.044 INFO:teuthology.orchestra.run.smithi045.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 425 kB/s | 11 kB 00:00 2024-09-15T22:04:25.051 INFO:teuthology.orchestra.run.smithi100.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-15T22:04:25.064 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2024-09-15T22:04:25.064 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2024-09-15T22:04:25.069 INFO:teuthology.orchestra.run.smithi045.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 709 kB/s | 18 kB 00:00 2024-09-15T22:04:25.077 INFO:teuthology.orchestra.run.smithi100.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-15T22:04:25.095 INFO:teuthology.orchestra.run.smithi045.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-15T22:04:25.102 INFO:teuthology.orchestra.run.smithi100.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-15T22:04:25.120 INFO:teuthology.orchestra.run.smithi045.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 776 kB/s | 19 kB 00:00 2024-09-15T22:04:25.136 INFO:teuthology.orchestra.run.smithi100.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-15T22:04:25.145 INFO:teuthology.orchestra.run.smithi045.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 790 kB/s | 20 kB 00:00 2024-09-15T22:04:25.161 INFO:teuthology.orchestra.run.smithi100.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-15T22:04:25.187 INFO:teuthology.orchestra.run.smithi100.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-15T22:04:25.204 INFO:teuthology.orchestra.run.smithi045.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-15T22:04:25.229 INFO:teuthology.orchestra.run.smithi045.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T22:04:25.255 INFO:teuthology.orchestra.run.smithi045.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-15T22:04:25.280 INFO:teuthology.orchestra.run.smithi045.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T22:04:25.314 INFO:teuthology.orchestra.run.smithi045.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-15T22:04:25.339 INFO:teuthology.orchestra.run.smithi045.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-15T22:04:25.364 INFO:teuthology.orchestra.run.smithi045.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-15T22:04:25.389 INFO:teuthology.orchestra.run.smithi045.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-15T22:04:25.404 INFO:teuthology.orchestra.run.smithi100.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-15T22:04:25.406 INFO:teuthology.orchestra.run.smithi045.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-15T22:04:25.429 INFO:teuthology.orchestra.run.smithi100.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-09-15T22:04:25.432 INFO:teuthology.orchestra.run.smithi045.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 732 kB/s | 31 kB 00:00 2024-09-15T22:04:25.457 INFO:teuthology.orchestra.run.smithi045.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-15T22:04:25.483 INFO:teuthology.orchestra.run.smithi045.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-15T22:04:25.487 INFO:teuthology.orchestra.run.smithi100.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-15T22:04:25.507 INFO:teuthology.orchestra.run.smithi045.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-15T22:04:25.512 INFO:teuthology.orchestra.run.smithi100.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 784 kB/s | 19 kB 00:00 2024-09-15T22:04:25.533 INFO:teuthology.orchestra.run.smithi045.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-15T22:04:25.538 INFO:teuthology.orchestra.run.smithi100.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.8 MB/s | 308 kB 00:00 2024-09-15T22:04:25.558 INFO:teuthology.orchestra.run.smithi045.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-15T22:04:25.563 INFO:teuthology.orchestra.run.smithi100.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-15T22:04:25.584 INFO:teuthology.orchestra.run.smithi045.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-15T22:04:25.588 INFO:teuthology.orchestra.run.smithi100.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-15T22:04:25.609 INFO:teuthology.orchestra.run.smithi045.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 797 kB/s | 20 kB 00:00 2024-09-15T22:04:25.614 INFO:teuthology.orchestra.run.smithi100.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-15T22:04:25.634 INFO:teuthology.orchestra.run.smithi045.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-15T22:04:25.647 INFO:teuthology.orchestra.run.smithi100.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-15T22:04:25.659 INFO:teuthology.orchestra.run.smithi045.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-15T22:04:25.731 INFO:teuthology.orchestra.run.smithi100.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-15T22:04:25.760 INFO:teuthology.orchestra.run.smithi045.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-15T22:04:25.764 INFO:teuthology.orchestra.run.smithi100.stdout:(113/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.5 MB/s | 863 kB 00:00 2024-09-15T22:04:25.815 INFO:teuthology.orchestra.run.smithi100.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-15T22:04:25.840 INFO:teuthology.orchestra.run.smithi100.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 577 kB/s | 43 kB 00:00 2024-09-15T22:04:25.865 INFO:teuthology.orchestra.run.smithi100.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 645 kB/s | 32 kB 00:00 2024-09-15T22:04:25.890 INFO:teuthology.orchestra.run.smithi100.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-15T22:04:25.916 INFO:teuthology.orchestra.run.smithi100.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-15T22:04:25.983 INFO:teuthology.orchestra.run.smithi100.stdout:(119/156): libarrow-9.0.0-11.el9.x86_64.rpm 9.4 MB/s | 4.4 MB 00:00 2024-09-15T22:04:26.009 INFO:teuthology.orchestra.run.smithi100.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-15T22:04:26.033 INFO:teuthology.orchestra.run.smithi100.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-09-15T22:04:26.058 INFO:teuthology.orchestra.run.smithi100.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-15T22:04:26.084 INFO:teuthology.orchestra.run.smithi100.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-15T22:04:26.085 INFO:teuthology.orchestra.run.smithi045.stdout:(148/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 9.7 MB/s | 3.2 MB 00:00 2024-09-15T22:04:26.109 INFO:teuthology.orchestra.run.smithi100.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-15T22:04:26.134 INFO:teuthology.orchestra.run.smithi100.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-15T22:04:26.160 INFO:teuthology.orchestra.run.smithi100.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-15T22:04:26.235 INFO:teuthology.orchestra.run.smithi100.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-09-15T22:04:26.244 INFO:teuthology.orchestra.run.smithi045.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 5.9 MB/s | 3.4 MB 00:00 2024-09-15T22:04:26.252 INFO:teuthology.orchestra.run.smithi100.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-09-15T22:04:26.277 INFO:teuthology.orchestra.run.smithi100.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T22:04:26.311 INFO:teuthology.orchestra.run.smithi100.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-15T22:04:26.337 INFO:teuthology.orchestra.run.smithi100.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T22:04:26.370 INFO:teuthology.orchestra.run.smithi100.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-15T22:04:26.419 INFO:teuthology.orchestra.run.smithi045.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 10 MB/s | 1.8 MB 00:00 2024-09-15T22:04:26.420 INFO:teuthology.orchestra.run.smithi100.stdout:(133/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.9 MB/s | 2.0 MB 00:00 2024-09-15T22:04:26.446 INFO:teuthology.orchestra.run.smithi100.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-09-15T22:04:26.471 INFO:teuthology.orchestra.run.smithi100.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-15T22:04:26.478 INFO:teuthology.orchestra.run.smithi045.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 5.9 MB/s | 2.3 MB 00:00 2024-09-15T22:04:26.496 INFO:teuthology.orchestra.run.smithi100.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-15T22:04:26.503 INFO:teuthology.orchestra.run.smithi045.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 489 kB/s | 41 kB 00:00 2024-09-15T22:04:26.521 INFO:teuthology.orchestra.run.smithi100.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-09-15T22:04:26.547 INFO:teuthology.orchestra.run.smithi100.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-15T22:04:26.562 INFO:teuthology.orchestra.run.smithi045.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 2.9 MB/s | 249 kB 00:00 2024-09-15T22:04:26.572 INFO:teuthology.orchestra.run.smithi100.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-15T22:04:26.597 INFO:teuthology.orchestra.run.smithi100.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-15T22:04:26.637 INFO:teuthology.orchestra.run.smithi045.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 10 MB/s | 1.4 MB 00:00 2024-09-15T22:04:26.650 INFO:teuthology.orchestra.run.smithi100.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-15T22:04:26.673 INFO:teuthology.orchestra.run.smithi100.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 742 kB/s | 74 kB 00:00 2024-09-15T22:04:26.698 INFO:teuthology.orchestra.run.smithi100.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.9 MB/s | 90 kB 00:00 2024-09-15T22:04:26.723 INFO:teuthology.orchestra.run.smithi100.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-15T22:04:26.748 INFO:teuthology.orchestra.run.smithi100.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-15T22:04:26.774 INFO:teuthology.orchestra.run.smithi100.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T22:04:26.787 INFO:teuthology.orchestra.run.smithi045.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-15T22:04:26.799 INFO:teuthology.orchestra.run.smithi100.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-15T22:04:26.900 INFO:teuthology.orchestra.run.smithi100.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-15T22:04:27.041 INFO:teuthology.orchestra.run.smithi100.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-15T22:04:27.108 INFO:teuthology.orchestra.run.smithi100.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-09-15T22:04:27.167 INFO:teuthology.orchestra.run.smithi100.stdout:(151/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 8.6 MB/s | 3.2 MB 00:00 2024-09-15T22:04:27.192 INFO:teuthology.orchestra.run.smithi100.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 488 kB/s | 41 kB 00:00 2024-09-15T22:04:27.234 INFO:teuthology.orchestra.run.smithi100.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 9.4 MB/s | 1.8 MB 00:00 2024-09-15T22:04:27.268 INFO:teuthology.orchestra.run.smithi100.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 18 MB/s | 1.4 MB 00:00 2024-09-15T22:04:27.326 INFO:teuthology.orchestra.run.smithi100.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-09-15T22:04:27.351 INFO:teuthology.orchestra.run.smithi100.stdout:(156/156): NetworkManager-tui-1.49.90-1.el9.x86 1.3 MB/s | 249 kB 00:00 2024-09-15T22:04:27.358 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:04:27.358 INFO:teuthology.orchestra.run.smithi100.stdout:Total 26 MB/s | 226 MB 00:08 2024-09-15T22:04:28.543 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-09-15T22:04:28.693 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-09-15T22:04:28.694 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-09-15T22:04:29.329 INFO:teuthology.orchestra.run.smithi045.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.0 MB/s | 16 MB 00:05 2024-09-15T22:04:29.334 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:04:29.334 INFO:teuthology.orchestra.run.smithi045.stdout:Total 14 MB/s | 226 MB 00:16 2024-09-15T22:04:30.489 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-09-15T22:04:30.490 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-09-15T22:04:30.604 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-09-15T22:04:30.772 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-09-15T22:04:30.772 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-09-15T22:04:31.370 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2024-09-15T22:04:31.471 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:04:31.509 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:04:31.571 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:04:31.614 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:04:31.639 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:04:31.682 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:04:32.060 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:04:32.166 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:04:32.289 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:04:32.317 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:04:32.409 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:04:32.438 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:04:32.593 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:04:32.652 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:04:32.680 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:04:32.784 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:04:32.806 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:04:32.869 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:04:32.890 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:04:32.910 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:04:33.059 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:04:33.073 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-09-15T22:04:33.073 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-09-15T22:04:33.188 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:04:33.306 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:04:33.401 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:04:33.491 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:04:33.709 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:04:33.813 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:04:33.908 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:04:33.946 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:04:33.981 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:04:34.046 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:04:34.091 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:04:34.131 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:04:34.175 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:04:34.207 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:04:34.235 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:04:34.333 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:04:34.392 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:04:34.430 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:04:34.478 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:04:34.556 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:04:34.589 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:04:34.641 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:04:34.677 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:04:34.749 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:04:34.793 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:04:34.868 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:04:35.004 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:04:35.054 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:04:35.593 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:04:35.674 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:04:35.703 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:04:35.750 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:04:35.784 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:04:35.826 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:04:35.973 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:04:36.029 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:04:36.092 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:04:36.173 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:04:36.205 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:04:36.241 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:04:36.297 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:04:36.332 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:04:36.373 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:04:36.415 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:04:36.561 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:04:36.609 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:04:36.651 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:04:36.754 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:04:36.793 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:04:36.820 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-09-15T22:04:36.832 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:04:36.858 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:04:36.883 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:04:36.930 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:04:36.958 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:04:37.052 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:04:37.085 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:04:37.116 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:04:37.144 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:04:37.165 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:04:37.186 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:04:37.215 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:04:37.240 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:04:37.284 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:04:37.300 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:04:37.366 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:04:37.396 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:04:37.430 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:04:37.464 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:04:37.506 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:04:37.540 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:04:37.612 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:04:37.627 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:04:37.670 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:04:37.710 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:04:37.724 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:04:37.822 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:04:37.836 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:04:37.867 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:04:37.877 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:04:37.957 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:04:37.988 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:04:38.132 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:04:38.184 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:04:38.204 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:04:38.307 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:04:38.330 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:04:38.392 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:04:38.415 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:04:38.435 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:04:38.603 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:04:38.633 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:04:38.650 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:04:38.684 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:04:38.775 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:04:38.782 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:04:38.839 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:04:38.880 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:04:38.892 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:04:38.979 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:04:38.988 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:04:39.020 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:04:39.056 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:04:39.205 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:04:39.235 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:04:39.276 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:04:39.312 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:04:39.391 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:04:39.483 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:04:39.511 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:04:39.555 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:04:39.628 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:04:39.681 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:04:39.716 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:04:39.760 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:04:39.773 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-09-15T22:04:39.792 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:04:39.820 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:04:39.888 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:04:39.900 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T22:04:39.939 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T22:04:39.942 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:04:39.958 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:04:39.972 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:04:40.008 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:04:40.076 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:04:40.085 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:04:40.118 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T22:04:40.119 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:04:40.160 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T22:04:40.163 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:04:40.185 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T22:04:40.199 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:04:40.237 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T22:04:40.268 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:04:40.313 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:04:40.386 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:04:40.529 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:04:40.582 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:04:40.592 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T22:04:40.699 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:04:40.816 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:04:40.842 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:04:40.934 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:04:40.964 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:04:41.091 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:04:41.132 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T22:04:41.169 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:04:41.177 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T22:04:41.199 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:04:41.213 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:04:41.250 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:04:41.288 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:04:41.315 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:04:41.319 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:04:41.329 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:04:41.356 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:04:41.398 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:04:41.420 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T22:04:41.426 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:04:41.457 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:04:41.459 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:04:41.483 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T22:04:41.485 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:04:41.549 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:04:41.604 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:04:41.635 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:04:41.679 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:04:41.720 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:04:41.756 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:04:41.770 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:04:41.802 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:04:41.812 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T22:04:41.833 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:04:41.838 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:04:41.881 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:04:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T22:04:41.930 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:04:41.932 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:04:41.961 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:04:41.997 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:04:42.016 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:04:42.066 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:04:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:04:42.192 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:04:42.234 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:04:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T22:04:42.335 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:04:42.367 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:04:42.408 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:04:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T22:04:42.433 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:04:42.457 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:04:42.482 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:04:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T22:04:42.532 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:04:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T22:04:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T22:04:42.658 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:04:42.674 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T22:04:42.690 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:04:42.718 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:04:42.725 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T22:04:42.752 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:04:42.765 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T22:04:42.791 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:04:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T22:04:42.823 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:04:42.850 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T22:04:42.853 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:04:42.885 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T22:04:42.887 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:04:42.892 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:04:42.920 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:04:42.956 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T22:04:42.962 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:04:42.997 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:04:43.020 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T22:04:43.056 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T22:04:43.082 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:04:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T22:04:43.123 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:04:43.127 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:04:43.153 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:04:43.158 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:04:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T22:04:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T22:04:43.260 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:04:43.262 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T22:04:43.298 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T22:04:43.318 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:04:43.371 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T22:04:43.422 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T22:04:43.499 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T22:04:43.644 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T22:04:43.692 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T22:04:44.029 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:04:44.073 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:04:44.115 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:04:44.213 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:04:44.246 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T22:04:44.262 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:04:44.315 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:04:44.348 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T22:04:44.383 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T22:04:44.392 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:04:44.435 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T22:04:44.437 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:04:44.480 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T22:04:44.532 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T22:04:44.620 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:04:44.651 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:04:44.697 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T22:04:44.750 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T22:04:44.753 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:04:44.807 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T22:04:44.881 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T22:04:44.918 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T22:04:44.954 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T22:04:45.013 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T22:04:45.054 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T22:04:45.324 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T22:04:45.366 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T22:04:45.389 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:04:45.507 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:04:45.510 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T22:04:45.515 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:04:45.549 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:04:45.550 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T22:04:45.592 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T22:04:45.697 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T22:04:45.733 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T22:04:45.774 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T22:04:45.807 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T22:04:45.831 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T22:04:45.925 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T22:04:46.054 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T22:04:46.097 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:04:46.099 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T22:04:46.136 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:04:46.142 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T22:04:46.185 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T22:04:46.219 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:04:46.219 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:04:46.219 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:04:46.219 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:04:46.225 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T22:04:46.246 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:04:46.265 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T22:04:46.295 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T22:04:46.329 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T22:04:46.366 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T22:04:46.408 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T22:04:46.442 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T22:04:46.532 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T22:04:46.582 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T22:04:46.621 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T22:04:46.722 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:04:46.728 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T22:04:46.781 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T22:04:46.805 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:04:46.833 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:04:46.866 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:04:47.200 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:04:47.412 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:04:47.521 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:04:47.543 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T22:04:47.559 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:04:47.595 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T22:04:47.595 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:04:47.637 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T22:04:47.748 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T22:04:47.801 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T22:04:47.846 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T22:04:47.938 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T22:04:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T22:04:48.074 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:04:48.099 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:04:48.170 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:04:48.180 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T22:04:48.192 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:04:48.213 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T22:04:48.293 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T22:04:48.982 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T22:04:49.181 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T22:04:50.509 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T22:04:50.513 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:04:50.547 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:04:50.609 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T22:04:50.637 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T22:04:50.671 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T22:04:50.997 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T22:04:51.050 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:04:51.090 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:04:51.126 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:04:51.150 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T22:04:51.188 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T22:04:51.220 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:04:51.220 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:04:51.220 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:04:51.220 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:04:51.233 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T22:04:51.252 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:04:51.742 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T22:04:51.770 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:04:51.842 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T22:04:51.872 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T22:04:54.260 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:04:54.293 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:04:54.890 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T22:04:54.931 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:04:55.014 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T22:04:55.014 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T22:04:55.014 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T22:04:55.014 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:04:55.057 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:04:57.933 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:04:57.934 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /sys 2024-09-15T22:04:57.934 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /proc 2024-09-15T22:04:57.934 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /mnt 2024-09-15T22:04:57.934 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /var/tmp 2024-09-15T22:04:57.934 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /home 2024-09-15T22:04:57.934 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /root 2024-09-15T22:04:57.934 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /tmp 2024-09-15T22:04:57.934 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:04:58.110 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:04:58.126 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:04:58.126 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:04:58.126 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:04:58.126 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:04:59.605 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:04:59.632 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:04:59.632 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:04:59.632 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:04:59.632 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:04:59.632 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:04:59.632 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:04:59.872 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:04:59.896 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:04:59.896 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:04:59.896 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:04:59.896 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:04:59.896 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:04:59.896 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:05:00.331 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:05:00.354 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:05:00.354 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:00.354 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:05:00.355 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:05:00.355 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:05:00.355 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:05:00.470 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:05:00.526 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:05:00.581 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:05:00.775 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:05:00.823 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:05:00.901 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:05:00.989 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:05:01.129 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:05:01.166 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:05:01.198 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:05:01.225 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:05:01.655 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:05:01.691 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:05:01.723 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:05:01.786 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:05:01.814 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:05:02.858 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:05:02.900 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:05:03.235 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:05:03.235 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-09-15T22:05:03.235 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-09-15T22:05:03.236 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-09-15T22:05:03.236 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-09-15T22:05:03.236 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-09-15T22:05:03.236 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-09-15T22:05:03.236 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-09-15T22:05:03.236 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:05:03.406 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:05:03.422 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:05:03.422 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:03.422 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:05:03.422 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:05:03.861 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:05:03.892 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:05:03.995 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:05:04.154 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:05:04.185 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:05:04.210 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:05:04.210 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:04.210 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:05:04.210 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:05:04.210 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:05:04.210 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:05:04.261 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:05:04.273 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:05:04.370 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:05:04.428 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:05:04.901 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:05:04.929 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:05:04.929 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:04.929 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:05:04.929 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:05:04.929 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:05:04.929 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:05:05.152 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:05:05.174 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:05:05.174 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:05.175 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:05:05.175 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:05:05.175 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:05:05.175 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:05:05.358 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:05:05.390 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:05:05.415 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:05:05.415 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:05.415 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:05:05.415 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:05:05.415 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:05:05.415 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:05:05.457 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:05:05.480 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:05:05.480 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:05.480 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:05:05.481 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:05:05.532 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:05:05.556 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:05:05.556 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:05.556 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:05:05.556 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:05:05.557 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:05:05.557 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:05:05.611 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:05:05.633 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:05:05.633 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:05.633 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:05:05.633 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:05:05.634 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:05:05.634 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:05:05.732 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:05:05.780 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:05:05.836 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:05:05.858 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:05:05.883 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:05:05.883 INFO:teuthology.orchestra.run.smithi165.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:05.883 INFO:teuthology.orchestra.run.smithi165.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:05:05.883 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:05:05.883 INFO:teuthology.orchestra.run.smithi165.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:05:05.883 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:05:06.020 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:05:06.069 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:05:06.138 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:05:06.226 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:05:06.364 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:05:06.411 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:05:06.443 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:05:06.471 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:05:06.866 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:05:06.895 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:05:06.926 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:05:06.988 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:05:07.018 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:05:07.711 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T22:05:07.711 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /sys 2024-09-15T22:05:07.711 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /proc 2024-09-15T22:05:07.711 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /mnt 2024-09-15T22:05:07.711 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /var/tmp 2024-09-15T22:05:07.711 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /home 2024-09-15T22:05:07.711 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /root 2024-09-15T22:05:07.711 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /tmp 2024-09-15T22:05:07.711 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:05:07.888 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:05:07.905 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T22:05:07.905 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:07.905 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T22:05:07.906 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:05:08.055 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:05:08.086 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:05:09.044 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:05:09.070 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:05:09.171 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:05:09.332 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:05:09.356 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:05:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:05:09.380 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:09.380 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:05:09.380 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:05:09.380 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:05:09.380 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:05:09.432 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:05:09.443 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:05:09.449 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:05:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T22:05:09.478 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:09.478 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T22:05:09.478 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:05:09.478 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T22:05:09.478 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:05:09.540 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:05:09.587 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:05:09.718 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:05:09.743 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T22:05:09.743 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:09.743 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T22:05:09.743 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:05:09.743 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T22:05:09.743 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:05:10.202 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:05:10.227 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T22:05:10.227 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:10.228 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T22:05:10.228 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:05:10.228 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T22:05:10.228 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:05:10.350 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T22:05:10.409 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T22:05:10.429 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:05:10.473 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T22:05:10.478 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:05:10.509 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:05:10.528 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:05:10.542 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:05:10.560 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:05:10.565 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:05:10.565 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:10.565 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:05:10.565 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:05:10.565 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:05:10.566 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:05:10.587 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:05:10.610 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:05:10.632 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:05:10.632 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:10.632 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:05:10.632 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:05:10.674 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T22:05:10.677 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:05:10.700 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:05:10.700 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:10.700 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:05:10.700 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:05:10.700 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:05:10.700 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:05:10.721 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T22:05:10.768 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:05:10.802 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T22:05:10.809 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:05:10.840 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:05:10.869 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:05:10.892 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T22:05:10.907 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:05:11.002 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:05:11.025 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:05:11.026 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:11.026 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:05:11.026 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:05:11.026 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:05:11.026 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:05:11.042 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T22:05:11.092 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T22:05:11.137 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T22:05:11.164 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T22:05:11.538 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:05:11.580 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:05:11.601 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:05:11.637 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:05:11.663 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T22:05:11.695 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T22:05:11.761 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T22:05:11.794 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:05:12.461 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:05:12.553 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:05:12.602 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:05:12.692 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:05:12.731 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:05:12.756 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:05:12.782 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:05:12.783 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:05:12.867 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:05:12.867 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:05:12.895 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T22:05:12.930 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:05:12.951 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:05:12.976 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:05:12.981 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:05:12.981 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:05:13.161 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:05:13.161 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:05:13.253 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:05:13.317 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:05:13.943 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T22:05:13.972 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:05:14.082 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T22:05:14.250 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T22:05:14.274 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:05:14.300 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T22:05:14.300 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:14.300 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T22:05:14.301 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:05:14.301 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T22:05:14.301 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:05:14.350 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:05:14.362 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T22:05:14.463 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T22:05:14.511 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T22:05:15.489 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T22:05:15.528 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:05:15.553 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T22:05:15.553 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:15.554 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T22:05:15.554 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:05:15.554 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:05:15.554 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:05:15.556 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:05:15.595 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:05:15.597 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:05:15.619 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T22:05:15.619 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:15.620 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T22:05:15.620 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:05:15.638 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:05:15.670 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:05:15.671 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:05:15.689 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:05:15.696 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T22:05:15.696 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:15.696 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T22:05:15.696 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:05:15.697 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:05:15.697 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:05:15.870 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:05:15.911 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:05:15.942 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:05:15.971 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:05:16.013 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:05:16.017 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:05:16.038 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T22:05:16.039 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T22:05:16.039 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T22:05:16.039 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:05:16.039 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T22:05:16.039 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:05:16.644 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:05:16.682 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:05:16.703 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:05:17.533 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:05:17.629 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:05:17.670 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:05:17.752 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:05:17.782 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:05:17.807 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:05:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:05:17.833 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:05:17.917 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:05:17.918 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:05:18.032 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:05:18.051 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:05:18.057 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:05:18.057 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:05:18.237 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:05:18.238 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:05:18.321 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:05:18.383 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:05:19.038 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:05:19.038 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:05:19.038 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:05:19.038 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:05:19.038 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:05:19.038 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:05:19.038 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:05:19.038 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:05:19.038 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:05:19.039 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:05:19.039 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:05:19.039 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:05:19.039 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:05:19.039 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:05:19.039 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:05:19.039 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:05:19.039 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:05:19.039 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:05:19.039 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:05:19.039 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:05:19.039 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:05:19.039 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:05:19.040 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:05:19.040 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:05:19.040 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:05:19.040 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:05:19.040 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:05:19.040 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:05:19.040 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:05:19.040 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:05:19.040 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:05:19.040 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:05:19.040 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:05:19.040 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:05:19.041 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:05:19.041 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:05:19.041 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:05:19.041 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:05:19.041 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:05:19.041 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:05:19.041 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:05:19.041 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:05:19.041 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:05:19.041 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:05:19.041 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:05:19.041 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:05:19.042 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:05:19.043 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:05:19.043 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:05:19.043 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:05:19.043 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:05:19.043 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:05:19.043 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:05:19.043 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:05:19.043 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:05:19.043 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:05:19.043 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:05:19.043 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:05:19.043 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:05:19.043 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:05:19.044 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:05:19.044 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:05:19.044 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:05:19.044 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:05:19.044 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:05:19.044 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:05:19.044 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:05:19.044 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:05:19.044 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:05:19.045 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:05:19.045 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:05:19.045 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:05:19.045 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:05:19.045 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:05:19.045 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:05:19.045 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:05:19.045 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:05:19.045 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:05:19.045 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:05:19.045 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:05:19.045 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:05:19.046 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:05:19.047 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:05:19.047 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:05:19.047 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:05:19.047 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:05:19.047 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:05:19.047 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:05:19.047 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:05:19.047 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:05:19.047 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:05:19.047 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:05:19.047 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:05:19.047 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:05:19.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:05:19.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:05:19.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:05:19.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:05:19.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:05:19.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:05:19.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:05:19.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:05:19.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:05:19.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:05:19.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:05:19.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:05:19.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:05:19.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:05:19.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:05:19.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:05:19.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:05:19.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:05:19.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:05:19.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:05:19.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:05:19.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:05:19.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:05:19.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:05:19.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:05:19.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:05:19.050 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:05:19.050 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:05:19.050 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:05:19.050 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:05:19.050 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:05:19.050 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:05:19.050 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:05:19.050 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:05:19.050 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:05:19.050 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:05:19.051 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:05:19.051 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:05:19.051 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:05:19.051 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:05:19.051 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:05:19.051 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:05:19.051 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:05:19.051 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:05:20.868 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T22:05:20.909 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T22:05:20.960 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T22:05:20.999 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T22:05:21.034 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T22:05:21.233 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T22:05:21.273 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T22:05:21.304 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T22:05:21.333 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T22:05:21.371 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T22:05:21.525 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:05:21.525 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:05:21.525 INFO:teuthology.orchestra.run.smithi165.stdout:Upgraded: 2024-09-15T22:05:21.525 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:05:21.525 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:05:21.526 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:05:21.526 INFO:teuthology.orchestra.run.smithi165.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:05:21.526 INFO:teuthology.orchestra.run.smithi165.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.526 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.526 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:05:21.526 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:05:21.526 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2024-09-15T22:05:21.526 INFO:teuthology.orchestra.run.smithi165.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:05:21.526 INFO:teuthology.orchestra.run.smithi165.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:05:21.526 INFO:teuthology.orchestra.run.smithi165.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:05:21.526 INFO:teuthology.orchestra.run.smithi165.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:05:21.526 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.526 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.527 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.527 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.527 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:21.527 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.527 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.527 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.527 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:21.527 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:21.527 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:21.527 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:21.527 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:21.527 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.527 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.528 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:21.528 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.528 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.528 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.528 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:21.528 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:21.528 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.528 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.528 INFO:teuthology.orchestra.run.smithi165.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:21.528 INFO:teuthology.orchestra.run.smithi165.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:05:21.528 INFO:teuthology.orchestra.run.smithi165.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:05:21.528 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:05:21.528 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:05:21.529 INFO:teuthology.orchestra.run.smithi165.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:05:21.529 INFO:teuthology.orchestra.run.smithi165.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:05:21.529 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:05:21.529 INFO:teuthology.orchestra.run.smithi165.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:05:21.529 INFO:teuthology.orchestra.run.smithi165.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:05:21.529 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:05:21.529 INFO:teuthology.orchestra.run.smithi165.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:05:21.529 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.529 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.529 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.529 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:05:21.529 INFO:teuthology.orchestra.run.smithi165.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:05:21.530 INFO:teuthology.orchestra.run.smithi165.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:05:21.530 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:05:21.530 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:05:21.530 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.530 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.530 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:05:21.530 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.530 INFO:teuthology.orchestra.run.smithi165.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:05:21.530 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:05:21.530 INFO:teuthology.orchestra.run.smithi165.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:05:21.530 INFO:teuthology.orchestra.run.smithi165.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:05:21.530 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:05:21.530 INFO:teuthology.orchestra.run.smithi165.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:05:21.531 INFO:teuthology.orchestra.run.smithi165.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:05:21.532 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:05:21.532 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:05:21.532 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:05:21.532 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.532 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.532 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.532 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:05:21.532 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:05:21.532 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:05:21.532 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:05:21.532 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:05:21.533 INFO:teuthology.orchestra.run.smithi165.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:05:21.533 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:05:21.533 INFO:teuthology.orchestra.run.smithi165.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:05:21.533 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:05:21.533 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:05:21.533 INFO:teuthology.orchestra.run.smithi165.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:05:21.533 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:05:21.533 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:05:21.533 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:05:21.533 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:05:21.533 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:05:21.533 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:05:21.533 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:05:21.534 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:05:21.534 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:05:21.534 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:05:21.534 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:05:21.534 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:05:21.534 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:05:21.534 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:05:21.534 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:05:21.534 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:05:21.534 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:05:21.534 INFO:teuthology.orchestra.run.smithi165.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:05:21.534 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:05:21.535 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:05:21.535 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:05:21.535 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:05:21.535 INFO:teuthology.orchestra.run.smithi165.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:05:21.535 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:05:21.535 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:05:21.535 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:05:21.535 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:05:21.535 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:05:21.535 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:05:21.535 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.536 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.536 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:05:21.536 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:05:21.536 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:05:21.536 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.536 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:05:21.536 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:05:21.536 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:05:21.536 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:05:21.536 INFO:teuthology.orchestra.run.smithi165.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:05:21.537 INFO:teuthology.orchestra.run.smithi165.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:05:21.537 INFO:teuthology.orchestra.run.smithi165.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:05:21.537 INFO:teuthology.orchestra.run.smithi165.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:05:21.537 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:05:21.537 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:05:21.537 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:05:21.537 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:05:21.537 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:05:21.537 INFO:teuthology.orchestra.run.smithi165.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:05:21.537 INFO:teuthology.orchestra.run.smithi165.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:05:21.537 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.537 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.538 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:21.538 INFO:teuthology.orchestra.run.smithi165.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:05:21.538 INFO:teuthology.orchestra.run.smithi165.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:05:21.538 INFO:teuthology.orchestra.run.smithi165.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:05:21.538 INFO:teuthology.orchestra.run.smithi165.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:05:21.538 INFO:teuthology.orchestra.run.smithi165.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:05:21.538 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:05:21.538 INFO:teuthology.orchestra.run.smithi165.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:05:21.538 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:05:21.539 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2024-09-15T22:05:21.981 DEBUG:teuthology.parallel:result is None 2024-09-15T22:05:22.016 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:05:22.061 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:05:22.083 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T22:05:22.976 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T22:05:23.059 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T22:05:23.106 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T22:05:23.204 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T22:05:23.237 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T22:05:23.262 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T22:05:23.297 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T22:05:23.297 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:05:23.406 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T22:05:23.407 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:05:23.507 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T22:05:23.532 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T22:05:23.538 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:05:23.538 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:05:23.734 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T22:05:23.735 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:05:23.819 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T22:05:23.887 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:05:23.943 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:05:23.943 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:05:23.943 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:05:23.944 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:05:23.944 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:05:23.944 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:05:23.944 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:05:23.944 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:05:23.944 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:05:23.944 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:05:23.944 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:05:23.944 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:05:23.944 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:05:23.944 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:05:23.945 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:05:23.945 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:05:23.945 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:05:23.945 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:05:23.945 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:05:23.945 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:05:23.945 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:05:23.945 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:05:23.945 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:05:23.946 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:05:23.946 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:05:23.946 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:05:23.946 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:05:23.946 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:05:23.946 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:05:23.946 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:05:23.946 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:05:23.959 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:05:23.959 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:05:23.959 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:05:23.959 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:05:23.959 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:05:23.959 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:05:23.959 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:05:23.959 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:05:23.959 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:05:23.960 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:05:23.960 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:05:23.960 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:05:23.960 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:05:23.960 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:05:23.960 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:05:23.960 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:05:23.960 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:05:23.960 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:05:23.960 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:05:23.960 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:05:23.960 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:05:23.961 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:05:23.961 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:05:23.961 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:05:23.961 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:05:23.961 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:05:23.961 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:05:23.961 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:05:23.961 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:05:23.961 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:05:23.961 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:05:23.961 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:05:23.961 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:05:23.961 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:05:23.962 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:05:23.962 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:05:23.962 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:05:23.962 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:05:23.962 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:05:23.962 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:05:23.962 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:05:23.963 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:05:23.963 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:05:23.963 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:05:23.963 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:05:23.963 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:05:23.963 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:05:23.963 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:05:23.963 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:05:23.964 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:05:23.964 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:05:23.964 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:05:23.964 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:05:23.964 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:05:23.964 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:05:23.964 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:05:23.964 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:05:23.964 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:05:23.964 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:05:23.964 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:05:23.964 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:05:23.965 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:05:23.965 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:05:23.965 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:05:23.965 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:05:23.965 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:05:23.965 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:05:23.965 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:05:23.965 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:05:23.965 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:05:23.965 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:05:23.965 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:05:23.965 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:05:23.965 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:05:23.966 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:05:23.966 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:05:23.966 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:05:23.966 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:05:23.966 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:05:23.966 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:05:23.966 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:05:23.966 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:05:23.966 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:05:23.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:05:23.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:05:23.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:05:23.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:05:23.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:05:23.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:05:23.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:05:23.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:05:23.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:05:23.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:05:23.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:05:23.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:05:23.967 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:05:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:05:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:05:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:05:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:05:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:05:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:05:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:05:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:05:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:05:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:05:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:05:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:05:23.968 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:05:23.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:05:23.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:05:23.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:05:23.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:05:23.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:05:23.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:05:23.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:05:23.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:05:23.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:05:23.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:05:23.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:05:23.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:05:23.969 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:05:23.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:05:23.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:05:23.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:05:23.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:05:23.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:05:23.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:05:23.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:05:23.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:05:23.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:05:23.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:05:23.970 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:05:26.648 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:05:26.648 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:05:26.648 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-09-15T22:05:26.648 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:05:26.648 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:05:26.649 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:05:26.649 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:05:26.649 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.649 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.649 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:05:26.649 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:05:26.649 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-09-15T22:05:26.649 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:05:26.649 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:05:26.649 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:05:26.649 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:05:26.650 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.650 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.650 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.650 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.650 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:26.650 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.650 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.650 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.650 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:26.650 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:26.650 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:26.650 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:26.651 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:26.651 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.651 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.651 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:26.651 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.651 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.651 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.651 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:26.651 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:26.651 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.651 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.651 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:26.652 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:05:26.652 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:05:26.652 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:05:26.652 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:05:26.652 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:05:26.652 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:05:26.652 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:05:26.652 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:05:26.653 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:05:26.653 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:05:26.653 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:05:26.653 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.653 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.653 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.653 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:05:26.653 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:05:26.653 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:05:26.653 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:05:26.654 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:05:26.654 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.654 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.654 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:05:26.654 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.654 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:05:26.654 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:05:26.654 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:05:26.654 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:05:26.654 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:05:26.654 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:05:26.655 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:05:26.655 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:05:26.655 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:05:26.655 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:05:26.655 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:05:26.655 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:05:26.655 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:05:26.655 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:05:26.655 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:05:26.655 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:05:26.655 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:05:26.656 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:05:26.656 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:05:26.656 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:05:26.656 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:05:26.656 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:05:26.656 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:05:26.656 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.656 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.656 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.656 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:05:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:05:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:05:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:05:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:05:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:05:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:05:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:05:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:05:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:05:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:05:26.657 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:05:26.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:05:26.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:05:26.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:05:26.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:05:26.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:05:26.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:05:26.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:05:26.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:05:26.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:05:26.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:05:26.658 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:05:26.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:05:26.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:05:26.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:05:26.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:05:26.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:05:26.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:05:26.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:05:26.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:05:26.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:05:26.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:05:26.659 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:05:26.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:05:26.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:05:26.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:05:26.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:05:26.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:05:26.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:05:26.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:05:26.660 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:05:26.661 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:05:26.661 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.661 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:05:26.661 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:05:26.661 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:05:26.661 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:05:26.661 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:05:26.661 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:05:26.662 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:05:26.662 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:05:26.662 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:05:26.662 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:05:26.662 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:05:26.662 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:05:26.662 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:05:26.662 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:05:26.662 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:05:26.662 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.663 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.663 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:26.663 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:05:26.663 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:05:26.663 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:05:26.663 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:05:26.663 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:05:26.663 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:05:26.664 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:05:26.664 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:05:26.664 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-09-15T22:05:27.049 DEBUG:teuthology.parallel:result is None 2024-09-15T22:05:29.654 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:05:29.654 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T22:05:29.654 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T22:05:29.654 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T22:05:29.654 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T22:05:29.654 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T22:05:29.654 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T22:05:29.654 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T22:05:29.654 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T22:05:29.655 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T22:05:29.655 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T22:05:29.655 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T22:05:29.655 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T22:05:29.655 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T22:05:29.655 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T22:05:29.655 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T22:05:29.655 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T22:05:29.656 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T22:05:29.656 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T22:05:29.656 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T22:05:29.656 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T22:05:29.656 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T22:05:29.656 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T22:05:29.656 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T22:05:29.656 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T22:05:29.657 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T22:05:29.657 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T22:05:29.657 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T22:05:29.657 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T22:05:29.657 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T22:05:29.657 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T22:05:29.657 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T22:05:29.657 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T22:05:29.657 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T22:05:29.657 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T22:05:29.657 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T22:05:29.657 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T22:05:29.657 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T22:05:29.658 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T22:05:29.658 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T22:05:29.658 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T22:05:29.658 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T22:05:29.658 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T22:05:29.658 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T22:05:29.658 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T22:05:29.658 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T22:05:29.658 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T22:05:29.658 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T22:05:29.658 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T22:05:29.658 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T22:05:29.658 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T22:05:29.659 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T22:05:29.659 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T22:05:29.659 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T22:05:29.659 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T22:05:29.659 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T22:05:29.659 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T22:05:29.659 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T22:05:29.659 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T22:05:29.659 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T22:05:29.659 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T22:05:29.659 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T22:05:29.659 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T22:05:29.660 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T22:05:29.660 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T22:05:29.660 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T22:05:29.660 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T22:05:29.660 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T22:05:29.660 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T22:05:29.660 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T22:05:29.660 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T22:05:29.660 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T22:05:29.660 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T22:05:29.660 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T22:05:29.660 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T22:05:29.661 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T22:05:29.661 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T22:05:29.661 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T22:05:29.661 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T22:05:29.661 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T22:05:29.661 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T22:05:29.661 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T22:05:29.661 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T22:05:29.661 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T22:05:29.661 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T22:05:29.661 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T22:05:29.661 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T22:05:29.661 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T22:05:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T22:05:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T22:05:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T22:05:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T22:05:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T22:05:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T22:05:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T22:05:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T22:05:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T22:05:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T22:05:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T22:05:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T22:05:29.662 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T22:05:29.663 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T22:05:29.663 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T22:05:29.663 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T22:05:29.663 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T22:05:29.663 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T22:05:29.663 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T22:05:29.663 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T22:05:29.663 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T22:05:29.663 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T22:05:29.663 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T22:05:29.663 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T22:05:29.663 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T22:05:29.664 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T22:05:29.664 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T22:05:29.664 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T22:05:29.664 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T22:05:29.664 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T22:05:29.664 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T22:05:29.664 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T22:05:29.664 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T22:05:29.664 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T22:05:29.664 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T22:05:29.664 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T22:05:29.664 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T22:05:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T22:05:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T22:05:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T22:05:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T22:05:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T22:05:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T22:05:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T22:05:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T22:05:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T22:05:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T22:05:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T22:05:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T22:05:29.665 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T22:05:29.666 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T22:05:29.667 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T22:05:29.667 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T22:05:29.667 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T22:05:29.667 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T22:05:29.667 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T22:05:29.667 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T22:05:29.667 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T22:05:29.667 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T22:05:29.667 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T22:05:29.667 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T22:05:29.667 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T22:05:29.667 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T22:05:32.258 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T22:05:32.258 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:05:32.259 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2024-09-15T22:05:32.259 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T22:05:32.259 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T22:05:32.259 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T22:05:32.259 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T22:05:32.259 INFO:teuthology.orchestra.run.smithi045.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.259 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.259 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T22:05:32.259 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T22:05:32.259 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-09-15T22:05:32.259 INFO:teuthology.orchestra.run.smithi045.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T22:05:32.260 INFO:teuthology.orchestra.run.smithi045.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T22:05:32.260 INFO:teuthology.orchestra.run.smithi045.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T22:05:32.260 INFO:teuthology.orchestra.run.smithi045.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T22:05:32.260 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.260 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.260 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.260 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.260 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:32.260 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.260 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.260 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.260 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:32.261 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:32.261 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:32.261 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:32.261 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:32.261 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.261 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.261 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:32.261 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.261 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.261 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.262 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:32.262 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:32.262 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.262 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.262 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T22:05:32.262 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T22:05:32.262 INFO:teuthology.orchestra.run.smithi045.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T22:05:32.263 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T22:05:32.263 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T22:05:32.263 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T22:05:32.263 INFO:teuthology.orchestra.run.smithi045.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T22:05:32.263 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T22:05:32.263 INFO:teuthology.orchestra.run.smithi045.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T22:05:32.263 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T22:05:32.263 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T22:05:32.263 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T22:05:32.264 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.264 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.264 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.264 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T22:05:32.264 INFO:teuthology.orchestra.run.smithi045.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T22:05:32.264 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T22:05:32.264 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T22:05:32.264 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T22:05:32.264 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.264 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.264 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T22:05:32.265 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.265 INFO:teuthology.orchestra.run.smithi045.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T22:05:32.265 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T22:05:32.265 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T22:05:32.265 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T22:05:32.265 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T22:05:32.265 INFO:teuthology.orchestra.run.smithi045.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T22:05:32.266 INFO:teuthology.orchestra.run.smithi045.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T22:05:32.266 INFO:teuthology.orchestra.run.smithi045.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T22:05:32.266 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T22:05:32.266 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T22:05:32.266 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T22:05:32.266 INFO:teuthology.orchestra.run.smithi045.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T22:05:32.267 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T22:05:32.267 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T22:05:32.267 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T22:05:32.267 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T22:05:32.267 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T22:05:32.267 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T22:05:32.267 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T22:05:32.268 INFO:teuthology.orchestra.run.smithi045.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T22:05:32.268 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T22:05:32.268 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T22:05:32.268 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T22:05:32.268 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.268 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.268 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.268 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T22:05:32.268 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T22:05:32.269 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T22:05:32.269 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T22:05:32.269 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T22:05:32.269 INFO:teuthology.orchestra.run.smithi045.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T22:05:32.269 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T22:05:32.269 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T22:05:32.269 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T22:05:32.270 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T22:05:32.270 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T22:05:32.270 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T22:05:32.270 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T22:05:32.270 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T22:05:32.271 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T22:05:32.271 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T22:05:32.271 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T22:05:32.271 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T22:05:32.271 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T22:05:32.271 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T22:05:32.271 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T22:05:32.272 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T22:05:32.272 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T22:05:32.272 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T22:05:32.272 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T22:05:32.272 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T22:05:32.272 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T22:05:32.272 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T22:05:32.272 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T22:05:32.272 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T22:05:32.272 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T22:05:32.272 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T22:05:32.273 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T22:05:32.273 INFO:teuthology.orchestra.run.smithi045.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T22:05:32.273 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T22:05:32.273 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T22:05:32.273 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T22:05:32.273 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T22:05:32.274 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T22:05:32.274 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T22:05:32.274 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.274 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.274 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T22:05:32.274 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T22:05:32.274 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T22:05:32.275 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.275 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T22:05:32.275 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T22:05:32.275 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T22:05:32.275 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T22:05:32.275 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T22:05:32.275 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T22:05:32.275 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T22:05:32.275 INFO:teuthology.orchestra.run.smithi045.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T22:05:32.275 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T22:05:32.276 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T22:05:32.276 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T22:05:32.276 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T22:05:32.276 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T22:05:32.276 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T22:05:32.276 INFO:teuthology.orchestra.run.smithi045.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T22:05:32.276 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.276 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.276 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T22:05:32.276 INFO:teuthology.orchestra.run.smithi045.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T22:05:32.276 INFO:teuthology.orchestra.run.smithi045.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T22:05:32.276 INFO:teuthology.orchestra.run.smithi045.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T22:05:32.277 INFO:teuthology.orchestra.run.smithi045.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T22:05:32.277 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T22:05:32.277 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T22:05:32.277 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T22:05:32.277 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:05:32.277 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-09-15T22:05:32.801 DEBUG:teuthology.parallel:result is None 2024-09-15T22:05:32.802 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:05:32.950 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:05:32.973 INFO:teuthology.orchestra.run.smithi045.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:05:32.973 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:05:32.974 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:05:32.975 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:05:33.114 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:05:33.141 INFO:teuthology.orchestra.run.smithi100.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:05:33.141 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:05:33.141 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:05:33.143 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:05:33.280 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T22:05:33.307 INFO:teuthology.orchestra.run.smithi165.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T22:05:33.307 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T22:05:33.307 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T22:05:33.309 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T22:05:33.310 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:05:33.310 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:05:33.340 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-15T22:05:33.340 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:05:33.374 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-15T22:05:33.374 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:05:33.405 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T22:05:33.406 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:05:33.406 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:05:33.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:05:33.500 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-15T22:05:33.500 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:05:33.529 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:05:33.598 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-15T22:05:33.598 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:05:33.629 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:05:33.698 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T22:05:33.699 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:05:33.699 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:05:33.728 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:05:33.796 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-15T22:05:33.796 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:05:33.825 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:05:33.893 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-15T22:05:33.893 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:05:33.923 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:05:33.992 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T22:05:33.992 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:05:33.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:05:34.022 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:05:34.091 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-15T22:05:34.091 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:05:34.119 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:05:34.188 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-15T22:05:34.188 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:05:34.218 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:05:34.286 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-15T22:05:34.391 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-15T22:05:34.391 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:05:34.391 INFO:tasks.cephadm:Cluster fsid is a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:05:34.392 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-15T22:05:34.392 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.45', 'mon.b': '172.21.15.100', 'mon.c': '172.21.15.165'} 2024-09-15T22:05:34.392 INFO:tasks.cephadm:First mon is mon.a on smithi045 2024-09-15T22:05:34.392 INFO:tasks.cephadm:First mgr is x 2024-09-15T22:05:34.392 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-15T22:05:34.392 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname $(hostname -s) 2024-09-15T22:05:34.428 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname $(hostname -s) 2024-09-15T22:05:34.458 DEBUG:teuthology.orchestra.run.smithi165:> sudo hostname $(hostname -s) 2024-09-15T22:05:34.488 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-15T22:05:34.488 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:05:34.630 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56081/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-326-g8921c8ef', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-326.g8921c8ef'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-15 16:06:42.385367', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-15T22:05:34.769 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref squid, sha1 8921c8ef947807b717db041d85f0761b7914d5fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:05:34.771 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T22:05:34.771 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T22:05:34.771 DEBUG:teuthology.orchestra.run.smithi045:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:05:35.167 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:05 /home/ubuntu/cephtest/cephadm 2024-09-15T22:05:35.167 DEBUG:teuthology.orchestra.run.smithi100:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:05:35.532 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:05 /home/ubuntu/cephtest/cephadm 2024-09-15T22:05:35.533 DEBUG:teuthology.orchestra.run.smithi165:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T22:05:35.899 INFO:teuthology.orchestra.run.smithi165.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 22:05 /home/ubuntu/cephtest/cephadm 2024-09-15T22:05:35.900 DEBUG:teuthology.orchestra.run.smithi045:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:05:35.920 DEBUG:teuthology.orchestra.run.smithi100:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:05:35.940 DEBUG:teuthology.orchestra.run.smithi165:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T22:05:35.975 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc on all hosts... 2024-09-15T22:05:35.975 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:05:35.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:05:35.982 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T22:05:37.511 INFO:teuthology.orchestra.run.smithi165.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:05:37.559 INFO:teuthology.orchestra.run.smithi100.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:05:37.694 INFO:teuthology.orchestra.run.smithi045.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:06:06.549 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:06:06.549 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:06:06.549 INFO:teuthology.orchestra.run.smithi045.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:06:06.549 INFO:teuthology.orchestra.run.smithi045.stdout: "repo_digests": [ 2024-09-15T22:06:06.549 INFO:teuthology.orchestra.run.smithi045.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:06:06.549 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-15T22:06:06.550 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:06:08.409 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-15T22:06:08.409 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:06:08.409 INFO:teuthology.orchestra.run.smithi165.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:06:08.409 INFO:teuthology.orchestra.run.smithi165.stdout: "repo_digests": [ 2024-09-15T22:06:08.409 INFO:teuthology.orchestra.run.smithi165.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:06:08.409 INFO:teuthology.orchestra.run.smithi165.stdout: ] 2024-09-15T22:06:08.410 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-15T22:06:10.361 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-15T22:06:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:06:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T22:06:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "repo_digests": [ 2024-09-15T22:06:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T22:06:10.362 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-09-15T22:06:10.362 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-15T22:06:10.387 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph 2024-09-15T22:06:10.422 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph 2024-09-15T22:06:10.450 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph 2024-09-15T22:06:10.484 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /etc/ceph 2024-09-15T22:06:10.515 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /etc/ceph 2024-09-15T22:06:10.541 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 777 /etc/ceph 2024-09-15T22:06:10.570 INFO:tasks.cephadm:Writing seed config... 2024-09-15T22:06:10.571 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-15T22:06:10.571 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-15T22:06:10.571 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-15T22:06:10.571 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-15T22:06:10.571 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-15T22:06:10.571 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-15T22:06:10.572 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-15T22:06:10.572 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-15T22:06:10.572 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-15T22:06:10.572 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-15T22:06:10.572 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-15T22:06:10.572 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-15T22:06:10.572 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-15T22:06:10.572 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-15T22:06:10.572 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-15T22:06:10.572 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-15T22:06:10.572 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-15T22:06:10.572 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-15T22:06:10.572 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-15T22:06:10.573 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-15T22:06:10.574 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-15T22:06:10.575 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:06:10.575 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-15T22:06:10.594 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a1911414-73ae-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-15T22:06:10.594 DEBUG:teuthology.orchestra.run.smithi045:mon.a> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.a.service 2024-09-15T22:06:10.637 DEBUG:teuthology.orchestra.run.smithi045:mgr.x> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mgr.x.service 2024-09-15T22:06:10.680 INFO:tasks.cephadm:Bootstrapping... 2024-09-15T22:06:10.681 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc -v bootstrap --fsid a1911414-73ae-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.45 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:06:10.894 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-09-15T22:06:10.895 INFO:teuthology.orchestra.run.smithi045.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc', '-v', 'bootstrap', '--fsid', 'a1911414-73ae-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.45', '--skip-admin-label'] 2024-09-15T22:06:10.895 INFO:teuthology.orchestra.run.smithi045.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-15T22:06:10.895 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying podman|docker is present... 2024-09-15T22:06:10.920 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stdout 5.2.2 2024-09-15T22:06:10.920 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying lvm2 is present... 2024-09-15T22:06:10.920 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying time synchronization is in place... 2024-09-15T22:06:10.928 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T22:06:10.928 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T22:06:10.934 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T22:06:10.934 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-09-15T22:06:10.941 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout enabled 2024-09-15T22:06:10.948 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout active 2024-09-15T22:06:10.948 INFO:teuthology.orchestra.run.smithi045.stdout:Unit chronyd.service is enabled and running 2024-09-15T22:06:10.948 INFO:teuthology.orchestra.run.smithi045.stdout:Repeating the final host check... 2024-09-15T22:06:10.971 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stdout 5.2.2 2024-09-15T22:06:10.972 INFO:teuthology.orchestra.run.smithi045.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-15T22:06:10.972 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl is present 2024-09-15T22:06:10.972 INFO:teuthology.orchestra.run.smithi045.stdout:lvcreate is present 2024-09-15T22:06:10.978 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T22:06:10.978 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T22:06:10.984 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T22:06:10.985 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-09-15T22:06:10.991 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout enabled 2024-09-15T22:06:11.001 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout active 2024-09-15T22:06:11.001 INFO:teuthology.orchestra.run.smithi045.stdout:Unit chronyd.service is enabled and running 2024-09-15T22:06:11.001 INFO:teuthology.orchestra.run.smithi045.stdout:Host looks OK 2024-09-15T22:06:11.001 INFO:teuthology.orchestra.run.smithi045.stdout:Cluster fsid: a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:06:11.001 INFO:teuthology.orchestra.run.smithi045.stdout:Acquiring lock 140087859520512 on /run/cephadm/a1911414-73ae-11ef-bceb-c7b262605968.lock 2024-09-15T22:06:11.001 INFO:teuthology.orchestra.run.smithi045.stdout:Lock 140087859520512 acquired on /run/cephadm/a1911414-73ae-11ef-bceb-c7b262605968.lock 2024-09-15T22:06:11.002 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying IP 172.21.15.45 port 3300 ... 2024-09-15T22:06:11.002 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying IP 172.21.15.45 port 6789 ... 2024-09-15T22:06:11.002 INFO:teuthology.orchestra.run.smithi045.stdout:Base mon IP(s) is [172.21.15.45:3300, 172.21.15.45:6789], mon addrv is [v2:172.21.15.45:3300,v1:172.21.15.45:6789] 2024-09-15T22:06:11.003 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.45 metric 100 2024-09-15T22:06:11.003 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.45 metric 100 2024-09-15T22:06:11.005 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-15T22:06:11.005 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-15T22:06:11.005 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1794sec hoplimit 64 pref medium 2024-09-15T22:06:11.008 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-15T22:06:11.008 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-15T22:06:11.008 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T22:06:11.008 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-15T22:06:11.008 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:12be/64 scope link 2024-09-15T22:06:11.008 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T22:06:11.010 INFO:teuthology.orchestra.run.smithi045.stdout:Mon IP `172.21.15.45` is in CIDR network `172.21.0.0/20` 2024-09-15T22:06:11.010 INFO:teuthology.orchestra.run.smithi045.stdout:Mon IP `172.21.15.45` is in CIDR network `172.21.0.0/20` 2024-09-15T22:06:11.010 INFO:teuthology.orchestra.run.smithi045.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-15T22:06:11.010 INFO:teuthology.orchestra.run.smithi045.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-15T22:06:11.011 INFO:teuthology.orchestra.run.smithi045.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:06:11.467 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stdout f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T22:06:11.467 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T22:06:11.467 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Getting image source signatures 2024-09-15T22:06:11.467 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Copying blob sha256:c0574da0c3174f3dc49daa274908f97d06456bd6a3cfab87e94022c1369a83a6 2024-09-15T22:06:11.467 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-15T22:06:11.467 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Copying config sha256:f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T22:06:11.467 INFO:teuthology.orchestra.run.smithi045.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-15T22:06:12.388 INFO:teuthology.orchestra.run.smithi045.stdout:ceph: stdout ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T22:06:12.388 INFO:teuthology.orchestra.run.smithi045.stdout:Ceph version: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T22:06:12.388 INFO:teuthology.orchestra.run.smithi045.stdout:Extracting ceph user uid/gid from container image... 2024-09-15T22:06:13.353 INFO:teuthology.orchestra.run.smithi045.stdout:stat: stdout 167 167 2024-09-15T22:06:13.353 INFO:teuthology.orchestra.run.smithi045.stdout:Creating initial keys... 2024-09-15T22:06:14.284 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph-authtool: stdout AQBVWudmjtl4KRAAVcE61G8A+oHmGV6btgW71A== 2024-09-15T22:06:15.122 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph-authtool: stdout AQBWWudmqgVAIhAAHhoCtR2nP89CJmdxa+S9aA== 2024-09-15T22:06:16.078 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph-authtool: stdout AQBXWudmg1C0GhAAgM69zM3MMh3HsbbBwgnmeQ== 2024-09-15T22:06:16.079 INFO:teuthology.orchestra.run.smithi045.stdout:Creating initial monmap... 2024-09-15T22:06:17.068 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T22:06:17.068 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-15T22:06:17.068 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:06:17.068 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T22:06:17.068 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool for a [v2:172.21.15.45:3300,v1:172.21.15.45:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T22:06:17.068 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = quincy 2024-09-15T22:06:17.068 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: set fsid to a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:06:17.069 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T22:06:17.069 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:06:17.069 INFO:teuthology.orchestra.run.smithi045.stdout:Creating mon... 2024-09-15T22:06:18.023 INFO:teuthology.orchestra.run.smithi045.stdout:create mon.a on 2024-09-15T22:06:18.254 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-15T22:06:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-15T22:06:18.589 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a1911414-73ae-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-a1911414-73ae-11ef-bceb-c7b262605968.target. 2024-09-15T22:06:18.589 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-a1911414-73ae-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-a1911414-73ae-11ef-bceb-c7b262605968.target. 2024-09-15T22:06:18.839 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.a 2024-09-15T22:06:18.840 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-15T22:06:19.008 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a1911414-73ae-11ef-bceb-c7b262605968.target.wants/ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-a1911414-73ae-11ef-bceb-c7b262605968@.service. 2024-09-15T22:06:19.522 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:19 smithi045 ceph-mon[30810]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T22:06:19.541 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:06:19.541 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout disabled 2024-09-15T22:06:19.549 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:06:19.549 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-09-15T22:06:19.549 INFO:teuthology.orchestra.run.smithi045.stdout:firewalld.service is not enabled 2024-09-15T22:06:19.550 INFO:teuthology.orchestra.run.smithi045.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T22:06:19.550 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mon to start... 2024-09-15T22:06:19.550 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mon... 2024-09-15T22:06:19.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:19 smithi045 bash[30788]: 442c8a5b7764b5c5b8d95edba16f0804b4665d124e7fe1d044f2b6979a8dc889 2024-09-15T22:06:19.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:19 smithi045 systemd[1]: Started Ceph mon.a for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:06:20.723 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:20 smithi045 ceph-mon[30810]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T22:06:20.723 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:20 smithi045 ceph-mon[30810]: monmap epoch 1 2024-09-15T22:06:20.723 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:20 smithi045 ceph-mon[30810]: fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:06:20.723 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:20 smithi045 ceph-mon[30810]: last_changed 2024-09-15T22:06:16.451807+0000 2024-09-15T22:06:20.723 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:20 smithi045 ceph-mon[30810]: created 2024-09-15T22:06:16.451807+0000 2024-09-15T22:06:20.723 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:20 smithi045 ceph-mon[30810]: min_mon_release 19 (squid) 2024-09-15T22:06:20.723 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:20 smithi045 ceph-mon[30810]: election_strategy: 1 2024-09-15T22:06:20.724 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:20 smithi045 ceph-mon[30810]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-09-15T22:06:20.724 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:20 smithi045 ceph-mon[30810]: fsmap 2024-09-15T22:06:20.724 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:20 smithi045 ceph-mon[30810]: osdmap e1: 0 total, 0 up, 0 in 2024-09-15T22:06:20.724 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:20 smithi045 ceph-mon[30810]: mgrmap e1: no daemons active 2024-09-15T22:06:20.724 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:20 smithi045 ceph-mon[30810]: from='client.? 172.21.15.45:0/1378149778' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-15T22:06:20.731 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout cluster: 2024-09-15T22:06:20.731 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout id: a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:06:20.731 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-15T22:06:20.731 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-15T22:06:20.731 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout services: 2024-09-15T22:06:20.731 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.656239s) 2024-09-15T22:06:20.731 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-15T22:06:20.731 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-15T22:06:20.732 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-15T22:06:20.732 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout data: 2024-09-15T22:06:20.732 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-15T22:06:20.732 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-15T22:06:20.732 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-15T22:06:20.732 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout pgs: 2024-09-15T22:06:20.732 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-15T22:06:20.732 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.074+0000 7f49f095c640 1 Processor -- start 2024-09-15T22:06:20.732 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.074+0000 7f49f095c640 1 -- start start 2024-09-15T22:06:20.732 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.074+0000 7f49f095c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 0x7f49ec1063e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:20.732 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.074+0000 7f49f095c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f49ec07bdd0 con 0x7f49ec105fe0 2024-09-15T22:06:20.732 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.075+0000 7f49ea59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 0x7f49ec1063e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:20.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.075+0000 7f49ea59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 0x7f49ec1063e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57510/0 (socket says 172.21.15.45:57510) 2024-09-15T22:06:20.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.075+0000 7f49ea59c640 1 -- 172.21.15.45:0/978318856 learned_addr learned my addr 172.21.15.45:0/978318856 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:20.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.075+0000 7f49ea59c640 1 -- 172.21.15.45:0/978318856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ec106920 con 0x7f49ec105fe0 2024-09-15T22:06:20.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.077+0000 7f49ea59c640 1 --2- 172.21.15.45:0/978318856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 0x7f49ec1063e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009820 tx=0x7f49dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9532c2349a0f6542 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:20.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.077+0000 7f49e959a640 1 -- 172.21.15.45:0/978318856 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49dc037070 con 0x7f49ec105fe0 2024-09-15T22:06:20.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.077+0000 7f49e959a640 1 -- 172.21.15.45:0/978318856 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc032440 con 0x7f49ec105fe0 2024-09-15T22:06:20.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.077+0000 7f49e959a640 1 -- 172.21.15.45:0/978318856 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49dc032740 con 0x7f49ec105fe0 2024-09-15T22:06:20.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.078+0000 7f49f095c640 1 -- 172.21.15.45:0/978318856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 msgr2=0x7f49ec1063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:20.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.078+0000 7f49f095c640 1 --2- 172.21.15.45:0/978318856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 0x7f49ec1063e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009820 tx=0x7f49dc02a270 comp rx=0 tx=0).stop 2024-09-15T22:06:20.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.078+0000 7f49f095c640 1 -- 172.21.15.45:0/978318856 shutdown_connections 2024-09-15T22:06:20.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.078+0000 7f49f095c640 1 --2- 172.21.15.45:0/978318856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 0x7f49ec1063e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:20.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.078+0000 7f49f095c640 1 -- 172.21.15.45:0/978318856 >> 172.21.15.45:0/978318856 conn(0x7f49ec101df0 msgr2=0x7f49ec104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:20.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.078+0000 7f49f095c640 1 -- 172.21.15.45:0/978318856 shutdown_connections 2024-09-15T22:06:20.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.078+0000 7f49f095c640 1 -- 172.21.15.45:0/978318856 wait complete. 2024-09-15T22:06:20.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.079+0000 7f49f095c640 1 Processor -- start 2024-09-15T22:06:20.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.079+0000 7f49f095c640 1 -- start start 2024-09-15T22:06:20.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.079+0000 7f49f095c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 0x7f49ec19d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:20.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.079+0000 7f49f095c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f49ec106d40 con 0x7f49ec105fe0 2024-09-15T22:06:20.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.080+0000 7f49ea59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 0x7f49ec19d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:20.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.080+0000 7f49ea59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 0x7f49ec19d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57520/0 (socket says 172.21.15.45:57520) 2024-09-15T22:06:20.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.080+0000 7f49ea59c640 1 -- 172.21.15.45:0/1378149778 learned_addr learned my addr 172.21.15.45:0/1378149778 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:20.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.080+0000 7f49ea59c640 1 -- 172.21.15.45:0/1378149778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ec19d5c0 con 0x7f49ec105fe0 2024-09-15T22:06:20.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.080+0000 7f49ea59c640 1 --2- 172.21.15.45:0/1378149778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 0x7f49ec19d080 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0090b0 tx=0x7f49dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:20.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.080+0000 7f49db7fe640 1 -- 172.21.15.45:0/1378149778 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49dc041070 con 0x7f49ec105fe0 2024-09-15T22:06:20.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.080+0000 7f49db7fe640 1 -- 172.21.15.45:0/1378149778 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc03c7a0 con 0x7f49ec105fe0 2024-09-15T22:06:20.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.080+0000 7f49db7fe640 1 -- 172.21.15.45:0/1378149778 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49dc037040 con 0x7f49ec105fe0 2024-09-15T22:06:20.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.080+0000 7f49f095c640 1 -- 172.21.15.45:0/1378149778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49ec19d850 con 0x7f49ec105fe0 2024-09-15T22:06:20.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.080+0000 7f49f095c640 1 -- 172.21.15.45:0/1378149778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49ec1a0540 con 0x7f49ec105fe0 2024-09-15T22:06:20.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.081+0000 7f49db7fe640 1 -- 172.21.15.45:0/1378149778 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f49dc044070 con 0x7f49ec105fe0 2024-09-15T22:06:20.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.081+0000 7f49db7fe640 1 -- 172.21.15.45:0/1378149778 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f49dc03d3f0 con 0x7f49ec105fe0 2024-09-15T22:06:20.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.081+0000 7f49f095c640 1 -- 172.21.15.45:0/1378149778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49ec106460 con 0x7f49ec105fe0 2024-09-15T22:06:20.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.084+0000 7f49db7fe640 1 -- 172.21.15.45:0/1378149778 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f49dc046450 con 0x7f49ec105fe0 2024-09-15T22:06:20.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.146+0000 7f49f095c640 1 -- 172.21.15.45:0/1378149778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f49ec1a0a90 con 0x7f49ec105fe0 2024-09-15T22:06:20.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.146+0000 7f49db7fe640 1 -- 172.21.15.45:0/1378149778 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f49dc046630 con 0x7f49ec105fe0 2024-09-15T22:06:20.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.147+0000 7f49f095c640 1 -- 172.21.15.45:0/1378149778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 msgr2=0x7f49ec19d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:20.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.147+0000 7f49f095c640 1 --2- 172.21.15.45:0/1378149778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 0x7f49ec19d080 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0090b0 tx=0x7f49dc0046c0 comp rx=0 tx=0).stop 2024-09-15T22:06:20.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.147+0000 7f49f095c640 1 -- 172.21.15.45:0/1378149778 shutdown_connections 2024-09-15T22:06:20.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.147+0000 7f49f095c640 1 --2- 172.21.15.45:0/1378149778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49ec105fe0 0x7f49ec19d080 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:20.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.147+0000 7f49f095c640 1 -- 172.21.15.45:0/1378149778 >> 172.21.15.45:0/1378149778 conn(0x7f49ec101df0 msgr2=0x7f49ec193660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:20.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.147+0000 7f49f095c640 1 -- 172.21.15.45:0/1378149778 shutdown_connections 2024-09-15T22:06:20.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:20.147+0000 7f49f095c640 1 -- 172.21.15.45:0/1378149778 wait complete. 2024-09-15T22:06:20.736 INFO:teuthology.orchestra.run.smithi045.stdout:mon is available 2024-09-15T22:06:20.736 INFO:teuthology.orchestra.run.smithi045.stdout:Assimilating anything we can from ceph.conf... 2024-09-15T22:06:21.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:21 smithi045 ceph-mon[30810]: from='client.? 172.21.15.45:0/3852261378' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T22:06:21.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:21 smithi045 ceph-mon[30810]: from='client.? 172.21.15.45:0/3852261378' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-15T22:06:21.813 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-15T22:06:21.814 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T22:06:21.814 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout fsid = a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:06:21.814 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.45:3300,v1:172.21.15.45:6789] 2024-09-15T22:06:21.814 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T22:06:21.814 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T22:06:21.814 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T22:06:21.814 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T22:06:21.814 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-15T22:06:21.814 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T22:06:21.814 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T22:06:21.814 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-15T22:06:21.814 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T22:06:21.815 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T22:06:21.815 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T22:06:21.815 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T22:06:21.815 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T22:06:21.815 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T22:06:21.815 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.145+0000 7f369ca6e640 1 Processor -- start 2024-09-15T22:06:21.815 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.145+0000 7f369ca6e640 1 -- start start 2024-09-15T22:06:21.815 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.146+0000 7f369ca6e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 0x7f369810a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:21.815 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.146+0000 7f369ca6e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f369807be50 con 0x7f3698108170 2024-09-15T22:06:21.815 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.146+0000 7f369659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 0x7f369810a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:21.815 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.146+0000 7f369659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 0x7f369810a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57530/0 (socket says 172.21.15.45:57530) 2024-09-15T22:06:21.815 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.146+0000 7f369659c640 1 -- 172.21.15.45:0/4137404693 learned_addr learned my addr 172.21.15.45:0/4137404693 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:21.815 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.146+0000 7f369659c640 1 -- 172.21.15.45:0/4137404693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369810aaa0 con 0x7f3698108170 2024-09-15T22:06:21.816 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.147+0000 7f369659c640 1 --2- 172.21.15.45:0/4137404693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 0x7f369810a560 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3688009820 tx=0x7f368802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dcd11ee4d7aa17 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:21.816 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.147+0000 7f369559a640 1 -- 172.21.15.45:0/4137404693 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3688037070 con 0x7f3698108170 2024-09-15T22:06:21.816 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.147+0000 7f369559a640 1 -- 172.21.15.45:0/4137404693 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3688032440 con 0x7f3698108170 2024-09-15T22:06:21.816 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.147+0000 7f369559a640 1 -- 172.21.15.45:0/4137404693 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3688032740 con 0x7f3698108170 2024-09-15T22:06:21.816 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.147+0000 7f369ca6e640 1 -- 172.21.15.45:0/4137404693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 msgr2=0x7f369810a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:21.816 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.148+0000 7f369ca6e640 1 --2- 172.21.15.45:0/4137404693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 0x7f369810a560 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f3688009820 tx=0x7f368802a270 comp rx=0 tx=0).stop 2024-09-15T22:06:21.816 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.148+0000 7f369ca6e640 1 -- 172.21.15.45:0/4137404693 shutdown_connections 2024-09-15T22:06:21.816 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.148+0000 7f369ca6e640 1 --2- 172.21.15.45:0/4137404693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 0x7f369810a560 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:21.816 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.148+0000 7f369ca6e640 1 -- 172.21.15.45:0/4137404693 >> 172.21.15.45:0/4137404693 conn(0x7f3698101df0 msgr2=0x7f3698104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:21.816 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.148+0000 7f369ca6e640 1 -- 172.21.15.45:0/4137404693 shutdown_connections 2024-09-15T22:06:21.816 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.148+0000 7f369ca6e640 1 -- 172.21.15.45:0/4137404693 wait complete. 2024-09-15T22:06:21.816 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.148+0000 7f369ca6e640 1 Processor -- start 2024-09-15T22:06:21.817 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.148+0000 7f369ca6e640 1 -- start start 2024-09-15T22:06:21.817 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.149+0000 7f369ca6e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 0x7f369819d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:21.817 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.149+0000 7f369ca6e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f369810af80 con 0x7f3698108170 2024-09-15T22:06:21.817 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.149+0000 7f369659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 0x7f369819d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:21.817 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.149+0000 7f369659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 0x7f369819d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57546/0 (socket says 172.21.15.45:57546) 2024-09-15T22:06:21.817 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.149+0000 7f369659c640 1 -- 172.21.15.45:0/3852261378 learned_addr learned my addr 172.21.15.45:0/3852261378 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:21.817 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.149+0000 7f369659c640 1 -- 172.21.15.45:0/3852261378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369819d650 con 0x7f3698108170 2024-09-15T22:06:21.817 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.149+0000 7f369659c640 1 --2- 172.21.15.45:0/3852261378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 0x7f369819d110 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f36880090b0 tx=0x7f36880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:21.817 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.149+0000 7f36877fe640 1 -- 172.21.15.45:0/3852261378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3688041070 con 0x7f3698108170 2024-09-15T22:06:21.817 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.149+0000 7f36877fe640 1 -- 172.21.15.45:0/3852261378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f368803c7a0 con 0x7f3698108170 2024-09-15T22:06:21.817 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.149+0000 7f369ca6e640 1 -- 172.21.15.45:0/3852261378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f369819d8e0 con 0x7f3698108170 2024-09-15T22:06:21.817 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.149+0000 7f36877fe640 1 -- 172.21.15.45:0/3852261378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3688037040 con 0x7f3698108170 2024-09-15T22:06:21.817 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.149+0000 7f369ca6e640 1 -- 172.21.15.45:0/3852261378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36981a05d0 con 0x7f3698108170 2024-09-15T22:06:21.818 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.150+0000 7f36877fe640 1 -- 172.21.15.45:0/3852261378 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3688044070 con 0x7f3698108170 2024-09-15T22:06:21.818 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.150+0000 7f36877fe640 1 -- 172.21.15.45:0/3852261378 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f368803d3f0 con 0x7f3698108170 2024-09-15T22:06:21.818 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.150+0000 7f369ca6e640 1 -- 172.21.15.45:0/3852261378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36981085d0 con 0x7f3698108170 2024-09-15T22:06:21.818 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.153+0000 7f36877fe640 1 -- 172.21.15.45:0/3852261378 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3688046450 con 0x7f3698108170 2024-09-15T22:06:21.818 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.212+0000 7f369ca6e640 1 -- 172.21.15.45:0/3852261378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f369802d940 con 0x7f3698108170 2024-09-15T22:06:21.818 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.215+0000 7f36877fe640 1 -- 172.21.15.45:0/3852261378 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f3688046630 con 0x7f3698108170 2024-09-15T22:06:21.818 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.215+0000 7f36877fe640 1 -- 172.21.15.45:0/3852261378 <== mon.0 v2:172.21.15.45:3300/0 8 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f3688056070 con 0x7f3698108170 2024-09-15T22:06:21.818 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.216+0000 7f369ca6e640 1 -- 172.21.15.45:0/3852261378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 msgr2=0x7f369819d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:21.818 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.216+0000 7f369ca6e640 1 --2- 172.21.15.45:0/3852261378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 0x7f369819d110 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f36880090b0 tx=0x7f36880046c0 comp rx=0 tx=0).stop 2024-09-15T22:06:21.818 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.216+0000 7f369ca6e640 1 -- 172.21.15.45:0/3852261378 shutdown_connections 2024-09-15T22:06:21.818 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.216+0000 7f369ca6e640 1 --2- 172.21.15.45:0/3852261378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3698108170 0x7f369819d110 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:21.818 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.216+0000 7f369ca6e640 1 -- 172.21.15.45:0/3852261378 >> 172.21.15.45:0/3852261378 conn(0x7f3698101df0 msgr2=0x7f36981034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:21.818 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.216+0000 7f369ca6e640 1 -- 172.21.15.45:0/3852261378 shutdown_connections 2024-09-15T22:06:21.819 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:21.216+0000 7f369ca6e640 1 -- 172.21.15.45:0/3852261378 wait complete. 2024-09-15T22:06:21.819 INFO:teuthology.orchestra.run.smithi045.stdout:Generating new minimal ceph.conf... 2024-09-15T22:06:25.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:24 smithi045 ceph-mon[30810]: from='client.? 172.21.15.45:0/4247108160' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:06:31.732 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.874+0000 7fbc5029c640 1 Processor -- start 2024-09-15T22:06:31.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.874+0000 7fbc5029c640 1 -- start start 2024-09-15T22:06:31.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.875+0000 7fbc5029c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 0x7fbc4810a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:31.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.875+0000 7fbc5029c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4807be50 con 0x7fbc48108170 2024-09-15T22:06:31.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.875+0000 7fbc4e038640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 0x7fbc4810a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:31.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.875+0000 7fbc4e038640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 0x7fbc4810a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42558/0 (socket says 172.21.15.45:42558) 2024-09-15T22:06:31.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.875+0000 7fbc4e038640 1 -- 172.21.15.45:0/2049880563 learned_addr learned my addr 172.21.15.45:0/2049880563 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:31.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.875+0000 7fbc4e038640 1 -- 172.21.15.45:0/2049880563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4810aaa0 con 0x7fbc48108170 2024-09-15T22:06:31.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.876+0000 7fbc4e038640 1 --2- 172.21.15.45:0/2049880563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 0x7fbc4810a560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009820 tx=0x7fbc4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4dbbcd21953e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:31.733 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.876+0000 7fbc4d036640 1 -- 172.21.15.45:0/2049880563 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc44037070 con 0x7fbc48108170 2024-09-15T22:06:31.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.876+0000 7fbc4d036640 1 -- 172.21.15.45:0/2049880563 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fbc44032920 con 0x7fbc48108170 2024-09-15T22:06:31.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.876+0000 7fbc4d036640 1 -- 172.21.15.45:0/2049880563 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc44030950 con 0x7fbc48108170 2024-09-15T22:06:31.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.877+0000 7fbc5029c640 1 -- 172.21.15.45:0/2049880563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 msgr2=0x7fbc4810a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:31.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.877+0000 7fbc5029c640 1 --2- 172.21.15.45:0/2049880563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 0x7fbc4810a560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fbc44009820 tx=0x7fbc4402a270 comp rx=0 tx=0).stop 2024-09-15T22:06:31.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.877+0000 7fbc5029c640 1 -- 172.21.15.45:0/2049880563 shutdown_connections 2024-09-15T22:06:31.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.877+0000 7fbc5029c640 1 --2- 172.21.15.45:0/2049880563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 0x7fbc4810a560 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:31.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.877+0000 7fbc5029c640 1 -- 172.21.15.45:0/2049880563 >> 172.21.15.45:0/2049880563 conn(0x7fbc48101df0 msgr2=0x7fbc48104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:31.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.877+0000 7fbc5029c640 1 -- 172.21.15.45:0/2049880563 shutdown_connections 2024-09-15T22:06:31.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.877+0000 7fbc5029c640 1 -- 172.21.15.45:0/2049880563 wait complete. 2024-09-15T22:06:31.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.877+0000 7fbc5029c640 1 Processor -- start 2024-09-15T22:06:31.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.877+0000 7fbc5029c640 1 -- start start 2024-09-15T22:06:31.734 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.878+0000 7fbc5029c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 0x7fbc4819d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:31.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.878+0000 7fbc5029c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbc4810bb40 con 0x7fbc48108170 2024-09-15T22:06:31.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.878+0000 7fbc4e038640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 0x7fbc4819d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:31.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.878+0000 7fbc4e038640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 0x7fbc4819d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42574/0 (socket says 172.21.15.45:42574) 2024-09-15T22:06:31.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.878+0000 7fbc4e038640 1 -- 172.21.15.45:0/4247108160 learned_addr learned my addr 172.21.15.45:0/4247108160 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:31.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.878+0000 7fbc4e038640 1 -- 172.21.15.45:0/4247108160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc4819de40 con 0x7fbc48108170 2024-09-15T22:06:31.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.878+0000 7fbc4e038640 1 --2- 172.21.15.45:0/4247108160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 0x7fbc4819d900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbc44031000 tx=0x7fbc44032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:31.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.878+0000 7fbc3f7fe640 1 -- 172.21.15.45:0/4247108160 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc44042070 con 0x7fbc48108170 2024-09-15T22:06:31.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.878+0000 7fbc3f7fe640 1 -- 172.21.15.45:0/4247108160 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fbc440326b0 con 0x7fbc48108170 2024-09-15T22:06:31.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.878+0000 7fbc5029c640 1 -- 172.21.15.45:0/4247108160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc4819e0d0 con 0x7fbc48108170 2024-09-15T22:06:31.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.878+0000 7fbc3f7fe640 1 -- 172.21.15.45:0/4247108160 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbc44037040 con 0x7fbc48108170 2024-09-15T22:06:31.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.878+0000 7fbc5029c640 1 -- 172.21.15.45:0/4247108160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc481a0dc0 con 0x7fbc48108170 2024-09-15T22:06:31.735 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.879+0000 7fbc3f7fe640 1 -- 172.21.15.45:0/4247108160 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbc44045070 con 0x7fbc48108170 2024-09-15T22:06:31.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.879+0000 7fbc3f7fe640 1 -- 172.21.15.45:0/4247108160 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbc44047bc0 con 0x7fbc48108170 2024-09-15T22:06:31.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.879+0000 7fbc5029c640 1 -- 172.21.15.45:0/4247108160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc481085d0 con 0x7fbc48108170 2024-09-15T22:06:31.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.882+0000 7fbc3f7fe640 1 -- 172.21.15.45:0/4247108160 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fbc4403dbf0 con 0x7fbc48108170 2024-09-15T22:06:31.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.942+0000 7fbc5029c640 1 -- 172.21.15.45:0/4247108160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fbc481a1330 con 0x7fbc48108170 2024-09-15T22:06:31.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.942+0000 7fbc3f7fe640 1 -- 172.21.15.45:0/4247108160 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fbc4403d430 con 0x7fbc48108170 2024-09-15T22:06:31.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.943+0000 7fbc5029c640 1 -- 172.21.15.45:0/4247108160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 msgr2=0x7fbc4819d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:31.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.943+0000 7fbc5029c640 1 --2- 172.21.15.45:0/4247108160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 0x7fbc4819d900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbc44031000 tx=0x7fbc44032e40 comp rx=0 tx=0).stop 2024-09-15T22:06:31.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.943+0000 7fbc5029c640 1 -- 172.21.15.45:0/4247108160 shutdown_connections 2024-09-15T22:06:31.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.943+0000 7fbc5029c640 1 --2- 172.21.15.45:0/4247108160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc48108170 0x7fbc4819d900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:31.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.943+0000 7fbc5029c640 1 -- 172.21.15.45:0/4247108160 >> 172.21.15.45:0/4247108160 conn(0x7fbc48101df0 msgr2=0x7fbc48102980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:31.736 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.943+0000 7fbc5029c640 1 -- 172.21.15.45:0/4247108160 shutdown_connections 2024-09-15T22:06:31.737 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:24.943+0000 7fbc5029c640 1 -- 172.21.15.45:0/4247108160 wait complete. 2024-09-15T22:06:31.737 INFO:teuthology.orchestra.run.smithi045.stdout:Restarting the monitor... 2024-09-15T22:06:32.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:31 smithi045 systemd[1]: Stopping Ceph mon.a for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:06:33.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:32 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a[30803]: 2024-09-15T22:06:32.858+0000 7ff954746640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:06:33.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:32 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a[30803]: 2024-09-15T22:06:32.858+0000 7ff954746640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-15T22:06:33.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:33 smithi045 podman[31059]: 2024-09-15 22:06:33.085516707 +0000 UTC m=+1.161552631 container died 442c8a5b7764b5c5b8d95edba16f0804b4665d124e7fe1d044f2b6979a8dc889 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:06:33.712 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:33 smithi045 podman[31059]: 2024-09-15 22:06:33.476406738 +0000 UTC m=+1.552442661 container cleanup 442c8a5b7764b5c5b8d95edba16f0804b4665d124e7fe1d044f2b6979a8dc889 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-15T22:06:33.712 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:33 smithi045 bash[31059]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a 2024-09-15T22:06:34.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:33 smithi045 podman[31070]: 2024-09-15 22:06:33.710636737 +0000 UTC m=+0.615872030 container remove 442c8a5b7764b5c5b8d95edba16f0804b4665d124e7fe1d044f2b6979a8dc889 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-15T22:06:34.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:33 smithi045 systemd[1]: ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-15T22:06:34.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:33 smithi045 systemd[1]: Stopped Ceph mon.a for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:06:34.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:33 smithi045 systemd[1]: Starting Ceph mon.a for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:06:34.356 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 podman[31161]: 2024-09-15 22:06:34.002138965 +0000 UTC m=+0.035304346 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:06:34.356 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 podman[31161]: 2024-09-15 22:06:34.111439198 +0000 UTC m=+0.144604579 container create 4d4f2538640b1bf5160a6dcc6e159dcddccd3aa13995f576650af785e6a43f98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-15T22:06:34.356 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 podman[31161]: 2024-09-15 22:06:34.33032788 +0000 UTC m=+0.363493261 container init 4d4f2538640b1bf5160a6dcc6e159dcddccd3aa13995f576650af785e6a43f98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2) 2024-09-15T22:06:34.356 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 podman[31161]: 2024-09-15 22:06:34.333418106 +0000 UTC m=+0.366583484 container start 4d4f2538640b1bf5160a6dcc6e159dcddccd3aa13995f576650af785e6a43f98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-15T22:06:34.356 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T22:06:34.411 INFO:teuthology.orchestra.run.smithi045.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-15T22:06:34.622 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T22:06:34.622 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: pidfile_write: ignore empty --pid-file 2024-09-15T22:06:34.622 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: load: jerasure load: lrc 2024-09-15T22:06:34.622 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: RocksDB version: 7.9.2 2024-09-15T22:06:34.622 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Git sha 0 2024-09-15T22:06:34.622 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T22:06:34.623 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: DB SUMMARY 2024-09-15T22:06:34.623 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: DB Session ID: X3QBNGQRWL0UGDUZQUUD 2024-09-15T22:06:34.623 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: CURRENT file: CURRENT 2024-09-15T22:06:34.623 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T22:06:34.623 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-15T22:06:34.623 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-15T22:06:34.623 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105190 ; 2024-09-15T22:06:34.623 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.error_if_exists: 0 2024-09-15T22:06:34.623 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.create_if_missing: 0 2024-09-15T22:06:34.624 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.paranoid_checks: 1 2024-09-15T22:06:34.624 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T22:06:34.624 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T22:06:34.624 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T22:06:34.624 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.env: 0x55ef56418940 2024-09-15T22:06:34.624 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T22:06:34.624 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.info_log: 0x55ef5708f6e0 2024-09-15T22:06:34.624 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T22:06:34.624 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.statistics: (nil) 2024-09-15T22:06:34.624 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.use_fsync: 0 2024-09-15T22:06:34.625 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_log_file_size: 0 2024-09-15T22:06:34.625 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T22:06:34.625 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T22:06:34.625 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T22:06:34.625 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T22:06:34.625 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.allow_fallocate: 1 2024-09-15T22:06:34.625 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T22:06:34.625 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T22:06:34.625 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.use_direct_reads: 0 2024-09-15T22:06:34.625 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T22:06:34.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T22:06:34.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.db_log_dir: 2024-09-15T22:06:34.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.wal_dir: 2024-09-15T22:06:34.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T22:06:34.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T22:06:34.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T22:06:34.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T22:06:34.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T22:06:34.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T22:06:34.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T22:06:34.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T22:06:34.627 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.write_buffer_manager: 0x55ef5709edc0 2024-09-15T22:06:34.627 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T22:06:34.627 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T22:06:34.627 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T22:06:34.627 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T22:06:34.627 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T22:06:34.627 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T22:06:34.627 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T22:06:34.627 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T22:06:34.627 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.unordered_write: 0 2024-09-15T22:06:34.627 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T22:06:34.628 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T22:06:34.628 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T22:06:34.628 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T22:06:34.628 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.row_cache: None 2024-09-15T22:06:34.628 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.wal_filter: None 2024-09-15T22:06:34.628 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T22:06:34.628 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T22:06:34.628 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.two_write_queues: 0 2024-09-15T22:06:34.628 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T22:06:34.628 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.wal_compression: 0 2024-09-15T22:06:34.629 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.atomic_flush: 0 2024-09-15T22:06:34.629 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T22:06:34.629 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T22:06:34.629 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T22:06:34.629 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.log_readahead_size: 0 2024-09-15T22:06:34.629 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T22:06:34.629 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T22:06:34.629 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T22:06:34.629 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T22:06:34.629 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T22:06:34.629 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T22:06:34.629 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T22:06:34.631 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_background_jobs: 2 2024-09-15T22:06:34.631 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_background_compactions: -1 2024-09-15T22:06:34.631 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_subcompactions: 1 2024-09-15T22:06:34.632 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T22:06:34.632 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T22:06:34.632 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T22:06:34.632 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T22:06:34.632 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T22:06:34.632 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T22:06:34.632 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T22:06:34.632 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T22:06:34.632 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_open_files: -1 2024-09-15T22:06:34.632 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T22:06:34.633 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T22:06:34.633 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T22:06:34.633 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T22:06:34.633 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_background_flushes: -1 2024-09-15T22:06:34.633 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Compression algorithms supported: 2024-09-15T22:06:34.633 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: kZSTD supported: 0 2024-09-15T22:06:34.633 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: kXpressCompression supported: 0 2024-09-15T22:06:34.633 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: kBZip2Compression supported: 0 2024-09-15T22:06:34.633 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T22:06:34.633 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: kLZ4Compression supported: 1 2024-09-15T22:06:34.634 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: kZlibCompression supported: 1 2024-09-15T22:06:34.634 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T22:06:34.634 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: kSnappyCompression supported: 1 2024-09-15T22:06:34.634 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T22:06:34.634 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T22:06:34.634 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-15T22:06:34.634 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T22:06:34.634 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T22:06:34.634 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.merge_operator: 2024-09-15T22:06:34.634 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compaction_filter: None 2024-09-15T22:06:34.635 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T22:06:34.635 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T22:06:34.635 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T22:06:34.635 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T22:06:34.635 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ef5708f320) 2024-09-15T22:06:34.635 INFO:journalctl@ceph.mon.a.smithi045.stdout: cache_index_and_filter_blocks: 1 2024-09-15T22:06:34.635 INFO:journalctl@ceph.mon.a.smithi045.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T22:06:34.635 INFO:journalctl@ceph.mon.a.smithi045.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T22:06:34.635 INFO:journalctl@ceph.mon.a.smithi045.stdout: pin_top_level_index_and_filter: 1 2024-09-15T22:06:34.635 INFO:journalctl@ceph.mon.a.smithi045.stdout: index_type: 0 2024-09-15T22:06:34.635 INFO:journalctl@ceph.mon.a.smithi045.stdout: data_block_index_type: 0 2024-09-15T22:06:34.636 INFO:journalctl@ceph.mon.a.smithi045.stdout: index_shortening: 1 2024-09-15T22:06:34.636 INFO:journalctl@ceph.mon.a.smithi045.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T22:06:34.636 INFO:journalctl@ceph.mon.a.smithi045.stdout: checksum: 4 2024-09-15T22:06:34.636 INFO:journalctl@ceph.mon.a.smithi045.stdout: no_block_cache: 0 2024-09-15T22:06:34.636 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_cache: 0x55ef570831f0 2024-09-15T22:06:34.636 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_cache_name: BinnedLRUCache 2024-09-15T22:06:34.636 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_cache_options: 2024-09-15T22:06:34.636 INFO:journalctl@ceph.mon.a.smithi045.stdout: capacity : 536870912 2024-09-15T22:06:34.636 INFO:journalctl@ceph.mon.a.smithi045.stdout: num_shard_bits : 4 2024-09-15T22:06:34.636 INFO:journalctl@ceph.mon.a.smithi045.stdout: strict_capacity_limit : 0 2024-09-15T22:06:34.636 INFO:journalctl@ceph.mon.a.smithi045.stdout: high_pri_pool_ratio: 0.000 2024-09-15T22:06:34.636 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_cache_compressed: (nil) 2024-09-15T22:06:34.637 INFO:journalctl@ceph.mon.a.smithi045.stdout: persistent_cache: (nil) 2024-09-15T22:06:34.637 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_size: 4096 2024-09-15T22:06:34.637 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_size_deviation: 10 2024-09-15T22:06:34.637 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_restart_interval: 16 2024-09-15T22:06:34.637 INFO:journalctl@ceph.mon.a.smithi045.stdout: index_block_restart_interval: 1 2024-09-15T22:06:34.637 INFO:journalctl@ceph.mon.a.smithi045.stdout: metadata_block_size: 4096 2024-09-15T22:06:34.637 INFO:journalctl@ceph.mon.a.smithi045.stdout: partition_filters: 0 2024-09-15T22:06:34.637 INFO:journalctl@ceph.mon.a.smithi045.stdout: use_delta_encoding: 1 2024-09-15T22:06:34.637 INFO:journalctl@ceph.mon.a.smithi045.stdout: filter_policy: bloomfilter 2024-09-15T22:06:34.637 INFO:journalctl@ceph.mon.a.smithi045.stdout: whole_key_filtering: 1 2024-09-15T22:06:34.638 INFO:journalctl@ceph.mon.a.smithi045.stdout: verify_compression: 0 2024-09-15T22:06:34.638 INFO:journalctl@ceph.mon.a.smithi045.stdout: read_amp_bytes_per_bit: 0 2024-09-15T22:06:34.638 INFO:journalctl@ceph.mon.a.smithi045.stdout: format_version: 5 2024-09-15T22:06:34.638 INFO:journalctl@ceph.mon.a.smithi045.stdout: enable_index_compression: 1 2024-09-15T22:06:34.638 INFO:journalctl@ceph.mon.a.smithi045.stdout: block_align: 0 2024-09-15T22:06:34.638 INFO:journalctl@ceph.mon.a.smithi045.stdout: max_auto_readahead_size: 262144 2024-09-15T22:06:34.638 INFO:journalctl@ceph.mon.a.smithi045.stdout: prepopulate_block_cache: 0 2024-09-15T22:06:34.638 INFO:journalctl@ceph.mon.a.smithi045.stdout: initial_auto_readahead_size: 8192 2024-09-15T22:06:34.638 INFO:journalctl@ceph.mon.a.smithi045.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T22:06:34.638 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T22:06:34.638 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T22:06:34.639 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compression: NoCompression 2024-09-15T22:06:34.639 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T22:06:34.639 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T22:06:34.639 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T22:06:34.639 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.num_levels: 7 2024-09-15T22:06:34.639 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T22:06:34.639 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T22:06:34.639 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T22:06:34.639 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T22:06:34.639 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T22:06:34.639 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T22:06:34.639 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T22:06:34.640 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:06:34.640 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T22:06:34.640 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T22:06:34.640 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:06:34.640 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:06:34.640 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T22:06:34.640 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T22:06:34.640 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T22:06:34.640 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T22:06:34.640 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:06:34.640 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:06:34.640 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T22:06:34.641 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T22:06:34.641 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:06:34.641 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T22:06:34.641 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T22:06:34.641 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T22:06:34.641 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T22:06:34.641 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T22:06:34.641 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T22:06:34.641 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T22:06:34.641 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T22:06:34.641 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T22:06:34.641 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T22:06:34.642 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T22:06:34.642 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T22:06:34.642 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T22:06:34.642 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T22:06:34.642 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T22:06:34.642 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T22:06:34.642 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T22:06:34.642 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T22:06:34.642 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T22:06:34.642 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T22:06:34.642 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T22:06:34.642 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T22:06:34.643 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T22:06:34.643 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T22:06:34.643 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T22:06:34.643 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T22:06:34.643 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T22:06:34.643 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T22:06:34.643 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T22:06:34.643 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T22:06:34.643 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T22:06:34.643 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T22:06:34.644 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T22:06:34.644 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.inplace_update_support: 0 2024-09-15T22:06:34.644 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T22:06:34.644 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T22:06:34.644 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T22:06:34.644 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T22:06:34.644 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.bloom_locality: 0 2024-09-15T22:06:34.644 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.max_successive_merges: 0 2024-09-15T22:06:34.644 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T22:06:34.644 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T22:06:34.645 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T22:06:34.645 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T22:06:34.645 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.ttl: 2592000 2024-09-15T22:06:34.645 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T22:06:34.645 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T22:06:34.645 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T22:06:34.645 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.enable_blob_files: false 2024-09-15T22:06:34.645 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.min_blob_size: 0 2024-09-15T22:06:34.645 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T22:06:34.645 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T22:06:34.645 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T22:06:34.646 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T22:06:34.646 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T22:06:34.646 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T22:06:34.646 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T22:06:34.646 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T22:06:34.646 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-15T22:06:34.646 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-15T22:06:34.646 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 553c6e6a-20b8-4e09-8f02-8f9962ab998c 2024-09-15T22:06:34.646 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726437994360402, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-15T22:06:34.646 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-15T22:06:34.647 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726437994361574, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100264, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98149, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14286, "raw_average_key_size": 49, "raw_value_size": 90419, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726437994, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "553c6e6a-20b8-4e09-8f02-8f9962ab998c", "db_session_id": "X3QBNGQRWL0UGDUZQUUD", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-15T22:06:34.647 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726437994361672, "job": 1, "event": "recovery_finished"} 2024-09-15T22:06:34.647 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-15T22:06:34.647 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T22:06:34.647 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ef570b0e00 2024-09-15T22:06:34.647 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: DB pointer 0x55ef571ac000 2024-09-15T22:06:34.647 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T22:06:34.647 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T22:06:34.647 INFO:journalctl@ceph.mon.a.smithi045.stdout: ** DB Stats ** 2024-09-15T22:06:34.647 INFO:journalctl@ceph.mon.a.smithi045.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:06:34.647 INFO:journalctl@ceph.mon.a.smithi045.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T22:06:34.648 INFO:journalctl@ceph.mon.a.smithi045.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:06:34.648 INFO:journalctl@ceph.mon.a.smithi045.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:06:34.648 INFO:journalctl@ceph.mon.a.smithi045.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T22:06:34.648 INFO:journalctl@ceph.mon.a.smithi045.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:06:34.648 INFO:journalctl@ceph.mon.a.smithi045.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:06:34.648 INFO:journalctl@ceph.mon.a.smithi045.stdout: 2024-09-15T22:06:34.648 INFO:journalctl@ceph.mon.a.smithi045.stdout: ** Compaction Stats [default] ** 2024-09-15T22:06:34.648 INFO:journalctl@ceph.mon.a.smithi045.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:06:34.648 INFO:journalctl@ceph.mon.a.smithi045.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T22:06:34.648 INFO:journalctl@ceph.mon.a.smithi045.stdout: L0 2/0 99.77 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:06:34.649 INFO:journalctl@ceph.mon.a.smithi045.stdout: Sum 2/0 99.77 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:06:34.649 INFO:journalctl@ceph.mon.a.smithi045.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:06:34.649 INFO:journalctl@ceph.mon.a.smithi045.stdout: 2024-09-15T22:06:34.649 INFO:journalctl@ceph.mon.a.smithi045.stdout: ** Compaction Stats [default] ** 2024-09-15T22:06:34.649 INFO:journalctl@ceph.mon.a.smithi045.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:06:34.649 INFO:journalctl@ceph.mon.a.smithi045.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T22:06:34.649 INFO:journalctl@ceph.mon.a.smithi045.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 126.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T22:06:34.649 INFO:journalctl@ceph.mon.a.smithi045.stdout: 2024-09-15T22:06:34.649 INFO:journalctl@ceph.mon.a.smithi045.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T22:06:34.650 INFO:journalctl@ceph.mon.a.smithi045.stdout: 2024-09-15T22:06:34.650 INFO:journalctl@ceph.mon.a.smithi045.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:06:34.650 INFO:journalctl@ceph.mon.a.smithi045.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T22:06:34.650 INFO:journalctl@ceph.mon.a.smithi045.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T22:06:34.650 INFO:journalctl@ceph.mon.a.smithi045.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T22:06:34.650 INFO:journalctl@ceph.mon.a.smithi045.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T22:06:34.650 INFO:journalctl@ceph.mon.a.smithi045.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T22:06:34.650 INFO:journalctl@ceph.mon.a.smithi045.stdout: Cumulative compaction: 0.00 GB write, 28.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:06:34.650 INFO:journalctl@ceph.mon.a.smithi045.stdout: Interval compaction: 0.00 GB write, 28.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:06:34.650 INFO:journalctl@ceph.mon.a.smithi045.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T22:06:34.651 INFO:journalctl@ceph.mon.a.smithi045.stdout: Block cache BinnedLRUCache@0x55ef570831f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-15T22:06:34.651 INFO:journalctl@ceph.mon.a.smithi045.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-15T22:06:34.651 INFO:journalctl@ceph.mon.a.smithi045.stdout: 2024-09-15T22:06:34.651 INFO:journalctl@ceph.mon.a.smithi045.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T22:06:34.651 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: starting mon.a rank 0 at public addrs [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] at bind addrs [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:06:34.651 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: mon.a@-1(???) e1 preinit fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:06:34.651 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: mon.a@-1(???).mds e1 new map 2024-09-15T22:06:34.651 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: mon.a@-1(???).mds e1 print_map 2024-09-15T22:06:34.651 INFO:journalctl@ceph.mon.a.smithi045.stdout: e1 2024-09-15T22:06:34.651 INFO:journalctl@ceph.mon.a.smithi045.stdout: btime 2024-09-15T22:06:19:492132+0000 2024-09-15T22:06:34.651 INFO:journalctl@ceph.mon.a.smithi045.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:06:34.651 INFO:journalctl@ceph.mon.a.smithi045.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:06:34.652 INFO:journalctl@ceph.mon.a.smithi045.stdout: legacy client fscid: -1 2024-09-15T22:06:34.652 INFO:journalctl@ceph.mon.a.smithi045.stdout: 2024-09-15T22:06:34.652 INFO:journalctl@ceph.mon.a.smithi045.stdout: No filesystems configured 2024-09-15T22:06:34.652 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T22:06:34.652 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:06:34.652 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:06:34.652 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:06:34.652 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-15T22:06:34.652 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 bash[31161]: 4d4f2538640b1bf5160a6dcc6e159dcddccd3aa13995f576650af785e6a43f98 2024-09-15T22:06:34.653 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 systemd[1]: Started Ceph mon.a for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:06:34.653 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T22:06:34.653 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: monmap epoch 1 2024-09-15T22:06:34.653 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:06:34.653 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: last_changed 2024-09-15T22:06:16.451807+0000 2024-09-15T22:06:34.653 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: created 2024-09-15T22:06:16.451807+0000 2024-09-15T22:06:34.653 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: min_mon_release 19 (squid) 2024-09-15T22:06:34.653 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: election_strategy: 1 2024-09-15T22:06:34.653 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-09-15T22:06:34.654 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: fsmap 2024-09-15T22:06:34.654 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: osdmap e1: 0 total, 0 up, 0 in 2024-09-15T22:06:34.654 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:34 smithi045 ceph-mon[31180]: mgrmap e1: no daemons active 2024-09-15T22:06:35.478 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.807+0000 7effbb965640 1 Processor -- start 2024-09-15T22:06:35.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.808+0000 7effbb965640 1 -- start start 2024-09-15T22:06:35.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.808+0000 7effbb965640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 0x7effb407c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:35.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.808+0000 7effbb965640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7effb407e160 con 0x7effb407dd60 2024-09-15T22:06:35.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.808+0000 7effb9701640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 0x7effb407c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:35.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.808+0000 7effb9701640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 0x7effb407c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59520/0 (socket says 172.21.15.45:59520) 2024-09-15T22:06:35.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.808+0000 7effb9701640 1 -- 172.21.15.45:0/422099611 learned_addr learned my addr 172.21.15.45:0/422099611 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:35.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.808+0000 7effb9701640 1 -- 172.21.15.45:0/422099611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb407c810 con 0x7effb407dd60 2024-09-15T22:06:35.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.810+0000 7effb9701640 1 --2- 172.21.15.45:0/422099611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 0x7effb407c2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7effb0009820 tx=0x7effb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3b9465642b344e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:35.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.811+0000 7effabfff640 1 -- 172.21.15.45:0/422099611 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb0037070 con 0x7effb407dd60 2024-09-15T22:06:35.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.811+0000 7effabfff640 1 -- 172.21.15.45:0/422099611 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7effb0032920 con 0x7effb407dd60 2024-09-15T22:06:35.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.811+0000 7effabfff640 1 -- 172.21.15.45:0/422099611 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb0030950 con 0x7effb407dd60 2024-09-15T22:06:35.480 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.811+0000 7effbb965640 1 -- 172.21.15.45:0/422099611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 msgr2=0x7effb407c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:35.480 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.811+0000 7effbb965640 1 --2- 172.21.15.45:0/422099611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 0x7effb407c2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7effb0009820 tx=0x7effb002a270 comp rx=0 tx=0).stop 2024-09-15T22:06:35.480 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.811+0000 7effbb965640 1 -- 172.21.15.45:0/422099611 shutdown_connections 2024-09-15T22:06:35.480 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.811+0000 7effbb965640 1 --2- 172.21.15.45:0/422099611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 0x7effb407c2d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:35.480 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.811+0000 7effbb965640 1 -- 172.21.15.45:0/422099611 >> 172.21.15.45:0/422099611 conn(0x7effb4102fc0 msgr2=0x7effb41053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:35.480 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.811+0000 7effbb965640 1 -- 172.21.15.45:0/422099611 shutdown_connections 2024-09-15T22:06:35.480 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.811+0000 7effbb965640 1 -- 172.21.15.45:0/422099611 wait complete. 2024-09-15T22:06:35.480 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.812+0000 7effbb965640 1 Processor -- start 2024-09-15T22:06:35.480 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.812+0000 7effbb965640 1 -- start start 2024-09-15T22:06:35.480 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.812+0000 7effbb965640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 0x7effb419d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:35.480 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.812+0000 7effbb965640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7effb410dcb0 con 0x7effb407dd60 2024-09-15T22:06:35.480 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.812+0000 7effb9701640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 0x7effb419d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:35.481 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.812+0000 7effb9701640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 0x7effb419d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59530/0 (socket says 172.21.15.45:59530) 2024-09-15T22:06:35.481 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.812+0000 7effb9701640 1 -- 172.21.15.45:0/2269552089 learned_addr learned my addr 172.21.15.45:0/2269552089 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:35.481 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.813+0000 7effb9701640 1 -- 172.21.15.45:0/2269552089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb419de30 con 0x7effb407dd60 2024-09-15T22:06:35.481 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.813+0000 7effb9701640 1 --2- 172.21.15.45:0/2269552089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 0x7effb419d8f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7effb0031000 tx=0x7effb0032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:35.481 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.813+0000 7effaa7fc640 1 -- 172.21.15.45:0/2269552089 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb0042070 con 0x7effb407dd60 2024-09-15T22:06:35.481 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.813+0000 7effaa7fc640 1 -- 172.21.15.45:0/2269552089 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7effb00326b0 con 0x7effb407dd60 2024-09-15T22:06:35.481 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.813+0000 7effbb965640 1 -- 172.21.15.45:0/2269552089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb419e0c0 con 0x7effb407dd60 2024-09-15T22:06:35.481 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.813+0000 7effaa7fc640 1 -- 172.21.15.45:0/2269552089 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effb0037040 con 0x7effb407dd60 2024-09-15T22:06:35.481 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.813+0000 7effbb965640 1 -- 172.21.15.45:0/2269552089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb41a0db0 con 0x7effb407dd60 2024-09-15T22:06:35.481 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.813+0000 7effaa7fc640 1 -- 172.21.15.45:0/2269552089 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7effb0045070 con 0x7effb407dd60 2024-09-15T22:06:35.481 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.813+0000 7effaa7fc640 1 -- 172.21.15.45:0/2269552089 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7effb0047bc0 con 0x7effb407dd60 2024-09-15T22:06:35.481 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.814+0000 7effbb965640 1 -- 172.21.15.45:0/2269552089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb407c350 con 0x7effb407dd60 2024-09-15T22:06:35.481 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.816+0000 7effaa7fc640 1 -- 172.21.15.45:0/2269552089 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7effb003dbf0 con 0x7effb407dd60 2024-09-15T22:06:35.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.876+0000 7effbb965640 1 -- 172.21.15.45:0/2269552089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7effb41a13a0 con 0x7effb407dd60 2024-09-15T22:06:35.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.878+0000 7effaa7fc640 1 -- 172.21.15.45:0/2269552089 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7effb003d430 con 0x7effb407dd60 2024-09-15T22:06:35.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.879+0000 7effbb965640 1 -- 172.21.15.45:0/2269552089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 msgr2=0x7effb419d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:35.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.879+0000 7effbb965640 1 --2- 172.21.15.45:0/2269552089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 0x7effb419d8f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7effb0031000 tx=0x7effb0032e40 comp rx=0 tx=0).stop 2024-09-15T22:06:35.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.879+0000 7effbb965640 1 -- 172.21.15.45:0/2269552089 shutdown_connections 2024-09-15T22:06:35.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.879+0000 7effbb965640 1 --2- 172.21.15.45:0/2269552089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effb407dd60 0x7effb419d8f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:35.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.879+0000 7effbb965640 1 -- 172.21.15.45:0/2269552089 >> 172.21.15.45:0/2269552089 conn(0x7effb4102fc0 msgr2=0x7effb4103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:35.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.879+0000 7effbb965640 1 -- 172.21.15.45:0/2269552089 shutdown_connections 2024-09-15T22:06:35.482 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:34.879+0000 7effbb965640 1 -- 172.21.15.45:0/2269552089 wait complete. 2024-09-15T22:06:35.482 INFO:teuthology.orchestra.run.smithi045.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-15T22:06:35.504 INFO:teuthology.orchestra.run.smithi045.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:06:35.504 INFO:teuthology.orchestra.run.smithi045.stdout:Creating mgr... 2024-09-15T22:06:35.504 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-15T22:06:35.505 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-15T22:06:35.763 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a1911414-73ae-11ef-bceb-c7b262605968@mgr.x 2024-09-15T22:06:35.763 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a1911414-73ae-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-a1911414-73ae-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-15T22:06:35.918 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a1911414-73ae-11ef-bceb-c7b262605968.target.wants/ceph-a1911414-73ae-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-a1911414-73ae-11ef-bceb-c7b262605968@.service. 2024-09-15T22:06:36.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:35 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2269552089' entity='client.admin' 2024-09-15T22:06:36.050 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:35 smithi045 systemd[1]: Starting Ceph mgr.x for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:06:36.433 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:36 smithi045 podman[31392]: 2024-09-15 22:06:36.147366993 +0000 UTC m=+0.112363536 container create 918e77660f125130f13f3efd75ec18c2242a0bc6bf3a3828b3c08cef47fe1475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-15T22:06:36.434 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:36 smithi045 podman[31392]: 2024-09-15 22:06:36.051292387 +0000 UTC m=+0.016288903 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:06:36.434 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:36 smithi045 podman[31392]: 2024-09-15 22:06:36.35790391 +0000 UTC m=+0.322900412 container init 918e77660f125130f13f3efd75ec18c2242a0bc6bf3a3828b3c08cef47fe1475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-15T22:06:36.434 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:36 smithi045 podman[31392]: 2024-09-15 22:06:36.360765207 +0000 UTC m=+0.325761721 container start 918e77660f125130f13f3efd75ec18c2242a0bc6bf3a3828b3c08cef47fe1475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:06:36.434 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:36 smithi045 bash[31392]: 918e77660f125130f13f3efd75ec18c2242a0bc6bf3a3828b3c08cef47fe1475 2024-09-15T22:06:36.448 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:06:36.448 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout disabled 2024-09-15T22:06:36.456 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:06:36.456 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-09-15T22:06:36.456 INFO:teuthology.orchestra.run.smithi045.stdout:firewalld.service is not enabled 2024-09-15T22:06:36.456 INFO:teuthology.orchestra.run.smithi045.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T22:06:36.465 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:06:36.465 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout disabled 2024-09-15T22:06:36.473 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:06:36.473 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-09-15T22:06:36.473 INFO:teuthology.orchestra.run.smithi045.stdout:firewalld.service is not enabled 2024-09-15T22:06:36.473 INFO:teuthology.orchestra.run.smithi045.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-15T22:06:36.473 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mgr to start... 2024-09-15T22:06:36.473 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mgr... 2024-09-15T22:06:36.707 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:36 smithi045 systemd[1]: Started Ceph mgr.x for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:06:36.707 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:36 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:36.487+0000 7f254eaf5040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:06:36.707 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:36 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:36.550+0000 7f254eaf5040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:06:36.981 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:36 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:36.707+0000 7f254eaf5040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:06:36.981 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:36 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:36.777+0000 7f254eaf5040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:06:36.981 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:36 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:36.937+0000 7f254eaf5040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:06:37.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:37 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3800591342' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:06:37.300 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:37 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:37.097+0000 7f254eaf5040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:06:37.689 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:37 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:37.430+0000 7f254eaf5040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:06:37.689 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:37 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:37.493+0000 7f254eaf5040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:06:37.689 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:37 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:37.687+0000 7f254eaf5040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:06:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-15T22:06:37.728 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:06:37.728 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsid": "a1911414-73ae-11ef-bceb-c7b262605968", 2024-09-15T22:06:37.728 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:06:37.728 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:06:37.729 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:06:37.730 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:06:37.730 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:37.730 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:06:37.730 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:06:37.730 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:06:37.730 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:06:37.730 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:06:37.738 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:06:37.738 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:06:37.738 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:06:37.738 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:37.738 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:06:37.738 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:06:37.738 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:06:37.738 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:06:37.738 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:06:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:06:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:06:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:06:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:06:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:06:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:06:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:06:19:492132+0000", 2024-09-15T22:06:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:06:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:06:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:06:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T22:06:37.740 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:06:37.740 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:06:37.740 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:06:37.740 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:06:37.740 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:06:37.740 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:06:37.740 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:06:37.740 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:37.740 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:06:37.740 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:06:37.740 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:06:19.492824+0000", 2024-09-15T22:06:37.740 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:06:37.740 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:37.741 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:06:37.741 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:06:37.741 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.907+0000 7f60a1182640 1 Processor -- start 2024-09-15T22:06:37.741 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.907+0000 7f60a1182640 1 -- start start 2024-09-15T22:06:37.741 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.908+0000 7f60a1182640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 0x7f609c10a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:37.741 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.908+0000 7f60a1182640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f609c07be50 con 0x7f609c108170 2024-09-15T22:06:37.741 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.908+0000 7f609ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 0x7f609c10a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:37.741 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.908+0000 7f609ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 0x7f609c10a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59558/0 (socket says 172.21.15.45:59558) 2024-09-15T22:06:37.741 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.908+0000 7f609ad9d640 1 -- 172.21.15.45:0/2362848865 learned_addr learned my addr 172.21.15.45:0/2362848865 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:37.741 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.908+0000 7f609ad9d640 1 -- 172.21.15.45:0/2362848865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c10aaa0 con 0x7f609c108170 2024-09-15T22:06:37.741 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.909+0000 7f609ad9d640 1 --2- 172.21.15.45:0/2362848865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 0x7f609c10a560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f608c009820 tx=0x7f608c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fb80f47bb16bc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:37.741 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.910+0000 7f6099d9b640 1 -- 172.21.15.45:0/2362848865 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f608c037070 con 0x7f609c108170 2024-09-15T22:06:37.742 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.910+0000 7f6099d9b640 1 -- 172.21.15.45:0/2362848865 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f608c032920 con 0x7f609c108170 2024-09-15T22:06:37.742 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.910+0000 7f6099d9b640 1 -- 172.21.15.45:0/2362848865 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f608c030950 con 0x7f609c108170 2024-09-15T22:06:37.742 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.911+0000 7f60a1182640 1 -- 172.21.15.45:0/2362848865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 msgr2=0x7f609c10a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:37.742 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.911+0000 7f60a1182640 1 --2- 172.21.15.45:0/2362848865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 0x7f609c10a560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f608c009820 tx=0x7f608c02a270 comp rx=0 tx=0).stop 2024-09-15T22:06:37.742 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.911+0000 7f60a1182640 1 -- 172.21.15.45:0/2362848865 shutdown_connections 2024-09-15T22:06:37.742 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.911+0000 7f60a1182640 1 --2- 172.21.15.45:0/2362848865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 0x7f609c10a560 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:37.742 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.911+0000 7f60a1182640 1 -- 172.21.15.45:0/2362848865 >> 172.21.15.45:0/2362848865 conn(0x7f609c101df0 msgr2=0x7f609c104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:37.742 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.911+0000 7f60a1182640 1 -- 172.21.15.45:0/2362848865 shutdown_connections 2024-09-15T22:06:37.742 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.911+0000 7f60a1182640 1 -- 172.21.15.45:0/2362848865 wait complete. 2024-09-15T22:06:37.742 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.912+0000 7f60a1182640 1 Processor -- start 2024-09-15T22:06:37.742 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.912+0000 7f60a1182640 1 -- start start 2024-09-15T22:06:37.742 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.912+0000 7f60a1182640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 0x7f609c1079f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:37.742 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.912+0000 7f60a1182640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f609c10bb40 con 0x7f609c108170 2024-09-15T22:06:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.912+0000 7f609ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 0x7f609c1079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.912+0000 7f609ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 0x7f609c1079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59560/0 (socket says 172.21.15.45:59560) 2024-09-15T22:06:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.912+0000 7f609ad9d640 1 -- 172.21.15.45:0/3800591342 learned_addr learned my addr 172.21.15.45:0/3800591342 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.912+0000 7f609ad9d640 1 -- 172.21.15.45:0/3800591342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c107f30 con 0x7f609c108170 2024-09-15T22:06:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.913+0000 7f609ad9d640 1 --2- 172.21.15.45:0/3800591342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 0x7f609c1079f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f608c006f10 tx=0x7f608c0327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.913+0000 7f6083fff640 1 -- 172.21.15.45:0/3800591342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f608c037040 con 0x7f609c108170 2024-09-15T22:06:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.913+0000 7f60a1182640 1 -- 172.21.15.45:0/3800591342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609c106120 con 0x7f609c108170 2024-09-15T22:06:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.913+0000 7f6083fff640 1 -- 172.21.15.45:0/3800591342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f608c040070 con 0x7f609c108170 2024-09-15T22:06:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.913+0000 7f6083fff640 1 -- 172.21.15.45:0/3800591342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f608c03a630 con 0x7f609c108170 2024-09-15T22:06:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.913+0000 7f60a1182640 1 -- 172.21.15.45:0/3800591342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609c106660 con 0x7f609c108170 2024-09-15T22:06:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.913+0000 7f6083fff640 1 -- 172.21.15.45:0/3800591342 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f608c03a820 con 0x7f609c108170 2024-09-15T22:06:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.913+0000 7f6083fff640 1 -- 172.21.15.45:0/3800591342 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f608c045b40 con 0x7f609c108170 2024-09-15T22:06:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.914+0000 7f60a1182640 1 -- 172.21.15.45:0/3800591342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f609c1085d0 con 0x7f609c108170 2024-09-15T22:06:37.744 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.916+0000 7f6083fff640 1 -- 172.21.15.45:0/3800591342 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f608c0328e0 con 0x7f609c108170 2024-09-15T22:06:37.744 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.979+0000 7f60a1182640 1 -- 172.21.15.45:0/3800591342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f609c106960 con 0x7f609c108170 2024-09-15T22:06:37.744 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.979+0000 7f6083fff640 1 -- 172.21.15.45:0/3800591342 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f608c045d90 con 0x7f609c108170 2024-09-15T22:06:37.744 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.981+0000 7f60a1182640 1 -- 172.21.15.45:0/3800591342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 msgr2=0x7f609c1079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:37.744 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.981+0000 7f60a1182640 1 --2- 172.21.15.45:0/3800591342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 0x7f609c1079f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f608c006f10 tx=0x7f608c0327d0 comp rx=0 tx=0).stop 2024-09-15T22:06:37.744 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.981+0000 7f60a1182640 1 -- 172.21.15.45:0/3800591342 shutdown_connections 2024-09-15T22:06:37.744 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.981+0000 7f60a1182640 1 --2- 172.21.15.45:0/3800591342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609c108170 0x7f609c1079f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:37.744 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.981+0000 7f60a1182640 1 -- 172.21.15.45:0/3800591342 >> 172.21.15.45:0/3800591342 conn(0x7f609c101df0 msgr2=0x7f609c102a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:37.744 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.981+0000 7f60a1182640 1 -- 172.21.15.45:0/3800591342 shutdown_connections 2024-09-15T22:06:37.744 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:36.981+0000 7f60a1182640 1 -- 172.21.15.45:0/3800591342 wait complete. 2024-09-15T22:06:37.744 INFO:teuthology.orchestra.run.smithi045.stdout:mgr not available, waiting (1/15)... 2024-09-15T22:06:39.049 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:38 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:38.611+0000 7f254eaf5040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:06:39.050 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:38 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:38.681+0000 7f254eaf5040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:06:39.709 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:39 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:39.438+0000 7f254eaf5040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:06:39.709 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:39 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:39.558+0000 7f254eaf5040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:06:39.970 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:39 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:39.707+0000 7f254eaf5040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:06:39.970 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:39 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:39.775+0000 7f254eaf5040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:06:39.970 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:39 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:39.933+0000 7f254eaf5040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:06:40.242 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:40.007+0000 7f254eaf5040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:06:40.242 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:40.070+0000 7f254eaf5040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:06:40.243 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:40.240+0000 7f254eaf5040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:06:40.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:40 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1385498185' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:06:40.533 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:40.312+0000 7f254eaf5040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:06:40.534 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:40.381+0000 7f254eaf5040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:06:40.534 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:40.468+0000 7f254eaf5040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:06:40.534 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:40.531+0000 7f254eaf5040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:06:40.799 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:40.594+0000 7f254eaf5040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:06:40.931 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-15T22:06:40.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:06:40.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsid": "a1911414-73ae-11ef-bceb-c7b262605968", 2024-09-15T22:06:40.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:06:40.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:06:40.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:06:40.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:06:40.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:40.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:06:40.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:06:40.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:06:40.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:06:40.932 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:06:40.933 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:06:40.933 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:06:40.933 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-15T22:06:40.933 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:06:40.933 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:06:40.933 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:06:40.933 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:06:40.933 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:40.933 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:06:40.933 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:06:40.933 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:06:40.933 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:06:40.933 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:06:40.941 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:06:40.942 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:06:40.942 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:06:40.942 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:40.942 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:06:40.942 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:06:40.942 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:06:40.942 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:06:40.942 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:06:40.942 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:06:40.942 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:06:40.942 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:06:40.942 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:06:40.943 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:40.943 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:06:40.943 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:06:40.943 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:06:19:492132+0000", 2024-09-15T22:06:40.943 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:06:40.943 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:06:40.943 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:40.943 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:06:40.943 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T22:06:40.943 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:06:40.943 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:06:40.943 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:06:40.944 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:06:40.944 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:06:40.944 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:06:40.944 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:06:40.944 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:40.944 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:06:40.944 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:06:40.944 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:06:19.492824+0000", 2024-09-15T22:06:40.944 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:06:40.944 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:40.944 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:06:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:06:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.174+0000 7fcaae064640 1 Processor -- start 2024-09-15T22:06:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.174+0000 7fcaae064640 1 -- start start 2024-09-15T22:06:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.175+0000 7fcaae064640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 0x7fcaa810a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.175+0000 7fcaae064640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa807be50 con 0x7fcaa8108170 2024-09-15T22:06:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.175+0000 7fcaa77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 0x7fcaa810a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.175+0000 7fcaa77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 0x7fcaa810a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59574/0 (socket says 172.21.15.45:59574) 2024-09-15T22:06:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.175+0000 7fcaa77fe640 1 -- 172.21.15.45:0/1973051341 learned_addr learned my addr 172.21.15.45:0/1973051341 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.175+0000 7fcaa77fe640 1 -- 172.21.15.45:0/1973051341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa810aaa0 con 0x7fcaa8108170 2024-09-15T22:06:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.176+0000 7fcaa77fe640 1 --2- 172.21.15.45:0/1973051341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 0x7fcaa810a560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fca98009820 tx=0x7fca9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c943a6e14bf6bef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.176+0000 7fcaa6ffd640 1 -- 172.21.15.45:0/1973051341 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca98037070 con 0x7fcaa8108170 2024-09-15T22:06:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.176+0000 7fcaa6ffd640 1 -- 172.21.15.45:0/1973051341 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fca98032920 con 0x7fcaa8108170 2024-09-15T22:06:40.945 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.176+0000 7fcaa6ffd640 1 -- 172.21.15.45:0/1973051341 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca98030950 con 0x7fcaa8108170 2024-09-15T22:06:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.177+0000 7fcaae064640 1 -- 172.21.15.45:0/1973051341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 msgr2=0x7fcaa810a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.177+0000 7fcaae064640 1 --2- 172.21.15.45:0/1973051341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 0x7fcaa810a560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fca98009820 tx=0x7fca9802a270 comp rx=0 tx=0).stop 2024-09-15T22:06:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.177+0000 7fcaae064640 1 -- 172.21.15.45:0/1973051341 shutdown_connections 2024-09-15T22:06:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.177+0000 7fcaae064640 1 --2- 172.21.15.45:0/1973051341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 0x7fcaa810a560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.177+0000 7fcaae064640 1 -- 172.21.15.45:0/1973051341 >> 172.21.15.45:0/1973051341 conn(0x7fcaa8101df0 msgr2=0x7fcaa8104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.177+0000 7fcaae064640 1 -- 172.21.15.45:0/1973051341 shutdown_connections 2024-09-15T22:06:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.177+0000 7fcaae064640 1 -- 172.21.15.45:0/1973051341 wait complete. 2024-09-15T22:06:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.177+0000 7fcaae064640 1 Processor -- start 2024-09-15T22:06:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.177+0000 7fcaae064640 1 -- start start 2024-09-15T22:06:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.178+0000 7fcaae064640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 0x7fcaa819b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.178+0000 7fcaae064640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa810bb40 con 0x7fcaa8108170 2024-09-15T22:06:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.178+0000 7fcaa77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 0x7fcaa819b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:40.946 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.178+0000 7fcaa77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 0x7fcaa819b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59588/0 (socket says 172.21.15.45:59588) 2024-09-15T22:06:40.947 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.178+0000 7fcaa77fe640 1 -- 172.21.15.45:0/1385498185 learned_addr learned my addr 172.21.15.45:0/1385498185 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:40.947 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.178+0000 7fcaa77fe640 1 -- 172.21.15.45:0/1385498185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa819bc90 con 0x7fcaa8108170 2024-09-15T22:06:40.947 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.178+0000 7fcaa77fe640 1 --2- 172.21.15.45:0/1385498185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 0x7fcaa819b750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fca98006f10 tx=0x7fca980327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:40.947 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.179+0000 7fcaa57fa640 1 -- 172.21.15.45:0/1385498185 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca98037040 con 0x7fcaa8108170 2024-09-15T22:06:40.947 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.179+0000 7fcaa57fa640 1 -- 172.21.15.45:0/1385498185 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fca98040070 con 0x7fcaa8108170 2024-09-15T22:06:40.947 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.179+0000 7fcaae064640 1 -- 172.21.15.45:0/1385498185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa819bf20 con 0x7fcaa8108170 2024-09-15T22:06:40.947 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.179+0000 7fcaae064640 1 -- 172.21.15.45:0/1385498185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa819ec10 con 0x7fcaa8108170 2024-09-15T22:06:40.947 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.179+0000 7fcaa57fa640 1 -- 172.21.15.45:0/1385498185 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9803a630 con 0x7fcaa8108170 2024-09-15T22:06:40.947 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.179+0000 7fcaa57fa640 1 -- 172.21.15.45:0/1385498185 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fca9803a820 con 0x7fcaa8108170 2024-09-15T22:06:40.947 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.179+0000 7fcaa57fa640 1 -- 172.21.15.45:0/1385498185 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fca98045b70 con 0x7fcaa8108170 2024-09-15T22:06:40.947 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.180+0000 7fcaae064640 1 -- 172.21.15.45:0/1385498185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca880052c0 con 0x7fcaa8108170 2024-09-15T22:06:40.947 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.182+0000 7fcaa57fa640 1 -- 172.21.15.45:0/1385498185 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fca980328e0 con 0x7fcaa8108170 2024-09-15T22:06:40.947 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.245+0000 7fcaae064640 1 -- 172.21.15.45:0/1385498185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fca88005880 con 0x7fcaa8108170 2024-09-15T22:06:40.948 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.246+0000 7fcaa57fa640 1 -- 172.21.15.45:0/1385498185 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fca98032d00 con 0x7fcaa8108170 2024-09-15T22:06:40.948 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.247+0000 7fcaae064640 1 -- 172.21.15.45:0/1385498185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 msgr2=0x7fcaa819b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:40.948 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.247+0000 7fcaae064640 1 --2- 172.21.15.45:0/1385498185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 0x7fcaa819b750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fca98006f10 tx=0x7fca980327d0 comp rx=0 tx=0).stop 2024-09-15T22:06:40.948 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.247+0000 7fcaae064640 1 -- 172.21.15.45:0/1385498185 shutdown_connections 2024-09-15T22:06:40.948 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.247+0000 7fcaae064640 1 --2- 172.21.15.45:0/1385498185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa8108170 0x7fcaa819b750 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:40.948 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.247+0000 7fcaae064640 1 -- 172.21.15.45:0/1385498185 >> 172.21.15.45:0/1385498185 conn(0x7fcaa8101df0 msgr2=0x7fcaa8102a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:40.948 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.247+0000 7fcaae064640 1 -- 172.21.15.45:0/1385498185 shutdown_connections 2024-09-15T22:06:40.948 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:40.247+0000 7fcaae064640 1 -- 172.21.15.45:0/1385498185 wait complete. 2024-09-15T22:06:40.948 INFO:teuthology.orchestra.run.smithi045.stdout:mgr not available, waiting (2/15)... 2024-09-15T22:06:41.800 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:41.425+0000 7f254eaf5040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:06:41.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-mon[31180]: Activating manager daemon x 2024-09-15T22:06:41.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-mon[31180]: mgrmap e2: x(active, starting, since 0.00310426s) 2024-09-15T22:06:41.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-mon[31180]: from='mgr.14100 172.21.15.45:0/3618389692' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:06:41.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-mon[31180]: from='mgr.14100 172.21.15.45:0/3618389692' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:06:41.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-mon[31180]: from='mgr.14100 172.21.15.45:0/3618389692' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:06:41.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-mon[31180]: from='mgr.14100 172.21.15.45:0/3618389692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:06:41.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-mon[31180]: from='mgr.14100 172.21.15.45:0/3618389692' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:06:41.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-mon[31180]: Manager daemon x is now available 2024-09-15T22:06:41.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-mon[31180]: from='mgr.14100 172.21.15.45:0/3618389692' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:06:41.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-mon[31180]: from='mgr.14100 172.21.15.45:0/3618389692' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:06:41.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-mon[31180]: from='mgr.14100 172.21.15.45:0/3618389692' entity='mgr.x' 2024-09-15T22:06:41.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-mon[31180]: from='mgr.14100 172.21.15.45:0/3618389692' entity='mgr.x' 2024-09-15T22:06:41.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:41 smithi045 ceph-mon[31180]: from='mgr.14100 172.21.15.45:0/3618389692' entity='mgr.x' 2024-09-15T22:06:43.597 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:43 smithi045 ceph-mon[31180]: mgrmap e3: x(active, since 1.00654s) 2024-09-15T22:06:44.154 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-15T22:06:44.154 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsid": "a1911414-73ae-11ef-bceb-c7b262605968", 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 0 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:06:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-15T22:06:44.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T22:06:44.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:06:44.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T22:06:44.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T22:06:44.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:44.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T22:06:44.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:06:44.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T22:06:44.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T22:06:44.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T22:06:44.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T22:06:44.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T22:06:44.156 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T22:06:44.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:44.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T22:06:44.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T22:06:44.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T22:06:44.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T22:06:44.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T22:06:44.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T22:06:44.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T22:06:44.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T22:06:44.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T22:06:44.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:44.157 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T22:06:19:492132+0000", 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ], 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:06:44.158 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T22:06:19.492824+0000", 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout }, 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.314+0000 7f5b7c9fe640 1 Processor -- start 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.315+0000 7f5b7c9fe640 1 -- start start 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.315+0000 7f5b7c9fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 0x7f5b78106820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.315+0000 7f5b7c9fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5b78106df0 con 0x7f5b78106420 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.315+0000 7f5b76d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 0x7f5b78106820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.315+0000 7f5b76d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 0x7f5b78106820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59666/0 (socket says 172.21.15.45:59666) 2024-09-15T22:06:44.159 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.315+0000 7f5b76d9d640 1 -- 172.21.15.45:0/1664058046 learned_addr learned my addr 172.21.15.45:0/1664058046 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:44.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.315+0000 7f5b76d9d640 1 -- 172.21.15.45:0/1664058046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b78107620 con 0x7f5b78106420 2024-09-15T22:06:44.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.316+0000 7f5b76d9d640 1 --2- 172.21.15.45:0/1664058046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 0x7f5b78106820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009820 tx=0x7f5b6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ce0c2ca9cdb41c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:44.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.316+0000 7f5b75d9b640 1 -- 172.21.15.45:0/1664058046 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b68037070 con 0x7f5b78106420 2024-09-15T22:06:44.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.316+0000 7f5b75d9b640 1 -- 172.21.15.45:0/1664058046 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f5b68032920 con 0x7f5b78106420 2024-09-15T22:06:44.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.316+0000 7f5b75d9b640 1 -- 172.21.15.45:0/1664058046 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b68030950 con 0x7f5b78106420 2024-09-15T22:06:44.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.317+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/1664058046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 msgr2=0x7f5b78106820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:44.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.317+0000 7f5b7c9fe640 1 --2- 172.21.15.45:0/1664058046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 0x7f5b78106820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5b68009820 tx=0x7f5b6802a270 comp rx=0 tx=0).stop 2024-09-15T22:06:44.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.317+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/1664058046 shutdown_connections 2024-09-15T22:06:44.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.317+0000 7f5b7c9fe640 1 --2- 172.21.15.45:0/1664058046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 0x7f5b78106820 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:44.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.317+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/1664058046 >> 172.21.15.45:0/1664058046 conn(0x7f5b78101c30 msgr2=0x7f5b78104050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:44.160 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.317+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/1664058046 shutdown_connections 2024-09-15T22:06:44.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.317+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/1664058046 wait complete. 2024-09-15T22:06:44.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.318+0000 7f5b7c9fe640 1 Processor -- start 2024-09-15T22:06:44.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.318+0000 7f5b7c9fe640 1 -- start start 2024-09-15T22:06:44.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.318+0000 7f5b7c9fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 0x7f5b7819d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:44.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.318+0000 7f5b7c9fe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7810a9d0 con 0x7f5b78106420 2024-09-15T22:06:44.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.318+0000 7f5b76d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 0x7f5b7819d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:44.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.318+0000 7f5b76d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 0x7f5b7819d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59682/0 (socket says 172.21.15.45:59682) 2024-09-15T22:06:44.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.318+0000 7f5b76d9d640 1 -- 172.21.15.45:0/951365762 learned_addr learned my addr 172.21.15.45:0/951365762 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:44.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.319+0000 7f5b76d9d640 1 -- 172.21.15.45:0/951365762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7819dd30 con 0x7f5b78106420 2024-09-15T22:06:44.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.319+0000 7f5b76d9d640 1 --2- 172.21.15.45:0/951365762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 0x7f5b7819d7f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5b680097f0 tx=0x7f5b68032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:44.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.319+0000 7f5b5ffff640 1 -- 172.21.15.45:0/951365762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b68037040 con 0x7f5b78106420 2024-09-15T22:06:44.161 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.319+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/951365762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b7819dfc0 con 0x7f5b78106420 2024-09-15T22:06:44.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.319+0000 7f5b5ffff640 1 -- 172.21.15.45:0/951365762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f5b68040070 con 0x7f5b78106420 2024-09-15T22:06:44.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.319+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/951365762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b781a0cb0 con 0x7f5b78106420 2024-09-15T22:06:44.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.319+0000 7f5b5ffff640 1 -- 172.21.15.45:0/951365762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b6803a610 con 0x7f5b78106420 2024-09-15T22:06:44.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.320+0000 7f5b5ffff640 1 -- 172.21.15.45:0/951365762 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f5b6803a890 con 0x7f5b78106420 2024-09-15T22:06:44.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.320+0000 7f5b5ffff640 1 --2- 172.21.15.45:0/951365762 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f5b60039050 0x7f5b6003b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:44.162 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.320+0000 7f5b5ffff640 1 -- 172.21.15.45:0/951365762 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5b6806d290 con 0x7f5b78106420 2024-09-15T22:06:44.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.320+0000 7f5b7659c640 1 --2- 172.21.15.45:0/951365762 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f5b60039050 0x7f5b6003b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:44.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.320+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/951365762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b64005290 con 0x7f5b78106420 2024-09-15T22:06:44.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.321+0000 7f5b7659c640 1 --2- 172.21.15.45:0/951365762 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f5b60039050 0x7f5b6003b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0098c0 tx=0x7f5b6c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:44.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.326+0000 7f5b5ffff640 1 -- 172.21.15.45:0/951365762 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5b68041270 con 0x7f5b78106420 2024-09-15T22:06:44.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.433+0000 7f5b5ffff640 1 -- 172.21.15.45:0/951365762 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f5b68045980 con 0x7f5b78106420 2024-09-15T22:06:44.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.595+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/951365762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5b64005580 con 0x7f5b78106420 2024-09-15T22:06:44.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.596+0000 7f5b5ffff640 1 -- 172.21.15.45:0/951365762 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f5b68043360 con 0x7f5b78106420 2024-09-15T22:06:44.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.598+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/951365762 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f5b60039050 msgr2=0x7f5b6003b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:44.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.598+0000 7f5b7c9fe640 1 --2- 172.21.15.45:0/951365762 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f5b60039050 0x7f5b6003b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c0098c0 tx=0x7f5b6c006db0 comp rx=0 tx=0).stop 2024-09-15T22:06:44.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.598+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/951365762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 msgr2=0x7f5b7819d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:44.163 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.598+0000 7f5b7c9fe640 1 --2- 172.21.15.45:0/951365762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 0x7f5b7819d7f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5b680097f0 tx=0x7f5b68032d00 comp rx=0 tx=0).stop 2024-09-15T22:06:44.164 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.598+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/951365762 shutdown_connections 2024-09-15T22:06:44.164 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.598+0000 7f5b7c9fe640 1 --2- 172.21.15.45:0/951365762 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f5b60039050 0x7f5b6003b510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:44.164 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.598+0000 7f5b7c9fe640 1 --2- 172.21.15.45:0/951365762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b78106420 0x7f5b7819d7f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:44.164 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.598+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/951365762 >> 172.21.15.45:0/951365762 conn(0x7f5b78101c30 msgr2=0x7f5b78102b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:44.164 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.598+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/951365762 shutdown_connections 2024-09-15T22:06:44.164 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:43.598+0000 7f5b7c9fe640 1 -- 172.21.15.45:0/951365762 wait complete. 2024-09-15T22:06:44.164 INFO:teuthology.orchestra.run.smithi045.stdout:mgr is available 2024-09-15T22:06:44.744 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:44 smithi045 ceph-mon[31180]: mgrmap e4: x(active, since 2s) 2024-09-15T22:06:44.744 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:44 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/951365762' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T22:06:45.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-15T22:06:45.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T22:06:45.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout fsid = a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:06:45.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.45:3300,v1:172.21.15.45:6789] 2024-09-15T22:06:45.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T22:06:45.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T22:06:45.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T22:06:45.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T22:06:45.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-15T22:06:45.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T22:06:45.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T22:06:45.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 2024-09-15T22:06:45.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T22:06:45.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T22:06:45.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T22:06:45.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T22:06:45.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.557+0000 7f62f1e61640 1 Processor -- start 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.557+0000 7f62f1e61640 1 -- start start 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.557+0000 7f62f1e61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 0x7f62ec107b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.557+0000 7f62f1e61640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec108050 con 0x7f62ec107710 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.557+0000 7f62eb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 0x7f62ec107b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.557+0000 7f62eb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 0x7f62ec107b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50984/0 (socket says 172.21.15.45:50984) 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.557+0000 7f62eb7fe640 1 -- 172.21.15.45:0/1014319548 learned_addr learned my addr 172.21.15.45:0/1014319548 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.558+0000 7f62eb7fe640 1 -- 172.21.15.45:0/1014319548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ec1081d0 con 0x7f62ec107710 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.558+0000 7f62eb7fe640 1 --2- 172.21.15.45:0/1014319548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 0x7f62ec107b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009e80 tx=0x7f62dc02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1106d1b769813cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.559+0000 7f62ea7fc640 1 -- 172.21.15.45:0/1014319548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc036070 con 0x7f62ec107710 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.559+0000 7f62ea7fc640 1 -- 172.21.15.45:0/1014319548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f62dc0318e0 con 0x7f62ec107710 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.559+0000 7f62ea7fc640 1 -- 172.21.15.45:0/1014319548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc007b00 con 0x7f62ec107710 2024-09-15T22:06:45.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.559+0000 7f62f1e61640 1 -- 172.21.15.45:0/1014319548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 msgr2=0x7f62ec107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.559+0000 7f62f1e61640 1 --2- 172.21.15.45:0/1014319548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 0x7f62ec107b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009e80 tx=0x7f62dc02a7a0 comp rx=0 tx=0).stop 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.559+0000 7f62f1e61640 1 -- 172.21.15.45:0/1014319548 shutdown_connections 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.559+0000 7f62f1e61640 1 --2- 172.21.15.45:0/1014319548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 0x7f62ec107b10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.559+0000 7f62f1e61640 1 -- 172.21.15.45:0/1014319548 >> 172.21.15.45:0/1014319548 conn(0x7f62ec102fc0 msgr2=0x7f62ec1053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.559+0000 7f62f1e61640 1 -- 172.21.15.45:0/1014319548 shutdown_connections 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.559+0000 7f62f1e61640 1 -- 172.21.15.45:0/1014319548 wait complete. 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.560+0000 7f62f1e61640 1 Processor -- start 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.560+0000 7f62f1e61640 1 -- start start 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.560+0000 7f62f1e61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 0x7f62ec19b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.560+0000 7f62f1e61640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f62ec10bb80 con 0x7f62ec107710 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.560+0000 7f62eb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 0x7f62ec19b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.560+0000 7f62eb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 0x7f62ec19b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50996/0 (socket says 172.21.15.45:50996) 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.560+0000 7f62eb7fe640 1 -- 172.21.15.45:0/3405958931 learned_addr learned my addr 172.21.15.45:0/3405958931 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:45.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.561+0000 7f62eb7fe640 1 -- 172.21.15.45:0/3405958931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ec19bbf0 con 0x7f62ec107710 2024-09-15T22:06:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.561+0000 7f62eb7fe640 1 --2- 172.21.15.45:0/3405958931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 0x7f62ec19b6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f62dc031700 tx=0x7f62dc031730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.561+0000 7f62e8ff9640 1 -- 172.21.15.45:0/3405958931 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc041020 con 0x7f62ec107710 2024-09-15T22:06:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.561+0000 7f62e8ff9640 1 -- 172.21.15.45:0/3405958931 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f62dc007e50 con 0x7f62ec107710 2024-09-15T22:06:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.561+0000 7f62f1e61640 1 -- 172.21.15.45:0/3405958931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ec19be80 con 0x7f62ec107710 2024-09-15T22:06:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.561+0000 7f62e8ff9640 1 -- 172.21.15.45:0/3405958931 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62dc036040 con 0x7f62ec107710 2024-09-15T22:06:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.561+0000 7f62f1e61640 1 -- 172.21.15.45:0/3405958931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ec19eb70 con 0x7f62ec107710 2024-09-15T22:06:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.562+0000 7f62e8ff9640 1 -- 172.21.15.45:0/3405958931 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f62dc044020 con 0x7f62ec107710 2024-09-15T22:06:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.562+0000 7f62e8ff9640 1 --2- 172.21.15.45:0/3405958931 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f62d4039160 0x7f62d403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.562+0000 7f62e8ff9640 1 -- 172.21.15.45:0/3405958931 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f62dc06d130 con 0x7f62ec107710 2024-09-15T22:06:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.562+0000 7f62f1e61640 1 -- 172.21.15.45:0/3405958931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62ec107b90 con 0x7f62ec107710 2024-09-15T22:06:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.562+0000 7f62eaffd640 1 --2- 172.21.15.45:0/3405958931 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f62d4039160 0x7f62d403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.563+0000 7f62eaffd640 1 --2- 172.21.15.45:0/3405958931 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f62d4039160 0x7f62d403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f62e00098c0 tx=0x7f62e0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:45.334 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.567+0000 7f62e8ff9640 1 -- 172.21.15.45:0/3405958931 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62dc04b020 con 0x7f62ec107710 2024-09-15T22:06:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.742+0000 7f62f1e61640 1 -- 172.21.15.45:0/3405958931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f62ec1a0280 con 0x7f62ec107710 2024-09-15T22:06:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.742+0000 7f62e8ff9640 1 -- 172.21.15.45:0/3405958931 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f62dc0457b0 con 0x7f62ec107710 2024-09-15T22:06:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.744+0000 7f62f1e61640 1 -- 172.21.15.45:0/3405958931 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f62d4039160 msgr2=0x7f62d403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.744+0000 7f62f1e61640 1 --2- 172.21.15.45:0/3405958931 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f62d4039160 0x7f62d403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f62e00098c0 tx=0x7f62e0006db0 comp rx=0 tx=0).stop 2024-09-15T22:06:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.744+0000 7f62f1e61640 1 -- 172.21.15.45:0/3405958931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 msgr2=0x7f62ec19b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.744+0000 7f62f1e61640 1 --2- 172.21.15.45:0/3405958931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 0x7f62ec19b6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f62dc031700 tx=0x7f62dc031730 comp rx=0 tx=0).stop 2024-09-15T22:06:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.745+0000 7f62f1e61640 1 -- 172.21.15.45:0/3405958931 shutdown_connections 2024-09-15T22:06:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.745+0000 7f62f1e61640 1 --2- 172.21.15.45:0/3405958931 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f62d4039160 0x7f62d403b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.745+0000 7f62f1e61640 1 --2- 172.21.15.45:0/3405958931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f62ec107710 0x7f62ec19b6b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.745+0000 7f62f1e61640 1 -- 172.21.15.45:0/3405958931 >> 172.21.15.45:0/3405958931 conn(0x7f62ec102fc0 msgr2=0x7f62ec103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.745+0000 7f62f1e61640 1 -- 172.21.15.45:0/3405958931 shutdown_connections 2024-09-15T22:06:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:44.745+0000 7f62f1e61640 1 -- 172.21.15.45:0/3405958931 wait complete. 2024-09-15T22:06:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling cephadm module... 2024-09-15T22:06:45.709 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:45 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3405958931' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T22:06:46.763 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:46 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1438590821' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-15T22:06:46.763 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:46 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: ignoring --setuser ceph since I am not root 2024-09-15T22:06:46.763 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:46 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: ignoring --setgroup ceph since I am not root 2024-09-15T22:06:46.763 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:46 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:46.584+0000 7fc837c35040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:06:46.763 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:46 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:46.643+0000 7fc837c35040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:06:47.013 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:46 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:46.800+0000 7fc837c35040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:06:47.013 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:46 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:46.870+0000 7fc837c35040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:06:47.021 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.728+0000 7f8b3241e640 1 Processor -- start 2024-09-15T22:06:47.021 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.728+0000 7f8b3241e640 1 -- start start 2024-09-15T22:06:47.021 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.728+0000 7f8b3241e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 0x7f8b2c10a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:47.021 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.728+0000 7f8b3241e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c07bdf0 con 0x7f8b2c1081d0 2024-09-15T22:06:47.021 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.728+0000 7f8b2bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 0x7f8b2c10a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:47.021 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.728+0000 7f8b2bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 0x7f8b2c10a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50998/0 (socket says 172.21.15.45:50998) 2024-09-15T22:06:47.021 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.728+0000 7f8b2bfff640 1 -- 172.21.15.45:0/1961643916 learned_addr learned my addr 172.21.15.45:0/1961643916 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:47.021 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.729+0000 7f8b2bfff640 1 -- 172.21.15.45:0/1961643916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2c10ab00 con 0x7f8b2c1081d0 2024-09-15T22:06:47.021 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.729+0000 7f8b2bfff640 1 --2- 172.21.15.45:0/1961643916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 0x7f8b2c10a5c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009820 tx=0x7f8b1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e5e5b3c101fbd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:47.021 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.729+0000 7f8b2affd640 1 -- 172.21.15.45:0/1961643916 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c037070 con 0x7f8b2c1081d0 2024-09-15T22:06:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.729+0000 7f8b2affd640 1 -- 172.21.15.45:0/1961643916 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8b1c032920 con 0x7f8b2c1081d0 2024-09-15T22:06:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.729+0000 7f8b2affd640 1 -- 172.21.15.45:0/1961643916 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c030950 con 0x7f8b2c1081d0 2024-09-15T22:06:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.730+0000 7f8b3241e640 1 -- 172.21.15.45:0/1961643916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 msgr2=0x7f8b2c10a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.730+0000 7f8b3241e640 1 --2- 172.21.15.45:0/1961643916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 0x7f8b2c10a5c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009820 tx=0x7f8b1c02a270 comp rx=0 tx=0).stop 2024-09-15T22:06:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.730+0000 7f8b3241e640 1 -- 172.21.15.45:0/1961643916 shutdown_connections 2024-09-15T22:06:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.730+0000 7f8b3241e640 1 --2- 172.21.15.45:0/1961643916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 0x7f8b2c10a5c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.730+0000 7f8b3241e640 1 -- 172.21.15.45:0/1961643916 >> 172.21.15.45:0/1961643916 conn(0x7f8b2c101e50 msgr2=0x7f8b2c104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.730+0000 7f8b3241e640 1 -- 172.21.15.45:0/1961643916 shutdown_connections 2024-09-15T22:06:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.730+0000 7f8b3241e640 1 -- 172.21.15.45:0/1961643916 wait complete. 2024-09-15T22:06:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.731+0000 7f8b3241e640 1 Processor -- start 2024-09-15T22:06:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.731+0000 7f8b3241e640 1 -- start start 2024-09-15T22:06:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.731+0000 7f8b3241e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 0x7f8b2c19d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:47.022 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.731+0000 7f8b3241e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c10bb40 con 0x7f8b2c1081d0 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.731+0000 7f8b2bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 0x7f8b2c19d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.731+0000 7f8b2bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 0x7f8b2c19d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51006/0 (socket says 172.21.15.45:51006) 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.731+0000 7f8b2bfff640 1 -- 172.21.15.45:0/1438590821 learned_addr learned my addr 172.21.15.45:0/1438590821 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.732+0000 7f8b2bfff640 1 -- 172.21.15.45:0/1438590821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2c19de10 con 0x7f8b2c1081d0 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.732+0000 7f8b2bfff640 1 --2- 172.21.15.45:0/1438590821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 0x7f8b2c19d8d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c031000 tx=0x7f8b1c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.732+0000 7f8b297fa640 1 -- 172.21.15.45:0/1438590821 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c042070 con 0x7f8b2c1081d0 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.732+0000 7f8b3241e640 1 -- 172.21.15.45:0/1438590821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2c19e0a0 con 0x7f8b2c1081d0 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.732+0000 7f8b3241e640 1 -- 172.21.15.45:0/1438590821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b2c1a0d90 con 0x7f8b2c1081d0 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.732+0000 7f8b297fa640 1 -- 172.21.15.45:0/1438590821 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8b1c0326b0 con 0x7f8b2c1081d0 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.732+0000 7f8b297fa640 1 -- 172.21.15.45:0/1438590821 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c037040 con 0x7f8b2c1081d0 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.733+0000 7f8b297fa640 1 -- 172.21.15.45:0/1438590821 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f8b1c045070 con 0x7f8b2c1081d0 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.733+0000 7f8b3241e640 1 -- 172.21.15.45:0/1438590821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b180052c0 con 0x7f8b2c1081d0 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.733+0000 7f8b297fa640 1 --2- 172.21.15.45:0/1438590821 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f8b14039110 0x7f8b1403b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:47.023 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.733+0000 7f8b297fa640 1 -- 172.21.15.45:0/1438590821 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8b1c06c1a0 con 0x7f8b2c1081d0 2024-09-15T22:06:47.024 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.733+0000 7f8b2b7fe640 1 --2- 172.21.15.45:0/1438590821 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f8b14039110 0x7f8b1403b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:47.024 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.734+0000 7f8b2b7fe640 1 --2- 172.21.15.45:0/1438590821 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f8b14039110 0x7f8b1403b5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8b200098c0 tx=0x7f8b20006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:47.024 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.738+0000 7f8b297fa640 1 -- 172.21.15.45:0/1438590821 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8b1c031e90 con 0x7f8b2c1081d0 2024-09-15T22:06:47.024 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:45.961+0000 7f8b3241e640 1 -- 172.21.15.45:0/1438590821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f8b180055b0 con 0x7f8b2c1081d0 2024-09-15T22:06:47.024 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:46.436+0000 7f8b297fa640 1 -- 172.21.15.45:0/1438590821 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f8b1c045360 con 0x7f8b2c1081d0 2024-09-15T22:06:47.024 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:46.438+0000 7f8b297fa640 1 -- 172.21.15.45:0/1438590821 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f8b1c03c7e0 con 0x7f8b2c1081d0 2024-09-15T22:06:47.024 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:46.439+0000 7f8b3241e640 1 -- 172.21.15.45:0/1438590821 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f8b14039110 msgr2=0x7f8b1403b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:47.024 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:46.439+0000 7f8b3241e640 1 --2- 172.21.15.45:0/1438590821 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f8b14039110 0x7f8b1403b5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8b200098c0 tx=0x7f8b20006db0 comp rx=0 tx=0).stop 2024-09-15T22:06:47.024 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:46.439+0000 7f8b3241e640 1 -- 172.21.15.45:0/1438590821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 msgr2=0x7f8b2c19d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:47.024 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:46.439+0000 7f8b3241e640 1 --2- 172.21.15.45:0/1438590821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 0x7f8b2c19d8d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c031000 tx=0x7f8b1c032e40 comp rx=0 tx=0).stop 2024-09-15T22:06:47.024 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:46.440+0000 7f8b3241e640 1 -- 172.21.15.45:0/1438590821 shutdown_connections 2024-09-15T22:06:47.024 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:46.440+0000 7f8b3241e640 1 --2- 172.21.15.45:0/1438590821 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7f8b14039110 0x7f8b1403b5d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:47.025 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:46.440+0000 7f8b3241e640 1 --2- 172.21.15.45:0/1438590821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b2c1081d0 0x7f8b2c19d8d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:47.025 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:46.440+0000 7f8b3241e640 1 -- 172.21.15.45:0/1438590821 >> 172.21.15.45:0/1438590821 conn(0x7f8b2c101e50 msgr2=0x7f8b2c1029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:47.025 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:46.440+0000 7f8b3241e640 1 -- 172.21.15.45:0/1438590821 shutdown_connections 2024-09-15T22:06:47.025 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:46.440+0000 7f8b3241e640 1 -- 172.21.15.45:0/1438590821 wait complete. 2024-09-15T22:06:47.280 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:47 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:47.031+0000 7fc837c35040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:06:47.280 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:47 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:47.186+0000 7fc837c35040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:06:47.549 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:47 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:47.522+0000 7fc837c35040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:06:47.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:47 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1438590821' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-15T22:06:47.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:47 smithi045 ceph-mon[31180]: mgrmap e5: x(active, since 5s) 2024-09-15T22:06:48.049 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:47 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:47.587+0000 7fc837c35040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:06:48.050 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:47 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:47.784+0000 7fc837c35040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:06:48.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:48 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1790850305' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T22:06:48.510 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:06:48.511 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-15T22:06:48.511 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:06:48.511 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T22:06:48.511 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T22:06:48.511 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:06:48.511 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.452+0000 7ff8a60f1640 1 Processor -- start 2024-09-15T22:06:48.511 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.452+0000 7ff8a60f1640 1 -- start start 2024-09-15T22:06:48.511 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.453+0000 7ff8a60f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 0x7ff8a010a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:48.511 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.453+0000 7ff8a60f1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a007be50 con 0x7ff8a0108170 2024-09-15T22:06:48.511 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.453+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 0x7ff8a010a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:48.511 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.453+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 0x7ff8a010a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51028/0 (socket says 172.21.15.45:51028) 2024-09-15T22:06:48.511 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.453+0000 7ff89f7fe640 1 -- 172.21.15.45:0/428783471 learned_addr learned my addr 172.21.15.45:0/428783471 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:48.511 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.453+0000 7ff89f7fe640 1 -- 172.21.15.45:0/428783471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a010aaa0 con 0x7ff8a0108170 2024-09-15T22:06:48.512 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.454+0000 7ff89f7fe640 1 --2- 172.21.15.45:0/428783471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 0x7ff8a010a560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff890009820 tx=0x7ff89002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78364ea389f22950 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:48.512 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.454+0000 7ff89e7fc640 1 -- 172.21.15.45:0/428783471 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff890037070 con 0x7ff8a0108170 2024-09-15T22:06:48.512 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.454+0000 7ff89e7fc640 1 -- 172.21.15.45:0/428783471 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff890032920 con 0x7ff8a0108170 2024-09-15T22:06:48.512 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.454+0000 7ff89e7fc640 1 -- 172.21.15.45:0/428783471 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff890030950 con 0x7ff8a0108170 2024-09-15T22:06:48.512 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.455+0000 7ff8a60f1640 1 -- 172.21.15.45:0/428783471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 msgr2=0x7ff8a010a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:48.512 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.455+0000 7ff8a60f1640 1 --2- 172.21.15.45:0/428783471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 0x7ff8a010a560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff890009820 tx=0x7ff89002a270 comp rx=0 tx=0).stop 2024-09-15T22:06:48.512 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.455+0000 7ff8a60f1640 1 -- 172.21.15.45:0/428783471 shutdown_connections 2024-09-15T22:06:48.512 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.455+0000 7ff8a60f1640 1 --2- 172.21.15.45:0/428783471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 0x7ff8a010a560 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:48.512 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.455+0000 7ff8a60f1640 1 -- 172.21.15.45:0/428783471 >> 172.21.15.45:0/428783471 conn(0x7ff8a0101df0 msgr2=0x7ff8a0104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:48.512 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.455+0000 7ff8a60f1640 1 -- 172.21.15.45:0/428783471 shutdown_connections 2024-09-15T22:06:48.512 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.455+0000 7ff8a60f1640 1 -- 172.21.15.45:0/428783471 wait complete. 2024-09-15T22:06:48.512 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.455+0000 7ff8a60f1640 1 Processor -- start 2024-09-15T22:06:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.456+0000 7ff8a60f1640 1 -- start start 2024-09-15T22:06:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.456+0000 7ff8a60f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 0x7ff8a019b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.456+0000 7ff8a60f1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a010bb40 con 0x7ff8a0108170 2024-09-15T22:06:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.456+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 0x7ff8a019b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.456+0000 7ff89f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 0x7ff8a019b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51040/0 (socket says 172.21.15.45:51040) 2024-09-15T22:06:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.456+0000 7ff89f7fe640 1 -- 172.21.15.45:0/1790850305 learned_addr learned my addr 172.21.15.45:0/1790850305 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.456+0000 7ff89f7fe640 1 -- 172.21.15.45:0/1790850305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a019bc90 con 0x7ff8a0108170 2024-09-15T22:06:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.456+0000 7ff89f7fe640 1 --2- 172.21.15.45:0/1790850305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 0x7ff8a019b750 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff890031000 tx=0x7ff890032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.457+0000 7ff89cff9640 1 -- 172.21.15.45:0/1790850305 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff890042070 con 0x7ff8a0108170 2024-09-15T22:06:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.457+0000 7ff8a60f1640 1 -- 172.21.15.45:0/1790850305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a019bf20 con 0x7ff8a0108170 2024-09-15T22:06:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.457+0000 7ff89cff9640 1 -- 172.21.15.45:0/1790850305 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff8900326b0 con 0x7ff8a0108170 2024-09-15T22:06:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.457+0000 7ff89cff9640 1 -- 172.21.15.45:0/1790850305 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff890037040 con 0x7ff8a0108170 2024-09-15T22:06:48.513 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.457+0000 7ff8a60f1640 1 -- 172.21.15.45:0/1790850305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a019ec10 con 0x7ff8a0108170 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.457+0000 7ff89cff9640 1 -- 172.21.15.45:0/1790850305 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7ff890045070 con 0x7ff8a0108170 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.458+0000 7ff8a60f1640 1 -- 172.21.15.45:0/1790850305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a01085d0 con 0x7ff8a0108170 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.458+0000 7ff89cff9640 1 --2- 172.21.15.45:0/1790850305 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7ff88c0391b0 0x7ff88c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.458+0000 7ff89cff9640 1 -- 172.21.15.45:0/1790850305 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff89006c280 con 0x7ff8a0108170 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.458+0000 7ff89effd640 1 -- 172.21.15.45:0/1790850305 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7ff88c0391b0 msgr2=0x7ff88c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/2191835021 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.458+0000 7ff89effd640 1 --2- 172.21.15.45:0/1790850305 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7ff88c0391b0 0x7ff88c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.463+0000 7ff89cff9640 1 -- 172.21.15.45:0/1790850305 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff89004b170 con 0x7ff8a0108170 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.659+0000 7ff89effd640 1 -- 172.21.15.45:0/1790850305 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7ff88c0391b0 msgr2=0x7ff88c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/2191835021 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.659+0000 7ff89effd640 1 --2- 172.21.15.45:0/1790850305 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7ff88c0391b0 0x7ff88c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.686+0000 7ff8a60f1640 1 -- 172.21.15.45:0/1790850305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ff8a019f220 con 0x7ff8a0108170 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.687+0000 7ff89cff9640 1 -- 172.21.15.45:0/1790850305 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7ff89006bca0 con 0x7ff8a0108170 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.689+0000 7ff8a60f1640 1 -- 172.21.15.45:0/1790850305 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7ff88c0391b0 msgr2=0x7ff88c03b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.689+0000 7ff8a60f1640 1 --2- 172.21.15.45:0/1790850305 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7ff88c0391b0 0x7ff88c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:48.514 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.689+0000 7ff8a60f1640 1 -- 172.21.15.45:0/1790850305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 msgr2=0x7ff8a019b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:48.515 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.689+0000 7ff8a60f1640 1 --2- 172.21.15.45:0/1790850305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 0x7ff8a019b750 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff890031000 tx=0x7ff890032e40 comp rx=0 tx=0).stop 2024-09-15T22:06:48.515 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.689+0000 7ff8a60f1640 1 -- 172.21.15.45:0/1790850305 shutdown_connections 2024-09-15T22:06:48.515 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.689+0000 7ff8a60f1640 1 --2- 172.21.15.45:0/1790850305 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7ff88c0391b0 0x7ff88c03b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:48.515 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.689+0000 7ff8a60f1640 1 --2- 172.21.15.45:0/1790850305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8a0108170 0x7ff8a019b750 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:48.515 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.689+0000 7ff8a60f1640 1 -- 172.21.15.45:0/1790850305 >> 172.21.15.45:0/1790850305 conn(0x7ff8a0101df0 msgr2=0x7ff8a0102a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:48.515 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.689+0000 7ff8a60f1640 1 -- 172.21.15.45:0/1790850305 shutdown_connections 2024-09-15T22:06:48.515 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:47.689+0000 7ff8a60f1640 1 -- 172.21.15.45:0/1790850305 wait complete. 2024-09-15T22:06:48.515 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for the mgr to restart... 2024-09-15T22:06:48.515 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mgr epoch 5... 2024-09-15T22:06:48.796 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:48 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:48.723+0000 7fc837c35040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:06:48.797 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:48 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:48.794+0000 7fc837c35040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:06:49.799 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:49 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:49.548+0000 7fc837c35040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:06:49.800 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:49 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:49.669+0000 7fc837c35040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:06:50.113 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:49 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:49.819+0000 7fc837c35040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:06:50.113 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:49 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:49.883+0000 7fc837c35040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:06:50.113 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:50 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:50.040+0000 7fc837c35040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:06:50.113 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:50 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:50.111+0000 7fc837c35040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:06:50.410 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:50 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:50.174+0000 7fc837c35040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:06:50.410 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:50 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:50.340+0000 7fc837c35040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:06:50.410 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:50 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:50.408+0000 7fc837c35040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:06:50.691 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:50 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:50.478+0000 7fc837c35040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:06:50.691 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:50 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:50.564+0000 7fc837c35040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:06:50.691 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:50 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:50.627+0000 7fc837c35040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:06:50.691 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:50 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:50.689+0000 7fc837c35040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:06:51.799 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:51.519+0000 7fc837c35040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:06:51.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: Active manager daemon x restarted 2024-09-15T22:06:51.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: Activating manager daemon x 2024-09-15T22:06:51.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: osdmap e2: 0 total, 0 up, 0 in 2024-09-15T22:06:51.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: mgrmap e6: x(active, starting, since 0.00363371s) 2024-09-15T22:06:51.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:06:51.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:06:51.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:06:51.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:06:51.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:06:51.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: Manager daemon x is now available 2024-09-15T22:06:51.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:06:51.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:06:51.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:51.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:51.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:06:51.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:51 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:06:52.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:52 smithi045 ceph-mon[31180]: Found migration_current of "None". Setting to last migration. 2024-09-15T22:06:52.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:52 smithi045 ceph-mon[31180]: mgrmap e7: x(active, since 1.00568s) 2024-09-15T22:06:53.075 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:06:53.075 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-15T22:06:53.076 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T22:06:53.076 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:06:53.076 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.912+0000 7fa4a616a640 1 Processor -- start 2024-09-15T22:06:53.076 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.912+0000 7fa4a616a640 1 -- start start 2024-09-15T22:06:53.076 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.912+0000 7fa4a616a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 0x7fa4a007c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:53.077 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.912+0000 7fa4a616a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a007c850 con 0x7fa4a007dda0 2024-09-15T22:06:53.077 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.912+0000 7fa49f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 0x7fa4a007c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:53.077 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.912+0000 7fa49f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 0x7fa4a007c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51042/0 (socket says 172.21.15.45:51042) 2024-09-15T22:06:53.077 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.912+0000 7fa49f7fe640 1 -- 172.21.15.45:0/1093684738 learned_addr learned my addr 172.21.15.45:0/1093684738 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:53.077 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.913+0000 7fa49f7fe640 1 -- 172.21.15.45:0/1093684738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a007c9d0 con 0x7fa4a007dda0 2024-09-15T22:06:53.078 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.913+0000 7fa49f7fe640 1 --2- 172.21.15.45:0/1093684738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 0x7fa4a007c310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa490009820 tx=0x7fa49002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62345c072e3bdc00 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:53.078 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.913+0000 7fa49effd640 1 -- 172.21.15.45:0/1093684738 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa490037070 con 0x7fa4a007dda0 2024-09-15T22:06:53.078 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.913+0000 7fa49effd640 1 -- 172.21.15.45:0/1093684738 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa490032920 con 0x7fa4a007dda0 2024-09-15T22:06:53.078 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.913+0000 7fa49effd640 1 -- 172.21.15.45:0/1093684738 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa490030950 con 0x7fa4a007dda0 2024-09-15T22:06:53.078 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.914+0000 7fa4a616a640 1 -- 172.21.15.45:0/1093684738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 msgr2=0x7fa4a007c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:53.078 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.914+0000 7fa4a616a640 1 --2- 172.21.15.45:0/1093684738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 0x7fa4a007c310 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa490009820 tx=0x7fa49002a270 comp rx=0 tx=0).stop 2024-09-15T22:06:53.079 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.914+0000 7fa4a616a640 1 -- 172.21.15.45:0/1093684738 shutdown_connections 2024-09-15T22:06:53.079 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.914+0000 7fa4a616a640 1 --2- 172.21.15.45:0/1093684738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 0x7fa4a007c310 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:53.079 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.914+0000 7fa4a616a640 1 -- 172.21.15.45:0/1093684738 >> 172.21.15.45:0/1093684738 conn(0x7fa4a0102f20 msgr2=0x7fa4a0105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:53.079 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.914+0000 7fa4a616a640 1 -- 172.21.15.45:0/1093684738 shutdown_connections 2024-09-15T22:06:53.079 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.914+0000 7fa4a616a640 1 -- 172.21.15.45:0/1093684738 wait complete. 2024-09-15T22:06:53.079 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.915+0000 7fa4a616a640 1 Processor -- start 2024-09-15T22:06:53.080 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.915+0000 7fa4a616a640 1 -- start start 2024-09-15T22:06:53.080 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.915+0000 7fa4a616a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 0x7fa4a019d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:53.080 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.915+0000 7fa4a616a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a010dcb0 con 0x7fa4a007dda0 2024-09-15T22:06:53.080 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.915+0000 7fa49f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 0x7fa4a019d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:53.080 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.915+0000 7fa49f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 0x7fa4a019d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51058/0 (socket says 172.21.15.45:51058) 2024-09-15T22:06:53.081 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.915+0000 7fa49f7fe640 1 -- 172.21.15.45:0/2797416502 learned_addr learned my addr 172.21.15.45:0/2797416502 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:53.081 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.915+0000 7fa49f7fe640 1 -- 172.21.15.45:0/2797416502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a019de20 con 0x7fa4a007dda0 2024-09-15T22:06:53.081 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.916+0000 7fa49f7fe640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 0x7fa4a019d8e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa490031000 tx=0x7fa490032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:53.081 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.916+0000 7fa49d7fa640 1 -- 172.21.15.45:0/2797416502 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa490042070 con 0x7fa4a007dda0 2024-09-15T22:06:53.081 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.916+0000 7fa49d7fa640 1 -- 172.21.15.45:0/2797416502 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fa4900326b0 con 0x7fa4a007dda0 2024-09-15T22:06:53.082 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.916+0000 7fa4a616a640 1 -- 172.21.15.45:0/2797416502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a019e0b0 con 0x7fa4a007dda0 2024-09-15T22:06:53.082 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.916+0000 7fa49d7fa640 1 -- 172.21.15.45:0/2797416502 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa490037040 con 0x7fa4a007dda0 2024-09-15T22:06:53.082 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.916+0000 7fa4a616a640 1 -- 172.21.15.45:0/2797416502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a01a0da0 con 0x7fa4a007dda0 2024-09-15T22:06:53.082 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.917+0000 7fa49d7fa640 1 -- 172.21.15.45:0/2797416502 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fa490045070 con 0x7fa4a007dda0 2024-09-15T22:06:53.082 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.917+0000 7fa49d7fa640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7fa48c0391b0 0x7fa48c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:53.082 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.917+0000 7fa49d7fa640 1 -- 172.21.15.45:0/2797416502 --> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa48c03bd80 con 0x7fa48c0391b0 2024-09-15T22:06:53.083 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.917+0000 7fa49d7fa640 1 -- 172.21.15.45:0/2797416502 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa49006c3a0 con 0x7fa4a007dda0 2024-09-15T22:06:53.083 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.917+0000 7fa497fff640 1 -- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7fa48c0391b0 msgr2=0x7fa48c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/2191835021 2024-09-15T22:06:53.083 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:48.917+0000 7fa497fff640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7fa48c0391b0 0x7fa48c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:06:53.083 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:49.118+0000 7fa497fff640 1 -- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7fa48c0391b0 msgr2=0x7fa48c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/2191835021 2024-09-15T22:06:53.083 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:49.118+0000 7fa497fff640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7fa48c0391b0 0x7fa48c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:06:53.084 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:49.519+0000 7fa497fff640 1 -- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7fa48c0391b0 msgr2=0x7fa48c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/2191835021 2024-09-15T22:06:53.084 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:49.519+0000 7fa497fff640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7fa48c0391b0 0x7fa48c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T22:06:53.084 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:50.320+0000 7fa497fff640 1 -- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7fa48c0391b0 msgr2=0x7fa48c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/2191835021 2024-09-15T22:06:53.084 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:50.320+0000 7fa497fff640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7fa48c0391b0 0x7fa48c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T22:06:53.084 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:51.522+0000 7fa49d7fa640 1 -- 172.21.15.45:0/2797416502 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fa49006ae60 con 0x7fa4a007dda0 2024-09-15T22:06:53.085 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:51.523+0000 7fa49d7fa640 1 -- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7fa48c0391b0 msgr2=0x7fa48c03b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:06:53.085 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:51.523+0000 7fa49d7fa640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7fa48c0391b0 0x7fa48c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:53.085 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.523+0000 7fa49d7fa640 1 -- 172.21.15.45:0/2797416502 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fa49003c800 con 0x7fa4a007dda0 2024-09-15T22:06:53.085 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.524+0000 7fa49d7fa640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7fa48c03cae0 0x7fa48c03eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:53.085 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.524+0000 7fa49d7fa640 1 -- 172.21.15.45:0/2797416502 --> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa48c03bd80 con 0x7fa48c03cae0 2024-09-15T22:06:53.086 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.524+0000 7fa497fff640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7fa48c03cae0 0x7fa48c03eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:53.086 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.525+0000 7fa497fff640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7fa48c03cae0 0x7fa48c03eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa488003980 tx=0x7fa488006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:53.086 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.526+0000 7fa49d7fa640 1 -- 172.21.15.45:0/2797416502 <== mgr.14118 v2:172.21.15.45:6800/3319321559 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fa48c03bd80 con 0x7fa48c03cae0 2024-09-15T22:06:53.086 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.533+0000 7fa4a616a640 1 -- 172.21.15.45:0/2797416502 --> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fa4a007c390 con 0x7fa48c03cae0 2024-09-15T22:06:53.086 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.533+0000 7fa49d7fa640 1 -- 172.21.15.45:0/2797416502 <== mgr.14118 v2:172.21.15.45:6800/3319321559 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fa4a007c390 con 0x7fa48c03cae0 2024-09-15T22:06:53.086 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.533+0000 7fa4a616a640 1 -- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7fa48c03cae0 msgr2=0x7fa48c03eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:53.087 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.533+0000 7fa4a616a640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7fa48c03cae0 0x7fa48c03eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa488003980 tx=0x7fa488006e10 comp rx=0 tx=0).stop 2024-09-15T22:06:53.087 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.533+0000 7fa4a616a640 1 -- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 msgr2=0x7fa4a019d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:53.087 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.533+0000 7fa4a616a640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 0x7fa4a019d8e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa490031000 tx=0x7fa490032e40 comp rx=0 tx=0).stop 2024-09-15T22:06:53.087 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.533+0000 7fa4a616a640 1 -- 172.21.15.45:0/2797416502 shutdown_connections 2024-09-15T22:06:53.087 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.533+0000 7fa4a616a640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7fa48c03cae0 0x7fa48c03eed0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:53.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.533+0000 7fa4a616a640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:6800/2191835021,v1:172.21.15.45:6801/2191835021] conn(0x7fa48c0391b0 0x7fa48c03b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:53.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.533+0000 7fa4a616a640 1 --2- 172.21.15.45:0/2797416502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4a007dda0 0x7fa4a019d8e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:53.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.533+0000 7fa4a616a640 1 -- 172.21.15.45:0/2797416502 >> 172.21.15.45:0/2797416502 conn(0x7fa4a0102f20 msgr2=0x7fa4a0103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:53.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.533+0000 7fa4a616a640 1 -- 172.21.15.45:0/2797416502 shutdown_connections 2024-09-15T22:06:53.088 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:52.533+0000 7fa4a616a640 1 -- 172.21.15.45:0/2797416502 wait complete. 2024-09-15T22:06:53.089 INFO:teuthology.orchestra.run.smithi045.stdout:mgr epoch 5 is available 2024-09-15T22:06:53.089 INFO:teuthology.orchestra.run.smithi045.stdout:Setting orchestrator backend to cephadm... 2024-09-15T22:06:54.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.447+0000 7f6e3ee74640 1 Processor -- start 2024-09-15T22:06:54.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.447+0000 7f6e3ee74640 1 -- start start 2024-09-15T22:06:54.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.447+0000 7f6e3ee74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 0x7f6e3810a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:54.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.447+0000 7f6e3ee74640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3807be50 con 0x7f6e38108170 2024-09-15T22:06:54.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.447+0000 7f6e3cc10640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 0x7f6e3810a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:54.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.447+0000 7f6e3cc10640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 0x7f6e3810a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51126/0 (socket says 172.21.15.45:51126) 2024-09-15T22:06:54.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.447+0000 7f6e3cc10640 1 -- 172.21.15.45:0/3789481432 learned_addr learned my addr 172.21.15.45:0/3789481432 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:54.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.448+0000 7f6e3cc10640 1 -- 172.21.15.45:0/3789481432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3810aaa0 con 0x7f6e38108170 2024-09-15T22:06:54.204 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.448+0000 7f6e3cc10640 1 --2- 172.21.15.45:0/3789481432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 0x7f6e3810a560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009820 tx=0x7f6e2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702ebd7ad87a71df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:54.205 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.448+0000 7f6e377fe640 1 -- 172.21.15.45:0/3789481432 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c037070 con 0x7f6e38108170 2024-09-15T22:06:54.205 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.448+0000 7f6e377fe640 1 -- 172.21.15.45:0/3789481432 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f6e2c032920 con 0x7f6e38108170 2024-09-15T22:06:54.205 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.448+0000 7f6e377fe640 1 -- 172.21.15.45:0/3789481432 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c030950 con 0x7f6e38108170 2024-09-15T22:06:54.205 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.449+0000 7f6e3ee74640 1 -- 172.21.15.45:0/3789481432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 msgr2=0x7f6e3810a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:54.205 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.449+0000 7f6e3ee74640 1 --2- 172.21.15.45:0/3789481432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 0x7f6e3810a560 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c009820 tx=0x7f6e2c02a270 comp rx=0 tx=0).stop 2024-09-15T22:06:54.205 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.449+0000 7f6e3ee74640 1 -- 172.21.15.45:0/3789481432 shutdown_connections 2024-09-15T22:06:54.205 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.449+0000 7f6e3ee74640 1 --2- 172.21.15.45:0/3789481432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 0x7f6e3810a560 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:54.205 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.449+0000 7f6e3ee74640 1 -- 172.21.15.45:0/3789481432 >> 172.21.15.45:0/3789481432 conn(0x7f6e38101df0 msgr2=0x7f6e38104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:54.205 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.449+0000 7f6e3ee74640 1 -- 172.21.15.45:0/3789481432 shutdown_connections 2024-09-15T22:06:54.205 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.449+0000 7f6e3ee74640 1 -- 172.21.15.45:0/3789481432 wait complete. 2024-09-15T22:06:54.205 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.450+0000 7f6e3ee74640 1 Processor -- start 2024-09-15T22:06:54.205 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.450+0000 7f6e3ee74640 1 -- start start 2024-09-15T22:06:54.205 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.450+0000 7f6e3ee74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 0x7f6e381079f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:54.206 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.450+0000 7f6e3ee74640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3810bb40 con 0x7f6e38108170 2024-09-15T22:06:54.206 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.450+0000 7f6e3cc10640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 0x7f6e381079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:54.206 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.450+0000 7f6e3cc10640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 0x7f6e381079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51136/0 (socket says 172.21.15.45:51136) 2024-09-15T22:06:54.206 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.450+0000 7f6e3cc10640 1 -- 172.21.15.45:0/143446237 learned_addr learned my addr 172.21.15.45:0/143446237 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:54.206 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.451+0000 7f6e3cc10640 1 -- 172.21.15.45:0/143446237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e38107f30 con 0x7f6e38108170 2024-09-15T22:06:54.206 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.451+0000 7f6e3cc10640 1 --2- 172.21.15.45:0/143446237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 0x7f6e381079f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c031000 tx=0x7f6e2c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:54.206 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.451+0000 7f6e35ffb640 1 -- 172.21.15.45:0/143446237 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c042070 con 0x7f6e38108170 2024-09-15T22:06:54.206 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.451+0000 7f6e35ffb640 1 -- 172.21.15.45:0/143446237 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f6e2c0326b0 con 0x7f6e38108170 2024-09-15T22:06:54.206 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.451+0000 7f6e3ee74640 1 -- 172.21.15.45:0/143446237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e38106120 con 0x7f6e38108170 2024-09-15T22:06:54.206 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.451+0000 7f6e35ffb640 1 -- 172.21.15.45:0/143446237 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c037040 con 0x7f6e38108170 2024-09-15T22:06:54.206 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.451+0000 7f6e3ee74640 1 -- 172.21.15.45:0/143446237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e38106660 con 0x7f6e38108170 2024-09-15T22:06:54.206 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.452+0000 7f6e35ffb640 1 -- 172.21.15.45:0/143446237 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f6e2c045070 con 0x7f6e38108170 2024-09-15T22:06:54.207 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.452+0000 7f6e3ee74640 1 -- 172.21.15.45:0/143446237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e381085d0 con 0x7f6e38108170 2024-09-15T22:06:54.207 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.453+0000 7f6e35ffb640 1 --2- 172.21.15.45:0/143446237 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f6e280390f0 0x7f6e2803b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:54.207 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.453+0000 7f6e35ffb640 1 -- 172.21.15.45:0/143446237 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6e2c06c060 con 0x7f6e38108170 2024-09-15T22:06:54.207 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.453+0000 7f6e37fff640 1 --2- 172.21.15.45:0/143446237 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f6e280390f0 0x7f6e2803b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:54.207 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.453+0000 7f6e37fff640 1 --2- 172.21.15.45:0/143446237 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f6e280390f0 0x7f6e2803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6e240098c0 tx=0x7f6e24006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:54.207 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.458+0000 7f6e35ffb640 1 -- 172.21.15.45:0/143446237 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e2c03c800 con 0x7f6e38108170 2024-09-15T22:06:54.207 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.649+0000 7f6e3ee74640 1 -- 172.21.15.45:0/143446237 --> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f6e38106ea0 con 0x7f6e280390f0 2024-09-15T22:06:54.207 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.654+0000 7f6e35ffb640 1 -- 172.21.15.45:0/143446237 <== mgr.14118 v2:172.21.15.45:6800/3319321559 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6e38106ea0 con 0x7f6e280390f0 2024-09-15T22:06:54.207 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.656+0000 7f6e3ee74640 1 -- 172.21.15.45:0/143446237 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f6e280390f0 msgr2=0x7f6e2803b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:54.207 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.656+0000 7f6e3ee74640 1 --2- 172.21.15.45:0/143446237 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f6e280390f0 0x7f6e2803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6e240098c0 tx=0x7f6e24006db0 comp rx=0 tx=0).stop 2024-09-15T22:06:54.207 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.656+0000 7f6e3ee74640 1 -- 172.21.15.45:0/143446237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 msgr2=0x7f6e381079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:54.207 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.656+0000 7f6e3ee74640 1 --2- 172.21.15.45:0/143446237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 0x7f6e381079f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c031000 tx=0x7f6e2c032e40 comp rx=0 tx=0).stop 2024-09-15T22:06:54.207 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.656+0000 7f6e3ee74640 1 -- 172.21.15.45:0/143446237 shutdown_connections 2024-09-15T22:06:54.208 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.656+0000 7f6e3ee74640 1 --2- 172.21.15.45:0/143446237 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f6e280390f0 0x7f6e2803b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:54.208 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.656+0000 7f6e3ee74640 1 --2- 172.21.15.45:0/143446237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e38108170 0x7f6e381079f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:54.208 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.656+0000 7f6e3ee74640 1 -- 172.21.15.45:0/143446237 >> 172.21.15.45:0/143446237 conn(0x7f6e38101df0 msgr2=0x7f6e38102a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:54.208 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.657+0000 7f6e3ee74640 1 -- 172.21.15.45:0/143446237 shutdown_connections 2024-09-15T22:06:54.208 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:53.657+0000 7f6e3ee74640 1 -- 172.21.15.45:0/143446237 wait complete. 2024-09-15T22:06:54.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-mon[31180]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T22:06:54.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-mon[31180]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T22:06:54.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:06:54.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:06:54.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:06:54.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:54.621 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:54.553+0000 7fc79ef4f640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:22:06:54] ENGINE Error in HTTPServer.serve 2024-09-15T22:06:54.621 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: Traceback (most recent call last): 2024-09-15T22:06:54.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:06:54.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: self._connections.run(self.expiration_interval) 2024-09-15T22:06:54.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:06:54.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: self._run(expiration_interval) 2024-09-15T22:06:54.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:06:54.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:06:54.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:06:54.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:06:54.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:06:54.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: s = self.context.wrap_socket( 2024-09-15T22:06:54.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:06:54.623 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: return self.sslsocket_class._create( 2024-09-15T22:06:54.623 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:06:54.623 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: self.do_handshake() 2024-09-15T22:06:54.623 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:06:54.623 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: self._sslobj.do_handshake() 2024-09-15T22:06:54.623 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:06:54.623 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:54 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:06:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:55 smithi045 ceph-mon[31180]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:06:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:55 smithi045 ceph-mon[31180]: mgrmap e8: x(active, since 2s) 2024-09-15T22:06:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:55 smithi045 ceph-mon[31180]: [15/Sep/2024:22:06:54] ENGINE Bus STARTING 2024-09-15T22:06:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:55 smithi045 ceph-mon[31180]: [15/Sep/2024:22:06:54] ENGINE Serving on http://172.21.15.45:8765 2024-09-15T22:06:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:55 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:06:55.444 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-15T22:06:55.444 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.618+0000 7f0e589ce640 1 Processor -- start 2024-09-15T22:06:55.445 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.619+0000 7f0e589ce640 1 -- start start 2024-09-15T22:06:55.445 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.619+0000 7f0e589ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 0x7f0e54107b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:55.445 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.619+0000 7f0e589ce640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0e541080e0 con 0x7f0e54107710 2024-09-15T22:06:55.445 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.619+0000 7f0e5259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 0x7f0e54107b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:55.445 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.619+0000 7f0e5259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 0x7f0e54107b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47608/0 (socket says 172.21.15.45:47608) 2024-09-15T22:06:55.445 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.619+0000 7f0e5259c640 1 -- 172.21.15.45:0/379513242 learned_addr learned my addr 172.21.15.45:0/379513242 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:55.445 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.619+0000 7f0e5259c640 1 -- 172.21.15.45:0/379513242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e541088c0 con 0x7f0e54107710 2024-09-15T22:06:55.445 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.620+0000 7f0e5259c640 1 --2- 172.21.15.45:0/379513242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 0x7f0e54107b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009820 tx=0x7f0e4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97399e0a32c1dfe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:55.445 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.620+0000 7f0e51d9b640 1 -- 172.21.15.45:0/379513242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e44037070 con 0x7f0e54107710 2024-09-15T22:06:55.445 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.620+0000 7f0e51d9b640 1 -- 172.21.15.45:0/379513242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f0e44032920 con 0x7f0e54107710 2024-09-15T22:06:55.445 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.620+0000 7f0e51d9b640 1 -- 172.21.15.45:0/379513242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e44030950 con 0x7f0e54107710 2024-09-15T22:06:55.446 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.621+0000 7f0e589ce640 1 -- 172.21.15.45:0/379513242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 msgr2=0x7f0e54107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:55.446 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.621+0000 7f0e589ce640 1 --2- 172.21.15.45:0/379513242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 0x7f0e54107b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009820 tx=0x7f0e4402a270 comp rx=0 tx=0).stop 2024-09-15T22:06:55.446 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.621+0000 7f0e589ce640 1 -- 172.21.15.45:0/379513242 shutdown_connections 2024-09-15T22:06:55.446 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.621+0000 7f0e589ce640 1 --2- 172.21.15.45:0/379513242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 0x7f0e54107b10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:55.446 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.621+0000 7f0e589ce640 1 -- 172.21.15.45:0/379513242 >> 172.21.15.45:0/379513242 conn(0x7f0e54102fc0 msgr2=0x7f0e541053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:55.446 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.621+0000 7f0e589ce640 1 -- 172.21.15.45:0/379513242 shutdown_connections 2024-09-15T22:06:55.446 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.621+0000 7f0e589ce640 1 -- 172.21.15.45:0/379513242 wait complete. 2024-09-15T22:06:55.446 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.621+0000 7f0e589ce640 1 Processor -- start 2024-09-15T22:06:55.446 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.622+0000 7f0e589ce640 1 -- start start 2024-09-15T22:06:55.446 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.622+0000 7f0e589ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 0x7f0e5419b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:55.446 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.622+0000 7f0e589ce640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5410bc70 con 0x7f0e54107710 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.622+0000 7f0e5259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 0x7f0e5419b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.622+0000 7f0e5259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 0x7f0e5419b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47612/0 (socket says 172.21.15.45:47612) 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.622+0000 7f0e5259c640 1 -- 172.21.15.45:0/4268082898 learned_addr learned my addr 172.21.15.45:0/4268082898 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.622+0000 7f0e5259c640 1 -- 172.21.15.45:0/4268082898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5419bc40 con 0x7f0e54107710 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.622+0000 7f0e5259c640 1 --2- 172.21.15.45:0/4268082898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 0x7f0e5419b700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009940 tx=0x7f0e44032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.622+0000 7f0e4b7fe640 1 -- 172.21.15.45:0/4268082898 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e44042070 con 0x7f0e54107710 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.622+0000 7f0e4b7fe640 1 -- 172.21.15.45:0/4268082898 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f0e440326b0 con 0x7f0e54107710 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.622+0000 7f0e589ce640 1 -- 172.21.15.45:0/4268082898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e5419bed0 con 0x7f0e54107710 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.622+0000 7f0e4b7fe640 1 -- 172.21.15.45:0/4268082898 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e44037040 con 0x7f0e54107710 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.623+0000 7f0e589ce640 1 -- 172.21.15.45:0/4268082898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e5419ebc0 con 0x7f0e54107710 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.623+0000 7f0e4b7fe640 1 -- 172.21.15.45:0/4268082898 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f0e44045070 con 0x7f0e54107710 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.624+0000 7f0e4b7fe640 1 --2- 172.21.15.45:0/4268082898 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0e400391b0 0x7f0e4003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.624+0000 7f0e589ce640 1 -- 172.21.15.45:0/4268082898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e54107b90 con 0x7f0e54107710 2024-09-15T22:06:55.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.624+0000 7f0e4b7fe640 1 -- 172.21.15.45:0/4268082898 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0e4406c4f0 con 0x7f0e54107710 2024-09-15T22:06:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.624+0000 7f0e4bfff640 1 --2- 172.21.15.45:0/4268082898 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0e400391b0 0x7f0e4003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.624+0000 7f0e4bfff640 1 --2- 172.21.15.45:0/4268082898 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0e400391b0 0x7f0e4003b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0098c0 tx=0x7f0e3c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.629+0000 7f0e4b7fe640 1 -- 172.21.15.45:0/4268082898 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e4403d910 con 0x7f0e54107710 2024-09-15T22:06:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.807+0000 7f0e589ce640 1 -- 172.21.15.45:0/4268082898 --> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f0e54104280 con 0x7f0e400391b0 2024-09-15T22:06:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.808+0000 7f0e4b7fe640 1 -- 172.21.15.45:0/4268082898 <== mgr.14118 v2:172.21.15.45:6800/3319321559 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f0e54104280 con 0x7f0e400391b0 2024-09-15T22:06:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.810+0000 7f0e589ce640 1 -- 172.21.15.45:0/4268082898 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0e400391b0 msgr2=0x7f0e4003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.810+0000 7f0e589ce640 1 --2- 172.21.15.45:0/4268082898 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0e400391b0 0x7f0e4003b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0098c0 tx=0x7f0e3c006db0 comp rx=0 tx=0).stop 2024-09-15T22:06:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.810+0000 7f0e589ce640 1 -- 172.21.15.45:0/4268082898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 msgr2=0x7f0e5419b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.810+0000 7f0e589ce640 1 --2- 172.21.15.45:0/4268082898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 0x7f0e5419b700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0e44009940 tx=0x7f0e44032e40 comp rx=0 tx=0).stop 2024-09-15T22:06:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.810+0000 7f0e589ce640 1 -- 172.21.15.45:0/4268082898 shutdown_connections 2024-09-15T22:06:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.810+0000 7f0e589ce640 1 --2- 172.21.15.45:0/4268082898 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0e400391b0 0x7f0e4003b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.810+0000 7f0e589ce640 1 --2- 172.21.15.45:0/4268082898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e54107710 0x7f0e5419b700 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:55.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.810+0000 7f0e589ce640 1 -- 172.21.15.45:0/4268082898 >> 172.21.15.45:0/4268082898 conn(0x7f0e54102fc0 msgr2=0x7f0e54103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:55.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.810+0000 7f0e589ce640 1 -- 172.21.15.45:0/4268082898 shutdown_connections 2024-09-15T22:06:55.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:54.810+0000 7f0e589ce640 1 -- 172.21.15.45:0/4268082898 wait complete. 2024-09-15T22:06:55.449 INFO:teuthology.orchestra.run.smithi045.stdout:Generating ssh key... 2024-09-15T22:06:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-mon[31180]: [15/Sep/2024:22:06:54] ENGINE Serving on https://172.21.15.45:7150 2024-09-15T22:06:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-mon[31180]: [15/Sep/2024:22:06:54] ENGINE Bus STARTED 2024-09-15T22:06:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-mon[31180]: [15/Sep/2024:22:06:54] ENGINE Error in HTTPServer.serve 2024-09-15T22:06:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout: Traceback (most recent call last): 2024-09-15T22:06:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:06:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:06:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:06:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout: self._run(expiration_interval) 2024-09-15T22:06:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:06:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:06:56.301 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:06:56.301 INFO:journalctl@ceph.mon.a.smithi045.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:06:56.301 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:06:56.301 INFO:journalctl@ceph.mon.a.smithi045.stdout: s = self.context.wrap_socket( 2024-09-15T22:06:56.301 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:06:56.301 INFO:journalctl@ceph.mon.a.smithi045.stdout: return self.sslsocket_class._create( 2024-09-15T22:06:56.301 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:06:56.301 INFO:journalctl@ceph.mon.a.smithi045.stdout: self.do_handshake() 2024-09-15T22:06:56.301 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:06:56.301 INFO:journalctl@ceph.mon.a.smithi045.stdout: self._sslobj.do_handshake() 2024-09-15T22:06:56.301 INFO:journalctl@ceph.mon.a.smithi045.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:06:56.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-mon[31180]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:06:56.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: Generating public/private rsa key pair. 2024-09-15T22:06:56.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: Your identification has been saved in /tmp/tmpmdx4hs_u/key 2024-09-15T22:06:56.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: Your public key has been saved in /tmp/tmpmdx4hs_u/key.pub 2024-09-15T22:06:56.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: The key fingerprint is: 2024-09-15T22:06:56.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: SHA256:YffAaK/4SLvcX7O2gaCpaBo87Te5ayT51WEbalFPEMY ceph-a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:06:56.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: The key's randomart image is: 2024-09-15T22:06:56.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: +---[RSA 3072]----+ 2024-09-15T22:06:56.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: | .+o | 2024-09-15T22:06:56.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: | .E . | 2024-09-15T22:06:56.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: | * * | 2024-09-15T22:06:56.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: | + B + | 2024-09-15T22:06:56.303 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: | . S = . | 2024-09-15T22:06:56.303 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: |. .o . B = . | 2024-09-15T22:06:56.303 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: |.o .+ O . . + | 2024-09-15T22:06:56.303 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: | .+. X = ..+ | 2024-09-15T22:06:56.303 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: |.o..+oO.o...o. | 2024-09-15T22:06:56.303 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:06:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: +----[SHA256]-----+ 2024-09-15T22:06:56.783 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.828+0000 7ff85f947640 1 Processor -- start 2024-09-15T22:06:56.783 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.828+0000 7ff85f947640 1 -- start start 2024-09-15T22:06:56.783 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.829+0000 7ff85f947640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 0x7ff85810a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:56.783 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.829+0000 7ff85f947640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff85807be50 con 0x7ff858108170 2024-09-15T22:06:56.784 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.829+0000 7ff85d6e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 0x7ff85810a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:56.784 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.829+0000 7ff85d6e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 0x7ff85810a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47618/0 (socket says 172.21.15.45:47618) 2024-09-15T22:06:56.784 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.829+0000 7ff85d6e3640 1 -- 172.21.15.45:0/2283116899 learned_addr learned my addr 172.21.15.45:0/2283116899 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:56.784 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.829+0000 7ff85d6e3640 1 -- 172.21.15.45:0/2283116899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85810aaa0 con 0x7ff858108170 2024-09-15T22:06:56.784 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.830+0000 7ff85d6e3640 1 --2- 172.21.15.45:0/2283116899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 0x7ff85810a560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff854009820 tx=0x7ff85402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a064bb7de91b998 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:56.784 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.830+0000 7ff84ffff640 1 -- 172.21.15.45:0/2283116899 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff854037070 con 0x7ff858108170 2024-09-15T22:06:56.784 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.830+0000 7ff84ffff640 1 -- 172.21.15.45:0/2283116899 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff854032920 con 0x7ff858108170 2024-09-15T22:06:56.784 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.830+0000 7ff84ffff640 1 -- 172.21.15.45:0/2283116899 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff854030950 con 0x7ff858108170 2024-09-15T22:06:56.784 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.831+0000 7ff85f947640 1 -- 172.21.15.45:0/2283116899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 msgr2=0x7ff85810a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:56.784 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.831+0000 7ff85f947640 1 --2- 172.21.15.45:0/2283116899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 0x7ff85810a560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff854009820 tx=0x7ff85402a270 comp rx=0 tx=0).stop 2024-09-15T22:06:56.784 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.831+0000 7ff85f947640 1 -- 172.21.15.45:0/2283116899 shutdown_connections 2024-09-15T22:06:56.784 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.831+0000 7ff85f947640 1 --2- 172.21.15.45:0/2283116899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 0x7ff85810a560 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.831+0000 7ff85f947640 1 -- 172.21.15.45:0/2283116899 >> 172.21.15.45:0/2283116899 conn(0x7ff858101df0 msgr2=0x7ff858104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.831+0000 7ff85f947640 1 -- 172.21.15.45:0/2283116899 shutdown_connections 2024-09-15T22:06:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.831+0000 7ff85f947640 1 -- 172.21.15.45:0/2283116899 wait complete. 2024-09-15T22:06:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.831+0000 7ff85f947640 1 Processor -- start 2024-09-15T22:06:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.831+0000 7ff85f947640 1 -- start start 2024-09-15T22:06:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.832+0000 7ff85f947640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 0x7ff8581079f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.832+0000 7ff85f947640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff85810bb40 con 0x7ff858108170 2024-09-15T22:06:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.832+0000 7ff85d6e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 0x7ff8581079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.832+0000 7ff85d6e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 0x7ff8581079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47632/0 (socket says 172.21.15.45:47632) 2024-09-15T22:06:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.832+0000 7ff85d6e3640 1 -- 172.21.15.45:0/1940754209 learned_addr learned my addr 172.21.15.45:0/1940754209 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.832+0000 7ff85d6e3640 1 -- 172.21.15.45:0/1940754209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff858107f30 con 0x7ff858108170 2024-09-15T22:06:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.832+0000 7ff85d6e3640 1 --2- 172.21.15.45:0/1940754209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 0x7ff8581079f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff854006f10 tx=0x7ff8540327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.832+0000 7ff84e7fc640 1 -- 172.21.15.45:0/1940754209 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff854037040 con 0x7ff858108170 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.832+0000 7ff84e7fc640 1 -- 172.21.15.45:0/1940754209 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff854040070 con 0x7ff858108170 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.832+0000 7ff85f947640 1 -- 172.21.15.45:0/1940754209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff858106120 con 0x7ff858108170 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.832+0000 7ff84e7fc640 1 -- 172.21.15.45:0/1940754209 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff85403a630 con 0x7ff858108170 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.832+0000 7ff85f947640 1 -- 172.21.15.45:0/1940754209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff858106660 con 0x7ff858108170 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.833+0000 7ff84e7fc640 1 -- 172.21.15.45:0/1940754209 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ff85403b420 con 0x7ff858108170 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.833+0000 7ff85f947640 1 -- 172.21.15.45:0/1940754209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8581085d0 con 0x7ff858108170 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.834+0000 7ff84e7fc640 1 --2- 172.21.15.45:0/1940754209 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7ff844039200 0x7ff84403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.834+0000 7ff84e7fc640 1 -- 172.21.15.45:0/1940754209 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff85406c6d0 con 0x7ff858108170 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.834+0000 7ff85cee2640 1 --2- 172.21.15.45:0/1940754209 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7ff844039200 0x7ff84403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.834+0000 7ff85cee2640 1 --2- 172.21.15.45:0/1940754209 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7ff844039200 0x7ff84403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff8480098c0 tx=0x7ff848006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:55.838+0000 7ff84e7fc640 1 -- 172.21.15.45:0/1940754209 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff85404a200 con 0x7ff858108170 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:56.017+0000 7ff85f947640 1 -- 172.21.15.45:0/1940754209 --> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7ff858106f40 con 0x7ff844039200 2024-09-15T22:06:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:56.226+0000 7ff84e7fc640 1 -- 172.21.15.45:0/1940754209 <== mgr.14118 v2:172.21.15.45:6800/3319321559 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff858106f40 con 0x7ff844039200 2024-09-15T22:06:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:56.228+0000 7ff85f947640 1 -- 172.21.15.45:0/1940754209 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7ff844039200 msgr2=0x7ff84403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:56.228+0000 7ff85f947640 1 --2- 172.21.15.45:0/1940754209 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7ff844039200 0x7ff84403b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff8480098c0 tx=0x7ff848006db0 comp rx=0 tx=0).stop 2024-09-15T22:06:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:56.228+0000 7ff85f947640 1 -- 172.21.15.45:0/1940754209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 msgr2=0x7ff8581079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:56.228+0000 7ff85f947640 1 --2- 172.21.15.45:0/1940754209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 0x7ff8581079f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff854006f10 tx=0x7ff8540327d0 comp rx=0 tx=0).stop 2024-09-15T22:06:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:56.228+0000 7ff85f947640 1 -- 172.21.15.45:0/1940754209 shutdown_connections 2024-09-15T22:06:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:56.228+0000 7ff85f947640 1 --2- 172.21.15.45:0/1940754209 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7ff844039200 0x7ff84403b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:56.228+0000 7ff85f947640 1 --2- 172.21.15.45:0/1940754209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff858108170 0x7ff8581079f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:56.228+0000 7ff85f947640 1 -- 172.21.15.45:0/1940754209 >> 172.21.15.45:0/1940754209 conn(0x7ff858101df0 msgr2=0x7ff858102a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:56.228+0000 7ff85f947640 1 -- 172.21.15.45:0/1940754209 shutdown_connections 2024-09-15T22:06:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:56.228+0000 7ff85f947640 1 -- 172.21.15.45:0/1940754209 wait complete. 2024-09-15T22:06:57.425 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:57 smithi045 ceph-mon[31180]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:06:57.425 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:57 smithi045 ceph-mon[31180]: Generating ssh key... 2024-09-15T22:06:57.425 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:57 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:06:57.425 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:57 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:06:57.982 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpGBxAvhXwqendVypoUZnWD84/oWj2O6ifZL29K9G5shkQY73J6dqmaNcBV5fBnqprEkXGBtDZFW2BKCGT6h5RNx0pAsp5BCZ4Ii7SXvXj+VahTXNrP2gNIdQIv1T6HFGdRZPwS8WjYLZPrTpZVs9ez5tkWlLD9hsSrpCNpep0Aln06vfnVdFIhivVOtaIBrBE4gYRrW7OUp+JVzB0N2Exf8RZdYkd+hEiNOfvKV+S2bp/USSMQNofl99I1nOUU5OLTHvQHR6s65I5QO3aknCbZaMNEBS/qxz1hspkyvsQwKS4orYDPd+ypKT7CDU7d4v0QC5aLw0RycgLn+3TufQyuqvmELzTjWApsgD110y4on8oiC7PUqciftoxNh74O4WiLB+CH/g251JaQBqflDapKLCEEtk7SOCGHcJ+Q+SrayKSVPC1TWyjzgvyLFZjpEPlQINAjaT7llMwXnqiZCr0BcYx0DOsEAv2tEPOo165CgrL4qHv5ffNYAr3OcInA/M= ceph-a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:06:57.982 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.229+0000 7ff27c772640 1 Processor -- start 2024-09-15T22:06:57.982 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.230+0000 7ff27c772640 1 -- start start 2024-09-15T22:06:57.982 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.230+0000 7ff27c772640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 0x7ff274107b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:57.982 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.230+0000 7ff27c772640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff274108050 con 0x7ff274107710 2024-09-15T22:06:57.982 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.230+0000 7ff27a50e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 0x7ff274107b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:57.982 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.230+0000 7ff27a50e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 0x7ff274107b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47634/0 (socket says 172.21.15.45:47634) 2024-09-15T22:06:57.982 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.230+0000 7ff27a50e640 1 -- 172.21.15.45:0/2031744768 learned_addr learned my addr 172.21.15.45:0/2031744768 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:57.982 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.230+0000 7ff27a50e640 1 -- 172.21.15.45:0/2031744768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2741081d0 con 0x7ff274107710 2024-09-15T22:06:57.982 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.231+0000 7ff27a50e640 1 --2- 172.21.15.45:0/2031744768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 0x7ff274107b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff264009e80 tx=0x7ff26402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a82e031e2b2875 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:57.983 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.231+0000 7ff27950c640 1 -- 172.21.15.45:0/2031744768 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff264036070 con 0x7ff274107710 2024-09-15T22:06:57.983 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.231+0000 7ff27950c640 1 -- 172.21.15.45:0/2031744768 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff2640318e0 con 0x7ff274107710 2024-09-15T22:06:57.983 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.231+0000 7ff27950c640 1 -- 172.21.15.45:0/2031744768 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff264007b00 con 0x7ff274107710 2024-09-15T22:06:57.983 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.232+0000 7ff27c772640 1 -- 172.21.15.45:0/2031744768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 msgr2=0x7ff274107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:57.983 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.232+0000 7ff27c772640 1 --2- 172.21.15.45:0/2031744768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 0x7ff274107b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff264009e80 tx=0x7ff26402a7a0 comp rx=0 tx=0).stop 2024-09-15T22:06:57.983 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.232+0000 7ff27c772640 1 -- 172.21.15.45:0/2031744768 shutdown_connections 2024-09-15T22:06:57.983 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.232+0000 7ff27c772640 1 --2- 172.21.15.45:0/2031744768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 0x7ff274107b10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:57.983 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.232+0000 7ff27c772640 1 -- 172.21.15.45:0/2031744768 >> 172.21.15.45:0/2031744768 conn(0x7ff274102fc0 msgr2=0x7ff2741053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:57.983 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.232+0000 7ff27c772640 1 -- 172.21.15.45:0/2031744768 shutdown_connections 2024-09-15T22:06:57.983 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.232+0000 7ff27c772640 1 -- 172.21.15.45:0/2031744768 wait complete. 2024-09-15T22:06:57.983 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.233+0000 7ff27c772640 1 Processor -- start 2024-09-15T22:06:57.983 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.233+0000 7ff27c772640 1 -- start start 2024-09-15T22:06:57.984 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.233+0000 7ff27c772640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 0x7ff27419b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:57.984 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.233+0000 7ff27c772640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff27410bb80 con 0x7ff274107710 2024-09-15T22:06:57.984 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.233+0000 7ff27a50e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 0x7ff27419b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:57.984 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.233+0000 7ff27a50e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 0x7ff27419b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47642/0 (socket says 172.21.15.45:47642) 2024-09-15T22:06:57.984 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.233+0000 7ff27a50e640 1 -- 172.21.15.45:0/3683398974 learned_addr learned my addr 172.21.15.45:0/3683398974 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:06:57.984 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.234+0000 7ff27a50e640 1 -- 172.21.15.45:0/3683398974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27419bbf0 con 0x7ff274107710 2024-09-15T22:06:57.984 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.234+0000 7ff27a50e640 1 --2- 172.21.15.45:0/3683398974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 0x7ff27419b6b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff26402acc0 tx=0x7ff264031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:57.984 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.234+0000 7ff2737fe640 1 -- 172.21.15.45:0/3683398974 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff264041020 con 0x7ff274107710 2024-09-15T22:06:57.984 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.234+0000 7ff27c772640 1 -- 172.21.15.45:0/3683398974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27419be80 con 0x7ff274107710 2024-09-15T22:06:57.984 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.234+0000 7ff2737fe640 1 -- 172.21.15.45:0/3683398974 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff264031c40 con 0x7ff274107710 2024-09-15T22:06:57.984 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.234+0000 7ff2737fe640 1 -- 172.21.15.45:0/3683398974 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff264036040 con 0x7ff274107710 2024-09-15T22:06:57.984 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.234+0000 7ff27c772640 1 -- 172.21.15.45:0/3683398974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27419eb70 con 0x7ff274107710 2024-09-15T22:06:57.984 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.235+0000 7ff2737fe640 1 -- 172.21.15.45:0/3683398974 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ff264044020 con 0x7ff274107710 2024-09-15T22:06:57.985 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.235+0000 7ff27c772640 1 -- 172.21.15.45:0/3683398974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff274107b90 con 0x7ff274107710 2024-09-15T22:06:57.985 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.235+0000 7ff2737fe640 1 --2- 172.21.15.45:0/3683398974 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7ff25c0391b0 0x7ff25c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:06:57.985 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.235+0000 7ff2737fe640 1 -- 172.21.15.45:0/3683398974 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff264007e00 con 0x7ff274107710 2024-09-15T22:06:57.985 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.236+0000 7ff279d0d640 1 --2- 172.21.15.45:0/3683398974 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7ff25c0391b0 0x7ff25c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:06:57.985 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.236+0000 7ff279d0d640 1 --2- 172.21.15.45:0/3683398974 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7ff25c0391b0 0x7ff25c03b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff2680098c0 tx=0x7ff268006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:06:57.985 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.240+0000 7ff2737fe640 1 -- 172.21.15.45:0/3683398974 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff26404b020 con 0x7ff274107710 2024-09-15T22:06:57.985 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.423+0000 7ff27c772640 1 -- 172.21.15.45:0/3683398974 --> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7ff274104240 con 0x7ff25c0391b0 2024-09-15T22:06:57.985 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.423+0000 7ff2737fe640 1 -- 172.21.15.45:0/3683398974 <== mgr.14118 v2:172.21.15.45:6800/3319321559 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7ff274104240 con 0x7ff25c0391b0 2024-09-15T22:06:57.985 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.426+0000 7ff27c772640 1 -- 172.21.15.45:0/3683398974 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7ff25c0391b0 msgr2=0x7ff25c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:57.985 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.426+0000 7ff27c772640 1 --2- 172.21.15.45:0/3683398974 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7ff25c0391b0 0x7ff25c03b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff2680098c0 tx=0x7ff268006db0 comp rx=0 tx=0).stop 2024-09-15T22:06:57.985 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.426+0000 7ff27c772640 1 -- 172.21.15.45:0/3683398974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 msgr2=0x7ff27419b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:06:57.985 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.426+0000 7ff27c772640 1 --2- 172.21.15.45:0/3683398974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 0x7ff27419b6b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff26402acc0 tx=0x7ff264031700 comp rx=0 tx=0).stop 2024-09-15T22:06:57.985 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.426+0000 7ff27c772640 1 -- 172.21.15.45:0/3683398974 shutdown_connections 2024-09-15T22:06:57.986 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.426+0000 7ff27c772640 1 --2- 172.21.15.45:0/3683398974 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7ff25c0391b0 0x7ff25c03b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:57.986 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.426+0000 7ff27c772640 1 --2- 172.21.15.45:0/3683398974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff274107710 0x7ff27419b6b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:06:57.986 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.426+0000 7ff27c772640 1 -- 172.21.15.45:0/3683398974 >> 172.21.15.45:0/3683398974 conn(0x7ff274102fc0 msgr2=0x7ff274103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:06:57.986 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.426+0000 7ff27c772640 1 -- 172.21.15.45:0/3683398974 shutdown_connections 2024-09-15T22:06:57.986 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:57.426+0000 7ff27c772640 1 -- 172.21.15.45:0/3683398974 wait complete. 2024-09-15T22:06:57.986 INFO:teuthology.orchestra.run.smithi045.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:06:57.986 INFO:teuthology.orchestra.run.smithi045.stdout:Adding key to root@localhost authorized_keys... 2024-09-15T22:06:57.986 INFO:teuthology.orchestra.run.smithi045.stdout:Adding host smithi045... 2024-09-15T22:06:58.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:58 smithi045 ceph-mon[31180]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:06:59.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:06:59 smithi045 ceph-mon[31180]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi045", "addr": "172.21.15.45", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:00.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:00 smithi045 ceph-mon[31180]: Deploying cephadm binary to smithi045 2024-09-15T22:07:03.062 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Added host 'smithi045' with addr '172.21.15.45' 2024-09-15T22:07:03.062 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.379+0000 7f89a9175640 1 Processor -- start 2024-09-15T22:07:03.062 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.379+0000 7f89a9175640 1 -- start start 2024-09-15T22:07:03.063 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.379+0000 7f89a9175640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 0x7f89a410a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:03.063 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.379+0000 7f89a9175640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f89a407bdd0 con 0x7f89a41081f0 2024-09-15T22:07:03.063 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.379+0000 7f89a2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 0x7f89a410a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:03.063 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.379+0000 7f89a2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 0x7f89a410a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47656/0 (socket says 172.21.15.45:47656) 2024-09-15T22:07:03.063 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.379+0000 7f89a2d9d640 1 -- 172.21.15.45:0/1989471189 learned_addr learned my addr 172.21.15.45:0/1989471189 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:03.063 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.379+0000 7f89a2d9d640 1 -- 172.21.15.45:0/1989471189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a410ab20 con 0x7f89a41081f0 2024-09-15T22:07:03.063 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.380+0000 7f89a2d9d640 1 --2- 172.21.15.45:0/1989471189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 0x7f89a410a5e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8994009820 tx=0x7f899402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec3cf4177aacb6b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:03.063 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.380+0000 7f89a1d9b640 1 -- 172.21.15.45:0/1989471189 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8994037070 con 0x7f89a41081f0 2024-09-15T22:07:03.063 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.380+0000 7f89a1d9b640 1 -- 172.21.15.45:0/1989471189 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8994032920 con 0x7f89a41081f0 2024-09-15T22:07:03.063 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.380+0000 7f89a1d9b640 1 -- 172.21.15.45:0/1989471189 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8994030950 con 0x7f89a41081f0 2024-09-15T22:07:03.063 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.381+0000 7f89a9175640 1 -- 172.21.15.45:0/1989471189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 msgr2=0x7f89a410a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:03.063 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.381+0000 7f89a9175640 1 --2- 172.21.15.45:0/1989471189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 0x7f89a410a5e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8994009820 tx=0x7f899402a270 comp rx=0 tx=0).stop 2024-09-15T22:07:03.063 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.381+0000 7f89a9175640 1 -- 172.21.15.45:0/1989471189 shutdown_connections 2024-09-15T22:07:03.064 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.381+0000 7f89a9175640 1 --2- 172.21.15.45:0/1989471189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 0x7f89a410a5e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:03.064 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.381+0000 7f89a9175640 1 -- 172.21.15.45:0/1989471189 >> 172.21.15.45:0/1989471189 conn(0x7f89a4101e50 msgr2=0x7f89a4104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:03.064 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.381+0000 7f89a9175640 1 -- 172.21.15.45:0/1989471189 shutdown_connections 2024-09-15T22:07:03.064 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.381+0000 7f89a9175640 1 -- 172.21.15.45:0/1989471189 wait complete. 2024-09-15T22:07:03.064 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.382+0000 7f89a9175640 1 Processor -- start 2024-09-15T22:07:03.064 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.382+0000 7f89a9175640 1 -- start start 2024-09-15T22:07:03.064 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.382+0000 7f89a9175640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 0x7f89a419b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:03.064 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.382+0000 7f89a9175640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f89a410bb00 con 0x7f89a41081f0 2024-09-15T22:07:03.064 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.382+0000 7f89a2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 0x7f89a419b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:03.064 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.382+0000 7f89a2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 0x7f89a419b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47668/0 (socket says 172.21.15.45:47668) 2024-09-15T22:07:03.065 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.382+0000 7f89a2d9d640 1 -- 172.21.15.45:0/490590310 learned_addr learned my addr 172.21.15.45:0/490590310 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:03.065 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.383+0000 7f89a2d9d640 1 -- 172.21.15.45:0/490590310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a419bc20 con 0x7f89a41081f0 2024-09-15T22:07:03.065 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.383+0000 7f89a2d9d640 1 --2- 172.21.15.45:0/490590310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 0x7f89a419b6e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8994006f10 tx=0x7f89940327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:03.065 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.383+0000 7f898bfff640 1 -- 172.21.15.45:0/490590310 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8994037040 con 0x7f89a41081f0 2024-09-15T22:07:03.065 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.383+0000 7f89a9175640 1 -- 172.21.15.45:0/490590310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a419beb0 con 0x7f89a41081f0 2024-09-15T22:07:03.065 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.383+0000 7f89a9175640 1 -- 172.21.15.45:0/490590310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a419eba0 con 0x7f89a41081f0 2024-09-15T22:07:03.065 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.383+0000 7f898bfff640 1 -- 172.21.15.45:0/490590310 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f8994040070 con 0x7f89a41081f0 2024-09-15T22:07:03.065 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.383+0000 7f898bfff640 1 -- 172.21.15.45:0/490590310 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f899403a630 con 0x7f89a41081f0 2024-09-15T22:07:03.065 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.384+0000 7f898bfff640 1 -- 172.21.15.45:0/490590310 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f899403a820 con 0x7f89a41081f0 2024-09-15T22:07:03.065 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.384+0000 7f89a9175640 1 -- 172.21.15.45:0/490590310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89900052c0 con 0x7f89a41081f0 2024-09-15T22:07:03.065 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.384+0000 7f898bfff640 1 --2- 172.21.15.45:0/490590310 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f898c039200 0x7f898c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:03.065 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.384+0000 7f898bfff640 1 -- 172.21.15.45:0/490590310 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f899406c630 con 0x7f89a41081f0 2024-09-15T22:07:03.066 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.385+0000 7f89a259c640 1 --2- 172.21.15.45:0/490590310 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f898c039200 0x7f898c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:03.066 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.385+0000 7f89a259c640 1 --2- 172.21.15.45:0/490590310 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f898c039200 0x7f898c03b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f899800ad30 tx=0x7f89980093f0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:03.066 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.389+0000 7f898bfff640 1 -- 172.21.15.45:0/490590310 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8994041270 con 0x7f89a41081f0 2024-09-15T22:07:03.066 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:06:58.568+0000 7f89a9175640 1 -- 172.21.15.45:0/490590310 --> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi045", "addr": "172.21.15.45", "target": ["mon-mgr", ""]}) -- 0x7f8990000bf0 con 0x7f898c039200 2024-09-15T22:07:03.066 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:02.490+0000 7f898bfff640 1 -- 172.21.15.45:0/490590310 <== mgr.14118 v2:172.21.15.45:6800/3319321559 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f8990000bf0 con 0x7f898c039200 2024-09-15T22:07:03.066 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:02.493+0000 7f89a9175640 1 -- 172.21.15.45:0/490590310 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f898c039200 msgr2=0x7f898c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:03.066 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:02.493+0000 7f89a9175640 1 --2- 172.21.15.45:0/490590310 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f898c039200 0x7f898c03b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f899800ad30 tx=0x7f89980093f0 comp rx=0 tx=0).stop 2024-09-15T22:07:03.066 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:02.493+0000 7f89a9175640 1 -- 172.21.15.45:0/490590310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 msgr2=0x7f89a419b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:03.066 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:02.493+0000 7f89a9175640 1 --2- 172.21.15.45:0/490590310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 0x7f89a419b6e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8994006f10 tx=0x7f89940327d0 comp rx=0 tx=0).stop 2024-09-15T22:07:03.066 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:02.493+0000 7f89a9175640 1 -- 172.21.15.45:0/490590310 shutdown_connections 2024-09-15T22:07:03.066 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:02.493+0000 7f89a9175640 1 --2- 172.21.15.45:0/490590310 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f898c039200 0x7f898c03b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:03.066 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:02.493+0000 7f89a9175640 1 --2- 172.21.15.45:0/490590310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a41081f0 0x7f89a419b6e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:03.066 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:02.493+0000 7f89a9175640 1 -- 172.21.15.45:0/490590310 >> 172.21.15.45:0/490590310 conn(0x7f89a4101e50 msgr2=0x7f89a41029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:03.067 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:02.493+0000 7f89a9175640 1 -- 172.21.15.45:0/490590310 shutdown_connections 2024-09-15T22:07:03.067 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:02.493+0000 7f89a9175640 1 -- 172.21.15.45:0/490590310 wait complete. 2024-09-15T22:07:03.067 INFO:teuthology.orchestra.run.smithi045.stdout:Deploying unmanaged mon service... 2024-09-15T22:07:03.727 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:03 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:07:03.727 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:03 smithi045 ceph-mon[31180]: Added host smithi045 2024-09-15T22:07:03.727 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:03 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:04.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-15T22:07:04.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.523+0000 7f5267b4a640 1 Processor -- start 2024-09-15T22:07:04.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.523+0000 7f5267b4a640 1 -- start start 2024-09-15T22:07:04.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.523+0000 7f5267b4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 0x7f5260106a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:04.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.523+0000 7f5267b4a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5260106fd0 con 0x7f5260106600 2024-09-15T22:07:04.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.524+0000 7f52658e6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 0x7f5260106a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:04.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.524+0000 7f52658e6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 0x7f5260106a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47672/0 (socket says 172.21.15.45:47672) 2024-09-15T22:07:04.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.524+0000 7f52658e6640 1 -- 172.21.15.45:0/3790508357 learned_addr learned my addr 172.21.15.45:0/3790508357 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:04.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.524+0000 7f52658e6640 1 -- 172.21.15.45:0/3790508357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52601077b0 con 0x7f5260106600 2024-09-15T22:07:04.447 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.525+0000 7f52658e6640 1 --2- 172.21.15.45:0/3790508357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 0x7f5260106a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f525c009820 tx=0x7f525c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30916de37545e361 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:04.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.525+0000 7f52648e4640 1 -- 172.21.15.45:0/3790508357 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f525c037070 con 0x7f5260106600 2024-09-15T22:07:04.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.525+0000 7f52648e4640 1 -- 172.21.15.45:0/3790508357 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f525c032920 con 0x7f5260106600 2024-09-15T22:07:04.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.525+0000 7f52648e4640 1 -- 172.21.15.45:0/3790508357 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f525c030950 con 0x7f5260106600 2024-09-15T22:07:04.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.526+0000 7f5267b4a640 1 -- 172.21.15.45:0/3790508357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 msgr2=0x7f5260106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:04.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.526+0000 7f5267b4a640 1 --2- 172.21.15.45:0/3790508357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 0x7f5260106a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f525c009820 tx=0x7f525c02a270 comp rx=0 tx=0).stop 2024-09-15T22:07:04.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.526+0000 7f5267b4a640 1 -- 172.21.15.45:0/3790508357 shutdown_connections 2024-09-15T22:07:04.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.526+0000 7f5267b4a640 1 --2- 172.21.15.45:0/3790508357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 0x7f5260106a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:04.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.526+0000 7f5267b4a640 1 -- 172.21.15.45:0/3790508357 >> 172.21.15.45:0/3790508357 conn(0x7f5260101e50 msgr2=0x7f5260104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:04.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.526+0000 7f5267b4a640 1 -- 172.21.15.45:0/3790508357 shutdown_connections 2024-09-15T22:07:04.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.526+0000 7f5267b4a640 1 -- 172.21.15.45:0/3790508357 wait complete. 2024-09-15T22:07:04.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.526+0000 7f5267b4a640 1 Processor -- start 2024-09-15T22:07:04.448 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.526+0000 7f5267b4a640 1 -- start start 2024-09-15T22:07:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.527+0000 7f5267b4a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 0x7f526019b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.527+0000 7f5267b4a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f526010ab60 con 0x7f5260106600 2024-09-15T22:07:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.527+0000 7f52658e6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 0x7f526019b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.527+0000 7f52658e6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 0x7f526019b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47686/0 (socket says 172.21.15.45:47686) 2024-09-15T22:07:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.527+0000 7f52658e6640 1 -- 172.21.15.45:0/706755030 learned_addr learned my addr 172.21.15.45:0/706755030 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.527+0000 7f52658e6640 1 -- 172.21.15.45:0/706755030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f526019bca0 con 0x7f5260106600 2024-09-15T22:07:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.527+0000 7f52658e6640 1 --2- 172.21.15.45:0/706755030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 0x7f526019b760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f525c006f10 tx=0x7f525c0327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.527+0000 7f5256ffd640 1 -- 172.21.15.45:0/706755030 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f525c037040 con 0x7f5260106600 2024-09-15T22:07:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.527+0000 7f5267b4a640 1 -- 172.21.15.45:0/706755030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f526019bf30 con 0x7f5260106600 2024-09-15T22:07:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.527+0000 7f5256ffd640 1 -- 172.21.15.45:0/706755030 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f525c040070 con 0x7f5260106600 2024-09-15T22:07:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.527+0000 7f5256ffd640 1 -- 172.21.15.45:0/706755030 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f525c03a610 con 0x7f5260106600 2024-09-15T22:07:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.527+0000 7f5267b4a640 1 -- 172.21.15.45:0/706755030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f526019ec20 con 0x7f5260106600 2024-09-15T22:07:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.528+0000 7f5256ffd640 1 -- 172.21.15.45:0/706755030 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f525c03a850 con 0x7f5260106600 2024-09-15T22:07:04.450 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.528+0000 7f5267b4a640 1 -- 172.21.15.45:0/706755030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5260106a80 con 0x7f5260106600 2024-09-15T22:07:04.450 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.528+0000 7f5256ffd640 1 --2- 172.21.15.45:0/706755030 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f524c0391b0 0x7f524c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:04.450 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.529+0000 7f5256ffd640 1 -- 172.21.15.45:0/706755030 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f525c06c7a0 con 0x7f5260106600 2024-09-15T22:07:04.450 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.529+0000 7f52650e5640 1 --2- 172.21.15.45:0/706755030 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f524c0391b0 0x7f524c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:04.450 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.529+0000 7f52650e5640 1 --2- 172.21.15.45:0/706755030 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f524c0391b0 0x7f524c03b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f52500098c0 tx=0x7f5250006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:04.450 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.533+0000 7f5256ffd640 1 -- 172.21.15.45:0/706755030 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f525c0392e0 con 0x7f5260106600 2024-09-15T22:07:04.450 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.726+0000 7f5267b4a640 1 -- 172.21.15.45:0/706755030 --> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f526002dab0 con 0x7f524c0391b0 2024-09-15T22:07:04.450 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.730+0000 7f5256ffd640 1 -- 172.21.15.45:0/706755030 <== mgr.14118 v2:172.21.15.45:6800/3319321559 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f526002dab0 con 0x7f524c0391b0 2024-09-15T22:07:04.450 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.732+0000 7f5267b4a640 1 -- 172.21.15.45:0/706755030 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f524c0391b0 msgr2=0x7f524c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:04.450 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.732+0000 7f5267b4a640 1 --2- 172.21.15.45:0/706755030 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f524c0391b0 0x7f524c03b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f52500098c0 tx=0x7f5250006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:04.450 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.732+0000 7f5267b4a640 1 -- 172.21.15.45:0/706755030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 msgr2=0x7f526019b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:04.450 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.732+0000 7f5267b4a640 1 --2- 172.21.15.45:0/706755030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 0x7f526019b760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f525c006f10 tx=0x7f525c0327d0 comp rx=0 tx=0).stop 2024-09-15T22:07:04.450 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.732+0000 7f5267b4a640 1 -- 172.21.15.45:0/706755030 shutdown_connections 2024-09-15T22:07:04.451 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.732+0000 7f5267b4a640 1 --2- 172.21.15.45:0/706755030 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f524c0391b0 0x7f524c03b670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:04.451 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.732+0000 7f5267b4a640 1 --2- 172.21.15.45:0/706755030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260106600 0x7f526019b760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:04.451 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.732+0000 7f5267b4a640 1 -- 172.21.15.45:0/706755030 >> 172.21.15.45:0/706755030 conn(0x7f5260101e50 msgr2=0x7f5260102d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:04.451 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.733+0000 7f5267b4a640 1 -- 172.21.15.45:0/706755030 shutdown_connections 2024-09-15T22:07:04.451 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:03.733+0000 7f5267b4a640 1 -- 172.21.15.45:0/706755030 wait complete. 2024-09-15T22:07:04.451 INFO:teuthology.orchestra.run.smithi045.stdout:Deploying unmanaged mgr service... 2024-09-15T22:07:04.919 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:04 smithi045 ceph-mon[31180]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:04.919 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:04 smithi045 ceph-mon[31180]: Saving service mon spec with placement count:5 2024-09-15T22:07:04.919 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:04 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:07:06.047 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-15T22:07:06.047 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.144+0000 7efccf6de640 1 Processor -- start 2024-09-15T22:07:06.047 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.144+0000 7efccf6de640 1 -- start start 2024-09-15T22:07:06.047 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.145+0000 7efccf6de640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 0x7efcc81063e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:06.047 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.145+0000 7efccf6de640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7efcc807bdd0 con 0x7efcc8105fe0 2024-09-15T22:07:06.047 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.145+0000 7efccd47a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 0x7efcc81063e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:06.047 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.145+0000 7efccd47a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 0x7efcc81063e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36564/0 (socket says 172.21.15.45:36564) 2024-09-15T22:07:06.047 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.145+0000 7efccd47a640 1 -- 172.21.15.45:0/1973030841 learned_addr learned my addr 172.21.15.45:0/1973030841 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:06.048 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.145+0000 7efccd47a640 1 -- 172.21.15.45:0/1973030841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc8106920 con 0x7efcc8105fe0 2024-09-15T22:07:06.048 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.146+0000 7efccd47a640 1 --2- 172.21.15.45:0/1973030841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 0x7efcc81063e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009820 tx=0x7efcc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70412f044de8a031 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:06.048 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.146+0000 7efcbffff640 1 -- 172.21.15.45:0/1973030841 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4037070 con 0x7efcc8105fe0 2024-09-15T22:07:06.048 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.146+0000 7efcbffff640 1 -- 172.21.15.45:0/1973030841 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7efcc4032920 con 0x7efcc8105fe0 2024-09-15T22:07:06.048 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.146+0000 7efcbffff640 1 -- 172.21.15.45:0/1973030841 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4030950 con 0x7efcc8105fe0 2024-09-15T22:07:06.048 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.147+0000 7efccf6de640 1 -- 172.21.15.45:0/1973030841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 msgr2=0x7efcc81063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:06.048 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.147+0000 7efccf6de640 1 --2- 172.21.15.45:0/1973030841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 0x7efcc81063e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009820 tx=0x7efcc402a270 comp rx=0 tx=0).stop 2024-09-15T22:07:06.048 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.147+0000 7efccf6de640 1 -- 172.21.15.45:0/1973030841 shutdown_connections 2024-09-15T22:07:06.048 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.147+0000 7efccf6de640 1 --2- 172.21.15.45:0/1973030841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 0x7efcc81063e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:06.048 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.147+0000 7efccf6de640 1 -- 172.21.15.45:0/1973030841 >> 172.21.15.45:0/1973030841 conn(0x7efcc8101df0 msgr2=0x7efcc8104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:06.048 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.147+0000 7efccf6de640 1 -- 172.21.15.45:0/1973030841 shutdown_connections 2024-09-15T22:07:06.048 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.147+0000 7efccf6de640 1 -- 172.21.15.45:0/1973030841 wait complete. 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.147+0000 7efccf6de640 1 Processor -- start 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.147+0000 7efccf6de640 1 -- start start 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.148+0000 7efccf6de640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 0x7efcc819db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.148+0000 7efccf6de640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7efcc8107900 con 0x7efcc8105fe0 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.148+0000 7efccd47a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 0x7efcc819db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.148+0000 7efccd47a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 0x7efcc819db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36580/0 (socket says 172.21.15.45:36580) 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.148+0000 7efccd47a640 1 -- 172.21.15.45:0/3728177359 learned_addr learned my addr 172.21.15.45:0/3728177359 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.148+0000 7efccd47a640 1 -- 172.21.15.45:0/3728177359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc819e070 con 0x7efcc8105fe0 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.148+0000 7efccd47a640 1 --2- 172.21.15.45:0/3728177359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 0x7efcc819db30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efcc4006f10 tx=0x7efcc40327d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.148+0000 7efcbe7fc640 1 -- 172.21.15.45:0/3728177359 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc4037040 con 0x7efcc8105fe0 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.148+0000 7efcbe7fc640 1 -- 172.21.15.45:0/3728177359 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7efcc4040070 con 0x7efcc8105fe0 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.148+0000 7efccf6de640 1 -- 172.21.15.45:0/3728177359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc819e300 con 0x7efcc8105fe0 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.148+0000 7efcbe7fc640 1 -- 172.21.15.45:0/3728177359 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcc403a630 con 0x7efcc8105fe0 2024-09-15T22:07:06.049 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.149+0000 7efccf6de640 1 -- 172.21.15.45:0/3728177359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc81a0ff0 con 0x7efcc8105fe0 2024-09-15T22:07:06.050 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.149+0000 7efcbe7fc640 1 -- 172.21.15.45:0/3728177359 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7efcc403ba70 con 0x7efcc8105fe0 2024-09-15T22:07:06.050 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.150+0000 7efccf6de640 1 -- 172.21.15.45:0/3728177359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc8069580 con 0x7efcc8105fe0 2024-09-15T22:07:06.050 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.150+0000 7efcbe7fc640 1 --2- 172.21.15.45:0/3728177359 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7efcb4039200 0x7efcb403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:06.050 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.150+0000 7efcbe7fc640 1 -- 172.21.15.45:0/3728177359 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7efcc406c6a0 con 0x7efcc8105fe0 2024-09-15T22:07:06.050 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.150+0000 7efcccc79640 1 --2- 172.21.15.45:0/3728177359 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7efcb4039200 0x7efcb403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:06.050 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.150+0000 7efcccc79640 1 --2- 172.21.15.45:0/3728177359 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7efcb4039200 0x7efcb403b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efcb80098c0 tx=0x7efcb8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:06.050 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.155+0000 7efcbe7fc640 1 -- 172.21.15.45:0/3728177359 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efcc4032db0 con 0x7efcc8105fe0 2024-09-15T22:07:06.050 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.351+0000 7efccf6de640 1 -- 172.21.15.45:0/3728177359 --> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7efcc8062630 con 0x7efcb4039200 2024-09-15T22:07:06.050 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.355+0000 7efcbe7fc640 1 -- 172.21.15.45:0/3728177359 <== mgr.14118 v2:172.21.15.45:6800/3319321559 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7efcc8062630 con 0x7efcb4039200 2024-09-15T22:07:06.050 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.357+0000 7efccf6de640 1 -- 172.21.15.45:0/3728177359 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7efcb4039200 msgr2=0x7efcb403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:06.050 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.357+0000 7efccf6de640 1 --2- 172.21.15.45:0/3728177359 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7efcb4039200 0x7efcb403b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efcb80098c0 tx=0x7efcb8006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:06.050 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.357+0000 7efccf6de640 1 -- 172.21.15.45:0/3728177359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 msgr2=0x7efcc819db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:06.050 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.357+0000 7efccf6de640 1 --2- 172.21.15.45:0/3728177359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 0x7efcc819db30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efcc4006f10 tx=0x7efcc40327d0 comp rx=0 tx=0).stop 2024-09-15T22:07:06.051 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.357+0000 7efccf6de640 1 -- 172.21.15.45:0/3728177359 shutdown_connections 2024-09-15T22:07:06.051 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.357+0000 7efccf6de640 1 --2- 172.21.15.45:0/3728177359 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7efcb4039200 0x7efcb403b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:06.051 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.357+0000 7efccf6de640 1 --2- 172.21.15.45:0/3728177359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efcc8105fe0 0x7efcc819db30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:06.051 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.357+0000 7efccf6de640 1 -- 172.21.15.45:0/3728177359 >> 172.21.15.45:0/3728177359 conn(0x7efcc8101df0 msgr2=0x7efcc8191c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:06.051 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.357+0000 7efccf6de640 1 -- 172.21.15.45:0/3728177359 shutdown_connections 2024-09-15T22:07:06.051 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:05.357+0000 7efccf6de640 1 -- 172.21.15.45:0/3728177359 wait complete. 2024-09-15T22:07:06.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:06 smithi045 ceph-mon[31180]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:06.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:06 smithi045 ceph-mon[31180]: Saving service mgr spec with placement count:2 2024-09-15T22:07:06.626 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:06 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:07:07.329 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.438+0000 7f8860ab3640 1 Processor -- start 2024-09-15T22:07:07.329 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.438+0000 7f8860ab3640 1 -- start start 2024-09-15T22:07:07.329 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.438+0000 7f8860ab3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 0x7f885c106a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:07.329 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.438+0000 7f8860ab3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f885c106fd0 con 0x7f885c106600 2024-09-15T22:07:07.329 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.438+0000 7f885a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 0x7f885c106a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.438+0000 7f885a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 0x7f885c106a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36582/0 (socket says 172.21.15.45:36582) 2024-09-15T22:07:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.438+0000 7f885a59c640 1 -- 172.21.15.45:0/3178716440 learned_addr learned my addr 172.21.15.45:0/3178716440 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.439+0000 7f885a59c640 1 -- 172.21.15.45:0/3178716440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c1077b0 con 0x7f885c106600 2024-09-15T22:07:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.439+0000 7f885a59c640 1 --2- 172.21.15.45:0/3178716440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 0x7f885c106a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f884c009820 tx=0x7f884c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4437d20048d4787 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.439+0000 7f885959a640 1 -- 172.21.15.45:0/3178716440 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f884c037070 con 0x7f885c106600 2024-09-15T22:07:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.439+0000 7f885959a640 1 -- 172.21.15.45:0/3178716440 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f884c032920 con 0x7f885c106600 2024-09-15T22:07:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.439+0000 7f885959a640 1 -- 172.21.15.45:0/3178716440 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f884c030950 con 0x7f885c106600 2024-09-15T22:07:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.440+0000 7f8860ab3640 1 -- 172.21.15.45:0/3178716440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 msgr2=0x7f885c106a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.440+0000 7f8860ab3640 1 --2- 172.21.15.45:0/3178716440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 0x7f885c106a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f884c009820 tx=0x7f884c02a270 comp rx=0 tx=0).stop 2024-09-15T22:07:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.440+0000 7f8860ab3640 1 -- 172.21.15.45:0/3178716440 shutdown_connections 2024-09-15T22:07:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.440+0000 7f8860ab3640 1 --2- 172.21.15.45:0/3178716440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 0x7f885c106a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:07.330 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.440+0000 7f8860ab3640 1 -- 172.21.15.45:0/3178716440 >> 172.21.15.45:0/3178716440 conn(0x7f885c101e10 msgr2=0x7f885c104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.440+0000 7f8860ab3640 1 -- 172.21.15.45:0/3178716440 shutdown_connections 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.440+0000 7f8860ab3640 1 -- 172.21.15.45:0/3178716440 wait complete. 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.441+0000 7f8860ab3640 1 Processor -- start 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.441+0000 7f8860ab3640 1 -- start start 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.441+0000 7f8860ab3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 0x7f885c19b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.441+0000 7f8860ab3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f885c10ab60 con 0x7f885c106600 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.441+0000 7f885a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 0x7f885c19b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.441+0000 7f885a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 0x7f885c19b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36596/0 (socket says 172.21.15.45:36596) 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.441+0000 7f885a59c640 1 -- 172.21.15.45:0/2795247101 learned_addr learned my addr 172.21.15.45:0/2795247101 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.442+0000 7f885a59c640 1 -- 172.21.15.45:0/2795247101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885c19bca0 con 0x7f885c106600 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.442+0000 7f885a59c640 1 --2- 172.21.15.45:0/2795247101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 0x7f885c19b760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f884c009940 tx=0x7f884c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.442+0000 7f884b7fe640 1 -- 172.21.15.45:0/2795247101 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f884c042070 con 0x7f885c106600 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.442+0000 7f884b7fe640 1 -- 172.21.15.45:0/2795247101 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f884c0326b0 con 0x7f885c106600 2024-09-15T22:07:07.331 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.442+0000 7f884b7fe640 1 -- 172.21.15.45:0/2795247101 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f884c037040 con 0x7f885c106600 2024-09-15T22:07:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.442+0000 7f8860ab3640 1 -- 172.21.15.45:0/2795247101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885c19bf30 con 0x7f885c106600 2024-09-15T22:07:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.442+0000 7f8860ab3640 1 -- 172.21.15.45:0/2795247101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885c19ec20 con 0x7f885c106600 2024-09-15T22:07:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.443+0000 7f884b7fe640 1 -- 172.21.15.45:0/2795247101 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f884c045070 con 0x7f885c106600 2024-09-15T22:07:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.443+0000 7f8860ab3640 1 -- 172.21.15.45:0/2795247101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f885c106a80 con 0x7f885c106600 2024-09-15T22:07:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.443+0000 7f884b7fe640 1 --2- 172.21.15.45:0/2795247101 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f8844039200 0x7f884403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.443+0000 7f884b7fe640 1 -- 172.21.15.45:0/2795247101 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f884c06c220 con 0x7f885c106600 2024-09-15T22:07:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.444+0000 7f8859d9b640 1 --2- 172.21.15.45:0/2795247101 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f8844039200 0x7f884403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.444+0000 7f8859d9b640 1 --2- 172.21.15.45:0/2795247101 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f8844039200 0x7f884403b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f88500098c0 tx=0x7f8850006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.448+0000 7f884b7fe640 1 -- 172.21.15.45:0/2795247101 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f884c045360 con 0x7f885c106600 2024-09-15T22:07:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.625+0000 7f8860ab3640 1 -- 172.21.15.45:0/2795247101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f885c02da40 con 0x7f885c106600 2024-09-15T22:07:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.627+0000 7f884b7fe640 1 -- 172.21.15.45:0/2795247101 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f884c02ed90 con 0x7f885c106600 2024-09-15T22:07:07.332 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.630+0000 7f8860ab3640 1 -- 172.21.15.45:0/2795247101 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f8844039200 msgr2=0x7f884403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.630+0000 7f8860ab3640 1 --2- 172.21.15.45:0/2795247101 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f8844039200 0x7f884403b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f88500098c0 tx=0x7f8850006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.630+0000 7f8860ab3640 1 -- 172.21.15.45:0/2795247101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 msgr2=0x7f885c19b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.630+0000 7f8860ab3640 1 --2- 172.21.15.45:0/2795247101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 0x7f885c19b760 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f884c009940 tx=0x7f884c032e40 comp rx=0 tx=0).stop 2024-09-15T22:07:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.630+0000 7f8860ab3640 1 -- 172.21.15.45:0/2795247101 shutdown_connections 2024-09-15T22:07:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.630+0000 7f8860ab3640 1 --2- 172.21.15.45:0/2795247101 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f8844039200 0x7f884403b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.630+0000 7f8860ab3640 1 --2- 172.21.15.45:0/2795247101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f885c106600 0x7f885c19b760 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.630+0000 7f8860ab3640 1 -- 172.21.15.45:0/2795247101 >> 172.21.15.45:0/2795247101 conn(0x7f885c101e10 msgr2=0x7f885c102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.630+0000 7f8860ab3640 1 -- 172.21.15.45:0/2795247101 shutdown_connections 2024-09-15T22:07:07.333 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:06.630+0000 7f8860ab3640 1 -- 172.21.15.45:0/2795247101 wait complete. 2024-09-15T22:07:07.774 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:07 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2795247101' entity='client.admin' 2024-09-15T22:07:07.775 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:07 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:07:07.775 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:07 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:07:08.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.856+0000 7f461b56a640 1 Processor -- start 2024-09-15T22:07:08.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.856+0000 7f461b56a640 1 -- start start 2024-09-15T22:07:08.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.856+0000 7f461b56a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 0x7f461410a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:08.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.856+0000 7f461b56a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f461407bdf0 con 0x7f46141081d0 2024-09-15T22:07:08.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.856+0000 7f4619306640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 0x7f461410a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:08.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.856+0000 7f4619306640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 0x7f461410a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36600/0 (socket says 172.21.15.45:36600) 2024-09-15T22:07:08.838 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.856+0000 7f4619306640 1 -- 172.21.15.45:0/1861398179 learned_addr learned my addr 172.21.15.45:0/1861398179 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.857+0000 7f4619306640 1 -- 172.21.15.45:0/1861398179 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461410ab00 con 0x7f46141081d0 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.857+0000 7f4619306640 1 --2- 172.21.15.45:0/1861398179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 0x7f461410a5c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4610009820 tx=0x7f461002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfb0172fc4fa81 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.857+0000 7f460bfff640 1 -- 172.21.15.45:0/1861398179 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4610037070 con 0x7f46141081d0 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.858+0000 7f460bfff640 1 -- 172.21.15.45:0/1861398179 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4610032940 con 0x7f46141081d0 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.858+0000 7f460bfff640 1 -- 172.21.15.45:0/1861398179 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46100308b0 con 0x7f46141081d0 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.858+0000 7f461b56a640 1 -- 172.21.15.45:0/1861398179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 msgr2=0x7f461410a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.858+0000 7f461b56a640 1 --2- 172.21.15.45:0/1861398179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 0x7f461410a5c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4610009820 tx=0x7f461002a270 comp rx=0 tx=0).stop 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.858+0000 7f461b56a640 1 -- 172.21.15.45:0/1861398179 shutdown_connections 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.858+0000 7f461b56a640 1 --2- 172.21.15.45:0/1861398179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 0x7f461410a5c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.858+0000 7f461b56a640 1 -- 172.21.15.45:0/1861398179 >> 172.21.15.45:0/1861398179 conn(0x7f4614101e50 msgr2=0x7f4614104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.858+0000 7f461b56a640 1 -- 172.21.15.45:0/1861398179 shutdown_connections 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.858+0000 7f461b56a640 1 -- 172.21.15.45:0/1861398179 wait complete. 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.859+0000 7f461b56a640 1 Processor -- start 2024-09-15T22:07:08.839 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.859+0000 7f461b56a640 1 -- start start 2024-09-15T22:07:08.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.859+0000 7f461b56a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 0x7f461419b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:08.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.859+0000 7f461b56a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f461410bb80 con 0x7f46141081d0 2024-09-15T22:07:08.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.859+0000 7f4619306640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 0x7f461419b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:08.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.859+0000 7f4619306640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 0x7f461419b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36606/0 (socket says 172.21.15.45:36606) 2024-09-15T22:07:08.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.859+0000 7f4619306640 1 -- 172.21.15.45:0/473498490 learned_addr learned my addr 172.21.15.45:0/473498490 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:08.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.860+0000 7f4619306640 1 -- 172.21.15.45:0/473498490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461419bc60 con 0x7f46141081d0 2024-09-15T22:07:08.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.860+0000 7f4619306640 1 --2- 172.21.15.45:0/473498490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 0x7f461419b720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f46100097f0 tx=0x7f4610032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:08.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.860+0000 7f460a7fc640 1 -- 172.21.15.45:0/473498490 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4610042070 con 0x7f46141081d0 2024-09-15T22:07:08.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.860+0000 7f460a7fc640 1 -- 172.21.15.45:0/473498490 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f461003d930 con 0x7f46141081d0 2024-09-15T22:07:08.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.860+0000 7f460a7fc640 1 -- 172.21.15.45:0/473498490 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4610037040 con 0x7f46141081d0 2024-09-15T22:07:08.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.860+0000 7f461b56a640 1 -- 172.21.15.45:0/473498490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461419bef0 con 0x7f46141081d0 2024-09-15T22:07:08.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.860+0000 7f461b56a640 1 -- 172.21.15.45:0/473498490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f461419ebe0 con 0x7f46141081d0 2024-09-15T22:07:08.840 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.861+0000 7f460a7fc640 1 -- 172.21.15.45:0/473498490 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4610045070 con 0x7f46141081d0 2024-09-15T22:07:08.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.861+0000 7f461b56a640 1 -- 172.21.15.45:0/473498490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4614108630 con 0x7f46141081d0 2024-09-15T22:07:08.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.861+0000 7f460a7fc640 1 --2- 172.21.15.45:0/473498490 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f46000391b0 0x7f460003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:08.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.861+0000 7f460a7fc640 1 -- 172.21.15.45:0/473498490 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f461006c4e0 con 0x7f46141081d0 2024-09-15T22:07:08.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.861+0000 7f4618b05640 1 --2- 172.21.15.45:0/473498490 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f46000391b0 0x7f460003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:08.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.862+0000 7f4618b05640 1 --2- 172.21.15.45:0/473498490 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f46000391b0 0x7f460003b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f46040098c0 tx=0x7f4604006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:08.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:07.866+0000 7f460a7fc640 1 -- 172.21.15.45:0/473498490 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4610045520 con 0x7f46141081d0 2024-09-15T22:07:08.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:08.059+0000 7f461b56a640 1 -- 172.21.15.45:0/473498490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f461419f240 con 0x7f46141081d0 2024-09-15T22:07:08.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:08.062+0000 7f460a7fc640 1 -- 172.21.15.45:0/473498490 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f4610045780 con 0x7f46141081d0 2024-09-15T22:07:08.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:08.064+0000 7f461b56a640 1 -- 172.21.15.45:0/473498490 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f46000391b0 msgr2=0x7f460003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:08.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:08.064+0000 7f461b56a640 1 --2- 172.21.15.45:0/473498490 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f46000391b0 0x7f460003b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f46040098c0 tx=0x7f4604006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:08.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:08.064+0000 7f461b56a640 1 -- 172.21.15.45:0/473498490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 msgr2=0x7f461419b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:08.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:08.064+0000 7f461b56a640 1 --2- 172.21.15.45:0/473498490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 0x7f461419b720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f46100097f0 tx=0x7f4610032670 comp rx=0 tx=0).stop 2024-09-15T22:07:08.841 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:08.064+0000 7f461b56a640 1 -- 172.21.15.45:0/473498490 shutdown_connections 2024-09-15T22:07:08.842 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:08.064+0000 7f461b56a640 1 --2- 172.21.15.45:0/473498490 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f46000391b0 0x7f460003b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:08.842 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:08.064+0000 7f461b56a640 1 --2- 172.21.15.45:0/473498490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46141081d0 0x7f461419b720 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:08.842 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:08.064+0000 7f461b56a640 1 -- 172.21.15.45:0/473498490 >> 172.21.15.45:0/473498490 conn(0x7f4614101e50 msgr2=0x7f46141029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:08.842 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:08.064+0000 7f461b56a640 1 -- 172.21.15.45:0/473498490 shutdown_connections 2024-09-15T22:07:08.842 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:08.065+0000 7f461b56a640 1 -- 172.21.15.45:0/473498490 wait complete. 2024-09-15T22:07:08.842 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling the dashboard module... 2024-09-15T22:07:09.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:09 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/473498490' entity='client.admin' 2024-09-15T22:07:10.520 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:10 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:07:10.520 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:10 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2648115246' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-15T22:07:10.521 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:10 smithi045 ceph-mon[31180]: from='mgr.14118 172.21.15.45:0/870050051' entity='mgr.x' 2024-09-15T22:07:10.521 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:10 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: ignoring --setuser ceph since I am not root 2024-09-15T22:07:10.521 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:10 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: ignoring --setgroup ceph since I am not root 2024-09-15T22:07:10.521 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:10 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:10.345+0000 7f09bd2d7040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:07:10.521 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:10 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:10.404+0000 7f09bd2d7040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:07:10.790 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:10 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:10.563+0000 7f09bd2d7040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:07:10.790 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:10 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:10.633+0000 7f09bd2d7040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:07:10.790 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:10 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:10.789+0000 7f09bd2d7040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:07:10.803 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.621+0000 7f00c1d07640 1 Processor -- start 2024-09-15T22:07:10.803 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.622+0000 7f00c1d07640 1 -- start start 2024-09-15T22:07:10.803 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.622+0000 7f00c1d07640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 0x7f00bc10a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:10.803 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.622+0000 7f00c1d07640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f00bc07be50 con 0x7f00bc108170 2024-09-15T22:07:10.803 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.622+0000 7f00bb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 0x7f00bc10a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:10.804 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.622+0000 7f00bb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 0x7f00bc10a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36618/0 (socket says 172.21.15.45:36618) 2024-09-15T22:07:10.804 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.622+0000 7f00bb7fe640 1 -- 172.21.15.45:0/1373103903 learned_addr learned my addr 172.21.15.45:0/1373103903 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:10.804 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.622+0000 7f00bb7fe640 1 -- 172.21.15.45:0/1373103903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00bc10aaa0 con 0x7f00bc108170 2024-09-15T22:07:10.804 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.623+0000 7f00bb7fe640 1 --2- 172.21.15.45:0/1373103903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 0x7f00bc10a560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009820 tx=0x7f00ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8a618c25ee37bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:10.804 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.623+0000 7f00ba7fc640 1 -- 172.21.15.45:0/1373103903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ac037070 con 0x7f00bc108170 2024-09-15T22:07:10.804 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.623+0000 7f00ba7fc640 1 -- 172.21.15.45:0/1373103903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f00ac032940 con 0x7f00bc108170 2024-09-15T22:07:10.805 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.623+0000 7f00ba7fc640 1 -- 172.21.15.45:0/1373103903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ac0308b0 con 0x7f00bc108170 2024-09-15T22:07:10.805 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.624+0000 7f00c1d07640 1 -- 172.21.15.45:0/1373103903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 msgr2=0x7f00bc10a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:10.805 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.624+0000 7f00c1d07640 1 --2- 172.21.15.45:0/1373103903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 0x7f00bc10a560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009820 tx=0x7f00ac02a270 comp rx=0 tx=0).stop 2024-09-15T22:07:10.805 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.624+0000 7f00c1d07640 1 -- 172.21.15.45:0/1373103903 shutdown_connections 2024-09-15T22:07:10.805 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.624+0000 7f00c1d07640 1 --2- 172.21.15.45:0/1373103903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 0x7f00bc10a560 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:10.805 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.624+0000 7f00c1d07640 1 -- 172.21.15.45:0/1373103903 >> 172.21.15.45:0/1373103903 conn(0x7f00bc101df0 msgr2=0x7f00bc104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:10.805 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.624+0000 7f00c1d07640 1 -- 172.21.15.45:0/1373103903 shutdown_connections 2024-09-15T22:07:10.805 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.624+0000 7f00c1d07640 1 -- 172.21.15.45:0/1373103903 wait complete. 2024-09-15T22:07:10.805 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.625+0000 7f00c1d07640 1 Processor -- start 2024-09-15T22:07:10.806 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.625+0000 7f00c1d07640 1 -- start start 2024-09-15T22:07:10.806 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.625+0000 7f00c1d07640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 0x7f00bc1079f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:10.806 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.625+0000 7f00c1d07640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f00bc10bb80 con 0x7f00bc108170 2024-09-15T22:07:10.806 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.625+0000 7f00bb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 0x7f00bc1079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:10.806 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.625+0000 7f00bb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 0x7f00bc1079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36626/0 (socket says 172.21.15.45:36626) 2024-09-15T22:07:10.806 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.625+0000 7f00bb7fe640 1 -- 172.21.15.45:0/2648115246 learned_addr learned my addr 172.21.15.45:0/2648115246 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:10.806 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.626+0000 7f00bb7fe640 1 -- 172.21.15.45:0/2648115246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00bc107f30 con 0x7f00bc108170 2024-09-15T22:07:10.806 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.626+0000 7f00bb7fe640 1 --2- 172.21.15.45:0/2648115246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 0x7f00bc1079f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f00ac0097f0 tx=0x7f00ac032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:10.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.626+0000 7f00b8ff9640 1 -- 172.21.15.45:0/2648115246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ac042070 con 0x7f00bc108170 2024-09-15T22:07:10.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.626+0000 7f00b8ff9640 1 -- 172.21.15.45:0/2648115246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f00ac03d930 con 0x7f00bc108170 2024-09-15T22:07:10.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.626+0000 7f00c1d07640 1 -- 172.21.15.45:0/2648115246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00bc106120 con 0x7f00bc108170 2024-09-15T22:07:10.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.626+0000 7f00b8ff9640 1 -- 172.21.15.45:0/2648115246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00ac037040 con 0x7f00bc108170 2024-09-15T22:07:10.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.626+0000 7f00c1d07640 1 -- 172.21.15.45:0/2648115246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00bc106660 con 0x7f00bc108170 2024-09-15T22:07:10.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.627+0000 7f00b8ff9640 1 -- 172.21.15.45:0/2648115246 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f00ac045070 con 0x7f00bc108170 2024-09-15T22:07:10.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.627+0000 7f00c1d07640 1 -- 172.21.15.45:0/2648115246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00bc1085d0 con 0x7f00bc108170 2024-09-15T22:07:10.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.627+0000 7f00b8ff9640 1 --2- 172.21.15.45:0/2648115246 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f00a4039200 0x7f00a403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:10.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.628+0000 7f00b8ff9640 1 -- 172.21.15.45:0/2648115246 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f00ac06c360 con 0x7f00bc108170 2024-09-15T22:07:10.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.628+0000 7f00baffd640 1 --2- 172.21.15.45:0/2648115246 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f00a4039200 0x7f00a403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:10.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.628+0000 7f00baffd640 1 --2- 172.21.15.45:0/2648115246 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f00a4039200 0x7f00a403b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f00b00098c0 tx=0x7f00b0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:10.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.632+0000 7f00b8ff9640 1 -- 172.21.15.45:0/2648115246 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00ac03cd30 con 0x7f00bc108170 2024-09-15T22:07:10.807 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:09.863+0000 7f00c1d07640 1 -- 172.21.15.45:0/2648115246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f00bc106e00 con 0x7f00bc108170 2024-09-15T22:07:10.808 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:10.190+0000 7f00b8ff9640 1 -- 172.21.15.45:0/2648115246 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f00ac03c860 con 0x7f00bc108170 2024-09-15T22:07:10.808 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:10.191+0000 7f00b8ff9640 1 -- 172.21.15.45:0/2648115246 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f00ac03dae0 con 0x7f00bc108170 2024-09-15T22:07:10.808 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:10.193+0000 7f00c1d07640 1 -- 172.21.15.45:0/2648115246 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f00a4039200 msgr2=0x7f00a403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:10.808 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:10.193+0000 7f00c1d07640 1 --2- 172.21.15.45:0/2648115246 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f00a4039200 0x7f00a403b6c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f00b00098c0 tx=0x7f00b0006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:10.808 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:10.193+0000 7f00c1d07640 1 -- 172.21.15.45:0/2648115246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 msgr2=0x7f00bc1079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:10.808 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:10.193+0000 7f00c1d07640 1 --2- 172.21.15.45:0/2648115246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 0x7f00bc1079f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f00ac0097f0 tx=0x7f00ac032670 comp rx=0 tx=0).stop 2024-09-15T22:07:10.808 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:10.193+0000 7f00c1d07640 1 -- 172.21.15.45:0/2648115246 shutdown_connections 2024-09-15T22:07:10.808 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:10.193+0000 7f00c1d07640 1 --2- 172.21.15.45:0/2648115246 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f00a4039200 0x7f00a403b6c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:10.808 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:10.193+0000 7f00c1d07640 1 --2- 172.21.15.45:0/2648115246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00bc108170 0x7f00bc1079f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:10.808 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:10.193+0000 7f00c1d07640 1 -- 172.21.15.45:0/2648115246 >> 172.21.15.45:0/2648115246 conn(0x7f00bc101df0 msgr2=0x7f00bc102a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:10.808 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:10.193+0000 7f00c1d07640 1 -- 172.21.15.45:0/2648115246 shutdown_connections 2024-09-15T22:07:10.808 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:10.193+0000 7f00c1d07640 1 -- 172.21.15.45:0/2648115246 wait complete. 2024-09-15T22:07:11.043 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:10 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:10.940+0000 7f09bd2d7040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:07:11.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:11 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2648115246' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-15T22:07:11.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:11 smithi045 ceph-mon[31180]: mgrmap e9: x(active, since 18s) 2024-09-15T22:07:11.300 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:11 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:11.279+0000 7f09bd2d7040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:07:11.768 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:11 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:11.343+0000 7f09bd2d7040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:07:11.768 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:11 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:11.541+0000 7f09bd2d7040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:07:12.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:12 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3595489290' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T22:07:12.649 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:12.502+0000 7f09bd2d7040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:07:12.649 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:12.578+0000 7f09bd2d7040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:07:12.958 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:07:12.958 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-15T22:07:12.959 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T22:07:12.959 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T22:07:12.959 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T22:07:12.959 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:07:12.959 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.848+0000 7f0d71867640 1 Processor -- start 2024-09-15T22:07:12.959 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.848+0000 7f0d71867640 1 -- start start 2024-09-15T22:07:12.959 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.848+0000 7f0d71867640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 0x7f0d6c1063c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:12.959 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.848+0000 7f0d71867640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6c07bdf0 con 0x7f0d6c105fc0 2024-09-15T22:07:12.959 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.848+0000 7f0d6affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 0x7f0d6c1063c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:12.959 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.848+0000 7f0d6affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 0x7f0d6c1063c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36660/0 (socket says 172.21.15.45:36660) 2024-09-15T22:07:12.959 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.848+0000 7f0d6affd640 1 -- 172.21.15.45:0/1360338027 learned_addr learned my addr 172.21.15.45:0/1360338027 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:12.960 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.849+0000 7f0d6affd640 1 -- 172.21.15.45:0/1360338027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6c106900 con 0x7f0d6c105fc0 2024-09-15T22:07:12.960 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.849+0000 7f0d6affd640 1 --2- 172.21.15.45:0/1360338027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 0x7f0d6c1063c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c009820 tx=0x7f0d5c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a40622248d4c486 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:12.960 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.850+0000 7f0d6a7fc640 1 -- 172.21.15.45:0/1360338027 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d5c037070 con 0x7f0d6c105fc0 2024-09-15T22:07:12.960 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.850+0000 7f0d6a7fc640 1 -- 172.21.15.45:0/1360338027 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0d5c032940 con 0x7f0d6c105fc0 2024-09-15T22:07:12.960 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.850+0000 7f0d6a7fc640 1 -- 172.21.15.45:0/1360338027 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d5c0308b0 con 0x7f0d6c105fc0 2024-09-15T22:07:12.960 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.850+0000 7f0d71867640 1 -- 172.21.15.45:0/1360338027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 msgr2=0x7f0d6c1063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:12.960 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.850+0000 7f0d71867640 1 --2- 172.21.15.45:0/1360338027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 0x7f0d6c1063c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c009820 tx=0x7f0d5c02a270 comp rx=0 tx=0).stop 2024-09-15T22:07:12.960 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.850+0000 7f0d71867640 1 -- 172.21.15.45:0/1360338027 shutdown_connections 2024-09-15T22:07:12.960 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.850+0000 7f0d71867640 1 --2- 172.21.15.45:0/1360338027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 0x7f0d6c1063c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:12.960 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.850+0000 7f0d71867640 1 -- 172.21.15.45:0/1360338027 >> 172.21.15.45:0/1360338027 conn(0x7f0d6c101e50 msgr2=0x7f0d6c104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:12.960 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.850+0000 7f0d71867640 1 -- 172.21.15.45:0/1360338027 shutdown_connections 2024-09-15T22:07:12.960 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.850+0000 7f0d71867640 1 -- 172.21.15.45:0/1360338027 wait complete. 2024-09-15T22:07:12.960 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.851+0000 7f0d71867640 1 Processor -- start 2024-09-15T22:07:12.961 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.851+0000 7f0d71867640 1 -- start start 2024-09-15T22:07:12.961 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.851+0000 7f0d71867640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 0x7f0d6c19d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:12.961 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.851+0000 7f0d71867640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6c107aa0 con 0x7f0d6c105fc0 2024-09-15T22:07:12.961 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.851+0000 7f0d6affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 0x7f0d6c19d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:12.961 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.851+0000 7f0d6affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 0x7f0d6c19d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36670/0 (socket says 172.21.15.45:36670) 2024-09-15T22:07:12.961 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.851+0000 7f0d6affd640 1 -- 172.21.15.45:0/3595489290 learned_addr learned my addr 172.21.15.45:0/3595489290 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:12.961 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.852+0000 7f0d6affd640 1 -- 172.21.15.45:0/3595489290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d6c19de20 con 0x7f0d6c105fc0 2024-09-15T22:07:12.961 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.852+0000 7f0d6affd640 1 --2- 172.21.15.45:0/3595489290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 0x7f0d6c19d8e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c032670 tx=0x7f0d5c0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:12.961 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.852+0000 7f0d70865640 1 -- 172.21.15.45:0/3595489290 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d5c042070 con 0x7f0d6c105fc0 2024-09-15T22:07:12.962 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.852+0000 7f0d70865640 1 -- 172.21.15.45:0/3595489290 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0d5c03d930 con 0x7f0d6c105fc0 2024-09-15T22:07:12.962 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.852+0000 7f0d71867640 1 -- 172.21.15.45:0/3595489290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d6c19e0b0 con 0x7f0d6c105fc0 2024-09-15T22:07:12.962 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.852+0000 7f0d70865640 1 -- 172.21.15.45:0/3595489290 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d5c037040 con 0x7f0d6c105fc0 2024-09-15T22:07:12.962 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.852+0000 7f0d71867640 1 -- 172.21.15.45:0/3595489290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d6c1a0da0 con 0x7f0d6c105fc0 2024-09-15T22:07:12.962 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.853+0000 7f0d71867640 1 -- 172.21.15.45:0/3595489290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d6c1063c0 con 0x7f0d6c105fc0 2024-09-15T22:07:12.962 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.853+0000 7f0d70865640 1 -- 172.21.15.45:0/3595489290 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f0d5c045070 con 0x7f0d6c105fc0 2024-09-15T22:07:12.962 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.853+0000 7f0d70865640 1 --2- 172.21.15.45:0/3595489290 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0d58039260 0x7f0d5803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:12.962 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.853+0000 7f0d70865640 1 -- 172.21.15.45:0/3595489290 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0d5c06c3e0 con 0x7f0d6c105fc0 2024-09-15T22:07:12.962 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.853+0000 7f0d63fff640 1 -- 172.21.15.45:0/3595489290 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0d58039260 msgr2=0x7f0d5803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/3319321559 2024-09-15T22:07:12.962 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.853+0000 7f0d63fff640 1 --2- 172.21.15.45:0/3595489290 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0d58039260 0x7f0d5803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:07:12.962 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:11.858+0000 7f0d70865640 1 -- 172.21.15.45:0/3595489290 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d5c04b170 con 0x7f0d6c105fc0 2024-09-15T22:07:12.962 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.054+0000 7f0d63fff640 1 -- 172.21.15.45:0/3595489290 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0d58039260 msgr2=0x7f0d5803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/3319321559 2024-09-15T22:07:12.963 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.054+0000 7f0d63fff640 1 --2- 172.21.15.45:0/3595489290 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0d58039260 0x7f0d5803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:07:12.963 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.079+0000 7f0d71867640 1 -- 172.21.15.45:0/3595489290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f0d6c196d50 con 0x7f0d6c105fc0 2024-09-15T22:07:12.963 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.080+0000 7f0d70865640 1 -- 172.21.15.45:0/3595489290 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f0d5c02fd90 con 0x7f0d6c105fc0 2024-09-15T22:07:12.963 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.082+0000 7f0d71867640 1 -- 172.21.15.45:0/3595489290 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0d58039260 msgr2=0x7f0d5803b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:07:12.963 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.082+0000 7f0d71867640 1 --2- 172.21.15.45:0/3595489290 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0d58039260 0x7f0d5803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:12.963 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.082+0000 7f0d71867640 1 -- 172.21.15.45:0/3595489290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 msgr2=0x7f0d6c19d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:12.963 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.082+0000 7f0d71867640 1 --2- 172.21.15.45:0/3595489290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 0x7f0d6c19d8e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c032670 tx=0x7f0d5c0326a0 comp rx=0 tx=0).stop 2024-09-15T22:07:12.963 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.082+0000 7f0d71867640 1 -- 172.21.15.45:0/3595489290 shutdown_connections 2024-09-15T22:07:12.963 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.082+0000 7f0d71867640 1 --2- 172.21.15.45:0/3595489290 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f0d58039260 0x7f0d5803b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:12.963 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.082+0000 7f0d71867640 1 --2- 172.21.15.45:0/3595489290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d6c105fc0 0x7f0d6c19d8e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:12.963 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.082+0000 7f0d71867640 1 -- 172.21.15.45:0/3595489290 >> 172.21.15.45:0/3595489290 conn(0x7f0d6c101e50 msgr2=0x7f0d6c191bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:12.963 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.082+0000 7f0d71867640 1 -- 172.21.15.45:0/3595489290 shutdown_connections 2024-09-15T22:07:12.964 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:12.082+0000 7f0d71867640 1 -- 172.21.15.45:0/3595489290 wait complete. 2024-09-15T22:07:12.964 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for the mgr to restart... 2024-09-15T22:07:12.964 INFO:teuthology.orchestra.run.smithi045.stdout:Waiting for mgr epoch 9... 2024-09-15T22:07:13.549 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:13.352+0000 7f09bd2d7040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:07:13.550 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:13.477+0000 7f09bd2d7040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:07:13.849 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:13.627+0000 7f09bd2d7040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:07:13.850 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:13.691+0000 7f09bd2d7040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:07:13.850 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:13.847+0000 7f09bd2d7040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:07:14.150 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:13.919+0000 7f09bd2d7040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:07:14.150 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:13.982+0000 7f09bd2d7040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:07:14.151 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:14 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:14.148+0000 7f09bd2d7040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:07:14.437 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:14 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:14.216+0000 7f09bd2d7040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:07:14.437 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:14 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:14.286+0000 7f09bd2d7040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:07:14.437 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:14 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:14.372+0000 7f09bd2d7040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:07:14.437 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:14 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:14.434+0000 7f09bd2d7040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:07:14.769 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:14 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:14.496+0000 7f09bd2d7040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:07:15.581 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:15.325+0000 7f09bd2d7040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:07:15.581 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-mon[31180]: Active manager daemon x restarted 2024-09-15T22:07:15.581 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-mon[31180]: Activating manager daemon x 2024-09-15T22:07:15.581 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-mon[31180]: osdmap e3: 0 total, 0 up, 0 in 2024-09-15T22:07:15.581 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-mon[31180]: mgrmap e10: x(active, starting, since 0.0033263s) 2024-09-15T22:07:15.581 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:07:15.582 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:07:15.582 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:07:15.582 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:07:15.582 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:07:15.582 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-mon[31180]: Manager daemon x is now available 2024-09-15T22:07:15.582 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:15.582 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:07:15.582 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:07:17.104 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout { 2024-09-15T22:07:17.104 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-15T22:07:17.104 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T22:07:17.104 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout } 2024-09-15T22:07:17.104 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.357+0000 7f444071a640 1 Processor -- start 2024-09-15T22:07:17.104 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.358+0000 7f444071a640 1 -- start start 2024-09-15T22:07:17.104 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.358+0000 7f444071a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 0x7f443810a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:17.104 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.358+0000 7f444071a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f443807bdd0 con 0x7f44381081e0 2024-09-15T22:07:17.104 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.358+0000 7f443e4b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 0x7f443810a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:17.104 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.358+0000 7f443e4b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 0x7f443810a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36686/0 (socket says 172.21.15.45:36686) 2024-09-15T22:07:17.104 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.358+0000 7f443e4b6640 1 -- 172.21.15.45:0/3617765407 learned_addr learned my addr 172.21.15.45:0/3617765407 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:17.105 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.359+0000 7f443e4b6640 1 -- 172.21.15.45:0/3617765407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443810ab10 con 0x7f44381081e0 2024-09-15T22:07:17.105 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.359+0000 7f443e4b6640 1 --2- 172.21.15.45:0/3617765407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 0x7f443810a5d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4434009820 tx=0x7f443402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88970a1c45d797be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:17.105 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.360+0000 7f443d4b4640 1 -- 172.21.15.45:0/3617765407 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4434037070 con 0x7f44381081e0 2024-09-15T22:07:17.105 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.360+0000 7f443d4b4640 1 -- 172.21.15.45:0/3617765407 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4434032940 con 0x7f44381081e0 2024-09-15T22:07:17.105 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.360+0000 7f443d4b4640 1 -- 172.21.15.45:0/3617765407 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44340308b0 con 0x7f44381081e0 2024-09-15T22:07:17.105 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.360+0000 7f444071a640 1 -- 172.21.15.45:0/3617765407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 msgr2=0x7f443810a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:17.105 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.360+0000 7f444071a640 1 --2- 172.21.15.45:0/3617765407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 0x7f443810a5d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4434009820 tx=0x7f443402a270 comp rx=0 tx=0).stop 2024-09-15T22:07:17.105 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.361+0000 7f444071a640 1 -- 172.21.15.45:0/3617765407 shutdown_connections 2024-09-15T22:07:17.105 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.361+0000 7f444071a640 1 --2- 172.21.15.45:0/3617765407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 0x7f443810a5d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:17.105 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.361+0000 7f444071a640 1 -- 172.21.15.45:0/3617765407 >> 172.21.15.45:0/3617765407 conn(0x7f4438101da0 msgr2=0x7f44381041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:17.105 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.361+0000 7f444071a640 1 -- 172.21.15.45:0/3617765407 shutdown_connections 2024-09-15T22:07:17.105 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.361+0000 7f444071a640 1 -- 172.21.15.45:0/3617765407 wait complete. 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.361+0000 7f444071a640 1 Processor -- start 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.361+0000 7f444071a640 1 -- start start 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.361+0000 7f444071a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 0x7f4438107a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.361+0000 7f444071a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f443810bb30 con 0x7f44381081e0 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.362+0000 7f443e4b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 0x7f4438107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.362+0000 7f443e4b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 0x7f4438107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36694/0 (socket says 172.21.15.45:36694) 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.362+0000 7f443e4b6640 1 -- 172.21.15.45:0/2013132650 learned_addr learned my addr 172.21.15.45:0/2013132650 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.362+0000 7f443e4b6640 1 -- 172.21.15.45:0/2013132650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4438107fa0 con 0x7f44381081e0 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.362+0000 7f443e4b6640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 0x7f4438107a60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4434032670 tx=0x7f44340326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.362+0000 7f442f7fe640 1 -- 172.21.15.45:0/2013132650 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4434042070 con 0x7f44381081e0 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.362+0000 7f442f7fe640 1 -- 172.21.15.45:0/2013132650 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f443403d930 con 0x7f44381081e0 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.362+0000 7f444071a640 1 -- 172.21.15.45:0/2013132650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4438106190 con 0x7f44381081e0 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.362+0000 7f442f7fe640 1 -- 172.21.15.45:0/2013132650 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4434037040 con 0x7f44381081e0 2024-09-15T22:07:17.106 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.363+0000 7f444071a640 1 -- 172.21.15.45:0/2013132650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44381066d0 con 0x7f44381081e0 2024-09-15T22:07:17.107 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.364+0000 7f442f7fe640 1 -- 172.21.15.45:0/2013132650 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f4434045070 con 0x7f44381081e0 2024-09-15T22:07:17.107 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.364+0000 7f442f7fe640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f4424039260 0x7f442403b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:17.107 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.364+0000 7f442f7fe640 1 -- 172.21.15.45:0/2013132650 --> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f442403be30 con 0x7f4424039260 2024-09-15T22:07:17.107 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.364+0000 7f442f7fe640 1 -- 172.21.15.45:0/2013132650 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f443406c5c0 con 0x7f44381081e0 2024-09-15T22:07:17.107 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.364+0000 7f443dcb5640 1 -- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f4424039260 msgr2=0x7f442403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/3319321559 2024-09-15T22:07:17.107 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.364+0000 7f443dcb5640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f4424039260 0x7f442403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:07:17.107 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.565+0000 7f443dcb5640 1 -- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f4424039260 msgr2=0x7f442403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/3319321559 2024-09-15T22:07:17.107 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.565+0000 7f443dcb5640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f4424039260 0x7f442403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:07:17.107 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.966+0000 7f443dcb5640 1 -- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f4424039260 msgr2=0x7f442403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/3319321559 2024-09-15T22:07:17.107 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:13.966+0000 7f443dcb5640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f4424039260 0x7f442403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T22:07:17.107 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:14.767+0000 7f443dcb5640 1 -- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f4424039260 msgr2=0x7f442403b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/3319321559 2024-09-15T22:07:17.107 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:14.767+0000 7f443dcb5640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f4424039260 0x7f442403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:15.328+0000 7f442f7fe640 1 -- 172.21.15.45:0/2013132650 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f443406b070 con 0x7f44381081e0 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:15.328+0000 7f442f7fe640 1 -- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f4424039260 msgr2=0x7f442403b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:15.328+0000 7f442f7fe640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f4424039260 0x7f442403b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.330+0000 7f442f7fe640 1 -- 172.21.15.45:0/2013132650 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f443406e010 con 0x7f44381081e0 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.330+0000 7f442f7fe640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f442403cd20 0x7f442403f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.330+0000 7f442f7fe640 1 -- 172.21.15.45:0/2013132650 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f443403ee50 con 0x7f442403cd20 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.331+0000 7f443dcb5640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f442403cd20 0x7f442403f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.331+0000 7f443dcb5640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f442403cd20 0x7f442403f110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4428003980 tx=0x7f44280092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.332+0000 7f442f7fe640 1 -- 172.21.15.45:0/2013132650 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f443403ee50 con 0x7f442403cd20 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.344+0000 7f444071a640 1 -- 172.21.15.45:0/2013132650 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f4438108640 con 0x7f442403cd20 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.344+0000 7f442f7fe640 1 -- 172.21.15.45:0/2013132650 <== mgr.14150 v2:172.21.15.45:6800/1919238369 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f4438108640 con 0x7f442403cd20 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.345+0000 7f444071a640 1 -- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f442403cd20 msgr2=0x7f442403f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.345+0000 7f444071a640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f442403cd20 0x7f442403f110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4428003980 tx=0x7f44280092b0 comp rx=0 tx=0).stop 2024-09-15T22:07:17.108 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.345+0000 7f444071a640 1 -- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 msgr2=0x7f4438107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:17.109 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.345+0000 7f444071a640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 0x7f4438107a60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4434032670 tx=0x7f44340326a0 comp rx=0 tx=0).stop 2024-09-15T22:07:17.109 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.345+0000 7f444071a640 1 -- 172.21.15.45:0/2013132650 shutdown_connections 2024-09-15T22:07:17.109 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.345+0000 7f444071a640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f442403cd20 0x7f442403f110 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:17.109 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.345+0000 7f444071a640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:6800/3319321559,v1:172.21.15.45:6801/3319321559] conn(0x7f4424039260 0x7f442403b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:17.109 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.345+0000 7f444071a640 1 --2- 172.21.15.45:0/2013132650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44381081e0 0x7f4438107a60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:17.109 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.345+0000 7f444071a640 1 -- 172.21.15.45:0/2013132650 >> 172.21.15.45:0/2013132650 conn(0x7f4438101da0 msgr2=0x7f4438102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:17.109 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.345+0000 7f444071a640 1 -- 172.21.15.45:0/2013132650 shutdown_connections 2024-09-15T22:07:17.109 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:16.345+0000 7f444071a640 1 -- 172.21.15.45:0/2013132650 wait complete. 2024-09-15T22:07:17.109 INFO:teuthology.orchestra.run.smithi045.stdout:mgr epoch 9 is available 2024-09-15T22:07:17.109 INFO:teuthology.orchestra.run.smithi045.stdout:Generating a dashboard self-signed certificate... 2024-09-15T22:07:17.363 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-mon[31180]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T22:07:17.363 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-mon[31180]: mgrmap e11: x(active, since 1.00582s) 2024-09-15T22:07:17.363 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-mon[31180]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T22:07:17.363 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:17.621 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:17.425+0000 7f09285eb640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:22:07:17] ENGINE Error in HTTPServer.serve 2024-09-15T22:07:17.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: Traceback (most recent call last): 2024-09-15T22:07:17.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:07:17.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: self._connections.run(self.expiration_interval) 2024-09-15T22:07:17.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:07:17.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: self._run(expiration_interval) 2024-09-15T22:07:17.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:07:17.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:07:17.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:07:17.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:07:17.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:07:17.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: s = self.context.wrap_socket( 2024-09-15T22:07:17.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:07:17.622 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: return self.sslsocket_class._create( 2024-09-15T22:07:17.623 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:07:17.623 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: self.do_handshake() 2024-09-15T22:07:17.623 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:07:17.623 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: self._sslobj.do_handshake() 2024-09-15T22:07:17.623 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:07:17.623 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:07:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:07:18.404 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-15T22:07:18.404 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.548+0000 7f4ae98f1640 1 Processor -- start 2024-09-15T22:07:18.405 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.548+0000 7f4ae98f1640 1 -- start start 2024-09-15T22:07:18.405 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.548+0000 7f4ae98f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 0x7f4ae4107b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:18.405 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.548+0000 7f4ae98f1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae4108050 con 0x7f4ae4107710 2024-09-15T22:07:18.405 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.548+0000 7f4ae2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 0x7f4ae4107b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:18.405 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.548+0000 7f4ae2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 0x7f4ae4107b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59500/0 (socket says 172.21.15.45:59500) 2024-09-15T22:07:18.405 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.548+0000 7f4ae2ffd640 1 -- 172.21.15.45:0/4154870887 learned_addr learned my addr 172.21.15.45:0/4154870887 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:18.405 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.549+0000 7f4ae2ffd640 1 -- 172.21.15.45:0/4154870887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae41081d0 con 0x7f4ae4107710 2024-09-15T22:07:18.405 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.549+0000 7f4ae2ffd640 1 --2- 172.21.15.45:0/4154870887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 0x7f4ae4107b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009820 tx=0x7f4ad402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6802e6a30cddc70d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:18.405 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.549+0000 7f4ae1ffb640 1 -- 172.21.15.45:0/4154870887 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad4037070 con 0x7f4ae4107710 2024-09-15T22:07:18.405 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.549+0000 7f4ae1ffb640 1 -- 172.21.15.45:0/4154870887 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4ad4032940 con 0x7f4ae4107710 2024-09-15T22:07:18.405 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.549+0000 7f4ae1ffb640 1 -- 172.21.15.45:0/4154870887 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad40308b0 con 0x7f4ae4107710 2024-09-15T22:07:18.405 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.550+0000 7f4ae98f1640 1 -- 172.21.15.45:0/4154870887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 msgr2=0x7f4ae4107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.550+0000 7f4ae98f1640 1 --2- 172.21.15.45:0/4154870887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 0x7f4ae4107b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4009820 tx=0x7f4ad402a270 comp rx=0 tx=0).stop 2024-09-15T22:07:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.550+0000 7f4ae98f1640 1 -- 172.21.15.45:0/4154870887 shutdown_connections 2024-09-15T22:07:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.550+0000 7f4ae98f1640 1 --2- 172.21.15.45:0/4154870887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 0x7f4ae4107b10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.550+0000 7f4ae98f1640 1 -- 172.21.15.45:0/4154870887 >> 172.21.15.45:0/4154870887 conn(0x7f4ae4102fc0 msgr2=0x7f4ae41053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.550+0000 7f4ae98f1640 1 -- 172.21.15.45:0/4154870887 shutdown_connections 2024-09-15T22:07:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.550+0000 7f4ae98f1640 1 -- 172.21.15.45:0/4154870887 wait complete. 2024-09-15T22:07:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.551+0000 7f4ae98f1640 1 Processor -- start 2024-09-15T22:07:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.551+0000 7f4ae98f1640 1 -- start start 2024-09-15T22:07:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.551+0000 7f4ae98f1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 0x7f4ae419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.551+0000 7f4ae98f1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae410bb80 con 0x7f4ae4107710 2024-09-15T22:07:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.551+0000 7f4ae2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 0x7f4ae419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.551+0000 7f4ae2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 0x7f4ae419b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59512/0 (socket says 172.21.15.45:59512) 2024-09-15T22:07:18.406 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.551+0000 7f4ae2ffd640 1 -- 172.21.15.45:0/393278626 learned_addr learned my addr 172.21.15.45:0/393278626 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:18.407 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.551+0000 7f4ae2ffd640 1 -- 172.21.15.45:0/393278626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae419bc10 con 0x7f4ae4107710 2024-09-15T22:07:18.407 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.552+0000 7f4ae2ffd640 1 --2- 172.21.15.45:0/393278626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 0x7f4ae419b6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4032670 tx=0x7f4ad40326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:18.407 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.552+0000 7f4ae88ef640 1 -- 172.21.15.45:0/393278626 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad4042070 con 0x7f4ae4107710 2024-09-15T22:07:18.407 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.552+0000 7f4ae88ef640 1 -- 172.21.15.45:0/393278626 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4ad403d930 con 0x7f4ae4107710 2024-09-15T22:07:18.407 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.552+0000 7f4ae98f1640 1 -- 172.21.15.45:0/393278626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae419bea0 con 0x7f4ae4107710 2024-09-15T22:07:18.407 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.552+0000 7f4ae88ef640 1 -- 172.21.15.45:0/393278626 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ad4037040 con 0x7f4ae4107710 2024-09-15T22:07:18.407 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.552+0000 7f4ae98f1640 1 -- 172.21.15.45:0/393278626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae419eb90 con 0x7f4ae4107710 2024-09-15T22:07:18.407 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.553+0000 7f4ae88ef640 1 -- 172.21.15.45:0/393278626 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f4ad4045070 con 0x7f4ae4107710 2024-09-15T22:07:18.407 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.553+0000 7f4ae88ef640 1 --2- 172.21.15.45:0/393278626 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4acc0390f0 0x7f4acc03b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:18.407 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.553+0000 7f4ae98f1640 1 -- 172.21.15.45:0/393278626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae4107b90 con 0x7f4ae4107710 2024-09-15T22:07:18.407 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.553+0000 7f4ae88ef640 1 -- 172.21.15.45:0/393278626 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4ad406c370 con 0x7f4ae4107710 2024-09-15T22:07:18.407 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.553+0000 7f4ae27fc640 1 --2- 172.21.15.45:0/393278626 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4acc0390f0 0x7f4acc03b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:18.408 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.554+0000 7f4ae27fc640 1 --2- 172.21.15.45:0/393278626 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4acc0390f0 0x7f4acc03b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80098c0 tx=0x7f4ad8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:18.408 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.558+0000 7f4ae88ef640 1 -- 172.21.15.45:0/393278626 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ad403c920 con 0x7f4ae4107710 2024-09-15T22:07:18.408 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.618+0000 7f4ae88ef640 1 -- 172.21.15.45:0/393278626 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f4ad403dae0 con 0x7f4ae4107710 2024-09-15T22:07:18.408 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.742+0000 7f4ae98f1640 1 -- 172.21.15.45:0/393278626 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f4ae4104240 con 0x7f4acc0390f0 2024-09-15T22:07:18.408 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.858+0000 7f4ae88ef640 1 -- 172.21.15.45:0/393278626 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f4ae4104240 con 0x7f4acc0390f0 2024-09-15T22:07:18.408 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.860+0000 7f4ae98f1640 1 -- 172.21.15.45:0/393278626 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4acc0390f0 msgr2=0x7f4acc03b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:18.408 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.860+0000 7f4ae98f1640 1 --2- 172.21.15.45:0/393278626 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4acc0390f0 0x7f4acc03b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80098c0 tx=0x7f4ad8006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:18.408 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.860+0000 7f4ae98f1640 1 -- 172.21.15.45:0/393278626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 msgr2=0x7f4ae419b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:18.408 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.860+0000 7f4ae98f1640 1 --2- 172.21.15.45:0/393278626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 0x7f4ae419b6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4032670 tx=0x7f4ad40326a0 comp rx=0 tx=0).stop 2024-09-15T22:07:18.408 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.860+0000 7f4ae98f1640 1 -- 172.21.15.45:0/393278626 shutdown_connections 2024-09-15T22:07:18.408 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.860+0000 7f4ae98f1640 1 --2- 172.21.15.45:0/393278626 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4acc0390f0 0x7f4acc03b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:18.408 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.860+0000 7f4ae98f1640 1 --2- 172.21.15.45:0/393278626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ae4107710 0x7f4ae419b6d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:18.408 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.860+0000 7f4ae98f1640 1 -- 172.21.15.45:0/393278626 >> 172.21.15.45:0/393278626 conn(0x7f4ae4102fc0 msgr2=0x7f4ae4103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:18.409 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.860+0000 7f4ae98f1640 1 -- 172.21.15.45:0/393278626 shutdown_connections 2024-09-15T22:07:18.409 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:17.860+0000 7f4ae98f1640 1 -- 172.21.15.45:0/393278626 wait complete. 2024-09-15T22:07:18.409 INFO:teuthology.orchestra.run.smithi045.stdout:Creating initial admin user... 2024-09-15T22:07:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:18 smithi045 ceph-mon[31180]: [15/Sep/2024:22:07:17] ENGINE Bus STARTING 2024-09-15T22:07:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:18 smithi045 ceph-mon[31180]: [15/Sep/2024:22:07:17] ENGINE Serving on https://172.21.15.45:7150 2024-09-15T22:07:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:18 smithi045 ceph-mon[31180]: [15/Sep/2024:22:07:17] ENGINE Error in HTTPServer.serve 2024-09-15T22:07:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout: Traceback (most recent call last): 2024-09-15T22:07:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:07:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:07:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:07:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout: self._run(expiration_interval) 2024-09-15T22:07:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:07:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:07:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:07:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:07:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:07:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout: s = self.context.wrap_socket( 2024-09-15T22:07:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:07:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout: return self.sslsocket_class._create( 2024-09-15T22:07:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:07:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout: self.do_handshake() 2024-09-15T22:07:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:07:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout: self._sslobj.do_handshake() 2024-09-15T22:07:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:07:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:18 smithi045 ceph-mon[31180]: [15/Sep/2024:22:07:17] ENGINE Serving on http://172.21.15.45:8765 2024-09-15T22:07:18.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:18 smithi045 ceph-mon[31180]: [15/Sep/2024:22:07:17] ENGINE Bus STARTED 2024-09-15T22:07:18.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:18 smithi045 ceph-mon[31180]: mgrmap e12: x(active, since 2s) 2024-09-15T22:07:18.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:18 smithi045 ceph-mon[31180]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:18.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:18 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:18.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:18 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:18.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:18 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:19.798 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:19 smithi045 ceph-mon[31180]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:19.798 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:19 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:20.475 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$RLKACLdTRIPjsOI.YMAzWOWgUbRDmBnDmOGMEhANa8iheyEK4fAMG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726438039, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-15T22:07:20.475 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.816+0000 7fafd5177640 1 Processor -- start 2024-09-15T22:07:20.475 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.816+0000 7fafd5177640 1 -- start start 2024-09-15T22:07:20.476 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.816+0000 7fafd5177640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 0x7fafd0107b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:20.476 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.816+0000 7fafd5177640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0108050 con 0x7fafd0107710 2024-09-15T22:07:20.476 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.816+0000 7fafced9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 0x7fafd0107b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:20.476 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.816+0000 7fafced9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 0x7fafd0107b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59526/0 (socket says 172.21.15.45:59526) 2024-09-15T22:07:20.476 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.816+0000 7fafced9d640 1 -- 172.21.15.45:0/2491898237 learned_addr learned my addr 172.21.15.45:0/2491898237 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:20.476 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.816+0000 7fafced9d640 1 -- 172.21.15.45:0/2491898237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd01081d0 con 0x7fafd0107710 2024-09-15T22:07:20.476 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.817+0000 7fafced9d640 1 --2- 172.21.15.45:0/2491898237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 0x7fafd0107b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009820 tx=0x7fafc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f607b7ef915e883b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:20.476 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.817+0000 7fafcdd9b640 1 -- 172.21.15.45:0/2491898237 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc0037070 con 0x7fafd0107710 2024-09-15T22:07:20.476 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.817+0000 7fafcdd9b640 1 -- 172.21.15.45:0/2491898237 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fafc0032940 con 0x7fafd0107710 2024-09-15T22:07:20.476 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.817+0000 7fafcdd9b640 1 -- 172.21.15.45:0/2491898237 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc00308b0 con 0x7fafd0107710 2024-09-15T22:07:20.476 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.818+0000 7fafd5177640 1 -- 172.21.15.45:0/2491898237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 msgr2=0x7fafd0107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:20.476 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.818+0000 7fafd5177640 1 --2- 172.21.15.45:0/2491898237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 0x7fafd0107b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009820 tx=0x7fafc002a270 comp rx=0 tx=0).stop 2024-09-15T22:07:20.477 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.818+0000 7fafd5177640 1 -- 172.21.15.45:0/2491898237 shutdown_connections 2024-09-15T22:07:20.477 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.818+0000 7fafd5177640 1 --2- 172.21.15.45:0/2491898237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 0x7fafd0107b10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:20.477 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.818+0000 7fafd5177640 1 -- 172.21.15.45:0/2491898237 >> 172.21.15.45:0/2491898237 conn(0x7fafd0102fc0 msgr2=0x7fafd01053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:20.477 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.818+0000 7fafd5177640 1 -- 172.21.15.45:0/2491898237 shutdown_connections 2024-09-15T22:07:20.477 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.818+0000 7fafd5177640 1 -- 172.21.15.45:0/2491898237 wait complete. 2024-09-15T22:07:20.477 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.819+0000 7fafd5177640 1 Processor -- start 2024-09-15T22:07:20.477 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.819+0000 7fafd5177640 1 -- start start 2024-09-15T22:07:20.477 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.819+0000 7fafd5177640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 0x7fafd019b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:20.477 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.819+0000 7fafd5177640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fafd010bb80 con 0x7fafd0107710 2024-09-15T22:07:20.477 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.819+0000 7fafced9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 0x7fafd019b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:20.477 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.819+0000 7fafced9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 0x7fafd019b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59528/0 (socket says 172.21.15.45:59528) 2024-09-15T22:07:20.477 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.819+0000 7fafced9d640 1 -- 172.21.15.45:0/3628317606 learned_addr learned my addr 172.21.15.45:0/3628317606 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:20.477 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.819+0000 7fafced9d640 1 -- 172.21.15.45:0/3628317606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd019bc10 con 0x7fafd0107710 2024-09-15T22:07:20.478 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.820+0000 7fafced9d640 1 --2- 172.21.15.45:0/3628317606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 0x7fafd019b6d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fafc00097f0 tx=0x7fafc0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:20.478 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.820+0000 7fafb7fff640 1 -- 172.21.15.45:0/3628317606 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc0042070 con 0x7fafd0107710 2024-09-15T22:07:20.478 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.820+0000 7fafb7fff640 1 -- 172.21.15.45:0/3628317606 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fafc003d930 con 0x7fafd0107710 2024-09-15T22:07:20.478 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.820+0000 7fafd5177640 1 -- 172.21.15.45:0/3628317606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd019bea0 con 0x7fafd0107710 2024-09-15T22:07:20.478 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.820+0000 7fafb7fff640 1 -- 172.21.15.45:0/3628317606 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafc0037040 con 0x7fafd0107710 2024-09-15T22:07:20.478 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.820+0000 7fafd5177640 1 -- 172.21.15.45:0/3628317606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd019eb90 con 0x7fafd0107710 2024-09-15T22:07:20.478 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.821+0000 7fafb7fff640 1 -- 172.21.15.45:0/3628317606 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fafc0045070 con 0x7fafd0107710 2024-09-15T22:07:20.478 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.821+0000 7fafd5177640 1 -- 172.21.15.45:0/3628317606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd0107b90 con 0x7fafd0107710 2024-09-15T22:07:20.478 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.821+0000 7fafb7fff640 1 --2- 172.21.15.45:0/3628317606 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fafb8039200 0x7fafb803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:20.478 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.821+0000 7fafb7fff640 1 -- 172.21.15.45:0/3628317606 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fafc006c480 con 0x7fafd0107710 2024-09-15T22:07:20.478 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.821+0000 7fafce59c640 1 --2- 172.21.15.45:0/3628317606 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fafb8039200 0x7fafb803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:20.478 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.821+0000 7fafce59c640 1 --2- 172.21.15.45:0/3628317606 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fafb8039200 0x7fafb803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fafc40098c0 tx=0x7fafc4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:18.826+0000 7fafb7fff640 1 -- 172.21.15.45:0/3628317606 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fafc0045520 con 0x7fafd0107710 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:19.019+0000 7fafd5177640 1 -- 172.21.15.45:0/3628317606 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fafd019ee20 con 0x7fafb8039200 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:19.269+0000 7fafb7fff640 1 -- 172.21.15.45:0/3628317606 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fafd019ee20 con 0x7fafb8039200 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:19.271+0000 7fafd5177640 1 -- 172.21.15.45:0/3628317606 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fafb8039200 msgr2=0x7fafb803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:19.271+0000 7fafd5177640 1 --2- 172.21.15.45:0/3628317606 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fafb8039200 0x7fafb803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fafc40098c0 tx=0x7fafc4006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:19.271+0000 7fafd5177640 1 -- 172.21.15.45:0/3628317606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 msgr2=0x7fafd019b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:19.271+0000 7fafd5177640 1 --2- 172.21.15.45:0/3628317606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 0x7fafd019b6d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fafc00097f0 tx=0x7fafc0032670 comp rx=0 tx=0).stop 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:19.271+0000 7fafd5177640 1 -- 172.21.15.45:0/3628317606 shutdown_connections 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:19.271+0000 7fafd5177640 1 --2- 172.21.15.45:0/3628317606 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fafb8039200 0x7fafb803b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:19.271+0000 7fafd5177640 1 --2- 172.21.15.45:0/3628317606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafd0107710 0x7fafd019b6d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:19.271+0000 7fafd5177640 1 -- 172.21.15.45:0/3628317606 >> 172.21.15.45:0/3628317606 conn(0x7fafd0102fc0 msgr2=0x7fafd0103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:19.271+0000 7fafd5177640 1 -- 172.21.15.45:0/3628317606 shutdown_connections 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:19.271+0000 7fafd5177640 1 -- 172.21.15.45:0/3628317606 wait complete. 2024-09-15T22:07:20.479 INFO:teuthology.orchestra.run.smithi045.stdout:Fetching dashboard port number... 2024-09-15T22:07:21.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:21 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1938749823' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-15T22:07:21.682 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stdout 8443 2024-09-15T22:07:21.682 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.924+0000 7f8fce31b640 1 Processor -- start 2024-09-15T22:07:21.682 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.925+0000 7f8fce31b640 1 -- start start 2024-09-15T22:07:21.682 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.925+0000 7f8fce31b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 0x7f8fc807c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:21.682 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.925+0000 7f8fce31b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc807e160 con 0x7f8fc807dd60 2024-09-15T22:07:21.682 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.925+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 0x7f8fc807c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:21.682 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.925+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 0x7f8fc807c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59532/0 (socket says 172.21.15.45:59532) 2024-09-15T22:07:21.682 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.925+0000 7f8fc7fff640 1 -- 172.21.15.45:0/439311974 learned_addr learned my addr 172.21.15.45:0/439311974 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.925+0000 7f8fc7fff640 1 -- 172.21.15.45:0/439311974 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc807c810 con 0x7f8fc807dd60 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.926+0000 7f8fc7fff640 1 --2- 172.21.15.45:0/439311974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 0x7f8fc807c2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009820 tx=0x7f8fb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fe10262bb4d289 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.926+0000 7f8fc6ffd640 1 -- 172.21.15.45:0/439311974 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb8037070 con 0x7f8fc807dd60 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.926+0000 7f8fc6ffd640 1 -- 172.21.15.45:0/439311974 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8fb8032940 con 0x7f8fc807dd60 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.926+0000 7f8fc6ffd640 1 -- 172.21.15.45:0/439311974 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb80308b0 con 0x7f8fc807dd60 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.927+0000 7f8fce31b640 1 -- 172.21.15.45:0/439311974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 msgr2=0x7f8fc807c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.927+0000 7f8fce31b640 1 --2- 172.21.15.45:0/439311974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 0x7f8fc807c2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009820 tx=0x7f8fb802a270 comp rx=0 tx=0).stop 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.927+0000 7f8fce31b640 1 -- 172.21.15.45:0/439311974 shutdown_connections 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.927+0000 7f8fce31b640 1 --2- 172.21.15.45:0/439311974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 0x7f8fc807c2d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.927+0000 7f8fce31b640 1 -- 172.21.15.45:0/439311974 >> 172.21.15.45:0/439311974 conn(0x7f8fc8102fc0 msgr2=0x7f8fc81053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.927+0000 7f8fce31b640 1 -- 172.21.15.45:0/439311974 shutdown_connections 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.927+0000 7f8fce31b640 1 -- 172.21.15.45:0/439311974 wait complete. 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.927+0000 7f8fce31b640 1 Processor -- start 2024-09-15T22:07:21.683 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.927+0000 7f8fce31b640 1 -- start start 2024-09-15T22:07:21.684 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.928+0000 7f8fce31b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 0x7f8fc819d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:21.684 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.928+0000 7f8fce31b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8fc810dcb0 con 0x7f8fc807dd60 2024-09-15T22:07:21.684 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.928+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 0x7f8fc819d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:21.684 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.928+0000 7f8fc7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 0x7f8fc819d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59542/0 (socket says 172.21.15.45:59542) 2024-09-15T22:07:21.684 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.928+0000 7f8fc7fff640 1 -- 172.21.15.45:0/1938749823 learned_addr learned my addr 172.21.15.45:0/1938749823 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:21.684 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.928+0000 7f8fc7fff640 1 -- 172.21.15.45:0/1938749823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc819de50 con 0x7f8fc807dd60 2024-09-15T22:07:21.684 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.928+0000 7f8fc7fff640 1 --2- 172.21.15.45:0/1938749823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 0x7f8fc819d910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8032670 tx=0x7f8fb80326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:21.684 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.928+0000 7f8fc57fa640 1 -- 172.21.15.45:0/1938749823 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb8042070 con 0x7f8fc807dd60 2024-09-15T22:07:21.684 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.929+0000 7f8fc57fa640 1 -- 172.21.15.45:0/1938749823 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8fb803d930 con 0x7f8fc807dd60 2024-09-15T22:07:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.929+0000 7f8fce31b640 1 -- 172.21.15.45:0/1938749823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fc819e0e0 con 0x7f8fc807dd60 2024-09-15T22:07:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.929+0000 7f8fc57fa640 1 -- 172.21.15.45:0/1938749823 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb8037040 con 0x7f8fc807dd60 2024-09-15T22:07:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.929+0000 7f8fce31b640 1 -- 172.21.15.45:0/1938749823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fc81a0dd0 con 0x7f8fc807dd60 2024-09-15T22:07:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.930+0000 7f8fc57fa640 1 -- 172.21.15.45:0/1938749823 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f8fb8045070 con 0x7f8fc807dd60 2024-09-15T22:07:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.930+0000 7f8fce31b640 1 -- 172.21.15.45:0/1938749823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fc807c350 con 0x7f8fc807dd60 2024-09-15T22:07:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.930+0000 7f8fc57fa640 1 --2- 172.21.15.45:0/1938749823 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8fb0039200 0x7f8fb003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.930+0000 7f8fc57fa640 1 -- 172.21.15.45:0/1938749823 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8fb806c5e0 con 0x7f8fc807dd60 2024-09-15T22:07:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.930+0000 7f8fc77fe640 1 --2- 172.21.15.45:0/1938749823 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8fb0039200 0x7f8fb003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.930+0000 7f8fc77fe640 1 --2- 172.21.15.45:0/1938749823 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8fb0039200 0x7f8fb003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0098c0 tx=0x7f8fbc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:20.935+0000 7f8fc57fa640 1 -- 172.21.15.45:0/1938749823 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8fb804b170 con 0x7f8fc807dd60 2024-09-15T22:07:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:21.109+0000 7f8fce31b640 1 -- 172.21.15.45:0/1938749823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f8fc81a0fa0 con 0x7f8fc807dd60 2024-09-15T22:07:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:21.110+0000 7f8fc57fa640 1 -- 172.21.15.45:0/1938749823 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f8fb802fd90 con 0x7f8fc807dd60 2024-09-15T22:07:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:21.112+0000 7f8fce31b640 1 -- 172.21.15.45:0/1938749823 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8fb0039200 msgr2=0x7f8fb003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:21.686 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:21.112+0000 7f8fce31b640 1 --2- 172.21.15.45:0/1938749823 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8fb0039200 0x7f8fb003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc0098c0 tx=0x7f8fbc006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:21.686 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:21.112+0000 7f8fce31b640 1 -- 172.21.15.45:0/1938749823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 msgr2=0x7f8fc819d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:21.686 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:21.112+0000 7f8fce31b640 1 --2- 172.21.15.45:0/1938749823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 0x7f8fc819d910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8032670 tx=0x7f8fb80326a0 comp rx=0 tx=0).stop 2024-09-15T22:07:21.686 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:21.112+0000 7f8fce31b640 1 -- 172.21.15.45:0/1938749823 shutdown_connections 2024-09-15T22:07:21.686 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:21.112+0000 7f8fce31b640 1 --2- 172.21.15.45:0/1938749823 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8fb0039200 0x7f8fb003b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:21.686 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:21.112+0000 7f8fce31b640 1 --2- 172.21.15.45:0/1938749823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fc807dd60 0x7f8fc819d910 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:21.686 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:21.112+0000 7f8fce31b640 1 -- 172.21.15.45:0/1938749823 >> 172.21.15.45:0/1938749823 conn(0x7f8fc8102fc0 msgr2=0x7f8fc8103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:21.686 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:21.112+0000 7f8fce31b640 1 -- 172.21.15.45:0/1938749823 shutdown_connections 2024-09-15T22:07:21.686 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:21.112+0000 7f8fce31b640 1 -- 172.21.15.45:0/1938749823 wait complete. 2024-09-15T22:07:21.690 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T22:07:21.690 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout disabled 2024-09-15T22:07:21.698 INFO:teuthology.orchestra.run.smithi045.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T22:07:21.698 INFO:teuthology.orchestra.run.smithi045.stdout:systemctl: stdout inactive 2024-09-15T22:07:21.698 INFO:teuthology.orchestra.run.smithi045.stdout:firewalld.service is not enabled 2024-09-15T22:07:21.698 INFO:teuthology.orchestra.run.smithi045.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-15T22:07:21.700 INFO:teuthology.orchestra.run.smithi045.stdout:Ceph Dashboard is now available at: 2024-09-15T22:07:21.700 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:07:21.700 INFO:teuthology.orchestra.run.smithi045.stdout: URL: https://smithi045.front.sepia.ceph.com:8443/ 2024-09-15T22:07:21.700 INFO:teuthology.orchestra.run.smithi045.stdout: User: admin 2024-09-15T22:07:21.700 INFO:teuthology.orchestra.run.smithi045.stdout: Password: bd2z9k9so0 2024-09-15T22:07:21.700 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:07:21.701 INFO:teuthology.orchestra.run.smithi045.stdout:Saving cluster configuration to /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config directory 2024-09-15T22:07:23.004 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.169+0000 7f0c82987640 1 Processor -- start 2024-09-15T22:07:23.004 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.169+0000 7f0c82987640 1 -- start start 2024-09-15T22:07:23.004 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.169+0000 7f0c82987640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 0x7f0c7c107b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:23.004 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.169+0000 7f0c82987640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c108050 con 0x7f0c7c107710 2024-09-15T22:07:23.004 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.169+0000 7f0c7bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 0x7f0c7c107b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:23.004 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.169+0000 7f0c7bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 0x7f0c7c107b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59546/0 (socket says 172.21.15.45:59546) 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.169+0000 7f0c7bfff640 1 -- 172.21.15.45:0/977295929 learned_addr learned my addr 172.21.15.45:0/977295929 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.169+0000 7f0c7bfff640 1 -- 172.21.15.45:0/977295929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7c1081d0 con 0x7f0c7c107710 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.170+0000 7f0c7bfff640 1 --2- 172.21.15.45:0/977295929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 0x7f0c7c107b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009820 tx=0x7f0c6c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7478c1dc761d9ef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.170+0000 7f0c7affd640 1 -- 172.21.15.45:0/977295929 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c6c037070 con 0x7f0c7c107710 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.170+0000 7f0c7affd640 1 -- 172.21.15.45:0/977295929 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c6c032940 con 0x7f0c7c107710 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.170+0000 7f0c7affd640 1 -- 172.21.15.45:0/977295929 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c6c0308b0 con 0x7f0c7c107710 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.171+0000 7f0c82987640 1 -- 172.21.15.45:0/977295929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 msgr2=0x7f0c7c107b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.171+0000 7f0c82987640 1 --2- 172.21.15.45:0/977295929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 0x7f0c7c107b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009820 tx=0x7f0c6c02a270 comp rx=0 tx=0).stop 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.171+0000 7f0c82987640 1 -- 172.21.15.45:0/977295929 shutdown_connections 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.171+0000 7f0c82987640 1 --2- 172.21.15.45:0/977295929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 0x7f0c7c107b10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.171+0000 7f0c82987640 1 -- 172.21.15.45:0/977295929 >> 172.21.15.45:0/977295929 conn(0x7f0c7c102fc0 msgr2=0x7f0c7c1053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.171+0000 7f0c82987640 1 -- 172.21.15.45:0/977295929 shutdown_connections 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.171+0000 7f0c82987640 1 -- 172.21.15.45:0/977295929 wait complete. 2024-09-15T22:07:23.005 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.172+0000 7f0c82987640 1 Processor -- start 2024-09-15T22:07:23.006 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.172+0000 7f0c82987640 1 -- start start 2024-09-15T22:07:23.006 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.172+0000 7f0c82987640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 0x7f0c7c07db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:23.006 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.172+0000 7f0c82987640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c10bb80 con 0x7f0c7c107710 2024-09-15T22:07:23.006 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.172+0000 7f0c7bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 0x7f0c7c07db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:23.006 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.172+0000 7f0c7bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 0x7f0c7c07db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59562/0 (socket says 172.21.15.45:59562) 2024-09-15T22:07:23.006 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.172+0000 7f0c7bfff640 1 -- 172.21.15.45:0/3722587335 learned_addr learned my addr 172.21.15.45:0/3722587335 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:23.006 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.173+0000 7f0c7bfff640 1 -- 172.21.15.45:0/3722587335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7c07e0a0 con 0x7f0c7c107710 2024-09-15T22:07:23.006 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.173+0000 7f0c7bfff640 1 --2- 172.21.15.45:0/3722587335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 0x7f0c7c07db60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c032670 tx=0x7f0c6c0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:23.006 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.173+0000 7f0c797fa640 1 -- 172.21.15.45:0/3722587335 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c6c042070 con 0x7f0c7c107710 2024-09-15T22:07:23.006 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.173+0000 7f0c797fa640 1 -- 172.21.15.45:0/3722587335 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c6c03d930 con 0x7f0c7c107710 2024-09-15T22:07:23.006 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.173+0000 7f0c82987640 1 -- 172.21.15.45:0/3722587335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c7c07c290 con 0x7f0c7c107710 2024-09-15T22:07:23.006 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.173+0000 7f0c797fa640 1 -- 172.21.15.45:0/3722587335 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c6c037040 con 0x7f0c7c107710 2024-09-15T22:07:23.006 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.173+0000 7f0c82987640 1 -- 172.21.15.45:0/3722587335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c7c07c7d0 con 0x7f0c7c107710 2024-09-15T22:07:23.007 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.174+0000 7f0c797fa640 1 -- 172.21.15.45:0/3722587335 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0c6c045070 con 0x7f0c7c107710 2024-09-15T22:07:23.007 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.174+0000 7f0c797fa640 1 --2- 172.21.15.45:0/3722587335 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0c640392a0 0x7f0c6403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:23.007 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.174+0000 7f0c797fa640 1 -- 172.21.15.45:0/3722587335 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0c6c06c680 con 0x7f0c7c107710 2024-09-15T22:07:23.007 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.174+0000 7f0c7b7fe640 1 --2- 172.21.15.45:0/3722587335 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0c640392a0 0x7f0c6403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:23.007 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.174+0000 7f0c82987640 1 -- 172.21.15.45:0/3722587335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c7c107b90 con 0x7f0c7c107710 2024-09-15T22:07:23.007 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.175+0000 7f0c7b7fe640 1 --2- 172.21.15.45:0/3722587335 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0c640392a0 0x7f0c6403b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0c700098c0 tx=0x7f0c70006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:23.007 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.179+0000 7f0c797fa640 1 -- 172.21.15.45:0/3722587335 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0c6c03c920 con 0x7f0c7c107710 2024-09-15T22:07:23.007 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.447+0000 7f0c82987640 1 -- 172.21.15.45:0/3722587335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f0c7c07ca50 con 0x7f0c7c107710 2024-09-15T22:07:23.007 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.449+0000 7f0c797fa640 1 -- 172.21.15.45:0/3722587335 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f0c6c03dae0 con 0x7f0c7c107710 2024-09-15T22:07:23.007 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-15T22:07:23.007 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.451+0000 7f0c82987640 1 -- 172.21.15.45:0/3722587335 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0c640392a0 msgr2=0x7f0c6403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:23.007 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.452+0000 7f0c82987640 1 --2- 172.21.15.45:0/3722587335 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0c640392a0 0x7f0c6403b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0c700098c0 tx=0x7f0c70006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.452+0000 7f0c82987640 1 -- 172.21.15.45:0/3722587335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 msgr2=0x7f0c7c07db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.452+0000 7f0c82987640 1 --2- 172.21.15.45:0/3722587335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 0x7f0c7c07db60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c032670 tx=0x7f0c6c0326a0 comp rx=0 tx=0).stop 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.452+0000 7f0c82987640 1 -- 172.21.15.45:0/3722587335 shutdown_connections 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.452+0000 7f0c82987640 1 --2- 172.21.15.45:0/3722587335 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0c640392a0 0x7f0c6403b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.452+0000 7f0c82987640 1 --2- 172.21.15.45:0/3722587335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c7c107710 0x7f0c7c07db60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.452+0000 7f0c82987640 1 -- 172.21.15.45:0/3722587335 >> 172.21.15.45:0/3722587335 conn(0x7f0c7c102fc0 msgr2=0x7f0c7c103b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.452+0000 7f0c82987640 1 -- 172.21.15.45:0/3722587335 shutdown_connections 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/bin/ceph: stderr 2024-09-15T22:07:22.452+0000 7f0c82987640 1 -- 172.21.15.45:0/3722587335 wait complete. 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout:Or, if you are only running a single cluster on this host: 2024-09-15T22:07:23.008 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:07:23.009 INFO:teuthology.orchestra.run.smithi045.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-15T22:07:23.009 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:07:23.009 INFO:teuthology.orchestra.run.smithi045.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-15T22:07:23.009 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:07:23.009 INFO:teuthology.orchestra.run.smithi045.stdout: ceph telemetry on 2024-09-15T22:07:23.009 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:07:23.009 INFO:teuthology.orchestra.run.smithi045.stdout:For more information see: 2024-09-15T22:07:23.009 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:07:23.009 INFO:teuthology.orchestra.run.smithi045.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-15T22:07:23.009 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:07:23.009 INFO:teuthology.orchestra.run.smithi045.stdout:Bootstrap complete. 2024-09-15T22:07:23.040 INFO:tasks.cephadm:Fetching config... 2024-09-15T22:07:23.041 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:07:23.041 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-15T22:07:23.057 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-15T22:07:23.057 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:07:23.057 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-15T22:07:23.113 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-15T22:07:23.114 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:07:23.114 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-15T22:07:23.179 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-15T22:07:23.179 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:07:23.179 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-15T22:07:23.236 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-15T22:07:23.236 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpGBxAvhXwqendVypoUZnWD84/oWj2O6ifZL29K9G5shkQY73J6dqmaNcBV5fBnqprEkXGBtDZFW2BKCGT6h5RNx0pAsp5BCZ4Ii7SXvXj+VahTXNrP2gNIdQIv1T6HFGdRZPwS8WjYLZPrTpZVs9ez5tkWlLD9hsSrpCNpep0Aln06vfnVdFIhivVOtaIBrBE4gYRrW7OUp+JVzB0N2Exf8RZdYkd+hEiNOfvKV+S2bp/USSMQNofl99I1nOUU5OLTHvQHR6s65I5QO3aknCbZaMNEBS/qxz1hspkyvsQwKS4orYDPd+ypKT7CDU7d4v0QC5aLw0RycgLn+3TufQyuqvmELzTjWApsgD110y4on8oiC7PUqciftoxNh74O4WiLB+CH/g251JaQBqflDapKLCEEtk7SOCGHcJ+Q+SrayKSVPC1TWyjzgvyLFZjpEPlQINAjaT7llMwXnqiZCr0BcYx0DOsEAv2tEPOo165CgrL4qHv5ffNYAr3OcInA/M= ceph-a1911414-73ae-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:07:23.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:23 smithi045 ceph-mon[31180]: mgrmap e13: x(active, since 6s) 2024-09-15T22:07:23.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:23 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3722587335' entity='client.admin' 2024-09-15T22:07:23.312 INFO:teuthology.orchestra.run.smithi045.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpGBxAvhXwqendVypoUZnWD84/oWj2O6ifZL29K9G5shkQY73J6dqmaNcBV5fBnqprEkXGBtDZFW2BKCGT6h5RNx0pAsp5BCZ4Ii7SXvXj+VahTXNrP2gNIdQIv1T6HFGdRZPwS8WjYLZPrTpZVs9ez5tkWlLD9hsSrpCNpep0Aln06vfnVdFIhivVOtaIBrBE4gYRrW7OUp+JVzB0N2Exf8RZdYkd+hEiNOfvKV+S2bp/USSMQNofl99I1nOUU5OLTHvQHR6s65I5QO3aknCbZaMNEBS/qxz1hspkyvsQwKS4orYDPd+ypKT7CDU7d4v0QC5aLw0RycgLn+3TufQyuqvmELzTjWApsgD110y4on8oiC7PUqciftoxNh74O4WiLB+CH/g251JaQBqflDapKLCEEtk7SOCGHcJ+Q+SrayKSVPC1TWyjzgvyLFZjpEPlQINAjaT7llMwXnqiZCr0BcYx0DOsEAv2tEPOo165CgrL4qHv5ffNYAr3OcInA/M= ceph-a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:07:23.323 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpGBxAvhXwqendVypoUZnWD84/oWj2O6ifZL29K9G5shkQY73J6dqmaNcBV5fBnqprEkXGBtDZFW2BKCGT6h5RNx0pAsp5BCZ4Ii7SXvXj+VahTXNrP2gNIdQIv1T6HFGdRZPwS8WjYLZPrTpZVs9ez5tkWlLD9hsSrpCNpep0Aln06vfnVdFIhivVOtaIBrBE4gYRrW7OUp+JVzB0N2Exf8RZdYkd+hEiNOfvKV+S2bp/USSMQNofl99I1nOUU5OLTHvQHR6s65I5QO3aknCbZaMNEBS/qxz1hspkyvsQwKS4orYDPd+ypKT7CDU7d4v0QC5aLw0RycgLn+3TufQyuqvmELzTjWApsgD110y4on8oiC7PUqciftoxNh74O4WiLB+CH/g251JaQBqflDapKLCEEtk7SOCGHcJ+Q+SrayKSVPC1TWyjzgvyLFZjpEPlQINAjaT7llMwXnqiZCr0BcYx0DOsEAv2tEPOo165CgrL4qHv5ffNYAr3OcInA/M= ceph-a1911414-73ae-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:07:23.365 INFO:teuthology.orchestra.run.smithi100.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpGBxAvhXwqendVypoUZnWD84/oWj2O6ifZL29K9G5shkQY73J6dqmaNcBV5fBnqprEkXGBtDZFW2BKCGT6h5RNx0pAsp5BCZ4Ii7SXvXj+VahTXNrP2gNIdQIv1T6HFGdRZPwS8WjYLZPrTpZVs9ez5tkWlLD9hsSrpCNpep0Aln06vfnVdFIhivVOtaIBrBE4gYRrW7OUp+JVzB0N2Exf8RZdYkd+hEiNOfvKV+S2bp/USSMQNofl99I1nOUU5OLTHvQHR6s65I5QO3aknCbZaMNEBS/qxz1hspkyvsQwKS4orYDPd+ypKT7CDU7d4v0QC5aLw0RycgLn+3TufQyuqvmELzTjWApsgD110y4on8oiC7PUqciftoxNh74O4WiLB+CH/g251JaQBqflDapKLCEEtk7SOCGHcJ+Q+SrayKSVPC1TWyjzgvyLFZjpEPlQINAjaT7llMwXnqiZCr0BcYx0DOsEAv2tEPOo165CgrL4qHv5ffNYAr3OcInA/M= ceph-a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:07:23.377 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpGBxAvhXwqendVypoUZnWD84/oWj2O6ifZL29K9G5shkQY73J6dqmaNcBV5fBnqprEkXGBtDZFW2BKCGT6h5RNx0pAsp5BCZ4Ii7SXvXj+VahTXNrP2gNIdQIv1T6HFGdRZPwS8WjYLZPrTpZVs9ez5tkWlLD9hsSrpCNpep0Aln06vfnVdFIhivVOtaIBrBE4gYRrW7OUp+JVzB0N2Exf8RZdYkd+hEiNOfvKV+S2bp/USSMQNofl99I1nOUU5OLTHvQHR6s65I5QO3aknCbZaMNEBS/qxz1hspkyvsQwKS4orYDPd+ypKT7CDU7d4v0QC5aLw0RycgLn+3TufQyuqvmELzTjWApsgD110y4on8oiC7PUqciftoxNh74O4WiLB+CH/g251JaQBqflDapKLCEEtk7SOCGHcJ+Q+SrayKSVPC1TWyjzgvyLFZjpEPlQINAjaT7llMwXnqiZCr0BcYx0DOsEAv2tEPOo165CgrL4qHv5ffNYAr3OcInA/M= ceph-a1911414-73ae-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T22:07:23.419 INFO:teuthology.orchestra.run.smithi165.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpGBxAvhXwqendVypoUZnWD84/oWj2O6ifZL29K9G5shkQY73J6dqmaNcBV5fBnqprEkXGBtDZFW2BKCGT6h5RNx0pAsp5BCZ4Ii7SXvXj+VahTXNrP2gNIdQIv1T6HFGdRZPwS8WjYLZPrTpZVs9ez5tkWlLD9hsSrpCNpep0Aln06vfnVdFIhivVOtaIBrBE4gYRrW7OUp+JVzB0N2Exf8RZdYkd+hEiNOfvKV+S2bp/USSMQNofl99I1nOUU5OLTHvQHR6s65I5QO3aknCbZaMNEBS/qxz1hspkyvsQwKS4orYDPd+ypKT7CDU7d4v0QC5aLw0RycgLn+3TufQyuqvmELzTjWApsgD110y4on8oiC7PUqciftoxNh74O4WiLB+CH/g251JaQBqflDapKLCEEtk7SOCGHcJ+Q+SrayKSVPC1TWyjzgvyLFZjpEPlQINAjaT7llMwXnqiZCr0BcYx0DOsEAv2tEPOo165CgrL4qHv5ffNYAr3OcInA/M= ceph-a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:07:23.432 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-15T22:07:23.769 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:07:24.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.196+0000 7fbb2259d640 1 -- 172.21.15.45:0/2214756492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb1c100540 msgr2=0x7fbb1c100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:24.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.196+0000 7fbb2259d640 1 --2- 172.21.15.45:0/2214756492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb1c100540 0x7fbb1c100940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009880 tx=0x7fbb0c02a5d0 comp rx=0 tx=0).stop 2024-09-15T22:07:24.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.196+0000 7fbb2259d640 1 -- 172.21.15.45:0/2214756492 shutdown_connections 2024-09-15T22:07:24.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.196+0000 7fbb2259d640 1 --2- 172.21.15.45:0/2214756492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb1c100540 0x7fbb1c100940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:24.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.196+0000 7fbb2259d640 1 -- 172.21.15.45:0/2214756492 >> 172.21.15.45:0/2214756492 conn(0x7fbb1c0fbcd0 msgr2=0x7fbb1c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:24.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.196+0000 7fbb2259d640 1 -- 172.21.15.45:0/2214756492 shutdown_connections 2024-09-15T22:07:24.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.196+0000 7fbb2259d640 1 -- 172.21.15.45:0/2214756492 wait complete. 2024-09-15T22:07:24.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.197+0000 7fbb2259d640 1 Processor -- start 2024-09-15T22:07:24.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.197+0000 7fbb2259d640 1 -- start start 2024-09-15T22:07:24.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.197+0000 7fbb2259d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb1c100540 0x7fbb1c1905c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:24.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.197+0000 7fbb2259d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbb1c106740 con 0x7fbb1c100540 2024-09-15T22:07:24.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.197+0000 7fbb1bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb1c100540 0x7fbb1c1905c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:24.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.197+0000 7fbb1bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb1c100540 0x7fbb1c1905c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59580/0 (socket says 172.21.15.45:59580) 2024-09-15T22:07:24.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.197+0000 7fbb1bfff640 1 -- 172.21.15.45:0/2453987602 learned_addr learned my addr 172.21.15.45:0/2453987602 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:24.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.198+0000 7fbb1bfff640 1 -- 172.21.15.45:0/2453987602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1c190b00 con 0x7fbb1c100540 2024-09-15T22:07:24.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.198+0000 7fbb1bfff640 1 --2- 172.21.15.45:0/2453987602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb1c100540 0x7fbb1c1905c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009230 tx=0x7fbb0c032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.198+0000 7fbb19ffb640 1 -- 172.21.15.45:0/2453987602 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0c03f030 con 0x7fbb1c100540 2024-09-15T22:07:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.198+0000 7fbb2259d640 1 -- 172.21.15.45:0/2453987602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1c190d90 con 0x7fbb1c100540 2024-09-15T22:07:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.198+0000 7fbb19ffb640 1 -- 172.21.15.45:0/2453987602 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb0c003e30 con 0x7fbb1c100540 2024-09-15T22:07:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.198+0000 7fbb19ffb640 1 -- 172.21.15.45:0/2453987602 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb0c035070 con 0x7fbb1c100540 2024-09-15T22:07:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.198+0000 7fbb2259d640 1 -- 172.21.15.45:0/2453987602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb1c193a80 con 0x7fbb1c100540 2024-09-15T22:07:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.199+0000 7fbb19ffb640 1 -- 172.21.15.45:0/2453987602 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fbb0c042030 con 0x7fbb1c100540 2024-09-15T22:07:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.199+0000 7fbb2259d640 1 -- 172.21.15.45:0/2453987602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb1c106ec0 con 0x7fbb1c100540 2024-09-15T22:07:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.199+0000 7fbb19ffb640 1 --2- 172.21.15.45:0/2453987602 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbb080392a0 0x7fbb0803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.199+0000 7fbb19ffb640 1 -- 172.21.15.45:0/2453987602 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbb0c040070 con 0x7fbb1c100540 2024-09-15T22:07:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.199+0000 7fbb13fff640 1 --2- 172.21.15.45:0/2453987602 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbb080392a0 0x7fbb0803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:24.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.200+0000 7fbb13fff640 1 --2- 172.21.15.45:0/2453987602 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbb080392a0 0x7fbb0803b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbb040098c0 tx=0x7fbb04006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:24.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.208+0000 7fbb19ffb640 1 -- 172.21.15.45:0/2453987602 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb0c030560 con 0x7fbb1c100540 2024-09-15T22:07:24.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.386+0000 7fbb2259d640 1 -- 172.21.15.45:0/2453987602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fbb1c18df70 con 0x7fbb1c100540 2024-09-15T22:07:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.389+0000 7fbb19ffb640 1 -- 172.21.15.45:0/2453987602 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fbb0c04ad60 con 0x7fbb1c100540 2024-09-15T22:07:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.391+0000 7fbb2259d640 1 -- 172.21.15.45:0/2453987602 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbb080392a0 msgr2=0x7fbb0803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.391+0000 7fbb2259d640 1 --2- 172.21.15.45:0/2453987602 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbb080392a0 0x7fbb0803b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbb040098c0 tx=0x7fbb04006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.391+0000 7fbb2259d640 1 -- 172.21.15.45:0/2453987602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb1c100540 msgr2=0x7fbb1c1905c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.391+0000 7fbb2259d640 1 --2- 172.21.15.45:0/2453987602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb1c100540 0x7fbb1c1905c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009230 tx=0x7fbb0c032d00 comp rx=0 tx=0).stop 2024-09-15T22:07:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.391+0000 7fbb2259d640 1 -- 172.21.15.45:0/2453987602 shutdown_connections 2024-09-15T22:07:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.391+0000 7fbb2259d640 1 --2- 172.21.15.45:0/2453987602 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbb080392a0 0x7fbb0803b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.391+0000 7fbb2259d640 1 --2- 172.21.15.45:0/2453987602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb1c100540 0x7fbb1c1905c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.391+0000 7fbb2259d640 1 -- 172.21.15.45:0/2453987602 >> 172.21.15.45:0/2453987602 conn(0x7fbb1c0fbcd0 msgr2=0x7fbb1c069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.391+0000 7fbb2259d640 1 -- 172.21.15.45:0/2453987602 shutdown_connections 2024-09-15T22:07:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:24.391+0000 7fbb2259d640 1 -- 172.21.15.45:0/2453987602 wait complete. 2024-09-15T22:07:25.027 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-15T22:07:25.027 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-15T22:07:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:07:25.630 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:25 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2453987602' entity='client.admin' 2024-09-15T22:07:26.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.319+0000 7fba04a80640 1 -- 172.21.15.45:0/499190508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00100510 msgr2=0x7fba00100910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:26.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.319+0000 7fba04a80640 1 --2- 172.21.15.45:0/499190508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00100510 0x7fba00100910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009880 tx=0x7fb9f002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:07:26.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.319+0000 7fba04a80640 1 -- 172.21.15.45:0/499190508 shutdown_connections 2024-09-15T22:07:26.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.319+0000 7fba04a80640 1 --2- 172.21.15.45:0/499190508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00100510 0x7fba00100910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:26.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.319+0000 7fba04a80640 1 -- 172.21.15.45:0/499190508 >> 172.21.15.45:0/499190508 conn(0x7fba000fbc80 msgr2=0x7fba000fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:26.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.319+0000 7fba04a80640 1 -- 172.21.15.45:0/499190508 shutdown_connections 2024-09-15T22:07:26.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.319+0000 7fba04a80640 1 -- 172.21.15.45:0/499190508 wait complete. 2024-09-15T22:07:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.320+0000 7fba04a80640 1 Processor -- start 2024-09-15T22:07:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.320+0000 7fba04a80640 1 -- start start 2024-09-15T22:07:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.320+0000 7fba04a80640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00100510 0x7fba000fdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.320+0000 7fba04a80640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fba00106760 con 0x7fba00100510 2024-09-15T22:07:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.320+0000 7fb9fe59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00100510 0x7fba000fdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.320+0000 7fb9fe59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00100510 0x7fba000fdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44922/0 (socket says 172.21.15.45:44922) 2024-09-15T22:07:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.320+0000 7fb9fe59c640 1 -- 172.21.15.45:0/3917016368 learned_addr learned my addr 172.21.15.45:0/3917016368 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.321+0000 7fb9fe59c640 1 -- 172.21.15.45:0/3917016368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba000fe0a0 con 0x7fba00100510 2024-09-15T22:07:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.321+0000 7fb9fe59c640 1 --2- 172.21.15.45:0/3917016368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00100510 0x7fba000fdb60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009230 tx=0x7fb9f0032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.321+0000 7fb9ef7fe640 1 -- 172.21.15.45:0/3917016368 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9f003f030 con 0x7fba00100510 2024-09-15T22:07:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.321+0000 7fb9ef7fe640 1 -- 172.21.15.45:0/3917016368 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9f0003d00 con 0x7fba00100510 2024-09-15T22:07:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.321+0000 7fba04a80640 1 -- 172.21.15.45:0/3917016368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba000fc290 con 0x7fba00100510 2024-09-15T22:07:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.321+0000 7fb9ef7fe640 1 -- 172.21.15.45:0/3917016368 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9f0035070 con 0x7fba00100510 2024-09-15T22:07:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.321+0000 7fba04a80640 1 -- 172.21.15.45:0/3917016368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba000fc7d0 con 0x7fba00100510 2024-09-15T22:07:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.322+0000 7fb9ef7fe640 1 -- 172.21.15.45:0/3917016368 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fb9f0042030 con 0x7fba00100510 2024-09-15T22:07:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.322+0000 7fb9ef7fe640 1 --2- 172.21.15.45:0/3917016368 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb9e80392a0 0x7fb9e803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.322+0000 7fba04a80640 1 -- 172.21.15.45:0/3917016368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba00106ee0 con 0x7fba00100510 2024-09-15T22:07:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.322+0000 7fb9ef7fe640 1 -- 172.21.15.45:0/3917016368 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb9f0040070 con 0x7fba00100510 2024-09-15T22:07:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.322+0000 7fb9fdd9b640 1 --2- 172.21.15.45:0/3917016368 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb9e80392a0 0x7fb9e803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.323+0000 7fb9fdd9b640 1 --2- 172.21.15.45:0/3917016368 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb9e80392a0 0x7fb9e803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb9f40098c0 tx=0x7fb9f4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.327+0000 7fb9ef7fe640 1 -- 172.21.15.45:0/3917016368 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9f004c350 con 0x7fba00100510 2024-09-15T22:07:26.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.508+0000 7fba04a80640 1 -- 172.21.15.45:0/3917016368 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fba00190380 con 0x7fb9e80392a0 2024-09-15T22:07:26.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:26.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:26.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi045", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:26.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:26.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:26.510 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:26.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.512+0000 7fb9ef7fe640 1 -- 172.21.15.45:0/3917016368 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fba00190380 con 0x7fb9e80392a0 2024-09-15T22:07:26.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.514+0000 7fba04a80640 1 -- 172.21.15.45:0/3917016368 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb9e80392a0 msgr2=0x7fb9e803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:26.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.514+0000 7fba04a80640 1 --2- 172.21.15.45:0/3917016368 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb9e80392a0 0x7fb9e803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb9f40098c0 tx=0x7fb9f4006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:26.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.514+0000 7fba04a80640 1 -- 172.21.15.45:0/3917016368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00100510 msgr2=0x7fba000fdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:26.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.514+0000 7fba04a80640 1 --2- 172.21.15.45:0/3917016368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00100510 0x7fba000fdb60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009230 tx=0x7fb9f0032d00 comp rx=0 tx=0).stop 2024-09-15T22:07:26.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.514+0000 7fba04a80640 1 -- 172.21.15.45:0/3917016368 shutdown_connections 2024-09-15T22:07:26.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.514+0000 7fba04a80640 1 --2- 172.21.15.45:0/3917016368 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb9e80392a0 0x7fb9e803b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:26.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.514+0000 7fba04a80640 1 --2- 172.21.15.45:0/3917016368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00100510 0x7fba000fdb60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:26.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.514+0000 7fba04a80640 1 -- 172.21.15.45:0/3917016368 >> 172.21.15.45:0/3917016368 conn(0x7fba000fbc80 msgr2=0x7fba0006a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:26.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.515+0000 7fba04a80640 1 -- 172.21.15.45:0/3917016368 shutdown_connections 2024-09-15T22:07:26.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:26.515+0000 7fba04a80640 1 -- 172.21.15.45:0/3917016368 wait complete. 2024-09-15T22:07:27.448 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi100 2024-09-15T22:07:27.448 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-15T22:07:27.448 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/etc/ceph/ceph.conf 2024-09-15T22:07:27.468 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-15T22:07:27.468 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:07:27.527 INFO:tasks.cephadm:Adding host smithi100 to orchestrator... 2024-09-15T22:07:27.527 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch host add smithi100 2024-09-15T22:07:27.783 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:27 smithi045 ceph-mon[31180]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:27 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:27 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:27 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:27 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:27 smithi045 ceph-mon[31180]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-15T22:07:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:27 smithi045 ceph-mon[31180]: Updating smithi045:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:07:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:27 smithi045 ceph-mon[31180]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:07:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:27 smithi045 ceph-mon[31180]: Updating smithi045:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:07:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:27 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:27 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:27.784 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:27 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:27.858 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:07:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.261+0000 7f432d511640 1 -- 172.21.15.45:0/3990061534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4328106560 msgr2=0x7f4328106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.261+0000 7f432d511640 1 --2- 172.21.15.45:0/3990061534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4328106560 0x7f4328106940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4318009880 tx=0x7f431802a5d0 comp rx=0 tx=0).stop 2024-09-15T22:07:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.261+0000 7f432d511640 1 -- 172.21.15.45:0/3990061534 shutdown_connections 2024-09-15T22:07:28.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.261+0000 7f432d511640 1 --2- 172.21.15.45:0/3990061534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4328106560 0x7f4328106940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.261+0000 7f432d511640 1 -- 172.21.15.45:0/3990061534 >> 172.21.15.45:0/3990061534 conn(0x7f43280fc1b0 msgr2=0x7f43280fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.261+0000 7f432d511640 1 -- 172.21.15.45:0/3990061534 shutdown_connections 2024-09-15T22:07:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.261+0000 7f432d511640 1 -- 172.21.15.45:0/3990061534 wait complete. 2024-09-15T22:07:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.262+0000 7f432d511640 1 Processor -- start 2024-09-15T22:07:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.262+0000 7f432d511640 1 -- start start 2024-09-15T22:07:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.262+0000 7f432d511640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4328106560 0x7f4328198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.262+0000 7f432d511640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f432810acd0 con 0x7f4328106560 2024-09-15T22:07:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.262+0000 7f4326ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4328106560 0x7f4328198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.262+0000 7f4326ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4328106560 0x7f4328198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44940/0 (socket says 172.21.15.45:44940) 2024-09-15T22:07:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.262+0000 7f4326ffd640 1 -- 172.21.15.45:0/3049481128 learned_addr learned my addr 172.21.15.45:0/3049481128 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.263+0000 7f4326ffd640 1 -- 172.21.15.45:0/3049481128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4328198570 con 0x7f4328106560 2024-09-15T22:07:28.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.263+0000 7f4326ffd640 1 --2- 172.21.15.45:0/3049481128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4328106560 0x7f4328198030 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4318006010 tx=0x7f4318003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:28.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.263+0000 7f4324ff9640 1 -- 172.21.15.45:0/3049481128 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f431803f070 con 0x7f4328106560 2024-09-15T22:07:28.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.263+0000 7f4324ff9640 1 -- 172.21.15.45:0/3049481128 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4318031c20 con 0x7f4328106560 2024-09-15T22:07:28.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.263+0000 7f432d511640 1 -- 172.21.15.45:0/3049481128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4328198800 con 0x7f4328106560 2024-09-15T22:07:28.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.263+0000 7f4324ff9640 1 -- 172.21.15.45:0/3049481128 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4318035030 con 0x7f4328106560 2024-09-15T22:07:28.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.263+0000 7f432d511640 1 -- 172.21.15.45:0/3049481128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4328198c60 con 0x7f4328106560 2024-09-15T22:07:28.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.264+0000 7f4324ff9640 1 -- 172.21.15.45:0/3049481128 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4318042070 con 0x7f4328106560 2024-09-15T22:07:28.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.264+0000 7f4324ff9640 1 --2- 172.21.15.45:0/3049481128 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4314039300 0x7f431403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:28.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.264+0000 7f4324ff9640 1 -- 172.21.15.45:0/3049481128 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f431806cf70 con 0x7f4328106560 2024-09-15T22:07:28.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.264+0000 7f432d511640 1 -- 172.21.15.45:0/3049481128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4328101bd0 con 0x7f4328106560 2024-09-15T22:07:28.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.264+0000 7f431ffff640 1 --2- 172.21.15.45:0/3049481128 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4314039300 0x7f431403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:28.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.265+0000 7f431ffff640 1 --2- 172.21.15.45:0/3049481128 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4314039300 0x7f431403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f43100098c0 tx=0x7f4310006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:28.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.269+0000 7f4324ff9640 1 -- 172.21.15.45:0/3049481128 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f431804c350 con 0x7f4328106560 2024-09-15T22:07:28.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:28.447+0000 7f432d511640 1 -- 172.21.15.45:0/3049481128 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}) -- 0x7f43281069c0 con 0x7f4314039300 2024-09-15T22:07:29.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:29 smithi045 ceph-mon[31180]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:30.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:30 smithi045 ceph-mon[31180]: Deploying cephadm binary to smithi100 2024-09-15T22:07:32.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:32.288+0000 7f4324ff9640 1 -- 172.21.15.45:0/3049481128 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f43281069c0 con 0x7f4314039300 2024-09-15T22:07:32.290 INFO:teuthology.orchestra.run.smithi045.stdout:Added host 'smithi100' with addr '172.21.15.100' 2024-09-15T22:07:32.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:32.291+0000 7f432d511640 1 -- 172.21.15.45:0/3049481128 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4314039300 msgr2=0x7f431403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:32.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:32.291+0000 7f432d511640 1 --2- 172.21.15.45:0/3049481128 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4314039300 0x7f431403b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f43100098c0 tx=0x7f4310006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:32.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:32.291+0000 7f432d511640 1 -- 172.21.15.45:0/3049481128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4328106560 msgr2=0x7f4328198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:32.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:32.291+0000 7f432d511640 1 --2- 172.21.15.45:0/3049481128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4328106560 0x7f4328198030 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4318006010 tx=0x7f4318003c00 comp rx=0 tx=0).stop 2024-09-15T22:07:32.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:32.291+0000 7f432d511640 1 -- 172.21.15.45:0/3049481128 shutdown_connections 2024-09-15T22:07:32.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:32.291+0000 7f432d511640 1 --2- 172.21.15.45:0/3049481128 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4314039300 0x7f431403b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:32.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:32.291+0000 7f432d511640 1 --2- 172.21.15.45:0/3049481128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4328106560 0x7f4328198030 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:32.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:32.291+0000 7f432d511640 1 -- 172.21.15.45:0/3049481128 >> 172.21.15.45:0/3049481128 conn(0x7f43280fc1b0 msgr2=0x7f43280fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:32.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:32.291+0000 7f432d511640 1 -- 172.21.15.45:0/3049481128 shutdown_connections 2024-09-15T22:07:32.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:32.291+0000 7f432d511640 1 -- 172.21.15.45:0/3049481128 wait complete. 2024-09-15T22:07:32.904 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T22:07:33.155 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:07:33.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:33.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:33 smithi045 ceph-mon[31180]: Added host smithi100 2024-09-15T22:07:33.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:33.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:33.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.582+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/2668605238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc102750 msgr2=0x7f3fdc102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.582+0000 7f3fe3d4c640 1 --2- 172.21.15.45:0/2668605238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc102750 0x7f3fdc102b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009880 tx=0x7f3fd802a670 comp rx=0 tx=0).stop 2024-09-15T22:07:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.582+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/2668605238 shutdown_connections 2024-09-15T22:07:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.582+0000 7f3fe3d4c640 1 --2- 172.21.15.45:0/2668605238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc102750 0x7f3fdc102b30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.582+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/2668605238 >> 172.21.15.45:0/2668605238 conn(0x7f3fdc0fc1b0 msgr2=0x7f3fdc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.582+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/2668605238 shutdown_connections 2024-09-15T22:07:33.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.582+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/2668605238 wait complete. 2024-09-15T22:07:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.583+0000 7f3fe3d4c640 1 Processor -- start 2024-09-15T22:07:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.583+0000 7f3fe3d4c640 1 -- start start 2024-09-15T22:07:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.583+0000 7f3fe3d4c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc102750 0x7f3fdc1003b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.583+0000 7f3fe3d4c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc10be00 con 0x7f3fdc102750 2024-09-15T22:07:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.583+0000 7f3fe1ae8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc102750 0x7f3fdc1003b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.583+0000 7f3fe1ae8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc102750 0x7f3fdc1003b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44960/0 (socket says 172.21.15.45:44960) 2024-09-15T22:07:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.583+0000 7f3fe1ae8640 1 -- 172.21.15.45:0/293585497 learned_addr learned my addr 172.21.15.45:0/293585497 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:33.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.583+0000 7f3fe1ae8640 1 -- 172.21.15.45:0/293585497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc1022a0 con 0x7f3fdc102750 2024-09-15T22:07:33.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.584+0000 7f3fe1ae8640 1 --2- 172.21.15.45:0/293585497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc102750 0x7f3fdc1003b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009230 tx=0x7f3fd8003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.584+0000 7f3fd2ffd640 1 -- 172.21.15.45:0/293585497 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd803f070 con 0x7f3fdc102750 2024-09-15T22:07:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.584+0000 7f3fd2ffd640 1 -- 172.21.15.45:0/293585497 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3fd8031d50 con 0x7f3fdc102750 2024-09-15T22:07:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.584+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/293585497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fdc1008f0 con 0x7f3fdc102750 2024-09-15T22:07:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.584+0000 7f3fd2ffd640 1 -- 172.21.15.45:0/293585497 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fd8035030 con 0x7f3fdc102750 2024-09-15T22:07:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.584+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/293585497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fdc100db0 con 0x7f3fdc102750 2024-09-15T22:07:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.585+0000 7f3fd2ffd640 1 -- 172.21.15.45:0/293585497 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3fd8042070 con 0x7f3fdc102750 2024-09-15T22:07:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.585+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/293585497 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fdc06a7b0 con 0x7f3fdc102750 2024-09-15T22:07:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.585+0000 7f3fd2ffd640 1 --2- 172.21.15.45:0/293585497 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3fc8039300 0x7f3fc803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.585+0000 7f3fd2ffd640 1 -- 172.21.15.45:0/293585497 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3fd806d160 con 0x7f3fdc102750 2024-09-15T22:07:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.585+0000 7f3fe12e7640 1 --2- 172.21.15.45:0/293585497 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3fc8039300 0x7f3fc803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:33.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.585+0000 7f3fe12e7640 1 --2- 172.21.15.45:0/293585497 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3fc8039300 0x7f3fc803b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc0098c0 tx=0x7f3fcc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:33.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.590+0000 7f3fd2ffd640 1 -- 172.21.15.45:0/293585497 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3fd8030420 con 0x7f3fdc102750 2024-09-15T22:07:33.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.772+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/293585497 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3fdc1018e0 con 0x7f3fc8039300 2024-09-15T22:07:33.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.773+0000 7f3fd2ffd640 1 -- 172.21.15.45:0/293585497 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f3fdc1018e0 con 0x7f3fc8039300 2024-09-15T22:07:33.775 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:07:33.775 INFO:teuthology.orchestra.run.smithi045.stdout:[{"addr": "172.21.15.45", "hostname": "smithi045", "labels": [], "status": ""}, {"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}] 2024-09-15T22:07:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.775+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/293585497 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3fc8039300 msgr2=0x7f3fc803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.775+0000 7f3fe3d4c640 1 --2- 172.21.15.45:0/293585497 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3fc8039300 0x7f3fc803b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc0098c0 tx=0x7f3fcc006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.775+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/293585497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc102750 msgr2=0x7f3fdc1003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.775+0000 7f3fe3d4c640 1 --2- 172.21.15.45:0/293585497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc102750 0x7f3fdc1003b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009230 tx=0x7f3fd8003cb0 comp rx=0 tx=0).stop 2024-09-15T22:07:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.775+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/293585497 shutdown_connections 2024-09-15T22:07:33.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.775+0000 7f3fe3d4c640 1 --2- 172.21.15.45:0/293585497 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3fc8039300 0x7f3fc803b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:33.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.775+0000 7f3fe3d4c640 1 --2- 172.21.15.45:0/293585497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc102750 0x7f3fdc1003b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:33.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.775+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/293585497 >> 172.21.15.45:0/293585497 conn(0x7f3fdc0fc1b0 msgr2=0x7f3fdc1034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:33.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.775+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/293585497 shutdown_connections 2024-09-15T22:07:33.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:33.775+0000 7f3fe3d4c640 1 -- 172.21.15.45:0/293585497 wait complete. 2024-09-15T22:07:34.325 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi165 2024-09-15T22:07:34.325 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-15T22:07:34.325 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/etc/ceph/ceph.conf 2024-09-15T22:07:34.345 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-15T22:07:34.345 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:07:34.404 INFO:tasks.cephadm:Adding host smithi165 to orchestrator... 2024-09-15T22:07:34.404 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch host add smithi165 2024-09-15T22:07:34.656 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:07:34.901 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:34 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:34.901 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:34 smithi045 ceph-mon[31180]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:07:35.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.112+0000 7f3f089cf640 1 -- 172.21.15.45:0/2971252425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f04102730 msgr2=0x7f3f04102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:35.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.112+0000 7f3f089cf640 1 --2- 172.21.15.45:0/2971252425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f04102730 0x7f3f04102b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4009c10 tx=0x7f3ef402aa10 comp rx=0 tx=0).stop 2024-09-15T22:07:35.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.112+0000 7f3f089cf640 1 -- 172.21.15.45:0/2971252425 shutdown_connections 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.112+0000 7f3f089cf640 1 --2- 172.21.15.45:0/2971252425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f04102730 0x7f3f04102b10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.112+0000 7f3f089cf640 1 -- 172.21.15.45:0/2971252425 >> 172.21.15.45:0/2971252425 conn(0x7f3f04077310 msgr2=0x7f3f040fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.112+0000 7f3f089cf640 1 -- 172.21.15.45:0/2971252425 shutdown_connections 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.112+0000 7f3f089cf640 1 -- 172.21.15.45:0/2971252425 wait complete. 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.113+0000 7f3f089cf640 1 Processor -- start 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.113+0000 7f3f089cf640 1 -- start start 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.113+0000 7f3f089cf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f04102730 0x7f3f041972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.113+0000 7f3f089cf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0410bdd0 con 0x7f3f04102730 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.113+0000 7f3f0259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f04102730 0x7f3f041972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.113+0000 7f3f0259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f04102730 0x7f3f041972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50542/0 (socket says 172.21.15.45:50542) 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.113+0000 7f3f0259c640 1 -- 172.21.15.45:0/2918098672 learned_addr learned my addr 172.21.15.45:0/2918098672 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.114+0000 7f3f0259c640 1 -- 172.21.15.45:0/2918098672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f041977e0 con 0x7f3f04102730 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.114+0000 7f3f0259c640 1 --2- 172.21.15.45:0/2918098672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f04102730 0x7f3f041972a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4005dd0 tx=0x7f3ef4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:35.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.114+0000 7f3ef37fe640 1 -- 172.21.15.45:0/2918098672 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef4034070 con 0x7f3f04102730 2024-09-15T22:07:35.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.114+0000 7f3ef37fe640 1 -- 172.21.15.45:0/2918098672 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3ef402f8e0 con 0x7f3f04102730 2024-09-15T22:07:35.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.114+0000 7f3f089cf640 1 -- 172.21.15.45:0/2918098672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f04197a70 con 0x7f3f04102730 2024-09-15T22:07:35.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.114+0000 7f3ef37fe640 1 -- 172.21.15.45:0/2918098672 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef4004520 con 0x7f3f04102730 2024-09-15T22:07:35.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.114+0000 7f3f089cf640 1 -- 172.21.15.45:0/2918098672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f04197e70 con 0x7f3f04102730 2024-09-15T22:07:35.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.115+0000 7f3ef37fe640 1 -- 172.21.15.45:0/2918098672 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3ef4037020 con 0x7f3f04102730 2024-09-15T22:07:35.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.115+0000 7f3f089cf640 1 -- 172.21.15.45:0/2918098672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f04069f90 con 0x7f3f04102730 2024-09-15T22:07:35.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.115+0000 7f3ef37fe640 1 --2- 172.21.15.45:0/2918098672 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3eec039300 0x7f3eec03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:35.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.115+0000 7f3ef37fe640 1 -- 172.21.15.45:0/2918098672 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3ef406d410 con 0x7f3f04102730 2024-09-15T22:07:35.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.115+0000 7f3f01d9b640 1 --2- 172.21.15.45:0/2918098672 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3eec039300 0x7f3eec03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:35.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.115+0000 7f3f01d9b640 1 --2- 172.21.15.45:0/2918098672 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3eec039300 0x7f3eec03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80098c0 tx=0x7f3ef8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:35.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.120+0000 7f3ef37fe640 1 -- 172.21.15.45:0/2918098672 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ef403f070 con 0x7f3f04102730 2024-09-15T22:07:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:35.299+0000 7f3f089cf640 1 -- 172.21.15.45:0/2918098672 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi165", "target": ["mon-mgr", ""]}) -- 0x7f3f04198690 con 0x7f3eec039300 2024-09-15T22:07:36.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:36 smithi045 ceph-mon[31180]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi165", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:36 smithi045 ceph-mon[31180]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:38 smithi045 ceph-mon[31180]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-15T22:07:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:38 smithi045 ceph-mon[31180]: Deploying cephadm binary to smithi165 2024-09-15T22:07:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:38 smithi045 ceph-mon[31180]: Updating smithi100:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:07:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:38 smithi045 ceph-mon[31180]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:07:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:38 smithi045 ceph-mon[31180]: Updating smithi100:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:07:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:39.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:39.128+0000 7f3ef37fe640 1 -- 172.21.15.45:0/2918098672 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f3f04198690 con 0x7f3eec039300 2024-09-15T22:07:39.131 INFO:teuthology.orchestra.run.smithi045.stdout:Added host 'smithi165' with addr '172.21.15.165' 2024-09-15T22:07:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:39.131+0000 7f3f089cf640 1 -- 172.21.15.45:0/2918098672 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3eec039300 msgr2=0x7f3eec03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:39.131+0000 7f3f089cf640 1 --2- 172.21.15.45:0/2918098672 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3eec039300 0x7f3eec03b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ef80098c0 tx=0x7f3ef8006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:39.131+0000 7f3f089cf640 1 -- 172.21.15.45:0/2918098672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f04102730 msgr2=0x7f3f041972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:39.131+0000 7f3f089cf640 1 --2- 172.21.15.45:0/2918098672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f04102730 0x7f3f041972a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4005dd0 tx=0x7f3ef4003ba0 comp rx=0 tx=0).stop 2024-09-15T22:07:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:39.131+0000 7f3f089cf640 1 -- 172.21.15.45:0/2918098672 shutdown_connections 2024-09-15T22:07:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:39.131+0000 7f3f089cf640 1 --2- 172.21.15.45:0/2918098672 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3eec039300 0x7f3eec03b7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:39.131+0000 7f3f089cf640 1 --2- 172.21.15.45:0/2918098672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f04102730 0x7f3f041972a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:39.131+0000 7f3f089cf640 1 -- 172.21.15.45:0/2918098672 >> 172.21.15.45:0/2918098672 conn(0x7f3f04077310 msgr2=0x7f3f041034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:39.131+0000 7f3f089cf640 1 -- 172.21.15.45:0/2918098672 shutdown_connections 2024-09-15T22:07:39.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:39.131+0000 7f3f089cf640 1 -- 172.21.15.45:0/2918098672 wait complete. 2024-09-15T22:07:39.425 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:39 smithi045 ceph-mon[31180]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:39.426 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:39 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:39.426 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:39 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:07:39.704 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T22:07:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:07:40.352 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:40 smithi045 ceph-mon[31180]: Added host smithi165 2024-09-15T22:07:40.352 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:40 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:40.352 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:40 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:40.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.350+0000 7fdada0f8640 1 -- 172.21.15.45:0/355672972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdad4107660 msgr2=0x7fdad4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:40.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.350+0000 7fdada0f8640 1 --2- 172.21.15.45:0/355672972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdad4107660 0x7fdad4107a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009880 tx=0x7fdac402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:07:40.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.350+0000 7fdada0f8640 1 -- 172.21.15.45:0/355672972 shutdown_connections 2024-09-15T22:07:40.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.350+0000 7fdada0f8640 1 --2- 172.21.15.45:0/355672972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdad4107660 0x7fdad4107a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:40.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.350+0000 7fdada0f8640 1 -- 172.21.15.45:0/355672972 >> 172.21.15.45:0/355672972 conn(0x7fdad40fd290 msgr2=0x7fdad40ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:40.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.350+0000 7fdada0f8640 1 -- 172.21.15.45:0/355672972 shutdown_connections 2024-09-15T22:07:40.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.350+0000 7fdada0f8640 1 -- 172.21.15.45:0/355672972 wait complete. 2024-09-15T22:07:40.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.351+0000 7fdada0f8640 1 Processor -- start 2024-09-15T22:07:40.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.351+0000 7fdada0f8640 1 -- start start 2024-09-15T22:07:40.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.351+0000 7fdada0f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdad4107660 0x7fdad4197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:40.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.351+0000 7fdada0f8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdad410bdd0 con 0x7fdad4107660 2024-09-15T22:07:40.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.351+0000 7fdad37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdad4107660 0x7fdad4197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:40.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.351+0000 7fdad37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdad4107660 0x7fdad4197190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50554/0 (socket says 172.21.15.45:50554) 2024-09-15T22:07:40.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.351+0000 7fdad37fe640 1 -- 172.21.15.45:0/2202567723 learned_addr learned my addr 172.21.15.45:0/2202567723 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:40.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.352+0000 7fdad37fe640 1 -- 172.21.15.45:0/2202567723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad41976d0 con 0x7fdad4107660 2024-09-15T22:07:40.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.352+0000 7fdad37fe640 1 --2- 172.21.15.45:0/2202567723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdad4107660 0x7fdad4197190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdac4006010 tx=0x7fdac4003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:40.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.352+0000 7fdad0ff9640 1 -- 172.21.15.45:0/2202567723 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdac403f070 con 0x7fdad4107660 2024-09-15T22:07:40.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.352+0000 7fdada0f8640 1 -- 172.21.15.45:0/2202567723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad4197960 con 0x7fdad4107660 2024-09-15T22:07:40.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.352+0000 7fdad0ff9640 1 -- 172.21.15.45:0/2202567723 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdac4031c20 con 0x7fdad4107660 2024-09-15T22:07:40.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.352+0000 7fdad0ff9640 1 -- 172.21.15.45:0/2202567723 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdac4035030 con 0x7fdad4107660 2024-09-15T22:07:40.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.352+0000 7fdada0f8640 1 -- 172.21.15.45:0/2202567723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad419ba60 con 0x7fdad4107660 2024-09-15T22:07:40.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.353+0000 7fdad0ff9640 1 -- 172.21.15.45:0/2202567723 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fdac4042070 con 0x7fdad4107660 2024-09-15T22:07:40.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.353+0000 7fdad0ff9640 1 --2- 172.21.15.45:0/2202567723 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdabc039300 0x7fdabc03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:40.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.353+0000 7fdad0ff9640 1 -- 172.21.15.45:0/2202567723 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdac406cf70 con 0x7fdad4107660 2024-09-15T22:07:40.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.353+0000 7fdad2ffd640 1 --2- 172.21.15.45:0/2202567723 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdabc039300 0x7fdabc03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:40.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.353+0000 7fdada0f8640 1 -- 172.21.15.45:0/2202567723 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdad4102cd0 con 0x7fdad4107660 2024-09-15T22:07:40.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.354+0000 7fdad2ffd640 1 --2- 172.21.15.45:0/2202567723 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdabc039300 0x7fdabc03b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdac80098c0 tx=0x7fdac8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:40.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.358+0000 7fdad0ff9640 1 -- 172.21.15.45:0/2202567723 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdac404c350 con 0x7fdad4107660 2024-09-15T22:07:40.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.538+0000 7fdada0f8640 1 -- 172.21.15.45:0/2202567723 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdad41984f0 con 0x7fdabc039300 2024-09-15T22:07:40.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.539+0000 7fdad0ff9640 1 -- 172.21.15.45:0/2202567723 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7fdad41984f0 con 0x7fdabc039300 2024-09-15T22:07:40.541 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:07:40.541 INFO:teuthology.orchestra.run.smithi045.stdout:[{"addr": "172.21.15.45", "hostname": "smithi045", "labels": [], "status": ""}, {"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}, {"addr": "172.21.15.165", "hostname": "smithi165", "labels": [], "status": ""}] 2024-09-15T22:07:40.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.541+0000 7fdada0f8640 1 -- 172.21.15.45:0/2202567723 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdabc039300 msgr2=0x7fdabc03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.541+0000 7fdada0f8640 1 --2- 172.21.15.45:0/2202567723 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdabc039300 0x7fdabc03b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdac80098c0 tx=0x7fdac8006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.542+0000 7fdada0f8640 1 -- 172.21.15.45:0/2202567723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdad4107660 msgr2=0x7fdad4197190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.542+0000 7fdada0f8640 1 --2- 172.21.15.45:0/2202567723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdad4107660 0x7fdad4197190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdac4006010 tx=0x7fdac4003c00 comp rx=0 tx=0).stop 2024-09-15T22:07:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.542+0000 7fdada0f8640 1 -- 172.21.15.45:0/2202567723 shutdown_connections 2024-09-15T22:07:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.542+0000 7fdada0f8640 1 --2- 172.21.15.45:0/2202567723 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdabc039300 0x7fdabc03b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.542+0000 7fdada0f8640 1 --2- 172.21.15.45:0/2202567723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdad4107660 0x7fdad4197190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.542+0000 7fdada0f8640 1 -- 172.21.15.45:0/2202567723 >> 172.21.15.45:0/2202567723 conn(0x7fdad40fd290 msgr2=0x7fdad40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.542+0000 7fdada0f8640 1 -- 172.21.15.45:0/2202567723 shutdown_connections 2024-09-15T22:07:40.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:40.542+0000 7fdada0f8640 1 -- 172.21.15.45:0/2202567723 wait complete. 2024-09-15T22:07:41.118 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-15T22:07:41.119 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-15T22:07:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:07:41.488 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:41 smithi045 ceph-mon[31180]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:41.488 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:41 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.799+0000 7f3764391640 1 -- 172.21.15.45:0/2644901406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f375c106540 msgr2=0x7f375c106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.799+0000 7f3764391640 1 --2- 172.21.15.45:0/2644901406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f375c106540 0x7f375c106920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3758009810 tx=0x7f375802a540 comp rx=0 tx=0).stop 2024-09-15T22:07:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.799+0000 7f3764391640 1 -- 172.21.15.45:0/2644901406 shutdown_connections 2024-09-15T22:07:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.799+0000 7f3764391640 1 --2- 172.21.15.45:0/2644901406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f375c106540 0x7f375c106920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.799+0000 7f3764391640 1 -- 172.21.15.45:0/2644901406 >> 172.21.15.45:0/2644901406 conn(0x7f375c077310 msgr2=0x7f375c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.799+0000 7f3764391640 1 -- 172.21.15.45:0/2644901406 shutdown_connections 2024-09-15T22:07:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.799+0000 7f3764391640 1 -- 172.21.15.45:0/2644901406 wait complete. 2024-09-15T22:07:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.800+0000 7f3764391640 1 Processor -- start 2024-09-15T22:07:41.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.800+0000 7f3764391640 1 -- start start 2024-09-15T22:07:41.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.800+0000 7f3764391640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f375c106540 0x7f375c198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:41.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.800+0000 7f3764391640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f375c10acb0 con 0x7f375c106540 2024-09-15T22:07:41.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.800+0000 7f376212d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f375c106540 0x7f375c198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:41.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.800+0000 7f376212d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f375c106540 0x7f375c198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50564/0 (socket says 172.21.15.45:50564) 2024-09-15T22:07:41.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.800+0000 7f376212d640 1 -- 172.21.15.45:0/69374676 learned_addr learned my addr 172.21.15.45:0/69374676 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:07:41.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.801+0000 7f376212d640 1 -- 172.21.15.45:0/69374676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375c1985d0 con 0x7f375c106540 2024-09-15T22:07:41.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.801+0000 7f376212d640 1 --2- 172.21.15.45:0/69374676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f375c106540 0x7f375c198090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f37580058e0 tx=0x7f37580045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:41.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.801+0000 7f37537fe640 1 -- 172.21.15.45:0/69374676 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3758031400 con 0x7f375c106540 2024-09-15T22:07:41.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.801+0000 7f37537fe640 1 -- 172.21.15.45:0/69374676 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f37580035f0 con 0x7f375c106540 2024-09-15T22:07:41.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.801+0000 7f37537fe640 1 -- 172.21.15.45:0/69374676 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f375803c480 con 0x7f375c106540 2024-09-15T22:07:41.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.801+0000 7f3764391640 1 -- 172.21.15.45:0/69374676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f375c198860 con 0x7f375c106540 2024-09-15T22:07:41.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.801+0000 7f3764391640 1 -- 172.21.15.45:0/69374676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f375c198cc0 con 0x7f375c106540 2024-09-15T22:07:41.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.802+0000 7f37537fe640 1 -- 172.21.15.45:0/69374676 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3758039040 con 0x7f375c106540 2024-09-15T22:07:41.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.802+0000 7f3764391640 1 -- 172.21.15.45:0/69374676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f375c101bb0 con 0x7f375c106540 2024-09-15T22:07:41.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.803+0000 7f37537fe640 1 --2- 172.21.15.45:0/69374676 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3748039300 0x7f374803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:41.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.803+0000 7f37537fe640 1 -- 172.21.15.45:0/69374676 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f375806d7d0 con 0x7f375c106540 2024-09-15T22:07:41.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.803+0000 7f376192c640 1 --2- 172.21.15.45:0/69374676 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3748039300 0x7f374803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:41.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.803+0000 7f376192c640 1 --2- 172.21.15.45:0/69374676 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3748039300 0x7f374803b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f374c0098c0 tx=0x7f374c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:41.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.807+0000 7f37537fe640 1 -- 172.21.15.45:0/69374676 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3758040030 con 0x7f375c106540 2024-09-15T22:07:41.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:41.990+0000 7f3764391640 1 -- 172.21.15.45:0/69374676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f375c1069a0 con 0x7f375c106540 2024-09-15T22:07:42.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:42.145+0000 7f37537fe640 1 -- 172.21.15.45:0/69374676 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f375804bb10 con 0x7f375c106540 2024-09-15T22:07:42.147 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2024-09-15T22:07:42.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:42.148+0000 7f3764391640 1 -- 172.21.15.45:0/69374676 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3748039300 msgr2=0x7f374803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:42.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:42.148+0000 7f3764391640 1 --2- 172.21.15.45:0/69374676 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3748039300 0x7f374803b7c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f374c0098c0 tx=0x7f374c006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:42.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:42.148+0000 7f3764391640 1 -- 172.21.15.45:0/69374676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f375c106540 msgr2=0x7f375c198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:42.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:42.148+0000 7f3764391640 1 --2- 172.21.15.45:0/69374676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f375c106540 0x7f375c198090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f37580058e0 tx=0x7f37580045e0 comp rx=0 tx=0).stop 2024-09-15T22:07:42.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:42.148+0000 7f3764391640 1 -- 172.21.15.45:0/69374676 shutdown_connections 2024-09-15T22:07:42.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:42.148+0000 7f3764391640 1 --2- 172.21.15.45:0/69374676 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3748039300 0x7f374803b7c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:42.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:42.148+0000 7f3764391640 1 --2- 172.21.15.45:0/69374676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f375c106540 0x7f375c198090 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:42.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:42.148+0000 7f3764391640 1 -- 172.21.15.45:0/69374676 >> 172.21.15.45:0/69374676 conn(0x7f375c077310 msgr2=0x7f375c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:42.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:42.149+0000 7f3764391640 1 -- 172.21.15.45:0/69374676 shutdown_connections 2024-09-15T22:07:42.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:07:42.149+0000 7f3764391640 1 -- 172.21.15.45:0/69374676 wait complete. 2024-09-15T22:07:42.437 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:42 smithi045 ceph-mon[31180]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:07:42.437 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:42 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/69374676' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T22:07:42.708 INFO:tasks.cephadm:Adding mon.a on smithi045 2024-09-15T22:07:42.708 INFO:tasks.cephadm:Adding mon.b on smithi100 2024-09-15T22:07:42.708 INFO:tasks.cephadm:Adding mon.c on smithi165 2024-09-15T22:07:42.708 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi045:172.21.15.45=a;smithi100:172.21.15.100=b;smithi165:172.21.15.165=c' 2024-09-15T22:07:43.241 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-15T22:07:43.289 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-15T22:07:43.446 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:43 smithi045 ceph-mon[31180]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:43.446 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:43 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/69374676' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T22:07:43.446 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:43 smithi045 ceph-mon[31180]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:07:43.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.763+0000 7fe7db53b640 1 -- 172.21.15.165:0/3830468758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d4100540 msgr2=0x7fe7d4100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:43.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.763+0000 7fe7db53b640 1 --2- 172.21.15.165:0/3830468758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d4100540 0x7fe7d4100940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009880 tx=0x7fe7d002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:07:43.805 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.763+0000 7fe7db53b640 1 -- 172.21.15.165:0/3830468758 shutdown_connections 2024-09-15T22:07:43.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.763+0000 7fe7db53b640 1 --2- 172.21.15.165:0/3830468758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d4100540 0x7fe7d4100940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:43.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.763+0000 7fe7db53b640 1 -- 172.21.15.165:0/3830468758 >> 172.21.15.165:0/3830468758 conn(0x7fe7d40fbcd0 msgr2=0x7fe7d40fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:43.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.764+0000 7fe7db53b640 1 -- 172.21.15.165:0/3830468758 shutdown_connections 2024-09-15T22:07:43.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.764+0000 7fe7db53b640 1 -- 172.21.15.165:0/3830468758 wait complete. 2024-09-15T22:07:43.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.764+0000 7fe7db53b640 1 Processor -- start 2024-09-15T22:07:43.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.764+0000 7fe7db53b640 1 -- start start 2024-09-15T22:07:43.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.764+0000 7fe7db53b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d4100540 0x7fe7d406a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:43.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.764+0000 7fe7db53b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d4106740 con 0x7fe7d4100540 2024-09-15T22:07:43.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.765+0000 7fe7d92d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d4100540 0x7fe7d406a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:43.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.765+0000 7fe7d92d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d4100540 0x7fe7d406a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.165:54788/0 (socket says 172.21.15.165:54788) 2024-09-15T22:07:43.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.765+0000 7fe7d92d7640 1 -- 172.21.15.165:0/1530122757 learned_addr learned my addr 172.21.15.165:0/1530122757 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-15T22:07:43.806 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.765+0000 7fe7d92d7640 1 -- 172.21.15.165:0/1530122757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d4199b80 con 0x7fe7d4100540 2024-09-15T22:07:43.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.765+0000 7fe7d92d7640 1 --2- 172.21.15.165:0/1530122757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d4100540 0x7fe7d406a170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009230 tx=0x7fe7d0032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:43.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.765+0000 7fe7ca7fc640 1 -- 172.21.15.165:0/1530122757 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7d003f030 con 0x7fe7d4100540 2024-09-15T22:07:43.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.765+0000 7fe7ca7fc640 1 -- 172.21.15.165:0/1530122757 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe7d0003e30 con 0x7fe7d4100540 2024-09-15T22:07:43.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.765+0000 7fe7db53b640 1 -- 172.21.15.165:0/1530122757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d4199d50 con 0x7fe7d4100540 2024-09-15T22:07:43.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.765+0000 7fe7ca7fc640 1 -- 172.21.15.165:0/1530122757 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7d0035070 con 0x7fe7d4100540 2024-09-15T22:07:43.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.765+0000 7fe7db53b640 1 -- 172.21.15.165:0/1530122757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d419a170 con 0x7fe7d4100540 2024-09-15T22:07:43.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.766+0000 7fe7db53b640 1 -- 172.21.15.165:0/1530122757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d4106ec0 con 0x7fe7d4100540 2024-09-15T22:07:43.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.766+0000 7fe7ca7fc640 1 -- 172.21.15.165:0/1530122757 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe7d0042030 con 0x7fe7d4100540 2024-09-15T22:07:43.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.767+0000 7fe7ca7fc640 1 --2- 172.21.15.165:0/1530122757 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe7c00392a0 0x7fe7c003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:43.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.767+0000 7fe7ca7fc640 1 -- 172.21.15.165:0/1530122757 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe7d0040070 con 0x7fe7d4100540 2024-09-15T22:07:43.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.767+0000 7fe7d8ad6640 1 --2- 172.21.15.165:0/1530122757 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe7c00392a0 0x7fe7c003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:43.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.767+0000 7fe7d8ad6640 1 --2- 172.21.15.165:0/1530122757 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe7c00392a0 0x7fe7c003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40098c0 tx=0x7fe7c4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:43.807 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.772+0000 7fe7ca7fc640 1 -- 172.21.15.165:0/1530122757 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe7d00433c0 con 0x7fe7d4100540 2024-09-15T22:07:43.963 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.961+0000 7fe7db53b640 1 -- 172.21.15.165:0/1530122757 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi045:172.21.15.45=a;smithi100:172.21.15.100=b;smithi165:172.21.15.165=c", "target": ["mon-mgr", ""]}) -- 0x7fe7d402db40 con 0x7fe7c00392a0 2024-09-15T22:07:43.968 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.966+0000 7fe7ca7fc640 1 -- 172.21.15.165:0/1530122757 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe7d402db40 con 0x7fe7c00392a0 2024-09-15T22:07:43.968 INFO:teuthology.orchestra.run.smithi165.stdout:Scheduled mon update... 2024-09-15T22:07:43.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.968+0000 7fe7db53b640 1 -- 172.21.15.165:0/1530122757 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe7c00392a0 msgr2=0x7fe7c003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:43.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.968+0000 7fe7db53b640 1 --2- 172.21.15.165:0/1530122757 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe7c00392a0 0x7fe7c003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40098c0 tx=0x7fe7c4006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:43.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.968+0000 7fe7db53b640 1 -- 172.21.15.165:0/1530122757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d4100540 msgr2=0x7fe7d406a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:43.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.968+0000 7fe7db53b640 1 --2- 172.21.15.165:0/1530122757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d4100540 0x7fe7d406a170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009230 tx=0x7fe7d0032d00 comp rx=0 tx=0).stop 2024-09-15T22:07:43.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.968+0000 7fe7db53b640 1 -- 172.21.15.165:0/1530122757 shutdown_connections 2024-09-15T22:07:43.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.968+0000 7fe7db53b640 1 --2- 172.21.15.165:0/1530122757 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe7c00392a0 0x7fe7c003b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:43.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.968+0000 7fe7db53b640 1 --2- 172.21.15.165:0/1530122757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d4100540 0x7fe7d406a170 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:43.970 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.968+0000 7fe7db53b640 1 -- 172.21.15.165:0/1530122757 >> 172.21.15.165:0/1530122757 conn(0x7fe7d40fbcd0 msgr2=0x7fe7d40fc740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:43.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.969+0000 7fe7db53b640 1 -- 172.21.15.165:0/1530122757 shutdown_connections 2024-09-15T22:07:43.971 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:43.969+0000 7fe7db53b640 1 -- 172.21.15.165:0/1530122757 wait complete. 2024-09-15T22:07:44.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:44.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:44.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:44.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:44.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi165", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:44.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:44.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:44.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-15T22:07:44.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:44.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:44.677 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:44.677 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:44.677 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:07:44.677 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:44.678 DEBUG:teuthology.orchestra.run.smithi100:mon.b> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.b.service 2024-09-15T22:07:44.681 DEBUG:teuthology.orchestra.run.smithi165:mon.c> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.c.service 2024-09-15T22:07:44.684 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:07:44.685 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:07:45.341 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:07:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:45 smithi045 ceph-mon[31180]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:45 smithi045 ceph-mon[31180]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:07:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:45 smithi045 ceph-mon[31180]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:07:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:45 smithi045 ceph-mon[31180]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:07:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:45 smithi045 ceph-mon[31180]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi045:172.21.15.45=a;smithi100:172.21.15.100=b;smithi165:172.21.15.165=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:45 smithi045 ceph-mon[31180]: Saving service mon spec with placement smithi045:172.21.15.45=a;smithi100:172.21.15.100=b;smithi165:172.21.15.165=c;count:3 2024-09-15T22:07:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:45 smithi045 ceph-mon[31180]: Deploying daemon mon.c on smithi165 2024-09-15T22:07:47.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.259+0000 7fd0eb801640 1 -- 172.21.15.165:0/1994017296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0e4106540 msgr2=0x7fd0e4106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:47.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.259+0000 7fd0eb801640 1 --2- 172.21.15.165:0/1994017296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0e4106540 0x7fd0e4106920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009810 tx=0x7fd0e002a540 comp rx=0 tx=0).stop 2024-09-15T22:07:47.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.259+0000 7fd0eb801640 1 -- 172.21.15.165:0/1994017296 shutdown_connections 2024-09-15T22:07:47.285 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.259+0000 7fd0eb801640 1 --2- 172.21.15.165:0/1994017296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0e4106540 0x7fd0e4106920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:47.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.259+0000 7fd0eb801640 1 -- 172.21.15.165:0/1994017296 >> 172.21.15.165:0/1994017296 conn(0x7fd0e4077310 msgr2=0x7fd0e40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:47.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.259+0000 7fd0eb801640 1 -- 172.21.15.165:0/1994017296 shutdown_connections 2024-09-15T22:07:47.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.259+0000 7fd0eb801640 1 -- 172.21.15.165:0/1994017296 wait complete. 2024-09-15T22:07:47.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.260+0000 7fd0eb801640 1 Processor -- start 2024-09-15T22:07:47.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.260+0000 7fd0eb801640 1 -- start start 2024-09-15T22:07:47.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.260+0000 7fd0eb801640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0e4106540 0x7fd0e4198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:47.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.260+0000 7fd0eb801640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e410acb0 con 0x7fd0e4106540 2024-09-15T22:07:47.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.260+0000 7fd0e959d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0e4106540 0x7fd0e4198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:47.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.260+0000 7fd0e959d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0e4106540 0x7fd0e4198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.165:54810/0 (socket says 172.21.15.165:54810) 2024-09-15T22:07:47.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.260+0000 7fd0e959d640 1 -- 172.21.15.165:0/745388516 learned_addr learned my addr 172.21.15.165:0/745388516 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-15T22:07:47.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.261+0000 7fd0e959d640 1 -- 172.21.15.165:0/745388516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e41985d0 con 0x7fd0e4106540 2024-09-15T22:07:47.286 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.261+0000 7fd0e959d640 1 --2- 172.21.15.165:0/745388516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0e4106540 0x7fd0e4198090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00058e0 tx=0x7fd0e00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:47.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.261+0000 7fd0da7fc640 1 -- 172.21.15.165:0/745388516 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e0031400 con 0x7fd0e4106540 2024-09-15T22:07:47.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.261+0000 7fd0eb801640 1 -- 172.21.15.165:0/745388516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e4198860 con 0x7fd0e4106540 2024-09-15T22:07:47.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.261+0000 7fd0eb801640 1 -- 172.21.15.165:0/745388516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e4198cc0 con 0x7fd0e4106540 2024-09-15T22:07:47.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.261+0000 7fd0da7fc640 1 -- 172.21.15.165:0/745388516 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd0e00035f0 con 0x7fd0e4106540 2024-09-15T22:07:47.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.261+0000 7fd0da7fc640 1 -- 172.21.15.165:0/745388516 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0e003c480 con 0x7fd0e4106540 2024-09-15T22:07:47.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.262+0000 7fd0eb801640 1 -- 172.21.15.165:0/745388516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e4101bb0 con 0x7fd0e4106540 2024-09-15T22:07:47.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.262+0000 7fd0da7fc640 1 -- 172.21.15.165:0/745388516 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fd0e0039040 con 0x7fd0e4106540 2024-09-15T22:07:47.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.262+0000 7fd0da7fc640 1 --2- 172.21.15.165:0/745388516 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd0d00392a0 0x7fd0d003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:47.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.263+0000 7fd0da7fc640 1 -- 172.21.15.165:0/745388516 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd0e006d990 con 0x7fd0e4106540 2024-09-15T22:07:47.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.263+0000 7fd0e8d9c640 1 --2- 172.21.15.165:0/745388516 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd0d00392a0 0x7fd0d003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:47.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.263+0000 7fd0e8d9c640 1 --2- 172.21.15.165:0/745388516 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd0d00392a0 0x7fd0d003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40098c0 tx=0x7fd0d4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:47.287 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.268+0000 7fd0da7fc640 1 -- 172.21.15.165:0/745388516 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd0e0040030 con 0x7fd0e4106540 2024-09-15T22:07:47.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:47 smithi045 ceph-mon[31180]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:47.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.567+0000 7fd0eb801640 1 -- 172.21.15.165:0/745388516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fd0e41069a0 con 0x7fd0e4106540 2024-09-15T22:07:47.570 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.568+0000 7fd0da7fc640 1 -- 172.21.15.165:0/745388516 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fd0e004c3a0 con 0x7fd0e4106540 2024-09-15T22:07:47.570 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:07:47.570 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":1,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","modified":"2024-09-15T22:06:16.451807Z","created":"2024-09-15T22:06:16.451807Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-15T22:07:47.570 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 1 2024-09-15T22:07:47.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.570+0000 7fd0eb801640 1 -- 172.21.15.165:0/745388516 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd0d00392a0 msgr2=0x7fd0d003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:47.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.570+0000 7fd0eb801640 1 --2- 172.21.15.165:0/745388516 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd0d00392a0 0x7fd0d003b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40098c0 tx=0x7fd0d4006db0 comp rx=0 tx=0).stop 2024-09-15T22:07:47.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.570+0000 7fd0eb801640 1 -- 172.21.15.165:0/745388516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0e4106540 msgr2=0x7fd0e4198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:47.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.570+0000 7fd0eb801640 1 --2- 172.21.15.165:0/745388516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0e4106540 0x7fd0e4198090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00058e0 tx=0x7fd0e00045e0 comp rx=0 tx=0).stop 2024-09-15T22:07:47.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.570+0000 7fd0eb801640 1 -- 172.21.15.165:0/745388516 shutdown_connections 2024-09-15T22:07:47.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.570+0000 7fd0eb801640 1 --2- 172.21.15.165:0/745388516 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd0d00392a0 0x7fd0d003b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:47.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.570+0000 7fd0eb801640 1 --2- 172.21.15.165:0/745388516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0e4106540 0x7fd0e4198090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:47.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.570+0000 7fd0eb801640 1 -- 172.21.15.165:0/745388516 >> 172.21.15.165:0/745388516 conn(0x7fd0e4077310 msgr2=0x7fd0e40feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:47.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.570+0000 7fd0eb801640 1 -- 172.21.15.165:0/745388516 shutdown_connections 2024-09-15T22:07:47.572 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:47.570+0000 7fd0eb801640 1 -- 172.21.15.165:0/745388516 wait complete. 2024-09-15T22:07:47.844 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:47 smithi165 systemd[1]: Starting Ceph mon.c for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:07:48.355 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 podman[35531]: 2024-09-15 22:07:48.311643841 +0000 UTC m=+0.111215398 container create 4efa1b799cd6b52089ba7f3827ce8e35b00fcc28385eb44bfe0b66b9b48e3bc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, RELEASE=squid-8921c8e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:07:48.355 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 podman[35531]: 2024-09-15 22:07:48.217218342 +0000 UTC m=+0.016789907 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:07:48.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:48 smithi045 ceph-mon[31180]: from='client.? 172.21.15.165:0/745388516' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:07:48.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 podman[35531]: 2024-09-15 22:07:48.610595857 +0000 UTC m=+0.410167419 container init 4efa1b799cd6b52089ba7f3827ce8e35b00fcc28385eb44bfe0b66b9b48e3bc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-c, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:07:48.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 podman[35531]: 2024-09-15 22:07:48.614068292 +0000 UTC m=+0.413639852 container start 4efa1b799cd6b52089ba7f3827ce8e35b00fcc28385eb44bfe0b66b9b48e3bc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-c, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-15T22:07:48.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T22:07:48.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T22:07:48.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: pidfile_write: ignore empty --pid-file 2024-09-15T22:07:48.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: load: jerasure load: lrc 2024-09-15T22:07:48.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: RocksDB version: 7.9.2 2024-09-15T22:07:48.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Git sha 0 2024-09-15T22:07:48.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T22:07:48.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: DB SUMMARY 2024-09-15T22:07:48.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: DB Session ID: YUN0VS71NUNLQZDQQH8O 2024-09-15T22:07:48.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: CURRENT file: CURRENT 2024-09-15T22:07:48.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T22:07:48.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-15T22:07:48.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-15T22:07:48.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-15T22:07:48.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.error_if_exists: 0 2024-09-15T22:07:48.967 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.create_if_missing: 0 2024-09-15T22:07:48.967 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.paranoid_checks: 1 2024-09-15T22:07:48.967 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T22:07:48.967 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T22:07:48.967 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T22:07:48.967 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.env: 0x55d70e9db940 2024-09-15T22:07:48.967 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T22:07:48.967 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.info_log: 0x55d70f4df6e0 2024-09-15T22:07:48.967 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T22:07:48.968 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.statistics: (nil) 2024-09-15T22:07:48.968 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.use_fsync: 0 2024-09-15T22:07:48.968 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_log_file_size: 0 2024-09-15T22:07:48.968 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T22:07:48.968 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T22:07:48.969 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T22:07:48.969 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T22:07:48.969 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.allow_fallocate: 1 2024-09-15T22:07:48.969 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T22:07:48.969 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T22:07:48.969 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.use_direct_reads: 0 2024-09-15T22:07:48.969 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T22:07:48.969 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T22:07:48.969 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.db_log_dir: 2024-09-15T22:07:48.969 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.wal_dir: 2024-09-15T22:07:48.969 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T22:07:48.969 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.write_buffer_manager: 0x55d70f4eedc0 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T22:07:48.970 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T22:07:48.971 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T22:07:48.971 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.unordered_write: 0 2024-09-15T22:07:48.971 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T22:07:48.971 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T22:07:48.971 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T22:07:48.971 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T22:07:48.971 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.row_cache: None 2024-09-15T22:07:48.971 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.wal_filter: None 2024-09-15T22:07:48.971 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T22:07:48.971 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T22:07:48.971 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.two_write_queues: 0 2024-09-15T22:07:48.971 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T22:07:48.971 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.wal_compression: 0 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.atomic_flush: 0 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.log_readahead_size: 0 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_background_jobs: 2 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_background_compactions: -1 2024-09-15T22:07:48.972 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_subcompactions: 1 2024-09-15T22:07:48.973 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T22:07:48.973 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T22:07:48.973 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T22:07:48.973 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T22:07:48.973 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T22:07:48.973 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T22:07:48.973 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T22:07:48.973 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T22:07:48.973 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_open_files: -1 2024-09-15T22:07:48.973 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T22:07:48.973 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T22:07:48.973 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T22:07:48.973 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T22:07:48.974 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_background_flushes: -1 2024-09-15T22:07:48.974 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Compression algorithms supported: 2024-09-15T22:07:48.974 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: kZSTD supported: 0 2024-09-15T22:07:48.974 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: kXpressCompression supported: 0 2024-09-15T22:07:48.974 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: kBZip2Compression supported: 0 2024-09-15T22:07:48.974 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T22:07:48.974 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: kLZ4Compression supported: 1 2024-09-15T22:07:48.974 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: kZlibCompression supported: 1 2024-09-15T22:07:48.974 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T22:07:48.974 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: kSnappyCompression supported: 1 2024-09-15T22:07:48.974 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T22:07:48.974 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T22:07:48.974 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-15T22:07:48.975 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T22:07:48.975 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T22:07:48.975 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.merge_operator: 2024-09-15T22:07:48.975 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compaction_filter: None 2024-09-15T22:07:48.975 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T22:07:48.975 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T22:07:48.975 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T22:07:48.975 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T22:07:48.975 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d70f4df320) 2024-09-15T22:07:48.975 INFO:journalctl@ceph.mon.c.smithi165.stdout: cache_index_and_filter_blocks: 1 2024-09-15T22:07:48.975 INFO:journalctl@ceph.mon.c.smithi165.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T22:07:48.975 INFO:journalctl@ceph.mon.c.smithi165.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T22:07:48.975 INFO:journalctl@ceph.mon.c.smithi165.stdout: pin_top_level_index_and_filter: 1 2024-09-15T22:07:48.976 INFO:journalctl@ceph.mon.c.smithi165.stdout: index_type: 0 2024-09-15T22:07:48.976 INFO:journalctl@ceph.mon.c.smithi165.stdout: data_block_index_type: 0 2024-09-15T22:07:48.976 INFO:journalctl@ceph.mon.c.smithi165.stdout: index_shortening: 1 2024-09-15T22:07:48.976 INFO:journalctl@ceph.mon.c.smithi165.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T22:07:48.976 INFO:journalctl@ceph.mon.c.smithi165.stdout: checksum: 4 2024-09-15T22:07:48.976 INFO:journalctl@ceph.mon.c.smithi165.stdout: no_block_cache: 0 2024-09-15T22:07:48.976 INFO:journalctl@ceph.mon.c.smithi165.stdout: block_cache: 0x55d70f4d31f0 2024-09-15T22:07:48.976 INFO:journalctl@ceph.mon.c.smithi165.stdout: block_cache_name: BinnedLRUCache 2024-09-15T22:07:48.976 INFO:journalctl@ceph.mon.c.smithi165.stdout: block_cache_options: 2024-09-15T22:07:48.976 INFO:journalctl@ceph.mon.c.smithi165.stdout: capacity : 536870912 2024-09-15T22:07:48.976 INFO:journalctl@ceph.mon.c.smithi165.stdout: num_shard_bits : 4 2024-09-15T22:07:48.976 INFO:journalctl@ceph.mon.c.smithi165.stdout: strict_capacity_limit : 0 2024-09-15T22:07:48.976 INFO:journalctl@ceph.mon.c.smithi165.stdout: high_pri_pool_ratio: 0.000 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: block_cache_compressed: (nil) 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: persistent_cache: (nil) 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: block_size: 4096 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: block_size_deviation: 10 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: block_restart_interval: 16 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: index_block_restart_interval: 1 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: metadata_block_size: 4096 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: partition_filters: 0 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: use_delta_encoding: 1 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: filter_policy: bloomfilter 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: whole_key_filtering: 1 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: verify_compression: 0 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: read_amp_bytes_per_bit: 0 2024-09-15T22:07:48.977 INFO:journalctl@ceph.mon.c.smithi165.stdout: format_version: 5 2024-09-15T22:07:48.978 INFO:journalctl@ceph.mon.c.smithi165.stdout: enable_index_compression: 1 2024-09-15T22:07:48.978 INFO:journalctl@ceph.mon.c.smithi165.stdout: block_align: 0 2024-09-15T22:07:48.978 INFO:journalctl@ceph.mon.c.smithi165.stdout: max_auto_readahead_size: 262144 2024-09-15T22:07:48.978 INFO:journalctl@ceph.mon.c.smithi165.stdout: prepopulate_block_cache: 0 2024-09-15T22:07:48.978 INFO:journalctl@ceph.mon.c.smithi165.stdout: initial_auto_readahead_size: 8192 2024-09-15T22:07:48.978 INFO:journalctl@ceph.mon.c.smithi165.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T22:07:48.978 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T22:07:48.978 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T22:07:48.978 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compression: NoCompression 2024-09-15T22:07:48.978 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T22:07:48.978 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T22:07:48.978 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T22:07:48.978 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.num_levels: 7 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T22:07:48.979 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T22:07:48.980 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T22:07:48.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T22:07:48.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T22:07:48.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T22:07:48.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T22:07:48.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T22:07:48.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T22:07:48.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T22:07:48.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T22:07:48.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T22:07:48.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T22:07:48.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T22:07:48.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T22:07:48.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.inplace_update_support: 0 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T22:07:48.982 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T22:07:48.983 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T22:07:48.983 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T22:07:48.983 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.bloom_locality: 0 2024-09-15T22:07:48.983 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.max_successive_merges: 0 2024-09-15T22:07:48.983 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T22:07:48.983 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T22:07:48.983 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T22:07:48.983 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T22:07:48.983 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.ttl: 2592000 2024-09-15T22:07:48.983 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T22:07:48.983 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T22:07:48.984 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T22:07:48.984 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.enable_blob_files: false 2024-09-15T22:07:48.984 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.min_blob_size: 0 2024-09-15T22:07:48.984 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T22:07:48.984 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T22:07:48.984 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T22:07:48.984 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b0746afc-5c0f-48f5-9a08-62085a540aff 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726438068641722, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726438068642139, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726438068, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b0746afc-5c0f-48f5-9a08-62085a540aff", "db_session_id": "YUN0VS71NUNLQZDQQH8O", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726438068642233, "job": 1, "event": "recovery_finished"} 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T22:07:48.985 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d70f500e00 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: DB pointer 0x55d70f5fc000 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout: ** DB Stats ** 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout: 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout: ** Compaction Stats [default] ** 2024-09-15T22:07:48.986 INFO:journalctl@ceph.mon.c.smithi165.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: ** Compaction Stats [default] ** 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T22:07:48.987 INFO:journalctl@ceph.mon.c.smithi165.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T22:07:48.988 INFO:journalctl@ceph.mon.c.smithi165.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T22:07:48.988 INFO:journalctl@ceph.mon.c.smithi165.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T22:07:48.988 INFO:journalctl@ceph.mon.c.smithi165.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T22:07:48.988 INFO:journalctl@ceph.mon.c.smithi165.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:07:48.988 INFO:journalctl@ceph.mon.c.smithi165.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:07:48.988 INFO:journalctl@ceph.mon.c.smithi165.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T22:07:48.988 INFO:journalctl@ceph.mon.c.smithi165.stdout: Block cache BinnedLRUCache@0x55d70f4d31f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-15T22:07:48.988 INFO:journalctl@ceph.mon.c.smithi165.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-15T22:07:48.988 INFO:journalctl@ceph.mon.c.smithi165.stdout: 2024-09-15T22:07:48.988 INFO:journalctl@ceph.mon.c.smithi165.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T22:07:48.988 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-15T22:07:48.988 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: using public_addr v2:172.21.15.165:0/0 -> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] 2024-09-15T22:07:48.988 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: starting mon.c rank -1 at public addrs [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] at bind addrs [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(???) e0 preinit fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(synchronizing).mds e1 new map 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout: e1 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout: btime 2024-09-15T22:06:19:492132+0000 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout: legacy client fscid: -1 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout: 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout: No filesystems configured 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-15T22:07:48.989 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/69374676' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/69374676' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:48.990 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi165", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:07:48.991 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi045:172.21.15.45=a;smithi100:172.21.15.100=b;smithi165:172.21.15.165=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:48.992 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: Saving service mon spec with placement smithi045:172.21.15.45=a;smithi100:172.21.15.100=b;smithi165:172.21.15.165=c;count:3 2024-09-15T22:07:48.992 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: Deploying daemon mon.c on smithi165 2024-09-15T22:07:48.992 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:48.992 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: from='client.? 172.21.15.165:0/745388516' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:07:48.992 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 ceph-mon[35551]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-15T22:07:48.992 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 bash[35531]: 4efa1b799cd6b52089ba7f3827ce8e35b00fcc28385eb44bfe0b66b9b48e3bc9 2024-09-15T22:07:48.992 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:48 smithi165 systemd[1]: Started Ceph mon.c for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:07:49.104 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:07:49.105 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:07:49.356 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:07:53.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:53.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:07:53.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: mon.a calling monitor election 2024-09-15T22:07:53.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:53.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:53.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:53.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: mon.c calling monitor election 2024-09-15T22:07:53.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:53.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:53.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:53.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:53.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:07:53.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: monmap epoch 2 2024-09-15T22:07:53.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:07:53.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: last_changed 2024-09-15T22:07:48.672984+0000 2024-09-15T22:07:53.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: created 2024-09-15T22:06:16.451807+0000 2024-09-15T22:07:53.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: min_mon_release 19 (squid) 2024-09-15T22:07:53.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: election_strategy: 1 2024-09-15T22:07:53.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-09-15T22:07:53.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.c 2024-09-15T22:07:53.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: fsmap 2024-09-15T22:07:53.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:07:53.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: mgrmap e13: x(active, since 38s) 2024-09-15T22:07:53.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: overall HEALTH_OK 2024-09-15T22:07:53.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:53.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:53.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:53.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:07:53.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:54.196 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.194+0000 7fe694db2640 1 -- 172.21.15.165:0/1066104693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c003530 msgr2=0x7fe67c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:54.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.194+0000 7fe694db2640 1 --2- 172.21.15.165:0/1066104693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c003530 0x7fe67c0059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe6901016c0 tx=0x7fe67802c490 comp rx=0 tx=0).stop 2024-09-15T22:07:54.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.195+0000 7fe694db2640 1 -- 172.21.15.165:0/1066104693 shutdown_connections 2024-09-15T22:07:54.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.195+0000 7fe694db2640 1 --2- 172.21.15.165:0/1066104693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c003530 0x7fe67c0059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:54.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.195+0000 7fe694db2640 1 -- 172.21.15.165:0/1066104693 >> 172.21.15.165:0/1066104693 conn(0x7fe6900fc280 msgr2=0x7fe6900fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:54.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.195+0000 7fe694db2640 1 -- 172.21.15.165:0/1066104693 shutdown_connections 2024-09-15T22:07:54.197 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.195+0000 7fe694db2640 1 -- 172.21.15.165:0/1066104693 wait complete. 2024-09-15T22:07:54.197 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:54.197 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: mon.a calling monitor election 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: mon.c calling monitor election 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: monmap epoch 2 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: last_changed 2024-09-15T22:07:48.672984+0000 2024-09-15T22:07:54.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: created 2024-09-15T22:06:16.451807+0000 2024-09-15T22:07:54.199 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: min_mon_release 19 (squid) 2024-09-15T22:07:54.199 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: election_strategy: 1 2024-09-15T22:07:54.199 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-09-15T22:07:54.199 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.c 2024-09-15T22:07:54.199 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: fsmap 2024-09-15T22:07:54.199 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:07:54.199 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: mgrmap e13: x(active, since 38s) 2024-09-15T22:07:54.199 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: overall HEALTH_OK 2024-09-15T22:07:54.199 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:54.199 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:54.199 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:54.199 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:07:54.199 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:54.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.196+0000 7fe694db2640 1 Processor -- start 2024-09-15T22:07:54.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.196+0000 7fe694db2640 1 -- start start 2024-09-15T22:07:54.201 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.196+0000 7fe694db2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c003530 0x7fe690197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:54.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.196+0000 7fe694db2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6901978c0 0x7fe69019bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:54.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.196+0000 7fe694db2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901087e0 con 0x7fe67c003530 2024-09-15T22:07:54.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.196+0000 7fe694db2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe690108660 con 0x7fe6901978c0 2024-09-15T22:07:54.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.197+0000 7fe68dd9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6901978c0 0x7fe69019bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:54.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.197+0000 7fe68e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c003530 0x7fe690197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:54.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.197+0000 7fe68dd9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6901978c0 0x7fe69019bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:50134/0 (socket says 172.21.15.165:50134) 2024-09-15T22:07:54.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.197+0000 7fe68dd9b640 1 -- 172.21.15.165:0/1152535879 learned_addr learned my addr 172.21.15.165:0/1152535879 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-15T22:07:54.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.197+0000 7fe68dd9b640 1 -- 172.21.15.165:0/1152535879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6901978c0 msgr2=0x7fe69019bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-15T22:07:54.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.197+0000 7fe68dd9b640 1 -- 172.21.15.165:0/1152535879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6901978c0 msgr2=0x7fe69019bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:07:54.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.197+0000 7fe68dd9b640 1 --2- 172.21.15.165:0/1152535879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6901978c0 0x7fe69019bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:07:54.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.197+0000 7fe68dd9b640 1 --2- 172.21.15.165:0/1152535879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6901978c0 0x7fe69019bc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:07:54.202 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.197+0000 7fe68e59c640 1 -- 172.21.15.165:0/1152535879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6901978c0 msgr2=0x7fe69019bc50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.197+0000 7fe68e59c640 1 --2- 172.21.15.165:0/1152535879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6901978c0 0x7fe69019bc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.197+0000 7fe68e59c640 1 -- 172.21.15.165:0/1152535879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe690197ee0 con 0x7fe67c003530 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.197+0000 7fe68e59c640 1 --2- 172.21.15.165:0/1152535879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c003530 0x7fe690197380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe678005f30 tx=0x7fe6780329b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.198+0000 7fe6877fe640 1 -- 172.21.15.165:0/1152535879 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe678038040 con 0x7fe67c003530 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.198+0000 7fe6877fe640 1 -- 172.21.15.165:0/1152535879 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe678032e70 con 0x7fe67c003530 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.198+0000 7fe694db2640 1 -- 172.21.15.165:0/1152535879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69019c190 con 0x7fe67c003530 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.198+0000 7fe6877fe640 1 -- 172.21.15.165:0/1152535879 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe6780049f0 con 0x7fe67c003530 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.198+0000 7fe694db2640 1 -- 172.21.15.165:0/1152535879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe69019c750 con 0x7fe67c003530 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.199+0000 7fe6877fe640 1 -- 172.21.15.165:0/1152535879 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe678043020 con 0x7fe67c003530 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.199+0000 7fe694db2640 1 -- 172.21.15.165:0/1152535879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe69019ca60 con 0x7fe67c003530 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.199+0000 7fe6877fe640 1 --2- 172.21.15.165:0/1152535879 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe670039090 0x7fe67003b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.199+0000 7fe6877fe640 1 -- 172.21.15.165:0/1152535879 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe67806e8a0 con 0x7fe67c003530 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.200+0000 7fe68dd9b640 1 --2- 172.21.15.165:0/1152535879 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe670039090 0x7fe67003b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:54.203 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.200+0000 7fe68dd9b640 1 --2- 172.21.15.165:0/1152535879 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe670039090 0x7fe67003b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe680009100 tx=0x7fe680008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:54.206 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.205+0000 7fe6877fe640 1 -- 172.21.15.165:0/1152535879 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe67804a020 con 0x7fe67c003530 2024-09-15T22:07:54.442 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.441+0000 7fe694db2640 1 -- 172.21.15.165:0/1152535879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe6901986e0 con 0x7fe67c003530 2024-09-15T22:07:54.443 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.442+0000 7fe6877fe640 1 -- 172.21.15.165:0/1152535879 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fe67804cbc0 con 0x7fe67c003530 2024-09-15T22:07:54.443 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:07:54.444 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":2,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","modified":"2024-09-15T22:07:48.672984Z","created":"2024-09-15T22:06:16.451807Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:3300","nonce":0},{"type":"v1","addr":"172.21.15.165:6789","nonce":0}]},"addr":"172.21.15.165:6789/0","public_addr":"172.21.15.165:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:07:54.444 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 2 2024-09-15T22:07:54.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.444+0000 7fe694db2640 1 -- 172.21.15.165:0/1152535879 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe670039090 msgr2=0x7fe67003b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:54.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.444+0000 7fe694db2640 1 --2- 172.21.15.165:0/1152535879 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe670039090 0x7fe67003b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe680009100 tx=0x7fe680008040 comp rx=0 tx=0).stop 2024-09-15T22:07:54.445 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.444+0000 7fe694db2640 1 -- 172.21.15.165:0/1152535879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c003530 msgr2=0x7fe690197380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:54.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.444+0000 7fe694db2640 1 --2- 172.21.15.165:0/1152535879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c003530 0x7fe690197380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe678005f30 tx=0x7fe6780329b0 comp rx=0 tx=0).stop 2024-09-15T22:07:54.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.444+0000 7fe694db2640 1 -- 172.21.15.165:0/1152535879 shutdown_connections 2024-09-15T22:07:54.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.444+0000 7fe694db2640 1 --2- 172.21.15.165:0/1152535879 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe670039090 0x7fe67003b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:54.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.444+0000 7fe694db2640 1 --2- 172.21.15.165:0/1152535879 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe6901978c0 0x7fe69019bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:54.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.444+0000 7fe694db2640 1 --2- 172.21.15.165:0/1152535879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67c003530 0x7fe690197380 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:54.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.444+0000 7fe694db2640 1 -- 172.21.15.165:0/1152535879 >> 172.21.15.165:0/1152535879 conn(0x7fe6900fc280 msgr2=0x7fe690104c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:54.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.444+0000 7fe694db2640 1 -- 172.21.15.165:0/1152535879 shutdown_connections 2024-09-15T22:07:54.446 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:54.444+0000 7fe694db2640 1 -- 172.21.15.165:0/1152535879 wait complete. 2024-09-15T22:07:55.004 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:54 smithi165 ceph-mon[35551]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:55.004 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:54 smithi165 ceph-mon[35551]: Deploying daemon mon.b on smithi100 2024-09-15T22:07:55.004 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:54 smithi165 ceph-mon[35551]: from='client.? 172.21.15.165:0/1152535879' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:07:55.004 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:55.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:54 smithi045 ceph-mon[31180]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:55.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:54 smithi045 ceph-mon[31180]: Deploying daemon mon.b on smithi100 2024-09-15T22:07:55.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:54 smithi045 ceph-mon[31180]: from='client.? 172.21.15.165:0/1152535879' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:07:55.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:56.006 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:07:56.007 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:07:56.260 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:07:56.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.693+0000 7f3cd86f9640 1 -- 172.21.15.165:0/2316801557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cd0106630 msgr2=0x7f3cd0106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:56.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.693+0000 7f3cd86f9640 1 --2- 172.21.15.165:0/2316801557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cd0106630 0x7f3cd0106a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009880 tx=0x7f3cc002a5d0 comp rx=0 tx=0).stop 2024-09-15T22:07:56.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.693+0000 7f3cd86f9640 1 -- 172.21.15.165:0/2316801557 shutdown_connections 2024-09-15T22:07:56.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.693+0000 7f3cd86f9640 1 --2- 172.21.15.165:0/2316801557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cd0106630 0x7f3cd0106a10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:56.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.693+0000 7f3cd86f9640 1 -- 172.21.15.165:0/2316801557 >> 172.21.15.165:0/2316801557 conn(0x7f3cd00fc220 msgr2=0x7f3cd00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:56.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.693+0000 7f3cd86f9640 1 -- 172.21.15.165:0/2316801557 shutdown_connections 2024-09-15T22:07:56.707 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.693+0000 7f3cd86f9640 1 -- 172.21.15.165:0/2316801557 wait complete. 2024-09-15T22:07:56.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.694+0000 7f3cd86f9640 1 Processor -- start 2024-09-15T22:07:56.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.694+0000 7f3cd86f9640 1 -- start start 2024-09-15T22:07:56.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.694+0000 7f3cd86f9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd0106630 0x7f3cd0196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:56.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.694+0000 7f3cd86f9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cd0196940 0x7f3cd019acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:56.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.694+0000 7f3cd86f9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd010ada0 con 0x7f3cd0196940 2024-09-15T22:07:56.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.694+0000 7f3cd86f9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd010ac20 con 0x7f3cd0106630 2024-09-15T22:07:56.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.694+0000 7f3cd6495640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd0106630 0x7f3cd0196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:56.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.694+0000 7f3cd6495640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd0106630 0x7f3cd0196400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:50146/0 (socket says 172.21.15.165:50146) 2024-09-15T22:07:56.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.694+0000 7f3cd6495640 1 -- 172.21.15.165:0/3542708893 learned_addr learned my addr 172.21.15.165:0/3542708893 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-15T22:07:56.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cd6495640 1 -- 172.21.15.165:0/3542708893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd0106630 msgr2=0x7f3cd0196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-15T22:07:56.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cd6495640 1 -- 172.21.15.165:0/3542708893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd0106630 msgr2=0x7f3cd0196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:07:56.708 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cd6495640 1 --2- 172.21.15.165:0/3542708893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd0106630 0x7f3cd0196400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:07:56.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cd6495640 1 --2- 172.21.15.165:0/3542708893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd0106630 0x7f3cd0196400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:07:56.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cd5c94640 1 --2- 172.21.15.165:0/3542708893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cd0196940 0x7f3cd019acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:56.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cd5c94640 1 -- 172.21.15.165:0/3542708893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd0106630 msgr2=0x7f3cd0196400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:07:56.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cd5c94640 1 --2- 172.21.15.165:0/3542708893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd0106630 0x7f3cd0196400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:56.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cd5c94640 1 -- 172.21.15.165:0/3542708893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd0196f60 con 0x7f3cd0196940 2024-09-15T22:07:56.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cd5c94640 1 --2- 172.21.15.165:0/3542708893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cd0196940 0x7f3cd019acd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00b3d0 tx=0x7f3ccc00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:56.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cc77fe640 1 -- 172.21.15.165:0/3542708893 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3ccc011630 con 0x7f3cd0196940 2024-09-15T22:07:56.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cc77fe640 1 -- 172.21.15.165:0/3542708893 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3ccc011cd0 con 0x7f3cd0196940 2024-09-15T22:07:56.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cd86f9640 1 -- 172.21.15.165:0/3542708893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd019b210 con 0x7f3cd0196940 2024-09-15T22:07:56.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cc77fe640 1 -- 172.21.15.165:0/3542708893 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3ccc00f2e0 con 0x7f3cd0196940 2024-09-15T22:07:56.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.695+0000 7f3cd86f9640 1 -- 172.21.15.165:0/3542708893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd019b750 con 0x7f3cd0196940 2024-09-15T22:07:56.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.696+0000 7f3cc77fe640 1 -- 172.21.15.165:0/3542708893 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3ccc018020 con 0x7f3cd0196940 2024-09-15T22:07:56.709 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.696+0000 7f3cd86f9640 1 -- 172.21.15.165:0/3542708893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd0101ca0 con 0x7f3cd0196940 2024-09-15T22:07:56.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.696+0000 7f3cc77fe640 1 --2- 172.21.15.165:0/3542708893 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3cbc039040 0x7f3cbc03b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:07:56.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.696+0000 7f3cc77fe640 1 -- 172.21.15.165:0/3542708893 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3ccc04bfa0 con 0x7f3cd0196940 2024-09-15T22:07:56.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.697+0000 7f3cd6495640 1 --2- 172.21.15.165:0/3542708893 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3cbc039040 0x7f3cbc03b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:07:56.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.697+0000 7f3cd6495640 1 --2- 172.21.15.165:0/3542708893 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3cbc039040 0x7f3cbc03b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00096c0 tx=0x7f3cc002aad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:07:56.710 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.702+0000 7f3cc77fe640 1 -- 172.21.15.165:0/3542708893 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ccc01f020 con 0x7f3cd0196940 2024-09-15T22:07:56.933 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.932+0000 7f3cd86f9640 1 -- 172.21.15.165:0/3542708893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3cd019ba60 con 0x7f3cd0196940 2024-09-15T22:07:56.934 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.933+0000 7f3cc77fe640 1 -- 172.21.15.165:0/3542708893 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f3ccc0172c0 con 0x7f3cd0196940 2024-09-15T22:07:56.934 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:07:56.934 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":2,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","modified":"2024-09-15T22:07:48.672984Z","created":"2024-09-15T22:06:16.451807Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:3300","nonce":0},{"type":"v1","addr":"172.21.15.165:6789","nonce":0}]},"addr":"172.21.15.165:6789/0","public_addr":"172.21.15.165:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:07:56.934 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 2 2024-09-15T22:07:56.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.935+0000 7f3cd86f9640 1 -- 172.21.15.165:0/3542708893 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3cbc039040 msgr2=0x7f3cbc03b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:56.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.935+0000 7f3cd86f9640 1 --2- 172.21.15.165:0/3542708893 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3cbc039040 0x7f3cbc03b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00096c0 tx=0x7f3cc002aad0 comp rx=0 tx=0).stop 2024-09-15T22:07:56.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.935+0000 7f3cd86f9640 1 -- 172.21.15.165:0/3542708893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cd0196940 msgr2=0x7f3cd019acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:07:56.936 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.935+0000 7f3cd86f9640 1 --2- 172.21.15.165:0/3542708893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cd0196940 0x7f3cd019acd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00b3d0 tx=0x7f3ccc00b890 comp rx=0 tx=0).stop 2024-09-15T22:07:56.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.935+0000 7f3cd86f9640 1 -- 172.21.15.165:0/3542708893 shutdown_connections 2024-09-15T22:07:56.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.935+0000 7f3cd86f9640 1 --2- 172.21.15.165:0/3542708893 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3cbc039040 0x7f3cbc03b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:56.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.935+0000 7f3cd86f9640 1 --2- 172.21.15.165:0/3542708893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3cd0196940 0x7f3cd019acd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:56.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.935+0000 7f3cd86f9640 1 --2- 172.21.15.165:0/3542708893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3cd0106630 0x7f3cd0196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:07:56.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.935+0000 7f3cd86f9640 1 -- 172.21.15.165:0/3542708893 >> 172.21.15.165:0/3542708893 conn(0x7f3cd00fc220 msgr2=0x7f3cd00fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:07:56.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.935+0000 7f3cd86f9640 1 -- 172.21.15.165:0/3542708893 shutdown_connections 2024-09-15T22:07:56.937 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:07:56.935+0000 7f3cd86f9640 1 -- 172.21.15.165:0/3542708893 wait complete. 2024-09-15T22:07:56.945 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:07:56 smithi165 ceph-mon[35551]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:57.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:07:56 smithi045 ceph-mon[31180]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:57.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 podman[35299]: 2024-09-15 22:07:57.096511616 +0000 UTC m=+0.016309255 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:07:57.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 podman[35299]: 2024-09-15 22:07:57.364715206 +0000 UTC m=+0.284512842 container init c6dc590835aa082e70518a9cca9dc53ba2d4d477d502ca37f1ea28deb1bd5376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-15T22:07:57.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 podman[35299]: 2024-09-15 22:07:57.36792707 +0000 UTC m=+0.287724697 container start c6dc590835aa082e70518a9cca9dc53ba2d4d477d502ca37f1ea28deb1bd5376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-15T22:07:57.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T22:07:57.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T22:07:57.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: pidfile_write: ignore empty --pid-file 2024-09-15T22:07:57.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: load: jerasure load: lrc 2024-09-15T22:07:57.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: RocksDB version: 7.9.2 2024-09-15T22:07:57.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Git sha 0 2024-09-15T22:07:57.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T22:07:57.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: DB SUMMARY 2024-09-15T22:07:57.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: DB Session ID: O1QZ19WEJSPK59RTFYV9 2024-09-15T22:07:57.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: CURRENT file: CURRENT 2024-09-15T22:07:57.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T22:07:57.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-15T22:07:57.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-15T22:07:57.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-15T22:07:57.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.error_if_exists: 0 2024-09-15T22:07:57.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.create_if_missing: 0 2024-09-15T22:07:57.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.paranoid_checks: 1 2024-09-15T22:07:57.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T22:07:57.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T22:07:57.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T22:07:57.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.env: 0x55e3b060b940 2024-09-15T22:07:57.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T22:07:57.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.info_log: 0x55e3b21136e0 2024-09-15T22:07:57.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T22:07:57.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.statistics: (nil) 2024-09-15T22:07:57.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.use_fsync: 0 2024-09-15T22:07:57.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_log_file_size: 0 2024-09-15T22:07:57.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T22:07:57.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T22:07:57.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T22:07:57.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T22:07:57.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.allow_fallocate: 1 2024-09-15T22:07:57.748 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T22:07:57.748 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T22:07:57.748 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.use_direct_reads: 0 2024-09-15T22:07:57.748 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T22:07:57.748 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T22:07:57.748 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.db_log_dir: 2024-09-15T22:07:57.748 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.wal_dir: 2024-09-15T22:07:57.748 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T22:07:57.748 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T22:07:57.748 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T22:07:57.748 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T22:07:57.748 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T22:07:57.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T22:07:57.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T22:07:57.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T22:07:57.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.write_buffer_manager: 0x55e3b2122dc0 2024-09-15T22:07:57.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T22:07:57.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T22:07:57.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T22:07:57.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T22:07:57.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T22:07:57.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T22:07:57.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T22:07:57.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T22:07:57.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.unordered_write: 0 2024-09-15T22:07:57.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T22:07:57.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T22:07:57.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T22:07:57.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T22:07:57.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.row_cache: None 2024-09-15T22:07:57.750 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.wal_filter: None 2024-09-15T22:07:57.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T22:07:57.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T22:07:57.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.two_write_queues: 0 2024-09-15T22:07:57.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T22:07:57.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.wal_compression: 0 2024-09-15T22:07:57.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.atomic_flush: 0 2024-09-15T22:07:57.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T22:07:57.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T22:07:57.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T22:07:57.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.log_readahead_size: 0 2024-09-15T22:07:57.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T22:07:57.752 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T22:07:57.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T22:07:57.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T22:07:57.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T22:07:57.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T22:07:57.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T22:07:57.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_background_jobs: 2 2024-09-15T22:07:57.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_background_compactions: -1 2024-09-15T22:07:57.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_subcompactions: 1 2024-09-15T22:07:57.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T22:07:57.753 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T22:07:57.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T22:07:57.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T22:07:57.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T22:07:57.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T22:07:57.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T22:07:57.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T22:07:57.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_open_files: -1 2024-09-15T22:07:57.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T22:07:57.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T22:07:57.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T22:07:57.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T22:07:57.754 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_background_flushes: -1 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Compression algorithms supported: 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: kZSTD supported: 0 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: kXpressCompression supported: 0 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: kBZip2Compression supported: 0 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: kLZ4Compression supported: 1 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: kZlibCompression supported: 1 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: kSnappyCompression supported: 1 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T22:07:57.755 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T22:07:57.756 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.merge_operator: 2024-09-15T22:07:57.756 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compaction_filter: None 2024-09-15T22:07:57.756 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T22:07:57.756 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T22:07:57.756 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T22:07:57.756 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T22:07:57.756 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e3b2113320) 2024-09-15T22:07:57.756 INFO:journalctl@ceph.mon.b.smithi100.stdout: cache_index_and_filter_blocks: 1 2024-09-15T22:07:57.756 INFO:journalctl@ceph.mon.b.smithi100.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T22:07:57.756 INFO:journalctl@ceph.mon.b.smithi100.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T22:07:57.756 INFO:journalctl@ceph.mon.b.smithi100.stdout: pin_top_level_index_and_filter: 1 2024-09-15T22:07:57.756 INFO:journalctl@ceph.mon.b.smithi100.stdout: index_type: 0 2024-09-15T22:07:57.756 INFO:journalctl@ceph.mon.b.smithi100.stdout: data_block_index_type: 0 2024-09-15T22:07:57.757 INFO:journalctl@ceph.mon.b.smithi100.stdout: index_shortening: 1 2024-09-15T22:07:57.757 INFO:journalctl@ceph.mon.b.smithi100.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T22:07:57.757 INFO:journalctl@ceph.mon.b.smithi100.stdout: checksum: 4 2024-09-15T22:07:57.757 INFO:journalctl@ceph.mon.b.smithi100.stdout: no_block_cache: 0 2024-09-15T22:07:57.757 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_cache: 0x55e3b21071f0 2024-09-15T22:07:57.757 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_cache_name: BinnedLRUCache 2024-09-15T22:07:57.757 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_cache_options: 2024-09-15T22:07:57.757 INFO:journalctl@ceph.mon.b.smithi100.stdout: capacity : 536870912 2024-09-15T22:07:57.757 INFO:journalctl@ceph.mon.b.smithi100.stdout: num_shard_bits : 4 2024-09-15T22:07:57.757 INFO:journalctl@ceph.mon.b.smithi100.stdout: strict_capacity_limit : 0 2024-09-15T22:07:57.757 INFO:journalctl@ceph.mon.b.smithi100.stdout: high_pri_pool_ratio: 0.000 2024-09-15T22:07:57.757 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_cache_compressed: (nil) 2024-09-15T22:07:57.758 INFO:journalctl@ceph.mon.b.smithi100.stdout: persistent_cache: (nil) 2024-09-15T22:07:57.758 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_size: 4096 2024-09-15T22:07:57.758 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_size_deviation: 10 2024-09-15T22:07:57.758 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_restart_interval: 16 2024-09-15T22:07:57.758 INFO:journalctl@ceph.mon.b.smithi100.stdout: index_block_restart_interval: 1 2024-09-15T22:07:57.758 INFO:journalctl@ceph.mon.b.smithi100.stdout: metadata_block_size: 4096 2024-09-15T22:07:57.758 INFO:journalctl@ceph.mon.b.smithi100.stdout: partition_filters: 0 2024-09-15T22:07:57.758 INFO:journalctl@ceph.mon.b.smithi100.stdout: use_delta_encoding: 1 2024-09-15T22:07:57.758 INFO:journalctl@ceph.mon.b.smithi100.stdout: filter_policy: bloomfilter 2024-09-15T22:07:57.758 INFO:journalctl@ceph.mon.b.smithi100.stdout: whole_key_filtering: 1 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout: verify_compression: 0 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout: read_amp_bytes_per_bit: 0 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout: format_version: 5 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout: enable_index_compression: 1 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_align: 0 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout: max_auto_readahead_size: 262144 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout: prepopulate_block_cache: 0 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout: initial_auto_readahead_size: 8192 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compression: NoCompression 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T22:07:57.759 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.num_levels: 7 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:07:57.760 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T22:07:57.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T22:07:57.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T22:07:57.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T22:07:57.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T22:07:57.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T22:07:57.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T22:07:57.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T22:07:57.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T22:07:57.761 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T22:07:57.762 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T22:07:57.762 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T22:07:57.762 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T22:07:57.762 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T22:07:57.762 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T22:07:57.762 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T22:07:57.762 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T22:07:57.762 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T22:07:57.762 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T22:07:57.762 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T22:07:57.763 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T22:07:57.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T22:07:57.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T22:07:57.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T22:07:57.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T22:07:57.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T22:07:57.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T22:07:57.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T22:07:57.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T22:07:57.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.inplace_update_support: 0 2024-09-15T22:07:57.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T22:07:57.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T22:07:57.764 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.bloom_locality: 0 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.max_successive_merges: 0 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.ttl: 2592000 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.enable_blob_files: false 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.min_blob_size: 0 2024-09-15T22:07:57.765 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7b5e1559-afd9-45ff-a0c2-39055b563a6a 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726438077395126, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726438077395534, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726438077, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7b5e1559-afd9-45ff-a0c2-39055b563a6a", "db_session_id": "O1QZ19WEJSPK59RTFYV9", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-15T22:07:57.766 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726438077395628, "job": 1, "event": "recovery_finished"} 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e3b2134e00 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: DB pointer 0x55e3b2230000 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout: ** DB Stats ** 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T22:07:57.767 INFO:journalctl@ceph.mon.b.smithi100.stdout: 2024-09-15T22:07:57.768 INFO:journalctl@ceph.mon.b.smithi100.stdout: ** Compaction Stats [default] ** 2024-09-15T22:07:57.768 INFO:journalctl@ceph.mon.b.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:07:57.768 INFO:journalctl@ceph.mon.b.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T22:07:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:07:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:07:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:07:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout: 2024-09-15T22:07:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout: ** Compaction Stats [default] ** 2024-09-15T22:07:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T22:07:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T22:07:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T22:07:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout: 2024-09-15T22:07:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T22:07:57.769 INFO:journalctl@ceph.mon.b.smithi100.stdout: 2024-09-15T22:07:57.770 INFO:journalctl@ceph.mon.b.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T22:07:57.770 INFO:journalctl@ceph.mon.b.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T22:07:57.770 INFO:journalctl@ceph.mon.b.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T22:07:57.770 INFO:journalctl@ceph.mon.b.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T22:07:57.770 INFO:journalctl@ceph.mon.b.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T22:07:57.770 INFO:journalctl@ceph.mon.b.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T22:07:57.770 INFO:journalctl@ceph.mon.b.smithi100.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:07:57.770 INFO:journalctl@ceph.mon.b.smithi100.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T22:07:57.770 INFO:journalctl@ceph.mon.b.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T22:07:57.770 INFO:journalctl@ceph.mon.b.smithi100.stdout: Block cache BinnedLRUCache@0x55e3b21071f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-15T22:07:57.770 INFO:journalctl@ceph.mon.b.smithi100.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-15T22:07:57.770 INFO:journalctl@ceph.mon.b.smithi100.stdout: 2024-09-15T22:07:57.770 INFO:journalctl@ceph.mon.b.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T22:07:57.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-15T22:07:57.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: using public_addr v2:172.21.15.100:0/0 -> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2024-09-15T22:07:57.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: starting mon.b rank -1 at public addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] at bind addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:07:57.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(???) e0 preinit fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:07:57.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(synchronizing).mds e1 new map 2024-09-15T22:07:57.771 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-15T22:07:57.771 INFO:journalctl@ceph.mon.b.smithi100.stdout: e1 2024-09-15T22:07:57.771 INFO:journalctl@ceph.mon.b.smithi100.stdout: btime 2024-09-15T22:06:19:492132+0000 2024-09-15T22:07:57.771 INFO:journalctl@ceph.mon.b.smithi100.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:07:57.771 INFO:journalctl@ceph.mon.b.smithi100.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:07:57.771 INFO:journalctl@ceph.mon.b.smithi100.stdout: legacy client fscid: -1 2024-09-15T22:07:57.771 INFO:journalctl@ceph.mon.b.smithi100.stdout: 2024-09-15T22:07:57.771 INFO:journalctl@ceph.mon.b.smithi100.stdout: No filesystems configured 2024-09-15T22:07:57.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-15T22:07:57.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-15T22:07:57.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-15T22:07:57.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-15T22:07:57.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-15T22:07:57.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-15T22:07:57.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T22:07:57.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:07:57.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:07:57.772 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T22:07:57.773 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:07:57.773 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/69374676' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T22:07:57.773 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:57.773 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/69374676' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T22:07:57.773 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:07:57.773 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:57.773 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:57.773 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:57.773 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:57.773 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi165", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:07:57.773 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:57.773 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:07:57.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-15T22:07:57.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:57.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:57.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:57.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:57.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:07:57.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:57.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:57.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:07:57.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:07:57.774 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:07:57.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi045:172.21.15.45=a;smithi100:172.21.15.100=b;smithi165:172.21.15.165=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:07:57.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: Saving service mon spec with placement smithi045:172.21.15.45=a;smithi100:172.21.15.100=b;smithi165:172.21.15.165=c;count:3 2024-09-15T22:07:57.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: Deploying daemon mon.c on smithi165 2024-09-15T22:07:57.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:57.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='client.? 172.21.15.165:0/745388516' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:07:57.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:57.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:07:57.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.a calling monitor election 2024-09-15T22:07:57.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:57.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:57.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:57.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.c calling monitor election 2024-09-15T22:07:57.775 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:57.776 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:57.776 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:57.776 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:57.776 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:07:57.776 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: monmap epoch 2 2024-09-15T22:07:57.776 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:07:57.776 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: last_changed 2024-09-15T22:07:48.672984+0000 2024-09-15T22:07:57.776 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: created 2024-09-15T22:06:16.451807+0000 2024-09-15T22:07:57.776 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: min_mon_release 19 (squid) 2024-09-15T22:07:57.776 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: election_strategy: 1 2024-09-15T22:07:57.776 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-09-15T22:07:57.776 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.c 2024-09-15T22:07:57.776 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: fsmap 2024-09-15T22:07:57.777 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:07:57.777 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mgrmap e13: x(active, since 38s) 2024-09-15T22:07:57.777 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: overall HEALTH_OK 2024-09-15T22:07:57.777 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:57.777 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:57.777 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:07:57.777 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:07:57.777 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:07:57.777 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:57.778 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: Deploying daemon mon.b on smithi100 2024-09-15T22:07:57.778 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='client.? 172.21.15.165:0/1152535879' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:07:57.778 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:07:57.778 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:07:57.778 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 ceph-mon[35319]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-15T22:07:57.778 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 bash[35299]: c6dc590835aa082e70518a9cca9dc53ba2d4d477d502ca37f1ea28deb1bd5376 2024-09-15T22:07:57.778 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:07:57 smithi100 systemd[1]: Started Ceph mon.b for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:07:58.564 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T22:07:58.565 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T22:07:58.818 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:08:02.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.476+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1232681127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb60003530 msgr2=0x7feb600059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:02.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.476+0000 7feb7dbe6640 1 --2- 172.21.15.165:0/1232681127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb60003530 0x7feb600059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feb7806a240 tx=0x7feb6c02c150 comp rx=0 tx=0).stop 2024-09-15T22:08:02.478 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.476+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1232681127 shutdown_connections 2024-09-15T22:08:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.476+0000 7feb7dbe6640 1 --2- 172.21.15.165:0/1232681127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb60003530 0x7feb600059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.476+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1232681127 >> 172.21.15.165:0/1232681127 conn(0x7feb780fc280 msgr2=0x7feb780fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.477+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1232681127 shutdown_connections 2024-09-15T22:08:02.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.477+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1232681127 wait complete. 2024-09-15T22:08:02.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.478+0000 7feb7dbe6640 1 Processor -- start 2024-09-15T22:08:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.478+0000 7feb7dbe6640 1 -- start start 2024-09-15T22:08:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.478+0000 7feb7dbe6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb60003530 0x7feb78197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.478+0000 7feb7dbe6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb781979d0 0x7feb7819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.478+0000 7feb7dbe6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb7819c2a0 0x7feb7819c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.478+0000 7feb7dbe6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7feb781098f0 con 0x7feb781979d0 2024-09-15T22:08:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.478+0000 7feb7dbe6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feb78109770 con 0x7feb60003530 2024-09-15T22:08:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.478+0000 7feb7dbe6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feb78109a70 con 0x7feb7819c2a0 2024-09-15T22:08:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb77fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb7819c2a0 0x7feb7819c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb77fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb7819c2a0 0x7feb7819c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:41540/0 (socket says 172.21.15.165:41540) 2024-09-15T22:08:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb77fff640 1 -- 172.21.15.165:0/1185619628 learned_addr learned my addr 172.21.15.165:0/1185619628 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-15T22:08:02.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb76ffd640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb781979d0 0x7feb7819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb777fe640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb60003530 0x7feb78197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb77fff640 1 -- 172.21.15.165:0/1185619628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb7819c2a0 msgr2=0x7feb7819c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb77fff640 1 -- 172.21.15.165:0/1185619628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb7819c2a0 msgr2=0x7feb7819c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb77fff640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb7819c2a0 0x7feb7819c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb77fff640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb7819c2a0 0x7feb7819c750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb777fe640 1 -- 172.21.15.165:0/1185619628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb60003530 msgr2=0x7feb78197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb777fe640 1 -- 172.21.15.165:0/1185619628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb60003530 msgr2=0x7feb78197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb777fe640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb60003530 0x7feb78197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb777fe640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb60003530 0x7feb78197490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb76ffd640 1 -- 172.21.15.165:0/1185619628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb7819c2a0 msgr2=0x7feb7819c750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb76ffd640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb7819c2a0 0x7feb7819c750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb76ffd640 1 -- 172.21.15.165:0/1185619628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb60003530 msgr2=0x7feb78197490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb76ffd640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb60003530 0x7feb78197490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:02.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb76ffd640 1 -- 172.21.15.165:0/1185619628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb781a4010 con 0x7feb781979d0 2024-09-15T22:08:02.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.479+0000 7feb76ffd640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb781979d0 0x7feb7819bd60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feb6800b450 tx=0x7feb6800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:02.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.480+0000 7feb74ff9640 1 -- 172.21.15.165:0/1185619628 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68004230 con 0x7feb781979d0 2024-09-15T22:08:02.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.480+0000 7feb74ff9640 1 -- 172.21.15.165:0/1185619628 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feb680043d0 con 0x7feb781979d0 2024-09-15T22:08:02.483 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.480+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1185619628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb781a4240 con 0x7feb781979d0 2024-09-15T22:08:02.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.480+0000 7feb74ff9640 1 -- 172.21.15.165:0/1185619628 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68003dc0 con 0x7feb781979d0 2024-09-15T22:08:02.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.480+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1185619628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb781a47a0 con 0x7feb781979d0 2024-09-15T22:08:02.484 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.481+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1185619628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb7810aa90 con 0x7feb781979d0 2024-09-15T22:08:02.485 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.484+0000 7feb74ff9640 1 -- 172.21.15.165:0/1185619628 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7feb6800f050 con 0x7feb781979d0 2024-09-15T22:08:02.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.484+0000 7feb74ff9640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7feb64039730 0x7feb6403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:02.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.485+0000 7feb74ff9640 1 -- 172.21.15.165:0/1185619628 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7feb6804c700 con 0x7feb781979d0 2024-09-15T22:08:02.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.485+0000 7feb777fe640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7feb64039730 0x7feb6403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:02.486 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.485+0000 7feb777fe640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7feb64039730 0x7feb6403bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feb6c005dc0 tx=0x7feb6c005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:02.490 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.489+0000 7feb74ff9640 1 -- 172.21.15.165:0/1185619628 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb6800d040 con 0x7feb781979d0 2024-09-15T22:08:02.734 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.733+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1185619628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7feb78190b30 con 0x7feb781979d0 2024-09-15T22:08:02.735 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.733+0000 7feb74ff9640 1 -- 172.21.15.165:0/1185619628 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7feb6803ae20 con 0x7feb781979d0 2024-09-15T22:08:02.735 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:08:02.735 INFO:teuthology.orchestra.run.smithi165.stdout:{"epoch":3,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","modified":"2024-09-15T22:07:57.420923Z","created":"2024-09-15T22:06:16.451807Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:3300","nonce":0},{"type":"v1","addr":"172.21.15.165:6789","nonce":0}]},"addr":"172.21.15.165:6789/0","public_addr":"172.21.15.165:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T22:08:02.736 INFO:teuthology.orchestra.run.smithi165.stderr:dumped monmap epoch 3 2024-09-15T22:08:02.736 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:02.736 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:08:02.736 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: mon.c calling monitor election 2024-09-15T22:08:02.736 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: mon.a calling monitor election 2024-09-15T22:08:02.736 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:02.736 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:08:02.737 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:02.737 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:02.737 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:02.737 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:02.737 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:02.737 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:02.737 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:02.737 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:08:02.737 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: monmap epoch 3 2024-09-15T22:08:02.737 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:08:02.737 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: last_changed 2024-09-15T22:07:57.420923+0000 2024-09-15T22:08:02.738 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: created 2024-09-15T22:06:16.451807+0000 2024-09-15T22:08:02.738 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: min_mon_release 19 (squid) 2024-09-15T22:08:02.738 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: election_strategy: 1 2024-09-15T22:08:02.738 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-09-15T22:08:02.738 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.c 2024-09-15T22:08:02.738 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-15T22:08:02.738 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: fsmap 2024-09-15T22:08:02.738 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:08:02.738 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: mgrmap e13: x(active, since 47s) 2024-09-15T22:08:02.738 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: overall HEALTH_OK 2024-09-15T22:08:02.738 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:02.739 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:02.739 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:02.739 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.735+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1185619628 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7feb64039730 msgr2=0x7feb6403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.735+0000 7feb7dbe6640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7feb64039730 0x7feb6403bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feb6c005dc0 tx=0x7feb6c005d10 comp rx=0 tx=0).stop 2024-09-15T22:08:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.735+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1185619628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb781979d0 msgr2=0x7feb7819bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.735+0000 7feb7dbe6640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb781979d0 0x7feb7819bd60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feb6800b450 tx=0x7feb6800b910 comp rx=0 tx=0).stop 2024-09-15T22:08:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.736+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1185619628 shutdown_connections 2024-09-15T22:08:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.736+0000 7feb7dbe6640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7feb64039730 0x7feb6403bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.736+0000 7feb7dbe6640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feb7819c2a0 0x7feb7819c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.736+0000 7feb7dbe6640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb781979d0 0x7feb7819bd60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.736+0000 7feb7dbe6640 1 --2- 172.21.15.165:0/1185619628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb60003530 0x7feb78197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:02.740 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.736+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1185619628 >> 172.21.15.165:0/1185619628 conn(0x7feb780fc280 msgr2=0x7feb780fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.736+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1185619628 shutdown_connections 2024-09-15T22:08:02.741 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:02.736+0000 7feb7dbe6640 1 -- 172.21.15.165:0/1185619628 wait complete. 2024-09-15T22:08:02.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:02.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:08:02.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: mon.c calling monitor election 2024-09-15T22:08:02.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: mon.a calling monitor election 2024-09-15T22:08:02.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:02.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:08:02.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:02.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:02.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:02.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:02.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:02.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:02.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:02.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:08:02.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: monmap epoch 3 2024-09-15T22:08:02.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:08:02.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: last_changed 2024-09-15T22:07:57.420923+0000 2024-09-15T22:08:02.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: created 2024-09-15T22:06:16.451807+0000 2024-09-15T22:08:02.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: min_mon_release 19 (squid) 2024-09-15T22:08:02.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: election_strategy: 1 2024-09-15T22:08:02.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-09-15T22:08:02.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.c 2024-09-15T22:08:02.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-15T22:08:02.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: fsmap 2024-09-15T22:08:02.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:08:02.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: mgrmap e13: x(active, since 47s) 2024-09-15T22:08:02.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: overall HEALTH_OK 2024-09-15T22:08:02.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:02.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:02.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:02.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:03.325 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-15T22:08:03.325 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-15T22:08:03.593 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:08:03.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:03.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:03 smithi165 ceph-mon[35551]: from='client.? 172.21.15.165:0/1185619628' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:08:03.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:03.715 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:03.715 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:03 smithi045 ceph-mon[31180]: from='client.? 172.21.15.165:0/1185619628' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:08:03.715 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:04.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.055+0000 7f39cc22a640 1 -- 172.21.15.45:0/1704664866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4106540 msgr2=0x7f39c4106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:04.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.055+0000 7f39cc22a640 1 --2- 172.21.15.45:0/1704664866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4106540 0x7f39c4106920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f39c0009810 tx=0x7f39c002a540 comp rx=0 tx=0).stop 2024-09-15T22:08:04.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.055+0000 7f39cc22a640 1 -- 172.21.15.45:0/1704664866 shutdown_connections 2024-09-15T22:08:04.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.055+0000 7f39cc22a640 1 --2- 172.21.15.45:0/1704664866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4106540 0x7f39c4106920 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:04.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.055+0000 7f39cc22a640 1 -- 172.21.15.45:0/1704664866 >> 172.21.15.45:0/1704664866 conn(0x7f39c4077310 msgr2=0x7f39c40fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:04.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.055+0000 7f39cc22a640 1 -- 172.21.15.45:0/1704664866 shutdown_connections 2024-09-15T22:08:04.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.055+0000 7f39cc22a640 1 -- 172.21.15.45:0/1704664866 wait complete. 2024-09-15T22:08:04.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.056+0000 7f39cc22a640 1 Processor -- start 2024-09-15T22:08:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.056+0000 7f39cc22a640 1 -- start start 2024-09-15T22:08:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.056+0000 7f39cc22a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4106540 0x7f39c4198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.056+0000 7f39cc22a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c41987d0 0x7f39c4198c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.056+0000 7f39cc22a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f39c41a1300 0x7f39c41a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.056+0000 7f39cc22a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f39c410acb0 con 0x7f39c4106540 2024-09-15T22:08:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.056+0000 7f39cc22a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f39c410ab30 con 0x7f39c41987d0 2024-09-15T22:08:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.056+0000 7f39cc22a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f39c410ae30 con 0x7f39c41a1300 2024-09-15T22:08:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.056+0000 7f39c9fc6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4106540 0x7f39c4198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.056+0000 7f39c9fc6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4106540 0x7f39c4198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59128/0 (socket says 172.21.15.45:59128) 2024-09-15T22:08:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.056+0000 7f39c9fc6640 1 -- 172.21.15.45:0/41330240 learned_addr learned my addr 172.21.15.45:0/41330240 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:08:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.056+0000 7f39ca7c7640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f39c41a1300 0x7f39c41a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.057+0000 7f39c9fc6640 1 -- 172.21.15.45:0/41330240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f39c41a1300 msgr2=0x7f39c41a36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:04.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.057+0000 7f39c9fc6640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f39c41a1300 0x7f39c41a36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.057+0000 7f39c9fc6640 1 -- 172.21.15.45:0/41330240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c41987d0 msgr2=0x7f39c4198c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.057+0000 7f39c97c5640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c41987d0 0x7f39c4198c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.057+0000 7f39c9fc6640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c41987d0 0x7f39c4198c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.057+0000 7f39c9fc6640 1 -- 172.21.15.45:0/41330240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c41a3e90 con 0x7f39c4106540 2024-09-15T22:08:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.057+0000 7f39c97c5640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c41987d0 0x7f39c4198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:08:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.057+0000 7f39c9fc6640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4106540 0x7f39c4198290 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39c0032ff0 tx=0x7f39c0030650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.057+0000 7f39baffd640 1 -- 172.21.15.45:0/41330240 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c0031600 con 0x7f39c4106540 2024-09-15T22:08:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.057+0000 7f39cc22a640 1 -- 172.21.15.45:0/41330240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c41a4120 con 0x7f39c4106540 2024-09-15T22:08:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.057+0000 7f39baffd640 1 -- 172.21.15.45:0/41330240 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f39c0031e50 con 0x7f39c4106540 2024-09-15T22:08:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.057+0000 7f39baffd640 1 -- 172.21.15.45:0/41330240 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c003c680 con 0x7f39c4106540 2024-09-15T22:08:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.057+0000 7f39cc22a640 1 -- 172.21.15.45:0/41330240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c41a4600 con 0x7f39c4106540 2024-09-15T22:08:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.058+0000 7f39baffd640 1 -- 172.21.15.45:0/41330240 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f39c0039040 con 0x7f39c4106540 2024-09-15T22:08:04.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.058+0000 7f39baffd640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f39b0039730 0x7f39b003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:04.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.058+0000 7f39baffd640 1 -- 172.21.15.45:0/41330240 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f39c006d5e0 con 0x7f39c4106540 2024-09-15T22:08:04.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.058+0000 7f39c97c5640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f39b0039730 0x7f39b003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:04.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.059+0000 7f39cc22a640 1 -- 172.21.15.45:0/41330240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c4101bb0 con 0x7f39c4106540 2024-09-15T22:08:04.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.059+0000 7f39c97c5640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f39b0039730 0x7f39b003bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f39b4007920 tx=0x7f39b4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:04.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.063+0000 7f39baffd640 1 -- 172.21.15.45:0/41330240 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f39c0040030 con 0x7f39c4106540 2024-09-15T22:08:04.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.253+0000 7f39cc22a640 1 -- 172.21.15.45:0/41330240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f39c4069dc0 con 0x7f39c4106540 2024-09-15T22:08:04.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.254+0000 7f39baffd640 1 -- 172.21.15.45:0/41330240 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f39c004b560 con 0x7f39c4106540 2024-09-15T22:08:04.256 INFO:teuthology.orchestra.run.smithi045.stdout:# minimal ceph.conf for a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:08:04.256 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2024-09-15T22:08:04.256 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:08:04.256 INFO:teuthology.orchestra.run.smithi045.stdout: mon_host = [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] 2024-09-15T22:08:04.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.256+0000 7f39cc22a640 1 -- 172.21.15.45:0/41330240 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f39b0039730 msgr2=0x7f39b003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:04.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.256+0000 7f39cc22a640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f39b0039730 0x7f39b003bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f39b4007920 tx=0x7f39b4008040 comp rx=0 tx=0).stop 2024-09-15T22:08:04.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.256+0000 7f39cc22a640 1 -- 172.21.15.45:0/41330240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4106540 msgr2=0x7f39c4198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:04.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.256+0000 7f39cc22a640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4106540 0x7f39c4198290 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39c0032ff0 tx=0x7f39c0030650 comp rx=0 tx=0).stop 2024-09-15T22:08:04.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.256+0000 7f39cc22a640 1 -- 172.21.15.45:0/41330240 shutdown_connections 2024-09-15T22:08:04.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.256+0000 7f39cc22a640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f39b0039730 0x7f39b003bbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:04.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.257+0000 7f39cc22a640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f39c41a1300 0x7f39c41a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:04.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.257+0000 7f39cc22a640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c41987d0 0x7f39c4198c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:04.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.257+0000 7f39cc22a640 1 --2- 172.21.15.45:0/41330240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39c4106540 0x7f39c4198290 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:04.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.257+0000 7f39cc22a640 1 -- 172.21.15.45:0/41330240 >> 172.21.15.45:0/41330240 conn(0x7f39c4077310 msgr2=0x7f39c40fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:04.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.257+0000 7f39cc22a640 1 -- 172.21.15.45:0/41330240 shutdown_connections 2024-09-15T22:08:04.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:04.257+0000 7f39cc22a640 1 -- 172.21.15.45:0/41330240 wait complete. 2024-09-15T22:08:04.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:04.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:08:04.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: mon.c calling monitor election 2024-09-15T22:08:04.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: mon.a calling monitor election 2024-09-15T22:08:04.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:04.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:08:04.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:04.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:04.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:04.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:04.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:04.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:04.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: monmap epoch 3 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: last_changed 2024-09-15T22:07:57.420923+0000 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: created 2024-09-15T22:06:16.451807+0000 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: min_mon_release 19 (squid) 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: election_strategy: 1 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.c 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: fsmap 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: mgrmap e13: x(active, since 47s) 2024-09-15T22:08:04.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: overall HEALTH_OK 2024-09-15T22:08:04.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:04.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:04.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:04.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:04.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:04.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='client.? 172.21.15.165:0/1185619628' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T22:08:04.747 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:04.982 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-15T22:08:04.983 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:08:04.983 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:08:05.011 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:08:05.011 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:08:05.078 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-15T22:08:05.078 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:08:05.105 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-15T22:08:05.105 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:08:05.170 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-15T22:08:05.170 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T22:08:05.197 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-15T22:08:05.197 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:08:05.262 INFO:tasks.cephadm:Adding mgr.x on smithi045 2024-09-15T22:08:05.262 INFO:tasks.cephadm:Adding mgr.y on smithi100 2024-09-15T22:08:05.263 INFO:tasks.cephadm:Adding mgr.z on smithi165 2024-09-15T22:08:05.263 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi045=x;smithi100=y;smithi165=z' 2024-09-15T22:08:05.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: mon.b calling monitor election 2024-09-15T22:08:05.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: mon.b calling monitor election 2024-09-15T22:08:05.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: mon.c calling monitor election 2024-09-15T22:08:05.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: mon.a calling monitor election 2024-09-15T22:08:05.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:08:05.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: monmap epoch 3 2024-09-15T22:08:05.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:08:05.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: last_changed 2024-09-15T22:07:57.420923+0000 2024-09-15T22:08:05.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: created 2024-09-15T22:06:16.451807+0000 2024-09-15T22:08:05.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: min_mon_release 19 (squid) 2024-09-15T22:08:05.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: election_strategy: 1 2024-09-15T22:08:05.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-09-15T22:08:05.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.c 2024-09-15T22:08:05.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-15T22:08:05.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: fsmap 2024-09-15T22:08:05.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:08:05.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: mgrmap e13: x(active, since 49s) 2024-09-15T22:08:05.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: overall HEALTH_OK 2024-09-15T22:08:05.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.468 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.468 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.468 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.468 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.468 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.468 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:08:05.468 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:08:05.469 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:05.480 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: mon.b calling monitor election 2024-09-15T22:08:05.480 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: mon.b calling monitor election 2024-09-15T22:08:05.480 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: mon.c calling monitor election 2024-09-15T22:08:05.480 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: mon.a calling monitor election 2024-09-15T22:08:05.480 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:08:05.480 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: monmap epoch 3 2024-09-15T22:08:05.480 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:08:05.481 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: last_changed 2024-09-15T22:07:57.420923+0000 2024-09-15T22:08:05.481 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: created 2024-09-15T22:06:16.451807+0000 2024-09-15T22:08:05.481 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: min_mon_release 19 (squid) 2024-09-15T22:08:05.481 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: election_strategy: 1 2024-09-15T22:08:05.481 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-09-15T22:08:05.481 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.c 2024-09-15T22:08:05.481 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-15T22:08:05.481 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: fsmap 2024-09-15T22:08:05.481 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:08:05.481 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: mgrmap e13: x(active, since 49s) 2024-09-15T22:08:05.481 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: overall HEALTH_OK 2024-09-15T22:08:05.482 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.482 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.482 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.482 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.482 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.482 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.482 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.482 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.482 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.482 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.482 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.482 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:08:05.483 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:08:05.483 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: mon.b calling monitor election 2024-09-15T22:08:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: mon.b calling monitor election 2024-09-15T22:08:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: mon.c calling monitor election 2024-09-15T22:08:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: mon.a calling monitor election 2024-09-15T22:08:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T22:08:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: monmap epoch 3 2024-09-15T22:08:05.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:08:05.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: last_changed 2024-09-15T22:07:57.420923+0000 2024-09-15T22:08:05.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: created 2024-09-15T22:06:16.451807+0000 2024-09-15T22:08:05.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: min_mon_release 19 (squid) 2024-09-15T22:08:05.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: election_strategy: 1 2024-09-15T22:08:05.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: 0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-09-15T22:08:05.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: 1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.c 2024-09-15T22:08:05.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: 2: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-09-15T22:08:05.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: fsmap 2024-09-15T22:08:05.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T22:08:05.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: mgrmap e13: x(active, since 49s) 2024-09-15T22:08:05.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: overall HEALTH_OK 2024-09-15T22:08:05.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:05.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:08:05.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:08:05.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:05.541 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:08:05.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.977+0000 7f737a839640 1 -- 172.21.15.165:0/1576875065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73741005e0 msgr2=0x7f73741009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:05.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.977+0000 7f737a839640 1 --2- 172.21.15.165:0/1576875065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73741005e0 0x7f73741009e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7364009880 tx=0x7f736402a5d0 comp rx=0 tx=0).stop 2024-09-15T22:08:05.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.977+0000 7f737a839640 1 -- 172.21.15.165:0/1576875065 shutdown_connections 2024-09-15T22:08:05.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.977+0000 7f737a839640 1 --2- 172.21.15.165:0/1576875065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73741005e0 0x7f73741009e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:05.985 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.977+0000 7f737a839640 1 -- 172.21.15.165:0/1576875065 >> 172.21.15.165:0/1576875065 conn(0x7f73740fbdb0 msgr2=0x7f73740fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.977+0000 7f737a839640 1 -- 172.21.15.165:0/1576875065 shutdown_connections 2024-09-15T22:08:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.977+0000 7f737a839640 1 -- 172.21.15.165:0/1576875065 wait complete. 2024-09-15T22:08:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.978+0000 7f737a839640 1 Processor -- start 2024-09-15T22:08:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.978+0000 7f737a839640 1 -- start start 2024-09-15T22:08:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.978+0000 7f737a839640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73741005e0 0x7f7374195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.978+0000 7f737a839640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7374196500 0x7f737419b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.978+0000 7f737a839640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7374196980 0x7f737419db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.978+0000 7f737a839640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7374106800 con 0x7f73741005e0 2024-09-15T22:08:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.978+0000 7f737a839640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7374106680 con 0x7f7374196500 2024-09-15T22:08:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.978+0000 7f737a839640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7374106980 con 0x7f7374196980 2024-09-15T22:08:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.978+0000 7f7378dd6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7374196980 0x7f737419db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:05.986 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.978+0000 7f7378dd6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7374196980 0x7f737419db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:41546/0 (socket says 172.21.15.165:41546) 2024-09-15T22:08:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.978+0000 7f7378dd6640 1 -- 172.21.15.165:0/4235190926 learned_addr learned my addr 172.21.15.165:0/4235190926 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-15T22:08:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f7373fff640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73741005e0 0x7f7374195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f736bfff640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7374196500 0x7f737419b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f7378dd6640 1 -- 172.21.15.165:0/4235190926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7374196500 msgr2=0x7f737419b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f7378dd6640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7374196500 0x7f737419b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f7378dd6640 1 -- 172.21.15.165:0/4235190926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73741005e0 msgr2=0x7f7374195fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f7378dd6640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73741005e0 0x7f7374195fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f7378dd6640 1 -- 172.21.15.165:0/4235190926 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737419e3c0 con 0x7f7374196980 2024-09-15T22:08:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f7373fff640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73741005e0 0x7f7374195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f736bfff640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7374196500 0x7f737419b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f7378dd6640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7374196980 0x7f737419db00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f736c00ba50 tx=0x7f736c00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:05.987 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f7371ffb640 1 -- 172.21.15.165:0/4235190926 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c019070 con 0x7f7374196980 2024-09-15T22:08:05.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f737a839640 1 -- 172.21.15.165:0/4235190926 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f737419e6b0 con 0x7f7374196980 2024-09-15T22:08:05.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f7371ffb640 1 -- 172.21.15.165:0/4235190926 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f736c00cbe0 con 0x7f7374196980 2024-09-15T22:08:05.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f7371ffb640 1 -- 172.21.15.165:0/4235190926 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c007750 con 0x7f7374196980 2024-09-15T22:08:05.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.979+0000 7f737a839640 1 -- 172.21.15.165:0/4235190926 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737419ec70 con 0x7f7374196980 2024-09-15T22:08:05.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.980+0000 7f7371ffb640 1 -- 172.21.15.165:0/4235190926 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f736c01c070 con 0x7f7374196980 2024-09-15T22:08:05.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.980+0000 7f7371ffb640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7360039730 0x7f736003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:05.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.980+0000 7f7371ffb640 1 -- 172.21.15.165:0/4235190926 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f736c04be60 con 0x7f7374196980 2024-09-15T22:08:05.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.980+0000 7f737a839640 1 -- 172.21.15.165:0/4235190926 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f737418f5c0 con 0x7f7374196980 2024-09-15T22:08:05.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.981+0000 7f7373fff640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7360039730 0x7f736003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:05.988 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.981+0000 7f7373fff640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7360039730 0x7f736003bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7364031570 tx=0x7f73640058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:05.989 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:05.986+0000 7f7371ffb640 1 -- 172.21.15.165:0/4235190926 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f736c00cd90 con 0x7f7374196980 2024-09-15T22:08:06.164 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.163+0000 7f737a839640 1 -- 172.21.15.165:0/4235190926 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi045=x;smithi100=y;smithi165=z", "target": ["mon-mgr", ""]}) -- 0x7f7374062630 con 0x7f7360039730 2024-09-15T22:08:06.170 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.169+0000 7f7371ffb640 1 -- 172.21.15.165:0/4235190926 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7374062630 con 0x7f7360039730 2024-09-15T22:08:06.170 INFO:teuthology.orchestra.run.smithi165.stdout:Scheduled mgr update... 2024-09-15T22:08:06.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.171+0000 7f737a839640 1 -- 172.21.15.165:0/4235190926 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7360039730 msgr2=0x7f736003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:06.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.171+0000 7f737a839640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7360039730 0x7f736003bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7364031570 tx=0x7f73640058d0 comp rx=0 tx=0).stop 2024-09-15T22:08:06.172 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.171+0000 7f737a839640 1 -- 172.21.15.165:0/4235190926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7374196980 msgr2=0x7f737419db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:06.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.171+0000 7f737a839640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7374196980 0x7f737419db00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f736c00ba50 tx=0x7f736c00bf10 comp rx=0 tx=0).stop 2024-09-15T22:08:06.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.171+0000 7f737a839640 1 -- 172.21.15.165:0/4235190926 shutdown_connections 2024-09-15T22:08:06.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.171+0000 7f737a839640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7360039730 0x7f736003bbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:06.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.171+0000 7f737a839640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7374196980 0x7f737419db00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:06.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.171+0000 7f737a839640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7374196500 0x7f737419b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:06.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.171+0000 7f737a839640 1 --2- 172.21.15.165:0/4235190926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73741005e0 0x7f7374195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:06.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.171+0000 7f737a839640 1 -- 172.21.15.165:0/4235190926 >> 172.21.15.165:0/4235190926 conn(0x7f73740fbdb0 msgr2=0x7f73740fc880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:06.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.171+0000 7f737a839640 1 -- 172.21.15.165:0/4235190926 shutdown_connections 2024-09-15T22:08:06.173 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:08:06.171+0000 7f737a839640 1 -- 172.21.15.165:0/4235190926 wait complete. 2024-09-15T22:08:06.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:06 smithi045 ceph-mon[31180]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:08:06.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:06 smithi045 ceph-mon[31180]: Updating smithi100:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:08:06.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:06 smithi045 ceph-mon[31180]: Updating smithi045:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:08:06.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:06 smithi045 ceph-mon[31180]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:08:06.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:06 smithi045 ceph-mon[31180]: Reconfiguring daemon mon.a on smithi045 2024-09-15T22:08:06.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:06 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:06.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:06 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:06.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:06 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:06.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:06 smithi165 ceph-mon[35551]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:08:06.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:06 smithi165 ceph-mon[35551]: Updating smithi100:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:08:06.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:06 smithi165 ceph-mon[35551]: Updating smithi045:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:08:06.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:06 smithi165 ceph-mon[35551]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:08:06.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:06 smithi165 ceph-mon[35551]: Reconfiguring daemon mon.a on smithi045 2024-09-15T22:08:06.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:06 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:06.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:06 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:06.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:06 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:06.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:06 smithi100 ceph-mon[35319]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:08:06.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:06 smithi100 ceph-mon[35319]: Updating smithi100:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:08:06.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:06 smithi100 ceph-mon[35319]: Updating smithi045:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:08:06.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:06 smithi100 ceph-mon[35319]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T22:08:06.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:06 smithi100 ceph-mon[35319]: Reconfiguring daemon mon.a on smithi045 2024-09-15T22:08:06.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:06 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:06.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:06 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:08:06.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:06 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:06.728 DEBUG:teuthology.orchestra.run.smithi100:mgr.y> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mgr.y.service 2024-09-15T22:08:06.731 DEBUG:teuthology.orchestra.run.smithi165:mgr.z> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mgr.z.service 2024-09-15T22:08:06.733 INFO:tasks.cephadm:Deploying OSDs... 2024-09-15T22:08:06.733 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:08:06.733 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:08:06.750 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:08:06.750 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2024-09-15T22:08:06.808 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:08:06.808 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:06.808 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-15T22:08:06.808 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:06.808 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:06.808 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-09-15 22:07:26.471780415 +0000 2024-09-15T22:08:06.808 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-15 22:03:20.595889037 +0000 2024-09-15T22:08:06.808 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-15 22:03:20.595889037 +0000 2024-09-15T22:08:06.808 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-09-15 22:03:20.595889037 +0000 2024-09-15T22:08:06.809 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:08:06.873 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-09-15T22:08:06.873 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-09-15T22:08:06.873 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 9.8781e-05 s, 5.2 MB/s 2024-09-15T22:08:06.875 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:08:06.931 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2024-09-15T22:08:06.988 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:08:06.988 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:06.988 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-15T22:08:06.988 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:06.988 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:06.988 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-09-15 22:07:26.505779896 +0000 2024-09-15T22:08:06.988 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-15 22:03:20.926884120 +0000 2024-09-15T22:08:06.988 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-15 22:03:20.926884120 +0000 2024-09-15T22:08:06.988 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-09-15 22:03:20.926884120 +0000 2024-09-15T22:08:06.989 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:08:07.051 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-09-15T22:08:07.052 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-09-15T22:08:07.052 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 9.3428e-05 s, 5.5 MB/s 2024-09-15T22:08:07.053 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:08:07.110 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2024-09-15T22:08:07.168 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:08:07.168 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:07.168 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-15T22:08:07.168 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:07.168 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:07.168 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-09-15 22:07:26.551779194 +0000 2024-09-15T22:08:07.168 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-15 22:03:21.242879425 +0000 2024-09-15T22:08:07.169 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-15 22:03:21.242879425 +0000 2024-09-15T22:08:07.169 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-09-15 22:03:21.242879425 +0000 2024-09-15T22:08:07.169 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:08:07.232 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-09-15T22:08:07.232 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-09-15T22:08:07.233 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 9.2644e-05 s, 5.5 MB/s 2024-09-15T22:08:07.234 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:08:07.290 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2024-09-15T22:08:07.346 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:08:07.347 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:07.347 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-15T22:08:07.347 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:07.347 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:07.347 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-09-15 22:07:26.591778583 +0000 2024-09-15T22:08:07.347 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-15 22:03:21.557874746 +0000 2024-09-15T22:08:07.347 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-15 22:03:21.557874746 +0000 2024-09-15T22:08:07.347 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-09-15 22:03:21.557874746 +0000 2024-09-15T22:08:07.348 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:08:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-09-15T22:08:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-09-15T22:08:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000107274 s, 4.8 MB/s 2024-09-15T22:08:07.412 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:08:07.469 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-09-15T22:08:07.469 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:08:07.488 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:08:07.488 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-09-15T22:08:07.545 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:08:07.545 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:07.545 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-15T22:08:07.546 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:07.546 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:07.546 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-15 22:07:56.910141737 +0000 2024-09-15T22:08:07.546 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-15 22:03:32.987206604 +0000 2024-09-15T22:08:07.546 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-15 22:03:32.987206604 +0000 2024-09-15T22:08:07.546 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-15 22:03:32.987206604 +0000 2024-09-15T22:08:07.546 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:08:07.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:07 smithi045 ceph-mon[31180]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:07.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:07 smithi045 ceph-mon[31180]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi045=x;smithi100=y;smithi165=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:07.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:07 smithi045 ceph-mon[31180]: Saving service mgr spec with placement smithi045=x;smithi100=y;smithi165=z;count:3 2024-09-15T22:08:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:08:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:08:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:07.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:07 smithi100 ceph-mon[35319]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:07.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:07 smithi100 ceph-mon[35319]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi045=x;smithi100=y;smithi165=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:07.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:07 smithi100 ceph-mon[35319]: Saving service mgr spec with placement smithi045=x;smithi100=y;smithi165=z;count:3 2024-09-15T22:08:07.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:07.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:07.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:08:07.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:08:07.610 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:07.612 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-15T22:08:07.612 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-15T22:08:07.612 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000255545 s, 2.0 MB/s 2024-09-15T22:08:07.614 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:08:07.672 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-09-15T22:08:07.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:07 smithi165 ceph-mon[35551]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:07.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:07 smithi165 ceph-mon[35551]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi045=x;smithi100=y;smithi165=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:07.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:07 smithi165 ceph-mon[35551]: Saving service mgr spec with placement smithi045=x;smithi100=y;smithi165=z;count:3 2024-09-15T22:08:07.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:07.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:07.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:08:07.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:08:07.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:07.728 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:08:07.728 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:07.729 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-15T22:08:07.729 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:07.729 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:07.729 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-15 22:07:56.910141737 +0000 2024-09-15T22:08:07.729 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-15 22:03:33.308198173 +0000 2024-09-15T22:08:07.729 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-15 22:03:33.308198173 +0000 2024-09-15T22:08:07.729 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-15 22:03:33.308198173 +0000 2024-09-15T22:08:07.729 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:08:07.794 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-15T22:08:07.794 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-15T22:08:07.794 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000192337 s, 2.7 MB/s 2024-09-15T22:08:07.796 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:08:07.853 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-09-15T22:08:07.908 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:08:07.908 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:07.908 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-15T22:08:07.908 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:07.908 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:07.909 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-15 22:07:56.911141712 +0000 2024-09-15T22:08:07.909 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-15 22:03:33.646189296 +0000 2024-09-15T22:08:07.909 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-15 22:03:33.646189296 +0000 2024-09-15T22:08:07.909 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-15 22:03:33.646189296 +0000 2024-09-15T22:08:07.909 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:08:07.972 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-15T22:08:07.972 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-15T22:08:07.972 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000190875 s, 2.7 MB/s 2024-09-15T22:08:07.973 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:08:08.029 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-09-15T22:08:08.085 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:08:08.086 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:08.086 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-15T22:08:08.086 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:08.086 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:08.086 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-09-15 22:07:56.911141712 +0000 2024-09-15T22:08:08.086 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-09-15 22:03:33.956181154 +0000 2024-09-15T22:08:08.086 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-09-15 22:03:33.956181154 +0000 2024-09-15T22:08:08.086 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-09-15 22:03:33.956181154 +0000 2024-09-15T22:08:08.086 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:08:08.149 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-09-15T22:08:08.149 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-09-15T22:08:08.149 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000248296 s, 2.1 MB/s 2024-09-15T22:08:08.150 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:08:08.207 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2024-09-15T22:08:08.208 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:08:08.227 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:08:08.228 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_1 2024-09-15T22:08:08.287 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:08:08.287 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:08.288 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-15T22:08:08.288 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:08.288 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:08.288 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-15 22:07:47.680448496 +0000 2024-09-15T22:08:08.289 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-15 22:03:33.528667306 +0000 2024-09-15T22:08:08.289 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-15 22:03:33.528667306 +0000 2024-09-15T22:08:08.289 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-15 22:03:33.528667306 +0000 2024-09-15T22:08:08.290 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:08:08.355 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-15T22:08:08.355 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-15T22:08:08.355 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000286754 s, 1.8 MB/s 2024-09-15T22:08:08.357 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:08:08.417 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_2 2024-09-15T22:08:08.475 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:08:08.475 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:08.476 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-15T22:08:08.476 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:08.476 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:08.476 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-15 22:07:47.680448496 +0000 2024-09-15T22:08:08.476 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-15 22:03:33.864662123 +0000 2024-09-15T22:08:08.476 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-15 22:03:33.864662123 +0000 2024-09-15T22:08:08.476 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-15 22:03:33.864662123 +0000 2024-09-15T22:08:08.476 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:08:08.538 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:08 smithi165 ceph-mon[35551]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:08:08.538 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:08 smithi165 ceph-mon[35551]: Reconfiguring daemon mgr.x on smithi045 2024-09-15T22:08:08.538 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:08.538 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:08.539 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:08:08.539 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:08:08.539 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:08.540 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-15T22:08:08.541 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-15T22:08:08.541 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000196155 s, 2.6 MB/s 2024-09-15T22:08:08.542 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:08:08.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:08 smithi045 ceph-mon[31180]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:08:08.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:08 smithi045 ceph-mon[31180]: Reconfiguring daemon mgr.x on smithi045 2024-09-15T22:08:08.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:08.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:08.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:08:08.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:08:08.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:08.599 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_3 2024-09-15T22:08:08.655 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:08:08.655 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:08.655 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-15T22:08:08.656 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:08.656 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:08.656 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-15 22:07:47.680448496 +0000 2024-09-15T22:08:08.656 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-15 22:03:34.187657141 +0000 2024-09-15T22:08:08.656 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-15 22:03:34.187657141 +0000 2024-09-15T22:08:08.656 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-15 22:03:34.187657141 +0000 2024-09-15T22:08:08.656 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:08:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-15T22:08:08.719 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-15T22:08:08.720 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000199041 s, 2.6 MB/s 2024-09-15T22:08:08.721 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:08:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:08 smithi100 ceph-mon[35319]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T22:08:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:08 smithi100 ceph-mon[35319]: Reconfiguring daemon mgr.x on smithi045 2024-09-15T22:08:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:08:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:08:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:08.777 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_4 2024-09-15T22:08:08.834 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:08:08.834 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:08:08.834 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-15T22:08:08.834 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:08:08.835 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T22:08:08.835 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2024-09-15 22:07:47.681448480 +0000 2024-09-15T22:08:08.835 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2024-09-15 22:03:34.513652113 +0000 2024-09-15T22:08:08.835 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2024-09-15 22:03:34.513652113 +0000 2024-09-15T22:08:08.835 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: 2024-09-15 22:03:34.513652113 +0000 2024-09-15T22:08:08.835 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:08:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2024-09-15T22:08:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2024-09-15T22:08:08.898 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000171186 s, 3.0 MB/s 2024-09-15T22:08:08.899 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:08:08.956 INFO:tasks.cephadm:Deploying osd.0 on smithi045 with /dev/vg_nvme/lv_4... 2024-09-15T22:08:08.957 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:08:09.234 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:08:09.536 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:09 smithi165 ceph-mon[35551]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:09.537 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:09 smithi165 ceph-mon[35551]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:08:09.537 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:09 smithi165 ceph-mon[35551]: Reconfiguring daemon mon.b on smithi100 2024-09-15T22:08:09.537 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:09 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:09.537 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:09 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:09.537 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:09 smithi165 ceph-mon[35551]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:08:09.537 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:09 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:08:09.537 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:09 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:08:09.537 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:09 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:09.537 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:09 smithi165 ceph-mon[35551]: Reconfiguring daemon mon.c on smithi165 2024-09-15T22:08:09.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:09 smithi045 ceph-mon[31180]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:09 smithi045 ceph-mon[31180]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:08:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:09 smithi045 ceph-mon[31180]: Reconfiguring daemon mon.b on smithi100 2024-09-15T22:08:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:09 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:09 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:09 smithi045 ceph-mon[31180]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:08:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:09 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:08:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:09 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:08:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:09 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:09 smithi045 ceph-mon[31180]: Reconfiguring daemon mon.c on smithi165 2024-09-15T22:08:09.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:09 smithi100 ceph-mon[35319]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:09.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:09 smithi100 ceph-mon[35319]: Reconfiguring mon.b (monmap changed)... 2024-09-15T22:08:09.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:09 smithi100 ceph-mon[35319]: Reconfiguring daemon mon.b on smithi100 2024-09-15T22:08:09.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:09 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:09.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:09 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:09.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:09 smithi100 ceph-mon[35319]: Reconfiguring mon.c (monmap changed)... 2024-09-15T22:08:09.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:09 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T22:08:09.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:09 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T22:08:09.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:09 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:09.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:09 smithi100 ceph-mon[35319]: Reconfiguring daemon mon.c on smithi165 2024-09-15T22:08:10.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:10 smithi165 ceph-mon[35551]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:10.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:10 smithi045 ceph-mon[31180]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:10.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:10 smithi100 ceph-mon[35319]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:11.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:11.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:11.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:11.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:11.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:11.676 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:11.677 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:08:11.677 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:08:11.677 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:08:11.677 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:11.677 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:11 smithi045 ceph-mon[31180]: Deploying daemon mgr.z on smithi165 2024-09-15T22:08:11.679 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:08:11.710 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_4 2024-09-15T22:08:11.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:11.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:11.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:11.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:11.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:11.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:11.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:08:11.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:08:11.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:08:11.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:11.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:11 smithi165 ceph-mon[35551]: Deploying daemon mgr.z on smithi165 2024-09-15T22:08:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:11.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:08:11.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:08:11.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:08:11.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:11.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:11 smithi100 ceph-mon[35319]: Deploying daemon mgr.z on smithi165 2024-09-15T22:08:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:08:12.358 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:12 smithi165 systemd[1]: Starting Ceph mgr.z for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:08:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.412+0000 7fa2544aa640 1 -- 172.21.15.45:0/270760263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa24c1026d0 msgr2=0x7fa24c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.412+0000 7fa2544aa640 1 --2- 172.21.15.45:0/270760263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa24c1026d0 0x7fa24c108f60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa244009ca0 tx=0x7fa24402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:08:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.412+0000 7fa2544aa640 1 -- 172.21.15.45:0/270760263 shutdown_connections 2024-09-15T22:08:12.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.412+0000 7fa2544aa640 1 --2- 172.21.15.45:0/270760263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa24c1026d0 0x7fa24c108f60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.412+0000 7fa2544aa640 1 --2- 172.21.15.45:0/270760263 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24c101d10 0x7fa24c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.412+0000 7fa2544aa640 1 --2- 172.21.15.45:0/270760263 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c100b10 0x7fa24c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.412+0000 7fa2544aa640 1 -- 172.21.15.45:0/270760263 >> 172.21.15.45:0/270760263 conn(0x7fa24c0fc2a0 msgr2=0x7fa24c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.412+0000 7fa2544aa640 1 -- 172.21.15.45:0/270760263 shutdown_connections 2024-09-15T22:08:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.412+0000 7fa2544aa640 1 -- 172.21.15.45:0/270760263 wait complete. 2024-09-15T22:08:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa2544aa640 1 Processor -- start 2024-09-15T22:08:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa2544aa640 1 -- start start 2024-09-15T22:08:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa2544aa640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24c100b10 0x7fa24c19a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa2544aa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c101d10 0x7fa24c19a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa2544aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa24c1026d0 0x7fa24c1a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa2544aa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c10c980 con 0x7fa24c1026d0 2024-09-15T22:08:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa2544aa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c10c800 con 0x7fa24c101d10 2024-09-15T22:08:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa2544aa640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa24c10cb00 con 0x7fa24c100b10 2024-09-15T22:08:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa252246640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24c100b10 0x7fa24c19a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa252a47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa24c1026d0 0x7fa24c1a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa252246640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24c100b10 0x7fa24c19a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:40834/0 (socket says 172.21.15.45:40834) 2024-09-15T22:08:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa252a47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa24c1026d0 0x7fa24c1a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38088/0 (socket says 172.21.15.45:38088) 2024-09-15T22:08:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa252246640 1 -- 172.21.15.45:0/2112480367 learned_addr learned my addr 172.21.15.45:0/2112480367 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:08:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.413+0000 7fa251a45640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c101d10 0x7fa24c19a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.414+0000 7fa252246640 1 -- 172.21.15.45:0/2112480367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c101d10 msgr2=0x7fa24c19a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.414+0000 7fa252246640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c101d10 0x7fa24c19a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.414+0000 7fa252246640 1 -- 172.21.15.45:0/2112480367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa24c1026d0 msgr2=0x7fa24c1a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.414+0000 7fa252246640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa24c1026d0 0x7fa24c1a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.414+0000 7fa252246640 1 -- 172.21.15.45:0/2112480367 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24c1a1ec0 con 0x7fa24c100b10 2024-09-15T22:08:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.414+0000 7fa251a45640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c101d10 0x7fa24c19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.414+0000 7fa252a47640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa24c1026d0 0x7fa24c1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:08:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.414+0000 7fa252246640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24c100b10 0x7fa24c19a290 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa24800d770 tx=0x7fa24800db70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.415+0000 7fa2437fe640 1 -- 172.21.15.45:0/2112480367 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248017070 con 0x7fa24c100b10 2024-09-15T22:08:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.415+0000 7fa2437fe640 1 -- 172.21.15.45:0/2112480367 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa248009d20 con 0x7fa24c100b10 2024-09-15T22:08:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.415+0000 7fa2437fe640 1 -- 172.21.15.45:0/2112480367 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248003dc0 con 0x7fa24c100b10 2024-09-15T22:08:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.415+0000 7fa2544aa640 1 -- 172.21.15.45:0/2112480367 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24c1a21b0 con 0x7fa24c100b10 2024-09-15T22:08:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.415+0000 7fa2544aa640 1 -- 172.21.15.45:0/2112480367 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa24c1a2720 con 0x7fa24c100b10 2024-09-15T22:08:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.416+0000 7fa2437fe640 1 -- 172.21.15.45:0/2112480367 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fa248010460 con 0x7fa24c100b10 2024-09-15T22:08:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.416+0000 7fa2544aa640 1 -- 172.21.15.45:0/2112480367 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa24c1a2a40 con 0x7fa24c100b10 2024-09-15T22:08:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.417+0000 7fa2437fe640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa238039500 0x7fa23803b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.417+0000 7fa2437fe640 1 -- 172.21.15.45:0/2112480367 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa24804c190 con 0x7fa24c100b10 2024-09-15T22:08:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.417+0000 7fa251a45640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa238039500 0x7fa23803b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:12.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.417+0000 7fa251a45640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa238039500 0x7fa23803b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa24c19b7b0 tx=0x7fa23c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:12.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.422+0000 7fa2437fe640 1 -- 172.21.15.45:0/2112480367 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa24800e350 con 0x7fa24c100b10 2024-09-15T22:08:12.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:12.605+0000 7fa2544aa640 1 -- 172.21.15.45:0/2112480367 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa24c0fe440 con 0x7fa238039500 2024-09-15T22:08:12.668 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:12 smithi165 ceph-mon[35551]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:12.668 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:12 smithi165 podman[37339]: 2024-09-15 22:08:12.356876517 +0000 UTC m=+0.104831115 container create 4fc695416bf10a3cc4fec1ffcd796c43c28a4ec0c77c552977c77eed3b313774 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:08:12.669 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:12 smithi165 podman[37339]: 2024-09-15 22:08:12.268110013 +0000 UTC m=+0.016064629 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:08:12.669 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:12 smithi165 podman[37339]: 2024-09-15 22:08:12.567258673 +0000 UTC m=+0.315213271 container init 4fc695416bf10a3cc4fec1ffcd796c43c28a4ec0c77c552977c77eed3b313774 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-15T22:08:12.669 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:12 smithi165 podman[37339]: 2024-09-15 22:08:12.569920457 +0000 UTC m=+0.317875058 container start 4fc695416bf10a3cc4fec1ffcd796c43c28a4ec0c77c552977c77eed3b313774 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-15T22:08:12.669 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:12 smithi165 ceph-mgr[37358]: -- 172.21.15.165:0/3556414725 <== mon.1 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e9bf9f50e0 con 0x55e9bf9d3400 2024-09-15T22:08:12.669 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:12 smithi165 bash[37339]: 4fc695416bf10a3cc4fec1ffcd796c43c28a4ec0c77c552977c77eed3b313774 2024-09-15T22:08:12.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:12 smithi100 ceph-mon[35319]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:12.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:12 smithi045 ceph-mon[31180]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:12.964 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:12 smithi165 systemd[1]: Started Ceph mgr.z for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:08:12.965 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:12.693+0000 7fd4fa7d0040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:08:12.965 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:12.755+0000 7fd4fa7d0040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:08:12.965 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:12.903+0000 7fd4fa7d0040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:08:13.257 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:12.969+0000 7fd4fa7d0040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:08:13.257 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:13.115+0000 7fd4fa7d0040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:08:13.257 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:13.255+0000 7fd4fa7d0040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:08:13.452 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:13 smithi100 ceph-mon[35319]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:13.452 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:13 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:08:13.452 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:13 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:08:13.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:13 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:13.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:13 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:13.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:13 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:13.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:13 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:13.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:13 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:08:13.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:13 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:08:13.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:13 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:08:13.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:13 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:13.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:13 smithi100 ceph-mon[35319]: Deploying daemon mgr.y on smithi100 2024-09-15T22:08:13.570 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-mon[35551]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:13.570 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:08:13.571 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:08:13.571 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:13.571 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:13.571 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:13.571 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:13.571 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:08:13.571 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:08:13.571 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:08:13.571 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:13.571 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-mon[35551]: Deploying daemon mgr.y on smithi100 2024-09-15T22:08:13.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:13 smithi045 ceph-mon[31180]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:13.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:13 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:08:13.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:13 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:08:13.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:13 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:13.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:13 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:13.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:13 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:13.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:13 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:13.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:13 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T22:08:13.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:13 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T22:08:13.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:13 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T22:08:13.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:13 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:13.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:13 smithi045 ceph-mon[31180]: Deploying daemon mgr.y on smithi100 2024-09-15T22:08:13.964 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:13.569+0000 7fd4fa7d0040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:08:13.965 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:13.630+0000 7fd4fa7d0040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:08:13.965 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:13.814+0000 7fd4fa7d0040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:08:14.665 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:14 smithi100 systemd[1]: Starting Ceph mgr.y for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:08:14.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:14 smithi045 ceph-mon[31180]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:14.934 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:14 smithi100 ceph-mon[35319]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:14.934 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:14 smithi100 podman[36665]: 2024-09-15 22:08:14.664477748 +0000 UTC m=+0.089694600 container create bf93c6228aa9d156a6e3083949080d42a7e4a8585aef09123ac3a73dcc64e3ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-15T22:08:14.935 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:14 smithi100 podman[36665]: 2024-09-15 22:08:14.590481975 +0000 UTC m=+0.015698826 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:08:14.935 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:14 smithi100 podman[36665]: 2024-09-15 22:08:14.841875839 +0000 UTC m=+0.267092691 container init bf93c6228aa9d156a6e3083949080d42a7e4a8585aef09123ac3a73dcc64e3ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-15T22:08:14.935 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:14 smithi100 podman[36665]: 2024-09-15 22:08:14.845097451 +0000 UTC m=+0.270314297 container start bf93c6228aa9d156a6e3083949080d42a7e4a8585aef09123ac3a73dcc64e3ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-15T22:08:14.935 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:14 smithi100 ceph-mgr[36684]: -- 172.21.15.100:0/1941932520 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56401dcc10e0 con 0x56401dc9f000 2024-09-15T22:08:14.935 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:14 smithi100 bash[36665]: bf93c6228aa9d156a6e3083949080d42a7e4a8585aef09123ac3a73dcc64e3ee 2024-09-15T22:08:14.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:14 smithi165 ceph-mon[35551]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:14.965 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:14 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:14.697+0000 7fd4fa7d0040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:08:14.965 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:14 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:14.765+0000 7fd4fa7d0040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:08:15.190 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:14 smithi100 systemd[1]: Started Ceph mgr.y for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:08:15.205 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:14 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:14.968+0000 7fcbc8ed7040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:08:15.205 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:15.032+0000 7fcbc8ed7040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:08:15.206 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:15.188+0000 7fcbc8ed7040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:08:15.494 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:15.257+0000 7fcbc8ed7040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:08:15.494 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:15.423+0000 7fcbc8ed7040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:08:15.808 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2341906605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b217c815-c5e4-4bee-aa74-03c8aab8be70"}]: dispatch 2024-09-15T22:08:15.809 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2341906605' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b217c815-c5e4-4bee-aa74-03c8aab8be70"}]': finished 2024-09-15T22:08:15.809 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-mon[35551]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:08:15.809 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:15.809 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:15.809 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:15.809 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:15.810 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:15.810 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:15.810 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:15.810 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1405023766' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:08:15.810 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:15.538+0000 7fd4fa7d0040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:08:15.810 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:15.654+0000 7fd4fa7d0040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:08:15.810 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:15.806+0000 7fd4fa7d0040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:08:15.836 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:15.579+0000 7fcbc8ed7040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:08:15.836 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2341906605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b217c815-c5e4-4bee-aa74-03c8aab8be70"}]: dispatch 2024-09-15T22:08:15.836 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2341906605' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b217c815-c5e4-4bee-aa74-03c8aab8be70"}]': finished 2024-09-15T22:08:15.837 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-mon[35319]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:08:15.837 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:15.837 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:15.837 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:15.837 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:15.837 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:15.837 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:15.837 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:15.837 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1405023766' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:08:16.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:15 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2341906605' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b217c815-c5e4-4bee-aa74-03c8aab8be70"}]: dispatch 2024-09-15T22:08:16.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:15 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2341906605' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b217c815-c5e4-4bee-aa74-03c8aab8be70"}]': finished 2024-09-15T22:08:16.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:15 smithi045 ceph-mon[31180]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T22:08:16.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:16.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:16.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:16.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:16.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:16.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:16.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:16.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:15 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1405023766' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:08:16.099 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:15.873+0000 7fd4fa7d0040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:08:16.099 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:16.028+0000 7fd4fa7d0040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:08:16.099 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:16.097+0000 7fd4fa7d0040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:08:16.167 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:15.902+0000 7fcbc8ed7040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:08:16.167 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:15.965+0000 7fcbc8ed7040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:08:16.398 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:16.163+0000 7fd4fa7d0040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:08:16.398 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:16.330+0000 7fd4fa7d0040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:08:16.398 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:16.396+0000 7fd4fa7d0040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:08:16.494 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:16 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:16.165+0000 7fcbc8ed7040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:08:16.669 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:16.466+0000 7fd4fa7d0040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:08:16.670 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:16.549+0000 7fd4fa7d0040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:08:16.670 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:16.609+0000 7fd4fa7d0040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:08:16.670 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:16.668+0000 7fd4fa7d0040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:08:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:17 smithi165 ceph-mon[35551]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.494 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:17.046+0000 7fcbc8ed7040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:08:17.494 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:17.113+0000 7fcbc8ed7040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:08:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-mon[35319]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:17 smithi045 ceph-mon[31180]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:17.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:17.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:17.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:17.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:17.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:17.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:17.714 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:08:17 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:08:17.461+0000 7fd4fa7d0040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:08:18.079 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:17.823+0000 7fcbc8ed7040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:08:18.079 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:17 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:17.937+0000 7fcbc8ed7040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:08:18.079 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:18.076+0000 7fcbc8ed7040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:08:18.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:18.135+0000 7fa2437fe640 1 -- 172.21.15.45:0/2112480367 <== mon.1 v2:172.21.15.165:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7fa248010750 con 0x7fa24c100b10 2024-09-15T22:08:18.356 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.165:0/3932315190' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:08:18.356 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-mon[35319]: Standby manager daemon z started 2024-09-15T22:08:18.356 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.165:0/3932315190' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:08:18.356 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.165:0/3932315190' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:08:18.356 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.165:0/3932315190' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:08:18.356 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:18.141+0000 7fcbc8ed7040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:08:18.356 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:18.287+0000 7fcbc8ed7040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:08:18.356 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:18.353+0000 7fcbc8ed7040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:08:18.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:18 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.165:0/3932315190' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:08:18.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:18 smithi165 ceph-mon[35551]: Standby manager daemon z started 2024-09-15T22:08:18.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:18 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.165:0/3932315190' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:08:18.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:18 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.165:0/3932315190' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:08:18.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:18 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.165:0/3932315190' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:08:18.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:18 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/3932315190' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:08:18.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:18 smithi045 ceph-mon[31180]: Standby manager daemon z started 2024-09-15T22:08:18.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:18 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/3932315190' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:08:18.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:18 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/3932315190' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:08:18.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:18 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/3932315190' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:08:18.635 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:18.412+0000 7fcbc8ed7040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:08:18.635 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:18.568+0000 7fcbc8ed7040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:08:18.635 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:18.632+0000 7fcbc8ed7040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:08:18.897 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:18.698+0000 7fcbc8ed7040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:08:18.898 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:18.779+0000 7fcbc8ed7040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:08:18.898 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:18.837+0000 7fcbc8ed7040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:08:18.898 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:18.895+0000 7fcbc8ed7040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:08:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:19 smithi100 ceph-mon[35319]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:19 smithi100 ceph-mon[35319]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-15T22:08:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:19 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:08:19.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:19 smithi165 ceph-mon[35551]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:19.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:19 smithi165 ceph-mon[35551]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-15T22:08:19.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:19 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:08:19.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:19 smithi045 ceph-mon[31180]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:19.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:19 smithi045 ceph-mon[31180]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-15T22:08:19.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:19 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:08:19.994 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:08:19 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:08:19.673+0000 7fcbc8ed7040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:08:20.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:20.142+0000 7fa2437fe640 1 -- 172.21.15.45:0/2112480367 <== mon.1 v2:172.21.15.165:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fa248010b70 con 0x7fa24c100b10 2024-09-15T22:08:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:20 smithi045 ceph-mon[31180]: Standby manager daemon y started 2024-09-15T22:08:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:20 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.100:0/3602588928' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:08:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:20 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.100:0/3602588928' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:08:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:20 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.100:0/3602588928' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:08:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:20 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.100:0/3602588928' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:08:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:20 smithi165 ceph-mon[35551]: Standby manager daemon y started 2024-09-15T22:08:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:20 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.100:0/3602588928' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:08:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:20 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.100:0/3602588928' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:08:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:20 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.100:0/3602588928' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:08:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:20 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.100:0/3602588928' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:08:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:20 smithi100 ceph-mon[35319]: Standby manager daemon y started 2024-09-15T22:08:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:20 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.100:0/3602588928' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:08:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:20 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.100:0/3602588928' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:08:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:20 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.100:0/3602588928' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:08:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:20 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.100:0/3602588928' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:08:21.405 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:21 smithi045 ceph-mon[31180]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:21.405 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:21 smithi045 ceph-mon[31180]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-15T22:08:21.405 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:21 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:08:21.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:21 smithi165 ceph-mon[35551]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:21.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:21 smithi165 ceph-mon[35551]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-15T22:08:21.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:21 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:08:21.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:21 smithi100 ceph-mon[35319]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:21.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:21 smithi100 ceph-mon[35319]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-15T22:08:21.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:21 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:08:23.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:23 smithi045 ceph-mon[31180]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:23.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:23 smithi165 ceph-mon[35551]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:23 smithi100 ceph-mon[35319]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:24.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:08:24.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:24.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:24 smithi165 ceph-mon[35551]: Deploying daemon osd.0 on smithi045 2024-09-15T22:08:24.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:08:24.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:24.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:24 smithi100 ceph-mon[35319]: Deploying daemon osd.0 on smithi045 2024-09-15T22:08:24.501 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T22:08:24.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:24.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:24 smithi045 ceph-mon[31180]: Deploying daemon osd.0 on smithi045 2024-09-15T22:08:25.408 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:25 smithi100 ceph-mon[35319]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:25.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:25 smithi165 ceph-mon[35551]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:25.552 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:25 smithi045 ceph-mon[31180]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:27.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:27 smithi045 ceph-mon[31180]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:27.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:27 smithi165 ceph-mon[35551]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:27 smithi100 ceph-mon[35319]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:29.459 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:29 smithi045 ceph-mon[31180]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:29.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:29 smithi165 ceph-mon[35551]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:29 smithi100 ceph-mon[35319]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:30.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:30 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:30.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:30 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:30.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:30 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:30.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:30 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:30.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:30 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:30.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:30 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:30.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:30 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:30.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:30 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:30.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:30 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:31.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:31 smithi045 ceph-mon[31180]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:31.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:31 smithi165 ceph-mon[35551]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:31.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:31 smithi100 ceph-mon[35319]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:32 smithi165 ceph-mon[35551]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:33.217 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:32 smithi045 ceph-mon[31180]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:33.217 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:33.217 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:33.217 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:33.217 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:33.217 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:32 smithi100 ceph-mon[35319]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:33.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:33.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:33.821+0000 7fa2437fe640 1 -- 172.21.15.45:0/2112480367 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa24c0fe440 con 0x7fa238039500 2024-09-15T22:08:33.824 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 0 on host 'smithi045' 2024-09-15T22:08:33.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:33.824+0000 7fa2544aa640 1 -- 172.21.15.45:0/2112480367 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa238039500 msgr2=0x7fa23803b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:33.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:33.824+0000 7fa2544aa640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa238039500 0x7fa23803b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa24c19b7b0 tx=0x7fa23c009110 comp rx=0 tx=0).stop 2024-09-15T22:08:33.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:33.824+0000 7fa2544aa640 1 -- 172.21.15.45:0/2112480367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24c100b10 msgr2=0x7fa24c19a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:33.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:33.824+0000 7fa2544aa640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24c100b10 0x7fa24c19a290 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa24800d770 tx=0x7fa24800db70 comp rx=0 tx=0).stop 2024-09-15T22:08:33.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:33.824+0000 7fa2544aa640 1 -- 172.21.15.45:0/2112480367 shutdown_connections 2024-09-15T22:08:33.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:33.824+0000 7fa2544aa640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa238039500 0x7fa23803b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:33.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:33.824+0000 7fa2544aa640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa24c1026d0 0x7fa24c1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:33.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:33.824+0000 7fa2544aa640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa24c101d10 0x7fa24c19a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:33.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:33.824+0000 7fa2544aa640 1 --2- 172.21.15.45:0/2112480367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa24c100b10 0x7fa24c19a290 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:33.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:33.824+0000 7fa2544aa640 1 -- 172.21.15.45:0/2112480367 >> 172.21.15.45:0/2112480367 conn(0x7fa24c0fc2a0 msgr2=0x7fa24c0fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:33.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:33.825+0000 7fa2544aa640 1 -- 172.21.15.45:0/2112480367 shutdown_connections 2024-09-15T22:08:33.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:08:33.825+0000 7fa2544aa640 1 -- 172.21.15.45:0/2112480367 wait complete. 2024-09-15T22:08:34.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:34.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:34.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:34.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:34.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:34.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:34.329 DEBUG:teuthology.orchestra.run.smithi045:osd.0> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.0.service 2024-09-15T22:08:34.331 INFO:tasks.cephadm:Deploying osd.1 on smithi100 with /dev/vg_nvme/lv_4... 2024-09-15T22:08:34.332 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:08:34.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:34.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:34.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:34.569 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:08:35.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:34 smithi100 ceph-mon[35319]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:35.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:34 smithi100 ceph-mon[35319]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:08:35.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:34 smithi045 ceph-mon[31180]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:35.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:34 smithi045 ceph-mon[31180]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:08:35.300 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:08:34 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0[45264]: 2024-09-15T22:08:34.932+0000 7fd3de773640 -1 osd.0 0 log_to_monitors true 2024-09-15T22:08:35.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:34 smithi165 ceph-mon[35551]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:35.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:34 smithi165 ceph-mon[35551]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T22:08:36.112 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:35 smithi100 ceph-mon[35319]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:08:36.112 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:35 smithi100 ceph-mon[35319]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:08:36.113 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:35 smithi100 ceph-mon[35319]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-15T22:08:36.113 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:35 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:36.113 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:35 smithi100 ceph-mon[35319]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:35 smithi045 ceph-mon[31180]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:35 smithi045 ceph-mon[31180]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:35 smithi045 ceph-mon[31180]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-15T22:08:36.177 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:35 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:36.178 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:35 smithi045 ceph-mon[31180]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-15T22:08:36.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:35 smithi165 ceph-mon[35551]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T22:08:36.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:35 smithi165 ceph-mon[35551]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T22:08:36.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:35 smithi165 ceph-mon[35551]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-15T22:08:36.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:35 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:36.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:35 smithi165 ceph-mon[35551]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-15T22:08:36.799 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:08:36 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0[45264]: 2024-09-15T22:08:36.544+0000 7fd3daf0a640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T22:08:36.800 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:08:36 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0[45264]: 2024-09-15T22:08:36.548+0000 7fd3d2516640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:08:36.869 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:08:36.894 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_4 2024-09-15T22:08:37.136 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:08:37.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:36 smithi100 ceph-mon[35319]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:37.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:36 smithi100 ceph-mon[35319]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:08:37.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:37.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:37.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:36 smithi100 ceph-mon[35319]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' 2024-09-15T22:08:37.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:37.263 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:36 smithi045 ceph-mon[31180]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:37.264 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:36 smithi045 ceph-mon[31180]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:08:37.264 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:37.264 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:37.264 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:36 smithi045 ceph-mon[31180]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' 2024-09-15T22:08:37.264 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:37.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:36 smithi165 ceph-mon[35551]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:37.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:36 smithi165 ceph-mon[35551]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T22:08:37.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:37.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:37.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:36 smithi165 ceph-mon[35551]: from='osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873]' entity='osd.0' 2024-09-15T22:08:37.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:37.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.544+0000 7fa39ac37640 1 -- 172.21.15.100:0/2851248983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa394101c00 msgr2=0x7fa394102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:37.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.544+0000 7fa39ac37640 1 --2- 172.21.15.100:0/2851248983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa394101c00 0x7fa394102000 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa388009900 tx=0x7fa38802a410 comp rx=0 tx=0).stop 2024-09-15T22:08:37.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.544+0000 7fa39ac37640 1 -- 172.21.15.100:0/2851248983 shutdown_connections 2024-09-15T22:08:37.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.544+0000 7fa39ac37640 1 --2- 172.21.15.100:0/2851248983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3941037c0 0x7fa39410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:37.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.544+0000 7fa39ac37640 1 --2- 172.21.15.100:0/2851248983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394102e00 0x7fa394103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:37.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.544+0000 7fa39ac37640 1 --2- 172.21.15.100:0/2851248983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa394101c00 0x7fa394102000 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:37.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.544+0000 7fa39ac37640 1 -- 172.21.15.100:0/2851248983 >> 172.21.15.100:0/2851248983 conn(0x7fa3940fd390 msgr2=0x7fa3940ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:37.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.544+0000 7fa39ac37640 1 -- 172.21.15.100:0/2851248983 shutdown_connections 2024-09-15T22:08:37.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.544+0000 7fa39ac37640 1 -- 172.21.15.100:0/2851248983 wait complete. 2024-09-15T22:08:37.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.545+0000 7fa39ac37640 1 Processor -- start 2024-09-15T22:08:37.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.545+0000 7fa39ac37640 1 -- start start 2024-09-15T22:08:37.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.545+0000 7fa39ac37640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa394101c00 0x7fa394197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:37.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.545+0000 7fa39ac37640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394102e00 0x7fa3941984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:37.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.545+0000 7fa39ac37640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3941037c0 0x7fa39419f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:37.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.545+0000 7fa39ac37640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa39410da10 con 0x7fa394102e00 2024-09-15T22:08:37.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.545+0000 7fa39ac37640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa39410d890 con 0x7fa394101c00 2024-09-15T22:08:37.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.545+0000 7fa39ac37640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa39410db90 con 0x7fa3941037c0 2024-09-15T22:08:37.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.545+0000 7fa3989d3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa394101c00 0x7fa394197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:37.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa3989d3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa394101c00 0x7fa394197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:37508/0 (socket says 172.21.15.100:37508) 2024-09-15T22:08:37.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa3989d3640 1 -- 172.21.15.100:0/410512658 learned_addr learned my addr 172.21.15.100:0/410512658 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-15T22:08:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa393fff640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394102e00 0x7fa3941984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa3991d4640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3941037c0 0x7fa39419f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa3989d3640 1 -- 172.21.15.100:0/410512658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3941037c0 msgr2=0x7fa39419f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa3989d3640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3941037c0 0x7fa39419f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa3989d3640 1 -- 172.21.15.100:0/410512658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394102e00 msgr2=0x7fa3941984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa3989d3640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394102e00 0x7fa3941984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa3989d3640 1 -- 172.21.15.100:0/410512658 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39419fb90 con 0x7fa394101c00 2024-09-15T22:08:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa393fff640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394102e00 0x7fa3941984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:08:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa3989d3640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa394101c00 0x7fa394197f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa3880316a0 tx=0x7fa388032d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa391ffb640 1 -- 172.21.15.100:0/410512658 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38803f030 con 0x7fa394101c00 2024-09-15T22:08:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa39ac37640 1 -- 172.21.15.100:0/410512658 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa39419fe20 con 0x7fa394101c00 2024-09-15T22:08:37.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa391ffb640 1 -- 172.21.15.100:0/410512658 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa388003d00 con 0x7fa394101c00 2024-09-15T22:08:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa391ffb640 1 -- 172.21.15.100:0/410512658 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa388035070 con 0x7fa394101c00 2024-09-15T22:08:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.546+0000 7fa39ac37640 1 -- 172.21.15.100:0/410512658 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3941a0220 con 0x7fa394101c00 2024-09-15T22:08:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.547+0000 7fa39ac37640 1 -- 172.21.15.100:0/410512658 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa394108f30 con 0x7fa394101c00 2024-09-15T22:08:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.549+0000 7fa391ffb640 1 -- 172.21.15.100:0/410512658 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fa388042030 con 0x7fa394101c00 2024-09-15T22:08:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.549+0000 7fa391ffb640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3840a31e0 0x7fa3840a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:08:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.549+0000 7fa391ffb640 1 -- 172.21.15.100:0/410512658 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fa3880ee720 con 0x7fa394101c00 2024-09-15T22:08:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.549+0000 7fa393fff640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3840a31e0 0x7fa3840a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:08:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.550+0000 7fa393fff640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3840a31e0 0x7fa3840a56a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa380005d00 tx=0x7fa380005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:08:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.553+0000 7fa391ffb640 1 -- 172.21.15.100:0/410512658 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3880bcfd0 con 0x7fa394101c00 2024-09-15T22:08:37.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:37.728+0000 7fa39ac37640 1 -- 172.21.15.100:0/410512658 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa394062630 con 0x7fa3840a31e0 2024-09-15T22:08:38.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: purged_snaps scrub starts 2024-09-15T22:08:38.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: purged_snaps scrub ok 2024-09-15T22:08:38.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:38.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: Detected new or changed devices on smithi045 2024-09-15T22:08:38.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:38.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:38.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:38.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi045 to 17092M 2024-09-15T22:08:38.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:38.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:38.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:38.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:38.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873] boot 2024-09-15T22:08:38.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:08:38.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:38.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:38.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:08:38.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:08:38.717 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: purged_snaps scrub starts 2024-09-15T22:08:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: purged_snaps scrub ok 2024-09-15T22:08:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: Detected new or changed devices on smithi045 2024-09-15T22:08:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:38.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:38.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:38.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi045 to 17092M 2024-09-15T22:08:38.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:38.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:38.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:38.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:38.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873] boot 2024-09-15T22:08:38.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:08:38.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:38.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:38.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:08:38.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:08:38.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:38.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: purged_snaps scrub starts 2024-09-15T22:08:38.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: purged_snaps scrub ok 2024-09-15T22:08:38.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T22:08:38.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: Detected new or changed devices on smithi045 2024-09-15T22:08:38.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:38.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:38.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:08:38.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi045 to 17092M 2024-09-15T22:08:38.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:38.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:38.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:38.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:38.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: osd.0 [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873] boot 2024-09-15T22:08:38.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T22:08:38.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:08:38.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:08:38.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:08:38.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:08:38.802 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:40.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:39 smithi045 ceph-mon[31180]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T22:08:40.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:39 smithi045 ceph-mon[31180]: from='client.? 172.21.15.100:0/1488594818' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "611af0ab-00b8-49e8-96ed-41fcbed176ff"}]: dispatch 2024-09-15T22:08:40.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:39 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "611af0ab-00b8-49e8-96ed-41fcbed176ff"}]: dispatch 2024-09-15T22:08:40.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:39 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "611af0ab-00b8-49e8-96ed-41fcbed176ff"}]': finished 2024-09-15T22:08:40.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:39 smithi045 ceph-mon[31180]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:08:40.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:39 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:08:40.459 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:39 smithi100 ceph-mon[35319]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T22:08:40.460 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:39 smithi100 ceph-mon[35319]: from='client.? 172.21.15.100:0/1488594818' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "611af0ab-00b8-49e8-96ed-41fcbed176ff"}]: dispatch 2024-09-15T22:08:40.460 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:39 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "611af0ab-00b8-49e8-96ed-41fcbed176ff"}]: dispatch 2024-09-15T22:08:40.460 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:39 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "611af0ab-00b8-49e8-96ed-41fcbed176ff"}]': finished 2024-09-15T22:08:40.460 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:39 smithi100 ceph-mon[35319]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:08:40.460 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:39 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:08:40.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:39 smithi165 ceph-mon[35551]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T22:08:40.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:39 smithi165 ceph-mon[35551]: from='client.? 172.21.15.100:0/1488594818' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "611af0ab-00b8-49e8-96ed-41fcbed176ff"}]: dispatch 2024-09-15T22:08:40.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:39 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "611af0ab-00b8-49e8-96ed-41fcbed176ff"}]: dispatch 2024-09-15T22:08:40.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:39 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "611af0ab-00b8-49e8-96ed-41fcbed176ff"}]': finished 2024-09-15T22:08:40.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:39 smithi165 ceph-mon[35551]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T22:08:40.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:39 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:08:41.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:40 smithi045 ceph-mon[31180]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:41.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:40 smithi045 ceph-mon[31180]: from='client.? 172.21.15.100:0/1312796396' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:08:41.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:40 smithi165 ceph-mon[35551]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:41.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:40 smithi165 ceph-mon[35551]: from='client.? 172.21.15.100:0/1312796396' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:08:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:40 smithi100 ceph-mon[35319]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:40 smithi100 ceph-mon[35319]: from='client.? 172.21.15.100:0/1312796396' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:08:43.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:43 smithi045 ceph-mon[31180]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:43.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:43 smithi165 ceph-mon[35551]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:43.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:43 smithi100 ceph-mon[35319]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:45.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:45 smithi045 ceph-mon[31180]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:45.407 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:45 smithi100 ceph-mon[35319]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:45.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:45 smithi165 ceph-mon[35551]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:47.113 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:47 smithi100 ceph-mon[35319]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:47.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:47 smithi045 ceph-mon[31180]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:47.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:47 smithi165 ceph-mon[35551]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:49.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:49 smithi045 ceph-mon[31180]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:49.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:49 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:08:49.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:49 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:49.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:49 smithi165 ceph-mon[35551]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:49.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:49 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:08:49.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:49 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:49.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:49 smithi100 ceph-mon[35319]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:49.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:49 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T22:08:49.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:49 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:50.220 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:50 smithi100 ceph-mon[35319]: Deploying daemon osd.1 on smithi100 2024-09-15T22:08:50.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:50 smithi045 ceph-mon[31180]: Deploying daemon osd.1 on smithi100 2024-09-15T22:08:50.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:50 smithi165 ceph-mon[35551]: Deploying daemon osd.1 on smithi100 2024-09-15T22:08:51.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:51 smithi045 ceph-mon[31180]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:51.320 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:51 smithi100 ceph-mon[35319]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:51.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:51 smithi165 ceph-mon[35551]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:53.283 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:53 smithi165 ceph-mon[35551]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:53.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:53 smithi045 ceph-mon[31180]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:53.423 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:53 smithi100 ceph-mon[35319]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:55.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:55 smithi100 ceph-mon[35319]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:55.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:55 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:55.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:55 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:55.270 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:55 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:55 smithi045 ceph-mon[31180]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:55 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:55 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:55 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:55 smithi165 ceph-mon[35551]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:55 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:55 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:55 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:57.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:57 smithi045 ceph-mon[31180]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:57.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:57 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:57.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:57 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:57.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:57 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:57.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:57 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:57.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:57 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:57.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:57 smithi165 ceph-mon[35551]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:57.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:57 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:57.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:57 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:57.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:57 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:57.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:57 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:57.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:57 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:57 smithi100 ceph-mon[35319]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:08:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:08:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:58.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:58.836+0000 7fa391ffb640 1 -- 172.21.15.100:0/410512658 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa394062630 con 0x7fa3840a31e0 2024-09-15T22:08:58.839 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 1 on host 'smithi100' 2024-09-15T22:08:58.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:58.838+0000 7fa39ac37640 1 -- 172.21.15.100:0/410512658 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3840a31e0 msgr2=0x7fa3840a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:58.838+0000 7fa39ac37640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3840a31e0 0x7fa3840a56a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa380005d00 tx=0x7fa380005c70 comp rx=0 tx=0).stop 2024-09-15T22:08:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:58.838+0000 7fa39ac37640 1 -- 172.21.15.100:0/410512658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa394101c00 msgr2=0x7fa394197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:08:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:58.838+0000 7fa39ac37640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa394101c00 0x7fa394197f60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa3880316a0 tx=0x7fa388032d70 comp rx=0 tx=0).stop 2024-09-15T22:08:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:58.838+0000 7fa39ac37640 1 -- 172.21.15.100:0/410512658 shutdown_connections 2024-09-15T22:08:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:58.838+0000 7fa39ac37640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3840a31e0 0x7fa3840a56a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:58.838+0000 7fa39ac37640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3941037c0 0x7fa39419f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:58.838+0000 7fa39ac37640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa394102e00 0x7fa3941984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:58.838+0000 7fa39ac37640 1 --2- 172.21.15.100:0/410512658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa394101c00 0x7fa394197f60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:08:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:58.839+0000 7fa39ac37640 1 -- 172.21.15.100:0/410512658 >> 172.21.15.100:0/410512658 conn(0x7fa3940fd390 msgr2=0x7fa394106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:08:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:58.839+0000 7fa39ac37640 1 -- 172.21.15.100:0/410512658 shutdown_connections 2024-09-15T22:08:58.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:08:58.839+0000 7fa39ac37640 1 -- 172.21.15.100:0/410512658 wait complete. 2024-09-15T22:08:59.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:59 smithi100 ceph-mon[35319]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:59.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:59 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:59.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:59 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:59.119 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:08:59 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:59.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:59 smithi045 ceph-mon[31180]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:59.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:59 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:59.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:59 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:59.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:08:59 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:59.414 DEBUG:teuthology.orchestra.run.smithi100:osd.1> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.1.service 2024-09-15T22:08:59.417 INFO:tasks.cephadm:Deploying osd.2 on smithi165 with /dev/vg_nvme/lv_4... 2024-09-15T22:08:59.417 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T22:08:59.445 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:59 smithi165 ceph-mon[35551]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:08:59.445 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:59 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:08:59.445 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:59 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:59.446 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:08:59 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:08:59.671 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:09:00.725 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:09:00 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1[39766]: 2024-09-15T22:09:00.611+0000 7f99c732f640 -1 osd.1 0 log_to_monitors true 2024-09-15T22:09:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:01 smithi045 ceph-mon[31180]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:09:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:01 smithi045 ceph-mon[31180]: from='osd.1 [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:09:01.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:01 smithi045 ceph-mon[31180]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:09:01.363 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:01 smithi165 ceph-mon[35551]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:09:01.363 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:01 smithi165 ceph-mon[35551]: from='osd.1 [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:09:01.364 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:01 smithi165 ceph-mon[35551]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:09:01.473 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:01 smithi100 ceph-mon[35319]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:09:01.473 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:01 smithi100 ceph-mon[35319]: from='osd.1 [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:09:01.473 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:01 smithi100 ceph-mon[35319]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T22:09:02.041 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:09:02.068 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_4 2024-09-15T22:09:02.200 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:02 smithi100 ceph-mon[35319]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:09:02.200 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:02 smithi100 ceph-mon[35319]: from='osd.1 [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:09:02.200 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:02 smithi100 ceph-mon[35319]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:09:02.200 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:02 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:02.200 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:02 smithi100 ceph-mon[35319]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:09:02.200 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:02 smithi100 ceph-mon[35319]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-15T22:09:02.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:02 smithi165 ceph-mon[35551]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:09:02.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:02 smithi165 ceph-mon[35551]: from='osd.1 [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:09:02.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:02 smithi165 ceph-mon[35551]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:09:02.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:02.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:02 smithi165 ceph-mon[35551]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:09:02.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:02 smithi165 ceph-mon[35551]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-15T22:09:02.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:02 smithi045 ceph-mon[31180]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T22:09:02.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:02 smithi045 ceph-mon[31180]: from='osd.1 [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:09:02.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:02 smithi045 ceph-mon[31180]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T22:09:02.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:02.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:02 smithi045 ceph-mon[31180]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:09:02.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:02 smithi045 ceph-mon[31180]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-15T22:09:02.353 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:09:02.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.821+0000 7ffb8d10d640 1 -- 172.21.15.165:0/1893515150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb88103870 msgr2=0x7ffb8810a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:02.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.821+0000 7ffb8d10d640 1 --2- 172.21.15.165:0/1893515150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb88103870 0x7ffb8810a100 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009cd0 tx=0x7ffb8002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:09:02.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.821+0000 7ffb8d10d640 1 -- 172.21.15.165:0/1893515150 shutdown_connections 2024-09-15T22:09:02.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.821+0000 7ffb8d10d640 1 --2- 172.21.15.165:0/1893515150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb88103870 0x7ffb8810a100 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:02.825 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.821+0000 7ffb8d10d640 1 --2- 172.21.15.165:0/1893515150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb88102eb0 0x7ffb88103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:02.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.821+0000 7ffb8d10d640 1 --2- 172.21.15.165:0/1893515150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb880ffed0 0x7ffb881002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:02.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.821+0000 7ffb8d10d640 1 -- 172.21.15.165:0/1893515150 >> 172.21.15.165:0/1893515150 conn(0x7ffb880fba40 msgr2=0x7ffb880fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:02.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.821+0000 7ffb8d10d640 1 -- 172.21.15.165:0/1893515150 shutdown_connections 2024-09-15T22:09:02.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.821+0000 7ffb8d10d640 1 -- 172.21.15.165:0/1893515150 wait complete. 2024-09-15T22:09:02.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.822+0000 7ffb8d10d640 1 Processor -- start 2024-09-15T22:09:02.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.822+0000 7ffb8d10d640 1 -- start start 2024-09-15T22:09:02.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.822+0000 7ffb8d10d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb880ffed0 0x7ffb88197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:02.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.822+0000 7ffb8d10d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb88102eb0 0x7ffb881984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:02.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb8d10d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb88103870 0x7ffb8819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:02.826 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb8d10d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8810d9f0 con 0x7ffb88103870 2024-09-15T22:09:02.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb8d10d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8810d870 con 0x7ffb88102eb0 2024-09-15T22:09:02.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb8d10d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8810db70 con 0x7ffb880ffed0 2024-09-15T22:09:02.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb86d9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb880ffed0 0x7ffb88197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:02.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb86d9d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb880ffed0 0x7ffb88197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:53528/0 (socket says 172.21.15.165:53528) 2024-09-15T22:09:02.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb86d9d640 1 -- 172.21.15.165:0/898619171 learned_addr learned my addr 172.21.15.165:0/898619171 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-15T22:09:02.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb8659c640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb88102eb0 0x7ffb881984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:02.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb8759e640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb88103870 0x7ffb8819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:02.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb86d9d640 1 -- 172.21.15.165:0/898619171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb88102eb0 msgr2=0x7ffb881984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:02.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb86d9d640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb88102eb0 0x7ffb881984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:02.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb86d9d640 1 -- 172.21.15.165:0/898619171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb88103870 msgr2=0x7ffb8819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:02.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb86d9d640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb88103870 0x7ffb8819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:02.827 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb86d9d640 1 -- 172.21.15.165:0/898619171 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb8819fba0 con 0x7ffb880ffed0 2024-09-15T22:09:02.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb8659c640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb88102eb0 0x7ffb881984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:02.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb8759e640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb88103870 0x7ffb8819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:09:02.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb86d9d640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb880ffed0 0x7ffb88197f70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800d770 tx=0x7ffb7800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:02.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb6ffff640 1 -- 172.21.15.165:0/898619171 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78017070 con 0x7ffb880ffed0 2024-09-15T22:09:02.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb6ffff640 1 -- 172.21.15.165:0/898619171 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffb78009c30 con 0x7ffb880ffed0 2024-09-15T22:09:02.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb8d10d640 1 -- 172.21.15.165:0/898619171 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb8819fe90 con 0x7ffb880ffed0 2024-09-15T22:09:02.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb6ffff640 1 -- 172.21.15.165:0/898619171 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb78003e40 con 0x7ffb880ffed0 2024-09-15T22:09:02.828 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.823+0000 7ffb8d10d640 1 -- 172.21.15.165:0/898619171 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb881a02f0 con 0x7ffb880ffed0 2024-09-15T22:09:02.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.824+0000 7ffb8d10d640 1 -- 172.21.15.165:0/898619171 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb88108fe0 con 0x7ffb880ffed0 2024-09-15T22:09:02.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.825+0000 7ffb6ffff640 1 -- 172.21.15.165:0/898619171 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7ffb78003fe0 con 0x7ffb880ffed0 2024-09-15T22:09:02.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.826+0000 7ffb6ffff640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ffb700a31e0 0x7ffb700a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:02.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.826+0000 7ffb6ffff640 1 -- 172.21.15.165:0/898619171 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7ffb780cd980 con 0x7ffb880ffed0 2024-09-15T22:09:02.829 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.826+0000 7ffb8659c640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ffb700a31e0 0x7ffb700a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:02.830 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.827+0000 7ffb8659c640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ffb700a31e0 0x7ffb700a56a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffb88199490 tx=0x7ffb7c005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:02.831 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:02.830+0000 7ffb6ffff640 1 -- 172.21.15.165:0/898619171 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffb78009de0 con 0x7ffb880ffed0 2024-09-15T22:09:02.994 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:09:02 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1[39766]: 2024-09-15T22:09:02.711+0000 7f99c32b2640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T22:09:02.994 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:09:02 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1[39766]: 2024-09-15T22:09:02.715+0000 7f99bb0d2640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:09:03.005 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:03.004+0000 7ffb8d10d640 1 -- 172.21.15.165:0/898619171 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ffb88062630 con 0x7ffb700a31e0 2024-09-15T22:09:03.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:09:03.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T22:09:03.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:03.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:03.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: Detected new or changed devices on smithi100 2024-09-15T22:09:03.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:03.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:03.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:03.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:03.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:03.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:03.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:03.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='osd.1 ' entity='osd.1' 2024-09-15T22:09:03.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:09:03.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:09:03.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:03.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:03.408 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:09:03.408 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T22:09:03.408 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:03.408 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:03.408 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: Detected new or changed devices on smithi100 2024-09-15T22:09:03.408 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:03.408 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:03.408 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:03.409 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:03.409 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:03.409 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:03.409 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:03.409 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='osd.1 ' entity='osd.1' 2024-09-15T22:09:03.409 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:09:03.409 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:09:03.409 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:03.409 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:03.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:09:03.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T22:09:03.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:03.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:03.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: Detected new or changed devices on smithi100 2024-09-15T22:09:03.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:03.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:03.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:03.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:03.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:03.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:03.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:03.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='osd.1 ' entity='osd.1' 2024-09-15T22:09:03.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:09:03.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:09:03.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:03.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:04.346 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:04 smithi165 ceph-mon[35551]: purged_snaps scrub starts 2024-09-15T22:09:04.346 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:04 smithi165 ceph-mon[35551]: purged_snaps scrub ok 2024-09-15T22:09:04.347 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:04 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-15T22:09:04.347 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:04 smithi165 ceph-mon[35551]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:09:04.347 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:04 smithi165 ceph-mon[35551]: osd.1 [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440] boot 2024-09-15T22:09:04.347 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:04 smithi165 ceph-mon[35551]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T22:09:04.347 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:04 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:04.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:04 smithi100 ceph-mon[35319]: purged_snaps scrub starts 2024-09-15T22:09:04.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:04 smithi100 ceph-mon[35319]: purged_snaps scrub ok 2024-09-15T22:09:04.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:04 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-15T22:09:04.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:04 smithi100 ceph-mon[35319]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:09:04.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:04 smithi100 ceph-mon[35319]: osd.1 [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440] boot 2024-09-15T22:09:04.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:04 smithi100 ceph-mon[35319]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T22:09:04.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:04.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:04 smithi045 ceph-mon[31180]: purged_snaps scrub starts 2024-09-15T22:09:04.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:04 smithi045 ceph-mon[31180]: purged_snaps scrub ok 2024-09-15T22:09:04.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:04 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi100 to 17087M 2024-09-15T22:09:04.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:04 smithi045 ceph-mon[31180]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:09:04.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:04 smithi045 ceph-mon[31180]: osd.1 [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440] boot 2024-09-15T22:09:04.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:04 smithi045 ceph-mon[31180]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T22:09:04.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:04 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:09:05.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:05 smithi165 ceph-mon[35551]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:09:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:05 smithi100 ceph-mon[35319]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:09:05.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:05 smithi045 ceph-mon[31180]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-15T22:09:06.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:06 smithi165 ceph-mon[35551]: osdmap e14: 2 total, 2 up, 2 in 2024-09-15T22:09:06.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:06 smithi165 ceph-mon[35551]: from='client.? 172.21.15.165:0/3957018423' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdf40a1b-1f33-4f51-bbed-bf9041598d50"}]: dispatch 2024-09-15T22:09:06.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:06 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdf40a1b-1f33-4f51-bbed-bf9041598d50"}]: dispatch 2024-09-15T22:09:06.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:06 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdf40a1b-1f33-4f51-bbed-bf9041598d50"}]': finished 2024-09-15T22:09:06.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:06 smithi165 ceph-mon[35551]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:09:06.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:06 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:06.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:06 smithi165 ceph-mon[35551]: from='client.? 172.21.15.165:0/3237225111' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:09:06.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:06 smithi100 ceph-mon[35319]: osdmap e14: 2 total, 2 up, 2 in 2024-09-15T22:09:06.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:06 smithi100 ceph-mon[35319]: from='client.? 172.21.15.165:0/3957018423' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdf40a1b-1f33-4f51-bbed-bf9041598d50"}]: dispatch 2024-09-15T22:09:06.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:06 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdf40a1b-1f33-4f51-bbed-bf9041598d50"}]: dispatch 2024-09-15T22:09:06.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:06 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdf40a1b-1f33-4f51-bbed-bf9041598d50"}]': finished 2024-09-15T22:09:06.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:06 smithi100 ceph-mon[35319]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:09:06.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:06 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:06.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:06 smithi100 ceph-mon[35319]: from='client.? 172.21.15.165:0/3237225111' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:09:06.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:06 smithi045 ceph-mon[31180]: osdmap e14: 2 total, 2 up, 2 in 2024-09-15T22:09:06.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:06 smithi045 ceph-mon[31180]: from='client.? 172.21.15.165:0/3957018423' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdf40a1b-1f33-4f51-bbed-bf9041598d50"}]: dispatch 2024-09-15T22:09:06.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:06 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bdf40a1b-1f33-4f51-bbed-bf9041598d50"}]: dispatch 2024-09-15T22:09:06.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:06 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdf40a1b-1f33-4f51-bbed-bf9041598d50"}]': finished 2024-09-15T22:09:06.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:06 smithi045 ceph-mon[31180]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T22:09:06.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:06 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:06.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:06 smithi045 ceph-mon[31180]: from='client.? 172.21.15.165:0/3237225111' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:09:07.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:07 smithi165 ceph-mon[35551]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:07 smithi100 ceph-mon[35319]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:07.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:07 smithi045 ceph-mon[31180]: pgmap v60: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:09.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:09 smithi165 ceph-mon[35551]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:09.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:09 smithi100 ceph-mon[35319]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:09.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:09 smithi045 ceph-mon[31180]: pgmap v61: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:11.352 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:11 smithi045 ceph-mon[31180]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:11.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:11 smithi165 ceph-mon[35551]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:11.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:11 smithi100 ceph-mon[35319]: pgmap v62: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:13.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:13 smithi165 ceph-mon[35551]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:13.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:13 smithi100 ceph-mon[35319]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:13.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:13 smithi045 ceph-mon[31180]: pgmap v63: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:14.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:09:14.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:14.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:09:14.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:14.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T22:09:14.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:15.127 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:15 smithi165 ceph-mon[35551]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:15.127 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:15 smithi165 ceph-mon[35551]: Deploying daemon osd.2 on smithi165 2024-09-15T22:09:15.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:15 smithi100 ceph-mon[35319]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:15.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:15 smithi100 ceph-mon[35319]: Deploying daemon osd.2 on smithi165 2024-09-15T22:09:15.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:15 smithi045 ceph-mon[31180]: pgmap v64: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:15.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:15 smithi045 ceph-mon[31180]: Deploying daemon osd.2 on smithi165 2024-09-15T22:09:17.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:17 smithi165 ceph-mon[35551]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:17 smithi100 ceph-mon[35319]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:17.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:17 smithi045 ceph-mon[31180]: pgmap v65: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:19.267 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:19 smithi165 ceph-mon[35551]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:19.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:19 smithi100 ceph-mon[35319]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:19.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:19 smithi045 ceph-mon[31180]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:20.421 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:20.422 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:20.422 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:20.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:20.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:20.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:21.358 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:21 smithi165 ceph-mon[35551]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:21.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:21 smithi100 ceph-mon[35319]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:21.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:21 smithi045 ceph-mon[31180]: pgmap v67: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:23.395 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:23 smithi165 ceph-mon[35551]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:23.395 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:23.395 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:23.395 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:23.395 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:23.396 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:23 smithi100 ceph-mon[35319]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:23.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:23.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:23.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:23 smithi045 ceph-mon[31180]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:23.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:23.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:23.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:23.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:23.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:24.129 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 2 on host 'smithi165' 2024-09-15T22:09:24.129 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:24.126+0000 7ffb6ffff640 1 -- 172.21.15.165:0/898619171 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ffb88062630 con 0x7ffb700a31e0 2024-09-15T22:09:24.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:24.128+0000 7ffb8d10d640 1 -- 172.21.15.165:0/898619171 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ffb700a31e0 msgr2=0x7ffb700a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:24.128+0000 7ffb8d10d640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ffb700a31e0 0x7ffb700a56a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ffb88199490 tx=0x7ffb7c005d90 comp rx=0 tx=0).stop 2024-09-15T22:09:24.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:24.129+0000 7ffb8d10d640 1 -- 172.21.15.165:0/898619171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb880ffed0 msgr2=0x7ffb88197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:24.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:24.129+0000 7ffb8d10d640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb880ffed0 0x7ffb88197f70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800d770 tx=0x7ffb7800dc30 comp rx=0 tx=0).stop 2024-09-15T22:09:24.131 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:24.129+0000 7ffb8d10d640 1 -- 172.21.15.165:0/898619171 shutdown_connections 2024-09-15T22:09:24.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:24.129+0000 7ffb8d10d640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ffb700a31e0 0x7ffb700a56a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:24.129+0000 7ffb8d10d640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb88103870 0x7ffb8819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:24.129+0000 7ffb8d10d640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffb88102eb0 0x7ffb881984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:24.129+0000 7ffb8d10d640 1 --2- 172.21.15.165:0/898619171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ffb880ffed0 0x7ffb88197f70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:24.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:24.129+0000 7ffb8d10d640 1 -- 172.21.15.165:0/898619171 >> 172.21.15.165:0/898619171 conn(0x7ffb880fba40 msgr2=0x7ffb881061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:24.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:24.129+0000 7ffb8d10d640 1 -- 172.21.15.165:0/898619171 shutdown_connections 2024-09-15T22:09:24.132 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:09:24.129+0000 7ffb8d10d640 1 -- 172.21.15.165:0/898619171 wait complete. 2024-09-15T22:09:24.711 DEBUG:teuthology.orchestra.run.smithi165:osd.2> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.2.service 2024-09-15T22:09:24.713 INFO:tasks.cephadm:Deploying osd.3 on smithi045 with /dev/vg_nvme/lv_3... 2024-09-15T22:09:24.714 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:09:24.983 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:25.354 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:25 smithi045 ceph-mon[31180]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:25.354 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:25 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:25.354 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:25 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:25.354 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:25 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:25.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:25 smithi165 ceph-mon[35551]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:25.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:25 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:25.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:25 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:25.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:25 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:25.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:25 smithi100 ceph-mon[35319]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:25.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:25 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:25.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:25 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:25.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:25 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:25.965 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:09:25 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2[40498]: 2024-09-15T22:09:25.655+0000 7fba1d3c0640 -1 osd.2 0 log_to_monitors true 2024-09-15T22:09:26.289 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:26 smithi165 ceph-mon[35551]: from='osd.2 [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:09:26.289 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:26 smithi165 ceph-mon[35551]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:09:26.380 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:26 smithi045 ceph-mon[31180]: from='osd.2 [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:09:26.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:26 smithi045 ceph-mon[31180]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:09:26.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:26 smithi100 ceph-mon[35319]: from='osd.2 [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:09:26.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:26 smithi100 ceph-mon[35319]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T22:09:27.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:27 smithi165 ceph-mon[35551]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:27.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:27 smithi165 ceph-mon[35551]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:09:27.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:27 smithi165 ceph-mon[35551]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T22:09:27.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:27 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:27.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:27 smithi165 ceph-mon[35551]: from='osd.2 [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:09:27.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:27 smithi165 ceph-mon[35551]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:09:27.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:27 smithi045 ceph-mon[31180]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:27.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:27 smithi045 ceph-mon[31180]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:09:27.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:27 smithi045 ceph-mon[31180]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T22:09:27.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:27 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:27.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:27 smithi045 ceph-mon[31180]: from='osd.2 [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:09:27.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:27 smithi045 ceph-mon[31180]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:09:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:27 smithi100 ceph-mon[35319]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:27 smithi100 ceph-mon[35319]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T22:09:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:27 smithi100 ceph-mon[35319]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T22:09:27.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:27 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:27.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:27 smithi100 ceph-mon[35319]: from='osd.2 [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:09:27.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:27 smithi100 ceph-mon[35319]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:09:27.744 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:09:27.769 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_3 2024-09-15T22:09:27.964 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:09:27 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2[40498]: 2024-09-15T22:09:27.804+0000 7fba19343640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T22:09:27.965 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:09:27 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2[40498]: 2024-09-15T22:09:27.807+0000 7fba11163640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:09:28.024 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:09:28.459 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:28 smithi045 ceph-mon[31180]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-15T22:09:28.460 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:28 smithi045 ceph-mon[31180]: osdmap e17: 3 total, 2 up, 3 in 2024-09-15T22:09:28.460 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:28.460 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:28.460 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:28.460 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:28.460 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:28.460 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:28.460 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:28.460 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:28.460 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:28.461 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:28 smithi045 ceph-mon[31180]: from='osd.2 ' entity='osd.2' 2024-09-15T22:09:28.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:28 smithi165 ceph-mon[35551]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-15T22:09:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:28 smithi165 ceph-mon[35551]: osdmap e17: 3 total, 2 up, 3 in 2024-09-15T22:09:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:28 smithi165 ceph-mon[35551]: from='osd.2 ' entity='osd.2' 2024-09-15T22:09:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:28 smithi100 ceph-mon[35319]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-15T22:09:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:28 smithi100 ceph-mon[35319]: osdmap e17: 3 total, 2 up, 3 in 2024-09-15T22:09:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:28.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:28.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:28.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:28.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:28.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:28.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:28.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:28.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:28 smithi100 ceph-mon[35319]: from='osd.2 ' entity='osd.2' 2024-09-15T22:09:28.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.543+0000 7f3248d44640 1 -- 172.21.15.45:0/2668922916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32441037c0 msgr2=0x7f324410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:28.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.543+0000 7f3248d44640 1 --2- 172.21.15.45:0/2668922916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32441037c0 0x7f324410a050 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f323c009900 tx=0x7f323c02a410 comp rx=0 tx=0).stop 2024-09-15T22:09:28.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.543+0000 7f3248d44640 1 -- 172.21.15.45:0/2668922916 shutdown_connections 2024-09-15T22:09:28.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.543+0000 7f3248d44640 1 --2- 172.21.15.45:0/2668922916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32441037c0 0x7f324410a050 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.543+0000 7f3248d44640 1 --2- 172.21.15.45:0/2668922916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3244102e00 0x7f3244103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.543+0000 7f3248d44640 1 --2- 172.21.15.45:0/2668922916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3244101c00 0x7f3244102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.543+0000 7f3248d44640 1 -- 172.21.15.45:0/2668922916 >> 172.21.15.45:0/2668922916 conn(0x7f32440fd390 msgr2=0x7f32440ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.543+0000 7f3248d44640 1 -- 172.21.15.45:0/2668922916 shutdown_connections 2024-09-15T22:09:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.543+0000 7f3248d44640 1 -- 172.21.15.45:0/2668922916 wait complete. 2024-09-15T22:09:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.544+0000 7f3248d44640 1 Processor -- start 2024-09-15T22:09:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.544+0000 7f3248d44640 1 -- start start 2024-09-15T22:09:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.544+0000 7f3248d44640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3244101c00 0x7f3244075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.544+0000 7f3248d44640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3244102e00 0x7f32440745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.544+0000 7f3248d44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32441037c0 0x7f3244074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:28.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.544+0000 7f3248d44640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f324410d9c0 con 0x7f32441037c0 2024-09-15T22:09:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.544+0000 7f3248d44640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f324410d840 con 0x7f3244101c00 2024-09-15T22:09:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.544+0000 7f3248d44640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f324410db40 con 0x7f3244102e00 2024-09-15T22:09:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.544+0000 7f3242d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32441037c0 0x7f3244074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f3242d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32441037c0 0x7f3244074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34986/0 (socket says 172.21.15.45:34986) 2024-09-15T22:09:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f3242d9d640 1 -- 172.21.15.45:0/3774882189 learned_addr learned my addr 172.21.15.45:0/3774882189 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:09:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f3241d9b640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3244102e00 0x7f32440745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f324259c640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3244101c00 0x7f3244075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f3242d9d640 1 -- 172.21.15.45:0/3774882189 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3244102e00 msgr2=0x7f32440745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f3242d9d640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3244102e00 0x7f32440745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f3242d9d640 1 -- 172.21.15.45:0/3774882189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3244101c00 msgr2=0x7f3244075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f3242d9d640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3244101c00 0x7f3244075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:28.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f3242d9d640 1 -- 172.21.15.45:0/3774882189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32440753e0 con 0x7f32441037c0 2024-09-15T22:09:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f324259c640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3244101c00 0x7f3244075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:09:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f3242d9d640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32441037c0 0x7f3244074b20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f323c0316a0 tx=0x7f323c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f323b7fe640 1 -- 172.21.15.45:0/3774882189 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c03f030 con 0x7f32441037c0 2024-09-15T22:09:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f323b7fe640 1 -- 172.21.15.45:0/3774882189 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f323c003d00 con 0x7f32441037c0 2024-09-15T22:09:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f3248d44640 1 -- 172.21.15.45:0/3774882189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32441a2000 con 0x7f32441037c0 2024-09-15T22:09:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f323b7fe640 1 -- 172.21.15.45:0/3774882189 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c035070 con 0x7f32441037c0 2024-09-15T22:09:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.545+0000 7f3248d44640 1 -- 172.21.15.45:0/3774882189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32441a24b0 con 0x7f32441037c0 2024-09-15T22:09:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.546+0000 7f3248d44640 1 -- 172.21.15.45:0/3774882189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3244108ed0 con 0x7f32441037c0 2024-09-15T22:09:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.548+0000 7f323b7fe640 1 -- 172.21.15.45:0/3774882189 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f323c042030 con 0x7f32441037c0 2024-09-15T22:09:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.548+0000 7f323b7fe640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32300a31b0 0x7f32300a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.549+0000 7f324259c640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32300a31b0 0x7f32300a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:28.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.549+0000 7f323b7fe640 1 -- 172.21.15.45:0/3774882189 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f323c0ee8d0 con 0x7f32441037c0 2024-09-15T22:09:28.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.549+0000 7f324259c640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32300a31b0 0x7f32300a5670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3244102c60 tx=0x7f3234009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:28.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.553+0000 7f323b7fe640 1 -- 172.21.15.45:0/3774882189 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f323c0bcd40 con 0x7f32441037c0 2024-09-15T22:09:28.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:28.735+0000 7f3248d44640 1 -- 172.21.15.45:0/3774882189 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3244062630 con 0x7f32300a31b0 2024-09-15T22:09:29.370 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:29 smithi045 ceph-mon[31180]: purged_snaps scrub starts 2024-09-15T22:09:29.370 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:29 smithi045 ceph-mon[31180]: purged_snaps scrub ok 2024-09-15T22:09:29.370 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:29 smithi045 ceph-mon[31180]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:29.370 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:29 smithi045 ceph-mon[31180]: Detected new or changed devices on smithi165 2024-09-15T22:09:29.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:29 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi165 to 17088M 2024-09-15T22:09:29.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:29 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:29.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:29 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:09:29.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:29 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:09:29.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:29 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:29.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:29 smithi045 ceph-mon[31180]: osd.2 [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014] boot 2024-09-15T22:09:29.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:29 smithi045 ceph-mon[31180]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:09:29.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:29 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:29 smithi165 ceph-mon[35551]: purged_snaps scrub starts 2024-09-15T22:09:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:29 smithi165 ceph-mon[35551]: purged_snaps scrub ok 2024-09-15T22:09:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:29 smithi165 ceph-mon[35551]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:29 smithi165 ceph-mon[35551]: Detected new or changed devices on smithi165 2024-09-15T22:09:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:29 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi165 to 17088M 2024-09-15T22:09:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:29 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:29 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:09:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:29 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:09:29.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:29 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:29.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:29 smithi165 ceph-mon[35551]: osd.2 [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014] boot 2024-09-15T22:09:29.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:29 smithi165 ceph-mon[35551]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:09:29.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:29 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:29 smithi100 ceph-mon[35319]: purged_snaps scrub starts 2024-09-15T22:09:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:29 smithi100 ceph-mon[35319]: purged_snaps scrub ok 2024-09-15T22:09:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:29 smithi100 ceph-mon[35319]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-09-15T22:09:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:29 smithi100 ceph-mon[35319]: Detected new or changed devices on smithi165 2024-09-15T22:09:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:29 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi165 to 17088M 2024-09-15T22:09:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:29 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:29.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:29 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:09:29.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:29 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:09:29.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:29 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:29.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:29 smithi100 ceph-mon[35319]: osd.2 [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014] boot 2024-09-15T22:09:29.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:29 smithi100 ceph-mon[35319]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T22:09:29.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:29 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:09:30.424 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:30 smithi045 ceph-mon[31180]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:09:30.425 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:30 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:09:30.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:30 smithi165 ceph-mon[35551]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:09:30.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:30 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:09:30.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:30 smithi100 ceph-mon[35319]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:09:30.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:30 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:09:31.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:31 smithi165 ceph-mon[35551]: pgmap v75: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:31.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:31 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:09:31.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:31 smithi165 ceph-mon[35551]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:09:31.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:31 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:09:31.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:31 smithi100 ceph-mon[35319]: pgmap v75: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:31.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:31 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:09:31.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:31 smithi100 ceph-mon[35319]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:09:31.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:31 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:09:31.497 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:31 smithi045 ceph-mon[31180]: pgmap v75: 0 pgs: ; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:31.498 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:31 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T22:09:31.498 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:31 smithi045 ceph-mon[31180]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T22:09:31.498 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:31 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:09:31.799 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:09:31 smithi045 sudo[50090]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:09:31.800 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:09:31 smithi045 sudo[50090]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:09:31.800 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:09:31 smithi045 sudo[50090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:09:31.800 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:09:31 smithi045 sudo[50090]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:09:32.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:32.264+0000 7f323b7fe640 1 -- 172.21.15.45:0/3774882189 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f323c0b8cb0 con 0x7f32441037c0 2024-09-15T22:09:32.392 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:09:32.392 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:32 smithi100 ceph-mon[35319]: osdmap e20: 3 total, 3 up, 3 in 2024-09-15T22:09:32.392 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:32 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1704920890' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20a0d21e-2952-4e0b-b875-68e206fae18c"}]: dispatch 2024-09-15T22:09:32.392 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:32 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1704920890' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20a0d21e-2952-4e0b-b875-68e206fae18c"}]': finished 2024-09-15T22:09:32.392 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:32 smithi100 ceph-mon[35319]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T22:09:32.393 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:32.393 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:32 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2035693079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:09:32.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:09:32.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:32 smithi165 ceph-mon[35551]: osdmap e20: 3 total, 3 up, 3 in 2024-09-15T22:09:32.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:32 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1704920890' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20a0d21e-2952-4e0b-b875-68e206fae18c"}]: dispatch 2024-09-15T22:09:32.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:32 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1704920890' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20a0d21e-2952-4e0b-b875-68e206fae18c"}]': finished 2024-09-15T22:09:32.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:32 smithi165 ceph-mon[35551]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T22:09:32.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:32.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:32 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2035693079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:09:32.549 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:09:32 smithi045 sudo[50115]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:09:32.550 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:09:32 smithi045 sudo[50115]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:09:32.550 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:09:32 smithi045 sudo[50115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:09:32.550 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:09:32 smithi045 sudo[50115]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:09:32.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:09:32.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:32 smithi045 ceph-mon[31180]: osdmap e20: 3 total, 3 up, 3 in 2024-09-15T22:09:32.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:32 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1704920890' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "20a0d21e-2952-4e0b-b875-68e206fae18c"}]: dispatch 2024-09-15T22:09:32.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:32 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1704920890' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "20a0d21e-2952-4e0b-b875-68e206fae18c"}]': finished 2024-09-15T22:09:32.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:32 smithi045 ceph-mon[31180]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T22:09:32.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:32.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:32 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2035693079' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:09:32.649 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:09:32 smithi100 sudo[43920]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:09:32.649 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:09:32 smithi100 sudo[43920]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:09:32.649 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:09:32 smithi100 sudo[43920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:09:32.649 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:09:32 smithi100 sudo[43920]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:09:32.994 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:09:32 smithi100 sudo[43923]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:09:32.994 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:09:32 smithi100 sudo[43923]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:09:32.994 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:09:32 smithi100 sudo[43923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:09:32.994 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:09:32 smithi100 sudo[43923]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:09:33.176 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:33 smithi165 ceph-mon[35551]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:33.176 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:33.176 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:33 smithi165 ceph-mon[35551]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:09:33.176 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:33.177 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:09:32 smithi165 sudo[44570]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:09:33.177 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:09:32 smithi165 sudo[44570]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:09:33.177 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:09:32 smithi165 sudo[44570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:09:33.177 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:09:32 smithi165 sudo[44570]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:09:33.464 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:09:33 smithi165 sudo[44573]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:09:33.465 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:09:33 smithi165 sudo[44573]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:09:33.465 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:09:33 smithi165 sudo[44573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:09:33.465 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:09:33 smithi165 sudo[44573]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:09:33.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:33 smithi100 ceph-mon[35319]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:33.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:33.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:33 smithi100 ceph-mon[35319]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:09:33.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:33.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:33 smithi045 ceph-mon[31180]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:33.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:33.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:33 smithi045 ceph-mon[31180]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T22:09:33.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:34.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:33 smithi045 sudo[50512]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:09:34.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:33 smithi045 sudo[50512]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:09:34.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:33 smithi045 sudo[50512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:09:34.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:33 smithi045 sudo[50512]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:09:34.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 sudo[44576]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:09:34.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 sudo[44576]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:09:34.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 sudo[44576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:09:34.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 sudo[44576]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:09:34.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:34 smithi045 sudo[50705]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:09:34.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:34 smithi045 sudo[50705]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:09:34.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:34 smithi045 sudo[50705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:09:34.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:34 smithi045 sudo[50705]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:09:34.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 sudo[44579]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:09:34.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 sudo[44579]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:09:34.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 sudo[44579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:09:34.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 sudo[44579]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:09:34.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:34.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 ceph-mon[35551]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:09:34.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 ceph-mon[35551]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:09:34.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:09:34.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:09:34.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:09:34.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:09:34.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:09:34.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:34 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:09:35.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:34 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:35.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:34 smithi045 ceph-mon[31180]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:09:35.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:34 smithi045 ceph-mon[31180]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:09:35.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:34 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:09:35.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:34 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:09:35.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:34 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:09:35.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:34 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:09:35.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:34 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:09:35.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:34 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:09:35.104 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:34 smithi100 sudo[43926]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T22:09:35.104 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:34 smithi100 sudo[43926]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:09:35.104 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:34 smithi100 sudo[43926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:09:35.104 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:34 smithi100 sudo[43926]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:09:35.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 sudo[43929]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T22:09:35.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 sudo[43929]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T22:09:35.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 sudo[43929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T22:09:35.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 sudo[43929]: pam_unix(sudo:session): session closed for user root 2024-09-15T22:09:35.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:35.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:09:35.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:09:35.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:09:35.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:09:35.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:09:35.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:09:35.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:09:35.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:09:35.908 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:35 smithi045 ceph-mon[31180]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:35.908 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:35 smithi045 ceph-mon[31180]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:09:35.908 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:35 smithi045 ceph-mon[31180]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:09:35.909 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:35 smithi045 ceph-mon[31180]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:09:35.909 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:35 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:09:35.909 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:35 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:09:35.909 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:35 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:09:35.909 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:35 smithi045 ceph-mon[31180]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:09:35.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:35 smithi165 ceph-mon[35551]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:35.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:35 smithi165 ceph-mon[35551]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:09:35.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:35 smithi165 ceph-mon[35551]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:09:35.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:35 smithi165 ceph-mon[35551]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:09:35.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:35 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:09:35.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:35 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:09:35.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:35 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:09:35.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:35 smithi165 ceph-mon[35551]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:09:35.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 101 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:35.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:09:35.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:09:35.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T22:09:35.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:09:35.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:09:35.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:09:35.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:35 smithi100 ceph-mon[35319]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T22:09:36.949 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:36 smithi045 ceph-mon[31180]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:36.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:36 smithi165 ceph-mon[35551]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:36.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:36 smithi100 ceph-mon[35319]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:38.722 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:38 smithi045 ceph-mon[31180]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:38.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:38 smithi165 ceph-mon[35551]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:38.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:38 smithi100 ceph-mon[35319]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:40.959 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:40 smithi045 ceph-mon[31180]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-15T22:09:40.959 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:40 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:09:40.959 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:40 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:40.960 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:40 smithi045 ceph-mon[31180]: Deploying daemon osd.3 on smithi045 2024-09-15T22:09:40.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:40 smithi165 ceph-mon[35551]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-15T22:09:40.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:40 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:09:40.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:40 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:40.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:40 smithi165 ceph-mon[35551]: Deploying daemon osd.3 on smithi045 2024-09-15T22:09:40.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:40 smithi100 ceph-mon[35319]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 65 KiB/s wr, 6 op/s 2024-09-15T22:09:40.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:40 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T22:09:40.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:40 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:40.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:40 smithi100 ceph-mon[35319]: Deploying daemon osd.3 on smithi045 2024-09-15T22:09:42.911 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:42 smithi045 ceph-mon[31180]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-15T22:09:42.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:42 smithi165 ceph-mon[35551]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-15T22:09:42.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:42 smithi100 ceph-mon[35319]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-09-15T22:09:44.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:44 smithi045 ceph-mon[31180]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-15T22:09:44.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:44 smithi165 ceph-mon[35551]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-15T22:09:44.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:44 smithi100 ceph-mon[35319]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-09-15T22:09:46.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:46 smithi045 ceph-mon[31180]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T22:09:46.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:46 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:46.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:46 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:46.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:46 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:46.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:46 smithi165 ceph-mon[35551]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T22:09:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:46 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:46 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:46 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:46.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:46 smithi100 ceph-mon[35319]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-09-15T22:09:46.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:46 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:46.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:46 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:46.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:46 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:49.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:49 smithi165 ceph-mon[35551]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T22:09:49.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:49 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:49.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:49 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:49.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:49 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:49.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:49 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:49.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:49 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:49.474 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:49 smithi045 ceph-mon[31180]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T22:09:49.474 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:49 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:49.475 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:49 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:49.475 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:49 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:49.475 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:49 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:49.475 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:49 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:49.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:49 smithi100 ceph-mon[35319]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T22:09:49.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:49 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:49.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:49 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:49.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:49 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:49.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:49 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:49.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:49 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:49.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:49.847+0000 7f323b7fe640 1 -- 172.21.15.45:0/3774882189 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3244062630 con 0x7f32300a31b0 2024-09-15T22:09:49.850 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 3 on host 'smithi045' 2024-09-15T22:09:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:49.850+0000 7f3248d44640 1 -- 172.21.15.45:0/3774882189 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32300a31b0 msgr2=0x7f32300a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:49.850+0000 7f3248d44640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32300a31b0 0x7f32300a5670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3244102c60 tx=0x7f3234009520 comp rx=0 tx=0).stop 2024-09-15T22:09:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:49.850+0000 7f3248d44640 1 -- 172.21.15.45:0/3774882189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32441037c0 msgr2=0x7f3244074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:49.850+0000 7f3248d44640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32441037c0 0x7f3244074b20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f323c0316a0 tx=0x7f323c004430 comp rx=0 tx=0).stop 2024-09-15T22:09:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:49.850+0000 7f3248d44640 1 -- 172.21.15.45:0/3774882189 shutdown_connections 2024-09-15T22:09:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:49.850+0000 7f3248d44640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32300a31b0 0x7f32300a5670 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:49.850+0000 7f3248d44640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32441037c0 0x7f3244074b20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:49.850+0000 7f3248d44640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3244102e00 0x7f32440745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:49.850+0000 7f3248d44640 1 --2- 172.21.15.45:0/3774882189 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3244101c00 0x7f3244075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:49.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:49.850+0000 7f3248d44640 1 -- 172.21.15.45:0/3774882189 >> 172.21.15.45:0/3774882189 conn(0x7f32440fd390 msgr2=0x7f32441060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:49.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:49.850+0000 7f3248d44640 1 -- 172.21.15.45:0/3774882189 shutdown_connections 2024-09-15T22:09:49.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:09:49.850+0000 7f3248d44640 1 -- 172.21.15.45:0/3774882189 wait complete. 2024-09-15T22:09:50.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:50.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:50.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:50.470 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:50.470 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:50.470 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:50.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:09:50.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:50.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:50.499 DEBUG:teuthology.orchestra.run.smithi045:osd.3> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.3.service 2024-09-15T22:09:50.501 INFO:tasks.cephadm:Deploying osd.4 on smithi100 with /dev/vg_nvme/lv_3... 2024-09-15T22:09:50.501 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:09:50.754 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:09:51.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:51 smithi165 ceph-mon[35551]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T22:09:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:51 smithi100 ceph-mon[35319]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T22:09:51.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:51 smithi045 ceph-mon[31180]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-09-15T22:09:51.894 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:09:51 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3[52130]: 2024-09-15T22:09:51.845+0000 7f3e6e4e6640 -1 osd.3 0 log_to_monitors true 2024-09-15T22:09:52.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:52 smithi165 ceph-mon[35551]: from='osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:09:52.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:52 smithi100 ceph-mon[35319]: from='osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:09:52.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:52 smithi045 ceph-mon[31180]: from='osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T22:09:53.325 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:09:53 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3[52130]: 2024-09-15T22:09:53.190+0000 7f3e6a469640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T22:09:53.326 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:09:53 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3[52130]: 2024-09-15T22:09:53.194+0000 7f3e66291640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:09:53.326 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:53 smithi045 ceph-mon[31180]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:53.326 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:53 smithi045 ceph-mon[31180]: from='osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:09:53.326 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:53 smithi045 ceph-mon[31180]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T22:09:53.326 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:53 smithi045 ceph-mon[31180]: from='osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-15T22:09:53.326 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:53.329 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:53 smithi100 ceph-mon[35319]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:53.329 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:53 smithi100 ceph-mon[35319]: from='osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:09:53.329 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:53 smithi100 ceph-mon[35319]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T22:09:53.329 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:53 smithi100 ceph-mon[35319]: from='osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-15T22:09:53.330 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:53 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:53.333 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:09:53.357 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_3 2024-09-15T22:09:53.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:53 smithi165 ceph-mon[35551]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:53.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:53 smithi165 ceph-mon[35551]: from='osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T22:09:53.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:53 smithi165 ceph-mon[35551]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T22:09:53.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:53 smithi165 ceph-mon[35551]: from='osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-15T22:09:53.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:53.606 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:09:54.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.067+0000 7f3151baf640 1 -- 172.21.15.100:0/3726714944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314c102690 msgr2=0x7f314c108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:54.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.067+0000 7f3151baf640 1 --2- 172.21.15.100:0/3726714944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314c102690 0x7f314c108f20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3144009ca0 tx=0x7f314402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:09:54.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.067+0000 7f3151baf640 1 -- 172.21.15.100:0/3726714944 shutdown_connections 2024-09-15T22:09:54.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.067+0000 7f3151baf640 1 --2- 172.21.15.100:0/3726714944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314c102690 0x7f314c108f20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:54.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.067+0000 7f3151baf640 1 --2- 172.21.15.100:0/3726714944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f314c101cd0 0x7f314c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:54.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.067+0000 7f3151baf640 1 --2- 172.21.15.100:0/3726714944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c100ad0 0x7f314c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:54.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.067+0000 7f3151baf640 1 -- 172.21.15.100:0/3726714944 >> 172.21.15.100:0/3726714944 conn(0x7f314c0fc280 msgr2=0x7f314c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:09:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.067+0000 7f3151baf640 1 -- 172.21.15.100:0/3726714944 shutdown_connections 2024-09-15T22:09:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.067+0000 7f3151baf640 1 -- 172.21.15.100:0/3726714944 wait complete. 2024-09-15T22:09:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.067+0000 7f3151baf640 1 Processor -- start 2024-09-15T22:09:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3151baf640 1 -- start start 2024-09-15T22:09:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3151baf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c100ad0 0x7f314c1049f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3151baf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314c101cd0 0x7f314c1030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3151baf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f314c102690 0x7f314c1035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3151baf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f314c10c890 con 0x7f314c100ad0 2024-09-15T22:09:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3151baf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f314c10c710 con 0x7f314c101cd0 2024-09-15T22:09:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3151baf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f314c10ca10 con 0x7f314c102690 2024-09-15T22:09:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3143fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314c101cd0 0x7f314c1030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:54.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3143fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314c101cd0 0x7f314c1030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41552/0 (socket says 172.21.15.100:41552) 2024-09-15T22:09:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3143fff640 1 -- 172.21.15.100:0/2309380354 learned_addr learned my addr 172.21.15.100:0/2309380354 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-15T22:09:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f314b7fe640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c100ad0 0x7f314c1049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f314bfff640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f314c102690 0x7f314c1035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3143fff640 1 -- 172.21.15.100:0/2309380354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f314c102690 msgr2=0x7f314c1035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3143fff640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f314c102690 0x7f314c1035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3143fff640 1 -- 172.21.15.100:0/2309380354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c100ad0 msgr2=0x7f314c1049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:09:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3143fff640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c100ad0 0x7f314c1049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:09:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.068+0000 7f3143fff640 1 -- 172.21.15.100:0/2309380354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314c103e10 con 0x7f314c101cd0 2024-09-15T22:09:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.069+0000 7f3143fff640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314c101cd0 0x7f314c1030b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f313400d770 tx=0x7f313400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.069+0000 7f31497fa640 1 -- 172.21.15.100:0/2309380354 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134017070 con 0x7f314c101cd0 2024-09-15T22:09:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.069+0000 7f31497fa640 1 -- 172.21.15.100:0/2309380354 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3134005520 con 0x7f314c101cd0 2024-09-15T22:09:54.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.069+0000 7f3151baf640 1 -- 172.21.15.100:0/2309380354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f314c1a2080 con 0x7f314c101cd0 2024-09-15T22:09:54.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.069+0000 7f31497fa640 1 -- 172.21.15.100:0/2309380354 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3134010460 con 0x7f314c101cd0 2024-09-15T22:09:54.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.069+0000 7f3151baf640 1 -- 172.21.15.100:0/2309380354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f314c1a2570 con 0x7f314c101cd0 2024-09-15T22:09:54.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.070+0000 7f3151baf640 1 -- 172.21.15.100:0/2309380354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f314c1a27d0 con 0x7f314c101cd0 2024-09-15T22:09:54.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.071+0000 7f31497fa640 1 -- 172.21.15.100:0/2309380354 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3134004ea0 con 0x7f314c101cd0 2024-09-15T22:09:54.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.072+0000 7f31497fa640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f31380a3240 0x7f31380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:09:54.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.072+0000 7f31497fa640 1 -- 172.21.15.100:0/2309380354 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3389+0+0 (secure 0 0 0) 0x7f31340ce4b0 con 0x7f314c101cd0 2024-09-15T22:09:54.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.072+0000 7f314b7fe640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f31380a3240 0x7f31380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:09:54.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.073+0000 7f314b7fe640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f31380a3240 0x7f31380a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f314c101b30 tx=0x7f313c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:09:54.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.075+0000 7f31497fa640 1 -- 172.21.15.100:0/2309380354 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f313409be20 con 0x7f314c101cd0 2024-09-15T22:09:54.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:54 smithi100 ceph-mon[35319]: from='osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-15T22:09:54.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:54 smithi100 ceph-mon[35319]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T22:09:54.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:54.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:54.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:54.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:54.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:54.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:54.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:54.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:54.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:54.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:54.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:09:54.274+0000 7f3151baf640 1 -- 172.21.15.100:0/2309380354 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f314c0fe440 con 0x7f31380a3240 2024-09-15T22:09:54.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:54 smithi165 ceph-mon[35551]: from='osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-15T22:09:54.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:54 smithi165 ceph-mon[35551]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T22:09:54.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:54.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:54.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:54.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:54.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:54.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:54.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:54.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:54.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:54.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:54.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:54 smithi045 ceph-mon[31180]: from='osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-15T22:09:54.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:54 smithi045 ceph-mon[31180]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T22:09:54.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:54.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:54.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:54.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:54.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:54.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:09:54.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:54.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:54.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:09:54.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:09:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: purged_snaps scrub starts 2024-09-15T22:09:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: purged_snaps scrub ok 2024-09-15T22:09:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: Detected new or changed devices on smithi045 2024-09-15T22:09:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi045 to 8546M 2024-09-15T22:09:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268] boot 2024-09-15T22:09:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T22:09:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: from='client.24194 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:09:55.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:09:55.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:09:55.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:55.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:55 smithi165 ceph-mon[35551]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T22:09:55.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: purged_snaps scrub starts 2024-09-15T22:09:55.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: purged_snaps scrub ok 2024-09-15T22:09:55.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: Detected new or changed devices on smithi045 2024-09-15T22:09:55.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:55.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi045 to 8546M 2024-09-15T22:09:55.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:55.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268] boot 2024-09-15T22:09:55.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T22:09:55.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:55.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: from='client.24194 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:09:55.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:09:55.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:09:55.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:55.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:55 smithi100 ceph-mon[35319]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T22:09:55.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: purged_snaps scrub starts 2024-09-15T22:09:55.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: purged_snaps scrub ok 2024-09-15T22:09:55.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: Detected new or changed devices on smithi045 2024-09-15T22:09:55.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 268 GiB / 268 GiB avail 2024-09-15T22:09:55.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi045 to 8546M 2024-09-15T22:09:55.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:55.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: osd.3 [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268] boot 2024-09-15T22:09:55.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: osdmap e24: 4 total, 4 up, 4 in 2024-09-15T22:09:55.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:09:55.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: from='client.24194 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:09:55.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:09:55.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:09:55.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:09:55.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:55 smithi045 ceph-mon[31180]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T22:09:56.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:56 smithi165 ceph-mon[35551]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:09:56.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:56 smithi165 ceph-mon[35551]: osdmap e26: 4 total, 4 up, 4 in 2024-09-15T22:09:56.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:56 smithi100 ceph-mon[35319]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:09:56.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:56 smithi100 ceph-mon[35319]: osdmap e26: 4 total, 4 up, 4 in 2024-09-15T22:09:56.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:56 smithi045 ceph-mon[31180]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:09:56.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:56 smithi045 ceph-mon[31180]: osdmap e26: 4 total, 4 up, 4 in 2024-09-15T22:09:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:57 smithi100 ceph-mon[35319]: osdmap e27: 4 total, 4 up, 4 in 2024-09-15T22:09:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:57 smithi100 ceph-mon[35319]: from='client.? 172.21.15.100:0/3376532917' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6685935-6ac3-4dc3-acf3-f82480001576"}]: dispatch 2024-09-15T22:09:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:57 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6685935-6ac3-4dc3-acf3-f82480001576"}]: dispatch 2024-09-15T22:09:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:57 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6685935-6ac3-4dc3-acf3-f82480001576"}]': finished 2024-09-15T22:09:57.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:57 smithi100 ceph-mon[35319]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T22:09:57.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:57 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:09:57.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:57 smithi100 ceph-mon[35319]: from='client.? 172.21.15.100:0/1882662474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:09:57.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:57 smithi165 ceph-mon[35551]: osdmap e27: 4 total, 4 up, 4 in 2024-09-15T22:09:57.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:57 smithi165 ceph-mon[35551]: from='client.? 172.21.15.100:0/3376532917' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6685935-6ac3-4dc3-acf3-f82480001576"}]: dispatch 2024-09-15T22:09:57.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:57 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6685935-6ac3-4dc3-acf3-f82480001576"}]: dispatch 2024-09-15T22:09:57.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:57 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6685935-6ac3-4dc3-acf3-f82480001576"}]': finished 2024-09-15T22:09:57.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:57 smithi165 ceph-mon[35551]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T22:09:57.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:57 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:09:57.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:57 smithi165 ceph-mon[35551]: from='client.? 172.21.15.100:0/1882662474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:09:57.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:57 smithi045 ceph-mon[31180]: osdmap e27: 4 total, 4 up, 4 in 2024-09-15T22:09:57.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:57 smithi045 ceph-mon[31180]: from='client.? 172.21.15.100:0/3376532917' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6685935-6ac3-4dc3-acf3-f82480001576"}]: dispatch 2024-09-15T22:09:57.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:57 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6685935-6ac3-4dc3-acf3-f82480001576"}]: dispatch 2024-09-15T22:09:57.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:57 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6685935-6ac3-4dc3-acf3-f82480001576"}]': finished 2024-09-15T22:09:57.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:57 smithi045 ceph-mon[31180]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T22:09:57.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:57 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:09:57.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:57 smithi045 ceph-mon[31180]: from='client.? 172.21.15.100:0/1882662474' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:09:58.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:09:58 smithi165 ceph-mon[35551]: pgmap v99: 1 pgs: 1 peering; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:09:58.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:09:58 smithi100 ceph-mon[35319]: pgmap v99: 1 pgs: 1 peering; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:09:59.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:09:58 smithi045 ceph-mon[31180]: pgmap v99: 1 pgs: 1 peering; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:00.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:00 smithi165 ceph-mon[35551]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-15T22:10:00.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:00 smithi165 ceph-mon[35551]: overall HEALTH_OK 2024-09-15T22:10:00.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:00 smithi100 ceph-mon[35319]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-15T22:10:00.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:00 smithi100 ceph-mon[35319]: overall HEALTH_OK 2024-09-15T22:10:01.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:00 smithi045 ceph-mon[31180]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-15T22:10:01.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:00 smithi045 ceph-mon[31180]: overall HEALTH_OK 2024-09-15T22:10:02.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:02 smithi100 ceph-mon[35319]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:10:02.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:02 smithi165 ceph-mon[35551]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:10:03.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:02 smithi045 ceph-mon[31180]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T22:10:04.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:04 smithi165 ceph-mon[35551]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:10:04.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:04 smithi100 ceph-mon[35319]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:10:05.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:04 smithi045 ceph-mon[31180]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:10:05.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:10:05.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:05.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:05 smithi165 ceph-mon[35551]: Deploying daemon osd.4 on smithi100 2024-09-15T22:10:05.974 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:10:05.975 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:05.975 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:05 smithi100 ceph-mon[35319]: Deploying daemon osd.4 on smithi100 2024-09-15T22:10:06.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T22:10:06.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:06.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:05 smithi045 ceph-mon[31180]: Deploying daemon osd.4 on smithi100 2024-09-15T22:10:06.947 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:06 smithi100 ceph-mon[35319]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-15T22:10:06.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:06 smithi165 ceph-mon[35551]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-15T22:10:07.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:06 smithi045 ceph-mon[31180]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-15T22:10:08.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:08 smithi165 ceph-mon[35551]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-15T22:10:08.965 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:08 smithi100 ceph-mon[35319]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-15T22:10:09.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:08 smithi045 ceph-mon[31180]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-15T22:10:10.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:10 smithi165 ceph-mon[35551]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:10:10.969 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:10 smithi100 ceph-mon[35319]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:10:11.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:10 smithi045 ceph-mon[31180]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T22:10:11.951 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:11.951 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:11.951 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:11.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:11.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:11.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:11.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:11.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:11.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:12.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:12 smithi165 ceph-mon[35551]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:12.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:12 smithi100 ceph-mon[35319]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:13.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:12 smithi045 ceph-mon[31180]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:14.899 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:14 smithi100 ceph-mon[35319]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:14.939 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 4 on host 'smithi100' 2024-09-15T22:10:14.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:10:14.937+0000 7f31497fa640 1 -- 172.21.15.100:0/2309380354 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f314c0fe440 con 0x7f31380a3240 2024-09-15T22:10:14.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:10:14.939+0000 7f3151baf640 1 -- 172.21.15.100:0/2309380354 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f31380a3240 msgr2=0x7f31380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:14.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:10:14.939+0000 7f3151baf640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f31380a3240 0x7f31380a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f314c101b30 tx=0x7f313c00a2d0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:10:14.939+0000 7f3151baf640 1 -- 172.21.15.100:0/2309380354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314c101cd0 msgr2=0x7f314c1030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:14.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:10:14.939+0000 7f3151baf640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314c101cd0 0x7f314c1030b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f313400d770 tx=0x7f313400dc30 comp rx=0 tx=0).stop 2024-09-15T22:10:14.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:10:14.939+0000 7f3151baf640 1 -- 172.21.15.100:0/2309380354 shutdown_connections 2024-09-15T22:10:14.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:10:14.939+0000 7f3151baf640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f31380a3240 0x7f31380a5700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:10:14.939+0000 7f3151baf640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f314c102690 0x7f314c1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:10:14.939+0000 7f3151baf640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f314c101cd0 0x7f314c1030b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:10:14.939+0000 7f3151baf640 1 --2- 172.21.15.100:0/2309380354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f314c100ad0 0x7f314c1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:14.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:10:14.939+0000 7f3151baf640 1 -- 172.21.15.100:0/2309380354 >> 172.21.15.100:0/2309380354 conn(0x7f314c0fc280 msgr2=0x7f314c0fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:14.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:10:14.940+0000 7f3151baf640 1 -- 172.21.15.100:0/2309380354 shutdown_connections 2024-09-15T22:10:14.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:10:14.940+0000 7f3151baf640 1 -- 172.21.15.100:0/2309380354 wait complete. 2024-09-15T22:10:14.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:14 smithi165 ceph-mon[35551]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:15.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:14 smithi045 ceph-mon[31180]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:15.572 DEBUG:teuthology.orchestra.run.smithi100:osd.4> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.4.service 2024-09-15T22:10:15.575 INFO:tasks.cephadm:Deploying osd.5 on smithi165 with /dev/vg_nvme/lv_3... 2024-09-15T22:10:15.575 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T22:10:15.831 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:10:16.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:15 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:16.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:15 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:16.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:15 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:16.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:15 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:16.219 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:15 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:16.219 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:15 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:16.219 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:15 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:16.219 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:15 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:16.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:16.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:16.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:16.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:17.127 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:16 smithi100 ceph-mon[35319]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:17.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:16 smithi165 ceph-mon[35551]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:17.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:16 smithi045 ceph-mon[31180]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:17.744 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:10:17 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4[46686]: 2024-09-15T22:10:17.636+0000 7fb65b8dc640 -1 osd.4 0 log_to_monitors true 2024-09-15T22:10:18.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:17 smithi165 ceph-mon[35551]: from='osd.4 [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:10:18.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:17 smithi165 ceph-mon[35551]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:10:18.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:17 smithi100 ceph-mon[35319]: from='osd.4 [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:10:18.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:17 smithi100 ceph-mon[35319]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:10:18.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:17 smithi045 ceph-mon[31180]: from='osd.4 [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:10:18.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:17 smithi045 ceph-mon[31180]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T22:10:18.354 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:10:18.381 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_3 2024-09-15T22:10:18.635 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:10:19.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.115+0000 7f448046d640 1 -- 172.21.15.165:0/3788436548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4478100ad0 msgr2=0x7f4478100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:19.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.115+0000 7f448046d640 1 --2- 172.21.15.165:0/3788436548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4478100ad0 0x7f4478100ed0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4474009900 tx=0x7f447402a410 comp rx=0 tx=0).stop 2024-09-15T22:10:19.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.115+0000 7f448046d640 1 -- 172.21.15.165:0/3788436548 shutdown_connections 2024-09-15T22:10:19.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.115+0000 7f448046d640 1 --2- 172.21.15.165:0/3788436548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4478102690 0x7f4478108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:19.138 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.115+0000 7f448046d640 1 --2- 172.21.15.165:0/3788436548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4478101cd0 0x7f4478102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:19.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.115+0000 7f448046d640 1 --2- 172.21.15.165:0/3788436548 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4478100ad0 0x7f4478100ed0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:19.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.115+0000 7f448046d640 1 -- 172.21.15.165:0/3788436548 >> 172.21.15.165:0/3788436548 conn(0x7f44780fc280 msgr2=0x7f44780fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:19.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.115+0000 7f448046d640 1 -- 172.21.15.165:0/3788436548 shutdown_connections 2024-09-15T22:10:19.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.115+0000 7f448046d640 1 -- 172.21.15.165:0/3788436548 wait complete. 2024-09-15T22:10:19.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f448046d640 1 Processor -- start 2024-09-15T22:10:19.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f448046d640 1 -- start start 2024-09-15T22:10:19.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f448046d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4478100ad0 0x7f447806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:19.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f448046d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4478101cd0 0x7f447819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:19.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f448046d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4478102690 0x7f447819f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:19.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f448046d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f447810c890 con 0x7f4478101cd0 2024-09-15T22:10:19.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f448046d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f447810c710 con 0x7f4478102690 2024-09-15T22:10:19.139 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f448046d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f447810ca10 con 0x7f4478100ad0 2024-09-15T22:10:19.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f447e209640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4478100ad0 0x7f447806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:19.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f447e209640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4478100ad0 0x7f447806aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:38506/0 (socket says 172.21.15.165:38506) 2024-09-15T22:10:19.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f447e209640 1 -- 172.21.15.165:0/906532057 learned_addr learned my addr 172.21.15.165:0/906532057 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-15T22:10:19.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f447ea0a640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4478102690 0x7f447819f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:19.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f447da08640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4478101cd0 0x7f447819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:19.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f447e209640 1 -- 172.21.15.165:0/906532057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4478102690 msgr2=0x7f447819f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:19.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f447e209640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4478102690 0x7f447819f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:19.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f447e209640 1 -- 172.21.15.165:0/906532057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4478101cd0 msgr2=0x7f447819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:19.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f447e209640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4478101cd0 0x7f447819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:19.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f447e209640 1 -- 172.21.15.165:0/906532057 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447819fc50 con 0x7f4478100ad0 2024-09-15T22:10:19.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f447ea0a640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4478102690 0x7f447819f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:10:19.140 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.116+0000 7f447da08640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4478101cd0 0x7f447819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:10:19.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.117+0000 7f447e209640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4478100ad0 0x7f447806aad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4474009230 tx=0x7f44740042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:19.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.117+0000 7f446f7fe640 1 -- 172.21.15.165:0/906532057 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447403f030 con 0x7f4478100ad0 2024-09-15T22:10:19.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.117+0000 7f448046d640 1 -- 172.21.15.165:0/906532057 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447819fe80 con 0x7f4478100ad0 2024-09-15T22:10:19.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.117+0000 7f446f7fe640 1 -- 172.21.15.165:0/906532057 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4474003d00 con 0x7f4478100ad0 2024-09-15T22:10:19.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.117+0000 7f446f7fe640 1 -- 172.21.15.165:0/906532057 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4474035070 con 0x7f4478100ad0 2024-09-15T22:10:19.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.117+0000 7f448046d640 1 -- 172.21.15.165:0/906532057 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44781a02d0 con 0x7f4478100ad0 2024-09-15T22:10:19.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.118+0000 7f448046d640 1 -- 172.21.15.165:0/906532057 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4478107f20 con 0x7f4478100ad0 2024-09-15T22:10:19.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.119+0000 7f446f7fe640 1 -- 172.21.15.165:0/906532057 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4474042030 con 0x7f4478100ad0 2024-09-15T22:10:19.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.120+0000 7f446f7fe640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f44640a3240 0x7f44640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:19.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.120+0000 7f446f7fe640 1 -- 172.21.15.165:0/906532057 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7f44740eec50 con 0x7f4478100ad0 2024-09-15T22:10:19.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.120+0000 7f447da08640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f44640a3240 0x7f44640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:19.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.121+0000 7f447da08640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f44640a3240 0x7f44640a5700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f447806b050 tx=0x7f446800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:19.141 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.125+0000 7f446f7fe640 1 -- 172.21.15.165:0/906532057 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44740f4020 con 0x7f4478100ad0 2024-09-15T22:10:19.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:19.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:10:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:10:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: from='osd.4 [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:10:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:10:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:10:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:10:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:10:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:18 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:10:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:10:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: from='osd.4 [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:10:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:10:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:19.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:19.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:10:19.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:10:19.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:19.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:19.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:10:19.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:18 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:19.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:19.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T22:10:19.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T22:10:19.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:19.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: from='osd.4 [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:10:19.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:10:19.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:19.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:19.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:10:19.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:10:19.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:19.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:19.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:10:19.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:18 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:19.303 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:19.302+0000 7f448046d640 1 -- 172.21.15.165:0/906532057 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4478062630 con 0x7f44640a3240 2024-09-15T22:10:19.952 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4[46686]: 2024-09-15T22:10:19.598+0000 7fb65785f640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T22:10:19.952 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4[46686]: 2024-09-15T22:10:19.602+0000 7fb64f67f640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:10:20.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: Detected new or changed devices on smithi100 2024-09-15T22:10:20.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-15T22:10:20.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-15T22:10:20.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T22:10:20.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:20.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:20.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:20.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:20.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:10:20.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:20.216 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:10:20.216 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:10:20.216 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:20.216 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:19 smithi165 ceph-mon[35551]: from='osd.4 ' entity='osd.4' 2024-09-15T22:10:20.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: Detected new or changed devices on smithi100 2024-09-15T22:10:20.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-15T22:10:20.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-15T22:10:20.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T22:10:20.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:20.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:20.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:20.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:20.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:10:20.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:20.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:10:20.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:10:20.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:20.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:19 smithi100 ceph-mon[35319]: from='osd.4 ' entity='osd.4' 2024-09-15T22:10:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: Detected new or changed devices on smithi100 2024-09-15T22:10:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi100 to 8543M 2024-09-15T22:10:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-15T22:10:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T22:10:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:10:20.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:20.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:10:20.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:10:20.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:20.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:19 smithi045 ceph-mon[31180]: from='osd.4 ' entity='osd.4' 2024-09-15T22:10:21.074 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:20 smithi165 ceph-mon[35551]: purged_snaps scrub starts 2024-09-15T22:10:21.075 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:20 smithi165 ceph-mon[35551]: purged_snaps scrub ok 2024-09-15T22:10:21.075 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:20 smithi165 ceph-mon[35551]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:21.075 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:20 smithi165 ceph-mon[35551]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:21.075 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:21.076 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:20 smithi165 ceph-mon[35551]: osd.4 [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991] boot 2024-09-15T22:10:21.076 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:20 smithi165 ceph-mon[35551]: osdmap e31: 5 total, 5 up, 5 in 2024-09-15T22:10:21.076 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:21.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:20 smithi100 ceph-mon[35319]: purged_snaps scrub starts 2024-09-15T22:10:21.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:20 smithi100 ceph-mon[35319]: purged_snaps scrub ok 2024-09-15T22:10:21.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:20 smithi100 ceph-mon[35319]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:21.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:20 smithi100 ceph-mon[35319]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:21.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:21.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:20 smithi100 ceph-mon[35319]: osd.4 [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991] boot 2024-09-15T22:10:21.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:20 smithi100 ceph-mon[35319]: osdmap e31: 5 total, 5 up, 5 in 2024-09-15T22:10:21.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:21.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:20 smithi045 ceph-mon[31180]: purged_snaps scrub starts 2024-09-15T22:10:21.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:20 smithi045 ceph-mon[31180]: purged_snaps scrub ok 2024-09-15T22:10:21.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:20 smithi045 ceph-mon[31180]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:21.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:20 smithi045 ceph-mon[31180]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-15T22:10:21.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:21.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:20 smithi045 ceph-mon[31180]: osd.4 [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991] boot 2024-09-15T22:10:21.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:20 smithi045 ceph-mon[31180]: osdmap e31: 5 total, 5 up, 5 in 2024-09-15T22:10:21.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:10:22.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:21 smithi165 ceph-mon[35551]: from='client.? 172.21.15.165:0/1801535934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a2ef15e-6522-4412-903b-0ce607d86649"}]: dispatch 2024-09-15T22:10:22.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:21 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a2ef15e-6522-4412-903b-0ce607d86649"}]: dispatch 2024-09-15T22:10:22.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:21 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a2ef15e-6522-4412-903b-0ce607d86649"}]': finished 2024-09-15T22:10:22.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:21 smithi165 ceph-mon[35551]: osdmap e32: 6 total, 5 up, 6 in 2024-09-15T22:10:22.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:21 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:22.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:21 smithi100 ceph-mon[35319]: from='client.? 172.21.15.165:0/1801535934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a2ef15e-6522-4412-903b-0ce607d86649"}]: dispatch 2024-09-15T22:10:22.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:21 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a2ef15e-6522-4412-903b-0ce607d86649"}]: dispatch 2024-09-15T22:10:22.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:21 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a2ef15e-6522-4412-903b-0ce607d86649"}]': finished 2024-09-15T22:10:22.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:21 smithi100 ceph-mon[35319]: osdmap e32: 6 total, 5 up, 6 in 2024-09-15T22:10:22.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:21 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:22.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:21 smithi045 ceph-mon[31180]: from='client.? 172.21.15.165:0/1801535934' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a2ef15e-6522-4412-903b-0ce607d86649"}]: dispatch 2024-09-15T22:10:22.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:21 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a2ef15e-6522-4412-903b-0ce607d86649"}]: dispatch 2024-09-15T22:10:22.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:21 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a2ef15e-6522-4412-903b-0ce607d86649"}]': finished 2024-09-15T22:10:22.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:21 smithi045 ceph-mon[31180]: osdmap e32: 6 total, 5 up, 6 in 2024-09-15T22:10:22.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:21 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:23.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:22 smithi045 ceph-mon[31180]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:23.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:22 smithi045 ceph-mon[31180]: from='client.? 172.21.15.165:0/1699677847' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:10:23.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:22 smithi165 ceph-mon[35551]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:23.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:22 smithi165 ceph-mon[35551]: from='client.? 172.21.15.165:0/1699677847' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:10:23.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:22 smithi100 ceph-mon[35319]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:23.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:22 smithi100 ceph-mon[35319]: from='client.? 172.21.15.165:0/1699677847' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:10:25.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:24 smithi100 ceph-mon[35319]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:25.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:24 smithi045 ceph-mon[31180]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:25.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:24 smithi165 ceph-mon[35551]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:27.110 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:26 smithi165 ceph-mon[35551]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:27.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:26 smithi100 ceph-mon[35319]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:27.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:26 smithi045 ceph-mon[31180]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:29.122 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:28 smithi165 ceph-mon[35551]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:29.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:28 smithi100 ceph-mon[35319]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:29.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:28 smithi045 ceph-mon[31180]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:30.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:29 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:10:30.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:29 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:30.269 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:29 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:10:30.269 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:29 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:30.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:29 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T22:10:30.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:29 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:31.120 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:30 smithi165 ceph-mon[35551]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:31.120 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:30 smithi165 ceph-mon[35551]: Deploying daemon osd.5 on smithi165 2024-09-15T22:10:31.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:30 smithi100 ceph-mon[35319]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:31.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:30 smithi100 ceph-mon[35319]: Deploying daemon osd.5 on smithi165 2024-09-15T22:10:31.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:30 smithi045 ceph-mon[31180]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:31.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:30 smithi045 ceph-mon[31180]: Deploying daemon osd.5 on smithi165 2024-09-15T22:10:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:32 smithi100 ceph-mon[35319]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:33.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:32 smithi045 ceph-mon[31180]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:33.331 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:32 smithi165 ceph-mon[35551]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:35.134 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:34 smithi165 ceph-mon[35551]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:35.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:34 smithi100 ceph-mon[35319]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:35.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:34 smithi045 ceph-mon[31180]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:37.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:36 smithi165 ceph-mon[35551]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:37.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:37.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:37.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:37.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:36 smithi100 ceph-mon[35319]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:37.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:37.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:37.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:37.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:36 smithi045 ceph-mon[31180]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:37.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:37.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:37.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:39.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:38 smithi100 ceph-mon[35319]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:39.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:39.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:39.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:39.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:10:39.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:38 smithi045 ceph-mon[31180]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:10:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:39.412 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:38 smithi165 ceph-mon[35551]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:39.412 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:39.412 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:39.412 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:39.413 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:10:39.413 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:40.103 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:40.101+0000 7f446f7fe640 1 -- 172.21.15.165:0/906532057 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4478062630 con 0x7f44640a3240 2024-09-15T22:10:40.104 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 5 on host 'smithi165' 2024-09-15T22:10:40.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:40.103+0000 7f448046d640 1 -- 172.21.15.165:0/906532057 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f44640a3240 msgr2=0x7f44640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:40.103+0000 7f448046d640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f44640a3240 0x7f44640a5700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f447806b050 tx=0x7f446800b390 comp rx=0 tx=0).stop 2024-09-15T22:10:40.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:40.103+0000 7f448046d640 1 -- 172.21.15.165:0/906532057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4478100ad0 msgr2=0x7f447806aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:40.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:40.103+0000 7f448046d640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4478100ad0 0x7f447806aad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4474009230 tx=0x7f44740042f0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:40.103+0000 7f448046d640 1 -- 172.21.15.165:0/906532057 shutdown_connections 2024-09-15T22:10:40.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:40.103+0000 7f448046d640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f44640a3240 0x7f44640a5700 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:40.103+0000 7f448046d640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4478102690 0x7f447819f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:40.103+0000 7f448046d640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4478101cd0 0x7f447819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:40.103+0000 7f448046d640 1 --2- 172.21.15.165:0/906532057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4478100ad0 0x7f447806aad0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:40.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:40.103+0000 7f448046d640 1 -- 172.21.15.165:0/906532057 >> 172.21.15.165:0/906532057 conn(0x7f44780fc280 msgr2=0x7f44781050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:40.106 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:40.103+0000 7f448046d640 1 -- 172.21.15.165:0/906532057 shutdown_connections 2024-09-15T22:10:40.107 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:10:40.103+0000 7f448046d640 1 -- 172.21.15.165:0/906532057 wait complete. 2024-09-15T22:10:40.734 DEBUG:teuthology.orchestra.run.smithi165:osd.5> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.5.service 2024-09-15T22:10:40.737 INFO:tasks.cephadm:Deploying osd.6 on smithi045 with /dev/vg_nvme/lv_2... 2024-09-15T22:10:40.737 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:10:41.008 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:40 smithi045 ceph-mon[31180]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:40 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:40 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:40 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:41.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:40 smithi100 ceph-mon[35319]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:41.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:40 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:41.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:40 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:41.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:40 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:41.253 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:40 smithi165 ceph-mon[35551]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:41.253 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:40 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:10:41.253 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:40 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:41.253 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:40 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:42.310 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:10:42 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:10:42.093+0000 7f128db18640 -1 osd.5 0 log_to_monitors true 2024-09-15T22:10:43.178 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:42 smithi045 ceph-mon[31180]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:43.178 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:42 smithi045 ceph-mon[31180]: from='osd.5 [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:10:43.178 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:42 smithi045 ceph-mon[31180]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:10:43.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:42 smithi100 ceph-mon[35319]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:43.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:42 smithi100 ceph-mon[35319]: from='osd.5 [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:10:43.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:42 smithi100 ceph-mon[35319]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:10:43.371 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:42 smithi165 ceph-mon[35551]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:43.372 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:42 smithi165 ceph-mon[35551]: from='osd.5 [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:10:43.372 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:42 smithi165 ceph-mon[35551]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T22:10:43.447 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:10:43.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_2 2024-09-15T22:10:43.743 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:10:44.148 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:44 smithi045 ceph-mon[31180]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:10:44.149 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:44 smithi045 ceph-mon[31180]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T22:10:44.149 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:44.149 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:44 smithi045 ceph-mon[31180]: from='osd.5 [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:10:44.149 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:44 smithi045 ceph-mon[31180]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:10:44.149 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:44.149 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:44.149 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:10:44.149 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:10:44.149 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:44.149 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:44.150 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:10:44.150 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:44.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.232+0000 7fbcb7524640 1 -- 172.21.15.45:0/1934565986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb0102690 msgr2=0x7fbcb0108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:44.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.232+0000 7fbcb7524640 1 --2- 172.21.15.45:0/1934565986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb0102690 0x7fbcb0108f20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009ca0 tx=0x7fbca802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:10:44.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.232+0000 7fbcb7524640 1 -- 172.21.15.45:0/1934565986 shutdown_connections 2024-09-15T22:10:44.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.232+0000 7fbcb7524640 1 --2- 172.21.15.45:0/1934565986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb0102690 0x7fbcb0108f20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:44.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.232+0000 7fbcb7524640 1 --2- 172.21.15.45:0/1934565986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcb0101cd0 0x7fbcb0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:44.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.232+0000 7fbcb7524640 1 --2- 172.21.15.45:0/1934565986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcb0100ad0 0x7fbcb0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:44.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.232+0000 7fbcb7524640 1 -- 172.21.15.45:0/1934565986 >> 172.21.15.45:0/1934565986 conn(0x7fbcb00fc280 msgr2=0x7fbcb00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:10:44.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.232+0000 7fbcb7524640 1 -- 172.21.15.45:0/1934565986 shutdown_connections 2024-09-15T22:10:44.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.232+0000 7fbcb7524640 1 -- 172.21.15.45:0/1934565986 wait complete. 2024-09-15T22:10:44.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb7524640 1 Processor -- start 2024-09-15T22:10:44.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb7524640 1 -- start start 2024-09-15T22:10:44.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb7524640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcb0100ad0 0x7fbcb0197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:44.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb7524640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcb0101cd0 0x7fbcb0198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:44.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb7524640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb0102690 0x7fbcb019f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:44.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb7524640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb010c890 con 0x7fbcb0102690 2024-09-15T22:10:44.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb7524640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb010c710 con 0x7fbcb0101cd0 2024-09-15T22:10:44.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb7524640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb010ca10 con 0x7fbcb0100ad0 2024-09-15T22:10:44.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb5ac1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb0102690 0x7fbcb019f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:44.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb5ac1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb0102690 0x7fbcb019f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52308/0 (socket says 172.21.15.45:52308) 2024-09-15T22:10:44.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb5ac1640 1 -- 172.21.15.45:0/3771337365 learned_addr learned my addr 172.21.15.45:0/3771337365 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:10:44.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb52c0640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcb0100ad0 0x7fbcb0197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:44.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb4abf640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcb0101cd0 0x7fbcb0198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:44.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb5ac1640 1 -- 172.21.15.45:0/3771337365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcb0100ad0 msgr2=0x7fbcb0197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:44.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb5ac1640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcb0100ad0 0x7fbcb0197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:44.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb5ac1640 1 -- 172.21.15.45:0/3771337365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcb0101cd0 msgr2=0x7fbcb0198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:10:44.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb5ac1640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcb0101cd0 0x7fbcb0198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:10:44.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.233+0000 7fbcb5ac1640 1 -- 172.21.15.45:0/3771337365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb019fc10 con 0x7fbcb0102690 2024-09-15T22:10:44.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.234+0000 7fbcb5ac1640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb0102690 0x7fbcb019f5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbca8006010 tx=0x7fbca8031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:44.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.234+0000 7fbca67fc640 1 -- 172.21.15.45:0/3771337365 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca802fae0 con 0x7fbcb0102690 2024-09-15T22:10:44.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.234+0000 7fbca67fc640 1 -- 172.21.15.45:0/3771337365 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbca802fc80 con 0x7fbcb0102690 2024-09-15T22:10:44.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.234+0000 7fbcb7524640 1 -- 172.21.15.45:0/3771337365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb019fea0 con 0x7fbcb0102690 2024-09-15T22:10:44.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.234+0000 7fbca67fc640 1 -- 172.21.15.45:0/3771337365 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca8046800 con 0x7fbcb0102690 2024-09-15T22:10:44.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.234+0000 7fbcb7524640 1 -- 172.21.15.45:0/3771337365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb01a03a0 con 0x7fbcb0102690 2024-09-15T22:10:44.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.235+0000 7fbcb7524640 1 -- 172.21.15.45:0/3771337365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb01a06c0 con 0x7fbcb0102690 2024-09-15T22:10:44.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.236+0000 7fbca67fc640 1 -- 172.21.15.45:0/3771337365 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbca80469a0 con 0x7fbcb0102690 2024-09-15T22:10:44.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.237+0000 7fbca67fc640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbc9c0a32f0 0x7fbc9c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:10:44.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.237+0000 7fbcb52c0640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbc9c0a32f0 0x7fbc9c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:10:44.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.237+0000 7fbca67fc640 1 -- 172.21.15.45:0/3771337365 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4253+0+0 (secure 0 0 0) 0x7fbca80efd60 con 0x7fbcb0102690 2024-09-15T22:10:44.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.237+0000 7fbcb52c0640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbc9c0a32f0 0x7fbc9c0a57b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbcac005fd0 tx=0x7fbcac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:10:44.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.241+0000 7fbca67fc640 1 -- 172.21.15.45:0/3771337365 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbca802fe30 con 0x7fbcb0102690 2024-09-15T22:10:44.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:10:44.427+0000 7fbcb7524640 1 -- 172.21.15.45:0/3771337365 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fbcb01a0890 con 0x7fbc9c0a32f0 2024-09-15T22:10:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-mon[35551]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:10:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-mon[35551]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T22:10:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-mon[35551]: from='osd.5 [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:10:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-mon[35551]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:10:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:10:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:10:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:44.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:10:44.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:44.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:44 smithi100 ceph-mon[35319]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T22:10:44.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:44 smithi100 ceph-mon[35319]: osdmap e33: 6 total, 5 up, 6 in 2024-09-15T22:10:44.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:44.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:44 smithi100 ceph-mon[35319]: from='osd.5 [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:10:44.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:44 smithi100 ceph-mon[35319]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:10:44.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:44.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:44.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:10:44.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:10:44.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:44.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:44.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:10:44.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:10:44.964 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:10:44.709+0000 7f1289a9b640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T22:10:44.965 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:10:44 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:10:44.716+0000 7f12818bb640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:10:45.100 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:45 smithi045 ceph-mon[31180]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:45.100 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:45 smithi045 ceph-mon[31180]: Detected new or changed devices on smithi165 2024-09-15T22:10:45.100 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:45 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi165 to 8544M 2024-09-15T22:10:45.100 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:45 smithi045 ceph-mon[31180]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-15T22:10:45.101 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:45 smithi045 ceph-mon[31180]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T22:10:45.101 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:45.101 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:45.101 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:45 smithi045 ceph-mon[31180]: osdmap e35: 6 total, 5 up, 6 in 2024-09-15T22:10:45.101 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:45.101 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:10:45.101 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:10:45.101 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:45.101 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:45 smithi045 ceph-mon[31180]: from='osd.5 ' entity='osd.5' 2024-09-15T22:10:45.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:45 smithi165 ceph-mon[35551]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:45.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:45 smithi165 ceph-mon[35551]: Detected new or changed devices on smithi165 2024-09-15T22:10:45.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:45 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi165 to 8544M 2024-09-15T22:10:45.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:45 smithi165 ceph-mon[35551]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-15T22:10:45.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:45 smithi165 ceph-mon[35551]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T22:10:45.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:45.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:45.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:45 smithi165 ceph-mon[35551]: osdmap e35: 6 total, 5 up, 6 in 2024-09-15T22:10:45.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:45.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:10:45.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:10:45.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:45.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:45 smithi165 ceph-mon[35551]: from='osd.5 ' entity='osd.5' 2024-09-15T22:10:45.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:45 smithi100 ceph-mon[35319]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:45.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:45 smithi100 ceph-mon[35319]: Detected new or changed devices on smithi165 2024-09-15T22:10:45.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:45 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi165 to 8544M 2024-09-15T22:10:45.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:45 smithi100 ceph-mon[35319]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-15T22:10:45.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:45 smithi100 ceph-mon[35319]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T22:10:45.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:45.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:45.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:45 smithi100 ceph-mon[35319]: osdmap e35: 6 total, 5 up, 6 in 2024-09-15T22:10:45.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:45.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:10:45.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:10:45.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:45.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:45 smithi100 ceph-mon[35319]: from='osd.5 ' entity='osd.5' 2024-09-15T22:10:46.144 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:46 smithi045 ceph-mon[31180]: purged_snaps scrub starts 2024-09-15T22:10:46.144 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:46 smithi045 ceph-mon[31180]: purged_snaps scrub ok 2024-09-15T22:10:46.144 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:46 smithi045 ceph-mon[31180]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:46.144 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:46 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:46.144 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:46 smithi045 ceph-mon[31180]: osd.5 [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044] boot 2024-09-15T22:10:46.144 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:46 smithi045 ceph-mon[31180]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T22:10:46.144 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:46 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:46.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:46 smithi165 ceph-mon[35551]: purged_snaps scrub starts 2024-09-15T22:10:46.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:46 smithi165 ceph-mon[35551]: purged_snaps scrub ok 2024-09-15T22:10:46.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:46 smithi165 ceph-mon[35551]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:46.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:46 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:46.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:46 smithi165 ceph-mon[35551]: osd.5 [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044] boot 2024-09-15T22:10:46.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:46 smithi165 ceph-mon[35551]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T22:10:46.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:46 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:46.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:46 smithi100 ceph-mon[35319]: purged_snaps scrub starts 2024-09-15T22:10:46.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:46 smithi100 ceph-mon[35319]: purged_snaps scrub ok 2024-09-15T22:10:46.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:46 smithi100 ceph-mon[35319]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:10:46.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:46 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:46.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:46 smithi100 ceph-mon[35319]: osd.5 [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044] boot 2024-09-15T22:10:46.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:46 smithi100 ceph-mon[35319]: osdmap e36: 6 total, 6 up, 6 in 2024-09-15T22:10:46.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:46 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:10:47.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:47 smithi045 ceph-mon[31180]: pgmap v130: 1 pgs: 1 peering; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:47.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:47 smithi045 ceph-mon[31180]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T22:10:47.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:47 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/806285449' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4df95994-2453-4634-8409-c5c47d0992db"}]: dispatch 2024-09-15T22:10:47.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:47 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/806285449' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4df95994-2453-4634-8409-c5c47d0992db"}]': finished 2024-09-15T22:10:47.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:47 smithi045 ceph-mon[31180]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T22:10:47.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:47 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:10:47.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:47 smithi165 ceph-mon[35551]: pgmap v130: 1 pgs: 1 peering; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:47.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:47 smithi165 ceph-mon[35551]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T22:10:47.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:47 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/806285449' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4df95994-2453-4634-8409-c5c47d0992db"}]: dispatch 2024-09-15T22:10:47.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:47 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/806285449' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4df95994-2453-4634-8409-c5c47d0992db"}]': finished 2024-09-15T22:10:47.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:47 smithi165 ceph-mon[35551]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T22:10:47.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:47 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:10:47.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:47 smithi100 ceph-mon[35319]: pgmap v130: 1 pgs: 1 peering; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-15T22:10:47.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:47 smithi100 ceph-mon[35319]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T22:10:47.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:47 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/806285449' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4df95994-2453-4634-8409-c5c47d0992db"}]: dispatch 2024-09-15T22:10:47.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:47 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/806285449' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4df95994-2453-4634-8409-c5c47d0992db"}]': finished 2024-09-15T22:10:47.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:47 smithi100 ceph-mon[35319]: osdmap e38: 7 total, 6 up, 7 in 2024-09-15T22:10:47.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:47 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:10:48.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:48 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1229840940' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:10:48.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:48 smithi045 ceph-mon[31180]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T22:10:48.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:48 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:10:48.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:48 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1229840940' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:10:48.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:48 smithi165 ceph-mon[35551]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T22:10:48.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:10:48.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:48 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1229840940' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:10:48.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:48 smithi100 ceph-mon[35319]: osdmap e39: 7 total, 6 up, 7 in 2024-09-15T22:10:48.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:48 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:10:49.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:49 smithi045 ceph-mon[31180]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:10:49.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:49 smithi045 ceph-mon[31180]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T22:10:49.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:49 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:10:49.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:49 smithi165 ceph-mon[35551]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:10:49.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:49 smithi165 ceph-mon[35551]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T22:10:49.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:49 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:10:49.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:49 smithi100 ceph-mon[35319]: pgmap v134: 1 pgs: 1 peering; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:10:49.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:49 smithi100 ceph-mon[35319]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T22:10:49.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:49 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:10:51.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:51 smithi045 ceph-mon[31180]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-15T22:10:51.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:51 smithi165 ceph-mon[35551]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-15T22:10:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:51 smithi100 ceph-mon[35319]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-09-15T22:10:53.215 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:53 smithi045 ceph-mon[31180]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-15T22:10:53.282 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:53 smithi165 ceph-mon[35551]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-15T22:10:53.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:53 smithi100 ceph-mon[35319]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-09-15T22:10:55.296 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:55 smithi100 ceph-mon[35319]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-15T22:10:55.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:55 smithi045 ceph-mon[31180]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-15T22:10:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:55 smithi165 ceph-mon[35551]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-15T22:10:56.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:56 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:10:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:56 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:56 smithi045 ceph-mon[31180]: Deploying daemon osd.6 on smithi045 2024-09-15T22:10:56.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:56 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:10:56.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:56 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:56.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:56 smithi165 ceph-mon[35551]: Deploying daemon osd.6 on smithi045 2024-09-15T22:10:56.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:56 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T22:10:56.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:56 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:10:56.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:56 smithi100 ceph-mon[35319]: Deploying daemon osd.6 on smithi045 2024-09-15T22:10:57.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:57 smithi045 ceph-mon[31180]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:10:57.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:57 smithi165 ceph-mon[35551]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:10:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:57 smithi100 ceph-mon[35319]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:10:59.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:10:59 smithi045 ceph-mon[31180]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-15T22:10:59.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:10:59 smithi165 ceph-mon[35551]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-15T22:10:59.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:10:59 smithi100 ceph-mon[35319]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-15T22:11:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:01 smithi045 ceph-mon[31180]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-15T22:11:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:01 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:01 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:01 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:01.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:01 smithi165 ceph-mon[35551]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-15T22:11:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:01 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:01 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:01 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:01 smithi100 ceph-mon[35319]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-15T22:11:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:01 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:01 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:01 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:03.202 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:03 smithi045 ceph-mon[31180]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:03.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:03 smithi165 ceph-mon[35551]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:03.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:03 smithi100 ceph-mon[35319]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:04.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:04.283+0000 7fbca67fc640 1 -- 172.21.15.45:0/3771337365 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbcb01a0890 con 0x7fbc9c0a32f0 2024-09-15T22:11:04.285 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 6 on host 'smithi045' 2024-09-15T22:11:04.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:04.285+0000 7fbcb7524640 1 -- 172.21.15.45:0/3771337365 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbc9c0a32f0 msgr2=0x7fbc9c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:04.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:04.285+0000 7fbcb7524640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbc9c0a32f0 0x7fbc9c0a57b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbcac005fd0 tx=0x7fbcac00b390 comp rx=0 tx=0).stop 2024-09-15T22:11:04.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:04.285+0000 7fbcb7524640 1 -- 172.21.15.45:0/3771337365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb0102690 msgr2=0x7fbcb019f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:04.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:04.285+0000 7fbcb7524640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb0102690 0x7fbcb019f5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbca8006010 tx=0x7fbca8031ee0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:04.285+0000 7fbcb7524640 1 -- 172.21.15.45:0/3771337365 shutdown_connections 2024-09-15T22:11:04.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:04.285+0000 7fbcb7524640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbc9c0a32f0 0x7fbc9c0a57b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:04.285+0000 7fbcb7524640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbcb0102690 0x7fbcb019f5a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:04.285+0000 7fbcb7524640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcb0101cd0 0x7fbcb0198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:04.285+0000 7fbcb7524640 1 --2- 172.21.15.45:0/3771337365 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbcb0100ad0 0x7fbcb0197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:04.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:04.285+0000 7fbcb7524640 1 -- 172.21.15.45:0/3771337365 >> 172.21.15.45:0/3771337365 conn(0x7fbcb00fc280 msgr2=0x7fbcb00fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:04.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:04.285+0000 7fbcb7524640 1 -- 172.21.15.45:0/3771337365 shutdown_connections 2024-09-15T22:11:04.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:04.285+0000 7fbcb7524640 1 -- 172.21.15.45:0/3771337365 wait complete. 2024-09-15T22:11:04.899 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:04 smithi045 ceph-mon[31180]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:04.900 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:04 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.900 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:04 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.900 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:04 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:04.900 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:04 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:04.900 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:04 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.900 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:04 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:04.900 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:04 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.900 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:04 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.926 DEBUG:teuthology.orchestra.run.smithi045:osd.6> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.6.service 2024-09-15T22:11:04.932 INFO:tasks.cephadm:Deploying osd.7 on smithi100 with /dev/vg_nvme/lv_2... 2024-09-15T22:11:04.932 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:11:04.960 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:04 smithi100 ceph-mon[35319]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:04.960 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.960 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.960 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:04.960 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:04.960 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.961 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:04.961 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.961 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:04 smithi165 ceph-mon[35551]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:04.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:04 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:04 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:04 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:04.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:04 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:04.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:04 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:04 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:04.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:04 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:04.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:04 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:05.186 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:11:06.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:06 smithi045 ceph-mon[31180]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:06.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:06 smithi045 ceph-mon[31180]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:11:06.801 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:11:06 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:11:06.593+0000 7fe9cb315640 -1 osd.6 0 log_to_monitors true 2024-09-15T22:11:06.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:06 smithi165 ceph-mon[35551]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:06.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:06 smithi165 ceph-mon[35551]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:11:06.990 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:06 smithi100 ceph-mon[35319]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:06.990 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:06 smithi100 ceph-mon[35319]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T22:11:07.750 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:11:07.778 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_2 2024-09-15T22:11:07.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:07 smithi045 ceph-mon[31180]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:11:07.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:07 smithi045 ceph-mon[31180]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T22:11:07.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:07 smithi045 ceph-mon[31180]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-15T22:11:07.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:07.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:07 smithi045 ceph-mon[31180]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-15T22:11:07.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:07 smithi045 ceph-mon[31180]: osdmap e42: 7 total, 6 up, 7 in 2024-09-15T22:11:07.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:07.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:07 smithi165 ceph-mon[35551]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:11:07.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:07 smithi165 ceph-mon[35551]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T22:11:07.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:07 smithi165 ceph-mon[35551]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-15T22:11:07.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:07.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:07 smithi165 ceph-mon[35551]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-15T22:11:07.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:07 smithi165 ceph-mon[35551]: osdmap e42: 7 total, 6 up, 7 in 2024-09-15T22:11:07.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:07.997 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:07 smithi100 ceph-mon[35319]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T22:11:07.997 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:07 smithi100 ceph-mon[35319]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T22:11:07.997 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:07 smithi100 ceph-mon[35319]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-15T22:11:07.997 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:07.997 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:07 smithi100 ceph-mon[35319]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-15T22:11:07.997 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:07 smithi100 ceph-mon[35319]: osdmap e42: 7 total, 6 up, 7 in 2024-09-15T22:11:07.997 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:08.070 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:11:08.550 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:11:08.143+0000 7fe9c7aac640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T22:11:08.550 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:11:08.151+0000 7fe9bf0b8640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:11:08.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.573+0000 7f93b5408640 1 -- 172.21.15.100:0/1886121893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93b0101c00 msgr2=0x7f93b0102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:08.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.573+0000 7f93b5408640 1 --2- 172.21.15.100:0/1886121893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93b0101c00 0x7f93b0102000 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f93a0009900 tx=0x7f93a002a410 comp rx=0 tx=0).stop 2024-09-15T22:11:08.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.573+0000 7f93b5408640 1 -- 172.21.15.100:0/1886121893 shutdown_connections 2024-09-15T22:11:08.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.573+0000 7f93b5408640 1 --2- 172.21.15.100:0/1886121893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93b01037c0 0x7f93b010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:08.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.573+0000 7f93b5408640 1 --2- 172.21.15.100:0/1886121893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93b0102e00 0x7f93b0103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:08.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.573+0000 7f93b5408640 1 --2- 172.21.15.100:0/1886121893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93b0101c00 0x7f93b0102000 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:08.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.573+0000 7f93b5408640 1 -- 172.21.15.100:0/1886121893 >> 172.21.15.100:0/1886121893 conn(0x7f93b00fd390 msgr2=0x7f93b00ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:08.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.573+0000 7f93b5408640 1 -- 172.21.15.100:0/1886121893 shutdown_connections 2024-09-15T22:11:08.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.573+0000 7f93b5408640 1 -- 172.21.15.100:0/1886121893 wait complete. 2024-09-15T22:11:08.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.573+0000 7f93b5408640 1 Processor -- start 2024-09-15T22:11:08.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93b5408640 1 -- start start 2024-09-15T22:11:08.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93b5408640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93b0101c00 0x7f93b0198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:08.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93b5408640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93b0102e00 0x7f93b0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:08.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93b5408640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93b01037c0 0x7f93b019f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:08.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93b5408640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f93b010da20 con 0x7f93b0102e00 2024-09-15T22:11:08.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93b5408640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f93b010d8a0 con 0x7f93b01037c0 2024-09-15T22:11:08.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93b5408640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f93b010dba0 con 0x7f93b0101c00 2024-09-15T22:11:08.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93af7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93b01037c0 0x7f93b019f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:08.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93af7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93b01037c0 0x7f93b019f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48216/0 (socket says 172.21.15.100:48216) 2024-09-15T22:11:08.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93af7fe640 1 -- 172.21.15.100:0/2465655561 learned_addr learned my addr 172.21.15.100:0/2465655561 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-15T22:11:08.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93ae7fc640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93b0102e00 0x7f93b0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:08.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93aeffd640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93b0101c00 0x7f93b0198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:08.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93af7fe640 1 -- 172.21.15.100:0/2465655561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93b0101c00 msgr2=0x7f93b0198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:08.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93af7fe640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93b0101c00 0x7f93b0198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:08.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93af7fe640 1 -- 172.21.15.100:0/2465655561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93b0102e00 msgr2=0x7f93b0198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:08.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93af7fe640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93b0102e00 0x7f93b0198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:08.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93af7fe640 1 -- 172.21.15.100:0/2465655561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b019fc70 con 0x7f93b01037c0 2024-09-15T22:11:08.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.574+0000 7f93af7fe640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93b01037c0 0x7f93b019f600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f93a800eb10 tx=0x7f93a800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:08.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.575+0000 7f9397fff640 1 -- 172.21.15.100:0/2465655561 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a800ce20 con 0x7f93b01037c0 2024-09-15T22:11:08.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.575+0000 7f9397fff640 1 -- 172.21.15.100:0/2465655561 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f93a8004b20 con 0x7f93b01037c0 2024-09-15T22:11:08.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.575+0000 7f93b5408640 1 -- 172.21.15.100:0/2465655561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b019ff60 con 0x7f93b01037c0 2024-09-15T22:11:08.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.575+0000 7f9397fff640 1 -- 172.21.15.100:0/2465655561 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a8010760 con 0x7f93b01037c0 2024-09-15T22:11:08.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.575+0000 7f93b5408640 1 -- 172.21.15.100:0/2465655561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b01a0440 con 0x7f93b01037c0 2024-09-15T22:11:08.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.576+0000 7f93b5408640 1 -- 172.21.15.100:0/2465655561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b0108f80 con 0x7f93b01037c0 2024-09-15T22:11:08.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.577+0000 7f9397fff640 1 -- 172.21.15.100:0/2465655561 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f93a8005020 con 0x7f93b01037c0 2024-09-15T22:11:08.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.577+0000 7f9397fff640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f93980a3270 0x7f93980a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:08.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.577+0000 7f9397fff640 1 -- 172.21.15.100:0/2465655561 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4685+0+0 (secure 0 0 0) 0x7f93a80cf0d0 con 0x7f93b01037c0 2024-09-15T22:11:08.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.577+0000 7f93aeffd640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f93980a3270 0x7f93980a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:08.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.578+0000 7f93aeffd640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f93980a3270 0x7f93980a5730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93a0006010 tx=0x7f93a0005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:08.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.582+0000 7f9397fff640 1 -- 172.21.15.100:0/2465655561 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93a809cc20 con 0x7f93b01037c0 2024-09-15T22:11:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: Detected new or changed devices on smithi045 2024-09-15T22:11:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:08.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:08.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:08.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:08.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi045 to 5697M 2024-09-15T22:11:08.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:08.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:08.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:08.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:08.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' 2024-09-15T22:11:08.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:08.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:08.758+0000 7f93b5408640 1 -- 172.21.15.100:0/2465655561 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f93b0062630 con 0x7f93980a3270 2024-09-15T22:11:08.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:08.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:08.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: Detected new or changed devices on smithi045 2024-09-15T22:11:08.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:08.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:08.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:08.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:08.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:08.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi045 to 5697M 2024-09-15T22:11:08.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:08.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:08.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:08.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:08.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' 2024-09-15T22:11:08.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:09.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:09.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:09.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: Detected new or changed devices on smithi045 2024-09-15T22:11:09.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:09.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:09.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:09.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:09.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:09.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi045 to 5697M 2024-09-15T22:11:09.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:09.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:09.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:09.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:09.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: from='osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026]' entity='osd.6' 2024-09-15T22:11:09.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:09.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:09 smithi100 ceph-mon[35319]: purged_snaps scrub starts 2024-09-15T22:11:09.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:09 smithi100 ceph-mon[35319]: purged_snaps scrub ok 2024-09-15T22:11:09.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:09 smithi100 ceph-mon[35319]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:09.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:09 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:11:09.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:09 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:11:09.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:09 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:09.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:09 smithi100 ceph-mon[35319]: osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026] boot 2024-09-15T22:11:09.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:09 smithi100 ceph-mon[35319]: osdmap e43: 7 total, 7 up, 7 in 2024-09-15T22:11:09.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:09 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:09.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:09 smithi165 ceph-mon[35551]: purged_snaps scrub starts 2024-09-15T22:11:09.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:09 smithi165 ceph-mon[35551]: purged_snaps scrub ok 2024-09-15T22:11:09.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:09 smithi165 ceph-mon[35551]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:09.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:09 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:11:09.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:09 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:11:09.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:09 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:09.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:09 smithi165 ceph-mon[35551]: osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026] boot 2024-09-15T22:11:09.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:09 smithi165 ceph-mon[35551]: osdmap e43: 7 total, 7 up, 7 in 2024-09-15T22:11:09.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:09 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:10.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:09 smithi045 ceph-mon[31180]: purged_snaps scrub starts 2024-09-15T22:11:10.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:09 smithi045 ceph-mon[31180]: purged_snaps scrub ok 2024-09-15T22:11:10.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:09 smithi045 ceph-mon[31180]: from='client.24263 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:10.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:09 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:11:10.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:09 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:11:10.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:09 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:10.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:09 smithi045 ceph-mon[31180]: osd.6 [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026] boot 2024-09-15T22:11:10.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:09 smithi045 ceph-mon[31180]: osdmap e43: 7 total, 7 up, 7 in 2024-09-15T22:11:10.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:09 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:11:11.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:11 smithi165 ceph-mon[35551]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:11.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:11 smithi165 ceph-mon[35551]: osdmap e44: 7 total, 7 up, 7 in 2024-09-15T22:11:11.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:11 smithi165 ceph-mon[35551]: from='client.? 172.21.15.100:0/1519235918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72e67807-f145-4211-a378-764b37983824"}]: dispatch 2024-09-15T22:11:11.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:11 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72e67807-f145-4211-a378-764b37983824"}]: dispatch 2024-09-15T22:11:11.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:11 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72e67807-f145-4211-a378-764b37983824"}]': finished 2024-09-15T22:11:11.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:11 smithi165 ceph-mon[35551]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T22:11:11.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:11.471 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:11 smithi100 ceph-mon[35319]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:11.471 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:11 smithi100 ceph-mon[35319]: osdmap e44: 7 total, 7 up, 7 in 2024-09-15T22:11:11.471 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:11 smithi100 ceph-mon[35319]: from='client.? 172.21.15.100:0/1519235918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72e67807-f145-4211-a378-764b37983824"}]: dispatch 2024-09-15T22:11:11.471 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:11 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72e67807-f145-4211-a378-764b37983824"}]: dispatch 2024-09-15T22:11:11.471 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:11 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72e67807-f145-4211-a378-764b37983824"}]': finished 2024-09-15T22:11:11.471 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:11 smithi100 ceph-mon[35319]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T22:11:11.471 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:11.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:11 smithi045 ceph-mon[31180]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 195 MiB used, 536 GiB / 536 GiB avail 2024-09-15T22:11:11.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:11 smithi045 ceph-mon[31180]: osdmap e44: 7 total, 7 up, 7 in 2024-09-15T22:11:11.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:11 smithi045 ceph-mon[31180]: from='client.? 172.21.15.100:0/1519235918' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72e67807-f145-4211-a378-764b37983824"}]: dispatch 2024-09-15T22:11:11.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:11 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72e67807-f145-4211-a378-764b37983824"}]: dispatch 2024-09-15T22:11:11.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:11 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72e67807-f145-4211-a378-764b37983824"}]': finished 2024-09-15T22:11:11.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:11 smithi045 ceph-mon[31180]: osdmap e45: 8 total, 7 up, 8 in 2024-09-15T22:11:11.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:12.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:12 smithi165 ceph-mon[35551]: from='client.? 172.21.15.100:0/140722618' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:11:12.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:12 smithi100 ceph-mon[35319]: from='client.? 172.21.15.100:0/140722618' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:11:12.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:12 smithi045 ceph-mon[31180]: from='client.? 172.21.15.100:0/140722618' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:11:13.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:13 smithi165 ceph-mon[35551]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:13.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:13 smithi100 ceph-mon[35319]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:13.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:13 smithi045 ceph-mon[31180]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:15.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:15 smithi165 ceph-mon[35551]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:15.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:15 smithi100 ceph-mon[35319]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:15.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:15 smithi045 ceph-mon[31180]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:17.371 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:17 smithi100 ceph-mon[35319]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:17 smithi165 ceph-mon[35551]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:17.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:17 smithi045 ceph-mon[31180]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:19.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:19 smithi165 ceph-mon[35551]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:19.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:19 smithi100 ceph-mon[35319]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:19.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:19 smithi045 ceph-mon[31180]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:20.219 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:11:20.220 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:20.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:11:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:20.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T22:11:20.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:21.352 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:21 smithi100 ceph-mon[35319]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:21.352 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:21 smithi100 ceph-mon[35319]: Deploying daemon osd.7 on smithi100 2024-09-15T22:11:21.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:21 smithi165 ceph-mon[35551]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:21.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:21 smithi165 ceph-mon[35551]: Deploying daemon osd.7 on smithi100 2024-09-15T22:11:21.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:21 smithi045 ceph-mon[31180]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:21.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:21 smithi045 ceph-mon[31180]: Deploying daemon osd.7 on smithi100 2024-09-15T22:11:23.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:23 smithi100 ceph-mon[35319]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:23.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:23 smithi165 ceph-mon[35551]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:23.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:23 smithi045 ceph-mon[31180]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:25.348 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:25 smithi100 ceph-mon[35319]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:25.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:25 smithi165 ceph-mon[35551]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:25.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:25 smithi045 ceph-mon[31180]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:26.356 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:26 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:26.356 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:26 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:26.356 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:26 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:26.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:26 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:26.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:26 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:26.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:26 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:26.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:26.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:26.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:27.437 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:27 smithi100 ceph-mon[35319]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:27.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:27 smithi165 ceph-mon[35551]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:27.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:27 smithi045 ceph-mon[31180]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:29.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:29.042+0000 7f9397fff640 1 -- 172.21.15.100:0/2465655561 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f93b0062630 con 0x7f93980a3270 2024-09-15T22:11:29.045 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 7 on host 'smithi100' 2024-09-15T22:11:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:29.045+0000 7f93b5408640 1 -- 172.21.15.100:0/2465655561 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f93980a3270 msgr2=0x7f93980a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:29.045+0000 7f93b5408640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f93980a3270 0x7f93980a5730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93a0006010 tx=0x7f93a0005be0 comp rx=0 tx=0).stop 2024-09-15T22:11:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:29.045+0000 7f93b5408640 1 -- 172.21.15.100:0/2465655561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93b01037c0 msgr2=0x7f93b019f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:29.045+0000 7f93b5408640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93b01037c0 0x7f93b019f600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f93a800eb10 tx=0x7f93a800ef10 comp rx=0 tx=0).stop 2024-09-15T22:11:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:29.045+0000 7f93b5408640 1 -- 172.21.15.100:0/2465655561 shutdown_connections 2024-09-15T22:11:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:29.045+0000 7f93b5408640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f93980a3270 0x7f93980a5730 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:29.045+0000 7f93b5408640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93b01037c0 0x7f93b019f600 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:29.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:29.045+0000 7f93b5408640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93b0102e00 0x7f93b0198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:29.045+0000 7f93b5408640 1 --2- 172.21.15.100:0/2465655561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f93b0101c00 0x7f93b0198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:29.045+0000 7f93b5408640 1 -- 172.21.15.100:0/2465655561 >> 172.21.15.100:0/2465655561 conn(0x7f93b00fd390 msgr2=0x7f93b0106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:29.045+0000 7f93b5408640 1 -- 172.21.15.100:0/2465655561 shutdown_connections 2024-09-15T22:11:29.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:11:29.045+0000 7f93b5408640 1 -- 172.21.15.100:0/2465655561 wait complete. 2024-09-15T22:11:29.409 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:29 smithi100 ceph-mon[35319]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:29.409 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:29 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:29.409 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:29 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:29 smithi165 ceph-mon[35551]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:29 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:29 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:29.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:29 smithi045 ceph-mon[31180]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:29.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:29 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:29.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:29 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:29.712 DEBUG:teuthology.orchestra.run.smithi100:osd.7> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.7.service 2024-09-15T22:11:29.714 INFO:tasks.cephadm:Deploying osd.8 on smithi165 with /dev/vg_nvme/lv_2... 2024-09-15T22:11:29.714 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T22:11:29.973 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:11:31.181 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:30 smithi165 ceph-mon[35551]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:31.181 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:30 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:31.181 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:30 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:31.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:30 smithi100 ceph-mon[35319]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:31.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:30 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:31.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:30 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:31.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:30 smithi045 ceph-mon[31180]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:31.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:30 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:31.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:30 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:31.580 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:11:31 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:11:31.499+0000 7f1125fd1640 -1 osd.7 0 log_to_monitors true 2024-09-15T22:11:31.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:31 smithi165 ceph-mon[35551]: from='osd.7 [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:11:31.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:31 smithi165 ceph-mon[35551]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:11:32.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:31 smithi100 ceph-mon[35319]: from='osd.7 [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:11:32.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:31 smithi100 ceph-mon[35319]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:11:32.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:31 smithi045 ceph-mon[31180]: from='osd.7 [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:11:32.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:31 smithi045 ceph-mon[31180]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T22:11:32.694 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:11:32.721 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_2 2024-09-15T22:11:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:32 smithi165 ceph-mon[35551]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:32 smithi165 ceph-mon[35551]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:11:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:32 smithi165 ceph-mon[35551]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T22:11:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:32 smithi165 ceph-mon[35551]: from='osd.7 [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:11:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:32 smithi165 ceph-mon[35551]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:11:32.973 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:11:32.994 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:11:32 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:11:32.869+0000 7f1121f54640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T22:11:32.994 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:11:32 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:11:32.876+0000 7f111dd7c640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:11:32.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:32 smithi100 ceph-mon[35319]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:32.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:32 smithi100 ceph-mon[35319]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:11:32.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:32 smithi100 ceph-mon[35319]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T22:11:32.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:32.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:32 smithi100 ceph-mon[35319]: from='osd.7 [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:11:32.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:32 smithi100 ceph-mon[35319]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:11:33.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:32 smithi045 ceph-mon[31180]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:33.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:32 smithi045 ceph-mon[31180]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T22:11:33.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:32 smithi045 ceph-mon[31180]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T22:11:33.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:33.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:32 smithi045 ceph-mon[31180]: from='osd.7 [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:11:33.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:32 smithi045 ceph-mon[31180]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:11:33.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.459+0000 7f0031bbf640 1 -- 172.21.15.165:0/328696271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f002c100ad0 msgr2=0x7f002c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:33.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.459+0000 7f0031bbf640 1 --2- 172.21.15.165:0/328696271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f002c100ad0 0x7f002c100ed0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f001c009900 tx=0x7f001c02a410 comp rx=0 tx=0).stop 2024-09-15T22:11:33.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.459+0000 7f0031bbf640 1 -- 172.21.15.165:0/328696271 shutdown_connections 2024-09-15T22:11:33.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.459+0000 7f0031bbf640 1 --2- 172.21.15.165:0/328696271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f002c102690 0x7f002c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:33.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.459+0000 7f0031bbf640 1 --2- 172.21.15.165:0/328696271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c101cd0 0x7f002c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:33.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.459+0000 7f0031bbf640 1 --2- 172.21.15.165:0/328696271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f002c100ad0 0x7f002c100ed0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:33.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.459+0000 7f0031bbf640 1 -- 172.21.15.165:0/328696271 >> 172.21.15.165:0/328696271 conn(0x7f002c0fc280 msgr2=0x7f002c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:33.479 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.459+0000 7f0031bbf640 1 -- 172.21.15.165:0/328696271 shutdown_connections 2024-09-15T22:11:33.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.459+0000 7f0031bbf640 1 -- 172.21.15.165:0/328696271 wait complete. 2024-09-15T22:11:33.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.460+0000 7f0031bbf640 1 Processor -- start 2024-09-15T22:11:33.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.460+0000 7f0031bbf640 1 -- start start 2024-09-15T22:11:33.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.460+0000 7f0031bbf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c100ad0 0x7f002c198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:33.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.460+0000 7f0031bbf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f002c101cd0 0x7f002c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:33.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.460+0000 7f0031bbf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f002c102690 0x7f002c19f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:33.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.460+0000 7f0031bbf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f002c10da20 con 0x7f002c101cd0 2024-09-15T22:11:33.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.460+0000 7f0031bbf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f002c10d8a0 con 0x7f002c100ad0 2024-09-15T22:11:33.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.460+0000 7f0031bbf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f002c10dba0 con 0x7f002c102690 2024-09-15T22:11:33.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.460+0000 7f002bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f002c102690 0x7f002c19f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:33.480 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.460+0000 7f002b7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c100ad0 0x7f002c198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:33.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.460+0000 7f002bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f002c102690 0x7f002c19f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:40716/0 (socket says 172.21.15.165:40716) 2024-09-15T22:11:33.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.460+0000 7f002bfff640 1 -- 172.21.15.165:0/692300683 learned_addr learned my addr 172.21.15.165:0/692300683 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-15T22:11:33.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.461+0000 7f002affd640 1 --2- 172.21.15.165:0/692300683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f002c101cd0 0x7f002c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:33.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.461+0000 7f002bfff640 1 -- 172.21.15.165:0/692300683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c100ad0 msgr2=0x7f002c198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:33.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.461+0000 7f002bfff640 1 --2- 172.21.15.165:0/692300683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c100ad0 0x7f002c198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:33.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.461+0000 7f002bfff640 1 -- 172.21.15.165:0/692300683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f002c101cd0 msgr2=0x7f002c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:33.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.461+0000 7f002bfff640 1 --2- 172.21.15.165:0/692300683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f002c101cd0 0x7f002c1985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:33.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.461+0000 7f002bfff640 1 -- 172.21.15.165:0/692300683 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002c19fca0 con 0x7f002c102690 2024-09-15T22:11:33.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.461+0000 7f002bfff640 1 --2- 172.21.15.165:0/692300683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f002c102690 0x7f002c19f630 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f002400b970 tx=0x7f002400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:33.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.461+0000 7f0028ff9640 1 -- 172.21.15.165:0/692300683 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024019070 con 0x7f002c102690 2024-09-15T22:11:33.481 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.461+0000 7f0031bbf640 1 -- 172.21.15.165:0/692300683 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f002c19ff90 con 0x7f002c102690 2024-09-15T22:11:33.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.461+0000 7f0028ff9640 1 -- 172.21.15.165:0/692300683 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f002400cb40 con 0x7f002c102690 2024-09-15T22:11:33.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.461+0000 7f0028ff9640 1 -- 172.21.15.165:0/692300683 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024007700 con 0x7f002c102690 2024-09-15T22:11:33.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.461+0000 7f0031bbf640 1 -- 172.21.15.165:0/692300683 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f002c1a0470 con 0x7f002c102690 2024-09-15T22:11:33.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.462+0000 7f0031bbf640 1 -- 172.21.15.165:0/692300683 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002c107ec0 con 0x7f002c102690 2024-09-15T22:11:33.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.463+0000 7f0028ff9640 1 -- 172.21.15.165:0/692300683 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f002401c070 con 0x7f002c102690 2024-09-15T22:11:33.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.464+0000 7f0028ff9640 1 --2- 172.21.15.165:0/692300683 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00140a3270 0x7f00140a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:33.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.464+0000 7f0028ff9640 1 -- 172.21.15.165:0/692300683 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5117+0+0 (secure 0 0 0) 0x7f00240ce1e0 con 0x7f002c102690 2024-09-15T22:11:33.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.464+0000 7f002b7fe640 1 --2- 172.21.15.165:0/692300683 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00140a3270 0x7f00140a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:33.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.464+0000 7f002b7fe640 1 --2- 172.21.15.165:0/692300683 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00140a3270 0x7f00140a5730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f001c031570 tx=0x7f001c031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:33.482 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.468+0000 7f0028ff9640 1 -- 172.21.15.165:0/692300683 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f002409b530 con 0x7f002c102690 2024-09-15T22:11:33.645 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:33.643+0000 7f0031bbf640 1 -- 172.21.15.165:0/692300683 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f002c062630 con 0x7f00140a3270 2024-09-15T22:11:33.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-15T22:11:33.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: osdmap e47: 8 total, 7 up, 8 in 2024-09-15T22:11:33.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:33.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:33.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: Detected new or changed devices on smithi100 2024-09-15T22:11:33.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:33.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:33.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:33.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:33.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:33.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-15T22:11:33.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:33.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:33.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:33.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:33.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:33.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:33.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:33.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:33.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:11:33.967 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:11:33.967 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:33 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:34.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-15T22:11:34.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: osdmap e47: 8 total, 7 up, 8 in 2024-09-15T22:11:34.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:34.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:34.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: Detected new or changed devices on smithi100 2024-09-15T22:11:34.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:34.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:34.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:34.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:34.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:34.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-15T22:11:34.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:34.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:34.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:34.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:34.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:34.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:34.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:34.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:34.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:11:34.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:11:34.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:33 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-15T22:11:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: osdmap e47: 8 total, 7 up, 8 in 2024-09-15T22:11:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: Detected new or changed devices on smithi100 2024-09-15T22:11:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:34.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:34.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:34.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:34.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi100 to 5695M 2024-09-15T22:11:34.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:34.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:34.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:34.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:34.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:34.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:34.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:34.302 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:34.302 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:11:34.302 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:11:34.302 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:33 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:35.086 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:34 smithi165 ceph-mon[35551]: purged_snaps scrub starts 2024-09-15T22:11:35.087 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:34 smithi165 ceph-mon[35551]: purged_snaps scrub ok 2024-09-15T22:11:35.087 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:34 smithi165 ceph-mon[35551]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:35.087 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:34 smithi165 ceph-mon[35551]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:35.087 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:34 smithi165 ceph-mon[35551]: osd.7 [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304] boot 2024-09-15T22:11:35.087 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:34 smithi165 ceph-mon[35551]: osdmap e48: 8 total, 8 up, 8 in 2024-09-15T22:11:35.087 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:34 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:35.087 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:34 smithi165 ceph-mon[35551]: osdmap e49: 8 total, 8 up, 8 in 2024-09-15T22:11:35.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:34 smithi100 ceph-mon[35319]: purged_snaps scrub starts 2024-09-15T22:11:35.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:34 smithi100 ceph-mon[35319]: purged_snaps scrub ok 2024-09-15T22:11:35.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:34 smithi100 ceph-mon[35319]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:35.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:34 smithi100 ceph-mon[35319]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:35.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:34 smithi100 ceph-mon[35319]: osd.7 [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304] boot 2024-09-15T22:11:35.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:34 smithi100 ceph-mon[35319]: osdmap e48: 8 total, 8 up, 8 in 2024-09-15T22:11:35.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:34 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:35.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:34 smithi100 ceph-mon[35319]: osdmap e49: 8 total, 8 up, 8 in 2024-09-15T22:11:35.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:34 smithi045 ceph-mon[31180]: purged_snaps scrub starts 2024-09-15T22:11:35.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:34 smithi045 ceph-mon[31180]: purged_snaps scrub ok 2024-09-15T22:11:35.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:34 smithi045 ceph-mon[31180]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 230 MiB used, 626 GiB / 626 GiB avail 2024-09-15T22:11:35.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:34 smithi045 ceph-mon[31180]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:11:35.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:34 smithi045 ceph-mon[31180]: osd.7 [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304] boot 2024-09-15T22:11:35.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:34 smithi045 ceph-mon[31180]: osdmap e48: 8 total, 8 up, 8 in 2024-09-15T22:11:35.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:34 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:11:35.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:34 smithi045 ceph-mon[31180]: osdmap e49: 8 total, 8 up, 8 in 2024-09-15T22:11:36.640 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:36 smithi165 ceph-mon[35551]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:36.640 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:36 smithi165 ceph-mon[35551]: osdmap e50: 8 total, 8 up, 8 in 2024-09-15T22:11:36.640 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:36 smithi165 ceph-mon[35551]: from='client.? 172.21.15.165:0/2084907388' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5"}]: dispatch 2024-09-15T22:11:36.640 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:36 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5"}]: dispatch 2024-09-15T22:11:36.640 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:36 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5"}]': finished 2024-09-15T22:11:36.641 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:36 smithi165 ceph-mon[35551]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T22:11:36.641 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:11:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:36 smithi100 ceph-mon[35319]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:36 smithi100 ceph-mon[35319]: osdmap e50: 8 total, 8 up, 8 in 2024-09-15T22:11:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:36 smithi100 ceph-mon[35319]: from='client.? 172.21.15.165:0/2084907388' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5"}]: dispatch 2024-09-15T22:11:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:36 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5"}]: dispatch 2024-09-15T22:11:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:36 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5"}]': finished 2024-09-15T22:11:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:36 smithi100 ceph-mon[35319]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T22:11:36.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:11:36.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:36 smithi045 ceph-mon[31180]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:36 smithi045 ceph-mon[31180]: osdmap e50: 8 total, 8 up, 8 in 2024-09-15T22:11:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:36 smithi045 ceph-mon[31180]: from='client.? 172.21.15.165:0/2084907388' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5"}]: dispatch 2024-09-15T22:11:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:36 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5"}]: dispatch 2024-09-15T22:11:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:36 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5"}]': finished 2024-09-15T22:11:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:36 smithi045 ceph-mon[31180]: osdmap e51: 9 total, 8 up, 9 in 2024-09-15T22:11:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:11:37.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:37 smithi165 ceph-mon[35551]: from='client.? 172.21.15.165:0/2947591581' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:11:37.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:37 smithi165 ceph-mon[35551]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:11:37.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:37 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:11:37.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:37 smithi100 ceph-mon[35319]: from='client.? 172.21.15.165:0/2947591581' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:11:37.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:37 smithi100 ceph-mon[35319]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:11:37.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:37 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:11:37.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:37 smithi045 ceph-mon[31180]: from='client.? 172.21.15.165:0/2947591581' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:11:37.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:37 smithi045 ceph-mon[31180]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T22:11:37.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:37 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:11:39.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:39 smithi165 ceph-mon[35551]: pgmap v173: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:39.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:39 smithi100 ceph-mon[35319]: pgmap v173: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:39.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:39 smithi045 ceph-mon[31180]: pgmap v173: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:41.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:41 smithi165 ceph-mon[35551]: pgmap v174: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:41.352 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:41 smithi045 ceph-mon[31180]: pgmap v174: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:41 smithi100 ceph-mon[35319]: pgmap v174: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:43.378 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:43 smithi165 ceph-mon[35551]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:43.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:43 smithi100 ceph-mon[35319]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:43.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:43 smithi045 ceph-mon[31180]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:45.325 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:45 smithi165 ceph-mon[35551]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:45.326 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:11:45.326 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:45.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:45 smithi100 ceph-mon[35319]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:45.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:11:45.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:45.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:45 smithi045 ceph-mon[31180]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T22:11:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:46.207 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:46 smithi165 ceph-mon[35551]: Deploying daemon osd.8 on smithi165 2024-09-15T22:11:46.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:46 smithi100 ceph-mon[35319]: Deploying daemon osd.8 on smithi165 2024-09-15T22:11:46.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:46 smithi045 ceph-mon[31180]: Deploying daemon osd.8 on smithi165 2024-09-15T22:11:47.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:47 smithi165 ceph-mon[35551]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:47.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:47 smithi100 ceph-mon[35319]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:47.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:47 smithi045 ceph-mon[31180]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:49.360 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:49 smithi165 ceph-mon[35551]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:49.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:49 smithi100 ceph-mon[35319]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:49.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:49 smithi045 ceph-mon[31180]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:51.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:51 smithi165 ceph-mon[35551]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:51.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:51 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:51.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:51 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:51.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:51 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:51 smithi100 ceph-mon[35319]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:51 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:51 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:51 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:51.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:51 smithi045 ceph-mon[31180]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:51.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:51 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:51.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:51 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:51.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:51 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:53.358 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:53 smithi165 ceph-mon[35551]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:53.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:53 smithi100 ceph-mon[35319]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:53.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:53 smithi045 ceph-mon[31180]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:54.959 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 8 on host 'smithi165' 2024-09-15T22:11:54.959 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:54.957+0000 7f0028ff9640 1 -- 172.21.15.165:0/692300683 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f002c062630 con 0x7f00140a3270 2024-09-15T22:11:54.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:54.959+0000 7f0031bbf640 1 -- 172.21.15.165:0/692300683 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00140a3270 msgr2=0x7f00140a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:54.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:54.959+0000 7f0031bbf640 1 --2- 172.21.15.165:0/692300683 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00140a3270 0x7f00140a5730 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f001c031570 tx=0x7f001c031640 comp rx=0 tx=0).stop 2024-09-15T22:11:54.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:54.959+0000 7f0031bbf640 1 -- 172.21.15.165:0/692300683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f002c102690 msgr2=0x7f002c19f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:54.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:54.959+0000 7f0031bbf640 1 --2- 172.21.15.165:0/692300683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f002c102690 0x7f002c19f630 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f002400b970 tx=0x7f002400be30 comp rx=0 tx=0).stop 2024-09-15T22:11:54.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:54.959+0000 7f0031bbf640 1 -- 172.21.15.165:0/692300683 shutdown_connections 2024-09-15T22:11:54.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:54.959+0000 7f0031bbf640 1 --2- 172.21.15.165:0/692300683 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00140a3270 0x7f00140a5730 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:54.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:54.959+0000 7f0031bbf640 1 --2- 172.21.15.165:0/692300683 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f002c102690 0x7f002c19f630 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:54.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:54.959+0000 7f0031bbf640 1 --2- 172.21.15.165:0/692300683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f002c101cd0 0x7f002c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:54.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:54.959+0000 7f0031bbf640 1 --2- 172.21.15.165:0/692300683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f002c100ad0 0x7f002c198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:54.961 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:54.959+0000 7f0031bbf640 1 -- 172.21.15.165:0/692300683 >> 172.21.15.165:0/692300683 conn(0x7f002c0fc280 msgr2=0x7f002c105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:54.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:54.959+0000 7f0031bbf640 1 -- 172.21.15.165:0/692300683 shutdown_connections 2024-09-15T22:11:54.962 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:11:54.960+0000 7f0031bbf640 1 -- 172.21.15.165:0/692300683 wait complete. 2024-09-15T22:11:55.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:54 smithi165 ceph-mon[35551]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:55.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:55.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:55.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:55.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:55.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:55.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:54 smithi100 ceph-mon[35319]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:55.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:55.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:55.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:55.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:55.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:54 smithi045 ceph-mon[31180]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:55.734 DEBUG:teuthology.orchestra.run.smithi165:osd.8> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.8.service 2024-09-15T22:11:55.736 INFO:tasks.cephadm:Deploying osd.9 on smithi045 with /dev/vg_nvme/lv_1... 2024-09-15T22:11:55.736 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:11:55.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:55 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:55.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:55 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:55.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:55 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:56.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:55 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:56.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:55 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:56.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:55 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:56.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:55 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:11:56.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:55 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:56.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:55 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:57.207 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:56 smithi045 ceph-mon[31180]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:57.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:56 smithi165 ceph-mon[35551]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:57.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:56 smithi100 ceph-mon[35319]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:57.716 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:11:57 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:11:57.266+0000 7f8b5b72a640 -1 osd.8 0 log_to_monitors true 2024-09-15T22:11:58.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:57 smithi165 ceph-mon[35551]: from='osd.8 [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:11:58.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:57 smithi165 ceph-mon[35551]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:11:58.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:57 smithi100 ceph-mon[35319]: from='osd.8 [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:11:58.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:57 smithi100 ceph-mon[35319]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:11:58.287 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:57 smithi045 ceph-mon[31180]: from='osd.8 [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:11:58.287 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:57 smithi045 ceph-mon[31180]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T22:11:58.884 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:11:58.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi045:vg_nvme/lv_1 2024-09-15T22:11:59.177 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:11:59.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:59.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:11:59.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T22:11:59.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:11:59.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: from='osd.8 [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:11:59.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:11:59.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:59.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:59.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:59.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:59.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:59.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:59.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:59.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:59.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:59.298 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:59.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:11:59.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T22:11:59.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:11:59.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: from='osd.8 [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:11:59.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:11:59.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:59.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:59.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:59.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:59.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:59.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:59.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:59.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:59.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:59.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 257 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:11:59.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T22:11:59.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T22:11:59.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:11:59.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: from='osd.8 [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:11:59.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:11:59.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:59.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:59.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:59.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:59.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:11:59.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:59.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:11:59.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:11:59.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:11:59.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.671+0000 7ff535e98640 1 -- 172.21.15.45:0/3162289059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff530102e00 msgr2=0x7ff530103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:59.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.671+0000 7ff535e98640 1 --2- 172.21.15.45:0/3162289059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff530102e00 0x7ff530103280 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff524009900 tx=0x7ff52402a410 comp rx=0 tx=0).stop 2024-09-15T22:11:59.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.671+0000 7ff535e98640 1 -- 172.21.15.45:0/3162289059 shutdown_connections 2024-09-15T22:11:59.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.671+0000 7ff535e98640 1 --2- 172.21.15.45:0/3162289059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5301037c0 0x7ff53010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:59.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.671+0000 7ff535e98640 1 --2- 172.21.15.45:0/3162289059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff530102e00 0x7ff530103280 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:59.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.671+0000 7ff535e98640 1 --2- 172.21.15.45:0/3162289059 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff530101c00 0x7ff530102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:59.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.671+0000 7ff535e98640 1 -- 172.21.15.45:0/3162289059 >> 172.21.15.45:0/3162289059 conn(0x7ff5300fd390 msgr2=0x7ff5300ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:11:59.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.671+0000 7ff535e98640 1 -- 172.21.15.45:0/3162289059 shutdown_connections 2024-09-15T22:11:59.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.671+0000 7ff535e98640 1 -- 172.21.15.45:0/3162289059 wait complete. 2024-09-15T22:11:59.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.672+0000 7ff535e98640 1 Processor -- start 2024-09-15T22:11:59.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.672+0000 7ff535e98640 1 -- start start 2024-09-15T22:11:59.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.672+0000 7ff535e98640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff530101c00 0x7ff530197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:59.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.672+0000 7ff535e98640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff530102e00 0x7ff5301984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:59.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.672+0000 7ff535e98640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5301037c0 0x7ff53019f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:59.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.672+0000 7ff535e98640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff53010d9c0 con 0x7ff5301037c0 2024-09-15T22:11:59.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.672+0000 7ff535e98640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff53010d840 con 0x7ff530102e00 2024-09-15T22:11:59.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.672+0000 7ff535e98640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff53010db40 con 0x7ff530101c00 2024-09-15T22:11:59.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.672+0000 7ff52ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5301037c0 0x7ff53019f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:59.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.672+0000 7ff52f7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff530101c00 0x7ff530197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:59.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.672+0000 7ff52ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5301037c0 0x7ff53019f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36258/0 (socket says 172.21.15.45:36258) 2024-09-15T22:11:59.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.672+0000 7ff52f7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff530101c00 0x7ff530197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:56564/0 (socket says 172.21.15.45:56564) 2024-09-15T22:11:59.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.672+0000 7ff52ffff640 1 -- 172.21.15.45:0/4268907360 learned_addr learned my addr 172.21.15.45:0/4268907360 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:11:59.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.673+0000 7ff52effd640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff530102e00 0x7ff5301984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:59.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.673+0000 7ff52ffff640 1 -- 172.21.15.45:0/4268907360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff530101c00 msgr2=0x7ff530197f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:59.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.673+0000 7ff52ffff640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff530101c00 0x7ff530197f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:59.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.673+0000 7ff52ffff640 1 -- 172.21.15.45:0/4268907360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff530102e00 msgr2=0x7ff5301984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:11:59.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.673+0000 7ff52ffff640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff530102e00 0x7ff5301984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:11:59.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.673+0000 7ff52ffff640 1 -- 172.21.15.45:0/4268907360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53019fbb0 con 0x7ff5301037c0 2024-09-15T22:11:59.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.673+0000 7ff52effd640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff530102e00 0x7ff5301984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:11:59.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.673+0000 7ff52ffff640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5301037c0 0x7ff53019f540 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff52800cce0 tx=0x7ff52800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:59.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.673+0000 7ff52cff9640 1 -- 172.21.15.45:0/4268907360 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52800f450 con 0x7ff5301037c0 2024-09-15T22:11:59.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.673+0000 7ff52cff9640 1 -- 172.21.15.45:0/4268907360 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff52800faf0 con 0x7ff5301037c0 2024-09-15T22:11:59.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.673+0000 7ff535e98640 1 -- 172.21.15.45:0/4268907360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53019fea0 con 0x7ff5301037c0 2024-09-15T22:11:59.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.673+0000 7ff52cff9640 1 -- 172.21.15.45:0/4268907360 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528018cc0 con 0x7ff5301037c0 2024-09-15T22:11:59.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.673+0000 7ff535e98640 1 -- 172.21.15.45:0/4268907360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5301a0300 con 0x7ff5301037c0 2024-09-15T22:11:59.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.674+0000 7ff535e98640 1 -- 172.21.15.45:0/4268907360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff530108f30 con 0x7ff5301037c0 2024-09-15T22:11:59.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.675+0000 7ff52cff9640 1 -- 172.21.15.45:0/4268907360 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff52800f5f0 con 0x7ff5301037c0 2024-09-15T22:11:59.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.676+0000 7ff52cff9640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff5180a3270 0x7ff5180a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:11:59.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.676+0000 7ff52f7fe640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff5180a3270 0x7ff5180a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:11:59.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.676+0000 7ff52cff9640 1 -- 172.21.15.45:0/4268907360 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5582+0+0 (secure 0 0 0) 0x7ff5280cf390 con 0x7ff5301037c0 2024-09-15T22:11:59.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.677+0000 7ff52f7fe640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff5180a3270 0x7ff5180a5730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff520005fd0 tx=0x7ff52000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:11:59.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.680+0000 7ff52cff9640 1 -- 172.21.15.45:0/4268907360 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff528014030 con 0x7ff5301037c0 2024-09-15T22:11:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:11:59.865+0000 7ff535e98640 1 -- 172.21.15.45:0/4268907360 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff530062630 con 0x7ff5180a3270 2024-09-15T22:11:59.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:11:59.617+0000 7f8b57ec1640 -1 osd.8 0 waiting for initial osdmap 2024-09-15T22:11:59.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:11:59.629+0000 7f8b4f4cd640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:12:00.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:59 smithi100 ceph-mon[35319]: Detected new or changed devices on smithi165 2024-09-15T22:12:00.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:59 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi165 to 5696M 2024-09-15T22:12:00.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:59 smithi100 ceph-mon[35319]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-15T22:12:00.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:59 smithi100 ceph-mon[35319]: osdmap e54: 9 total, 8 up, 9 in 2024-09-15T22:12:00.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:59 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:00.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:59 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:00.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:59 smithi100 ceph-mon[35319]: osdmap e55: 9 total, 8 up, 9 in 2024-09-15T22:12:00.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:59 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:00.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:59 smithi100 ceph-mon[35319]: from='osd.8 ' entity='osd.8' 2024-09-15T22:12:00.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:59 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:12:00.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:59 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:12:00.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:11:59 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:00.283 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:59 smithi045 ceph-mon[31180]: Detected new or changed devices on smithi165 2024-09-15T22:12:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:59 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi165 to 5696M 2024-09-15T22:12:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:59 smithi045 ceph-mon[31180]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-15T22:12:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:59 smithi045 ceph-mon[31180]: osdmap e54: 9 total, 8 up, 9 in 2024-09-15T22:12:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:59 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:59 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:59 smithi045 ceph-mon[31180]: osdmap e55: 9 total, 8 up, 9 in 2024-09-15T22:12:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:59 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:59 smithi045 ceph-mon[31180]: from='osd.8 ' entity='osd.8' 2024-09-15T22:12:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:59 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:12:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:59 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:12:00.284 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:11:59 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:00.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-mon[35551]: Detected new or changed devices on smithi165 2024-09-15T22:12:00.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi165 to 5696M 2024-09-15T22:12:00.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-mon[35551]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-15T22:12:00.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-mon[35551]: osdmap e54: 9 total, 8 up, 9 in 2024-09-15T22:12:00.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:00.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:00.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-mon[35551]: osdmap e55: 9 total, 8 up, 9 in 2024-09-15T22:12:00.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:00.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-mon[35551]: from='osd.8 ' entity='osd.8' 2024-09-15T22:12:00.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:12:00.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:12:00.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:11:59 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:01.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:00 smithi100 ceph-mon[35319]: purged_snaps scrub starts 2024-09-15T22:12:01.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:00 smithi100 ceph-mon[35319]: purged_snaps scrub ok 2024-09-15T22:12:01.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:00 smithi100 ceph-mon[35319]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 258 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:12:01.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:00 smithi100 ceph-mon[35319]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:12:01.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:00 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:01.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:00 smithi100 ceph-mon[35319]: osd.8 [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821] boot 2024-09-15T22:12:01.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:00 smithi100 ceph-mon[35319]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T22:12:01.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:00 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:00 smithi045 ceph-mon[31180]: purged_snaps scrub starts 2024-09-15T22:12:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:00 smithi045 ceph-mon[31180]: purged_snaps scrub ok 2024-09-15T22:12:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:00 smithi045 ceph-mon[31180]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 258 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:12:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:00 smithi045 ceph-mon[31180]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:12:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:00 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:00 smithi045 ceph-mon[31180]: osd.8 [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821] boot 2024-09-15T22:12:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:00 smithi045 ceph-mon[31180]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T22:12:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:00 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:01.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:00 smithi165 ceph-mon[35551]: purged_snaps scrub starts 2024-09-15T22:12:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:00 smithi165 ceph-mon[35551]: purged_snaps scrub ok 2024-09-15T22:12:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:00 smithi165 ceph-mon[35551]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 258 MiB used, 715 GiB / 715 GiB avail 2024-09-15T22:12:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:00 smithi165 ceph-mon[35551]: from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi045:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:12:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:00 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:00 smithi165 ceph-mon[35551]: osd.8 [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821] boot 2024-09-15T22:12:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:00 smithi165 ceph-mon[35551]: osdmap e56: 9 total, 9 up, 9 in 2024-09-15T22:12:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:00 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:12:02.692 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:02 smithi045 ceph-mon[31180]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:02.692 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:02 smithi045 ceph-mon[31180]: osdmap e57: 9 total, 9 up, 9 in 2024-09-15T22:12:02.692 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:02 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1817697321' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a072cad-a025-4de9-ae41-97459f416a66"}]: dispatch 2024-09-15T22:12:02.693 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:02 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1817697321' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a072cad-a025-4de9-ae41-97459f416a66"}]': finished 2024-09-15T22:12:02.693 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:02 smithi045 ceph-mon[31180]: osdmap e58: 10 total, 9 up, 10 in 2024-09-15T22:12:02.693 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:02.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:02 smithi165 ceph-mon[35551]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:02.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:02 smithi165 ceph-mon[35551]: osdmap e57: 9 total, 9 up, 9 in 2024-09-15T22:12:02.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:02 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1817697321' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a072cad-a025-4de9-ae41-97459f416a66"}]: dispatch 2024-09-15T22:12:02.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:02 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1817697321' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a072cad-a025-4de9-ae41-97459f416a66"}]': finished 2024-09-15T22:12:02.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:02 smithi165 ceph-mon[35551]: osdmap e58: 10 total, 9 up, 10 in 2024-09-15T22:12:02.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:02.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:02 smithi100 ceph-mon[35319]: pgmap v189: 1 pgs: 1 remapped+peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:02.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:02 smithi100 ceph-mon[35319]: osdmap e57: 9 total, 9 up, 9 in 2024-09-15T22:12:02.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:02 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1817697321' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a072cad-a025-4de9-ae41-97459f416a66"}]: dispatch 2024-09-15T22:12:02.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:02 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1817697321' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a072cad-a025-4de9-ae41-97459f416a66"}]': finished 2024-09-15T22:12:02.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:02 smithi100 ceph-mon[35319]: osdmap e58: 10 total, 9 up, 10 in 2024-09-15T22:12:02.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:02 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:03.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:03 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3602128026' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:12:03.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:03 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3602128026' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:12:03.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:03 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3602128026' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:12:04.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:04 smithi165 ceph-mon[35551]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:04.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:04 smithi165 ceph-mon[35551]: osdmap e59: 10 total, 9 up, 10 in 2024-09-15T22:12:04.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:04 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:04.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:04 smithi100 ceph-mon[35319]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:04.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:04 smithi100 ceph-mon[35319]: osdmap e59: 10 total, 9 up, 10 in 2024-09-15T22:12:04.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:04 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:04.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:04 smithi045 ceph-mon[31180]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:04.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:04 smithi045 ceph-mon[31180]: osdmap e59: 10 total, 9 up, 10 in 2024-09-15T22:12:04.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:04 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:05.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:05 smithi165 ceph-mon[35551]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T22:12:05.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:05.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:05 smithi100 ceph-mon[35319]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T22:12:05.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:05.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:05 smithi045 ceph-mon[31180]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T22:12:05.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:06.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:06 smithi165 ceph-mon[35551]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:12:06.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:06 smithi100 ceph-mon[35319]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:12:06.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:06 smithi045 ceph-mon[31180]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:12:08.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:08 smithi165 ceph-mon[35551]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-15T22:12:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:08 smithi100 ceph-mon[35319]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-15T22:12:08.778 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:08 smithi045 ceph-mon[31180]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-09-15T22:12:10.563 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:10 smithi045 ceph-mon[31180]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-15T22:12:10.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:10 smithi100 ceph-mon[35319]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-15T22:12:10.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:10 smithi165 ceph-mon[35551]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-15T22:12:11.697 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:12:11.697 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:11 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:11.697 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:11 smithi045 ceph-mon[31180]: Deploying daemon osd.9 on smithi045 2024-09-15T22:12:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:12:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:11 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:11 smithi100 ceph-mon[35319]: Deploying daemon osd.9 on smithi045 2024-09-15T22:12:11.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T22:12:11.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:11 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:11.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:11 smithi165 ceph-mon[35551]: Deploying daemon osd.9 on smithi045 2024-09-15T22:12:12.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:12 smithi100 ceph-mon[35319]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:12:12.776 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:12 smithi045 ceph-mon[31180]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:12:12.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:12 smithi165 ceph-mon[35551]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:12:14.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:14 smithi045 ceph-mon[31180]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:12:14.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:14 smithi100 ceph-mon[35319]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:12:14.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:14 smithi165 ceph-mon[35551]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T22:12:16.528 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:16 smithi045 ceph-mon[31180]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-15T22:12:16.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:16 smithi100 ceph-mon[35319]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-15T22:12:16.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:16 smithi165 ceph-mon[35551]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-15T22:12:17.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:17.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:17.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:17.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:17.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:17.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:17.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:17.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:17.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:18 smithi045 ceph-mon[31180]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:18.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:18 smithi165 ceph-mon[35551]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:18.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:18 smithi100 ceph-mon[35319]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:20.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:12:20.404+0000 7ff52cff9640 1 -- 172.21.15.45:0/4268907360 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff530062630 con 0x7ff5180a3270 2024-09-15T22:12:20.407 INFO:teuthology.orchestra.run.smithi045.stdout:Created osd(s) 9 on host 'smithi045' 2024-09-15T22:12:20.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:12:20.407+0000 7ff535e98640 1 -- 172.21.15.45:0/4268907360 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff5180a3270 msgr2=0x7ff5180a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:20.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:12:20.407+0000 7ff535e98640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff5180a3270 0x7ff5180a5730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff520005fd0 tx=0x7ff52000b390 comp rx=0 tx=0).stop 2024-09-15T22:12:20.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:12:20.407+0000 7ff535e98640 1 -- 172.21.15.45:0/4268907360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5301037c0 msgr2=0x7ff53019f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:20.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:12:20.407+0000 7ff535e98640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5301037c0 0x7ff53019f540 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff52800cce0 tx=0x7ff52800a620 comp rx=0 tx=0).stop 2024-09-15T22:12:20.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:12:20.407+0000 7ff535e98640 1 -- 172.21.15.45:0/4268907360 shutdown_connections 2024-09-15T22:12:20.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:12:20.407+0000 7ff535e98640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff5180a3270 0x7ff5180a5730 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:20.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:12:20.407+0000 7ff535e98640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5301037c0 0x7ff53019f540 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:20.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:12:20.407+0000 7ff535e98640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff530102e00 0x7ff5301984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:20.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:12:20.407+0000 7ff535e98640 1 --2- 172.21.15.45:0/4268907360 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff530101c00 0x7ff530197f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:20.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:12:20.407+0000 7ff535e98640 1 -- 172.21.15.45:0/4268907360 >> 172.21.15.45:0/4268907360 conn(0x7ff5300fd390 msgr2=0x7ff530106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:20.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:12:20.407+0000 7ff535e98640 1 -- 172.21.15.45:0/4268907360 shutdown_connections 2024-09-15T22:12:20.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:12:20.407+0000 7ff535e98640 1 -- 172.21.15.45:0/4268907360 wait complete. 2024-09-15T22:12:20.729 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:20 smithi045 ceph-mon[31180]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:20.729 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.729 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.729 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:20.729 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:20.729 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.729 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:20.729 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.729 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:20 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:20 smithi165 ceph-mon[35551]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:20.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:20.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:20.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:20.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:20 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:20 smithi100 ceph-mon[35319]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:20.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:20.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:20.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:20.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:20.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:20 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:21.041 DEBUG:teuthology.orchestra.run.smithi045:osd.9> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.9.service 2024-09-15T22:12:21.044 INFO:tasks.cephadm:Deploying osd.10 on smithi100 with /dev/vg_nvme/lv_1... 2024-09-15T22:12:21.044 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:12:21.300 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:12:22.689 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:22 smithi045 ceph-mon[31180]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:22.689 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:22 smithi045 ceph-mon[31180]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:12:22.689 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:12:22 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:12:22.477+0000 7fa62fdbf640 -1 osd.9 0 log_to_monitors true 2024-09-15T22:12:22.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:22 smithi100 ceph-mon[35319]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:22.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:22 smithi100 ceph-mon[35319]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:12:22.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:22 smithi165 ceph-mon[35551]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:22.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:22 smithi165 ceph-mon[35551]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T22:12:23.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:23 smithi100 ceph-mon[35319]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:12:23.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:23 smithi100 ceph-mon[35319]: osdmap e61: 10 total, 9 up, 10 in 2024-09-15T22:12:23.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:23 smithi100 ceph-mon[35319]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-15T22:12:23.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:23.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:23 smithi100 ceph-mon[35319]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-15T22:12:23.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:23 smithi100 ceph-mon[35319]: osdmap e62: 10 total, 9 up, 10 in 2024-09-15T22:12:23.754 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:23 smithi045 ceph-mon[31180]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:12:23.754 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:23 smithi045 ceph-mon[31180]: osdmap e61: 10 total, 9 up, 10 in 2024-09-15T22:12:23.754 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:23 smithi045 ceph-mon[31180]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-15T22:12:23.755 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:23.755 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:23 smithi045 ceph-mon[31180]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-15T22:12:23.755 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:23 smithi045 ceph-mon[31180]: osdmap e62: 10 total, 9 up, 10 in 2024-09-15T22:12:23.866 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:23 smithi165 ceph-mon[35551]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T22:12:23.866 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:23 smithi165 ceph-mon[35551]: osdmap e61: 10 total, 9 up, 10 in 2024-09-15T22:12:23.866 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:23 smithi165 ceph-mon[35551]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]: dispatch 2024-09-15T22:12:23.866 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:23.867 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:23 smithi165 ceph-mon[35551]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi045", "root=default"]}]': finished 2024-09-15T22:12:23.867 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:23 smithi165 ceph-mon[35551]: osdmap e62: 10 total, 9 up, 10 in 2024-09-15T22:12:23.945 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-09-15T22:12:23.970 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi100:vg_nvme/lv_1 2024-09-15T22:12:24.230 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:12:24.550 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:12:24.103+0000 7fa62bd42640 -1 osd.9 0 waiting for initial osdmap 2024-09-15T22:12:24.550 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:12:24.115+0000 7fa623b62640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:12:24.630 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:24.630 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:24.630 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: Detected new or changed devices on smithi045 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi045 to 4273M 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:24.631 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:24 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:24.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.710+0000 7f704c0f2640 1 -- 172.21.15.100:0/3995518398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7044101d10 msgr2=0x7f7044102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:24.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.710+0000 7f704c0f2640 1 --2- 172.21.15.100:0/3995518398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7044101d10 0x7f7044102190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7034009900 tx=0x7f703402a410 comp rx=0 tx=0).stop 2024-09-15T22:12:24.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.710+0000 7f704c0f2640 1 -- 172.21.15.100:0/3995518398 shutdown_connections 2024-09-15T22:12:24.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.710+0000 7f704c0f2640 1 --2- 172.21.15.100:0/3995518398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f70441026d0 0x7f7044108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:24.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.710+0000 7f704c0f2640 1 --2- 172.21.15.100:0/3995518398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7044101d10 0x7f7044102190 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:24.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.710+0000 7f704c0f2640 1 --2- 172.21.15.100:0/3995518398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7044100b10 0x7f7044100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:24.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.710+0000 7f704c0f2640 1 -- 172.21.15.100:0/3995518398 >> 172.21.15.100:0/3995518398 conn(0x7f70440fc2a0 msgr2=0x7f70440fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:24.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.710+0000 7f704c0f2640 1 -- 172.21.15.100:0/3995518398 shutdown_connections 2024-09-15T22:12:24.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.710+0000 7f704c0f2640 1 -- 172.21.15.100:0/3995518398 wait complete. 2024-09-15T22:12:24.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.711+0000 7f704c0f2640 1 Processor -- start 2024-09-15T22:12:24.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.711+0000 7f704c0f2640 1 -- start start 2024-09-15T22:12:24.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.711+0000 7f704c0f2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7044100b10 0x7f704406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:24.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.711+0000 7f704c0f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7044101d10 0x7f704419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:24.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.711+0000 7f704c0f2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70441026d0 0x7f704419f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:24.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.711+0000 7f704c0f2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f704410c8d0 con 0x7f7044101d10 2024-09-15T22:12:24.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.711+0000 7f704c0f2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f704410c750 con 0x7f70441026d0 2024-09-15T22:12:24.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.711+0000 7f704c0f2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f704410ca50 con 0x7f7044100b10 2024-09-15T22:12:24.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.711+0000 7f704a68f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70441026d0 0x7f704419f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:24.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.711+0000 7f704a68f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70441026d0 0x7f704419f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48998/0 (socket says 172.21.15.100:48998) 2024-09-15T22:12:24.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.711+0000 7f704a68f640 1 -- 172.21.15.100:0/1886561148 learned_addr learned my addr 172.21.15.100:0/1886561148 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-09-15T22:12:24.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f7049e8e640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7044100b10 0x7f704406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:24.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f704968d640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7044101d10 0x7f704419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:24.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f704a68f640 1 -- 172.21.15.100:0/1886561148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7044100b10 msgr2=0x7f704406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:24.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f704a68f640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7044100b10 0x7f704406b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:24.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f704a68f640 1 -- 172.21.15.100:0/1886561148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7044101d10 msgr2=0x7f704419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:24.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f704a68f640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7044101d10 0x7f704419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:24.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f704a68f640 1 -- 172.21.15.100:0/1886561148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f704419fc30 con 0x7f70441026d0 2024-09-15T22:12:24.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f704968d640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7044101d10 0x7f704419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:12:24.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f704a68f640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70441026d0 0x7f704419f320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f703c00eb10 tx=0x7f703c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f703affd640 1 -- 172.21.15.100:0/1886561148 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703c004b20 con 0x7f70441026d0 2024-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f703affd640 1 -- 172.21.15.100:0/1886561148 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f703c004cc0 con 0x7f70441026d0 2024-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f704c0f2640 1 -- 172.21.15.100:0/1886561148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f704419fec0 con 0x7f70441026d0 2024-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f703affd640 1 -- 172.21.15.100:0/1886561148 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703c0107f0 con 0x7f70441026d0 2024-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.712+0000 7f704c0f2640 1 -- 172.21.15.100:0/1886561148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70441a0420 con 0x7f70441026d0 2024-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.713+0000 7f704c0f2640 1 -- 172.21.15.100:0/1886561148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7044107ec0 con 0x7f70441026d0 2024-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.714+0000 7f703affd640 1 -- 172.21.15.100:0/1886561148 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f703c010990 con 0x7f70441026d0 2024-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.715+0000 7f703affd640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f70300a32c0 0x7f70300a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.715+0000 7f703affd640 1 -- 172.21.15.100:0/1886561148 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 5981+0+0 (secure 0 0 0) 0x7f703c0cf740 con 0x7f70441026d0 2024-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.715+0000 7f7049e8e640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f70300a32c0 0x7f70300a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.716+0000 7f7049e8e640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f70300a32c0 0x7f70300a5780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7044101b70 tx=0x7f704000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:24.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.718+0000 7f703affd640 1 -- 172.21.15.100:0/1886561148 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f703c0541b0 con 0x7f70441026d0 2024-09-15T22:12:24.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:24.895+0000 7f704c0f2640 1 -- 172.21.15.100:0/1886561148 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f7044062630 con 0x7f70300a32c0 2024-09-15T22:12:24.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:24.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:24.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:24.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: Detected new or changed devices on smithi045 2024-09-15T22:12:24.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:24.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' 2024-09-15T22:12:24.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:24.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:24.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:24.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:24.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:24.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi045 to 4273M 2024-09-15T22:12:24.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:24.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:24.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:24.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:24.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:24 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:25.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:25.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:25.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:25.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: Detected new or changed devices on smithi045 2024-09-15T22:12:25.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:25.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686]' entity='osd.9' 2024-09-15T22:12:25.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:25.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:25.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:25.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:25.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:25.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi045 to 4273M 2024-09-15T22:12:25.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:25.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:25.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:25.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:25.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:24 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:25.954 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:25 smithi100 ceph-mon[35319]: purged_snaps scrub starts 2024-09-15T22:12:25.954 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:25 smithi100 ceph-mon[35319]: purged_snaps scrub ok 2024-09-15T22:12:25.954 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:25 smithi100 ceph-mon[35319]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:12:25.954 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:25 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:12:25.954 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:25 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:12:25.954 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:25 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:25.955 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:25 smithi100 ceph-mon[35319]: osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686] boot 2024-09-15T22:12:25.955 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:25 smithi100 ceph-mon[35319]: osdmap e63: 10 total, 10 up, 10 in 2024-09-15T22:12:25.955 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:25 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:25.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:25 smithi165 ceph-mon[35551]: purged_snaps scrub starts 2024-09-15T22:12:25.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:25 smithi165 ceph-mon[35551]: purged_snaps scrub ok 2024-09-15T22:12:25.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:25 smithi165 ceph-mon[35551]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:12:25.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:25 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:12:25.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:25 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:12:25.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:25 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:25.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:25 smithi165 ceph-mon[35551]: osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686] boot 2024-09-15T22:12:25.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:25 smithi165 ceph-mon[35551]: osdmap e63: 10 total, 10 up, 10 in 2024-09-15T22:12:25.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:25 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:26.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:25 smithi045 ceph-mon[31180]: purged_snaps scrub starts 2024-09-15T22:12:26.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:25 smithi045 ceph-mon[31180]: purged_snaps scrub ok 2024-09-15T22:12:26.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:25 smithi045 ceph-mon[31180]: from='client.24320 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:12:26.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:25 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:12:26.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:25 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:12:26.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:25 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:26.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:25 smithi045 ceph-mon[31180]: osd.9 [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686] boot 2024-09-15T22:12:26.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:25 smithi045 ceph-mon[31180]: osdmap e63: 10 total, 10 up, 10 in 2024-09-15T22:12:26.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:25 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:12:27.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:27 smithi100 ceph-mon[35319]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:27.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:27 smithi100 ceph-mon[35319]: osdmap e64: 10 total, 10 up, 10 in 2024-09-15T22:12:27.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:27 smithi165 ceph-mon[35551]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:27.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:27 smithi165 ceph-mon[35551]: osdmap e64: 10 total, 10 up, 10 in 2024-09-15T22:12:27.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:27 smithi045 ceph-mon[31180]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-15T22:12:27.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:27 smithi045 ceph-mon[31180]: osdmap e64: 10 total, 10 up, 10 in 2024-09-15T22:12:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:28 smithi165 ceph-mon[35551]: from='client.? 172.21.15.100:0/2044634619' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "072c0003-c933-47ff-9866-53934143f598"}]: dispatch 2024-09-15T22:12:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:28 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "072c0003-c933-47ff-9866-53934143f598"}]: dispatch 2024-09-15T22:12:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:28 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "072c0003-c933-47ff-9866-53934143f598"}]': finished 2024-09-15T22:12:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:28 smithi165 ceph-mon[35551]: osdmap e65: 11 total, 10 up, 11 in 2024-09-15T22:12:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:28 smithi165 ceph-mon[35551]: from='client.? 172.21.15.100:0/4221302284' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:12:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:28 smithi100 ceph-mon[35319]: from='client.? 172.21.15.100:0/2044634619' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "072c0003-c933-47ff-9866-53934143f598"}]: dispatch 2024-09-15T22:12:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:28 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "072c0003-c933-47ff-9866-53934143f598"}]: dispatch 2024-09-15T22:12:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:28 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "072c0003-c933-47ff-9866-53934143f598"}]': finished 2024-09-15T22:12:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:28 smithi100 ceph-mon[35319]: osdmap e65: 11 total, 10 up, 11 in 2024-09-15T22:12:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:28.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:28 smithi100 ceph-mon[35319]: from='client.? 172.21.15.100:0/4221302284' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:12:28.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:28 smithi045 ceph-mon[31180]: from='client.? 172.21.15.100:0/2044634619' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "072c0003-c933-47ff-9866-53934143f598"}]: dispatch 2024-09-15T22:12:28.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:28 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "072c0003-c933-47ff-9866-53934143f598"}]: dispatch 2024-09-15T22:12:28.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:28 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "072c0003-c933-47ff-9866-53934143f598"}]': finished 2024-09-15T22:12:28.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:28 smithi045 ceph-mon[31180]: osdmap e65: 11 total, 10 up, 11 in 2024-09-15T22:12:28.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:28.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:28 smithi045 ceph-mon[31180]: from='client.? 172.21.15.100:0/4221302284' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:12:29.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:29 smithi045 ceph-mon[31180]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:29.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:29 smithi165 ceph-mon[35551]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:29.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:29 smithi100 ceph-mon[35319]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:31.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:31 smithi045 ceph-mon[31180]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:31.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:31 smithi165 ceph-mon[35551]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:31.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:31 smithi100 ceph-mon[35319]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:33.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:33 smithi100 ceph-mon[35319]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:33.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:33 smithi165 ceph-mon[35551]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:33.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:33 smithi045 ceph-mon[31180]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:34.656 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:34 smithi100 ceph-mon[35319]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:34.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:34 smithi165 ceph-mon[35551]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:34.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:34 smithi045 ceph-mon[31180]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:36.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:36 smithi165 ceph-mon[35551]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:12:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:36 smithi165 ceph-mon[35551]: Deploying daemon osd.10 on smithi100 2024-09-15T22:12:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:36 smithi100 ceph-mon[35319]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:12:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:36 smithi100 ceph-mon[35319]: Deploying daemon osd.10 on smithi100 2024-09-15T22:12:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:36 smithi045 ceph-mon[31180]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T22:12:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:36.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:36 smithi045 ceph-mon[31180]: Deploying daemon osd.10 on smithi100 2024-09-15T22:12:38.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:38 smithi165 ceph-mon[35551]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:38 smithi100 ceph-mon[35319]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:38.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:38 smithi045 ceph-mon[31180]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:40.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:40 smithi165 ceph-mon[35551]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:40.738 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:40 smithi100 ceph-mon[35319]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:40.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:40 smithi045 ceph-mon[31180]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:42.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:42 smithi165 ceph-mon[35551]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:42.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:42 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:42.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:42 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:42.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:42 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:42.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:42 smithi100 ceph-mon[35319]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:42.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:42 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:42.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:42 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:42.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:42 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:42.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:42 smithi045 ceph-mon[31180]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:42.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:42 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:42.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:42 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:42.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:42 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:44.679 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:44 smithi100 ceph-mon[35319]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:44.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:44 smithi165 ceph-mon[35551]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:44.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:44 smithi045 ceph-mon[31180]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:45.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:45.688+0000 7f703affd640 1 -- 172.21.15.100:0/1886561148 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f7044062630 con 0x7f70300a32c0 2024-09-15T22:12:45.691 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 10 on host 'smithi100' 2024-09-15T22:12:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:45.691+0000 7f704c0f2640 1 -- 172.21.15.100:0/1886561148 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f70300a32c0 msgr2=0x7f70300a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:45.691+0000 7f704c0f2640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f70300a32c0 0x7f70300a5780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7044101b70 tx=0x7f704000b390 comp rx=0 tx=0).stop 2024-09-15T22:12:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:45.691+0000 7f704c0f2640 1 -- 172.21.15.100:0/1886561148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70441026d0 msgr2=0x7f704419f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:45.691+0000 7f704c0f2640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70441026d0 0x7f704419f320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f703c00eb10 tx=0x7f703c00c2d0 comp rx=0 tx=0).stop 2024-09-15T22:12:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:45.691+0000 7f704c0f2640 1 -- 172.21.15.100:0/1886561148 shutdown_connections 2024-09-15T22:12:45.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:45.691+0000 7f704c0f2640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f70300a32c0 0x7f70300a5780 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:45.691+0000 7f704c0f2640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70441026d0 0x7f704419f320 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:45.691+0000 7f704c0f2640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7044101d10 0x7f704419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:45.691+0000 7f704c0f2640 1 --2- 172.21.15.100:0/1886561148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7044100b10 0x7f704406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:45.691+0000 7f704c0f2640 1 -- 172.21.15.100:0/1886561148 >> 172.21.15.100:0/1886561148 conn(0x7f70440fc2a0 msgr2=0x7f7044105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:45.691+0000 7f704c0f2640 1 -- 172.21.15.100:0/1886561148 shutdown_connections 2024-09-15T22:12:45.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-09-15T22:12:45.691+0000 7f704c0f2640 1 -- 172.21.15.100:0/1886561148 wait complete. 2024-09-15T22:12:46.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:46.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:46.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:46.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:45 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:46.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:46.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:46.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:45 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.314 DEBUG:teuthology.orchestra.run.smithi100:osd.10> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.10.service 2024-09-15T22:12:46.317 INFO:tasks.cephadm:Deploying osd.11 on smithi165 with /dev/vg_nvme/lv_1... 2024-09-15T22:12:46.317 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T22:12:46.346 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.346 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.346 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:46.346 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:46.346 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.346 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:12:46.346 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.346 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:45 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:46.576 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:12:47.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:46 smithi100 ceph-mon[35319]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:47.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:46 smithi045 ceph-mon[31180]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:47.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:46 smithi165 ceph-mon[35551]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:48.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:12:48 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:12:48.157+0000 7fdad604b640 -1 osd.10 0 log_to_monitors true 2024-09-15T22:12:49.229 INFO:teuthology.orchestra.run.smithi165.stdout: 2024-09-15T22:12:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:48 smithi100 ceph-mon[35319]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:48 smithi100 ceph-mon[35319]: from='osd.10 [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:12:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:48 smithi100 ceph-mon[35319]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:12:49.253 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:48 smithi165 ceph-mon[35551]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:49.253 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:48 smithi165 ceph-mon[35551]: from='osd.10 [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:12:49.253 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:48 smithi165 ceph-mon[35551]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:12:49.255 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi165:vg_nvme/lv_1 2024-09-15T22:12:49.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:48 smithi045 ceph-mon[31180]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:49.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:48 smithi045 ceph-mon[31180]: from='osd.10 [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:12:49.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:48 smithi045 ceph-mon[31180]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T22:12:49.551 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:12:50.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.068+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/3704478725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b241026d0 msgr2=0x7f3b24108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:50.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.068+0000 7f3b2a9ba640 1 --2- 172.21.15.165:0/3704478725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b241026d0 0x7f3b24108f60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009ca0 tx=0x7f3b1c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:12:50.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.068+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/3704478725 shutdown_connections 2024-09-15T22:12:50.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.068+0000 7f3b2a9ba640 1 --2- 172.21.15.165:0/3704478725 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b241026d0 0x7f3b24108f60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:50.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.068+0000 7f3b2a9ba640 1 --2- 172.21.15.165:0/3704478725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b24101d10 0x7f3b24102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:50.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.068+0000 7f3b2a9ba640 1 --2- 172.21.15.165:0/3704478725 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b24100b10 0x7f3b24100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:50.087 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.068+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/3704478725 >> 172.21.15.165:0/3704478725 conn(0x7f3b240fc2a0 msgr2=0x7f3b240fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:12:50.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.069+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/3704478725 shutdown_connections 2024-09-15T22:12:50.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.069+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/3704478725 wait complete. 2024-09-15T22:12:50.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.069+0000 7f3b2a9ba640 1 Processor -- start 2024-09-15T22:12:50.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.069+0000 7f3b2a9ba640 1 -- start start 2024-09-15T22:12:50.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.069+0000 7f3b2a9ba640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b24100b10 0x7f3b24196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:50.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.069+0000 7f3b2a9ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b24101d10 0x7f3b24197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:50.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b2a9ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b241026d0 0x7f3b2419e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:50.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b2a9ba640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2410c950 con 0x7f3b241026d0 2024-09-15T22:12:50.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b2a9ba640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2410c7d0 con 0x7f3b24101d10 2024-09-15T22:12:50.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b2a9ba640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2410cad0 con 0x7f3b24100b10 2024-09-15T22:12:50.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b23fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b24100b10 0x7f3b24196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:50.088 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b23fff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b24100b10 0x7f3b24196ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:37716/0 (socket says 172.21.15.165:37716) 2024-09-15T22:12:50.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b23fff640 1 -- 172.21.15.165:0/2746703830 learned_addr learned my addr 172.21.15.165:0/2746703830 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-15T22:12:50.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b28f57640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b241026d0 0x7f3b2419e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:50.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b23fff640 1 -- 172.21.15.165:0/2746703830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b24101d10 msgr2=0x7f3b24197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:50.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b23fff640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b24101d10 0x7f3b24197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:50.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b23fff640 1 -- 172.21.15.165:0/2746703830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b241026d0 msgr2=0x7f3b2419e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:12:50.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b23fff640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b241026d0 0x7f3b2419e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:12:50.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b23fff640 1 -- 172.21.15.165:0/2746703830 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2419eb10 con 0x7f3b24100b10 2024-09-15T22:12:50.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b28f57640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b241026d0 0x7f3b2419e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:12:50.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b23fff640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b24100b10 0x7f3b24196ee0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400b450 tx=0x7f3b1400b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:50.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b217fa640 1 -- 172.21.15.165:0/2746703830 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14015020 con 0x7f3b24100b10 2024-09-15T22:12:50.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b217fa640 1 -- 172.21.15.165:0/2746703830 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3b14011d90 con 0x7f3b24100b10 2024-09-15T22:12:50.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/2746703830 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2419ee00 con 0x7f3b24100b10 2024-09-15T22:12:50.089 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b217fa640 1 -- 172.21.15.165:0/2746703830 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1400f340 con 0x7f3b24100b10 2024-09-15T22:12:50.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.070+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/2746703830 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b2419f2e0 con 0x7f3b24100b10 2024-09-15T22:12:50.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.071+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/2746703830 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b24107ec0 con 0x7f3b24100b10 2024-09-15T22:12:50.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.073+0000 7f3b217fa640 1 -- 172.21.15.165:0/2746703830 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3b14018020 con 0x7f3b24100b10 2024-09-15T22:12:50.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.073+0000 7f3b217fa640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b100a3270 0x7f3b100a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:12:50.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.073+0000 7f3b217fa640 1 -- 172.21.15.165:0/2746703830 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6414+0+0 (secure 0 0 0) 0x7f3b140cf090 con 0x7f3b24100b10 2024-09-15T22:12:50.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.073+0000 7f3b237fe640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b100a3270 0x7f3b100a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:12:50.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.074+0000 7f3b237fe640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b100a3270 0x7f3b100a5730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0058c0 tx=0x7f3b0c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:12:50.090 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.076+0000 7f3b217fa640 1 -- 172.21.15.165:0/2746703830 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b1401f020 con 0x7f3b24100b10 2024-09-15T22:12:50.253 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:12:50.250+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/2746703830 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3b24062630 con 0x7f3b100a3270 2024-09-15T22:12:50.253 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:12:50.253 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='osd.10 [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:12:50.253 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: osdmap e66: 11 total, 10 up, 11 in 2024-09-15T22:12:50.253 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:50.253 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:12:50.254 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:50.254 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:50.254 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:50.254 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:50.254 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:50.254 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:50.254 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:50.254 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:50.254 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:50.254 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:50 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:50.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:49 smithi045 ceph-mon[31180]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:12:50.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:49 smithi045 ceph-mon[31180]: from='osd.10 [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:12:50.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:50 smithi045 ceph-mon[31180]: osdmap e66: 11 total, 10 up, 11 in 2024-09-15T22:12:50.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:50.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:50 smithi045 ceph-mon[31180]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:12:50.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:50.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:50.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:50.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:50.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:50.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:50.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:50.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:50.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:50.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:50 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:50.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:12:50.003+0000 7fdad1fce640 -1 osd.10 0 waiting for initial osdmap 2024-09-15T22:12:50.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:12:50.015+0000 7fdacddf6640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:12:50.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T22:12:50.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='osd.10 [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:12:50.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: osdmap e66: 11 total, 10 up, 11 in 2024-09-15T22:12:50.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:50.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2024-09-15T22:12:50.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:50.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:50.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:50.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:50.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:50.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:12:50.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:50.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:50.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:12:50.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:50 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:12:51.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: Detected new or changed devices on smithi100 2024-09-15T22:12:51.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-15T22:12:51.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:51.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-15T22:12:51.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: osdmap e67: 11 total, 10 up, 11 in 2024-09-15T22:12:51.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:51.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:51.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:12:51.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:12:51.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:12:51.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:51.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: osd.10 [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547] boot 2024-09-15T22:12:51.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: osdmap e68: 11 total, 11 up, 11 in 2024-09-15T22:12:51.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:51 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:51.387 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: Detected new or changed devices on smithi100 2024-09-15T22:12:51.387 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-15T22:12:51.387 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:51.387 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-15T22:12:51.388 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: osdmap e67: 11 total, 10 up, 11 in 2024-09-15T22:12:51.388 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:51.388 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:51.388 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:12:51.388 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:12:51.388 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:12:51.388 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:51.388 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: osd.10 [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547] boot 2024-09-15T22:12:51.388 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: osdmap e68: 11 total, 11 up, 11 in 2024-09-15T22:12:51.388 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:51 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: Detected new or changed devices on smithi100 2024-09-15T22:12:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi100 to 4271M 2024-09-15T22:12:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 894 GiB / 894 GiB avail 2024-09-15T22:12:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2024-09-15T22:12:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: osdmap e67: 11 total, 10 up, 11 in 2024-09-15T22:12:51.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:51.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:51.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: from='client.24352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi165:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:12:51.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T22:12:51.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T22:12:51.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:12:51.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: osd.10 [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547] boot 2024-09-15T22:12:51.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: osdmap e68: 11 total, 11 up, 11 in 2024-09-15T22:12:51.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:51 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:12:52.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:52 smithi165 ceph-mon[35551]: purged_snaps scrub starts 2024-09-15T22:12:52.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:52 smithi165 ceph-mon[35551]: purged_snaps scrub ok 2024-09-15T22:12:52.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:52 smithi045 ceph-mon[31180]: purged_snaps scrub starts 2024-09-15T22:12:52.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:52 smithi045 ceph-mon[31180]: purged_snaps scrub ok 2024-09-15T22:12:52.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:52 smithi100 ceph-mon[35319]: purged_snaps scrub starts 2024-09-15T22:12:52.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:52 smithi100 ceph-mon[35319]: purged_snaps scrub ok 2024-09-15T22:12:53.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:53 smithi165 ceph-mon[35551]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:12:53.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:53 smithi165 ceph-mon[35551]: osdmap e69: 11 total, 11 up, 11 in 2024-09-15T22:12:53.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:53 smithi165 ceph-mon[35551]: from='client.? 172.21.15.165:0/1069947114' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ad7e570-4045-4f50-aa81-4bf73af76c1d"}]: dispatch 2024-09-15T22:12:53.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:53 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ad7e570-4045-4f50-aa81-4bf73af76c1d"}]: dispatch 2024-09-15T22:12:53.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:53 smithi165 ceph-mon[35551]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ad7e570-4045-4f50-aa81-4bf73af76c1d"}]': finished 2024-09-15T22:12:53.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:53 smithi165 ceph-mon[35551]: osdmap e70: 12 total, 11 up, 12 in 2024-09-15T22:12:53.198 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:53 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:12:53.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:53 smithi045 ceph-mon[31180]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:12:53.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:53 smithi045 ceph-mon[31180]: osdmap e69: 11 total, 11 up, 11 in 2024-09-15T22:12:53.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:53 smithi045 ceph-mon[31180]: from='client.? 172.21.15.165:0/1069947114' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ad7e570-4045-4f50-aa81-4bf73af76c1d"}]: dispatch 2024-09-15T22:12:53.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:53 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ad7e570-4045-4f50-aa81-4bf73af76c1d"}]: dispatch 2024-09-15T22:12:53.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:53 smithi045 ceph-mon[31180]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ad7e570-4045-4f50-aa81-4bf73af76c1d"}]': finished 2024-09-15T22:12:53.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:53 smithi045 ceph-mon[31180]: osdmap e70: 12 total, 11 up, 12 in 2024-09-15T22:12:53.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:53 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:12:53.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:53 smithi100 ceph-mon[35319]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:12:53.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:53 smithi100 ceph-mon[35319]: osdmap e69: 11 total, 11 up, 11 in 2024-09-15T22:12:53.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:53 smithi100 ceph-mon[35319]: from='client.? 172.21.15.165:0/1069947114' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ad7e570-4045-4f50-aa81-4bf73af76c1d"}]: dispatch 2024-09-15T22:12:53.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:53 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ad7e570-4045-4f50-aa81-4bf73af76c1d"}]: dispatch 2024-09-15T22:12:53.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:53 smithi100 ceph-mon[35319]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ad7e570-4045-4f50-aa81-4bf73af76c1d"}]': finished 2024-09-15T22:12:53.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:53 smithi100 ceph-mon[35319]: osdmap e70: 12 total, 11 up, 12 in 2024-09-15T22:12:53.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:53 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:12:54.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:54 smithi045 ceph-mon[31180]: from='client.? 172.21.15.165:0/2377649151' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:12:54.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:54 smithi165 ceph-mon[35551]: from='client.? 172.21.15.165:0/2377649151' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:12:54.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:54 smithi100 ceph-mon[35319]: from='client.? 172.21.15.165:0/2377649151' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T22:12:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:55 smithi045 ceph-mon[31180]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:12:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:55 smithi045 ceph-mon[31180]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:12:55.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:55 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:12:55.395 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:55 smithi100 ceph-mon[35319]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:12:55.395 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:55 smithi100 ceph-mon[35319]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:12:55.396 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:55 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:12:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:55 smithi165 ceph-mon[35551]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:12:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:55 smithi165 ceph-mon[35551]: osdmap e71: 12 total, 11 up, 12 in 2024-09-15T22:12:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:55 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:12:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:56 smithi045 ceph-mon[31180]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T22:12:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:56 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:12:56.407 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:56 smithi100 ceph-mon[35319]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T22:12:56.407 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:56 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:12:56.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:56 smithi165 ceph-mon[35551]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T22:12:56.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:56 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:12:57.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:57 smithi045 ceph-mon[31180]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:12:57.378 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:57 smithi165 ceph-mon[35551]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:12:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:57 smithi100 ceph-mon[35319]: pgmap v232: 1 pgs: 1 peering; 577 KiB data, 352 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-15T22:12:59.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:12:59 smithi165 ceph-mon[35551]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-15T22:12:59.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:12:59 smithi045 ceph-mon[31180]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-15T22:12:59.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:12:59 smithi100 ceph-mon[35319]: pgmap v233: 1 pgs: 1 peering; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-15T22:13:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:01 smithi045 ceph-mon[31180]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-15T22:13:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:01 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:13:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:01 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:01.322 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:01 smithi165 ceph-mon[35551]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-15T22:13:01.322 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:01 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:13:01.322 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:01 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:01 smithi100 ceph-mon[35319]: pgmap v234: 1 pgs: 1 peering; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-15T22:13:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:01 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T22:13:01.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:01 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:02.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:02 smithi045 ceph-mon[31180]: Deploying daemon osd.11 on smithi165 2024-09-15T22:13:02.324 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:02 smithi165 ceph-mon[35551]: Deploying daemon osd.11 on smithi165 2024-09-15T22:13:02.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:02 smithi100 ceph-mon[35319]: Deploying daemon osd.11 on smithi165 2024-09-15T22:13:03.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:03 smithi045 ceph-mon[31180]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:13:03.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:03 smithi165 ceph-mon[35551]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:13:03.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:03 smithi100 ceph-mon[35319]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T22:13:05.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:05 smithi045 ceph-mon[31180]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-15T22:13:05.459 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:05 smithi165 ceph-mon[35551]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-15T22:13:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:05 smithi100 ceph-mon[35319]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-15T22:13:07.357 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:07 smithi165 ceph-mon[35551]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:07.358 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:07.358 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:07.358 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:07 smithi100 ceph-mon[35319]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:07 smithi045 ceph-mon[31180]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:09.376 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:09 smithi165 ceph-mon[35551]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:09.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:09 smithi100 ceph-mon[35319]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:09 smithi045 ceph-mon[31180]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:10.576 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:10.574+0000 7f3b217fa640 1 -- 172.21.15.165:0/2746703830 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3b24062630 con 0x7f3b100a3270 2024-09-15T22:13:10.576 INFO:teuthology.orchestra.run.smithi165.stdout:Created osd(s) 11 on host 'smithi165' 2024-09-15T22:13:10.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:10.577+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/2746703830 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b100a3270 msgr2=0x7f3b100a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:10.578 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:10.577+0000 7f3b2a9ba640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b100a3270 0x7f3b100a5730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0058c0 tx=0x7f3b0c005850 comp rx=0 tx=0).stop 2024-09-15T22:13:10.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:10.577+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/2746703830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b24100b10 msgr2=0x7f3b24196ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:10.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:10.577+0000 7f3b2a9ba640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b24100b10 0x7f3b24196ee0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400b450 tx=0x7f3b1400b910 comp rx=0 tx=0).stop 2024-09-15T22:13:10.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:10.577+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/2746703830 shutdown_connections 2024-09-15T22:13:10.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:10.577+0000 7f3b2a9ba640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b100a3270 0x7f3b100a5730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:10.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:10.577+0000 7f3b2a9ba640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b241026d0 0x7f3b2419e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:10.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:10.577+0000 7f3b2a9ba640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b24101d10 0x7f3b24197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:10.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:10.577+0000 7f3b2a9ba640 1 --2- 172.21.15.165:0/2746703830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b24100b10 0x7f3b24196ee0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:10.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:10.577+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/2746703830 >> 172.21.15.165:0/2746703830 conn(0x7f3b240fc2a0 msgr2=0x7f3b24105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:10.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:10.577+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/2746703830 shutdown_connections 2024-09-15T22:13:10.579 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:10.577+0000 7f3b2a9ba640 1 -- 172.21.15.165:0/2746703830 wait complete. 2024-09-15T22:13:10.954 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:10 smithi165 ceph-mon[35551]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:10.954 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:10 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:10.954 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:10 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:10.954 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:10 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:10.954 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:10 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:13:10.954 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:10 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:10.955 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:10 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:10.955 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:10 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:10.955 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:10 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:10.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:10 smithi100 ceph-mon[35319]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:10.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:10 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:10.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:10 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:10.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:10 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:10.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:10 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:13:10.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:10 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:10.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:10 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:10.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:10 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:10.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:10 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:11.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:10 smithi045 ceph-mon[31180]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:11.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:10 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:11.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:10 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:11.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:10 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:11.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:10 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:13:11.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:10 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:11.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:10 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:11.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:10 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:11.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:10 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:11.360 DEBUG:teuthology.orchestra.run.smithi165:osd.11> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.11.service 2024-09-15T22:13:11.362 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-15T22:13:11.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:13:11.637 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:12.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.225+0000 7fec8da57640 1 -- 172.21.15.45:0/2377285844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec881037c0 msgr2=0x7fec8810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:12.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.225+0000 7fec8da57640 1 --2- 172.21.15.45:0/2377285844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec881037c0 0x7fec8810a050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fec80009ca0 tx=0x7fec8002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:13:12.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.225+0000 7fec8da57640 1 -- 172.21.15.45:0/2377285844 shutdown_connections 2024-09-15T22:13:12.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.225+0000 7fec8da57640 1 --2- 172.21.15.45:0/2377285844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec881037c0 0x7fec8810a050 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:12.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.225+0000 7fec8da57640 1 --2- 172.21.15.45:0/2377285844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec88102e00 0x7fec88103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.225+0000 7fec8da57640 1 --2- 172.21.15.45:0/2377285844 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec88101c00 0x7fec88102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.225+0000 7fec8da57640 1 -- 172.21.15.45:0/2377285844 >> 172.21.15.45:0/2377285844 conn(0x7fec880fd390 msgr2=0x7fec880ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.225+0000 7fec8da57640 1 -- 172.21.15.45:0/2377285844 shutdown_connections 2024-09-15T22:13:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.225+0000 7fec8da57640 1 -- 172.21.15.45:0/2377285844 wait complete. 2024-09-15T22:13:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.225+0000 7fec8da57640 1 Processor -- start 2024-09-15T22:13:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec8da57640 1 -- start start 2024-09-15T22:13:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec8da57640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec88101c00 0x7fec88197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:12.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec8da57640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec88102e00 0x7fec881984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec8da57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec881037c0 0x7fec8819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec8da57640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fec8810da10 con 0x7fec881037c0 2024-09-15T22:13:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec8da57640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fec8810d890 con 0x7fec88102e00 2024-09-15T22:13:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec8da57640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fec8810db90 con 0x7fec88101c00 2024-09-15T22:13:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec877fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec881037c0 0x7fec8819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec877fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec881037c0 0x7fec8819f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34446/0 (socket says 172.21.15.45:34446) 2024-09-15T22:13:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec877fe640 1 -- 172.21.15.45:0/3423305531 learned_addr learned my addr 172.21.15.45:0/3423305531 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec86ffd640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec88101c00 0x7fec88197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:12.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec867fc640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec88102e00 0x7fec881984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec877fe640 1 -- 172.21.15.45:0/3423305531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec88101c00 msgr2=0x7fec88197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec877fe640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec88101c00 0x7fec88197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec877fe640 1 -- 172.21.15.45:0/3423305531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec88102e00 msgr2=0x7fec881984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec877fe640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec88102e00 0x7fec881984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.226+0000 7fec877fe640 1 -- 172.21.15.45:0/3423305531 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8819fba0 con 0x7fec881037c0 2024-09-15T22:13:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.227+0000 7fec877fe640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec881037c0 0x7fec8819f530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec800319f0 tx=0x7fec8002f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.227+0000 7fec8ca55640 1 -- 172.21.15.45:0/3423305531 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80003c70 con 0x7fec881037c0 2024-09-15T22:13:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.227+0000 7fec8ca55640 1 -- 172.21.15.45:0/3423305531 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec80003e10 con 0x7fec881037c0 2024-09-15T22:13:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.227+0000 7fec8da57640 1 -- 172.21.15.45:0/3423305531 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec8819fe30 con 0x7fec881037c0 2024-09-15T22:13:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.227+0000 7fec8ca55640 1 -- 172.21.15.45:0/3423305531 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8002fe30 con 0x7fec881037c0 2024-09-15T22:13:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.227+0000 7fec8da57640 1 -- 172.21.15.45:0/3423305531 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec881a02e0 con 0x7fec881037c0 2024-09-15T22:13:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.228+0000 7fec8da57640 1 -- 172.21.15.45:0/3423305531 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec88108ed0 con 0x7fec881037c0 2024-09-15T22:13:12.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.229+0000 7fec8ca55640 1 -- 172.21.15.45:0/3423305531 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fec80004040 con 0x7fec881037c0 2024-09-15T22:13:12.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.230+0000 7fec8ca55640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fec700a3270 0x7fec700a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:12.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.230+0000 7fec86ffd640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fec700a3270 0x7fec700a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:12.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.230+0000 7fec8ca55640 1 -- 172.21.15.45:0/3423305531 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7fec800f0870 con 0x7fec881037c0 2024-09-15T22:13:12.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.230+0000 7fec86ffd640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fec700a3270 0x7fec700a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fec78005fd0 tx=0x7fec7800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:12.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.238+0000 7fec8ca55640 1 -- 172.21.15.45:0/3423305531 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fec800bdb70 con 0x7fec881037c0 2024-09-15T22:13:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.417+0000 7fec8da57640 1 -- 172.21.15.45:0/3423305531 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fec88062df0 con 0x7fec881037c0 2024-09-15T22:13:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.417+0000 7fec8ca55640 1 -- 172.21.15.45:0/3423305531 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fec800bd470 con 0x7fec881037c0 2024-09-15T22:13:12.419 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:12.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.419+0000 7fec8da57640 1 -- 172.21.15.45:0/3423305531 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fec700a3270 msgr2=0x7fec700a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:12.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.419+0000 7fec8da57640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fec700a3270 0x7fec700a5730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fec78005fd0 tx=0x7fec7800b390 comp rx=0 tx=0).stop 2024-09-15T22:13:12.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.419+0000 7fec8da57640 1 -- 172.21.15.45:0/3423305531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec881037c0 msgr2=0x7fec8819f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:12.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.419+0000 7fec8da57640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec881037c0 0x7fec8819f530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec800319f0 tx=0x7fec8002f450 comp rx=0 tx=0).stop 2024-09-15T22:13:12.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.420+0000 7fec8da57640 1 -- 172.21.15.45:0/3423305531 shutdown_connections 2024-09-15T22:13:12.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.420+0000 7fec8da57640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fec700a3270 0x7fec700a5730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:12.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.420+0000 7fec8da57640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec881037c0 0x7fec8819f530 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:12.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.420+0000 7fec8da57640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec88102e00 0x7fec881984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:12.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.420+0000 7fec8da57640 1 --2- 172.21.15.45:0/3423305531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fec88101c00 0x7fec88197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:12.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.420+0000 7fec8da57640 1 -- 172.21.15.45:0/3423305531 >> 172.21.15.45:0/3423305531 conn(0x7fec880fd390 msgr2=0x7fec881060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:12.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.420+0000 7fec8da57640 1 -- 172.21.15.45:0/3423305531 shutdown_connections 2024-09-15T22:13:12.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:12.420+0000 7fec8da57640 1 -- 172.21.15.45:0/3423305531 wait complete. 2024-09-15T22:13:12.919 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:12 smithi165 ceph-mon[35551]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:12.919 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:12 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3423305531' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:13:12.919 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:12 smithi165 ceph-mon[35551]: from='osd.11 [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:13:12.919 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:12 smithi165 ceph-mon[35551]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:13:12.920 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:13:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:13:12.578+0000 7f2a894ab640 -1 osd.11 0 log_to_monitors true 2024-09-15T22:13:12.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:12 smithi100 ceph-mon[35319]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:12.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:12 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3423305531' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:13:12.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:12 smithi100 ceph-mon[35319]: from='osd.11 [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:13:12.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:12 smithi100 ceph-mon[35319]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:13:13.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:12 smithi045 ceph-mon[31180]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:13.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:12 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3423305531' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:13:13.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:12 smithi045 ceph-mon[31180]: from='osd.11 [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:13:13.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:12 smithi045 ceph-mon[31180]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T22:13:13.184 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726438370,"num_in_osds":12,"osd_in_since":1726438372,"num_remapped_pgs":0} 2024-09-15T22:13:13.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:13 smithi165 ceph-mon[35551]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:13:13.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:13 smithi165 ceph-mon[35551]: osdmap e73: 12 total, 11 up, 12 in 2024-09-15T22:13:13.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:13 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:13.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:13 smithi165 ceph-mon[35551]: from='osd.11 [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:13:13.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:13 smithi165 ceph-mon[35551]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:13:13.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:13 smithi100 ceph-mon[35319]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:13:13.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:13 smithi100 ceph-mon[35319]: osdmap e73: 12 total, 11 up, 12 in 2024-09-15T22:13:13.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:13 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:13.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:13 smithi100 ceph-mon[35319]: from='osd.11 [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:13:13.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:13 smithi100 ceph-mon[35319]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:13:14.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:13 smithi045 ceph-mon[31180]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T22:13:14.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:13 smithi045 ceph-mon[31180]: osdmap e73: 12 total, 11 up, 12 in 2024-09-15T22:13:14.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:13 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:14.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:13 smithi045 ceph-mon[31180]: from='osd.11 [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:13:14.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:13 smithi045 ceph-mon[31180]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]: dispatch 2024-09-15T22:13:14.185 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:13:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:14.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:13:14.431+0000 7f2a8542e640 -1 osd.11 0 waiting for initial osdmap 2024-09-15T22:13:14.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:13:14.446+0000 7f2a7d24e640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:13:14.860 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:14.860 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-15T22:13:14.860 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: osdmap e74: 12 total, 11 up, 12 in 2024-09-15T22:13:14.860 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:14.860 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:14.861 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='osd.11 ' entity='osd.11' 2024-09-15T22:13:14.861 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:14.861 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:14.861 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:13:14.861 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:13:14.861 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:13:14.861 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:13:14.861 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:14.861 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:14.861 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:13:14.861 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:14 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:14.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.941+0000 7fdd16ae1640 1 -- 172.21.15.45:0/3263187055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd10101d10 msgr2=0x7fdd10102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:14.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.941+0000 7fdd16ae1640 1 --2- 172.21.15.45:0/3263187055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd10101d10 0x7fdd10102190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009900 tx=0x7fdcfc02a410 comp rx=0 tx=0).stop 2024-09-15T22:13:14.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.941+0000 7fdd16ae1640 1 -- 172.21.15.45:0/3263187055 shutdown_connections 2024-09-15T22:13:14.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.941+0000 7fdd16ae1640 1 --2- 172.21.15.45:0/3263187055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd101026d0 0x7fdd10108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:14.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.941+0000 7fdd16ae1640 1 --2- 172.21.15.45:0/3263187055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd10101d10 0x7fdd10102190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:14.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.941+0000 7fdd16ae1640 1 --2- 172.21.15.45:0/3263187055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd10100b10 0x7fdd10100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:14.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.941+0000 7fdd16ae1640 1 -- 172.21.15.45:0/3263187055 >> 172.21.15.45:0/3263187055 conn(0x7fdd100fc2a0 msgr2=0x7fdd100fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:14.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.941+0000 7fdd16ae1640 1 -- 172.21.15.45:0/3263187055 shutdown_connections 2024-09-15T22:13:14.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.941+0000 7fdd16ae1640 1 -- 172.21.15.45:0/3263187055 wait complete. 2024-09-15T22:13:14.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd16ae1640 1 Processor -- start 2024-09-15T22:13:14.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd16ae1640 1 -- start start 2024-09-15T22:13:14.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd16ae1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd10100b10 0x7fdd1019a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd16ae1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd10101d10 0x7fdd1019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd16ae1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd101026d0 0x7fdd101a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd16ae1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1010c8d0 con 0x7fdd10100b10 2024-09-15T22:13:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd16ae1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1010c750 con 0x7fdd101026d0 2024-09-15T22:13:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd16ae1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1010ca50 con 0x7fdd10101d10 2024-09-15T22:13:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd1487d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd10100b10 0x7fdd1019a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd1487d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd10100b10 0x7fdd1019a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44972/0 (socket says 172.21.15.45:44972) 2024-09-15T22:13:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd1487d640 1 -- 172.21.15.45:0/2835609043 learned_addr learned my addr 172.21.15.45:0/2835609043 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd1507e640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd101026d0 0x7fdd101a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd0ffff640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd10101d10 0x7fdd1019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd1487d640 1 -- 172.21.15.45:0/2835609043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd10101d10 msgr2=0x7fdd1019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd1487d640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd10101d10 0x7fdd1019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:14.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd1487d640 1 -- 172.21.15.45:0/2835609043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd101026d0 msgr2=0x7fdd101a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd1487d640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd101026d0 0x7fdd101a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd1487d640 1 -- 172.21.15.45:0/2835609043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd101a1e20 con 0x7fdd10100b10 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd1507e640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd101026d0 0x7fdd101a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.942+0000 7fdd0ffff640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd10101d10 0x7fdd1019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.943+0000 7fdd1487d640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd10100b10 0x7fdd1019a1f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400d950 tx=0x7fdd0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.943+0000 7fdd0dffb640 1 -- 172.21.15.45:0/2835609043 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd04017020 con 0x7fdd10100b10 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.943+0000 7fdd0dffb640 1 -- 172.21.15.45:0/2835609043 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdd04009c30 con 0x7fdd10100b10 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.943+0000 7fdd16ae1640 1 -- 172.21.15.45:0/2835609043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd101a2110 con 0x7fdd10100b10 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.943+0000 7fdd0dffb640 1 -- 172.21.15.45:0/2835609043 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400f7b0 con 0x7fdd10100b10 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.943+0000 7fdd16ae1640 1 -- 172.21.15.45:0/2835609043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd101a26a0 con 0x7fdd10100b10 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.944+0000 7fdd16ae1640 1 -- 172.21.15.45:0/2835609043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd101a2960 con 0x7fdd10100b10 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.945+0000 7fdd0dffb640 1 -- 172.21.15.45:0/2835609043 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fdd0401a020 con 0x7fdd10100b10 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.946+0000 7fdd0dffb640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdd000a32f0 0x7fdd000a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:14.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.946+0000 7fdd0ffff640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdd000a32f0 0x7fdd000a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.946+0000 7fdd0dffb640 1 -- 172.21.15.45:0/2835609043 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6847+0+0 (secure 0 0 0) 0x7fdd040cf280 con 0x7fdd10100b10 2024-09-15T22:13:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.946+0000 7fdd0ffff640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdd000a32f0 0x7fdd000a57b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc000c00 tx=0x7fdcfc009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:14.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:14.950+0000 7fdd0dffb640 1 -- 172.21.15.45:0/2835609043 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd04021020 con 0x7fdd10100b10 2024-09-15T22:13:14.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:14.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-15T22:13:14.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: osdmap e74: 12 total, 11 up, 12 in 2024-09-15T22:13:14.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:14.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:14.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='osd.11 ' entity='osd.11' 2024-09-15T22:13:14.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:14.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:14.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:13:14.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:13:14.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:13:14.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:13:14.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:14.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:14.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:13:14.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:14 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:15.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.127+0000 7fdd16ae1640 1 -- 172.21.15.45:0/2835609043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fdd101a2b30 con 0x7fdd10100b10 2024-09-15T22:13:15.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.128+0000 7fdd0dffb640 1 -- 172.21.15.45:0/2835609043 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7fdd040860a0 con 0x7fdd10100b10 2024-09-15T22:13:15.129 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:15.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.130+0000 7fdd16ae1640 1 -- 172.21.15.45:0/2835609043 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdd000a32f0 msgr2=0x7fdd000a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:15.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.130+0000 7fdd16ae1640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdd000a32f0 0x7fdd000a57b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc000c00 tx=0x7fdcfc009560 comp rx=0 tx=0).stop 2024-09-15T22:13:15.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.130+0000 7fdd16ae1640 1 -- 172.21.15.45:0/2835609043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd10100b10 msgr2=0x7fdd1019a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:15.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.130+0000 7fdd16ae1640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd10100b10 0x7fdd1019a1f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdd0400d950 tx=0x7fdd0400de10 comp rx=0 tx=0).stop 2024-09-15T22:13:15.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.130+0000 7fdd16ae1640 1 -- 172.21.15.45:0/2835609043 shutdown_connections 2024-09-15T22:13:15.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.130+0000 7fdd16ae1640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdd000a32f0 0x7fdd000a57b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:15.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.130+0000 7fdd16ae1640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd101026d0 0x7fdd101a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:15.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.130+0000 7fdd16ae1640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdd10101d10 0x7fdd1019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:15.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.130+0000 7fdd16ae1640 1 --2- 172.21.15.45:0/2835609043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd10100b10 0x7fdd1019a1f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:15.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.130+0000 7fdd16ae1640 1 -- 172.21.15.45:0/2835609043 >> 172.21.15.45:0/2835609043 conn(0x7fdd100fc2a0 msgr2=0x7fdd100fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:15.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.131+0000 7fdd16ae1640 1 -- 172.21.15.45:0/2835609043 shutdown_connections 2024-09-15T22:13:15.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:15.131+0000 7fdd16ae1640 1 -- 172.21.15.45:0/2835609043 wait complete. 2024-09-15T22:13:15.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi165", "root=default"]}]': finished 2024-09-15T22:13:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: osdmap e74: 12 total, 11 up, 12 in 2024-09-15T22:13:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='osd.11 ' entity='osd.11' 2024-09-15T22:13:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:13:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:13:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:13:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:13:15.216 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:15.216 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:15.216 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:13:15.216 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:14 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:15.905 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:15 smithi045 ceph-mon[31180]: purged_snaps scrub starts 2024-09-15T22:13:15.905 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:15 smithi045 ceph-mon[31180]: purged_snaps scrub ok 2024-09-15T22:13:15.905 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:15 smithi045 ceph-mon[31180]: Detected new or changed devices on smithi165 2024-09-15T22:13:15.905 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:15 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi165 to 4272M 2024-09-15T22:13:15.905 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:15.905 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:15 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2835609043' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:13:15.905 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:15 smithi045 ceph-mon[31180]: osd.11 [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054] boot 2024-09-15T22:13:15.905 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:15 smithi045 ceph-mon[31180]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T22:13:15.905 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:15 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:15.906 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1726438370,"num_in_osds":12,"osd_in_since":1726438372,"num_remapped_pgs":0} 2024-09-15T22:13:15.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:15 smithi100 ceph-mon[35319]: purged_snaps scrub starts 2024-09-15T22:13:15.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:15 smithi100 ceph-mon[35319]: purged_snaps scrub ok 2024-09-15T22:13:15.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:15 smithi100 ceph-mon[35319]: Detected new or changed devices on smithi165 2024-09-15T22:13:15.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:15 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi165 to 4272M 2024-09-15T22:13:15.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:15 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:15.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:15 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2835609043' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:13:15.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:15 smithi100 ceph-mon[35319]: osd.11 [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054] boot 2024-09-15T22:13:15.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:15 smithi100 ceph-mon[35319]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T22:13:15.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:15 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:16.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:15 smithi165 ceph-mon[35551]: purged_snaps scrub starts 2024-09-15T22:13:16.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:15 smithi165 ceph-mon[35551]: purged_snaps scrub ok 2024-09-15T22:13:16.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:15 smithi165 ceph-mon[35551]: Detected new or changed devices on smithi165 2024-09-15T22:13:16.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:15 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi165 to 4272M 2024-09-15T22:13:16.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:15 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:16.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:15 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2835609043' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:13:16.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:15 smithi165 ceph-mon[35551]: osd.11 [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054] boot 2024-09-15T22:13:16.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:15 smithi165 ceph-mon[35551]: osdmap e75: 12 total, 12 up, 12 in 2024-09-15T22:13:16.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:15 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:13:16.907 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T22:13:16.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:16 smithi100 ceph-mon[35319]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:16.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:16 smithi100 ceph-mon[35319]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:13:17.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:16 smithi045 ceph-mon[31180]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:17.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:16 smithi045 ceph-mon[31180]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:13:17.176 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:17.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:16 smithi165 ceph-mon[35551]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 357 MiB used, 983 GiB / 983 GiB avail 2024-09-15T22:13:17.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:16 smithi165 ceph-mon[35551]: osdmap e76: 12 total, 12 up, 12 in 2024-09-15T22:13:17.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.610+0000 7f4b2a244640 1 -- 172.21.15.45:0/2626898783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b24102690 msgr2=0x7f4b24104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:17.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.610+0000 7f4b2a244640 1 --2- 172.21.15.45:0/2626898783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b24102690 0x7f4b24104a80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4b14009900 tx=0x7f4b1402a410 comp rx=0 tx=0).stop 2024-09-15T22:13:17.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.610+0000 7f4b2a244640 1 -- 172.21.15.45:0/2626898783 shutdown_connections 2024-09-15T22:13:17.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.610+0000 7f4b2a244640 1 --2- 172.21.15.45:0/2626898783 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b241078f0 0x7f4b24109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:17.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.610+0000 7f4b2a244640 1 --2- 172.21.15.45:0/2626898783 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b24104fc0 0x7f4b241073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:17.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.610+0000 7f4b2a244640 1 --2- 172.21.15.45:0/2626898783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b24102690 0x7f4b24104a80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:17.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.610+0000 7f4b2a244640 1 -- 172.21.15.45:0/2626898783 >> 172.21.15.45:0/2626898783 conn(0x7f4b240fc270 msgr2=0x7f4b240fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:17.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.610+0000 7f4b2a244640 1 -- 172.21.15.45:0/2626898783 shutdown_connections 2024-09-15T22:13:17.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.610+0000 7f4b2a244640 1 -- 172.21.15.45:0/2626898783 wait complete. 2024-09-15T22:13:17.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.610+0000 7f4b2a244640 1 Processor -- start 2024-09-15T22:13:17.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.610+0000 7f4b2a244640 1 -- start start 2024-09-15T22:13:17.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b2a244640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b24102690 0x7f4b2419a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:17.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b2a244640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b24104fc0 0x7f4b2419a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:17.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b2a244640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b241078f0 0x7f4b241a1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:17.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b2a244640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4b24101010 con 0x7f4b24102690 2024-09-15T22:13:17.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b2a244640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4b24100e90 con 0x7f4b24104fc0 2024-09-15T22:13:17.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b2a244640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4b24101190 con 0x7f4b241078f0 2024-09-15T22:13:17.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b237fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b24102690 0x7f4b2419a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:17.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b237fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b24102690 0x7f4b2419a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44978/0 (socket says 172.21.15.45:44978) 2024-09-15T22:13:17.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b237fe640 1 -- 172.21.15.45:0/1827355541 learned_addr learned my addr 172.21.15.45:0/1827355541 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b23fff640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b241078f0 0x7f4b241a1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b1affd640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b24104fc0 0x7f4b2419a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b237fe640 1 -- 172.21.15.45:0/1827355541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b241078f0 msgr2=0x7f4b241a1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b237fe640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b241078f0 0x7f4b241a1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b237fe640 1 -- 172.21.15.45:0/1827355541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b24104fc0 msgr2=0x7f4b2419a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b237fe640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b24104fc0 0x7f4b2419a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b237fe640 1 -- 172.21.15.45:0/1827355541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b241a1ff0 con 0x7f4b24102690 2024-09-15T22:13:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.611+0000 7f4b237fe640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b24102690 0x7f4b2419a3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4b140316a0 tx=0x7f4b14032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.612+0000 7f4b217fa640 1 -- 172.21.15.45:0/1827355541 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1403f030 con 0x7f4b24102690 2024-09-15T22:13:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.612+0000 7f4b217fa640 1 -- 172.21.15.45:0/1827355541 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4b14003d00 con 0x7f4b24102690 2024-09-15T22:13:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.612+0000 7f4b2a244640 1 -- 172.21.15.45:0/1827355541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b241a2280 con 0x7f4b24102690 2024-09-15T22:13:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.612+0000 7f4b217fa640 1 -- 172.21.15.45:0/1827355541 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14035070 con 0x7f4b24102690 2024-09-15T22:13:17.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.612+0000 7f4b2a244640 1 -- 172.21.15.45:0/1827355541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b241a27e0 con 0x7f4b24102690 2024-09-15T22:13:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.613+0000 7f4b2a244640 1 -- 172.21.15.45:0/1827355541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b241a2a40 con 0x7f4b24102690 2024-09-15T22:13:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.614+0000 7f4b217fa640 1 -- 172.21.15.45:0/1827355541 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4b14042030 con 0x7f4b24102690 2024-09-15T22:13:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.615+0000 7f4b217fa640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4b100a3270 0x7f4b100a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.615+0000 7f4b1affd640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4b100a3270 0x7f4b100a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.615+0000 7f4b217fa640 1 -- 172.21.15.45:0/1827355541 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f4b140efb60 con 0x7f4b24102690 2024-09-15T22:13:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.615+0000 7f4b1affd640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4b100a3270 0x7f4b100a5730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4b2419b8e0 tx=0x7f4b0c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:17.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.619+0000 7f4b217fa640 1 -- 172.21.15.45:0/1827355541 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b140bcc80 con 0x7f4b24102690 2024-09-15T22:13:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.794+0000 7f4b2a244640 1 -- 172.21.15.45:0/1827355541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4b241a2c10 con 0x7f4b24102690 2024-09-15T22:13:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.794+0000 7f4b217fa640 1 -- 172.21.15.45:0/1827355541 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f4b140bc580 con 0x7f4b24102690 2024-09-15T22:13:17.795 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:17.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.796+0000 7f4b2a244640 1 -- 172.21.15.45:0/1827355541 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4b100a3270 msgr2=0x7f4b100a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:17.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.796+0000 7f4b2a244640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4b100a3270 0x7f4b100a5730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4b2419b8e0 tx=0x7f4b0c008040 comp rx=0 tx=0).stop 2024-09-15T22:13:17.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.796+0000 7f4b2a244640 1 -- 172.21.15.45:0/1827355541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b24102690 msgr2=0x7f4b2419a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:17.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.796+0000 7f4b2a244640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b24102690 0x7f4b2419a3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4b140316a0 tx=0x7f4b14032cc0 comp rx=0 tx=0).stop 2024-09-15T22:13:17.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.796+0000 7f4b2a244640 1 -- 172.21.15.45:0/1827355541 shutdown_connections 2024-09-15T22:13:17.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.796+0000 7f4b2a244640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4b100a3270 0x7f4b100a5730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:17.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.796+0000 7f4b2a244640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4b241078f0 0x7f4b241a1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:17.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.796+0000 7f4b2a244640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b24104fc0 0x7f4b2419a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:17.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.796+0000 7f4b2a244640 1 --2- 172.21.15.45:0/1827355541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b24102690 0x7f4b2419a3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:17.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.796+0000 7f4b2a244640 1 -- 172.21.15.45:0/1827355541 >> 172.21.15.45:0/1827355541 conn(0x7f4b240fc270 msgr2=0x7f4b24107cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:17.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.796+0000 7f4b2a244640 1 -- 172.21.15.45:0/1827355541 shutdown_connections 2024-09-15T22:13:17.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:17.796+0000 7f4b2a244640 1 -- 172.21.15.45:0/1827355541 wait complete. 2024-09-15T22:13:18.479 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":76,"num_osds":12,"num_up_osds":12,"osd_up_since":1726438395,"num_in_osds":12,"osd_in_since":1726438372,"num_remapped_pgs":0} 2024-09-15T22:13:18.479 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:13:18.728 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:18 smithi045 ceph-mon[31180]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:18.729 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:18 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1827355541' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:13:18.733 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:18.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:18 smithi100 ceph-mon[35319]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:18.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:18 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1827355541' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:13:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.192+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3020134488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a4106f10 msgr2=0x7fd7a410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.192+0000 7fd7a8c18640 1 --2- 172.21.15.45:0/3020134488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a4106f10 0x7fd7a410ea90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd79c009ca0 tx=0x7fd79c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:13:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.192+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3020134488 shutdown_connections 2024-09-15T22:13:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.192+0000 7fd7a8c18640 1 --2- 172.21.15.45:0/3020134488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a4106f10 0x7fd7a410ea90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.192+0000 7fd7a8c18640 1 --2- 172.21.15.45:0/3020134488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7a4102790 0x7fd7a41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.192+0000 7fd7a8c18640 1 --2- 172.21.15.45:0/3020134488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7a4101de0 0x7fd7a41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.192+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3020134488 >> 172.21.15.45:0/3020134488 conn(0x7fd7a40fd8c0 msgr2=0x7fd7a40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.192+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3020134488 shutdown_connections 2024-09-15T22:13:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.192+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3020134488 wait complete. 2024-09-15T22:13:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.193+0000 7fd7a8c18640 1 Processor -- start 2024-09-15T22:13:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.193+0000 7fd7a8c18640 1 -- start start 2024-09-15T22:13:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.193+0000 7fd7a8c18640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7a4101de0 0x7fd7a40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.193+0000 7fd7a8c18640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a4102790 0x7fd7a4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.193+0000 7fd7a8c18640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7a4106f10 0x7fd7a4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.193+0000 7fd7a8c18640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a4112090 con 0x7fd7a4102790 2024-09-15T22:13:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.193+0000 7fd7a8c18640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a4111f10 con 0x7fd7a4106f10 2024-09-15T22:13:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.193+0000 7fd7a8c18640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a4112210 con 0x7fd7a4101de0 2024-09-15T22:13:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.193+0000 7fd799d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a4102790 0x7fd7a4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.193+0000 7fd799d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a4102790 0x7fd7a4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44986/0 (socket says 172.21.15.45:44986) 2024-09-15T22:13:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.193+0000 7fd799d9b640 1 -- 172.21.15.45:0/3410922275 learned_addr learned my addr 172.21.15.45:0/3410922275 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.193+0000 7fd7a259c640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7a4101de0 0x7fd7a40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.194+0000 7fd7a2d9d640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7a4106f10 0x7fd7a4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.194+0000 7fd799d9b640 1 -- 172.21.15.45:0/3410922275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7a4101de0 msgr2=0x7fd7a40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.194+0000 7fd799d9b640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7a4101de0 0x7fd7a40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.194+0000 7fd799d9b640 1 -- 172.21.15.45:0/3410922275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7a4106f10 msgr2=0x7fd7a4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.194+0000 7fd799d9b640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7a4106f10 0x7fd7a4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.194+0000 7fd799d9b640 1 -- 172.21.15.45:0/3410922275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a41a6970 con 0x7fd7a4102790 2024-09-15T22:13:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.194+0000 7fd799d9b640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a4102790 0x7fd7a4074a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00d950 tx=0x7fd78c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.194+0000 7fd79bfff640 1 -- 172.21.15.45:0/3410922275 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c017070 con 0x7fd7a4102790 2024-09-15T22:13:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.194+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3410922275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a41a6c60 con 0x7fd7a4102790 2024-09-15T22:13:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.194+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3410922275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a41a71a0 con 0x7fd7a4102790 2024-09-15T22:13:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.194+0000 7fd79bfff640 1 -- 172.21.15.45:0/3410922275 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd78c009c30 con 0x7fd7a4102790 2024-09-15T22:13:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.194+0000 7fd79bfff640 1 -- 172.21.15.45:0/3410922275 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c020060 con 0x7fd7a4102790 2024-09-15T22:13:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.195+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3410922275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd784005290 con 0x7fd7a4102790 2024-09-15T22:13:19.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.196+0000 7fd79bfff640 1 -- 172.21.15.45:0/3410922275 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd78c005030 con 0x7fd7a4102790 2024-09-15T22:13:19.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.197+0000 7fd79bfff640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd7900a3240 0x7fd7900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:19.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.197+0000 7fd79bfff640 1 -- 172.21.15.45:0/3410922275 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd78c0cee70 con 0x7fd7a4102790 2024-09-15T22:13:19.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.197+0000 7fd7a259c640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd7900a3240 0x7fd7900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:19.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.197+0000 7fd7a259c640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd7900a3240 0x7fd7900a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd794009bd0 tx=0x7fd794005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:19.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.200+0000 7fd79bfff640 1 -- 172.21.15.45:0/3410922275 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd78c009de0 con 0x7fd7a4102790 2024-09-15T22:13:19.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:18 smithi165 ceph-mon[35551]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:19.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:18 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1827355541' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T22:13:19.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.378+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3410922275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd784005850 con 0x7fd7a4102790 2024-09-15T22:13:19.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.380+0000 7fd79bfff640 1 -- 172.21.15.45:0/3410922275 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18446 (secure 0 0 0) 0x7fd78c09b9e0 con 0x7fd7a4102790 2024-09-15T22:13:19.381 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:19.381 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":76,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:13:16.445689+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:13:19.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.382+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3410922275 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd7900a3240 msgr2=0x7fd7900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:19.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.382+0000 7fd7a8c18640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd7900a3240 0x7fd7900a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd794009bd0 tx=0x7fd794005f90 comp rx=0 tx=0).stop 2024-09-15T22:13:19.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.382+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3410922275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a4102790 msgr2=0x7fd7a4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:19.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.382+0000 7fd7a8c18640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a4102790 0x7fd7a4074a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00d950 tx=0x7fd78c00de10 comp rx=0 tx=0).stop 2024-09-15T22:13:19.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.382+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3410922275 shutdown_connections 2024-09-15T22:13:19.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.382+0000 7fd7a8c18640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd7900a3240 0x7fd7900a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:19.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.382+0000 7fd7a8c18640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7a4106f10 0x7fd7a4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:19.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.382+0000 7fd7a8c18640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7a4102790 0x7fd7a4074a30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:19.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.382+0000 7fd7a8c18640 1 --2- 172.21.15.45:0/3410922275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd7a4101de0 0x7fd7a40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:19.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.382+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3410922275 >> 172.21.15.45:0/3410922275 conn(0x7fd7a40fd8c0 msgr2=0x7fd7a40feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:19.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.382+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3410922275 shutdown_connections 2024-09-15T22:13:19.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:19.382+0000 7fd7a8c18640 1 -- 172.21.15.45:0/3410922275 wait complete. 2024-09-15T22:13:19.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:19 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3410922275' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:13:20.025 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:19 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3410922275' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:13:20.056 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:09:29.838325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:13:20.056 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-15T22:13:20.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:19 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3410922275' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:13:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:20.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.745+0000 7f5264da6640 1 -- 172.21.15.45:0/1301464014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260100a80 msgr2=0x7f5260100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:20.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.745+0000 7f5264da6640 1 --2- 172.21.15.45:0/1301464014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260100a80 0x7f5260100ee0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5248009930 tx=0x7f524802a420 comp rx=0 tx=0).stop 2024-09-15T22:13:20.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.745+0000 7f5264da6640 1 -- 172.21.15.45:0/1301464014 shutdown_connections 2024-09-15T22:13:20.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.745+0000 7f5264da6640 1 --2- 172.21.15.45:0/1301464014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5260101420 0x7f526010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:20.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.745+0000 7f5264da6640 1 --2- 172.21.15.45:0/1301464014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260100a80 0x7f5260100ee0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:20.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.745+0000 7f5264da6640 1 --2- 172.21.15.45:0/1301464014 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5260106a80 0x7f5260106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:20.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.745+0000 7f5264da6640 1 -- 172.21.15.45:0/1301464014 >> 172.21.15.45:0/1301464014 conn(0x7f52600fc7a0 msgr2=0x7f52600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:20.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.745+0000 7f5264da6640 1 -- 172.21.15.45:0/1301464014 shutdown_connections 2024-09-15T22:13:20.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.745+0000 7f5264da6640 1 -- 172.21.15.45:0/1301464014 wait complete. 2024-09-15T22:13:20.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.746+0000 7f5264da6640 1 Processor -- start 2024-09-15T22:13:20.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.746+0000 7f5264da6640 1 -- start start 2024-09-15T22:13:20.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.746+0000 7f5264da6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5260100a80 0x7f52600fcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:20.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.746+0000 7f5264da6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260101420 0x7f52600fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:20.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.746+0000 7f5264da6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5260106a80 0x7f52600fd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:20.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.746+0000 7f5264da6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5260110fa0 con 0x7f5260101420 2024-09-15T22:13:20.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.746+0000 7f5264da6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5260110e20 con 0x7f5260100a80 2024-09-15T22:13:20.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.746+0000 7f5264da6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5260111120 con 0x7f5260106a80 2024-09-15T22:13:20.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.746+0000 7f5257fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260101420 0x7f52600fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:20.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.746+0000 7f5257fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260101420 0x7f52600fd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45006/0 (socket says 172.21.15.45:45006) 2024-09-15T22:13:20.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.746+0000 7f5257fff640 1 -- 172.21.15.45:0/4011726902 learned_addr learned my addr 172.21.15.45:0/4011726902 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:20.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.747+0000 7f525e59c640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5260100a80 0x7f52600fcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:20.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.747+0000 7f525ed9d640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5260106a80 0x7f52600fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:20.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.747+0000 7f5257fff640 1 -- 172.21.15.45:0/4011726902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5260106a80 msgr2=0x7f52600fd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:20.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.747+0000 7f5257fff640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5260106a80 0x7f52600fd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:20.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.747+0000 7f5257fff640 1 -- 172.21.15.45:0/4011726902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5260100a80 msgr2=0x7f52600fcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:20.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.747+0000 7f5257fff640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5260100a80 0x7f52600fcd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:20.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.747+0000 7f5257fff640 1 -- 172.21.15.45:0/4011726902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52601a6a70 con 0x7f5260101420 2024-09-15T22:13:20.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.747+0000 7f5257fff640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260101420 0x7f52600fd2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5248009230 tx=0x7f5248004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:20.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.747+0000 7f52577fe640 1 -- 172.21.15.45:0/4011726902 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524803f030 con 0x7f5260101420 2024-09-15T22:13:20.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.747+0000 7f52577fe640 1 -- 172.21.15.45:0/4011726902 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5248003af0 con 0x7f5260101420 2024-09-15T22:13:20.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.747+0000 7f5264da6640 1 -- 172.21.15.45:0/4011726902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52601a6d00 con 0x7f5260101420 2024-09-15T22:13:20.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.747+0000 7f52577fe640 1 -- 172.21.15.45:0/4011726902 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248035070 con 0x7f5260101420 2024-09-15T22:13:20.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.747+0000 7f5264da6640 1 -- 172.21.15.45:0/4011726902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52601a7190 con 0x7f5260101420 2024-09-15T22:13:20.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.748+0000 7f5264da6640 1 -- 172.21.15.45:0/4011726902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5260100ee0 con 0x7f5260101420 2024-09-15T22:13:20.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.749+0000 7f52577fe640 1 -- 172.21.15.45:0/4011726902 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5248042030 con 0x7f5260101420 2024-09-15T22:13:20.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.750+0000 7f52577fe640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f524c0a3240 0x7f524c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:20.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.750+0000 7f525e59c640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f524c0a3240 0x7f524c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:20.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.750+0000 7f52577fe640 1 -- 172.21.15.45:0/4011726902 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f52480efce0 con 0x7f5260101420 2024-09-15T22:13:20.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.750+0000 7f525e59c640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f524c0a3240 0x7f524c0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5250005fd0 tx=0x7f525000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:20.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.754+0000 7f52577fe640 1 -- 172.21.15.45:0/4011726902 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f52480bcec0 con 0x7f5260101420 2024-09-15T22:13:20.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.927+0000 7f5264da6640 1 -- 172.21.15.45:0/4011726902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f526010a000 con 0x7f5260101420 2024-09-15T22:13:20.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.928+0000 7f52577fe640 1 -- 172.21.15.45:0/4011726902 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7f52480bc7c0 con 0x7f5260101420 2024-09-15T22:13:20.929 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-09-15T22:13:20.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.929+0000 7f5264da6640 1 -- 172.21.15.45:0/4011726902 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f524c0a3240 msgr2=0x7f524c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:20.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.929+0000 7f5264da6640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f524c0a3240 0x7f524c0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5250005fd0 tx=0x7f525000b390 comp rx=0 tx=0).stop 2024-09-15T22:13:20.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.929+0000 7f5264da6640 1 -- 172.21.15.45:0/4011726902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260101420 msgr2=0x7f52600fd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:20.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.929+0000 7f5264da6640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260101420 0x7f52600fd2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5248009230 tx=0x7f5248004270 comp rx=0 tx=0).stop 2024-09-15T22:13:20.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.930+0000 7f5264da6640 1 -- 172.21.15.45:0/4011726902 shutdown_connections 2024-09-15T22:13:20.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.930+0000 7f5264da6640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f524c0a3240 0x7f524c0a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:20.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.930+0000 7f5264da6640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5260106a80 0x7f52600fd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:20.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.930+0000 7f5264da6640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5260101420 0x7f52600fd2c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:20.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.930+0000 7f5264da6640 1 --2- 172.21.15.45:0/4011726902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5260100a80 0x7f52600fcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:20.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.930+0000 7f5264da6640 1 -- 172.21.15.45:0/4011726902 >> 172.21.15.45:0/4011726902 conn(0x7f52600fc7a0 msgr2=0x7f526006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:20.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.930+0000 7f5264da6640 1 -- 172.21.15.45:0/4011726902 shutdown_connections 2024-09-15T22:13:20.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:20.930+0000 7f5264da6640 1 -- 172.21.15.45:0/4011726902 wait complete. 2024-09-15T22:13:20.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:20 smithi100 ceph-mon[35319]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:21.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:20 smithi045 ceph-mon[31180]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:21.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:20 smithi165 ceph-mon[35551]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:21.752 INFO:tasks.cephadm:Adding mds.a on smithi045 2024-09-15T22:13:21.752 INFO:tasks.cephadm:Adding mds.d on smithi045 2024-09-15T22:13:21.752 INFO:tasks.cephadm:Adding mds.g on smithi045 2024-09-15T22:13:21.752 INFO:tasks.cephadm:Adding mds.j on smithi045 2024-09-15T22:13:21.752 INFO:tasks.cephadm:Adding mds.b on smithi100 2024-09-15T22:13:21.752 INFO:tasks.cephadm:Adding mds.e on smithi100 2024-09-15T22:13:21.752 INFO:tasks.cephadm:Adding mds.h on smithi100 2024-09-15T22:13:21.752 INFO:tasks.cephadm:Adding mds.k on smithi100 2024-09-15T22:13:21.753 INFO:tasks.cephadm:Adding mds.c on smithi165 2024-09-15T22:13:21.753 INFO:tasks.cephadm:Adding mds.f on smithi165 2024-09-15T22:13:21.753 INFO:tasks.cephadm:Adding mds.i on smithi165 2024-09-15T22:13:21.753 INFO:tasks.cephadm:Adding mds.l on smithi165 2024-09-15T22:13:21.753 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi165=c;smithi165=f;smithi165=i;smithi165=l' 2024-09-15T22:13:21.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:21 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/4011726902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:13:22.011 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:13:22.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:21 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/4011726902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:13:22.132 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:21 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/4011726902' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:13:22.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.589+0000 7f31d30a4640 1 -- 172.21.15.165:0/989408097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31cc101c00 msgr2=0x7f31cc102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:22.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.589+0000 7f31d30a4640 1 --2- 172.21.15.165:0/989408097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31cc101c00 0x7f31cc102000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009900 tx=0x7f31c002a410 comp rx=0 tx=0).stop 2024-09-15T22:13:22.599 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.589+0000 7f31d30a4640 1 -- 172.21.15.165:0/989408097 shutdown_connections 2024-09-15T22:13:22.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.589+0000 7f31d30a4640 1 --2- 172.21.15.165:0/989408097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31cc1037c0 0x7f31cc10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:22.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.589+0000 7f31d30a4640 1 --2- 172.21.15.165:0/989408097 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31cc102e00 0x7f31cc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:22.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.589+0000 7f31d30a4640 1 --2- 172.21.15.165:0/989408097 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31cc101c00 0x7f31cc102000 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:22.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.589+0000 7f31d30a4640 1 -- 172.21.15.165:0/989408097 >> 172.21.15.165:0/989408097 conn(0x7f31cc0fd390 msgr2=0x7f31cc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:22.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.589+0000 7f31d30a4640 1 -- 172.21.15.165:0/989408097 shutdown_connections 2024-09-15T22:13:22.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.589+0000 7f31d30a4640 1 -- 172.21.15.165:0/989408097 wait complete. 2024-09-15T22:13:22.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.589+0000 7f31d30a4640 1 Processor -- start 2024-09-15T22:13:22.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.589+0000 7f31d30a4640 1 -- start start 2024-09-15T22:13:22.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.589+0000 7f31d30a4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31cc101c00 0x7f31cc198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:22.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.589+0000 7f31d30a4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31cc102e00 0x7f31cc198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:22.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31d30a4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31cc1037c0 0x7f31cc19f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:22.600 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31d30a4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc10d9c0 con 0x7f31cc1037c0 2024-09-15T22:13:22.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31d30a4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc10d840 con 0x7f31cc101c00 2024-09-15T22:13:22.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31d30a4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc10db40 con 0x7f31cc102e00 2024-09-15T22:13:22.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31cbfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31cc102e00 0x7f31cc198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:22.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31cbfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31cc102e00 0x7f31cc198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.165:37742/0 (socket says 172.21.15.165:37742) 2024-09-15T22:13:22.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31cbfff640 1 -- 172.21.15.165:0/2347608732 learned_addr learned my addr 172.21.15.165:0/2347608732 (peer_addr_for_me v2:172.21.15.165:0/0) 2024-09-15T22:13:22.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31d1641640 1 --2- 172.21.15.165:0/2347608732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31cc1037c0 0x7f31cc19f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:22.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31cbfff640 1 -- 172.21.15.165:0/2347608732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31cc101c00 msgr2=0x7f31cc198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:22.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31cbfff640 1 --2- 172.21.15.165:0/2347608732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31cc101c00 0x7f31cc198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:22.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31cbfff640 1 -- 172.21.15.165:0/2347608732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31cc1037c0 msgr2=0x7f31cc19f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:22.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31cbfff640 1 --2- 172.21.15.165:0/2347608732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31cc1037c0 0x7f31cc19f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:22.601 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31cbfff640 1 -- 172.21.15.165:0/2347608732 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31cc19fc40 con 0x7f31cc102e00 2024-09-15T22:13:22.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31cbfff640 1 --2- 172.21.15.165:0/2347608732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31cc102e00 0x7f31cc198550 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31b800e9f0 tx=0x7f31b800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:22.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31c9ffb640 1 -- 172.21.15.165:0/2347608732 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b800cd80 con 0x7f31cc102e00 2024-09-15T22:13:22.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31c9ffb640 1 -- 172.21.15.165:0/2347608732 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f31b8005520 con 0x7f31cc102e00 2024-09-15T22:13:22.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31d30a4640 1 -- 172.21.15.165:0/2347608732 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31cc19ff30 con 0x7f31cc102e00 2024-09-15T22:13:22.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31c9ffb640 1 -- 172.21.15.165:0/2347608732 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8010690 con 0x7f31cc102e00 2024-09-15T22:13:22.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.590+0000 7f31d30a4640 1 -- 172.21.15.165:0/2347608732 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31cc1a0390 con 0x7f31cc102e00 2024-09-15T22:13:22.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.591+0000 7f31d30a4640 1 -- 172.21.15.165:0/2347608732 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31cc108fa0 con 0x7f31cc102e00 2024-09-15T22:13:22.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.592+0000 7f31c9ffb640 1 -- 172.21.15.165:0/2347608732 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f31b80046c0 con 0x7f31cc102e00 2024-09-15T22:13:22.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.593+0000 7f31c9ffb640 1 --2- 172.21.15.165:0/2347608732 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f31bc0a3270 0x7f31bc0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:22.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.593+0000 7f31c9ffb640 1 -- 172.21.15.165:0/2347608732 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f31b80cf9a0 con 0x7f31cc102e00 2024-09-15T22:13:22.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.593+0000 7f31d0e40640 1 --2- 172.21.15.165:0/2347608732 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f31bc0a3270 0x7f31bc0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:22.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.594+0000 7f31d0e40640 1 --2- 172.21.15.165:0/2347608732 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f31bc0a3270 0x7f31bc0a5730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f31c0005c20 tx=0x7f31c0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:22.602 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.597+0000 7f31c9ffb640 1 -- 172.21.15.165:0/2347608732 <== mon.1 v2:172.21.15.165:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31b809cb60 con 0x7f31cc102e00 2024-09-15T22:13:22.781 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.779+0000 7f31d30a4640 1 -- 172.21.15.165:0/2347608732 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi165=c;smithi165=f;smithi165=i;smithi165=l", "target": ["mon-mgr", ""]}) -- 0x7f31cc062730 con 0x7f31bc0a3270 2024-09-15T22:13:22.788 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.787+0000 7f31c9ffb640 1 -- 172.21.15.165:0/2347608732 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f31cc062730 con 0x7f31bc0a3270 2024-09-15T22:13:22.788 INFO:teuthology.orchestra.run.smithi165.stdout:Scheduled mds.all update... 2024-09-15T22:13:22.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.789+0000 7f31d30a4640 1 -- 172.21.15.165:0/2347608732 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f31bc0a3270 msgr2=0x7f31bc0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:22.790 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.789+0000 7f31d30a4640 1 --2- 172.21.15.165:0/2347608732 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f31bc0a3270 0x7f31bc0a5730 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f31c0005c20 tx=0x7f31c0000bc0 comp rx=0 tx=0).stop 2024-09-15T22:13:22.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.789+0000 7f31d30a4640 1 -- 172.21.15.165:0/2347608732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31cc102e00 msgr2=0x7f31cc198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:22.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.789+0000 7f31d30a4640 1 --2- 172.21.15.165:0/2347608732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31cc102e00 0x7f31cc198550 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31b800e9f0 tx=0x7f31b800edf0 comp rx=0 tx=0).stop 2024-09-15T22:13:22.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.789+0000 7f31d30a4640 1 -- 172.21.15.165:0/2347608732 shutdown_connections 2024-09-15T22:13:22.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.789+0000 7f31d30a4640 1 --2- 172.21.15.165:0/2347608732 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f31bc0a3270 0x7f31bc0a5730 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:22.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.789+0000 7f31d30a4640 1 --2- 172.21.15.165:0/2347608732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31cc1037c0 0x7f31cc19f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:22.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.789+0000 7f31d30a4640 1 --2- 172.21.15.165:0/2347608732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31cc102e00 0x7f31cc198550 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:22.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.789+0000 7f31d30a4640 1 --2- 172.21.15.165:0/2347608732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31cc101c00 0x7f31cc198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:22.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.789+0000 7f31d30a4640 1 -- 172.21.15.165:0/2347608732 >> 172.21.15.165:0/2347608732 conn(0x7f31cc0fd390 msgr2=0x7f31cc106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:22.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.789+0000 7f31d30a4640 1 -- 172.21.15.165:0/2347608732 shutdown_connections 2024-09-15T22:13:22.791 INFO:teuthology.orchestra.run.smithi165.stderr:2024-09-15T22:13:22.789+0000 7f31d30a4640 1 -- 172.21.15.165:0/2347608732 wait complete. 2024-09-15T22:13:22.981 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:22 smithi165 ceph-mon[35551]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:22.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:22 smithi100 ceph-mon[35319]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:23.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:22 smithi045 ceph-mon[31180]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:23.448 DEBUG:teuthology.orchestra.run.smithi045:mds.a> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.a.service 2024-09-15T22:13:23.451 DEBUG:teuthology.orchestra.run.smithi045:mds.d> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.d.service 2024-09-15T22:13:23.494 DEBUG:teuthology.orchestra.run.smithi045:mds.g> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.g.service 2024-09-15T22:13:23.537 DEBUG:teuthology.orchestra.run.smithi045:mds.j> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.j.service 2024-09-15T22:13:23.580 DEBUG:teuthology.orchestra.run.smithi100:mds.b> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.b.service 2024-09-15T22:13:23.583 DEBUG:teuthology.orchestra.run.smithi100:mds.e> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.e.service 2024-09-15T22:13:23.626 DEBUG:teuthology.orchestra.run.smithi100:mds.h> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.h.service 2024-09-15T22:13:23.669 DEBUG:teuthology.orchestra.run.smithi100:mds.k> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.k.service 2024-09-15T22:13:23.712 DEBUG:teuthology.orchestra.run.smithi165:mds.c> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.c.service 2024-09-15T22:13:23.715 DEBUG:teuthology.orchestra.run.smithi165:mds.f> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.f.service 2024-09-15T22:13:23.757 DEBUG:teuthology.orchestra.run.smithi165:mds.i> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.i.service 2024-09-15T22:13:23.800 DEBUG:teuthology.orchestra.run.smithi165:mds.l> sudo journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.l.service 2024-09-15T22:13:23.843 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-15T22:13:23.843 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:13:23.866 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:23 smithi045 ceph-mon[31180]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi165=c;smithi165=f;smithi165=i;smithi165=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:13:23.867 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:23 smithi045 ceph-mon[31180]: Saving service mds.all spec with placement smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi165=c;smithi165=f;smithi165=i;smithi165=l;count:12 2024-09-15T22:13:23.867 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:23.867 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:23.867 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:23.867 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:13:23.867 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:23.867 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:23.867 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:23.867 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:23 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:23.867 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:23 smithi045 ceph-mon[31180]: Deploying daemon mds.l on smithi165 2024-09-15T22:13:23.906 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:23 smithi165 ceph-mon[35551]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi165=c;smithi165=f;smithi165=i;smithi165=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:13:23.906 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:23 smithi165 ceph-mon[35551]: Saving service mds.all spec with placement smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi165=c;smithi165=f;smithi165=i;smithi165=l;count:12 2024-09-15T22:13:23.906 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:23.906 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:23.906 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:23.907 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:13:23.907 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:23.907 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:23.907 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:23.907 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:23 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:23.907 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:23 smithi165 ceph-mon[35551]: Deploying daemon mds.l on smithi165 2024-09-15T22:13:23.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:23 smithi100 ceph-mon[35319]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi165=c;smithi165=f;smithi165=i;smithi165=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:13:23.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:23 smithi100 ceph-mon[35319]: Saving service mds.all spec with placement smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi165=c;smithi165=f;smithi165=i;smithi165=l;count:12 2024-09-15T22:13:23.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:23.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:23.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:23.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:13:23.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:23.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:23.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:23.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:23 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:23.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:23 smithi100 ceph-mon[35319]: Deploying daemon mds.l on smithi165 2024-09-15T22:13:24.095 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:24.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.562+0000 7fc86b164640 1 -- 172.21.15.45:0/1324997037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc864103740 msgr2=0x7fc864107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:24.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.562+0000 7fc86b164640 1 --2- 172.21.15.45:0/1324997037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc864103740 0x7fc864107b80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc858009930 tx=0x7fc85802a420 comp rx=0 tx=0).stop 2024-09-15T22:13:24.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.562+0000 7fc86b164640 1 -- 172.21.15.45:0/1324997037 shutdown_connections 2024-09-15T22:13:24.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.562+0000 7fc86b164640 1 --2- 172.21.15.45:0/1324997037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc864108290 0x7fc86410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.562+0000 7fc86b164640 1 --2- 172.21.15.45:0/1324997037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc864103740 0x7fc864107b80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.562+0000 7fc86b164640 1 --2- 172.21.15.45:0/1324997037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc864102d90 0x7fc864103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.562+0000 7fc86b164640 1 -- 172.21.15.45:0/1324997037 >> 172.21.15.45:0/1324997037 conn(0x7fc8640fc7d0 msgr2=0x7fc8640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.562+0000 7fc86b164640 1 -- 172.21.15.45:0/1324997037 shutdown_connections 2024-09-15T22:13:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.562+0000 7fc86b164640 1 -- 172.21.15.45:0/1324997037 wait complete. 2024-09-15T22:13:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.562+0000 7fc86b164640 1 Processor -- start 2024-09-15T22:13:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.562+0000 7fc86b164640 1 -- start start 2024-09-15T22:13:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc86b164640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc864102d90 0x7fc8641009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc86b164640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc864103740 0x7fc864100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc86b164640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc864108290 0x7fc864101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc86b164640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc864112170 con 0x7fc864103740 2024-09-15T22:13:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc86b164640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc864111ff0 con 0x7fc864102d90 2024-09-15T22:13:24.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc86b164640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641122f0 con 0x7fc864108290 2024-09-15T22:13:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc863fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc864103740 0x7fc864100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc863fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc864103740 0x7fc864100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33410/0 (socket says 172.21.15.45:33410) 2024-09-15T22:13:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc863fff640 1 -- 172.21.15.45:0/3684587022 learned_addr learned my addr 172.21.15.45:0/3684587022 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc868f00640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc864102d90 0x7fc8641009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc869701640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc864108290 0x7fc864101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc863fff640 1 -- 172.21.15.45:0/3684587022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc864108290 msgr2=0x7fc864101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc863fff640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc864108290 0x7fc864101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc863fff640 1 -- 172.21.15.45:0/3684587022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc864102d90 msgr2=0x7fc8641009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc863fff640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc864102d90 0x7fc8641009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc863fff640 1 -- 172.21.15.45:0/3684587022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8641a6ad0 con 0x7fc864103740 2024-09-15T22:13:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.563+0000 7fc863fff640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc864103740 0x7fc864100f30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc858005940 tx=0x7fc8580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.564+0000 7fc861ffb640 1 -- 172.21.15.45:0/3684587022 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85803f030 con 0x7fc864103740 2024-09-15T22:13:24.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.564+0000 7fc861ffb640 1 -- 172.21.15.45:0/3684587022 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc858003d00 con 0x7fc864103740 2024-09-15T22:13:24.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.564+0000 7fc86b164640 1 -- 172.21.15.45:0/3684587022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8641a6d60 con 0x7fc864103740 2024-09-15T22:13:24.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.564+0000 7fc861ffb640 1 -- 172.21.15.45:0/3684587022 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858035070 con 0x7fc864103740 2024-09-15T22:13:24.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.564+0000 7fc86b164640 1 -- 172.21.15.45:0/3684587022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8641a7230 con 0x7fc864103740 2024-09-15T22:13:24.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.565+0000 7fc86b164640 1 -- 172.21.15.45:0/3684587022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc864103170 con 0x7fc864103740 2024-09-15T22:13:24.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.566+0000 7fc861ffb640 1 -- 172.21.15.45:0/3684587022 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc858042030 con 0x7fc864103740 2024-09-15T22:13:24.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.567+0000 7fc861ffb640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc84c0a32c0 0x7fc84c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:24.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.567+0000 7fc868f00640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc84c0a32c0 0x7fc84c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:24.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.567+0000 7fc861ffb640 1 -- 172.21.15.45:0/3684587022 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fc8580ef880 con 0x7fc864103740 2024-09-15T22:13:24.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.567+0000 7fc868f00640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc84c0a32c0 0x7fc84c0a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc85400abe0 tx=0x7fc85400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:24.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.571+0000 7fc861ffb640 1 -- 172.21.15.45:0/3684587022 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc8580bc9a0 con 0x7fc864103740 2024-09-15T22:13:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.783+0000 7fc86b164640 1 -- 172.21.15.45:0/3684587022 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc86410a2a0 con 0x7fc864103740 2024-09-15T22:13:24.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.784+0000 7fc861ffb640 1 -- 172.21.15.45:0/3684587022 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fc8580bc2a0 con 0x7fc864103740 2024-09-15T22:13:24.786 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:24.787 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":1,"btime":"2024-09-15T22:06:19:492132+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-15T22:13:24.787 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 1 2024-09-15T22:13:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.786+0000 7fc86b164640 1 -- 172.21.15.45:0/3684587022 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc84c0a32c0 msgr2=0x7fc84c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.786+0000 7fc86b164640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc84c0a32c0 0x7fc84c0a5780 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc85400abe0 tx=0x7fc85400a2d0 comp rx=0 tx=0).stop 2024-09-15T22:13:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.786+0000 7fc86b164640 1 -- 172.21.15.45:0/3684587022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc864103740 msgr2=0x7fc864100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.786+0000 7fc86b164640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc864103740 0x7fc864100f30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc858005940 tx=0x7fc8580042f0 comp rx=0 tx=0).stop 2024-09-15T22:13:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.787+0000 7fc86b164640 1 -- 172.21.15.45:0/3684587022 shutdown_connections 2024-09-15T22:13:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.787+0000 7fc86b164640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc84c0a32c0 0x7fc84c0a5780 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.787+0000 7fc86b164640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc864108290 0x7fc864101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.787+0000 7fc86b164640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc864103740 0x7fc864100f30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.787+0000 7fc86b164640 1 --2- 172.21.15.45:0/3684587022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc864102d90 0x7fc8641009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:24.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.787+0000 7fc86b164640 1 -- 172.21.15.45:0/3684587022 >> 172.21.15.45:0/3684587022 conn(0x7fc8640fc7d0 msgr2=0x7fc864106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:24.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.787+0000 7fc86b164640 1 -- 172.21.15.45:0/3684587022 shutdown_connections 2024-09-15T22:13:24.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:24.787+0000 7fc86b164640 1 -- 172.21.15.45:0/3684587022 wait complete. 2024-09-15T22:13:25.424 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:25 smithi165 ceph-mon[35551]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:25.425 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:25 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3684587022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:25.425 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:13:25 smithi165 systemd[1]: Starting Ceph mds.l for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:13:25.425 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:13:25 smithi165 podman[65372]: 2024-09-15 22:13:25.32578968 +0000 UTC m=+0.016216917 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:13:25.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:25 smithi100 ceph-mon[35319]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:25.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:25 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3684587022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:25.503 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:25 smithi045 ceph-mon[31180]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:25.503 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:25 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3684587022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:25.693 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:13:25 smithi165 podman[65372]: 2024-09-15 22:13:25.437749807 +0000 UTC m=+0.128177045 container create 334bfe979f6a87ca1be77262b26b63861b79acae20e972979d4686ad40e0d890 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-15T22:13:25.693 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:13:25 smithi165 podman[65372]: 2024-09-15 22:13:25.66539054 +0000 UTC m=+0.355817776 container init 334bfe979f6a87ca1be77262b26b63861b79acae20e972979d4686ad40e0d890 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-15T22:13:25.693 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:13:25 smithi165 podman[65372]: 2024-09-15 22:13:25.668474451 +0000 UTC m=+0.358901690 container start 334bfe979f6a87ca1be77262b26b63861b79acae20e972979d4686ad40e0d890 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e) 2024-09-15T22:13:25.964 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:13:25 smithi165 ceph-mds[65391]: -- 172.21.15.165:0/981107550 <== mon.1 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce58a0f860 con 0x55ce589ed000 2024-09-15T22:13:25.965 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:13:25 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-l[65387]: starting mds.l at 2024-09-15T22:13:25.965 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:13:25 smithi165 bash[65372]: 334bfe979f6a87ca1be77262b26b63861b79acae20e972979d4686ad40e0d890 2024-09-15T22:13:25.965 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:13:25 smithi165 systemd[1]: Started Ceph mds.l for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:13:26.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:26 smithi165 ceph-mon[35551]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:26.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:26 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.165:6832/3442116684,v1:172.21.15.165:6833/3442116684] up:boot 2024-09-15T22:13:26.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:26 smithi165 ceph-mon[35551]: fsmap 1 up:standby 2024-09-15T22:13:26.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:26 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:13:26.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:26 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:26.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:26 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:26.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:26 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:26.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:26 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:26.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:26 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:26.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:26 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:26.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:26 smithi165 ceph-mon[35551]: Deploying daemon mds.k on smithi100 2024-09-15T22:13:26.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:26 smithi100 ceph-mon[35319]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:26.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:26 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.165:6832/3442116684,v1:172.21.15.165:6833/3442116684] up:boot 2024-09-15T22:13:26.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:26 smithi100 ceph-mon[35319]: fsmap 1 up:standby 2024-09-15T22:13:26.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:26 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:13:26.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:26 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:26.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:26 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:26.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:26 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:26.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:26 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:26.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:26 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:26.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:26 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:26.996 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:26 smithi100 ceph-mon[35319]: Deploying daemon mds.k on smithi100 2024-09-15T22:13:27.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:26 smithi045 ceph-mon[31180]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:27.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:26 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.165:6832/3442116684,v1:172.21.15.165:6833/3442116684] up:boot 2024-09-15T22:13:27.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:26 smithi045 ceph-mon[31180]: fsmap 1 up:standby 2024-09-15T22:13:27.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:13:27.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:27.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:27.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:27.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:27.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:27.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:26 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:27.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:26 smithi045 ceph-mon[31180]: Deploying daemon mds.k on smithi100 2024-09-15T22:13:27.534 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:13:27.802 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:27.994 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:13:27 smithi100 systemd[1]: Starting Ceph mds.k for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:13:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.277+0000 7f84149f0640 1 -- 172.21.15.45:0/1143757259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841010c170 msgr2=0x7f841010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.277+0000 7f84149f0640 1 --2- 172.21.15.45:0/1143757259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841010c170 0x7f841010e610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8408009ca0 tx=0x7f840802a950 comp rx=0 tx=0).stop 2024-09-15T22:13:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.277+0000 7f84149f0640 1 -- 172.21.15.45:0/1143757259 shutdown_connections 2024-09-15T22:13:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.277+0000 7f84149f0640 1 --2- 172.21.15.45:0/1143757259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f841010c170 0x7f841010e610 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.277+0000 7f84149f0640 1 --2- 172.21.15.45:0/1143757259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8410103660 0x7f841010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.277+0000 7f84149f0640 1 --2- 172.21.15.45:0/1143757259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410102d40 0x7f8410103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.277+0000 7f84149f0640 1 -- 172.21.15.45:0/1143757259 >> 172.21.15.45:0/1143757259 conn(0x7f84100fc7a0 msgr2=0x7f84100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.277+0000 7f84149f0640 1 -- 172.21.15.45:0/1143757259 shutdown_connections 2024-09-15T22:13:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.277+0000 7f84149f0640 1 -- 172.21.15.45:0/1143757259 wait complete. 2024-09-15T22:13:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.278+0000 7f84149f0640 1 Processor -- start 2024-09-15T22:13:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.278+0000 7f84149f0640 1 -- start start 2024-09-15T22:13:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f84149f0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8410102d40 0x7f841019a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f84149f0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410103660 0x7f841019ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f84149f0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f841010c170 0x7f841019efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f84149f0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8410112090 con 0x7f8410102d40 2024-09-15T22:13:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f84149f0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8410111f10 con 0x7f8410103660 2024-09-15T22:13:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f84149f0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8410112210 con 0x7f841010c170 2024-09-15T22:13:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f840e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8410102d40 0x7f841019a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f840e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8410102d40 0x7f841019a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33424/0 (socket says 172.21.15.45:33424) 2024-09-15T22:13:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f840e59c640 1 -- 172.21.15.45:0/1954995704 learned_addr learned my addr 172.21.15.45:0/1954995704 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f8405d9b640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410103660 0x7f841019ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f840ed9d640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f841010c170 0x7f841019efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f840e59c640 1 -- 172.21.15.45:0/1954995704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f841010c170 msgr2=0x7f841019efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f840e59c640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f841010c170 0x7f841019efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f840e59c640 1 -- 172.21.15.45:0/1954995704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410103660 msgr2=0x7f841019ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f840e59c640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410103660 0x7f841019ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f840e59c640 1 -- 172.21.15.45:0/1954995704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841019f6b0 con 0x7f8410102d40 2024-09-15T22:13:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f840e59c640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8410102d40 0x7f841019a700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f840000e9f0 tx=0x7f840000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f8407fff640 1 -- 172.21.15.45:0/1954995704 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840000cd80 con 0x7f8410102d40 2024-09-15T22:13:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f8407fff640 1 -- 172.21.15.45:0/1954995704 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8400010930 con 0x7f8410102d40 2024-09-15T22:13:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f84149f0640 1 -- 172.21.15.45:0/1954995704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841019f9a0 con 0x7f8410102d40 2024-09-15T22:13:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f8407fff640 1 -- 172.21.15.45:0/1954995704 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400018b00 con 0x7f8410102d40 2024-09-15T22:13:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.279+0000 7f84149f0640 1 -- 172.21.15.45:0/1954995704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84101a7280 con 0x7f8410102d40 2024-09-15T22:13:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.280+0000 7f84149f0640 1 -- 172.21.15.45:0/1954995704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8410103120 con 0x7f8410102d40 2024-09-15T22:13:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.282+0000 7f8407fff640 1 -- 172.21.15.45:0/1954995704 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8400018ca0 con 0x7f8410102d40 2024-09-15T22:13:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.282+0000 7f8407fff640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f83fc0a3240 0x7f83fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.282+0000 7f8405d9b640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f83fc0a3240 0x7f83fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.282+0000 7f8407fff640 1 -- 172.21.15.45:0/1954995704 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f84000cf8e0 con 0x7f8410102d40 2024-09-15T22:13:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.283+0000 7f8405d9b640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f83fc0a3240 0x7f83fc0a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f841010eab0 tx=0x7f83f8005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.286+0000 7f8407fff640 1 -- 172.21.15.45:0/1954995704 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f840009caa0 con 0x7f8410102d40 2024-09-15T22:13:28.301 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:13:28 smithi100 podman[64434]: 2024-09-15 22:13:27.927892403 +0000 UTC m=+0.015812108 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:13:28.301 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:13:28 smithi100 podman[64434]: 2024-09-15 22:13:28.055834707 +0000 UTC m=+0.143754402 container create 3354fa9b1bc6f3064e9845a516258e457865dbc48c2a30ed99b47146c3d23cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T22:13:28.301 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:13:28 smithi100 podman[64434]: 2024-09-15 22:13:28.300331916 +0000 UTC m=+0.388251625 container init 3354fa9b1bc6f3064e9845a516258e457865dbc48c2a30ed99b47146c3d23cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-k, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e) 2024-09-15T22:13:28.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.512+0000 7f84149f0640 1 -- 172.21.15.45:0/1954995704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84101a7570 con 0x7f8410102d40 2024-09-15T22:13:28.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.512+0000 7f8407fff640 1 -- 172.21.15.45:0/1954995704 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f840009c3a0 con 0x7f8410102d40 2024-09-15T22:13:28.515 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:28.515 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":2,"btime":"2024-09-15T22:13:25:696624+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:13:28.515 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 2 2024-09-15T22:13:28.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.515+0000 7f84149f0640 1 -- 172.21.15.45:0/1954995704 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f83fc0a3240 msgr2=0x7f83fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:28.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.515+0000 7f84149f0640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f83fc0a3240 0x7f83fc0a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f841010eab0 tx=0x7f83f8005f50 comp rx=0 tx=0).stop 2024-09-15T22:13:28.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.515+0000 7f84149f0640 1 -- 172.21.15.45:0/1954995704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8410102d40 msgr2=0x7f841019a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:28.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.515+0000 7f84149f0640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8410102d40 0x7f841019a700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f840000e9f0 tx=0x7f840000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:13:28.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.515+0000 7f84149f0640 1 -- 172.21.15.45:0/1954995704 shutdown_connections 2024-09-15T22:13:28.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.515+0000 7f84149f0640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f83fc0a3240 0x7f83fc0a5700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:28.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.515+0000 7f84149f0640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f841010c170 0x7f841019efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:28.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.515+0000 7f84149f0640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8410103660 0x7f841019ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:28.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.515+0000 7f84149f0640 1 --2- 172.21.15.45:0/1954995704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8410102d40 0x7f841019a700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:28.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.515+0000 7f84149f0640 1 -- 172.21.15.45:0/1954995704 >> 172.21.15.45:0/1954995704 conn(0x7f84100fc7a0 msgr2=0x7f841010d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:28.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.515+0000 7f84149f0640 1 -- 172.21.15.45:0/1954995704 shutdown_connections 2024-09-15T22:13:28.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:28.515+0000 7f84149f0640 1 -- 172.21.15.45:0/1954995704 wait complete. 2024-09-15T22:13:28.703 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:13:28 smithi100 podman[64434]: 2024-09-15 22:13:28.30356302 +0000 UTC m=+0.391482716 container start 3354fa9b1bc6f3064e9845a516258e457865dbc48c2a30ed99b47146c3d23cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-15T22:13:28.703 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:13:28 smithi100 ceph-mds[64454]: -- 172.21.15.100:0/1297539103 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bb024d7c20 con 0x55bb024b5000 2024-09-15T22:13:28.703 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:13:28 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-k[64450]: starting mds.k at 2024-09-15T22:13:28.703 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:13:28 smithi100 bash[64434]: 3354fa9b1bc6f3064e9845a516258e457865dbc48c2a30ed99b47146c3d23cb5 2024-09-15T22:13:28.703 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:13:28 smithi100 systemd[1]: Started Ceph mds.k for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:13:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:28 smithi045 ceph-mon[31180]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:28.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:28.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:28 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:28.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:28 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1954995704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:28.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:28 smithi165 ceph-mon[35551]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:28 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:28 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1954995704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:28 smithi100 ceph-mon[35319]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:28.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:28.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:28.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:28 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:28.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:28 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1954995704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:29.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:29 smithi100 ceph-mon[35319]: Deploying daemon mds.j on smithi045 2024-09-15T22:13:29.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:29 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.100:6832/3112428521,v1:172.21.15.100:6833/3112428521] up:boot 2024-09-15T22:13:29.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:29 smithi100 ceph-mon[35319]: fsmap 2 up:standby 2024-09-15T22:13:29.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:29 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:13:30.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:29 smithi045 ceph-mon[31180]: Deploying daemon mds.j on smithi045 2024-09-15T22:13:30.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:29 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.100:6832/3112428521,v1:172.21.15.100:6833/3112428521] up:boot 2024-09-15T22:13:30.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:29 smithi045 ceph-mon[31180]: fsmap 2 up:standby 2024-09-15T22:13:30.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:29 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:13:30.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:29 smithi165 ceph-mon[35551]: Deploying daemon mds.j on smithi045 2024-09-15T22:13:30.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:29 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.100:6832/3112428521,v1:172.21.15.100:6833/3112428521] up:boot 2024-09-15T22:13:30.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:29 smithi165 ceph-mon[35551]: fsmap 2 up:standby 2024-09-15T22:13:30.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:29 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:13:30.886 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:30 smithi045 ceph-mon[31180]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:30.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:30 smithi100 ceph-mon[35319]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:31.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:30 smithi165 ceph-mon[35551]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:31.289 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:13:31 smithi045 systemd[1]: Starting Ceph mds.j for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:13:31.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:13:31.550 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:13:31 smithi045 podman[71069]: 2024-09-15 22:13:31.19051115 +0000 UTC m=+0.016540835 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:13:31.550 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:13:31 smithi045 podman[71069]: 2024-09-15 22:13:31.30275816 +0000 UTC m=+0.128787834 container create e7614a6af401a01c05634a533e4c1d92322fcc4d5aebb03bac4db421d9dd833e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-15T22:13:31.550 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:13:31 smithi045 podman[71069]: 2024-09-15 22:13:31.531187236 +0000 UTC m=+0.357216905 container init e7614a6af401a01c05634a533e4c1d92322fcc4d5aebb03bac4db421d9dd833e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:13:31.550 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:13:31 smithi045 podman[71069]: 2024-09-15 22:13:31.534740154 +0000 UTC m=+0.360769832 container start e7614a6af401a01c05634a533e4c1d92322fcc4d5aebb03bac4db421d9dd833e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-15T22:13:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:31.831 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:13:31 smithi045 ceph-mds[71117]: -- 172.21.15.45:0/3985765571 <== mon.0 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fe37ca3860 con 0x55fe37c80800 2024-09-15T22:13:31.831 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:13:31 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-j[71102]: starting mds.j at 2024-09-15T22:13:31.831 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:13:31 smithi045 bash[71069]: e7614a6af401a01c05634a533e4c1d92322fcc4d5aebb03bac4db421d9dd833e 2024-09-15T22:13:31.831 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:13:31 smithi045 systemd[1]: Started Ceph mds.j for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:13:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.185+0000 7f9397dac640 1 -- 172.21.15.45:0/2898020941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9390100b20 msgr2=0x7f9390100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.185+0000 7f9397dac640 1 --2- 172.21.15.45:0/2898020941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9390100b20 0x7f9390100f00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f938c009900 tx=0x7f938c02a410 comp rx=0 tx=0).stop 2024-09-15T22:13:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.185+0000 7f9397dac640 1 -- 172.21.15.45:0/2898020941 shutdown_connections 2024-09-15T22:13:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.185+0000 7f9397dac640 1 --2- 172.21.15.45:0/2898020941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f939010e500 0x7f9390110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.185+0000 7f9397dac640 1 --2- 172.21.15.45:0/2898020941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9390101440 0x7f939010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.185+0000 7f9397dac640 1 --2- 172.21.15.45:0/2898020941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9390100b20 0x7f9390100f00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.185+0000 7f9397dac640 1 -- 172.21.15.45:0/2898020941 >> 172.21.15.45:0/2898020941 conn(0x7f93900fc7d0 msgr2=0x7f93900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:32.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.185+0000 7f9397dac640 1 -- 172.21.15.45:0/2898020941 shutdown_connections 2024-09-15T22:13:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.185+0000 7f9397dac640 1 -- 172.21.15.45:0/2898020941 wait complete. 2024-09-15T22:13:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.185+0000 7f9397dac640 1 Processor -- start 2024-09-15T22:13:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.185+0000 7f9397dac640 1 -- start start 2024-09-15T22:13:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9397dac640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9390100b20 0x7f93901a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9397dac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9390101440 0x7f93901a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9397dac640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f939010e500 0x7f939019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9397dac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f93901143b0 con 0x7f9390101440 2024-09-15T22:13:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9397dac640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9390114230 con 0x7f939010e500 2024-09-15T22:13:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9397dac640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9390114530 con 0x7f9390100b20 2024-09-15T22:13:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9395347640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9390101440 0x7f93901a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9395347640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9390101440 0x7f93901a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33454/0 (socket says 172.21.15.45:33454) 2024-09-15T22:13:32.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9395347640 1 -- 172.21.15.45:0/1209078668 learned_addr learned my addr 172.21.15.45:0/1209078668 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9395b48640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9390100b20 0x7f93901a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9396349640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f939010e500 0x7f939019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9395347640 1 -- 172.21.15.45:0/1209078668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9390100b20 msgr2=0x7f93901a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9395347640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9390100b20 0x7f93901a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9395347640 1 -- 172.21.15.45:0/1209078668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f939010e500 msgr2=0x7f939019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9395347640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f939010e500 0x7f939019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9395347640 1 -- 172.21.15.45:0/1209078668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939019aed0 con 0x7f9390101440 2024-09-15T22:13:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9395347640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9390101440 0x7f93901a0ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f938000d770 tx=0x7f938000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.186+0000 7f9386ffd640 1 -- 172.21.15.45:0/1209078668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380017070 con 0x7f9390101440 2024-09-15T22:13:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.187+0000 7f9386ffd640 1 -- 172.21.15.45:0/1209078668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9380009c30 con 0x7f9390101440 2024-09-15T22:13:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.187+0000 7f9397dac640 1 -- 172.21.15.45:0/1209078668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939019b1c0 con 0x7f9390101440 2024-09-15T22:13:32.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.187+0000 7f9386ffd640 1 -- 172.21.15.45:0/1209078668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380003e40 con 0x7f9390101440 2024-09-15T22:13:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.187+0000 7f9397dac640 1 -- 172.21.15.45:0/1209078668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93901a7510 con 0x7f9390101440 2024-09-15T22:13:32.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.188+0000 7f9397dac640 1 -- 172.21.15.45:0/1209078668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f939019b530 con 0x7f9390101440 2024-09-15T22:13:32.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.189+0000 7f9386ffd640 1 -- 172.21.15.45:0/1209078668 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9380003fe0 con 0x7f9390101440 2024-09-15T22:13:32.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.189+0000 7f9386ffd640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f937c0a3240 0x7f937c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:32.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.189+0000 7f9395b48640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f937c0a3240 0x7f937c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:32.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.190+0000 7f9386ffd640 1 -- 172.21.15.45:0/1209078668 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f93800ced80 con 0x7f9390101440 2024-09-15T22:13:32.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.190+0000 7f9395b48640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f937c0a3240 0x7f937c0a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f938c009230 tx=0x7f938c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:32.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.194+0000 7f9386ffd640 1 -- 172.21.15.45:0/1209078668 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9380009de0 con 0x7f9390101440 2024-09-15T22:13:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.421+0000 7f9397dac640 1 -- 172.21.15.45:0/1209078668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f939019bb90 con 0x7f9390101440 2024-09-15T22:13:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.421+0000 7f9386ffd640 1 -- 172.21.15.45:0/1209078668 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f938009b8f0 con 0x7f9390101440 2024-09-15T22:13:32.424 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:32.424 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":4,"btime":"2024-09-15T22:13:31:718982+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:13:32.424 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 4 2024-09-15T22:13:32.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.423+0000 7f9397dac640 1 -- 172.21.15.45:0/1209078668 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f937c0a3240 msgr2=0x7f937c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:32.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.423+0000 7f9397dac640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f937c0a3240 0x7f937c0a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f938c009230 tx=0x7f938c0058d0 comp rx=0 tx=0).stop 2024-09-15T22:13:32.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.423+0000 7f9397dac640 1 -- 172.21.15.45:0/1209078668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9390101440 msgr2=0x7f93901a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:32.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.423+0000 7f9397dac640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9390101440 0x7f93901a0ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f938000d770 tx=0x7f938000dc30 comp rx=0 tx=0).stop 2024-09-15T22:13:32.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.423+0000 7f9397dac640 1 -- 172.21.15.45:0/1209078668 shutdown_connections 2024-09-15T22:13:32.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.423+0000 7f9397dac640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f937c0a3240 0x7f937c0a5700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:32.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.424+0000 7f9397dac640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f939010e500 0x7f939019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:32.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.424+0000 7f9397dac640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9390101440 0x7f93901a0ad0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:32.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.424+0000 7f9397dac640 1 --2- 172.21.15.45:0/1209078668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9390100b20 0x7f93901a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:32.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.424+0000 7f9397dac640 1 -- 172.21.15.45:0/1209078668 >> 172.21.15.45:0/1209078668 conn(0x7f93900fc7d0 msgr2=0x7f93900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:32.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.424+0000 7f9397dac640 1 -- 172.21.15.45:0/1209078668 shutdown_connections 2024-09-15T22:13:32.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:32.424+0000 7f9397dac640 1 -- 172.21.15.45:0/1209078668 wait complete. 2024-09-15T22:13:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:32 smithi165 ceph-mon[35551]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:32 smithi165 ceph-mon[35551]: Deploying daemon mds.d on smithi045 2024-09-15T22:13:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:32 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.45:6834/2368971397,v1:172.21.15.45:6835/2368971397] up:boot 2024-09-15T22:13:32.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:32 smithi165 ceph-mon[35551]: fsmap 3 up:standby 2024-09-15T22:13:32.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:32 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:13:32.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:32 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1209078668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:32.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:32 smithi100 ceph-mon[35319]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:32.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:32.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:32.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:32.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:32.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:32.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:32.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:32 smithi100 ceph-mon[35319]: Deploying daemon mds.d on smithi045 2024-09-15T22:13:32.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:32 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.45:6834/2368971397,v1:172.21.15.45:6835/2368971397] up:boot 2024-09-15T22:13:32.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:32 smithi100 ceph-mon[35319]: fsmap 3 up:standby 2024-09-15T22:13:32.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:32 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:13:32.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:32 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1209078668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:32 smithi045 ceph-mon[31180]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:33.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:33.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:32 smithi045 ceph-mon[31180]: Deploying daemon mds.d on smithi045 2024-09-15T22:13:33.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:32 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.45:6834/2368971397,v1:172.21.15.45:6835/2368971397] up:boot 2024-09-15T22:13:33.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:32 smithi045 ceph-mon[31180]: fsmap 3 up:standby 2024-09-15T22:13:33.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:32 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:13:33.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:32 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1209078668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:34.700 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:13:34 smithi045 systemd[1]: Starting Ceph mds.d for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:13:34.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:34 smithi165 ceph-mon[35551]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:34.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:34 smithi100 ceph-mon[35319]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:35.043 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:34 smithi045 ceph-mon[31180]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:35.043 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:13:34 smithi045 podman[71481]: 2024-09-15 22:13:34.656752944 +0000 UTC m=+0.016764870 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:13:35.043 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:13:34 smithi045 podman[71481]: 2024-09-15 22:13:34.763045914 +0000 UTC m=+0.123057870 container create 467840f2b6d70d383bbe8346a932f59dffec7808fd00914756752fd10ed56206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-15T22:13:35.044 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:13:35 smithi045 podman[71481]: 2024-09-15 22:13:35.041895045 +0000 UTC m=+0.401906959 container init 467840f2b6d70d383bbe8346a932f59dffec7808fd00914756752fd10ed56206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-09-15T22:13:35.164 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:13:35.300 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:13:35 smithi045 podman[71481]: 2024-09-15 22:13:35.045912073 +0000 UTC m=+0.405923995 container start 467840f2b6d70d383bbe8346a932f59dffec7808fd00914756752fd10ed56206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-15T22:13:35.300 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:13:35 smithi045 ceph-mds[71500]: -- 172.21.15.45:0/3796646608 <== mon.0 v2:172.21.15.45:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560ef9f83860 con 0x560ef9f61000 2024-09-15T22:13:35.300 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:13:35 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-d[71496]: starting mds.d at 2024-09-15T22:13:35.300 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:13:35 smithi045 bash[71481]: 467840f2b6d70d383bbe8346a932f59dffec7808fd00914756752fd10ed56206 2024-09-15T22:13:35.300 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:13:35 smithi045 systemd[1]: Started Ceph mds.d for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:13:35.428 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:35.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.937+0000 7fadef732640 1 -- 172.21.15.45:0/2118109697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fade8106f10 msgr2=0x7fade810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:35.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.937+0000 7fadef732640 1 --2- 172.21.15.45:0/2118109697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fade8106f10 0x7fade810ea90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fade0009ca0 tx=0x7fade002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:13:35.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.937+0000 7fadef732640 1 -- 172.21.15.45:0/2118109697 shutdown_connections 2024-09-15T22:13:35.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.937+0000 7fadef732640 1 --2- 172.21.15.45:0/2118109697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fade8106f10 0x7fade810ea90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:35.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.937+0000 7fadef732640 1 --2- 172.21.15.45:0/2118109697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fade8102790 0x7fade81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:35.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.937+0000 7fadef732640 1 --2- 172.21.15.45:0/2118109697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fade8101de0 0x7fade81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:35.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.937+0000 7fadef732640 1 -- 172.21.15.45:0/2118109697 >> 172.21.15.45:0/2118109697 conn(0x7fade80fd8c0 msgr2=0x7fade80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:35.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.937+0000 7fadef732640 1 -- 172.21.15.45:0/2118109697 shutdown_connections 2024-09-15T22:13:35.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.937+0000 7fadef732640 1 -- 172.21.15.45:0/2118109697 wait complete. 2024-09-15T22:13:35.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.937+0000 7fadef732640 1 Processor -- start 2024-09-15T22:13:35.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.937+0000 7fadef732640 1 -- start start 2024-09-15T22:13:35.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadef732640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fade8101de0 0x7fade80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:35.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadef732640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fade8102790 0x7fade8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:35.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadef732640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fade8106f10 0x7fade8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:35.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadef732640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fade8112090 con 0x7fade8102790 2024-09-15T22:13:35.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadef732640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fade8111f10 con 0x7fade8101de0 2024-09-15T22:13:35.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadef732640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fade8112210 con 0x7fade8106f10 2024-09-15T22:13:35.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadecccd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fade8102790 0x7fade8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:35.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadecccd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fade8102790 0x7fade8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35120/0 (socket says 172.21.15.45:35120) 2024-09-15T22:13:35.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadecccd640 1 -- 172.21.15.45:0/3772853791 learned_addr learned my addr 172.21.15.45:0/3772853791 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:35.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadedccf640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fade8106f10 0x7fade8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:35.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7faded4ce640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fade8101de0 0x7fade80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:35.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadecccd640 1 -- 172.21.15.45:0/3772853791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fade8106f10 msgr2=0x7fade8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:35.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadecccd640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fade8106f10 0x7fade8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:35.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadecccd640 1 -- 172.21.15.45:0/3772853791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fade8101de0 msgr2=0x7fade80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:35.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadecccd640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fade8101de0 0x7fade80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:35.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadecccd640 1 -- 172.21.15.45:0/3772853791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade81a6970 con 0x7fade8102790 2024-09-15T22:13:35.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadecccd640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fade8102790 0x7fade8074a30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fadd800d950 tx=0x7fadd800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:35.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadde7fc640 1 -- 172.21.15.45:0/3772853791 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8017030 con 0x7fade8102790 2024-09-15T22:13:35.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadde7fc640 1 -- 172.21.15.45:0/3772853791 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fadd8004020 con 0x7fade8102790 2024-09-15T22:13:35.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadef732640 1 -- 172.21.15.45:0/3772853791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade81a6c60 con 0x7fade8102790 2024-09-15T22:13:35.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadde7fc640 1 -- 172.21.15.45:0/3772853791 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8004a00 con 0x7fade8102790 2024-09-15T22:13:35.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.938+0000 7fadef732640 1 -- 172.21.15.45:0/3772853791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade81a71a0 con 0x7fade8102790 2024-09-15T22:13:35.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.940+0000 7fadef732640 1 -- 172.21.15.45:0/3772853791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade81021c0 con 0x7fade8102790 2024-09-15T22:13:35.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.941+0000 7fadde7fc640 1 -- 172.21.15.45:0/3772853791 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fadd80041d0 con 0x7fade8102790 2024-09-15T22:13:35.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.941+0000 7fadde7fc640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fadd40a32c0 0x7fadd40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:35.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.942+0000 7faded4ce640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fadd40a32c0 0x7fadd40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:35.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.942+0000 7fadde7fc640 1 -- 172.21.15.45:0/3772853791 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fadd80cf480 con 0x7fade8102790 2024-09-15T22:13:35.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.942+0000 7faded4ce640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fadd40a32c0 0x7fadd40a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fade4005fd0 tx=0x7fade4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:35.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:35.945+0000 7fadde7fc640 1 -- 172.21.15.45:0/3772853791 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fadd809c6c0 con 0x7fade8102790 2024-09-15T22:13:36.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.155+0000 7fadef732640 1 -- 172.21.15.45:0/3772853791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fade8075a20 con 0x7fade8102790 2024-09-15T22:13:36.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.156+0000 7fadde7fc640 1 -- 172.21.15.45:0/3772853791 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7fade8075a20 con 0x7fade8102790 2024-09-15T22:13:36.158 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:36.158 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":5,"btime":"2024-09-15T22:13:35:699318+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:13:36.159 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 5 2024-09-15T22:13:36.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.158+0000 7fadef732640 1 -- 172.21.15.45:0/3772853791 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fadd40a32c0 msgr2=0x7fadd40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:36.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.158+0000 7fadef732640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fadd40a32c0 0x7fadd40a5780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fade4005fd0 tx=0x7fade4005850 comp rx=0 tx=0).stop 2024-09-15T22:13:36.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.158+0000 7fadef732640 1 -- 172.21.15.45:0/3772853791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fade8102790 msgr2=0x7fade8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:36.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.158+0000 7fadef732640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fade8102790 0x7fade8074a30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fadd800d950 tx=0x7fadd800de10 comp rx=0 tx=0).stop 2024-09-15T22:13:36.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.158+0000 7fadef732640 1 -- 172.21.15.45:0/3772853791 shutdown_connections 2024-09-15T22:13:36.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.158+0000 7fadef732640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fadd40a32c0 0x7fadd40a5780 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:36.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.158+0000 7fadef732640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fade8106f10 0x7fade8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:36.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.158+0000 7fadef732640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fade8102790 0x7fade8074a30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:36.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.158+0000 7fadef732640 1 --2- 172.21.15.45:0/3772853791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fade8101de0 0x7fade80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:36.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.158+0000 7fadef732640 1 -- 172.21.15.45:0/3772853791 >> 172.21.15.45:0/3772853791 conn(0x7fade80fd8c0 msgr2=0x7fade80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:36.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.158+0000 7fadef732640 1 -- 172.21.15.45:0/3772853791 shutdown_connections 2024-09-15T22:13:36.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:36.158+0000 7fadef732640 1 -- 172.21.15.45:0/3772853791 wait complete. 2024-09-15T22:13:36.476 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:36.477 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:36.477 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:36.477 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:36.477 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:36.477 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:36.477 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:36 smithi045 ceph-mon[31180]: Deploying daemon mds.e on smithi100 2024-09-15T22:13:36.477 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:36 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.45:6836/378260478,v1:172.21.15.45:6837/378260478] up:boot 2024-09-15T22:13:36.477 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:36 smithi045 ceph-mon[31180]: fsmap 4 up:standby 2024-09-15T22:13:36.477 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:36 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:13:36.477 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:36 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3772853791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:36 smithi165 ceph-mon[35551]: Deploying daemon mds.e on smithi100 2024-09-15T22:13:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:36 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.45:6836/378260478,v1:172.21.15.45:6837/378260478] up:boot 2024-09-15T22:13:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:36 smithi165 ceph-mon[35551]: fsmap 4 up:standby 2024-09-15T22:13:36.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:36 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:13:36.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:36 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3772853791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:36.738 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:36.739 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:36.739 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:36.739 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:36.739 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:36.739 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:36.739 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:36 smithi100 ceph-mon[35319]: Deploying daemon mds.e on smithi100 2024-09-15T22:13:36.739 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:36 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.45:6836/378260478,v1:172.21.15.45:6837/378260478] up:boot 2024-09-15T22:13:36.739 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:36 smithi100 ceph-mon[35319]: fsmap 4 up:standby 2024-09-15T22:13:36.739 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:36 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:13:36.739 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:36 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3772853791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:37.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:37 smithi100 ceph-mon[35319]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:37.495 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:13:37 smithi100 systemd[1]: Starting Ceph mds.e for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:13:37.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:37 smithi045 ceph-mon[31180]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:37.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:37 smithi165 ceph-mon[35551]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:37.841 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:13:37 smithi100 podman[64748]: 2024-09-15 22:13:37.462623712 +0000 UTC m=+0.016221236 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:13:37.841 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:13:37 smithi100 podman[64748]: 2024-09-15 22:13:37.587415457 +0000 UTC m=+0.141012965 container create 4d9d404d9948e80752808551312b06637bd954c34405736844873fd21d186987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:13:37.841 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:13:37 smithi100 podman[64748]: 2024-09-15 22:13:37.840118596 +0000 UTC m=+0.393716104 container init 4d9d404d9948e80752808551312b06637bd954c34405736844873fd21d186987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-15T22:13:38.244 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:13:37 smithi100 podman[64748]: 2024-09-15 22:13:37.843266695 +0000 UTC m=+0.396864204 container start 4d9d404d9948e80752808551312b06637bd954c34405736844873fd21d186987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-15T22:13:38.244 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:13:37 smithi100 ceph-mds[64766]: -- 172.21.15.100:0/3434771197 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55daafabf860 con 0x55daafa9c800 2024-09-15T22:13:38.244 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:13:37 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-e[64762]: starting mds.e at 2024-09-15T22:13:38.244 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:13:37 smithi100 bash[64748]: 4d9d404d9948e80752808551312b06637bd954c34405736844873fd21d186987 2024-09-15T22:13:38.245 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:13:37 smithi100 systemd[1]: Started Ceph mds.e for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:13:38.923 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:13:39.195 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:39.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:38 smithi100 ceph-mon[35319]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:39.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:39.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:39.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:39.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:39.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:39.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:39.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:38 smithi100 ceph-mon[35319]: Deploying daemon mds.f on smithi165 2024-09-15T22:13:39.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:38 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.100:6834/1950215908,v1:172.21.15.100:6835/1950215908] up:boot 2024-09-15T22:13:39.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:38 smithi100 ceph-mon[35319]: fsmap 5 up:standby 2024-09-15T22:13:39.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:38 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:13:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:38 smithi045 ceph-mon[31180]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:39.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:38 smithi045 ceph-mon[31180]: Deploying daemon mds.f on smithi165 2024-09-15T22:13:39.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:38 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.100:6834/1950215908,v1:172.21.15.100:6835/1950215908] up:boot 2024-09-15T22:13:39.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:38 smithi045 ceph-mon[31180]: fsmap 5 up:standby 2024-09-15T22:13:39.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:38 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:13:39.449 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:38 smithi165 ceph-mon[35551]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:39.449 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:39.449 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:39.449 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:39.449 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:39.449 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:39.449 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:39.449 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:38 smithi165 ceph-mon[35551]: Deploying daemon mds.f on smithi165 2024-09-15T22:13:39.449 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:38 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.100:6834/1950215908,v1:172.21.15.100:6835/1950215908] up:boot 2024-09-15T22:13:39.449 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:38 smithi165 ceph-mon[35551]: fsmap 5 up:standby 2024-09-15T22:13:39.449 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:38 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:13:39.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.679+0000 7f28a3fc6640 1 -- 172.21.15.45:0/228412894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c102b50 msgr2=0x7f289c100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:39.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.679+0000 7f28a3fc6640 1 --2- 172.21.15.45:0/228412894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c102b50 0x7f289c100090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2898009900 tx=0x7f289802a400 comp rx=0 tx=0).stop 2024-09-15T22:13:39.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.679+0000 7f28a3fc6640 1 -- 172.21.15.45:0/228412894 shutdown_connections 2024-09-15T22:13:39.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.679+0000 7f28a3fc6640 1 --2- 172.21.15.45:0/228412894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f289c10e810 0x7f289c110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:39.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.679+0000 7f28a3fc6640 1 --2- 172.21.15.45:0/228412894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f289c102fc0 0x7f289c1005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:39.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.679+0000 7f28a3fc6640 1 --2- 172.21.15.45:0/228412894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c102b50 0x7f289c100090 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:39.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.679+0000 7f28a3fc6640 1 -- 172.21.15.45:0/228412894 >> 172.21.15.45:0/228412894 conn(0x7f289c077210 msgr2=0x7f289c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:39.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.679+0000 7f28a3fc6640 1 -- 172.21.15.45:0/228412894 shutdown_connections 2024-09-15T22:13:39.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.679+0000 7f28a3fc6640 1 -- 172.21.15.45:0/228412894 wait complete. 2024-09-15T22:13:39.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.680+0000 7f28a3fc6640 1 Processor -- start 2024-09-15T22:13:39.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.680+0000 7f28a3fc6640 1 -- start start 2024-09-15T22:13:39.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.680+0000 7f28a3fc6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f289c102b50 0x7f289c1a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:39.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.680+0000 7f28a3fc6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f289c10e810 0x7f289c1a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:39.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.680+0000 7f28a3fc6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c19a5a0 0x7f289c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:39.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.680+0000 7f28a3fc6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f289c114310 con 0x7f289c19a5a0 2024-09-15T22:13:39.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.680+0000 7f28a3fc6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f289c114190 con 0x7f289c10e810 2024-09-15T22:13:39.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.680+0000 7f28a3fc6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f289c114490 con 0x7f289c102b50 2024-09-15T22:13:39.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.680+0000 7f28a2563640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c19a5a0 0x7f289c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:39.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.680+0000 7f28a1d62640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f289c102b50 0x7f289c1a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:39.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.680+0000 7f28a2563640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c19a5a0 0x7f289c19aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35148/0 (socket says 172.21.15.45:35148) 2024-09-15T22:13:39.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.680+0000 7f28a2563640 1 -- 172.21.15.45:0/1162864083 learned_addr learned my addr 172.21.15.45:0/1162864083 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:39.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.681+0000 7f28a1561640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f289c10e810 0x7f289c1a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:39.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.681+0000 7f28a2563640 1 -- 172.21.15.45:0/1162864083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f289c102b50 msgr2=0x7f289c1a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:39.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.681+0000 7f28a2563640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f289c102b50 0x7f289c1a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:39.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.681+0000 7f28a2563640 1 -- 172.21.15.45:0/1162864083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f289c10e810 msgr2=0x7f289c1a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:39.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.681+0000 7f28a2563640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f289c10e810 0x7f289c1a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:39.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.681+0000 7f28a2563640 1 -- 172.21.15.45:0/1162864083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289c19b0c0 con 0x7f289c19a5a0 2024-09-15T22:13:39.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.681+0000 7f28a1561640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f289c10e810 0x7f289c1a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:13:39.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.681+0000 7f28a2563640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c19a5a0 0x7f289c19aa50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f289400cad0 tx=0x7f289400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:39.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.681+0000 7f2892ffd640 1 -- 172.21.15.45:0/1162864083 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289400ae20 con 0x7f289c19a5a0 2024-09-15T22:13:39.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.681+0000 7f2892ffd640 1 -- 172.21.15.45:0/1162864083 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2894004b20 con 0x7f289c19a5a0 2024-09-15T22:13:39.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.681+0000 7f2892ffd640 1 -- 172.21.15.45:0/1162864083 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289400f780 con 0x7f289c19a5a0 2024-09-15T22:13:39.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.681+0000 7f28a3fc6640 1 -- 172.21.15.45:0/1162864083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289c19b3b0 con 0x7f289c19a5a0 2024-09-15T22:13:39.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.681+0000 7f28a3fc6640 1 -- 172.21.15.45:0/1162864083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f289c1a75f0 con 0x7f289c19a5a0 2024-09-15T22:13:39.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.682+0000 7f28a3fc6640 1 -- 172.21.15.45:0/1162864083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f289c100090 con 0x7f289c19a5a0 2024-09-15T22:13:39.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.683+0000 7f2892ffd640 1 -- 172.21.15.45:0/1162864083 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2894004cd0 con 0x7f289c19a5a0 2024-09-15T22:13:39.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.684+0000 7f2892ffd640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f28880a32f0 0x7f28880a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:39.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.684+0000 7f28a1d62640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f28880a32f0 0x7f28880a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:39.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.684+0000 7f2892ffd640 1 -- 172.21.15.45:0/1162864083 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f28940cf440 con 0x7f289c19a5a0 2024-09-15T22:13:39.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.685+0000 7f28a1d62640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f28880a32f0 0x7f28880a57b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2898009230 tx=0x7f28980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:39.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.688+0000 7f2892ffd640 1 -- 172.21.15.45:0/1162864083 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2894014030 con 0x7f289c19a5a0 2024-09-15T22:13:39.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.900+0000 7f28a3fc6640 1 -- 172.21.15.45:0/1162864083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f289c1030c0 con 0x7f289c19a5a0 2024-09-15T22:13:39.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.901+0000 7f2892ffd640 1 -- 172.21.15.45:0/1162864083 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4741 (secure 0 0 0) 0x7f289409c600 con 0x7f289c19a5a0 2024-09-15T22:13:39.903 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:39.903 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":6,"btime":"2024-09-15T22:13:38:285346+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-15T22:13:39.903 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 6 2024-09-15T22:13:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.904+0000 7f28a3fc6640 1 -- 172.21.15.45:0/1162864083 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f28880a32f0 msgr2=0x7f28880a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.904+0000 7f28a3fc6640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f28880a32f0 0x7f28880a57b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2898009230 tx=0x7f28980058d0 comp rx=0 tx=0).stop 2024-09-15T22:13:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.904+0000 7f28a3fc6640 1 -- 172.21.15.45:0/1162864083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c19a5a0 msgr2=0x7f289c19aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.904+0000 7f28a3fc6640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c19a5a0 0x7f289c19aa50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f289400cad0 tx=0x7f289400cf90 comp rx=0 tx=0).stop 2024-09-15T22:13:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.904+0000 7f28a3fc6640 1 -- 172.21.15.45:0/1162864083 shutdown_connections 2024-09-15T22:13:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.904+0000 7f28a3fc6640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f28880a32f0 0x7f28880a57b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.904+0000 7f28a3fc6640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f289c19a5a0 0x7f289c19aa50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.904+0000 7f28a3fc6640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f289c10e810 0x7f289c1a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.904+0000 7f28a3fc6640 1 --2- 172.21.15.45:0/1162864083 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f289c102b50 0x7f289c1a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.904+0000 7f28a3fc6640 1 -- 172.21.15.45:0/1162864083 >> 172.21.15.45:0/1162864083 conn(0x7f289c077210 msgr2=0x7f289c10fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.904+0000 7f28a3fc6640 1 -- 172.21.15.45:0/1162864083 shutdown_connections 2024-09-15T22:13:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:39.904+0000 7f28a3fc6640 1 -- 172.21.15.45:0/1162864083 wait complete. 2024-09-15T22:13:40.000 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:13:39 smithi165 systemd[1]: Starting Ceph mds.f for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:13:40.259 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:39 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1162864083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:40.259 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:13:40 smithi165 podman[65674]: 2024-09-15 22:13:40.041929054 +0000 UTC m=+0.016034028 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:13:40.260 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:13:40 smithi165 podman[65674]: 2024-09-15 22:13:40.158519817 +0000 UTC m=+0.132624788 container create f5cdd361da5a62f728d201ffe74ebd7911e2b9d07f2508778aa892a158721293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-15T22:13:40.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:39 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1162864083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:40.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:39 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1162864083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:40.714 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:13:40 smithi165 podman[65674]: 2024-09-15 22:13:40.369936289 +0000 UTC m=+0.344041261 container init f5cdd361da5a62f728d201ffe74ebd7911e2b9d07f2508778aa892a158721293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:13:40.715 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:13:40 smithi165 podman[65674]: 2024-09-15 22:13:40.372856857 +0000 UTC m=+0.346961828 container start f5cdd361da5a62f728d201ffe74ebd7911e2b9d07f2508778aa892a158721293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-09-15T22:13:40.715 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:13:40 smithi165 ceph-mds[65693]: -- 172.21.15.165:0/2087569214 <== mon.1 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d6cefdf860 con 0x55d6cefbd400 2024-09-15T22:13:40.715 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:13:40 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-f[65689]: starting mds.f at 2024-09-15T22:13:40.715 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:13:40 smithi165 bash[65674]: f5cdd361da5a62f728d201ffe74ebd7911e2b9d07f2508778aa892a158721293 2024-09-15T22:13:40.715 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:13:40 smithi165 systemd[1]: Started Ceph mds.f for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:13:41.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:41 smithi165 ceph-mon[35551]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:41.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:41 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:41.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:41 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:41.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:41 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:41.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:41 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:41.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:41 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:41.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:41 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:41.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:41 smithi045 ceph-mon[31180]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:41.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:41 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:41.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:41 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:41.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:41 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:41.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:41 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:41.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:41 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:41.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:41 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:41 smithi100 ceph-mon[35319]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:41 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:41 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:41 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:41 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:41 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:41 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:42.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:42 smithi045 ceph-mon[31180]: Deploying daemon mds.c on smithi165 2024-09-15T22:13:42.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:42 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.165:6834/2608811330,v1:172.21.15.165:6835/2608811330] up:boot 2024-09-15T22:13:42.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:42 smithi045 ceph-mon[31180]: fsmap 6 up:standby 2024-09-15T22:13:42.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:42 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:13:42.341 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:42 smithi165 ceph-mon[35551]: Deploying daemon mds.c on smithi165 2024-09-15T22:13:42.341 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:42 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.165:6834/2608811330,v1:172.21.15.165:6835/2608811330] up:boot 2024-09-15T22:13:42.341 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:42 smithi165 ceph-mon[35551]: fsmap 6 up:standby 2024-09-15T22:13:42.341 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:42 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:13:42.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:42 smithi100 ceph-mon[35319]: Deploying daemon mds.c on smithi165 2024-09-15T22:13:42.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:42 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.165:6834/2608811330,v1:172.21.15.165:6835/2608811330] up:boot 2024-09-15T22:13:42.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:42 smithi100 ceph-mon[35319]: fsmap 6 up:standby 2024-09-15T22:13:42.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:42 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:13:42.541 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:13:42.714 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:13:42 smithi165 systemd[1]: Starting Ceph mds.c for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:13:42.816 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:43.011 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:13:42 smithi165 podman[65974]: 2024-09-15 22:13:42.643897376 +0000 UTC m=+0.015498856 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:13:43.011 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:13:42 smithi165 podman[65974]: 2024-09-15 22:13:42.772116846 +0000 UTC m=+0.143718325 container create 0b145dea67f6deb2649c1520e0ab8cafe0e9efe948cb0eaa036c9a39c99fbd35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-c, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:13:43.103 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:43 smithi045 ceph-mon[31180]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:43.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.278+0000 7f076bc48640 1 -- 172.21.15.45:0/769784975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0764102ef0 msgr2=0x7f076410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.278+0000 7f076bc48640 1 --2- 172.21.15.45:0/769784975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0764102ef0 0x7f076410da40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f075c009ca0 tx=0x7f075c02a950 comp rx=0 tx=0).stop 2024-09-15T22:13:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.278+0000 7f076bc48640 1 -- 172.21.15.45:0/769784975 shutdown_connections 2024-09-15T22:13:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.278+0000 7f076bc48640 1 --2- 172.21.15.45:0/769784975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0764102ef0 0x7f076410da40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.278+0000 7f076bc48640 1 --2- 172.21.15.45:0/769784975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0764102570 0x7f07641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.278+0000 7f076bc48640 1 --2- 172.21.15.45:0/769784975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0764100e20 0x7f0764101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.278+0000 7f076bc48640 1 -- 172.21.15.45:0/769784975 >> 172.21.15.45:0/769784975 conn(0x7f07640fc7d0 msgr2=0x7f07640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.278+0000 7f076bc48640 1 -- 172.21.15.45:0/769784975 shutdown_connections 2024-09-15T22:13:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.278+0000 7f076bc48640 1 -- 172.21.15.45:0/769784975 wait complete. 2024-09-15T22:13:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.278+0000 7f076bc48640 1 Processor -- start 2024-09-15T22:13:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076bc48640 1 -- start start 2024-09-15T22:13:43.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076bc48640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0764100e20 0x7f07641993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076bc48640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0764102570 0x7f0764199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076bc48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0764102ef0 0x7f07641a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076bc48640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f07641110a0 con 0x7f0764102ef0 2024-09-15T22:13:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076bc48640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0764110f20 con 0x7f0764100e20 2024-09-15T22:13:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076bc48640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0764111220 con 0x7f0764102570 2024-09-15T22:13:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076a1e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0764102ef0 0x7f07641a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076a1e5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0764102ef0 0x7f07641a4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35174/0 (socket says 172.21.15.45:35174) 2024-09-15T22:13:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076a1e5640 1 -- 172.21.15.45:0/3268767894 learned_addr learned my addr 172.21.15.45:0/3268767894 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f07699e4640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0764100e20 0x7f07641993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f07691e3640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0764102570 0x7f0764199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076a1e5640 1 -- 172.21.15.45:0/3268767894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0764102570 msgr2=0x7f0764199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:43.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076a1e5640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0764102570 0x7f0764199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076a1e5640 1 -- 172.21.15.45:0/3268767894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0764100e20 msgr2=0x7f07641993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076a1e5640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0764100e20 0x7f07641993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.279+0000 7f076a1e5640 1 -- 172.21.15.45:0/3268767894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07641a49b0 con 0x7f0764102ef0 2024-09-15T22:13:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.280+0000 7f076a1e5640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0764102ef0 0x7f07641a4470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f075c005cc0 tx=0x7f075c02f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.280+0000 7f075affd640 1 -- 172.21.15.45:0/3268767894 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075c034040 con 0x7f0764102ef0 2024-09-15T22:13:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.280+0000 7f075affd640 1 -- 172.21.15.45:0/3268767894 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f075c030940 con 0x7f0764102ef0 2024-09-15T22:13:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.280+0000 7f075affd640 1 -- 172.21.15.45:0/3268767894 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075c0456e0 con 0x7f0764102ef0 2024-09-15T22:13:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.280+0000 7f076bc48640 1 -- 172.21.15.45:0/3268767894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07641a4b80 con 0x7f0764102ef0 2024-09-15T22:13:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.280+0000 7f076bc48640 1 -- 172.21.15.45:0/3268767894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07641a4f80 con 0x7f0764102ef0 2024-09-15T22:13:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.281+0000 7f076bc48640 1 -- 172.21.15.45:0/3268767894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0764101200 con 0x7f0764102ef0 2024-09-15T22:13:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.282+0000 7f075affd640 1 -- 172.21.15.45:0/3268767894 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f075c037020 con 0x7f0764102ef0 2024-09-15T22:13:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.283+0000 7f075affd640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f07500a3240 0x7f07500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:43.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.283+0000 7f075affd640 1 -- 172.21.15.45:0/3268767894 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f075c0f03a0 con 0x7f0764102ef0 2024-09-15T22:13:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.283+0000 7f07699e4640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f07500a3240 0x7f07500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.283+0000 7f07699e4640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f07500a3240 0x7f07500a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0760005d00 tx=0x7f076000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:43.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.286+0000 7f075affd640 1 -- 172.21.15.45:0/3268767894 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f075c0bd5f0 con 0x7f0764102ef0 2024-09-15T22:13:43.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:43 smithi165 ceph-mon[35551]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:43.465 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:13:43 smithi165 podman[65974]: 2024-09-15 22:13:43.024766537 +0000 UTC m=+0.396368017 container init 0b145dea67f6deb2649c1520e0ab8cafe0e9efe948cb0eaa036c9a39c99fbd35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-15T22:13:43.465 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:13:43 smithi165 podman[65974]: 2024-09-15 22:13:43.027695455 +0000 UTC m=+0.399296943 container start 0b145dea67f6deb2649c1520e0ab8cafe0e9efe948cb0eaa036c9a39c99fbd35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-15T22:13:43.465 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:13:43 smithi165 ceph-mds[65993]: -- 172.21.15.165:0/1740357506 <== mon.1 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564b79fc9860 con 0x564b79fa6800 2024-09-15T22:13:43.465 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:13:43 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-c[65989]: starting mds.c at 2024-09-15T22:13:43.465 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:13:43 smithi165 bash[65974]: 0b145dea67f6deb2649c1520e0ab8cafe0e9efe948cb0eaa036c9a39c99fbd35 2024-09-15T22:13:43.465 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:13:43 smithi165 systemd[1]: Started Ceph mds.c for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:13:43.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:43 smithi100 ceph-mon[35319]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:43.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.500+0000 7f076bc48640 1 -- 172.21.15.45:0/3268767894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07641a5270 con 0x7f0764102ef0 2024-09-15T22:13:43.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.500+0000 7f075affd640 1 -- 172.21.15.45:0/3268767894 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5569 (secure 0 0 0) 0x7f075c0bcef0 con 0x7f0764102ef0 2024-09-15T22:13:43.503 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:43.503 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":7,"btime":"2024-09-15T22:13:40:996060+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-15T22:13:43.503 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 7 2024-09-15T22:13:43.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.503+0000 7f076bc48640 1 -- 172.21.15.45:0/3268767894 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f07500a3240 msgr2=0x7f07500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.503+0000 7f076bc48640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f07500a3240 0x7f07500a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0760005d00 tx=0x7f076000b410 comp rx=0 tx=0).stop 2024-09-15T22:13:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.503+0000 7f076bc48640 1 -- 172.21.15.45:0/3268767894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0764102ef0 msgr2=0x7f07641a4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.503+0000 7f076bc48640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0764102ef0 0x7f07641a4470 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f075c005cc0 tx=0x7f075c02f790 comp rx=0 tx=0).stop 2024-09-15T22:13:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.503+0000 7f076bc48640 1 -- 172.21.15.45:0/3268767894 shutdown_connections 2024-09-15T22:13:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.503+0000 7f076bc48640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f07500a3240 0x7f07500a5700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.503+0000 7f076bc48640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0764102ef0 0x7f07641a4470 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.503+0000 7f076bc48640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0764102570 0x7f0764199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.503+0000 7f076bc48640 1 --2- 172.21.15.45:0/3268767894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0764100e20 0x7f07641993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.503+0000 7f076bc48640 1 -- 172.21.15.45:0/3268767894 >> 172.21.15.45:0/3268767894 conn(0x7f07640fc7d0 msgr2=0x7f0764106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.503+0000 7f076bc48640 1 -- 172.21.15.45:0/3268767894 shutdown_connections 2024-09-15T22:13:43.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:43.503+0000 7f076bc48640 1 -- 172.21.15.45:0/3268767894 wait complete. 2024-09-15T22:13:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:44.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:44.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:44.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:44 smithi165 ceph-mon[35551]: Deploying daemon mds.h on smithi100 2024-09-15T22:13:44.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:44 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3268767894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:44.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:44 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.165:6836/1072928476,v1:172.21.15.165:6837/1072928476] up:boot 2024-09-15T22:13:44.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:44 smithi165 ceph-mon[35551]: fsmap 7 up:standby 2024-09-15T22:13:44.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:44 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:13:44.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:44.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:44.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:44.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:44.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:44.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:44.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:44 smithi100 ceph-mon[35319]: Deploying daemon mds.h on smithi100 2024-09-15T22:13:44.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:44 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3268767894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:44.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:44 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.165:6836/1072928476,v1:172.21.15.165:6837/1072928476] up:boot 2024-09-15T22:13:44.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:44 smithi100 ceph-mon[35319]: fsmap 7 up:standby 2024-09-15T22:13:44.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:44 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:13:44.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:44.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:44.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:44.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:44.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:44.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:44.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:44 smithi045 ceph-mon[31180]: Deploying daemon mds.h on smithi100 2024-09-15T22:13:44.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:44 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3268767894' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:44.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:44 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.165:6836/1072928476,v1:172.21.15.165:6837/1072928476] up:boot 2024-09-15T22:13:44.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:44 smithi045 ceph-mon[31180]: fsmap 7 up:standby 2024-09-15T22:13:44.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:44 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:13:45.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:45 smithi165 ceph-mon[35551]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:45.481 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:45 smithi100 ceph-mon[35319]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:45.482 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:13:45 smithi100 systemd[1]: Starting Ceph mds.h for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:13:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:45 smithi045 ceph-mon[31180]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:45.744 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:13:45 smithi100 podman[65050]: 2024-09-15 22:13:45.383057444 +0000 UTC m=+0.016009759 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:13:45.745 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:13:45 smithi100 podman[65050]: 2024-09-15 22:13:45.501745525 +0000 UTC m=+0.134697840 container create 2da772e7e96491b8b8e38af50f8208a70777e608a27f39ab39420cd4d9ed2267 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-h, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-15T22:13:46.206 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:13:46.244 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:13:45 smithi100 podman[65050]: 2024-09-15 22:13:45.754637783 +0000 UTC m=+0.387590098 container init 2da772e7e96491b8b8e38af50f8208a70777e608a27f39ab39420cd4d9ed2267 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-h, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:13:46.244 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:13:45 smithi100 podman[65050]: 2024-09-15 22:13:45.757552335 +0000 UTC m=+0.390504649 container start 2da772e7e96491b8b8e38af50f8208a70777e608a27f39ab39420cd4d9ed2267 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-h, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-15T22:13:46.244 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:13:45 smithi100 ceph-mds[65070]: -- 172.21.15.100:0/613266750 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55569ea53860 con 0x55569ea31000 2024-09-15T22:13:46.244 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:13:45 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-h[65066]: starting mds.h at 2024-09-15T22:13:46.245 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:13:45 smithi100 bash[65050]: 2da772e7e96491b8b8e38af50f8208a70777e608a27f39ab39420cd4d9ed2267 2024-09-15T22:13:46.245 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:13:45 smithi100 systemd[1]: Started Ceph mds.h for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:13:46.477 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:46 smithi165 ceph-mon[35551]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:46 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:46 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:46 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:46 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:46 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:46 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:46 smithi165 ceph-mon[35551]: Deploying daemon mds.i on smithi165 2024-09-15T22:13:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:46 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.100:6836/864108145,v1:172.21.15.100:6837/864108145] up:boot 2024-09-15T22:13:46.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:46 smithi165 ceph-mon[35551]: fsmap 8 up:standby 2024-09-15T22:13:46.966 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:46 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:13:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.974+0000 7f5fa413e640 1 -- 172.21.15.45:0/1021651028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f9c106f10 msgr2=0x7f5f9c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.974+0000 7f5fa413e640 1 --2- 172.21.15.45:0/1021651028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f9c106f10 0x7f5f9c10ea90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c009900 tx=0x7f5f8c02a410 comp rx=0 tx=0).stop 2024-09-15T22:13:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.974+0000 7f5fa413e640 1 -- 172.21.15.45:0/1021651028 shutdown_connections 2024-09-15T22:13:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.974+0000 7f5fa413e640 1 --2- 172.21.15.45:0/1021651028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f9c106f10 0x7f5f9c10ea90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.974+0000 7f5fa413e640 1 --2- 172.21.15.45:0/1021651028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f9c102790 0x7f5f9c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.974+0000 7f5fa413e640 1 --2- 172.21.15.45:0/1021651028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f9c101de0 0x7f5f9c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.974+0000 7f5fa413e640 1 -- 172.21.15.45:0/1021651028 >> 172.21.15.45:0/1021651028 conn(0x7f5f9c0fd8c0 msgr2=0x7f5f9c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.974+0000 7f5fa413e640 1 -- 172.21.15.45:0/1021651028 shutdown_connections 2024-09-15T22:13:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.974+0000 7f5fa413e640 1 -- 172.21.15.45:0/1021651028 wait complete. 2024-09-15T22:13:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.975+0000 7f5fa413e640 1 Processor -- start 2024-09-15T22:13:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.975+0000 7f5fa413e640 1 -- start start 2024-09-15T22:13:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.975+0000 7f5fa413e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f9c101de0 0x7f5f9c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.975+0000 7f5fa413e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f9c102790 0x7f5f9c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.975+0000 7f5fa413e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f9c106f10 0x7f5f9c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.975+0000 7f5fa413e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c112090 con 0x7f5f9c101de0 2024-09-15T22:13:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.975+0000 7f5fa413e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c111f10 con 0x7f5f9c106f10 2024-09-15T22:13:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.975+0000 7f5fa413e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c112210 con 0x7f5f9c102790 2024-09-15T22:13:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.975+0000 7f5fa1eda640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f9c101de0 0x7f5f9c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.975+0000 7f5fa1eda640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f9c101de0 0x7f5f9c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38182/0 (socket says 172.21.15.45:38182) 2024-09-15T22:13:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.975+0000 7f5fa1eda640 1 -- 172.21.15.45:0/869302043 learned_addr learned my addr 172.21.15.45:0/869302043 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5fa26db640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f9c106f10 0x7f5f9c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5fa16d9640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f9c102790 0x7f5f9c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5fa1eda640 1 -- 172.21.15.45:0/869302043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f9c102790 msgr2=0x7f5f9c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5fa1eda640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f9c102790 0x7f5f9c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5fa1eda640 1 -- 172.21.15.45:0/869302043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f9c106f10 msgr2=0x7f5f9c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5fa1eda640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f9c106f10 0x7f5f9c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5fa1eda640 1 -- 172.21.15.45:0/869302043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c1a6910 con 0x7f5f9c101de0 2024-09-15T22:13:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5fa16d9640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f9c102790 0x7f5f9c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:13:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5fa1eda640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f9c101de0 0x7f5f9c0744f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400cce0 tx=0x7f5f9400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5f9affd640 1 -- 172.21.15.45:0/869302043 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9400f650 con 0x7f5f9c101de0 2024-09-15T22:13:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5f9affd640 1 -- 172.21.15.45:0/869302043 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f9400fcf0 con 0x7f5f9c101de0 2024-09-15T22:13:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5fa413e640 1 -- 172.21.15.45:0/869302043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9c1a6c00 con 0x7f5f9c101de0 2024-09-15T22:13:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5f9affd640 1 -- 172.21.15.45:0/869302043 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94018d20 con 0x7f5f9c101de0 2024-09-15T22:13:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.976+0000 7f5fa413e640 1 -- 172.21.15.45:0/869302043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f9c1a7140 con 0x7f5f9c101de0 2024-09-15T22:13:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.977+0000 7f5fa413e640 1 -- 172.21.15.45:0/869302043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9c1021c0 con 0x7f5f9c101de0 2024-09-15T22:13:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.978+0000 7f5f9affd640 1 -- 172.21.15.45:0/869302043 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5f9400f7f0 con 0x7f5f9c101de0 2024-09-15T22:13:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.979+0000 7f5f9affd640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f5f840a3240 0x7f5f840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.979+0000 7f5fa16d9640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f5f840a3240 0x7f5f840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.979+0000 7f5f9affd640 1 -- 172.21.15.45:0/869302043 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f5f940cf9d0 con 0x7f5f9c101de0 2024-09-15T22:13:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.979+0000 7f5fa16d9640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f5f840a3240 0x7f5f840a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c075f80 tx=0x7f5f90005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:46.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:46.983+0000 7f5f9affd640 1 -- 172.21.15.45:0/869302043 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5f94014030 con 0x7f5f9c101de0 2024-09-15T22:13:47.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.196+0000 7f5fa413e640 1 -- 172.21.15.45:0/869302043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f9c109b60 con 0x7f5f9c101de0 2024-09-15T22:13:47.198 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:46 smithi045 ceph-mon[31180]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:47.199 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:46 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:47.199 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:46 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:47.199 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:46 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:47.199 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:46 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:47.199 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:46 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:47.199 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:46 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:47.199 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:46 smithi045 ceph-mon[31180]: Deploying daemon mds.i on smithi165 2024-09-15T22:13:47.199 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:46 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.100:6836/864108145,v1:172.21.15.100:6837/864108145] up:boot 2024-09-15T22:13:47.199 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:46 smithi045 ceph-mon[31180]: fsmap 8 up:standby 2024-09-15T22:13:47.199 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:46 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:13:47.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.197+0000 7f5f9affd640 1 -- 172.21.15.45:0/869302043 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7222 (secure 0 0 0) 0x7f5f9409cb90 con 0x7f5f9c101de0 2024-09-15T22:13:47.200 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:47.200 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":9,"btime":"2024-09-15T22:13:46:197383+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-15T22:13:47.200 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 9 2024-09-15T22:13:47.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.199+0000 7f5fa413e640 1 -- 172.21.15.45:0/869302043 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f5f840a3240 msgr2=0x7f5f840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:47.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.199+0000 7f5fa413e640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f5f840a3240 0x7f5f840a5700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c075f80 tx=0x7f5f90005f90 comp rx=0 tx=0).stop 2024-09-15T22:13:47.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.199+0000 7f5fa413e640 1 -- 172.21.15.45:0/869302043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f9c101de0 msgr2=0x7f5f9c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:47.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.199+0000 7f5fa413e640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f9c101de0 0x7f5f9c0744f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400cce0 tx=0x7f5f9400a620 comp rx=0 tx=0).stop 2024-09-15T22:13:47.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.199+0000 7f5fa413e640 1 -- 172.21.15.45:0/869302043 shutdown_connections 2024-09-15T22:13:47.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.199+0000 7f5fa413e640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f5f840a3240 0x7f5f840a5700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.199+0000 7f5fa413e640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f9c106f10 0x7f5f9c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.199+0000 7f5fa413e640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f9c102790 0x7f5f9c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.199+0000 7f5fa413e640 1 --2- 172.21.15.45:0/869302043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f9c101de0 0x7f5f9c0744f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:47.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.199+0000 7f5fa413e640 1 -- 172.21.15.45:0/869302043 >> 172.21.15.45:0/869302043 conn(0x7f5f9c0fd8c0 msgr2=0x7f5f9c0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:47.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.199+0000 7f5fa413e640 1 -- 172.21.15.45:0/869302043 shutdown_connections 2024-09-15T22:13:47.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:47.199+0000 7f5fa413e640 1 -- 172.21.15.45:0/869302043 wait complete. 2024-09-15T22:13:47.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:46 smithi100 ceph-mon[35319]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:47.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:46 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:47.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:46 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:47.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:46 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:47.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:46 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:47.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:46 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:47.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:46 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:47.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:46 smithi100 ceph-mon[35319]: Deploying daemon mds.i on smithi165 2024-09-15T22:13:47.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:46 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.100:6836/864108145,v1:172.21.15.100:6837/864108145] up:boot 2024-09-15T22:13:47.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:46 smithi100 ceph-mon[35319]: fsmap 8 up:standby 2024-09-15T22:13:47.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:46 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:13:47.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:47 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/869302043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:48.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:47 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/869302043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:48.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:47 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/869302043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:48.715 INFO:journalctl@ceph.mds.i.smithi165.stdout:Sep 15 22:13:48 smithi165 systemd[1]: Started Ceph mds.i for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:13:49.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:48 smithi165 ceph-mon[35551]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:49.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:49.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:49.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:49.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:49.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:49.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:48 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:48 smithi100 ceph-mon[35319]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:48 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:48 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:48 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:48 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:48 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:48 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:49.271 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:48 smithi045 ceph-mon[31180]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:49.271 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:48 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:49.271 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:48 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:49.271 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:48 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:49.271 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:48 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:49.271 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:48 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:49.271 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:48 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:49.831 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:13:50.122 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:50.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:49 smithi165 ceph-mon[35551]: Deploying daemon mds.g on smithi045 2024-09-15T22:13:50.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:49 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.165:6838/2278031843,v1:172.21.15.165:6839/2278031843] up:boot 2024-09-15T22:13:50.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:49 smithi165 ceph-mon[35551]: fsmap 9 up:standby 2024-09-15T22:13:50.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:49 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:13:50.243 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:49 smithi045 ceph-mon[31180]: Deploying daemon mds.g on smithi045 2024-09-15T22:13:50.243 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:49 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.165:6838/2278031843,v1:172.21.15.165:6839/2278031843] up:boot 2024-09-15T22:13:50.243 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:49 smithi045 ceph-mon[31180]: fsmap 9 up:standby 2024-09-15T22:13:50.243 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:49 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:13:50.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:49 smithi100 ceph-mon[35319]: Deploying daemon mds.g on smithi045 2024-09-15T22:13:50.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:49 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.165:6838/2278031843,v1:172.21.15.165:6839/2278031843] up:boot 2024-09-15T22:13:50.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:49 smithi100 ceph-mon[35319]: fsmap 9 up:standby 2024-09-15T22:13:50.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:49 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:13:50.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.697+0000 7f979630e640 1 -- 172.21.15.45:0/214626373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9790106a80 msgr2=0x7f9790106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:50.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.697+0000 7f979630e640 1 --2- 172.21.15.45:0/214626373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9790106a80 0x7f9790106e60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9780009930 tx=0x7f978002a420 comp rx=0 tx=0).stop 2024-09-15T22:13:50.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.697+0000 7f979630e640 1 -- 172.21.15.45:0/214626373 shutdown_connections 2024-09-15T22:13:50.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.697+0000 7f979630e640 1 --2- 172.21.15.45:0/214626373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9790101420 0x7f979010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:50.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.697+0000 7f979630e640 1 --2- 172.21.15.45:0/214626373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9790100a80 0x7f9790100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:50.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.697+0000 7f979630e640 1 --2- 172.21.15.45:0/214626373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9790106a80 0x7f9790106e60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:50.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.697+0000 7f979630e640 1 -- 172.21.15.45:0/214626373 >> 172.21.15.45:0/214626373 conn(0x7f97900fc7a0 msgr2=0x7f97900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:50.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.697+0000 7f979630e640 1 -- 172.21.15.45:0/214626373 shutdown_connections 2024-09-15T22:13:50.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.698+0000 7f979630e640 1 -- 172.21.15.45:0/214626373 wait complete. 2024-09-15T22:13:50.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.698+0000 7f979630e640 1 Processor -- start 2024-09-15T22:13:50.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.698+0000 7f979630e640 1 -- start start 2024-09-15T22:13:50.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f979630e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9790100a80 0x7f97901993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:50.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f979630e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9790101420 0x7f9790199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:50.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f979630e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9790106a80 0x7f97901a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:50.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f979630e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9790110fe0 con 0x7f9790100a80 2024-09-15T22:13:50.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f979630e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9790110e60 con 0x7f9790106a80 2024-09-15T22:13:50.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f979630e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9790111160 con 0x7f9790101420 2024-09-15T22:13:50.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f978ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9790100a80 0x7f97901993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:50.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f978ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9790100a80 0x7f97901993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38198/0 (socket says 172.21.15.45:38198) 2024-09-15T22:13:50.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f978ffff640 1 -- 172.21.15.45:0/1931333398 learned_addr learned my addr 172.21.15.45:0/1931333398 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:50.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f97948ab640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9790106a80 0x7f97901a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:50.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f978f7fe640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9790101420 0x7f9790199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:50.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f978ffff640 1 -- 172.21.15.45:0/1931333398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9790101420 msgr2=0x7f9790199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:50.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f978ffff640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9790101420 0x7f9790199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:50.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f978ffff640 1 -- 172.21.15.45:0/1931333398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9790106a80 msgr2=0x7f97901a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:50.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f978ffff640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9790106a80 0x7f97901a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:50.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f978ffff640 1 -- 172.21.15.45:0/1931333398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97901a4980 con 0x7f9790100a80 2024-09-15T22:13:50.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f978f7fe640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9790101420 0x7f9790199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:13:50.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f978ffff640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9790100a80 0x7f97901993c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9780009a50 tx=0x7f9780004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:50.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f978d7fa640 1 -- 172.21.15.45:0/1931333398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978003f030 con 0x7f9790100a80 2024-09-15T22:13:50.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f978d7fa640 1 -- 172.21.15.45:0/1931333398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9780003af0 con 0x7f9790100a80 2024-09-15T22:13:50.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.699+0000 7f979630e640 1 -- 172.21.15.45:0/1931333398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97901a4b50 con 0x7f9790100a80 2024-09-15T22:13:50.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.700+0000 7f978d7fa640 1 -- 172.21.15.45:0/1931333398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9780035070 con 0x7f9790100a80 2024-09-15T22:13:50.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.700+0000 7f979630e640 1 -- 172.21.15.45:0/1931333398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97901a5000 con 0x7f9790100a80 2024-09-15T22:13:50.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.700+0000 7f979630e640 1 -- 172.21.15.45:0/1931333398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9790100ee0 con 0x7f9790100a80 2024-09-15T22:13:50.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.702+0000 7f978d7fa640 1 -- 172.21.15.45:0/1931333398 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9780042030 con 0x7f9790100a80 2024-09-15T22:13:50.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.702+0000 7f978d7fa640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f97780a32c0 0x7f97780a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:50.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.702+0000 7f978f7fe640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f97780a32c0 0x7f97780a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:50.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.702+0000 7f978d7fa640 1 -- 172.21.15.45:0/1931333398 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f97800ef940 con 0x7f9790100a80 2024-09-15T22:13:50.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.703+0000 7f978f7fe640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f97780a32c0 0x7f97780a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9784006fd0 tx=0x7f9784008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:50.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.707+0000 7f978d7fa640 1 -- 172.21.15.45:0/1931333398 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f97800bcb00 con 0x7f9790100a80 2024-09-15T22:13:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.937+0000 7f979630e640 1 -- 172.21.15.45:0/1931333398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97901a5230 con 0x7f9790100a80 2024-09-15T22:13:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.938+0000 7f978d7fa640 1 -- 172.21.15.45:0/1931333398 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7f97800bc400 con 0x7f9790100a80 2024-09-15T22:13:50.940 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:50.940 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":10,"btime":"2024-09-15T22:13:48:929046+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-15T22:13:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 10 2024-09-15T22:13:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.940+0000 7f979630e640 1 -- 172.21.15.45:0/1931333398 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f97780a32c0 msgr2=0x7f97780a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.940+0000 7f979630e640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f97780a32c0 0x7f97780a5780 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9784006fd0 tx=0x7f9784008040 comp rx=0 tx=0).stop 2024-09-15T22:13:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.940+0000 7f979630e640 1 -- 172.21.15.45:0/1931333398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9790100a80 msgr2=0x7f97901993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.940+0000 7f979630e640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9790100a80 0x7f97901993c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9780009a50 tx=0x7f9780004270 comp rx=0 tx=0).stop 2024-09-15T22:13:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.940+0000 7f979630e640 1 -- 172.21.15.45:0/1931333398 shutdown_connections 2024-09-15T22:13:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.940+0000 7f979630e640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f97780a32c0 0x7f97780a5780 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:50.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.940+0000 7f979630e640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9790106a80 0x7f97901a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:50.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.940+0000 7f979630e640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9790101420 0x7f9790199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:50.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.940+0000 7f979630e640 1 --2- 172.21.15.45:0/1931333398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9790100a80 0x7f97901993c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:50.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.940+0000 7f979630e640 1 -- 172.21.15.45:0/1931333398 >> 172.21.15.45:0/1931333398 conn(0x7f97900fc7a0 msgr2=0x7f97900fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:50.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.940+0000 7f979630e640 1 -- 172.21.15.45:0/1931333398 shutdown_connections 2024-09-15T22:13:50.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:50.940+0000 7f979630e640 1 -- 172.21.15.45:0/1931333398 wait complete. 2024-09-15T22:13:51.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:50 smithi165 ceph-mon[35551]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:51.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:50 smithi100 ceph-mon[35319]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:51.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:50 smithi045 ceph-mon[31180]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:51.945 INFO:journalctl@ceph.mds.g.smithi045.stdout:Sep 15 22:13:51 smithi045 systemd[1]: Started Ceph mds.g for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:13:52.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:51 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1931333398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:52.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:51 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1931333398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:52.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:51 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1931333398' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:53.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:52 smithi165 ceph-mon[35551]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:53.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:52 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:53.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:52 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.45:6838/3708053507,v1:172.21.15.45:6839/3708053507] up:boot 2024-09-15T22:13:53.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:52 smithi165 ceph-mon[35551]: fsmap 10 up:standby 2024-09-15T22:13:53.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:52 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:13:53.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:52 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:53.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:52 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:53.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:52 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:53.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:52 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:53.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:52 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:53.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:52 smithi165 ceph-mon[35551]: Deploying daemon mds.a on smithi045 2024-09-15T22:13:53.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:52 smithi100 ceph-mon[35319]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:53.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:52 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:53.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:52 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.45:6838/3708053507,v1:172.21.15.45:6839/3708053507] up:boot 2024-09-15T22:13:53.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:52 smithi100 ceph-mon[35319]: fsmap 10 up:standby 2024-09-15T22:13:53.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:52 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:13:53.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:52 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:53.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:52 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:53.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:52 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:53.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:52 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:53.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:52 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:53.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:52 smithi100 ceph-mon[35319]: Deploying daemon mds.a on smithi045 2024-09-15T22:13:53.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:52 smithi045 ceph-mon[31180]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:53.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:52 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:53.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:52 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.45:6838/3708053507,v1:172.21.15.45:6839/3708053507] up:boot 2024-09-15T22:13:53.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:52 smithi045 ceph-mon[31180]: fsmap 10 up:standby 2024-09-15T22:13:53.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:52 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:13:53.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:52 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:53.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:52 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:53.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:52 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:53.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:52 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:53.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:52 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:53.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:52 smithi045 ceph-mon[31180]: Deploying daemon mds.a on smithi045 2024-09-15T22:13:53.693 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:13:54.549 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:54.672 INFO:journalctl@ceph.mds.a.smithi045.stdout:Sep 15 22:13:54 smithi045 systemd[1]: Started Ceph mds.a for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:13:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.039+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/356708149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e9c106a60 msgr2=0x7f9e9c106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.039+0000 7f9ea2ec4640 1 --2- 172.21.15.45:0/356708149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e9c106a60 0x7f9e9c106e40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009930 tx=0x7f9e9802a420 comp rx=0 tx=0).stop 2024-09-15T22:13:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.039+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/356708149 shutdown_connections 2024-09-15T22:13:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.039+0000 7f9ea2ec4640 1 --2- 172.21.15.45:0/356708149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e9c101400 0x7f9e9c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.039+0000 7f9ea2ec4640 1 --2- 172.21.15.45:0/356708149 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e9c100a60 0x7f9e9c100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.039+0000 7f9ea2ec4640 1 --2- 172.21.15.45:0/356708149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e9c106a60 0x7f9e9c106e40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:55.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.039+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/356708149 >> 172.21.15.45:0/356708149 conn(0x7f9e9c0fc780 msgr2=0x7f9e9c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:55.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.039+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/356708149 shutdown_connections 2024-09-15T22:13:55.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.039+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/356708149 wait complete. 2024-09-15T22:13:55.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.040+0000 7f9ea2ec4640 1 Processor -- start 2024-09-15T22:13:55.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.040+0000 7f9ea2ec4640 1 -- start start 2024-09-15T22:13:55.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.040+0000 7f9ea2ec4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e9c100a60 0x7f9e9c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:55.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.040+0000 7f9ea2ec4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e9c101400 0x7f9e9c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:55.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.040+0000 7f9ea2ec4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e9c106a60 0x7f9e9c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:55.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.040+0000 7f9ea2ec4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c110f40 con 0x7f9e9c101400 2024-09-15T22:13:55.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.040+0000 7f9ea2ec4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c110dc0 con 0x7f9e9c106a60 2024-09-15T22:13:55.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.040+0000 7f9ea2ec4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9c1110c0 con 0x7f9e9c100a60 2024-09-15T22:13:55.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.040+0000 7f9e93fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e9c101400 0x7f9e9c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:55.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.040+0000 7f9e93fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e9c101400 0x7f9e9c1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35328/0 (socket says 172.21.15.45:35328) 2024-09-15T22:13:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.040+0000 7f9e93fff640 1 -- 172.21.15.45:0/1262554929 learned_addr learned my addr 172.21.15.45:0/1262554929 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.040+0000 7f9ea1461640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e9c106a60 0x7f9e9c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.040+0000 7f9ea0c60640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e9c100a60 0x7f9e9c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.041+0000 7f9e93fff640 1 -- 172.21.15.45:0/1262554929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e9c100a60 msgr2=0x7f9e9c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.041+0000 7f9e93fff640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e9c100a60 0x7f9e9c198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.041+0000 7f9e93fff640 1 -- 172.21.15.45:0/1262554929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e9c106a60 msgr2=0x7f9e9c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.041+0000 7f9e93fff640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e9c106a60 0x7f9e9c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.041+0000 7f9e93fff640 1 -- 172.21.15.45:0/1262554929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9c19d440 con 0x7f9e9c101400 2024-09-15T22:13:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.041+0000 7f9ea1461640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e9c106a60 0x7f9e9c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:13:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.041+0000 7f9e93fff640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e9c101400 0x7f9e9c1989d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00c920 tx=0x7f9e8c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.041+0000 7f9e91ffb640 1 -- 172.21.15.45:0/1262554929 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c007c70 con 0x7f9e9c101400 2024-09-15T22:13:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.041+0000 7f9e91ffb640 1 -- 172.21.15.45:0/1262554929 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9e8c007e10 con 0x7f9e9c101400 2024-09-15T22:13:55.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.041+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/1262554929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9c19d730 con 0x7f9e9c101400 2024-09-15T22:13:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.041+0000 7f9e91ffb640 1 -- 172.21.15.45:0/1262554929 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c018940 con 0x7f9e9c101400 2024-09-15T22:13:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.041+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/1262554929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9c1a5010 con 0x7f9e9c101400 2024-09-15T22:13:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.042+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/1262554929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e9c100ec0 con 0x7f9e9c101400 2024-09-15T22:13:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.043+0000 7f9e91ffb640 1 -- 172.21.15.45:0/1262554929 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9e8c018b20 con 0x7f9e9c101400 2024-09-15T22:13:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.044+0000 7f9e91ffb640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f9e840a3240 0x7f9e840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.044+0000 7f9ea0c60640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f9e840a3240 0x7f9e840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.044+0000 7f9e91ffb640 1 -- 172.21.15.45:0/1262554929 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f9e8c0cf540 con 0x7f9e9c101400 2024-09-15T22:13:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.044+0000 7f9ea0c60640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f9e840a3240 0x7f9e840a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009900 tx=0x7f9e980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:55.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.048+0000 7f9e91ffb640 1 -- 172.21.15.45:0/1262554929 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e8c014030 con 0x7f9e9c101400 2024-09-15T22:13:55.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:54 smithi165 ceph-mon[35551]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:55.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:55.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:55.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:55.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:55.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:55.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:54 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:55.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:54 smithi100 ceph-mon[35319]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:55.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:55.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:55.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:55.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:55.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:55.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:54 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:55.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.261+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/1262554929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e9c02d7c0 con 0x7f9e9c101400 2024-09-15T22:13:55.263 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:54 smithi045 ceph-mon[31180]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:55.263 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:55.263 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:55.263 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:55.263 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T22:13:55.264 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T22:13:55.264 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:54 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:13:55.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.261+0000 7f9e91ffb640 1 -- 172.21.15.45:0/1262554929 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9704 (secure 0 0 0) 0x7f9e8c09c700 con 0x7f9e9c101400 2024-09-15T22:13:55.265 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:55.265 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":12,"btime":"2024-09-15T22:13:54:947519+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-15T22:13:55.265 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 12 2024-09-15T22:13:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.263+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/1262554929 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f9e840a3240 msgr2=0x7f9e840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.263+0000 7f9ea2ec4640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f9e840a3240 0x7f9e840a5700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009900 tx=0x7f9e980058d0 comp rx=0 tx=0).stop 2024-09-15T22:13:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.263+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/1262554929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e9c101400 msgr2=0x7f9e9c1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.263+0000 7f9ea2ec4640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e9c101400 0x7f9e9c1989d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00c920 tx=0x7f9e8c00cde0 comp rx=0 tx=0).stop 2024-09-15T22:13:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.263+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/1262554929 shutdown_connections 2024-09-15T22:13:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.263+0000 7f9ea2ec4640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f9e840a3240 0x7f9e840a5700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.263+0000 7f9ea2ec4640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e9c106a60 0x7f9e9c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.263+0000 7f9ea2ec4640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e9c101400 0x7f9e9c1989d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.263+0000 7f9ea2ec4640 1 --2- 172.21.15.45:0/1262554929 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9e9c100a60 0x7f9e9c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.263+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/1262554929 >> 172.21.15.45:0/1262554929 conn(0x7f9e9c0fc780 msgr2=0x7f9e9c06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:55.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.264+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/1262554929 shutdown_connections 2024-09-15T22:13:55.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:55.264+0000 7f9ea2ec4640 1 -- 172.21.15.45:0/1262554929 wait complete. 2024-09-15T22:13:56.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:55 smithi165 ceph-mon[35551]: Deploying daemon mds.b on smithi100 2024-09-15T22:13:56.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:55 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.45:6840/1624795277,v1:172.21.15.45:6841/1624795277] up:boot 2024-09-15T22:13:56.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:55 smithi165 ceph-mon[35551]: fsmap 11 up:standby 2024-09-15T22:13:56.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:55 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:13:56.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:55 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1262554929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:56.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:55 smithi100 ceph-mon[35319]: Deploying daemon mds.b on smithi100 2024-09-15T22:13:56.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:55 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.45:6840/1624795277,v1:172.21.15.45:6841/1624795277] up:boot 2024-09-15T22:13:56.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:55 smithi100 ceph-mon[35319]: fsmap 11 up:standby 2024-09-15T22:13:56.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:55 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:13:56.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:55 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1262554929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:55 smithi045 ceph-mon[31180]: Deploying daemon mds.b on smithi100 2024-09-15T22:13:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:55 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.45:6840/1624795277,v1:172.21.15.45:6841/1624795277] up:boot 2024-09-15T22:13:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:55 smithi045 ceph-mon[31180]: fsmap 11 up:standby 2024-09-15T22:13:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:55 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:13:56.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:55 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1262554929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:13:56.960 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:13:56 smithi100 systemd[1]: Starting Ceph mds.b for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:13:57.212 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:56 smithi100 ceph-mon[35319]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:57.213 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:13:56 smithi100 podman[65361]: 2024-09-15 22:13:56.959043569 +0000 UTC m=+0.093070467 container create e5b7bff31d78c693c04a6b303d95ad6c99230cb36d351f8fd7748fd2c30667ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-8921c8e) 2024-09-15T22:13:57.213 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:13:56 smithi100 podman[65361]: 2024-09-15 22:13:56.882579542 +0000 UTC m=+0.016606448 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:13:57.213 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:13:57 smithi100 podman[65361]: 2024-09-15 22:13:57.211938599 +0000 UTC m=+0.345965496 container init e5b7bff31d78c693c04a6b303d95ad6c99230cb36d351f8fd7748fd2c30667ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-15T22:13:57.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:56 smithi165 ceph-mon[35551]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:57.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:56 smithi045 ceph-mon[31180]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:57.494 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:13:57 smithi100 podman[65361]: 2024-09-15 22:13:57.214874303 +0000 UTC m=+0.348901204 container start e5b7bff31d78c693c04a6b303d95ad6c99230cb36d351f8fd7748fd2c30667ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True) 2024-09-15T22:13:57.494 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:13:57 smithi100 ceph-mds[65380]: -- 172.21.15.100:0/454521775 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eaf362f860 con 0x55eaf360d400 2024-09-15T22:13:57.494 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:13:57 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-b[65376]: starting mds.b at 2024-09-15T22:13:57.494 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:13:57 smithi100 bash[65361]: e5b7bff31d78c693c04a6b303d95ad6c99230cb36d351f8fd7748fd2c30667ac 2024-09-15T22:13:57.495 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:13:57 smithi100 systemd[1]: Started Ceph mds.b for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:13:57.914 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:13:58.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:58 smithi045 ceph-mon[31180]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:58.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:58.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:58 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] up:boot 2024-09-15T22:13:58.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:58 smithi045 ceph-mon[31180]: fsmap 12 up:standby 2024-09-15T22:13:58.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:58 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:13:58.597 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:13:58.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:58 smithi165 ceph-mon[35551]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:58.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:58.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:58 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] up:boot 2024-09-15T22:13:58.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:58 smithi165 ceph-mon[35551]: fsmap 12 up:standby 2024-09-15T22:13:58.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:58 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:13:58.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:13:58.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:58 smithi100 ceph-mon[35319]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:13:58.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:13:58.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:58 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] up:boot 2024-09-15T22:13:58.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:58 smithi100 ceph-mon[35319]: fsmap 12 up:standby 2024-09-15T22:13:58.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:58 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:13:59.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.060+0000 7fd65cba0640 1 -- 172.21.15.45:0/3999644395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd658106f10 msgr2=0x7fd65810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.060+0000 7fd65cba0640 1 --2- 172.21.15.45:0/3999644395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd658106f10 0x7fd65810ea90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd650009ca0 tx=0x7fd65002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:13:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.060+0000 7fd65cba0640 1 -- 172.21.15.45:0/3999644395 shutdown_connections 2024-09-15T22:13:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.060+0000 7fd65cba0640 1 --2- 172.21.15.45:0/3999644395 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd658106f10 0x7fd65810ea90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.060+0000 7fd65cba0640 1 --2- 172.21.15.45:0/3999644395 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd658102790 0x7fd6581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.060+0000 7fd65cba0640 1 --2- 172.21.15.45:0/3999644395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd658101de0 0x7fd6581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.060+0000 7fd65cba0640 1 -- 172.21.15.45:0/3999644395 >> 172.21.15.45:0/3999644395 conn(0x7fd6580fd8c0 msgr2=0x7fd6580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.060+0000 7fd65cba0640 1 -- 172.21.15.45:0/3999644395 shutdown_connections 2024-09-15T22:13:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.060+0000 7fd65cba0640 1 -- 172.21.15.45:0/3999644395 wait complete. 2024-09-15T22:13:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.061+0000 7fd65cba0640 1 Processor -- start 2024-09-15T22:13:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.061+0000 7fd65cba0640 1 -- start start 2024-09-15T22:13:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.061+0000 7fd65cba0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd658101de0 0x7fd65819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.061+0000 7fd65cba0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd658102790 0x7fd65819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.061+0000 7fd65cba0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd658106f10 0x7fd65819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.061+0000 7fd65cba0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd6581120d0 con 0x7fd658102790 2024-09-15T22:13:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.061+0000 7fd65cba0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd658111f50 con 0x7fd658101de0 2024-09-15T22:13:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.061+0000 7fd65cba0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd658112250 con 0x7fd658106f10 2024-09-15T22:13:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd655d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd658102790 0x7fd65819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd655d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd658102790 0x7fd65819abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35348/0 (socket says 172.21.15.45:35348) 2024-09-15T22:13:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd655d9b640 1 -- 172.21.15.45:0/1465163407 learned_addr learned my addr 172.21.15.45:0/1465163407 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:13:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd656d9d640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd658106f10 0x7fd65819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd65659c640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd658101de0 0x7fd65819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd655d9b640 1 -- 172.21.15.45:0/1465163407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd658106f10 msgr2=0x7fd65819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd655d9b640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd658106f10 0x7fd65819ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd655d9b640 1 -- 172.21.15.45:0/1465163407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd658101de0 msgr2=0x7fd65819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd655d9b640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd658101de0 0x7fd65819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd655d9b640 1 -- 172.21.15.45:0/1465163407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65819f640 con 0x7fd658102790 2024-09-15T22:13:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd65659c640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd658101de0 0x7fd65819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:13:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd655d9b640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd658102790 0x7fd65819abd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00b4a0 tx=0x7fd64c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd6477fe640 1 -- 172.21.15.45:0/1465163407 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c014070 con 0x7fd658102790 2024-09-15T22:13:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd6477fe640 1 -- 172.21.15.45:0/1465163407 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd64c010b10 con 0x7fd658102790 2024-09-15T22:13:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd65cba0640 1 -- 172.21.15.45:0/1465163407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65819f930 con 0x7fd658102790 2024-09-15T22:13:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd6477fe640 1 -- 172.21.15.45:0/1465163407 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c017d60 con 0x7fd658102790 2024-09-15T22:13:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.062+0000 7fd65cba0640 1 -- 172.21.15.45:0/1465163407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6581a7210 con 0x7fd658102790 2024-09-15T22:13:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.063+0000 7fd65cba0640 1 -- 172.21.15.45:0/1465163407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6581021c0 con 0x7fd658102790 2024-09-15T22:13:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.065+0000 7fd6477fe640 1 -- 172.21.15.45:0/1465163407 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd64c017070 con 0x7fd658102790 2024-09-15T22:13:59.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.065+0000 7fd6477fe640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd6400a3240 0x7fd6400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:13:59.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.065+0000 7fd65659c640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd6400a3240 0x7fd6400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:13:59.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.065+0000 7fd6477fe640 1 -- 172.21.15.45:0/1465163407 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd64c0cec10 con 0x7fd658102790 2024-09-15T22:13:59.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.066+0000 7fd65659c640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd6400a3240 0x7fd6400a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd64800abe0 tx=0x7fd64800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:13:59.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.069+0000 7fd6477fe640 1 -- 172.21.15.45:0/1465163407 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd64c09bdd0 con 0x7fd658102790 2024-09-15T22:13:59.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.289+0000 7fd65cba0640 1 -- 172.21.15.45:0/1465163407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd65819b9f0 con 0x7fd658102790 2024-09-15T22:13:59.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.290+0000 7fd6477fe640 1 -- 172.21.15.45:0/1465163407 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7fd65819b9f0 con 0x7fd658102790 2024-09-15T22:13:59.292 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:13:59.293 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":13,"btime":"2024-09-15T22:13:57:960998+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-15T22:13:59.293 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 13 2024-09-15T22:13:59.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.292+0000 7fd65cba0640 1 -- 172.21.15.45:0/1465163407 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd6400a3240 msgr2=0x7fd6400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:59.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.292+0000 7fd65cba0640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd6400a3240 0x7fd6400a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd64800abe0 tx=0x7fd64800a5c0 comp rx=0 tx=0).stop 2024-09-15T22:13:59.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.292+0000 7fd65cba0640 1 -- 172.21.15.45:0/1465163407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd658102790 msgr2=0x7fd65819abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:13:59.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.292+0000 7fd65cba0640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd658102790 0x7fd65819abd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00b4a0 tx=0x7fd64c00b960 comp rx=0 tx=0).stop 2024-09-15T22:13:59.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.292+0000 7fd65cba0640 1 -- 172.21.15.45:0/1465163407 shutdown_connections 2024-09-15T22:13:59.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.292+0000 7fd65cba0640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd6400a3240 0x7fd6400a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:59.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.292+0000 7fd65cba0640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd658106f10 0x7fd65819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:59.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.292+0000 7fd65cba0640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd658102790 0x7fd65819abd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:59.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.292+0000 7fd65cba0640 1 --2- 172.21.15.45:0/1465163407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd658101de0 0x7fd65819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:13:59.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.292+0000 7fd65cba0640 1 -- 172.21.15.45:0/1465163407 >> 172.21.15.45:0/1465163407 conn(0x7fd6580fd8c0 msgr2=0x7fd6580ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:13:59.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.293+0000 7fd65cba0640 1 -- 172.21.15.45:0/1465163407 shutdown_connections 2024-09-15T22:13:59.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:13:59.293+0000 7fd65cba0640 1 -- 172.21.15.45:0/1465163407 wait complete. 2024-09-15T22:13:59.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-15T22:14:00.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:59 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:00.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:59 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:00.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:59 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:00.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:59 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:00.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:13:59 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1465163407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:14:00.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:59 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:00.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:59 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:00.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:59 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:00.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:59 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:00.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:13:59 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1465163407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:14:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:00.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:59 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:00.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:59 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:00.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:59 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:00.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:59 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:00.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:13:59 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1465163407' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:14:00.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.776+0000 7f325bdda640 1 -- 172.21.15.45:0/1784652034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3254100a80 msgr2=0x7f3254100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:00.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.776+0000 7f325bdda640 1 --2- 172.21.15.45:0/1784652034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3254100a80 0x7f3254100ee0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3244009930 tx=0x7f324402a420 comp rx=0 tx=0).stop 2024-09-15T22:14:00.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.776+0000 7f325bdda640 1 -- 172.21.15.45:0/1784652034 shutdown_connections 2024-09-15T22:14:00.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.776+0000 7f325bdda640 1 --2- 172.21.15.45:0/1784652034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3254101420 0x7f325410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:00.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.776+0000 7f325bdda640 1 --2- 172.21.15.45:0/1784652034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3254100a80 0x7f3254100ee0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:00.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.776+0000 7f325bdda640 1 --2- 172.21.15.45:0/1784652034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3254106a80 0x7f3254106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.776+0000 7f325bdda640 1 -- 172.21.15.45:0/1784652034 >> 172.21.15.45:0/1784652034 conn(0x7f32540fc7a0 msgr2=0x7f32540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.776+0000 7f325bdda640 1 -- 172.21.15.45:0/1784652034 shutdown_connections 2024-09-15T22:14:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.776+0000 7f325bdda640 1 -- 172.21.15.45:0/1784652034 wait complete. 2024-09-15T22:14:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.777+0000 7f325bdda640 1 Processor -- start 2024-09-15T22:14:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.777+0000 7f325bdda640 1 -- start start 2024-09-15T22:14:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.777+0000 7f325bdda640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3254100a80 0x7f32540fcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.777+0000 7f325bdda640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3254101420 0x7f32540fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.777+0000 7f325bdda640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3254106a80 0x7f32540fd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.777+0000 7f325bdda640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3254110fa0 con 0x7f3254101420 2024-09-15T22:14:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.777+0000 7f325bdda640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3254110e20 con 0x7f3254106a80 2024-09-15T22:14:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.777+0000 7f325bdda640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3254111120 con 0x7f3254100a80 2024-09-15T22:14:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.777+0000 7f3259375640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3254101420 0x7f32540fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.777+0000 7f3259375640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3254101420 0x7f32540fd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35358/0 (socket says 172.21.15.45:35358) 2024-09-15T22:14:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.777+0000 7f3259375640 1 -- 172.21.15.45:0/1385944616 learned_addr learned my addr 172.21.15.45:0/1385944616 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.777+0000 7f3259b76640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3254100a80 0x7f32540fcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.777+0000 7f325a377640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3254106a80 0x7f32540fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.778+0000 7f3259375640 1 -- 172.21.15.45:0/1385944616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3254100a80 msgr2=0x7f32540fcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.778+0000 7f3259375640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3254100a80 0x7f32540fcd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.778+0000 7f3259375640 1 -- 172.21.15.45:0/1385944616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3254106a80 msgr2=0x7f32540fd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.778+0000 7f3259375640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3254106a80 0x7f32540fd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.778+0000 7f3259375640 1 -- 172.21.15.45:0/1385944616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32541a6a40 con 0x7f3254101420 2024-09-15T22:14:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.778+0000 7f3259375640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3254101420 0x7f32540fd2c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3244009230 tx=0x7f3244004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.778+0000 7f324affd640 1 -- 172.21.15.45:0/1385944616 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324403f030 con 0x7f3254101420 2024-09-15T22:14:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.778+0000 7f325bdda640 1 -- 172.21.15.45:0/1385944616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32541a6cd0 con 0x7f3254101420 2024-09-15T22:14:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.778+0000 7f324affd640 1 -- 172.21.15.45:0/1385944616 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3244004440 con 0x7f3254101420 2024-09-15T22:14:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.778+0000 7f324affd640 1 -- 172.21.15.45:0/1385944616 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244035070 con 0x7f3254101420 2024-09-15T22:14:00.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.778+0000 7f325bdda640 1 -- 172.21.15.45:0/1385944616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32541a71b0 con 0x7f3254101420 2024-09-15T22:14:00.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.779+0000 7f325bdda640 1 -- 172.21.15.45:0/1385944616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3254100ee0 con 0x7f3254101420 2024-09-15T22:14:00.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.781+0000 7f324affd640 1 -- 172.21.15.45:0/1385944616 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3244042030 con 0x7f3254101420 2024-09-15T22:14:00.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.782+0000 7f324affd640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32400a3240 0x7f32400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:00.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.782+0000 7f3259b76640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32400a3240 0x7f32400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:00.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.782+0000 7f324affd640 1 -- 172.21.15.45:0/1385944616 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f32440efbd0 con 0x7f3254101420 2024-09-15T22:14:00.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.782+0000 7f3259b76640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32400a3240 0x7f32400a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3250009b50 tx=0x7f3250005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:00.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.785+0000 7f324affd640 1 -- 172.21.15.45:0/1385944616 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32440bc6a0 con 0x7f3254101420 2024-09-15T22:14:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.976+0000 7f325bdda640 1 -- 172.21.15.45:0/1385944616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f325410a000 con 0x7f3254101420 2024-09-15T22:14:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.977+0000 7f324affd640 1 -- 172.21.15.45:0/1385944616 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7f32440c09a0 con 0x7f3254101420 2024-09-15T22:14:00.979 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:14:00.979 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2024-09-15T22:14:00.979 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:14:00.979 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2024-09-15T22:14:00.979 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2024-09-15T22:14:00.980 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:14:00.980 INFO:teuthology.orchestra.run.smithi045.stdout:] 2024-09-15T22:14:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.979+0000 7f325bdda640 1 -- 172.21.15.45:0/1385944616 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32400a3240 msgr2=0x7f32400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.979+0000 7f325bdda640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32400a3240 0x7f32400a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3250009b50 tx=0x7f3250005f90 comp rx=0 tx=0).stop 2024-09-15T22:14:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.979+0000 7f325bdda640 1 -- 172.21.15.45:0/1385944616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3254101420 msgr2=0x7f32540fd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.979+0000 7f325bdda640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3254101420 0x7f32540fd2c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3244009230 tx=0x7f3244004040 comp rx=0 tx=0).stop 2024-09-15T22:14:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.979+0000 7f325bdda640 1 -- 172.21.15.45:0/1385944616 shutdown_connections 2024-09-15T22:14:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.979+0000 7f325bdda640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32400a3240 0x7f32400a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.979+0000 7f325bdda640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3254106a80 0x7f32540fd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:00.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.979+0000 7f325bdda640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3254101420 0x7f32540fd2c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:00.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.979+0000 7f325bdda640 1 --2- 172.21.15.45:0/1385944616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3254100a80 0x7f32540fcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:00.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.979+0000 7f325bdda640 1 -- 172.21.15.45:0/1385944616 >> 172.21.15.45:0/1385944616 conn(0x7f32540fc7a0 msgr2=0x7f325406aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:00.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.979+0000 7f325bdda640 1 -- 172.21.15.45:0/1385944616 shutdown_connections 2024-09-15T22:14:00.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:00.979+0000 7f325bdda640 1 -- 172.21.15.45:0/1385944616 wait complete. 2024-09-15T22:14:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:01 smithi045 ceph-mon[31180]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:01 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:01 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:01 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:14:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:01 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:14:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:01 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:01 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:14:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:01 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:01.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:01 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1385944616' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:14:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:01 smithi165 ceph-mon[35551]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:01 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:01 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:01 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:14:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:01 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:14:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:01 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:01.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:01 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:14:01.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:01 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:01.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:01 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1385944616' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:14:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:01 smithi100 ceph-mon[35319]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:01 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:01 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:01 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:14:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:01 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:14:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:01 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:01 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:14:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:01 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:01 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1385944616' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T22:14:01.989 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:14:01.990 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:14:02.334 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:02.705 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:02 smithi045 ceph-mon[31180]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:02.705 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:02.705 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:02.705 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:02.705 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:02 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:02.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.789+0000 7f8d60d5a640 1 -- 172.21.15.45:0/1808875180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5c10c170 msgr2=0x7f8d5c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:02.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.789+0000 7f8d60d5a640 1 --2- 172.21.15.45:0/1808875180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5c10c170 0x7f8d5c10e610 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009ca0 tx=0x7f8d5402a950 comp rx=0 tx=0).stop 2024-09-15T22:14:02.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.789+0000 7f8d60d5a640 1 -- 172.21.15.45:0/1808875180 shutdown_connections 2024-09-15T22:14:02.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.789+0000 7f8d60d5a640 1 --2- 172.21.15.45:0/1808875180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5c10c170 0x7f8d5c10e610 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.789+0000 7f8d60d5a640 1 --2- 172.21.15.45:0/1808875180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d5c103660 0x7f8d5c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.789+0000 7f8d60d5a640 1 --2- 172.21.15.45:0/1808875180 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d5c102d40 0x7f8d5c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.789+0000 7f8d60d5a640 1 -- 172.21.15.45:0/1808875180 >> 172.21.15.45:0/1808875180 conn(0x7f8d5c0fc7a0 msgr2=0x7f8d5c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:02.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.789+0000 7f8d60d5a640 1 -- 172.21.15.45:0/1808875180 shutdown_connections 2024-09-15T22:14:02.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.789+0000 7f8d60d5a640 1 -- 172.21.15.45:0/1808875180 wait complete. 2024-09-15T22:14:02.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.790+0000 7f8d60d5a640 1 Processor -- start 2024-09-15T22:14:02.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.790+0000 7f8d60d5a640 1 -- start start 2024-09-15T22:14:02.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.790+0000 7f8d60d5a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d5c102d40 0x7f8d5c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.790+0000 7f8d60d5a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d5c103660 0x7f8d5c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.790+0000 7f8d60d5a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5c10c170 0x7f8d5c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.790+0000 7f8d60d5a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c112090 con 0x7f8d5c10c170 2024-09-15T22:14:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.790+0000 7f8d60d5a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c111f10 con 0x7f8d5c103660 2024-09-15T22:14:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.790+0000 7f8d60d5a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c112210 con 0x7f8d5c102d40 2024-09-15T22:14:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.790+0000 7f8d5ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5c10c170 0x7f8d5c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.790+0000 7f8d5ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5c10c170 0x7f8d5c19cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35380/0 (socket says 172.21.15.45:35380) 2024-09-15T22:14:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d5ad9d640 1 -- 172.21.15.45:0/2945552013 learned_addr learned my addr 172.21.15.45:0/2945552013 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d5a59c640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d5c102d40 0x7f8d5c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d53fff640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d5c103660 0x7f8d5c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d5ad9d640 1 -- 172.21.15.45:0/2945552013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d5c102d40 msgr2=0x7f8d5c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:02.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d5ad9d640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d5c102d40 0x7f8d5c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d5ad9d640 1 -- 172.21.15.45:0/2945552013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d5c103660 msgr2=0x7f8d5c198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d5ad9d640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d5c103660 0x7f8d5c198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d5ad9d640 1 -- 172.21.15.45:0/2945552013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c19d480 con 0x7f8d5c10c170 2024-09-15T22:14:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d5ad9d640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5c10c170 0x7f8d5c19cda0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8d54005cc0 tx=0x7f8d5402f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d537fe640 1 -- 172.21.15.45:0/2945552013 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54034040 con 0x7f8d5c10c170 2024-09-15T22:14:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d60d5a640 1 -- 172.21.15.45:0/2945552013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5c19d710 con 0x7f8d5c10c170 2024-09-15T22:14:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d537fe640 1 -- 172.21.15.45:0/2945552013 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8d54030940 con 0x7f8d5c10c170 2024-09-15T22:14:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d537fe640 1 -- 172.21.15.45:0/2945552013 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d540456e0 con 0x7f8d5c10c170 2024-09-15T22:14:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.791+0000 7f8d60d5a640 1 -- 172.21.15.45:0/2945552013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5c1a5050 con 0x7f8d5c10c170 2024-09-15T22:14:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.792+0000 7f8d60d5a640 1 -- 172.21.15.45:0/2945552013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d5c103120 con 0x7f8d5c10c170 2024-09-15T22:14:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.793+0000 7f8d537fe640 1 -- 172.21.15.45:0/2945552013 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8d54037020 con 0x7f8d5c10c170 2024-09-15T22:14:02.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.794+0000 7f8d537fe640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8d480a3240 0x7f8d480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:02.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.794+0000 7f8d5a59c640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8d480a3240 0x7f8d480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:02.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.794+0000 7f8d537fe640 1 -- 172.21.15.45:0/2945552013 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f8d540f03c0 con 0x7f8d5c10c170 2024-09-15T22:14:02.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.795+0000 7f8d5a59c640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8d480a3240 0x7f8d480a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c005fd0 tx=0x7f8d4c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:02.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.798+0000 7f8d537fe640 1 -- 172.21.15.45:0/2945552013 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d540bd580 con 0x7f8d5c10c170 2024-09-15T22:14:02.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:02 smithi165 ceph-mon[35551]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:02.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:02.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:02.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:02.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:02 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:02.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:02.990+0000 7f8d60d5a640 1 -- 172.21.15.45:0/2945552013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8d5c1a5220 con 0x7f8d5c10c170 2024-09-15T22:14:02.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:02 smithi100 ceph-mon[35319]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:02.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:02 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:02.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:02 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:02.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:02 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:02.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:02 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:03.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:03.702+0000 7f8d537fe640 1 -- 172.21.15.45:0/2945552013 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7f8d540bce80 con 0x7f8d5c10c170 2024-09-15T22:14:03.704 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2024-09-15T22:14:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:03.704+0000 7f8d60d5a640 1 -- 172.21.15.45:0/2945552013 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8d480a3240 msgr2=0x7f8d480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:03.704+0000 7f8d60d5a640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8d480a3240 0x7f8d480a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c005fd0 tx=0x7f8d4c00b390 comp rx=0 tx=0).stop 2024-09-15T22:14:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:03.704+0000 7f8d60d5a640 1 -- 172.21.15.45:0/2945552013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5c10c170 msgr2=0x7f8d5c19cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:03.704+0000 7f8d60d5a640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5c10c170 0x7f8d5c19cda0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8d54005cc0 tx=0x7f8d5402f790 comp rx=0 tx=0).stop 2024-09-15T22:14:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:03.704+0000 7f8d60d5a640 1 -- 172.21.15.45:0/2945552013 shutdown_connections 2024-09-15T22:14:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:03.704+0000 7f8d60d5a640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8d480a3240 0x7f8d480a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:03.704+0000 7f8d60d5a640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d5c10c170 0x7f8d5c19cda0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:03.704+0000 7f8d60d5a640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d5c103660 0x7f8d5c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:03.704+0000 7f8d60d5a640 1 --2- 172.21.15.45:0/2945552013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d5c102d40 0x7f8d5c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:03.704+0000 7f8d60d5a640 1 -- 172.21.15.45:0/2945552013 >> 172.21.15.45:0/2945552013 conn(0x7f8d5c0fc7a0 msgr2=0x7f8d5c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:03.705+0000 7f8d60d5a640 1 -- 172.21.15.45:0/2945552013 shutdown_connections 2024-09-15T22:14:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:03.705+0000 7f8d60d5a640 1 -- 172.21.15.45:0/2945552013 wait complete. 2024-09-15T22:14:03.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:03 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2945552013' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:14:03.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:03.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:03.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:14:03.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:14:03.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:03.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:03 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2945552013' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:14:03.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:03.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:03.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:14:03.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:14:03.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:04.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:03 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2945552013' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T22:14:04.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:04.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:04.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:14:04.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:14:04.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:14:04.387 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-15T22:14:04.650 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:04.963 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:04 smithi045 ceph-mon[31180]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:04.963 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:04 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2945552013' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:14:04.963 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:04 smithi045 ceph-mon[31180]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:14:04.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:04 smithi165 ceph-mon[35551]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:04.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:04 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2945552013' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:14:04.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:04 smithi165 ceph-mon[35551]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:14:04.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:04 smithi100 ceph-mon[35319]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:04.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:04 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2945552013' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T22:14:04.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:04 smithi100 ceph-mon[35319]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T22:14:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.161+0000 7f005d707640 1 -- 172.21.15.45:0/3916193153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0058100c80 msgr2=0x7f0058110890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.161+0000 7f005d707640 1 --2- 172.21.15.45:0/3916193153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0058100c80 0x7f0058110890 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0050009900 tx=0x7f005002a410 comp rx=0 tx=0).stop 2024-09-15T22:14:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.161+0000 7f005d707640 1 -- 172.21.15.45:0/3916193153 shutdown_connections 2024-09-15T22:14:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.161+0000 7f005d707640 1 --2- 172.21.15.45:0/3916193153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0058100c80 0x7f0058110890 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:05.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.161+0000 7f005d707640 1 --2- 172.21.15.45:0/3916193153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0058100100 0x7f0058100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:05.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.161+0000 7f005d707640 1 --2- 172.21.15.45:0/3916193153 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0058102a50 0x7f0058102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:05.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.161+0000 7f005d707640 1 -- 172.21.15.45:0/3916193153 >> 172.21.15.45:0/3916193153 conn(0x7f0058077230 msgr2=0x7f00580fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:05.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.161+0000 7f005d707640 1 -- 172.21.15.45:0/3916193153 shutdown_connections 2024-09-15T22:14:05.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.161+0000 7f005d707640 1 -- 172.21.15.45:0/3916193153 wait complete. 2024-09-15T22:14:05.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.161+0000 7f005d707640 1 Processor -- start 2024-09-15T22:14:05.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f005d707640 1 -- start start 2024-09-15T22:14:05.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f005d707640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0058100100 0x7f005819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:05.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f005d707640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0058100c80 0x7f005819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:05.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f005d707640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0058102a50 0x7f005819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:05.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f005d707640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0058114270 con 0x7f0058100c80 2024-09-15T22:14:05.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f005d707640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f00581140f0 con 0x7f0058100100 2024-09-15T22:14:05.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f005d707640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f00581143f0 con 0x7f0058102a50 2024-09-15T22:14:05.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f00567fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0058100c80 0x7f005819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:05.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f00567fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0058100c80 0x7f005819abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51878/0 (socket says 172.21.15.45:51878) 2024-09-15T22:14:05.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f00567fc640 1 -- 172.21.15.45:0/3997134511 learned_addr learned my addr 172.21.15.45:0/3997134511 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:05.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f00577fe640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0058102a50 0x7f005819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f0056ffd640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0058100100 0x7f005819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f00567fc640 1 -- 172.21.15.45:0/3997134511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0058102a50 msgr2=0x7f005819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f00567fc640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0058102a50 0x7f005819ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f00567fc640 1 -- 172.21.15.45:0/3997134511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0058100100 msgr2=0x7f005819a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f00567fc640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0058100100 0x7f005819a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f00567fc640 1 -- 172.21.15.45:0/3997134511 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005819f640 con 0x7f0058100c80 2024-09-15T22:14:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.162+0000 7f00567fc640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0058100c80 0x7f005819abd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c890 tx=0x7f004c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.163+0000 7f003ffff640 1 -- 172.21.15.45:0/3997134511 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c004220 con 0x7f0058100c80 2024-09-15T22:14:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.163+0000 7f005d707640 1 -- 172.21.15.45:0/3997134511 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005819f930 con 0x7f0058100c80 2024-09-15T22:14:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.163+0000 7f003ffff640 1 -- 172.21.15.45:0/3997134511 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f004c0043c0 con 0x7f0058100c80 2024-09-15T22:14:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.163+0000 7f003ffff640 1 -- 172.21.15.45:0/3997134511 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c004b10 con 0x7f0058100c80 2024-09-15T22:14:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.163+0000 7f005d707640 1 -- 172.21.15.45:0/3997134511 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00581a7210 con 0x7f0058100c80 2024-09-15T22:14:05.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.164+0000 7f005d707640 1 -- 172.21.15.45:0/3997134511 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0058100520 con 0x7f0058100c80 2024-09-15T22:14:05.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.166+0000 7f003ffff640 1 -- 172.21.15.45:0/3997134511 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f004c0051b0 con 0x7f0058100c80 2024-09-15T22:14:05.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.167+0000 7f003ffff640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00400a3240 0x7f00400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:05.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.167+0000 7f0056ffd640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00400a3240 0x7f00400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:05.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.167+0000 7f003ffff640 1 -- 172.21.15.45:0/3997134511 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7f004c0cf730 con 0x7f0058100c80 2024-09-15T22:14:05.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.167+0000 7f0056ffd640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00400a3240 0x7f00400a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f004800a300 tx=0x7f004800a290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:05.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.170+0000 7f003ffff640 1 -- 172.21.15.45:0/3997134511 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f004c014030 con 0x7f0058100c80 2024-09-15T22:14:05.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.348+0000 7f005d707640 1 -- 172.21.15.45:0/3997134511 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f005819b9f0 con 0x7f0058100c80 2024-09-15T22:14:05.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.781+0000 7f003ffff640 1 -- 172.21.15.45:0/3997134511 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v79) ==== 171+0+0 (secure 0 0 0) 0x7f005819b9f0 con 0x7f0058100c80 2024-09-15T22:14:05.784 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2024-09-15T22:14:05.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.784+0000 7f005d707640 1 -- 172.21.15.45:0/3997134511 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00400a3240 msgr2=0x7f00400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:05.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.784+0000 7f005d707640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00400a3240 0x7f00400a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f004800a300 tx=0x7f004800a290 comp rx=0 tx=0).stop 2024-09-15T22:14:05.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.784+0000 7f005d707640 1 -- 172.21.15.45:0/3997134511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0058100c80 msgr2=0x7f005819abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:05.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.784+0000 7f005d707640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0058100c80 0x7f005819abd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c890 tx=0x7f004c00cd50 comp rx=0 tx=0).stop 2024-09-15T22:14:05.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.784+0000 7f005d707640 1 -- 172.21.15.45:0/3997134511 shutdown_connections 2024-09-15T22:14:05.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.784+0000 7f005d707640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00400a3240 0x7f00400a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:05.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.784+0000 7f005d707640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0058102a50 0x7f005819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:05.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.784+0000 7f005d707640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0058100c80 0x7f005819abd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:05.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.784+0000 7f005d707640 1 --2- 172.21.15.45:0/3997134511 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0058100100 0x7f005819a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:05.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.784+0000 7f005d707640 1 -- 172.21.15.45:0/3997134511 >> 172.21.15.45:0/3997134511 conn(0x7f0058077230 msgr2=0x7f00580fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:05.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.784+0000 7f005d707640 1 -- 172.21.15.45:0/3997134511 shutdown_connections 2024-09-15T22:14:05.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:05.784+0000 7f005d707640 1 -- 172.21.15.45:0/3997134511 wait complete. 2024-09-15T22:14:06.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:05 smithi045 ceph-mon[31180]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:14:06.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:05 smithi165 ceph-mon[35551]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:14:06.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:05 smithi100 ceph-mon[35319]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T22:14:06.502 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:14:06.764 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:06.805 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:06 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3997134511' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-15T22:14:06.806 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:06 smithi045 ceph-mon[31180]: pgmap v273: 33 pgs: 6 active+clean, 7 creating+peering, 20 unknown; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:06.806 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:06 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3997134511' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-15T22:14:06.806 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:06 smithi045 ceph-mon[31180]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:14:06.806 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:06 smithi045 ceph-mon[31180]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:14:07.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:06 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3997134511' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-15T22:14:07.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:06 smithi165 ceph-mon[35551]: pgmap v273: 33 pgs: 6 active+clean, 7 creating+peering, 20 unknown; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:07.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:06 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3997134511' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-15T22:14:07.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:06 smithi165 ceph-mon[35551]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:14:07.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:06 smithi165 ceph-mon[35551]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:14:07.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:06 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3997134511' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-15T22:14:07.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:06 smithi100 ceph-mon[35319]: pgmap v273: 33 pgs: 6 active+clean, 7 creating+peering, 20 unknown; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:07.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:06 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3997134511' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-15T22:14:07.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:06 smithi100 ceph-mon[35319]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T22:14:07.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:06 smithi100 ceph-mon[35319]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:14:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.257+0000 7f63b853b640 1 -- 172.21.15.45:0/127135553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b010c1a0 msgr2=0x7f63b010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.257+0000 7f63b853b640 1 --2- 172.21.15.45:0/127135553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b010c1a0 0x7f63b010e610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f63a8009ca0 tx=0x7f63a802a950 comp rx=0 tx=0).stop 2024-09-15T22:14:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.258+0000 7f63b853b640 1 -- 172.21.15.45:0/127135553 shutdown_connections 2024-09-15T22:14:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.258+0000 7f63b853b640 1 --2- 172.21.15.45:0/127135553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b010c1a0 0x7f63b010e610 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.258+0000 7f63b853b640 1 --2- 172.21.15.45:0/127135553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63b0103720 0x7f63b010bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.258+0000 7f63b853b640 1 --2- 172.21.15.45:0/127135553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0102e00 0x7f63b01031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.258+0000 7f63b853b640 1 -- 172.21.15.45:0/127135553 >> 172.21.15.45:0/127135553 conn(0x7f63b00fc780 msgr2=0x7f63b00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:07.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.258+0000 7f63b853b640 1 -- 172.21.15.45:0/127135553 shutdown_connections 2024-09-15T22:14:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.258+0000 7f63b853b640 1 -- 172.21.15.45:0/127135553 wait complete. 2024-09-15T22:14:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.258+0000 7f63b853b640 1 Processor -- start 2024-09-15T22:14:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.258+0000 7f63b853b640 1 -- start start 2024-09-15T22:14:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b853b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b0102e00 0x7f63b0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b853b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0103720 0x7f63b0198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b853b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63b010c1a0 0x7f63b019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b853b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f63b0112090 con 0x7f63b0102e00 2024-09-15T22:14:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b853b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63b0111f10 con 0x7f63b0103720 2024-09-15T22:14:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b853b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f63b0112210 con 0x7f63b010c1a0 2024-09-15T22:14:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b62d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b0102e00 0x7f63b0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b62d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b0102e00 0x7f63b0198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51894/0 (socket says 172.21.15.45:51894) 2024-09-15T22:14:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b62d7640 1 -- 172.21.15.45:0/1474378156 learned_addr learned my addr 172.21.15.45:0/1474378156 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:07.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b5ad6640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0103720 0x7f63b0198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b6ad8640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63b010c1a0 0x7f63b019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b62d7640 1 -- 172.21.15.45:0/1474378156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63b010c1a0 msgr2=0x7f63b019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b62d7640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63b010c1a0 0x7f63b019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b62d7640 1 -- 172.21.15.45:0/1474378156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0103720 msgr2=0x7f63b0198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b62d7640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0103720 0x7f63b0198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b62d7640 1 -- 172.21.15.45:0/1474378156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b019d3f0 con 0x7f63b0102e00 2024-09-15T22:14:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.259+0000 7f63b62d7640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b0102e00 0x7f63b0198440 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00c920 tx=0x7f63ac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.260+0000 7f63a77fe640 1 -- 172.21.15.45:0/1474378156 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac007c70 con 0x7f63b0102e00 2024-09-15T22:14:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.260+0000 7f63b853b640 1 -- 172.21.15.45:0/1474378156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b019d6e0 con 0x7f63b0102e00 2024-09-15T22:14:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.260+0000 7f63a77fe640 1 -- 172.21.15.45:0/1474378156 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63ac007e10 con 0x7f63b0102e00 2024-09-15T22:14:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.260+0000 7f63a77fe640 1 -- 172.21.15.45:0/1474378156 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac018940 con 0x7f63b0102e00 2024-09-15T22:14:07.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.260+0000 7f63b853b640 1 -- 172.21.15.45:0/1474378156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b01a4fc0 con 0x7f63b0102e00 2024-09-15T22:14:07.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.261+0000 7f63b853b640 1 -- 172.21.15.45:0/1474378156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b01031e0 con 0x7f63b0102e00 2024-09-15T22:14:07.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.262+0000 7f63a77fe640 1 -- 172.21.15.45:0/1474378156 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f63ac018be0 con 0x7f63b0102e00 2024-09-15T22:14:07.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.263+0000 7f63a77fe640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f639c0a3240 0x7f639c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:07.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.263+0000 7f63b5ad6640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f639c0a3240 0x7f639c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:07.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.263+0000 7f63a77fe640 1 -- 172.21.15.45:0/1474378156 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f63ac0cf9d0 con 0x7f63b0102e00 2024-09-15T22:14:07.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.263+0000 7f63b5ad6640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f639c0a3240 0x7f639c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f63a0005fd0 tx=0x7f63a000b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:07.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.267+0000 7f63a77fe640 1 -- 172.21.15.45:0/1474378156 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f63ac014030 con 0x7f63b0102e00 2024-09-15T22:14:07.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.478+0000 7f63b853b640 1 -- 172.21.15.45:0/1474378156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f63b01a52c0 con 0x7f63b0102e00 2024-09-15T22:14:07.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.804+0000 7f63a77fe640 1 -- 172.21.15.45:0/1474378156 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f63ac09c800 con 0x7f63b0102e00 2024-09-15T22:14:07.806 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T22:14:07.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.806+0000 7f63b853b640 1 -- 172.21.15.45:0/1474378156 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f639c0a3240 msgr2=0x7f639c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:07.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.806+0000 7f63b853b640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f639c0a3240 0x7f639c0a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f63a0005fd0 tx=0x7f63a000b510 comp rx=0 tx=0).stop 2024-09-15T22:14:07.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.806+0000 7f63b853b640 1 -- 172.21.15.45:0/1474378156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b0102e00 msgr2=0x7f63b0198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:07.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.806+0000 7f63b853b640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b0102e00 0x7f63b0198440 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f63ac00c920 tx=0x7f63ac00cde0 comp rx=0 tx=0).stop 2024-09-15T22:14:07.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.806+0000 7f63b853b640 1 -- 172.21.15.45:0/1474378156 shutdown_connections 2024-09-15T22:14:07.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.806+0000 7f63b853b640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f639c0a3240 0x7f639c0a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:07.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.806+0000 7f63b853b640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63b010c1a0 0x7f63b019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:07.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.806+0000 7f63b853b640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63b0103720 0x7f63b0198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:07.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.806+0000 7f63b853b640 1 --2- 172.21.15.45:0/1474378156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63b0102e00 0x7f63b0198440 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:07.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.806+0000 7f63b853b640 1 -- 172.21.15.45:0/1474378156 >> 172.21.15.45:0/1474378156 conn(0x7f63b00fc780 msgr2=0x7f63b00fde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:07.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.806+0000 7f63b853b640 1 -- 172.21.15.45:0/1474378156 shutdown_connections 2024-09-15T22:14:07.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:07.806+0000 7f63b853b640 1 -- 172.21.15.45:0/1474378156 wait complete. 2024-09-15T22:14:08.188 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:07 smithi045 ceph-mon[31180]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:14:08.188 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:07 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1474378156' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:14:08.188 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:07 smithi045 ceph-mon[31180]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T22:14:08.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:07 smithi165 ceph-mon[35551]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:14:08.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:07 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1474378156' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:14:08.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:07 smithi165 ceph-mon[35551]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T22:14:08.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:07 smithi100 ceph-mon[35319]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T22:14:08.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:07 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1474378156' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T22:14:08.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:07 smithi100 ceph-mon[35319]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-15T22:14:08.488 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-15T22:14:08.488 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-15T22:14:08.747 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:09.159 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:08 smithi045 ceph-mon[31180]: pgmap v276: 97 pgs: 26 active+clean, 22 creating+peering, 49 unknown; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:09.160 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:08 smithi045 ceph-mon[31180]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:14:09.160 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:08 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1474378156' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:14:09.160 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:08 smithi045 ceph-mon[31180]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T22:14:09.160 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:08 smithi045 ceph-mon[31180]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T22:14:09.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:08 smithi165 ceph-mon[35551]: pgmap v276: 97 pgs: 26 active+clean, 22 creating+peering, 49 unknown; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:09.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:08 smithi165 ceph-mon[35551]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:14:09.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:08 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1474378156' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:14:09.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:08 smithi165 ceph-mon[35551]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T22:14:09.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:08 smithi165 ceph-mon[35551]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T22:14:09.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:08 smithi100 ceph-mon[35319]: pgmap v276: 97 pgs: 26 active+clean, 22 creating+peering, 49 unknown; 577 KiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:09.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:08 smithi100 ceph-mon[35319]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T22:14:09.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:08 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1474378156' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T22:14:09.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:08 smithi100 ceph-mon[35319]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-15T22:14:09.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:08 smithi100 ceph-mon[35319]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-15T22:14:09.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.245+0000 7f88f5673640 1 -- 172.21.15.45:0/3794398168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88f0102790 msgr2=0x7f88f01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:09.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.245+0000 7f88f5673640 1 --2- 172.21.15.45:0/3794398168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88f0102790 0x7f88f01067e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009900 tx=0x7f88d802a410 comp rx=0 tx=0).stop 2024-09-15T22:14:09.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.245+0000 7f88f5673640 1 -- 172.21.15.45:0/3794398168 shutdown_connections 2024-09-15T22:14:09.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.245+0000 7f88f5673640 1 --2- 172.21.15.45:0/3794398168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88f0106f10 0x7f88f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.245+0000 7f88f5673640 1 --2- 172.21.15.45:0/3794398168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88f0102790 0x7f88f01067e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.245+0000 7f88f5673640 1 --2- 172.21.15.45:0/3794398168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f0101de0 0x7f88f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.245+0000 7f88f5673640 1 -- 172.21.15.45:0/3794398168 >> 172.21.15.45:0/3794398168 conn(0x7f88f00fd8c0 msgr2=0x7f88f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.245+0000 7f88f5673640 1 -- 172.21.15.45:0/3794398168 shutdown_connections 2024-09-15T22:14:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.245+0000 7f88f5673640 1 -- 172.21.15.45:0/3794398168 wait complete. 2024-09-15T22:14:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.246+0000 7f88f5673640 1 Processor -- start 2024-09-15T22:14:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.246+0000 7f88f5673640 1 -- start start 2024-09-15T22:14:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.246+0000 7f88f5673640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f0101de0 0x7f88f00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.246+0000 7f88f5673640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88f0102790 0x7f88f0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.246+0000 7f88f5673640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88f0106f10 0x7f88f0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.246+0000 7f88f5673640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f88f0112140 con 0x7f88f0106f10 2024-09-15T22:14:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.246+0000 7f88f5673640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f88f0111fc0 con 0x7f88f0101de0 2024-09-15T22:14:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.246+0000 7f88f5673640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f88f01122c0 con 0x7f88f0102790 2024-09-15T22:14:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.246+0000 7f88ef7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88f0106f10 0x7f88f0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.246+0000 7f88ef7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88f0106f10 0x7f88f0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51908/0 (socket says 172.21.15.45:51908) 2024-09-15T22:14:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.246+0000 7f88ef7fe640 1 -- 172.21.15.45:0/2278519827 learned_addr learned my addr 172.21.15.45:0/2278519827 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.247+0000 7f88eeffd640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f0101de0 0x7f88f00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.247+0000 7f88ef7fe640 1 -- 172.21.15.45:0/2278519827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88f0102790 msgr2=0x7f88f0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.247+0000 7f88ef7fe640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88f0102790 0x7f88f0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.247+0000 7f88ef7fe640 1 -- 172.21.15.45:0/2278519827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f0101de0 msgr2=0x7f88f00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.247+0000 7f88ef7fe640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f0101de0 0x7f88f00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.247+0000 7f88ef7fe640 1 -- 172.21.15.45:0/2278519827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f01a69e0 con 0x7f88f0106f10 2024-09-15T22:14:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.247+0000 7f88eeffd640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f0101de0 0x7f88f00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.247+0000 7f88ef7fe640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88f0106f10 0x7f88f0074f70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f88e800b990 tx=0x7f88e800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.247+0000 7f88ecff9640 1 -- 172.21.15.45:0/2278519827 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e8019070 con 0x7f88f0106f10 2024-09-15T22:14:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.247+0000 7f88ecff9640 1 -- 172.21.15.45:0/2278519827 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f88e800cba0 con 0x7f88f0106f10 2024-09-15T22:14:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.247+0000 7f88ecff9640 1 -- 172.21.15.45:0/2278519827 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e8007770 con 0x7f88f0106f10 2024-09-15T22:14:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.247+0000 7f88f5673640 1 -- 172.21.15.45:0/2278519827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f01a6cd0 con 0x7f88f0106f10 2024-09-15T22:14:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.247+0000 7f88f5673640 1 -- 172.21.15.45:0/2278519827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f01a71c0 con 0x7f88f0106f10 2024-09-15T22:14:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.248+0000 7f88f5673640 1 -- 172.21.15.45:0/2278519827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f01021c0 con 0x7f88f0106f10 2024-09-15T22:14:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.249+0000 7f88ecff9640 1 -- 172.21.15.45:0/2278519827 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f88e801c070 con 0x7f88f0106f10 2024-09-15T22:14:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.250+0000 7f88ecff9640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f88dc0a32c0 0x7f88dc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.250+0000 7f88eeffd640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f88dc0a32c0 0x7f88dc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.250+0000 7f88ecff9640 1 -- 172.21.15.45:0/2278519827 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f88e80cedf0 con 0x7f88f0106f10 2024-09-15T22:14:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.250+0000 7f88eeffd640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f88dc0a32c0 0x7f88dc0a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f88e000baa0 tx=0x7f88e0005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.254+0000 7f88ecff9640 1 -- 172.21.15.45:0/2278519827 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f88e809bc60 con 0x7f88f0106f10 2024-09-15T22:14:09.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.439+0000 7f88f5673640 1 -- 172.21.15.45:0/2278519827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f88f0109b60 con 0x7f88f0106f10 2024-09-15T22:14:09.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.815+0000 7f88ecff9640 1 -- 172.21.15.45:0/2278519827 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v82) ==== 157+0+0 (secure 0 0 0) 0x7f88e809b560 con 0x7f88f0106f10 2024-09-15T22:14:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.818+0000 7f88f5673640 1 -- 172.21.15.45:0/2278519827 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f88dc0a32c0 msgr2=0x7f88dc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.818+0000 7f88f5673640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f88dc0a32c0 0x7f88dc0a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f88e000baa0 tx=0x7f88e0005d90 comp rx=0 tx=0).stop 2024-09-15T22:14:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.818+0000 7f88f5673640 1 -- 172.21.15.45:0/2278519827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88f0106f10 msgr2=0x7f88f0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.818+0000 7f88f5673640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88f0106f10 0x7f88f0074f70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f88e800b990 tx=0x7f88e800be50 comp rx=0 tx=0).stop 2024-09-15T22:14:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.818+0000 7f88f5673640 1 -- 172.21.15.45:0/2278519827 shutdown_connections 2024-09-15T22:14:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.818+0000 7f88f5673640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f88dc0a32c0 0x7f88dc0a5780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.818+0000 7f88f5673640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88f0106f10 0x7f88f0074f70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.818+0000 7f88f5673640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f88f0102790 0x7f88f0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.818+0000 7f88f5673640 1 --2- 172.21.15.45:0/2278519827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88f0101de0 0x7f88f00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.818+0000 7f88f5673640 1 -- 172.21.15.45:0/2278519827 >> 172.21.15.45:0/2278519827 conn(0x7f88f00fd8c0 msgr2=0x7f88f00fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.819+0000 7f88f5673640 1 -- 172.21.15.45:0/2278519827 shutdown_connections 2024-09-15T22:14:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:09.819+0000 7f88f5673640 1 -- 172.21.15.45:0/2278519827 wait complete. 2024-09-15T22:14:10.181 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:09 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] up:active 2024-09-15T22:14:10.181 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:09 smithi045 ceph-mon[31180]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:10.181 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:09 smithi045 ceph-mon[31180]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:10.182 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:09 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2278519827' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-15T22:14:10.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:09 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] up:active 2024-09-15T22:14:10.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:09 smithi165 ceph-mon[35551]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:10.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:09 smithi165 ceph-mon[35551]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:10.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:09 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2278519827' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-15T22:14:10.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:09 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] up:active 2024-09-15T22:14:10.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:09 smithi100 ceph-mon[35319]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:10.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:09 smithi100 ceph-mon[35319]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:10.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:09 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2278519827' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-15T22:14:10.527 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:14:10.789 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:11.080 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:10 smithi045 ceph-mon[31180]: pgmap v278: 97 pgs: 48 active+clean, 18 creating+peering, 31 unknown; 577 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 0 op/s 2024-09-15T22:14:11.080 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:10 smithi045 ceph-mon[31180]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:14:11.080 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:10 smithi045 ceph-mon[31180]: Cluster is now healthy 2024-09-15T22:14:11.080 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:10 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2278519827' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-15T22:14:11.080 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:10 smithi045 ceph-mon[31180]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:14:11.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:10 smithi165 ceph-mon[35551]: pgmap v278: 97 pgs: 48 active+clean, 18 creating+peering, 31 unknown; 577 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 0 op/s 2024-09-15T22:14:11.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:10 smithi165 ceph-mon[35551]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:14:11.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:10 smithi165 ceph-mon[35551]: Cluster is now healthy 2024-09-15T22:14:11.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:10 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2278519827' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-15T22:14:11.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:10 smithi165 ceph-mon[35551]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:14:11.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:10 smithi100 ceph-mon[35319]: pgmap v278: 97 pgs: 48 active+clean, 18 creating+peering, 31 unknown; 577 KiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 0 op/s 2024-09-15T22:14:11.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:10 smithi100 ceph-mon[35319]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T22:14:11.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:10 smithi100 ceph-mon[35319]: Cluster is now healthy 2024-09-15T22:14:11.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:10 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2278519827' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-15T22:14:11.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:10 smithi100 ceph-mon[35319]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T22:14:11.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.292+0000 7f329d2e8640 1 -- 172.21.15.45:0/47338553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32981036e0 msgr2=0x7f3298107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:11.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.292+0000 7f329d2e8640 1 --2- 172.21.15.45:0/47338553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32981036e0 0x7f3298107b90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f328c009930 tx=0x7f328c02a420 comp rx=0 tx=0).stop 2024-09-15T22:14:11.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.292+0000 7f329d2e8640 1 -- 172.21.15.45:0/47338553 shutdown_connections 2024-09-15T22:14:11.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.292+0000 7f329d2e8640 1 --2- 172.21.15.45:0/47338553 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32981082a0 0x7f329810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:11.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.292+0000 7f329d2e8640 1 --2- 172.21.15.45:0/47338553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32981036e0 0x7f3298107b90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:11.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.292+0000 7f329d2e8640 1 --2- 172.21.15.45:0/47338553 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3298102d30 0x7f3298103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:11.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.292+0000 7f329d2e8640 1 -- 172.21.15.45:0/47338553 >> 172.21.15.45:0/47338553 conn(0x7f32980fc7d0 msgr2=0x7f32980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:11.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.292+0000 7f329d2e8640 1 -- 172.21.15.45:0/47338553 shutdown_connections 2024-09-15T22:14:11.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.292+0000 7f329d2e8640 1 -- 172.21.15.45:0/47338553 wait complete. 2024-09-15T22:14:11.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.292+0000 7f329d2e8640 1 Processor -- start 2024-09-15T22:14:11.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.292+0000 7f329d2e8640 1 -- start start 2024-09-15T22:14:11.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f329d2e8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3298102d30 0x7f32981a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:11.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f329d2e8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32981036e0 0x7f32981a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:11.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f329d2e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32981082a0 0x7f329819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:11.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f329d2e8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3298112200 con 0x7f32981082a0 2024-09-15T22:14:11.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f329d2e8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3298112080 con 0x7f3298102d30 2024-09-15T22:14:11.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f329d2e8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3298112380 con 0x7f32981036e0 2024-09-15T22:14:11.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f32977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32981082a0 0x7f329819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:11.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f32977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32981082a0 0x7f329819a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51924/0 (socket says 172.21.15.45:51924) 2024-09-15T22:14:11.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f32977fe640 1 -- 172.21.15.45:0/3943223084 learned_addr learned my addr 172.21.15.45:0/3943223084 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:11.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f3296ffd640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3298102d30 0x7f32981a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f32967fc640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32981036e0 0x7f32981a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f32977fe640 1 -- 172.21.15.45:0/3943223084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32981036e0 msgr2=0x7f32981a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f32977fe640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32981036e0 0x7f32981a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f32977fe640 1 -- 172.21.15.45:0/3943223084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3298102d30 msgr2=0x7f32981a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f32977fe640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3298102d30 0x7f32981a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f32977fe640 1 -- 172.21.15.45:0/3943223084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f329819af80 con 0x7f32981082a0 2024-09-15T22:14:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f32967fc640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32981036e0 0x7f32981a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f32977fe640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32981082a0 0x7f329819a710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f329000c970 tx=0x7f329000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f327ffff640 1 -- 172.21.15.45:0/3943223084 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290007bb0 con 0x7f32981082a0 2024-09-15T22:14:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.293+0000 7f329d2e8640 1 -- 172.21.15.45:0/3943223084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f329819b270 con 0x7f32981082a0 2024-09-15T22:14:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.294+0000 7f327ffff640 1 -- 172.21.15.45:0/3943223084 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3290007d50 con 0x7f32981082a0 2024-09-15T22:14:11.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.294+0000 7f327ffff640 1 -- 172.21.15.45:0/3943223084 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329000f450 con 0x7f32981082a0 2024-09-15T22:14:11.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.294+0000 7f329d2e8640 1 -- 172.21.15.45:0/3943223084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32981a75c0 con 0x7f32981082a0 2024-09-15T22:14:11.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.294+0000 7f329d2e8640 1 -- 172.21.15.45:0/3943223084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f329806a850 con 0x7f32981082a0 2024-09-15T22:14:11.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.296+0000 7f327ffff640 1 -- 172.21.15.45:0/3943223084 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3290005020 con 0x7f32981082a0 2024-09-15T22:14:11.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.296+0000 7f327ffff640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32800a3240 0x7f32800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.296+0000 7f3296ffd640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32800a3240 0x7f32800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.296+0000 7f327ffff640 1 -- 172.21.15.45:0/3943223084 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8277+0+0 (secure 0 0 0) 0x7f32900cf660 con 0x7f32981082a0 2024-09-15T22:14:11.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.297+0000 7f3296ffd640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32800a3240 0x7f32800a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f328800a400 tx=0x7f328800d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:11.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.301+0000 7f327ffff640 1 -- 172.21.15.45:0/3943223084 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3290014030 con 0x7f32981082a0 2024-09-15T22:14:11.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:11.477+0000 7f329d2e8640 1 -- 172.21.15.45:0/3943223084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f329819bc40 con 0x7f32981082a0 2024-09-15T22:14:12.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:11 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3943223084' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:14:12.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:11 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3943223084' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:14:12.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:11 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3943223084' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T22:14:12.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:12.824+0000 7f327ffff640 1 -- 172.21.15.45:0/3943223084 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v84) ==== 228+0+0 (secure 0 0 0) 0x7f329009c350 con 0x7f32981082a0 2024-09-15T22:14:12.828 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_ec' created 2024-09-15T22:14:12.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:12.827+0000 7f329d2e8640 1 -- 172.21.15.45:0/3943223084 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32800a3240 msgr2=0x7f32800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:12.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:12.827+0000 7f329d2e8640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32800a3240 0x7f32800a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f328800a400 tx=0x7f328800d040 comp rx=0 tx=0).stop 2024-09-15T22:14:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:12.827+0000 7f329d2e8640 1 -- 172.21.15.45:0/3943223084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32981082a0 msgr2=0x7f329819a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:12.827+0000 7f329d2e8640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32981082a0 0x7f329819a710 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f329000c970 tx=0x7f329000ce30 comp rx=0 tx=0).stop 2024-09-15T22:14:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:12.827+0000 7f329d2e8640 1 -- 172.21.15.45:0/3943223084 shutdown_connections 2024-09-15T22:14:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:12.827+0000 7f329d2e8640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f32800a3240 0x7f32800a5700 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f328800a400 tx=0x7f328800d040 comp rx=0 tx=0).stop 2024-09-15T22:14:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:12.827+0000 7f329d2e8640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32981082a0 0x7f329819a710 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:12.827+0000 7f329d2e8640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f32981036e0 0x7f32981a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:12.827+0000 7f329d2e8640 1 --2- 172.21.15.45:0/3943223084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3298102d30 0x7f32981a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:12.827+0000 7f329d2e8640 1 -- 172.21.15.45:0/3943223084 >> 172.21.15.45:0/3943223084 conn(0x7f32980fc7d0 msgr2=0x7f3298100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:12.828+0000 7f329d2e8640 1 -- 172.21.15.45:0/3943223084 shutdown_connections 2024-09-15T22:14:12.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:12.828+0000 7f329d2e8640 1 -- 172.21.15.45:0/3943223084 wait complete. 2024-09-15T22:14:12.844 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:12 smithi045 ceph-mon[31180]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2024-09-15T22:14:12.844 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:12 smithi045 ceph-mon[31180]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:14:13.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:12 smithi165 ceph-mon[35551]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2024-09-15T22:14:13.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:12 smithi165 ceph-mon[35551]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:14:13.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:12 smithi100 ceph-mon[35319]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 7 op/s 2024-09-15T22:14:13.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:12 smithi100 ceph-mon[35319]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T22:14:13.244 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:14:12 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-b[65376]: 2024-09-15T22:14:12.968+0000 7fac8c08e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:14:13.489 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-15T22:14:13.750 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:14.197 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:13 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3943223084' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:14:14.197 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:13 smithi045 ceph-mon[31180]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:14:14.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:13 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3943223084' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:14:14.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:13 smithi165 ceph-mon[35551]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:14:14.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:13 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3943223084' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T22:14:14.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:13 smithi100 ceph-mon[35319]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T22:14:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.285+0000 7fa330120640 1 -- 172.21.15.45:0/1269262714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3281082a0 msgr2=0x7fa32810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.285+0000 7fa330120640 1 --2- 172.21.15.45:0/1269262714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3281082a0 0x7fa32810ec40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa320009cd0 tx=0x7fa32002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:14:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.285+0000 7fa330120640 1 -- 172.21.15.45:0/1269262714 shutdown_connections 2024-09-15T22:14:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.285+0000 7fa330120640 1 --2- 172.21.15.45:0/1269262714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3281082a0 0x7fa32810ec40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.285+0000 7fa330120640 1 --2- 172.21.15.45:0/1269262714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3281036e0 0x7fa328107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.285+0000 7fa330120640 1 --2- 172.21.15.45:0/1269262714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa328102d30 0x7fa328103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.285+0000 7fa330120640 1 -- 172.21.15.45:0/1269262714 >> 172.21.15.45:0/1269262714 conn(0x7fa3280fc7d0 msgr2=0x7fa3280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.285+0000 7fa330120640 1 -- 172.21.15.45:0/1269262714 shutdown_connections 2024-09-15T22:14:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.285+0000 7fa330120640 1 -- 172.21.15.45:0/1269262714 wait complete. 2024-09-15T22:14:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.285+0000 7fa330120640 1 Processor -- start 2024-09-15T22:14:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa330120640 1 -- start start 2024-09-15T22:14:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa330120640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa328102d30 0x7fa328100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa330120640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3281036e0 0x7fa328100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa330120640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3281082a0 0x7fa328101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa330120640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa3281121c0 con 0x7fa3281036e0 2024-09-15T22:14:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa330120640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa328112040 con 0x7fa328102d30 2024-09-15T22:14:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa330120640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa328112340 con 0x7fa3281082a0 2024-09-15T22:14:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa32d6bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3281036e0 0x7fa328100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa32d6bb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3281036e0 0x7fa328100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58132/0 (socket says 172.21.15.45:58132) 2024-09-15T22:14:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa32d6bb640 1 -- 172.21.15.45:0/447626758 learned_addr learned my addr 172.21.15.45:0/447626758 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa32debc640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa328102d30 0x7fa328100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa32e6bd640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3281082a0 0x7fa328101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa32d6bb640 1 -- 172.21.15.45:0/447626758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3281082a0 msgr2=0x7fa328101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa32d6bb640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3281082a0 0x7fa328101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa32d6bb640 1 -- 172.21.15.45:0/447626758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa328102d30 msgr2=0x7fa328100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa32d6bb640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa328102d30 0x7fa328100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa32d6bb640 1 -- 172.21.15.45:0/447626758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3281a6b20 con 0x7fa3281036e0 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa32e6bd640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3281082a0 0x7fa328101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.286+0000 7fa32d6bb640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3281036e0 0x7fa328100ed0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa31800d740 tx=0x7fa31800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.287+0000 7fa31effd640 1 -- 172.21.15.45:0/447626758 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318017070 con 0x7fa3281036e0 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.287+0000 7fa330120640 1 -- 172.21.15.45:0/447626758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3281a6e10 con 0x7fa3281036e0 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.287+0000 7fa31effd640 1 -- 172.21.15.45:0/447626758 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa31800de50 con 0x7fa3281036e0 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.287+0000 7fa31effd640 1 -- 172.21.15.45:0/447626758 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31800f740 con 0x7fa3281036e0 2024-09-15T22:14:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.287+0000 7fa330120640 1 -- 172.21.15.45:0/447626758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3281a72c0 con 0x7fa3281036e0 2024-09-15T22:14:14.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.288+0000 7fa330120640 1 -- 172.21.15.45:0/447626758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa328103110 con 0x7fa3281036e0 2024-09-15T22:14:14.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.289+0000 7fa31effd640 1 -- 172.21.15.45:0/447626758 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa31801a070 con 0x7fa3281036e0 2024-09-15T22:14:14.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.290+0000 7fa31effd640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3140a3240 0x7fa3140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:14.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.290+0000 7fa32debc640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3140a3240 0x7fa3140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:14.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.290+0000 7fa31effd640 1 -- 172.21.15.45:0/447626758 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8770+0+0 (secure 0 0 0) 0x7fa3180cf440 con 0x7fa3281036e0 2024-09-15T22:14:14.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.290+0000 7fa32debc640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3140a3240 0x7fa3140a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa32400bbe0 tx=0x7fa32400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:14.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.293+0000 7fa31effd640 1 -- 172.21.15.45:0/447626758 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa31809bf40 con 0x7fa3281036e0 2024-09-15T22:14:14.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.467+0000 7fa330120640 1 -- 172.21.15.45:0/447626758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fa3281a7560 con 0x7fa3281036e0 2024-09-15T22:14:14.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.835+0000 7fa31effd640 1 -- 172.21.15.45:0/447626758 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v86) ==== 169+0+0 (secure 0 0 0) 0x7fa31809b840 con 0x7fa3281036e0 2024-09-15T22:14:14.838 INFO:teuthology.orchestra.run.smithi045.stderr:set pool 4 allow_ec_overwrites to true 2024-09-15T22:14:14.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.838+0000 7fa330120640 1 -- 172.21.15.45:0/447626758 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3140a3240 msgr2=0x7fa3140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:14.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.838+0000 7fa330120640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3140a3240 0x7fa3140a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa32400bbe0 tx=0x7fa32400b390 comp rx=0 tx=0).stop 2024-09-15T22:14:14.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.838+0000 7fa330120640 1 -- 172.21.15.45:0/447626758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3281036e0 msgr2=0x7fa328100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:14.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.838+0000 7fa330120640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3281036e0 0x7fa328100ed0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa31800d740 tx=0x7fa31800dc00 comp rx=0 tx=0).stop 2024-09-15T22:14:14.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.838+0000 7fa330120640 1 -- 172.21.15.45:0/447626758 shutdown_connections 2024-09-15T22:14:14.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.838+0000 7fa330120640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3140a3240 0x7fa3140a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:14.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.838+0000 7fa330120640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3281082a0 0x7fa328101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:14.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.838+0000 7fa330120640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3281036e0 0x7fa328100ed0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:14.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.838+0000 7fa330120640 1 --2- 172.21.15.45:0/447626758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa328102d30 0x7fa328100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:14.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.838+0000 7fa330120640 1 -- 172.21.15.45:0/447626758 >> 172.21.15.45:0/447626758 conn(0x7fa3280fc7d0 msgr2=0x7fa3280fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:14.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.838+0000 7fa330120640 1 -- 172.21.15.45:0/447626758 shutdown_connections 2024-09-15T22:14:14.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:14.838+0000 7fa330120640 1 -- 172.21.15.45:0/447626758 wait complete. 2024-09-15T22:14:15.160 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:14 smithi045 ceph-mon[31180]: pgmap v283: 129 pgs: 2 creating+peering, 30 unknown, 97 active+clean; 579 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-15T22:14:15.160 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:14 smithi045 ceph-mon[31180]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:14:15.160 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:14 smithi045 ceph-mon[31180]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T22:14:15.160 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:14 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/447626758' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-15T22:14:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:14 smithi165 ceph-mon[35551]: pgmap v283: 129 pgs: 2 creating+peering, 30 unknown, 97 active+clean; 579 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-15T22:14:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:14 smithi165 ceph-mon[35551]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:14:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:14 smithi165 ceph-mon[35551]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T22:14:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:14 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/447626758' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-15T22:14:15.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:14 smithi100 ceph-mon[35319]: pgmap v283: 129 pgs: 2 creating+peering, 30 unknown, 97 active+clean; 579 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 8 op/s 2024-09-15T22:14:15.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:14 smithi100 ceph-mon[35319]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T22:14:15.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:14 smithi100 ceph-mon[35319]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T22:14:15.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:14 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/447626758' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-15T22:14:15.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-15T22:14:15.751 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:16.149 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:15 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/447626758' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-15T22:14:16.149 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:15 smithi045 ceph-mon[31180]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T22:14:16.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:15 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/447626758' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-15T22:14:16.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:15 smithi165 ceph-mon[35551]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T22:14:16.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:15 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/447626758' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-15T22:14:16.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:15 smithi100 ceph-mon[35319]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T22:14:16.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.232+0000 7efc05804640 1 -- 172.21.15.45:0/903546658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc001068f0 msgr2=0x7efc00106cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:16.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.232+0000 7efc05804640 1 --2- 172.21.15.45:0/903546658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc001068f0 0x7efc00106cd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009930 tx=0x7efbf002a420 comp rx=0 tx=0).stop 2024-09-15T22:14:16.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.232+0000 7efc05804640 1 -- 172.21.15.45:0/903546658 shutdown_connections 2024-09-15T22:14:16.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.232+0000 7efc05804640 1 --2- 172.21.15.45:0/903546658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00101290 0x7efc0010d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.232+0000 7efc05804640 1 --2- 172.21.15.45:0/903546658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc001008f0 0x7efc00100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.232+0000 7efc05804640 1 --2- 172.21.15.45:0/903546658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc001068f0 0x7efc00106cd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.232+0000 7efc05804640 1 -- 172.21.15.45:0/903546658 >> 172.21.15.45:0/903546658 conn(0x7efc000fc630 msgr2=0x7efc000fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:16.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.232+0000 7efc05804640 1 -- 172.21.15.45:0/903546658 shutdown_connections 2024-09-15T22:14:16.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.232+0000 7efc05804640 1 -- 172.21.15.45:0/903546658 wait complete. 2024-09-15T22:14:16.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.233+0000 7efc05804640 1 Processor -- start 2024-09-15T22:14:16.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.233+0000 7efc05804640 1 -- start start 2024-09-15T22:14:16.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.233+0000 7efc05804640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc001008f0 0x7efc00199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:16.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.233+0000 7efc05804640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00101290 0x7efc00199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:16.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.233+0000 7efc05804640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc001068f0 0x7efc001a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:16.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.233+0000 7efc05804640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7efc00110e10 con 0x7efc001068f0 2024-09-15T22:14:16.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.233+0000 7efc05804640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efc00110c90 con 0x7efc00101290 2024-09-15T22:14:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.233+0000 7efc05804640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efc00110f90 con 0x7efc001008f0 2024-09-15T22:14:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.233+0000 7efbff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc001068f0 0x7efc001a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efbff7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc001068f0 0x7efc001a42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58142/0 (socket says 172.21.15.45:58142) 2024-09-15T22:14:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efbff7fe640 1 -- 172.21.15.45:0/2796572748 learned_addr learned my addr 172.21.15.45:0/2796572748 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efbfe7fc640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00101290 0x7efc00199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efbfeffd640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc001008f0 0x7efc00199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efbff7fe640 1 -- 172.21.15.45:0/2796572748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc001008f0 msgr2=0x7efc00199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efbff7fe640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc001008f0 0x7efc00199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efbff7fe640 1 -- 172.21.15.45:0/2796572748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00101290 msgr2=0x7efc00199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efbff7fe640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00101290 0x7efc00199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efbff7fe640 1 -- 172.21.15.45:0/2796572748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc001a4800 con 0x7efc001068f0 2024-09-15T22:14:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efbfeffd640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc001008f0 0x7efc00199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:14:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efbff7fe640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc001068f0 0x7efc001a42c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efbf800eaa0 tx=0x7efbf800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:16.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efc04802640 1 -- 172.21.15.45:0/2796572748 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf800cdb0 con 0x7efc001068f0 2024-09-15T22:14:16.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efc05804640 1 -- 172.21.15.45:0/2796572748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc001a49d0 con 0x7efc001068f0 2024-09-15T22:14:16.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efc04802640 1 -- 172.21.15.45:0/2796572748 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efbf8004b20 con 0x7efc001068f0 2024-09-15T22:14:16.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efc04802640 1 -- 172.21.15.45:0/2796572748 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf8011760 con 0x7efc001068f0 2024-09-15T22:14:16.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.234+0000 7efc05804640 1 -- 172.21.15.45:0/2796572748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc001a4f10 con 0x7efc001068f0 2024-09-15T22:14:16.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.235+0000 7efc05804640 1 -- 172.21.15.45:0/2796572748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc00100d50 con 0x7efc001068f0 2024-09-15T22:14:16.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.237+0000 7efc04802640 1 -- 172.21.15.45:0/2796572748 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7efbf8011900 con 0x7efc001068f0 2024-09-15T22:14:16.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.238+0000 7efc04802640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7efbe80a3240 0x7efbe80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:16.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.238+0000 7efbfeffd640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7efbe80a3240 0x7efbe80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:16.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.238+0000 7efc04802640 1 -- 172.21.15.45:0/2796572748 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8770+0+0 (secure 0 0 0) 0x7efbf80d00c0 con 0x7efc001068f0 2024-09-15T22:14:16.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.238+0000 7efbfeffd640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7efbe80a3240 0x7efbe80a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efbf0000c00 tx=0x7efbf0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:16.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.241+0000 7efc04802640 1 -- 172.21.15.45:0/2796572748 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efbf8016030 con 0x7efc001068f0 2024-09-15T22:14:16.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.454+0000 7efc05804640 1 -- 172.21.15.45:0/2796572748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7efc00108e60 con 0x7efc001068f0 2024-09-15T22:14:16.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.850+0000 7efc04802640 1 -- 172.21.15.45:0/2796572748 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7efbf809cbc0 con 0x7efc001068f0 2024-09-15T22:14:16.852 INFO:teuthology.orchestra.run.smithi045.stderr:added data pool 4 to fsmap 2024-09-15T22:14:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.853+0000 7efc05804640 1 -- 172.21.15.45:0/2796572748 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7efbe80a3240 msgr2=0x7efbe80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.853+0000 7efc05804640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7efbe80a3240 0x7efbe80a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efbf0000c00 tx=0x7efbf0005a20 comp rx=0 tx=0).stop 2024-09-15T22:14:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.853+0000 7efc05804640 1 -- 172.21.15.45:0/2796572748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc001068f0 msgr2=0x7efc001a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.853+0000 7efc05804640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc001068f0 0x7efc001a42c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efbf800eaa0 tx=0x7efbf800ef60 comp rx=0 tx=0).stop 2024-09-15T22:14:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.853+0000 7efc05804640 1 -- 172.21.15.45:0/2796572748 shutdown_connections 2024-09-15T22:14:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.853+0000 7efc05804640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7efbe80a3240 0x7efbe80a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.853+0000 7efc05804640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc001068f0 0x7efc001a42c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.853+0000 7efc05804640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc00101290 0x7efc00199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.853+0000 7efc05804640 1 --2- 172.21.15.45:0/2796572748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc001008f0 0x7efc00199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:16.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.853+0000 7efc05804640 1 -- 172.21.15.45:0/2796572748 >> 172.21.15.45:0/2796572748 conn(0x7efc000fc630 msgr2=0x7efc000fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:16.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.853+0000 7efc05804640 1 -- 172.21.15.45:0/2796572748 shutdown_connections 2024-09-15T22:14:16.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:16.853+0000 7efc05804640 1 -- 172.21.15.45:0/2796572748 wait complete. 2024-09-15T22:14:17.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:16 smithi165 ceph-mon[35551]: pgmap v286: 129 pgs: 2 creating+peering, 19 unknown, 108 active+clean; 579 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:17.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:16 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2796572748' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-15T22:14:17.228 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:16 smithi045 ceph-mon[31180]: pgmap v286: 129 pgs: 2 creating+peering, 19 unknown, 108 active+clean; 579 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:17.228 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:16 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2796572748' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-15T22:14:17.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:16 smithi100 ceph-mon[35319]: pgmap v286: 129 pgs: 2 creating+peering, 19 unknown, 108 active+clean; 579 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:17.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:16 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2796572748' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-15T22:14:17.631 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:14:17.896 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:18.017 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:17 smithi045 ceph-mon[31180]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T22:14:18.017 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:17 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2796572748' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-15T22:14:18.017 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:17 smithi045 ceph-mon[31180]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:18.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:17 smithi165 ceph-mon[35551]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T22:14:18.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:17 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2796572748' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-15T22:14:18.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:17 smithi165 ceph-mon[35551]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:18.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:17 smithi100 ceph-mon[35319]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T22:14:18.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:17 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2796572748' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-15T22:14:18.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:17 smithi100 ceph-mon[35319]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:18.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.424+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/1193982204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cd8100a80 msgr2=0x7f2cd8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:18.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.424+0000 7f2cdcb2b640 1 --2- 172.21.15.45:0/1193982204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cd8100a80 0x7f2cd8100ee0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009930 tx=0x7f2ccc02a420 comp rx=0 tx=0).stop 2024-09-15T22:14:18.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.424+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/1193982204 shutdown_connections 2024-09-15T22:14:18.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.424+0000 7f2cdcb2b640 1 --2- 172.21.15.45:0/1193982204 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd8101420 0x7f2cd810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:18.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.424+0000 7f2cdcb2b640 1 --2- 172.21.15.45:0/1193982204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cd8100a80 0x7f2cd8100ee0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:18.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.424+0000 7f2cdcb2b640 1 --2- 172.21.15.45:0/1193982204 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd8106a80 0x7f2cd8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:18.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.424+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/1193982204 >> 172.21.15.45:0/1193982204 conn(0x7f2cd80fc7a0 msgr2=0x7f2cd80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:18.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.424+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/1193982204 shutdown_connections 2024-09-15T22:14:18.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.424+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/1193982204 wait complete. 2024-09-15T22:14:18.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.425+0000 7f2cdcb2b640 1 Processor -- start 2024-09-15T22:14:18.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.425+0000 7f2cdcb2b640 1 -- start start 2024-09-15T22:14:18.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.425+0000 7f2cdcb2b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd8100a80 0x7f2cd80fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:18.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.425+0000 7f2cdcb2b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd8101420 0x7f2cd80fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:18.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.425+0000 7f2cdcb2b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cd8106a80 0x7f2cd80fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:18.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.425+0000 7f2cdcb2b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd8110fa0 con 0x7f2cd8106a80 2024-09-15T22:14:18.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.425+0000 7f2cdcb2b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd8110e20 con 0x7f2cd8100a80 2024-09-15T22:14:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.425+0000 7f2cdcb2b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2cd8111120 con 0x7f2cd8101420 2024-09-15T22:14:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.425+0000 7f2cd6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cd8106a80 0x7f2cd80fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.425+0000 7f2cd6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cd8106a80 0x7f2cd80fd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58152/0 (socket says 172.21.15.45:58152) 2024-09-15T22:14:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.425+0000 7f2cd6d9d640 1 -- 172.21.15.45:0/414358191 learned_addr learned my addr 172.21.15.45:0/414358191 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.425+0000 7f2cd659c640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd8100a80 0x7f2cd80fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.425+0000 7f2cd5d9b640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd8101420 0x7f2cd80fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.426+0000 7f2cd6d9d640 1 -- 172.21.15.45:0/414358191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd8101420 msgr2=0x7f2cd80fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.426+0000 7f2cd6d9d640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd8101420 0x7f2cd80fd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.426+0000 7f2cd6d9d640 1 -- 172.21.15.45:0/414358191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd8100a80 msgr2=0x7f2cd80fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.426+0000 7f2cd6d9d640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd8100a80 0x7f2cd80fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.426+0000 7f2cd6d9d640 1 -- 172.21.15.45:0/414358191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cd81a69b0 con 0x7f2cd8106a80 2024-09-15T22:14:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.426+0000 7f2cd5d9b640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd8101420 0x7f2cd80fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:14:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.426+0000 7f2cd6d9d640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cd8106a80 0x7f2cd80fd770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c970 tx=0x7f2cd000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.426+0000 7f2cc77fe640 1 -- 172.21.15.45:0/414358191 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0007bb0 con 0x7f2cd8106a80 2024-09-15T22:14:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.426+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/414358191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cd81a6ca0 con 0x7f2cd8106a80 2024-09-15T22:14:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.426+0000 7f2cc77fe640 1 -- 172.21.15.45:0/414358191 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2cd0007d50 con 0x7f2cd8106a80 2024-09-15T22:14:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.426+0000 7f2cc77fe640 1 -- 172.21.15.45:0/414358191 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd00188a0 con 0x7f2cd8106a80 2024-09-15T22:14:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.426+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/414358191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cd81a71b0 con 0x7f2cd8106a80 2024-09-15T22:14:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.427+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/414358191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cd81021c0 con 0x7f2cd8106a80 2024-09-15T22:14:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.428+0000 7f2cc77fe640 1 -- 172.21.15.45:0/414358191 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2cd0018b60 con 0x7f2cd8106a80 2024-09-15T22:14:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.429+0000 7f2cc77fe640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f2cc00a3240 0x7f2cc00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.430+0000 7f2cd659c640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f2cc00a3240 0x7f2cc00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.430+0000 7f2cc77fe640 1 -- 172.21.15.45:0/414358191 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f2cd00cfda0 con 0x7f2cd8106a80 2024-09-15T22:14:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.430+0000 7f2cd659c640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f2cc00a3240 0x7f2cc00a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8005fd0 tx=0x7f2cc8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.433+0000 7f2cc77fe640 1 -- 172.21.15.45:0/414358191 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2cd0014030 con 0x7f2cd8106a80 2024-09-15T22:14:18.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.643+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/414358191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2cd8100ee0 con 0x7f2cd8106a80 2024-09-15T22:14:18.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.644+0000 7f2cc77fe640 1 -- 172.21.15.45:0/414358191 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11851 (secure 0 0 0) 0x7f2cd8100ee0 con 0x7f2cd8106a80 2024-09-15T22:14:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:14:18.646 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"btime":"2024-09-15T22:14:16:842421+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:16.455798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:14:18.646 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 17 2024-09-15T22:14:18.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.646+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/414358191 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f2cc00a3240 msgr2=0x7f2cc00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:18.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.646+0000 7f2cdcb2b640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f2cc00a3240 0x7f2cc00a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8005fd0 tx=0x7f2cc8009500 comp rx=0 tx=0).stop 2024-09-15T22:14:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.646+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/414358191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cd8106a80 msgr2=0x7f2cd80fd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.646+0000 7f2cdcb2b640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cd8106a80 0x7f2cd80fd770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000c970 tx=0x7f2cd000ce30 comp rx=0 tx=0).stop 2024-09-15T22:14:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.646+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/414358191 shutdown_connections 2024-09-15T22:14:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.646+0000 7f2cdcb2b640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f2cc00a3240 0x7f2cc00a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.646+0000 7f2cdcb2b640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cd8106a80 0x7f2cd80fd770 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.646+0000 7f2cdcb2b640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2cd8101420 0x7f2cd80fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.646+0000 7f2cdcb2b640 1 --2- 172.21.15.45:0/414358191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cd8100a80 0x7f2cd80fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.646+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/414358191 >> 172.21.15.45:0/414358191 conn(0x7f2cd80fc7a0 msgr2=0x7f2cd806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.646+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/414358191 shutdown_connections 2024-09-15T22:14:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:18.646+0000 7f2cdcb2b640 1 -- 172.21.15.45:0/414358191 wait complete. 2024-09-15T22:14:18.989 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:18 smithi045 ceph-mon[31180]: pgmap v288: 129 pgs: 2 creating+peering, 127 active+clean; 579 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:18.989 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:18 smithi045 ceph-mon[31180]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T22:14:18.989 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:18 smithi045 ceph-mon[31180]: Cluster is now healthy 2024-09-15T22:14:18.989 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:18 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/414358191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:14:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:18 smithi165 ceph-mon[35551]: pgmap v288: 129 pgs: 2 creating+peering, 127 active+clean; 579 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:18 smithi165 ceph-mon[35551]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T22:14:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:18 smithi165 ceph-mon[35551]: Cluster is now healthy 2024-09-15T22:14:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:18 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/414358191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:14:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:18 smithi100 ceph-mon[35319]: pgmap v288: 129 pgs: 2 creating+peering, 127 active+clean; 579 KiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:18 smithi100 ceph-mon[35319]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T22:14:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:18 smithi100 ceph-mon[35319]: Cluster is now healthy 2024-09-15T22:14:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:18 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/414358191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:14:19.325 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:14:19.586 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.083+0000 7fc35836c640 1 -- 172.21.15.45:0/759389685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc35010e3c0 msgr2=0x7fc350110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.083+0000 7fc35836c640 1 --2- 172.21.15.45:0/759389685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc35010e3c0 0x7fc350110810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc348009ca0 tx=0x7fc34802a950 comp rx=0 tx=0).stop 2024-09-15T22:14:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.083+0000 7fc35836c640 1 -- 172.21.15.45:0/759389685 shutdown_connections 2024-09-15T22:14:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.083+0000 7fc35836c640 1 --2- 172.21.15.45:0/759389685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc35010e3c0 0x7fc350110810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.083+0000 7fc35836c640 1 --2- 172.21.15.45:0/759389685 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc350074f40 0x7fc35010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.083+0000 7fc35836c640 1 --2- 172.21.15.45:0/759389685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc350074620 0x7fc350074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.083+0000 7fc35836c640 1 -- 172.21.15.45:0/759389685 >> 172.21.15.45:0/759389685 conn(0x7fc3500fd8c0 msgr2=0x7fc3500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:20.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.083+0000 7fc35836c640 1 -- 172.21.15.45:0/759389685 shutdown_connections 2024-09-15T22:14:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.083+0000 7fc35836c640 1 -- 172.21.15.45:0/759389685 wait complete. 2024-09-15T22:14:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.083+0000 7fc35836c640 1 Processor -- start 2024-09-15T22:14:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.083+0000 7fc35836c640 1 -- start start 2024-09-15T22:14:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc35836c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc350074620 0x7fc35019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc35836c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc350074f40 0x7fc35019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc35836c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc35010e3c0 0x7fc35019efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc35836c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc350114290 con 0x7fc350074620 2024-09-15T22:14:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc35836c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc350114110 con 0x7fc350074f40 2024-09-15T22:14:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc35836c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc350114410 con 0x7fc35010e3c0 2024-09-15T22:14:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc356108640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc350074620 0x7fc35019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc356108640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc350074620 0x7fc35019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58166/0 (socket says 172.21.15.45:58166) 2024-09-15T22:14:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc356108640 1 -- 172.21.15.45:0/3877414639 learned_addr learned my addr 172.21.15.45:0/3877414639 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:20.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc355907640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc350074f40 0x7fc35019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc356909640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc35010e3c0 0x7fc35019efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc356108640 1 -- 172.21.15.45:0/3877414639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc35010e3c0 msgr2=0x7fc35019efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc356108640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc35010e3c0 0x7fc35019efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc356108640 1 -- 172.21.15.45:0/3877414639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc350074f40 msgr2=0x7fc35019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc356108640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc350074f40 0x7fc35019ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc356108640 1 -- 172.21.15.45:0/3877414639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35019f6c0 con 0x7fc350074620 2024-09-15T22:14:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc356909640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc35010e3c0 0x7fc35019efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc356108640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc350074620 0x7fc35019a710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00e9f0 tx=0x7fc34c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc3477fe640 1 -- 172.21.15.45:0/3877414639 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00cd80 con 0x7fc350074620 2024-09-15T22:14:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc35836c640 1 -- 172.21.15.45:0/3877414639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35019f9b0 con 0x7fc350074620 2024-09-15T22:14:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.084+0000 7fc3477fe640 1 -- 172.21.15.45:0/3877414639 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc34c010930 con 0x7fc350074620 2024-09-15T22:14:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.085+0000 7fc3477fe640 1 -- 172.21.15.45:0/3877414639 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34c018b00 con 0x7fc350074620 2024-09-15T22:14:20.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.085+0000 7fc35836c640 1 -- 172.21.15.45:0/3877414639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3501a7290 con 0x7fc350074620 2024-09-15T22:14:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.086+0000 7fc35836c640 1 -- 172.21.15.45:0/3877414639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc350074a00 con 0x7fc350074620 2024-09-15T22:14:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.087+0000 7fc3477fe640 1 -- 172.21.15.45:0/3877414639 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc34c018ca0 con 0x7fc350074620 2024-09-15T22:14:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.088+0000 7fc3477fe640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc33c0a3240 0x7fc33c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.088+0000 7fc355907640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc33c0a3240 0x7fc33c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.088+0000 7fc3477fe640 1 -- 172.21.15.45:0/3877414639 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fc34c0cffc0 con 0x7fc350074620 2024-09-15T22:14:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.088+0000 7fc355907640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc33c0a3240 0x7fc33c0a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc3501013e0 tx=0x7fc340005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:20.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.092+0000 7fc3477fe640 1 -- 172.21.15.45:0/3877414639 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc34c09caa0 con 0x7fc350074620 2024-09-15T22:14:20.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.268+0000 7fc35836c640 1 -- 172.21.15.45:0/3877414639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3501a74c0 con 0x7fc350074620 2024-09-15T22:14:20.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.270+0000 7fc3477fe640 1 -- 172.21.15.45:0/3877414639 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24190 (secure 0 0 0) 0x7fc34c09c3a0 con 0x7fc350074620 2024-09-15T22:14:20.272 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:14:20.272 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:14:16.455664+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:14:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.273+0000 7fc35836c640 1 -- 172.21.15.45:0/3877414639 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc33c0a3240 msgr2=0x7fc33c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.273+0000 7fc35836c640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc33c0a3240 0x7fc33c0a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc3501013e0 tx=0x7fc340005f90 comp rx=0 tx=0).stop 2024-09-15T22:14:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.273+0000 7fc35836c640 1 -- 172.21.15.45:0/3877414639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc350074620 msgr2=0x7fc35019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.273+0000 7fc35836c640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc350074620 0x7fc35019a710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00e9f0 tx=0x7fc34c00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:14:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.273+0000 7fc35836c640 1 -- 172.21.15.45:0/3877414639 shutdown_connections 2024-09-15T22:14:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.273+0000 7fc35836c640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc33c0a3240 0x7fc33c0a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.273+0000 7fc35836c640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc35010e3c0 0x7fc35019efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.273+0000 7fc35836c640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc350074f40 0x7fc35019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:20.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.273+0000 7fc35836c640 1 --2- 172.21.15.45:0/3877414639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc350074620 0x7fc35019a710 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.273+0000 7fc35836c640 1 -- 172.21.15.45:0/3877414639 >> 172.21.15.45:0/3877414639 conn(0x7fc3500fd8c0 msgr2=0x7fc3500fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.273+0000 7fc35836c640 1 -- 172.21.15.45:0/3877414639 shutdown_connections 2024-09-15T22:14:20.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:20.273+0000 7fc35836c640 1 -- 172.21.15.45:0/3877414639 wait complete. 2024-09-15T22:14:20.979 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:20 smithi045 ceph-mon[31180]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:20.979 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:20 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3877414639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:20.981 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:14:21.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:20 smithi165 ceph-mon[35551]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:21.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:20 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3877414639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:21.239 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:21.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:20 smithi100 ceph-mon[35319]: pgmap v289: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:21.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:20 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3877414639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.738+0000 7f8c86f0c640 1 -- 172.21.15.45:0/1488103771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c80102d90 msgr2=0x7f8c80103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.738+0000 7f8c86f0c640 1 --2- 172.21.15.45:0/1488103771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c80102d90 0x7f8c80103170 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009930 tx=0x7f8c7002a420 comp rx=0 tx=0).stop 2024-09-15T22:14:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 -- 172.21.15.45:0/1488103771 shutdown_connections 2024-09-15T22:14:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 --2- 172.21.15.45:0/1488103771 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c80108290 0x7f8c8010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 --2- 172.21.15.45:0/1488103771 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c80103740 0x7f8c80107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 --2- 172.21.15.45:0/1488103771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c80102d90 0x7f8c80103170 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 -- 172.21.15.45:0/1488103771 >> 172.21.15.45:0/1488103771 conn(0x7f8c800fc7d0 msgr2=0x7f8c800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 -- 172.21.15.45:0/1488103771 shutdown_connections 2024-09-15T22:14:21.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 -- 172.21.15.45:0/1488103771 wait complete. 2024-09-15T22:14:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 Processor -- start 2024-09-15T22:14:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 -- start start 2024-09-15T22:14:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c80102d90 0x7f8c801a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c80103740 0x7f8c801a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c80108290 0x7f8c8019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8c80112210 con 0x7f8c80108290 2024-09-15T22:14:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8c80112090 con 0x7f8c80102d90 2024-09-15T22:14:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.739+0000 7f8c86f0c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8c80112390 con 0x7f8c80103740 2024-09-15T22:14:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c854a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c80108290 0x7f8c8019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c854a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c80108290 0x7f8c8019a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58186/0 (socket says 172.21.15.45:58186) 2024-09-15T22:14:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c854a9640 1 -- 172.21.15.45:0/3795944574 learned_addr learned my addr 172.21.15.45:0/3795944574 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:21.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c84ca8640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c80102d90 0x7f8c801a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c7ffff640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c80103740 0x7f8c801a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c854a9640 1 -- 172.21.15.45:0/3795944574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c80103740 msgr2=0x7f8c801a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c854a9640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c80103740 0x7f8c801a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c854a9640 1 -- 172.21.15.45:0/3795944574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c80102d90 msgr2=0x7f8c801a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c854a9640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c80102d90 0x7f8c801a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c854a9640 1 -- 172.21.15.45:0/3795944574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8019af20 con 0x7f8c80108290 2024-09-15T22:14:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c7ffff640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c80103740 0x7f8c801a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:14:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c854a9640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c80108290 0x7f8c8019a780 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800cad0 tx=0x7f8c7800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c7dffb640 1 -- 172.21.15.45:0/3795944574 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800ae20 con 0x7f8c80108290 2024-09-15T22:14:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c7dffb640 1 -- 172.21.15.45:0/3795944574 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8c78004b20 con 0x7f8c80108290 2024-09-15T22:14:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c86f0c640 1 -- 172.21.15.45:0/3795944574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8019b210 con 0x7f8c80108290 2024-09-15T22:14:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.740+0000 7f8c7dffb640 1 -- 172.21.15.45:0/3795944574 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7800f780 con 0x7f8c80108290 2024-09-15T22:14:21.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.741+0000 7f8c86f0c640 1 -- 172.21.15.45:0/3795944574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c801a7460 con 0x7f8c80108290 2024-09-15T22:14:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.742+0000 7f8c86f0c640 1 -- 172.21.15.45:0/3795944574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8006a7f0 con 0x7f8c80108290 2024-09-15T22:14:21.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.743+0000 7f8c7dffb640 1 -- 172.21.15.45:0/3795944574 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8c78004cd0 con 0x7f8c80108290 2024-09-15T22:14:21.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.743+0000 7f8c7dffb640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8c6c0a32c0 0x7f8c6c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:21.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.743+0000 7f8c84ca8640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8c6c0a32c0 0x7f8c6c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:21.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.743+0000 7f8c7dffb640 1 -- 172.21.15.45:0/3795944574 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f8c780cfb90 con 0x7f8c80108290 2024-09-15T22:14:21.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.744+0000 7f8c84ca8640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8c6c0a32c0 0x7f8c6c0a5780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009900 tx=0x7f8c700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:21.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.747+0000 7f8c7dffb640 1 -- 172.21.15.45:0/3795944574 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8c78014030 con 0x7f8c80108290 2024-09-15T22:14:21.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.927+0000 7f8c86f0c640 1 -- 172.21.15.45:0/3795944574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c8010c2b0 con 0x7f8c80108290 2024-09-15T22:14:21.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.929+0000 7f8c7dffb640 1 -- 172.21.15.45:0/3795944574 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24190 (secure 0 0 0) 0x7f8c7809c670 con 0x7f8c80108290 2024-09-15T22:14:21.930 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:14:21.930 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:14:16.455664+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:14:21.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.931+0000 7f8c86f0c640 1 -- 172.21.15.45:0/3795944574 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8c6c0a32c0 msgr2=0x7f8c6c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:21.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.931+0000 7f8c86f0c640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8c6c0a32c0 0x7f8c6c0a5780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009900 tx=0x7f8c700058d0 comp rx=0 tx=0).stop 2024-09-15T22:14:21.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.931+0000 7f8c86f0c640 1 -- 172.21.15.45:0/3795944574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c80108290 msgr2=0x7f8c8019a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:21.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.931+0000 7f8c86f0c640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c80108290 0x7f8c8019a780 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800cad0 tx=0x7f8c7800cf90 comp rx=0 tx=0).stop 2024-09-15T22:14:21.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.931+0000 7f8c86f0c640 1 -- 172.21.15.45:0/3795944574 shutdown_connections 2024-09-15T22:14:21.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.931+0000 7f8c86f0c640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8c6c0a32c0 0x7f8c6c0a5780 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:21.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.931+0000 7f8c86f0c640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c80108290 0x7f8c8019a780 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:21.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.931+0000 7f8c86f0c640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8c80103740 0x7f8c801a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:21.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.931+0000 7f8c86f0c640 1 --2- 172.21.15.45:0/3795944574 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c80102d90 0x7f8c801a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:21.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.931+0000 7f8c86f0c640 1 -- 172.21.15.45:0/3795944574 >> 172.21.15.45:0/3795944574 conn(0x7f8c800fc7d0 msgr2=0x7f8c80100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:21.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.931+0000 7f8c86f0c640 1 -- 172.21.15.45:0/3795944574 shutdown_connections 2024-09-15T22:14:21.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:21.931+0000 7f8c86f0c640 1 -- 172.21.15.45:0/3795944574 wait complete. 2024-09-15T22:14:22.630 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:14:22.893 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:23.164 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:22 smithi045 ceph-mon[31180]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:23.164 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:22 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3795944574' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:23.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:22 smithi165 ceph-mon[35551]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:23.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:22 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3795944574' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:23.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:22 smithi100 ceph-mon[35319]: pgmap v290: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:23.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:22 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3795944574' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:23.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.389+0000 7f714cf0f640 1 -- 172.21.15.45:0/3568161507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7148102570 msgr2=0x7f71481029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.389+0000 7f714cf0f640 1 --2- 172.21.15.45:0/3568161507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7148102570 0x7f71481029b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f713c009900 tx=0x7f713c02a480 comp rx=0 tx=0).stop 2024-09-15T22:14:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.389+0000 7f714cf0f640 1 -- 172.21.15.45:0/3568161507 shutdown_connections 2024-09-15T22:14:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.389+0000 7f714cf0f640 1 --2- 172.21.15.45:0/3568161507 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7148102ef0 0x7f714810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.389+0000 7f714cf0f640 1 --2- 172.21.15.45:0/3568161507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7148102570 0x7f71481029b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.389+0000 7f714cf0f640 1 --2- 172.21.15.45:0/3568161507 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7148100e20 0x7f7148101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.389+0000 7f714cf0f640 1 -- 172.21.15.45:0/3568161507 >> 172.21.15.45:0/3568161507 conn(0x7f71480fc7d0 msgr2=0x7f71480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.389+0000 7f714cf0f640 1 -- 172.21.15.45:0/3568161507 shutdown_connections 2024-09-15T22:14:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.389+0000 7f714cf0f640 1 -- 172.21.15.45:0/3568161507 wait complete. 2024-09-15T22:14:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.390+0000 7f714cf0f640 1 Processor -- start 2024-09-15T22:14:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.390+0000 7f714cf0f640 1 -- start start 2024-09-15T22:14:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.390+0000 7f714cf0f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7148100e20 0x7f7148199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.390+0000 7f714cf0f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7148102570 0x7f7148199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.390+0000 7f714cf0f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7148102ef0 0x7f71481a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.390+0000 7f714cf0f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f71481110f0 con 0x7f7148102570 2024-09-15T22:14:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.390+0000 7f714cf0f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7148110f70 con 0x7f7148102ef0 2024-09-15T22:14:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.390+0000 7f714cf0f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7148111270 con 0x7f7148100e20 2024-09-15T22:14:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f7145d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7148102570 0x7f7148199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f7145d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7148102570 0x7f7148199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58202/0 (socket says 172.21.15.45:58202) 2024-09-15T22:14:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f7145d9b640 1 -- 172.21.15.45:0/3451045684 learned_addr learned my addr 172.21.15.45:0/3451045684 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f714659c640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7148100e20 0x7f7148199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f7146d9d640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7148102ef0 0x7f71481a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f7145d9b640 1 -- 172.21.15.45:0/3451045684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7148100e20 msgr2=0x7f7148199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f7145d9b640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7148100e20 0x7f7148199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f7145d9b640 1 -- 172.21.15.45:0/3451045684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7148102ef0 msgr2=0x7f71481a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f7145d9b640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7148102ef0 0x7f71481a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f7145d9b640 1 -- 172.21.15.45:0/3451045684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71481a4a00 con 0x7f7148102570 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f7145d9b640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7148102570 0x7f7148199980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f713c02aa70 tx=0x7f713c031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f71377fe640 1 -- 172.21.15.45:0/3451045684 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c03f070 con 0x7f7148102570 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f71377fe640 1 -- 172.21.15.45:0/3451045684 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f713c005490 con 0x7f7148102570 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f71377fe640 1 -- 172.21.15.45:0/3451045684 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c035030 con 0x7f7148102570 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f714cf0f640 1 -- 172.21.15.45:0/3451045684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71481a4bd0 con 0x7f7148102570 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.391+0000 7f714cf0f640 1 -- 172.21.15.45:0/3451045684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71481a5020 con 0x7f7148102570 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.392+0000 7f714cf0f640 1 -- 172.21.15.45:0/3451045684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7148101200 con 0x7f7148102570 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.393+0000 7f71377fe640 1 -- 172.21.15.45:0/3451045684 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f713c042070 con 0x7f7148102570 2024-09-15T22:14:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.394+0000 7f71377fe640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f71300a3240 0x7f71300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:23.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.395+0000 7f714659c640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f71300a3240 0x7f71300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:23.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.395+0000 7f71377fe640 1 -- 172.21.15.45:0/3451045684 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f713c0f05b0 con 0x7f7148102570 2024-09-15T22:14:23.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.395+0000 7f714659c640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f71300a3240 0x7f71300a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7138009bd0 tx=0x7f7138005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:23.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.398+0000 7f71377fe640 1 -- 172.21.15.45:0/3451045684 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f713c0bc9e0 con 0x7f7148102570 2024-09-15T22:14:23.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.611+0000 7f714cf0f640 1 -- 172.21.15.45:0/3451045684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71481a5290 con 0x7f7148102570 2024-09-15T22:14:23.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.612+0000 7f71377fe640 1 -- 172.21.15.45:0/3451045684 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11851 (secure 0 0 0) 0x7f713c0c0ce0 con 0x7f7148102570 2024-09-15T22:14:23.613 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:14:23.614 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"btime":"2024-09-15T22:14:16:842421+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:16.455798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:14:23.614 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 17 2024-09-15T22:14:23.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.614+0000 7f714cf0f640 1 -- 172.21.15.45:0/3451045684 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f71300a3240 msgr2=0x7f71300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:23.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.614+0000 7f714cf0f640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f71300a3240 0x7f71300a5700 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7138009bd0 tx=0x7f7138005f90 comp rx=0 tx=0).stop 2024-09-15T22:14:23.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.614+0000 7f714cf0f640 1 -- 172.21.15.45:0/3451045684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7148102570 msgr2=0x7f7148199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:23.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.614+0000 7f714cf0f640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7148102570 0x7f7148199980 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f713c02aa70 tx=0x7f713c031400 comp rx=0 tx=0).stop 2024-09-15T22:14:23.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.614+0000 7f714cf0f640 1 -- 172.21.15.45:0/3451045684 shutdown_connections 2024-09-15T22:14:23.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.614+0000 7f714cf0f640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f71300a3240 0x7f71300a5700 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:23.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.614+0000 7f714cf0f640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7148102ef0 0x7f71481a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:23.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.614+0000 7f714cf0f640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7148102570 0x7f7148199980 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:23.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.614+0000 7f714cf0f640 1 --2- 172.21.15.45:0/3451045684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7148100e20 0x7f7148199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:23.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.614+0000 7f714cf0f640 1 -- 172.21.15.45:0/3451045684 >> 172.21.15.45:0/3451045684 conn(0x7f71480fc7d0 msgr2=0x7f7148106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:23.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.614+0000 7f714cf0f640 1 -- 172.21.15.45:0/3451045684 shutdown_connections 2024-09-15T22:14:23.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:23.615+0000 7f714cf0f640 1 -- 172.21.15.45:0/3451045684 wait complete. 2024-09-15T22:14:24.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:23 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3451045684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:14:24.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:23 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3451045684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:14:24.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:23 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3451045684' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:14:24.359 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:14:24.619 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:24.991 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:24 smithi045 ceph-mon[31180]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.071+0000 7f10030a1640 1 -- 172.21.15.45:0/2203570276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ffc106a80 msgr2=0x7f0ffc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.071+0000 7f10030a1640 1 --2- 172.21.15.45:0/2203570276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ffc106a80 0x7f0ffc106e60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009930 tx=0x7f0ff002a420 comp rx=0 tx=0).stop 2024-09-15T22:14:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.072+0000 7f10030a1640 1 -- 172.21.15.45:0/2203570276 shutdown_connections 2024-09-15T22:14:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.072+0000 7f10030a1640 1 --2- 172.21.15.45:0/2203570276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ffc101420 0x7f0ffc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.072+0000 7f10030a1640 1 --2- 172.21.15.45:0/2203570276 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ffc100a80 0x7f0ffc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.072+0000 7f10030a1640 1 --2- 172.21.15.45:0/2203570276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ffc106a80 0x7f0ffc106e60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.072+0000 7f10030a1640 1 -- 172.21.15.45:0/2203570276 >> 172.21.15.45:0/2203570276 conn(0x7f0ffc0fc7a0 msgr2=0x7f0ffc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.072+0000 7f10030a1640 1 -- 172.21.15.45:0/2203570276 shutdown_connections 2024-09-15T22:14:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.072+0000 7f10030a1640 1 -- 172.21.15.45:0/2203570276 wait complete. 2024-09-15T22:14:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.072+0000 7f10030a1640 1 Processor -- start 2024-09-15T22:14:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.072+0000 7f10030a1640 1 -- start start 2024-09-15T22:14:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f10030a1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ffc100a80 0x7f0ffc199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f10030a1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ffc101420 0x7f0ffc199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f10030a1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ffc106a80 0x7f0ffc1a4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f10030a1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc110ff0 con 0x7f0ffc101420 2024-09-15T22:14:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f10030a1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc110e70 con 0x7f0ffc100a80 2024-09-15T22:14:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f10030a1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0ffc111170 con 0x7f0ffc106a80 2024-09-15T22:14:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f0ffbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ffc101420 0x7f0ffc199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:25.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f0ffbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ffc101420 0x7f0ffc199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48410/0 (socket says 172.21.15.45:48410) 2024-09-15T22:14:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f0ffbfff640 1 -- 172.21.15.45:0/2334617605 learned_addr learned my addr 172.21.15.45:0/2334617605 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f1000e3d640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ffc100a80 0x7f0ffc199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f0ffbfff640 1 -- 172.21.15.45:0/2334617605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ffc106a80 msgr2=0x7f0ffc1a4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f100163e640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ffc106a80 0x7f0ffc1a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f0ffbfff640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ffc106a80 0x7f0ffc1a4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f0ffbfff640 1 -- 172.21.15.45:0/2334617605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ffc100a80 msgr2=0x7f0ffc199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f0ffbfff640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ffc100a80 0x7f0ffc199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f0ffbfff640 1 -- 172.21.15.45:0/2334617605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ffc1971f0 con 0x7f0ffc101420 2024-09-15T22:14:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f100163e640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ffc106a80 0x7f0ffc1a4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f0ffbfff640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ffc101420 0x7f0ffc199940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800d770 tx=0x7f0fe800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f0ff9ffb640 1 -- 172.21.15.45:0/2334617605 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8017070 con 0x7f0ffc101420 2024-09-15T22:14:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f10030a1640 1 -- 172.21.15.45:0/2334617605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ffc1974e0 con 0x7f0ffc101420 2024-09-15T22:14:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f0ff9ffb640 1 -- 172.21.15.45:0/2334617605 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0fe8005520 con 0x7f0ffc101420 2024-09-15T22:14:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.073+0000 7f0ff9ffb640 1 -- 172.21.15.45:0/2334617605 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8010460 con 0x7f0ffc101420 2024-09-15T22:14:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.074+0000 7f10030a1640 1 -- 172.21.15.45:0/2334617605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ffc197a20 con 0x7f0ffc101420 2024-09-15T22:14:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.075+0000 7f10030a1640 1 -- 172.21.15.45:0/2334617605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ffc1021c0 con 0x7f0ffc101420 2024-09-15T22:14:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.076+0000 7f0ff9ffb640 1 -- 172.21.15.45:0/2334617605 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0fe8004ea0 con 0x7f0ffc101420 2024-09-15T22:14:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.076+0000 7f0ff9ffb640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0fec0a3240 0x7f0fec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.077+0000 7f1000e3d640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0fec0a3240 0x7f0fec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.077+0000 7f0ff9ffb640 1 -- 172.21.15.45:0/2334617605 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f0fe80cf730 con 0x7f0ffc101420 2024-09-15T22:14:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.077+0000 7f1000e3d640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0fec0a3240 0x7f0fec0a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0006010 tx=0x7f0ff0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.081+0000 7f0ff9ffb640 1 -- 172.21.15.45:0/2334617605 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0fe809c210 con 0x7f0ffc101420 2024-09-15T22:14:25.145 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:24 smithi100 ceph-mon[35319]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:25.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:24 smithi165 ceph-mon[35551]: pgmap v291: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:25.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.256+0000 7f10030a1640 1 -- 172.21.15.45:0/2334617605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ffc197c80 con 0x7f0ffc101420 2024-09-15T22:14:25.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.258+0000 7f0ff9ffb640 1 -- 172.21.15.45:0/2334617605 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24190 (secure 0 0 0) 0x7f0fe809bb10 con 0x7f0ffc101420 2024-09-15T22:14:25.259 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:14:25.259 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:14:16.455664+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:14:25.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.260+0000 7f10030a1640 1 -- 172.21.15.45:0/2334617605 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0fec0a3240 msgr2=0x7f0fec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:25.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.260+0000 7f10030a1640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0fec0a3240 0x7f0fec0a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0006010 tx=0x7f0ff0005a20 comp rx=0 tx=0).stop 2024-09-15T22:14:25.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.260+0000 7f10030a1640 1 -- 172.21.15.45:0/2334617605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ffc101420 msgr2=0x7f0ffc199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:25.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.260+0000 7f10030a1640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ffc101420 0x7f0ffc199940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0fe800d770 tx=0x7f0fe800dc30 comp rx=0 tx=0).stop 2024-09-15T22:14:25.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.260+0000 7f10030a1640 1 -- 172.21.15.45:0/2334617605 shutdown_connections 2024-09-15T22:14:25.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.260+0000 7f10030a1640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0fec0a3240 0x7f0fec0a5700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:25.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.260+0000 7f10030a1640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0ffc106a80 0x7f0ffc1a4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:25.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.260+0000 7f10030a1640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ffc101420 0x7f0ffc199940 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:25.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.260+0000 7f10030a1640 1 --2- 172.21.15.45:0/2334617605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0ffc100a80 0x7f0ffc199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:25.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.260+0000 7f10030a1640 1 -- 172.21.15.45:0/2334617605 >> 172.21.15.45:0/2334617605 conn(0x7f0ffc0fc7a0 msgr2=0x7f0ffc0fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:25.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.261+0000 7f10030a1640 1 -- 172.21.15.45:0/2334617605 shutdown_connections 2024-09-15T22:14:25.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:25.261+0000 7f10030a1640 1 -- 172.21.15.45:0/2334617605 wait complete. 2024-09-15T22:14:26.032 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:14:07.480609+0000', 'modified': '2024-09-15T22:14:16.455798+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6839/1428203088', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 1428203088}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 1428203088}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24476, 'qdb_cluster': [24476]} 2024-09-15T22:14:26.032 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:14:26.033 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:14:26.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:25 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2334617605' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:26.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:25 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2334617605' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:26.296 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:26.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:25 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2334617605' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.766+0000 7f1961236640 1 -- 172.21.15.45:0/2696489188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195c101420 msgr2=0x7f195c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.766+0000 7f1961236640 1 --2- 172.21.15.45:0/2696489188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195c101420 0x7f195c10d950 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1954009cd0 tx=0x7f195402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.767+0000 7f1961236640 1 -- 172.21.15.45:0/2696489188 shutdown_connections 2024-09-15T22:14:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.767+0000 7f1961236640 1 --2- 172.21.15.45:0/2696489188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195c101420 0x7f195c10d950 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.767+0000 7f1961236640 1 --2- 172.21.15.45:0/2696489188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c100a80 0x7f195c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.767+0000 7f1961236640 1 --2- 172.21.15.45:0/2696489188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f195c106a80 0x7f195c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.767+0000 7f1961236640 1 -- 172.21.15.45:0/2696489188 >> 172.21.15.45:0/2696489188 conn(0x7f195c0fc7a0 msgr2=0x7f195c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.767+0000 7f1961236640 1 -- 172.21.15.45:0/2696489188 shutdown_connections 2024-09-15T22:14:26.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.767+0000 7f1961236640 1 -- 172.21.15.45:0/2696489188 wait complete. 2024-09-15T22:14:26.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.767+0000 7f1961236640 1 Processor -- start 2024-09-15T22:14:26.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f1961236640 1 -- start start 2024-09-15T22:14:26.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f1961236640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195c100a80 0x7f195c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f1961236640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f195c101420 0x7f195c199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f1961236640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c106a80 0x7f195c1a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f1961236640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f195c110fa0 con 0x7f195c100a80 2024-09-15T22:14:26.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f1961236640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f195c110e20 con 0x7f195c106a80 2024-09-15T22:14:26.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f1961236640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f195c111120 con 0x7f195c101420 2024-09-15T22:14:26.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f195ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195c100a80 0x7f195c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f195ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195c100a80 0x7f195c199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48440/0 (socket says 172.21.15.45:48440) 2024-09-15T22:14:26.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f195ad9d640 1 -- 172.21.15.45:0/2492222621 learned_addr learned my addr 172.21.15.45:0/2492222621 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:26.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f195a59c640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f195c101420 0x7f195c199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f195b59e640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c106a80 0x7f195c1a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f195ad9d640 1 -- 172.21.15.45:0/2492222621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f195c101420 msgr2=0x7f195c199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:26.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f195ad9d640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f195c101420 0x7f195c199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f195ad9d640 1 -- 172.21.15.45:0/2492222621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c106a80 msgr2=0x7f195c1a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:26.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f195ad9d640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c106a80 0x7f195c1a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f195ad9d640 1 -- 172.21.15.45:0/2492222621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195c1a48d0 con 0x7f195c100a80 2024-09-15T22:14:26.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.768+0000 7f195ad9d640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195c100a80 0x7f195c199310 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f194c00d950 tx=0x7f194c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:26.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.769+0000 7f1943fff640 1 -- 172.21.15.45:0/2492222621 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c017070 con 0x7f195c100a80 2024-09-15T22:14:26.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.769+0000 7f1961236640 1 -- 172.21.15.45:0/2492222621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f195c1a4aa0 con 0x7f195c100a80 2024-09-15T22:14:26.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.769+0000 7f1943fff640 1 -- 172.21.15.45:0/2492222621 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f194c009c30 con 0x7f195c100a80 2024-09-15T22:14:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.769+0000 7f1961236640 1 -- 172.21.15.45:0/2492222621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f195c1a4fe0 con 0x7f195c100a80 2024-09-15T22:14:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.769+0000 7f1943fff640 1 -- 172.21.15.45:0/2492222621 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f194c00f740 con 0x7f195c100a80 2024-09-15T22:14:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.771+0000 7f1943fff640 1 -- 172.21.15.45:0/2492222621 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f194c00f8e0 con 0x7f195c100a80 2024-09-15T22:14:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.771+0000 7f196360f740 1 Processor -- start 2024-09-15T22:14:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.771+0000 7f196360f740 1 -- start start 2024-09-15T22:14:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f196360f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c70de0 0x558282c711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f196360f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c71700 0x558282c7ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f196360f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c7bfc0 0x558282c7e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f196360f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558282bd3090 con 0x558282c70de0 2024-09-15T22:14:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f196360f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558282b7aa70 con 0x558282c71700 2024-09-15T22:14:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f196360f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558282bcf050 con 0x558282c7bfc0 2024-09-15T22:14:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f195b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c70de0 0x558282c711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f195b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c70de0 0x558282c711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48444/0 (socket says 172.21.15.45:48444) 2024-09-15T22:14:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f195b59e640 1 -- 172.21.15.45:0/3258823331 learned_addr learned my addr 172.21.15.45:0/3258823331 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f195ad9d640 1 --2- 172.21.15.45:0/3258823331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c71700 0x558282c7ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f195a59c640 1 --2- 172.21.15.45:0/3258823331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c7bfc0 0x558282c7e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f195b59e640 1 -- 172.21.15.45:0/3258823331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c7bfc0 msgr2=0x558282c7e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f195b59e640 1 --2- 172.21.15.45:0/3258823331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c7bfc0 0x558282c7e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f195b59e640 1 -- 172.21.15.45:0/3258823331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c71700 msgr2=0x558282c7ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:26.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f195b59e640 1 --2- 172.21.15.45:0/3258823331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c71700 0x558282c7ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f195b59e640 1 -- 172.21.15.45:0/3258823331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558282b87130 con 0x558282c70de0 2024-09-15T22:14:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f1943fff640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f19440a3240 0x7f19440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f195ad9d640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f19440a3240 0x7f19440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f195b59e640 1 --2- 172.21.15.45:0/3258823331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c70de0 0x558282c711c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1954009cd0 tx=0x7f19540093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c09bdc21705650 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f1943fff640 1 -- 172.21.15.45:0/2492222621 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f194c0cf9f0 con 0x7f195c100a80 2024-09-15T22:14:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.772+0000 7f19417fa640 1 -- 172.21.15.45:0/3258823331 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954048070 con 0x558282c70de0 2024-09-15T22:14:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.773+0000 7f19417fa640 1 -- 172.21.15.45:0/3258823331 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1954036070 con 0x558282c70de0 2024-09-15T22:14:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.773+0000 7f19417fa640 1 -- 172.21.15.45:0/3258823331 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954004430 con 0x558282c70de0 2024-09-15T22:14:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.773+0000 7f196360f740 1 -- 172.21.15.45:0/3258823331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c70de0 msgr2=0x558282c711c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.773+0000 7f195ad9d640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f19440a3240 0x7f19440a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f194c0cd620 tx=0x7f194c0d5530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.773+0000 7f196360f740 1 --2- 172.21.15.45:0/3258823331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c70de0 0x558282c711c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1954009cd0 tx=0x7f19540093f0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.773+0000 7f196360f740 1 -- 172.21.15.45:0/3258823331 shutdown_connections 2024-09-15T22:14:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.773+0000 7f196360f740 1 --2- 172.21.15.45:0/3258823331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c7bfc0 0x558282c7e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.773+0000 7f196360f740 1 --2- 172.21.15.45:0/3258823331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c71700 0x558282c7ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.773+0000 7f196360f740 1 --2- 172.21.15.45:0/3258823331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c70de0 0x558282c711c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.773+0000 7f196360f740 1 -- 172.21.15.45:0/3258823331 >> 172.21.15.45:0/3258823331 conn(0x558282c6d370 msgr2=0x558282c6d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.773+0000 7f196360f740 1 -- 172.21.15.45:0/3258823331 shutdown_connections 2024-09-15T22:14:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.773+0000 7f196360f740 1 -- 172.21.15.45:0/3258823331 wait complete. 2024-09-15T22:14:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.774+0000 7f196360f740 1 -- start start 2024-09-15T22:14:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.774+0000 7f196360f740 1 Processor -- start 2024-09-15T22:14:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.774+0000 7f196360f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c70de0 0x558282c7b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.774+0000 7f196360f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 0x558282c78c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.774+0000 7f196360f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c7bfc0 0x558282c79150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.774+0000 7f196360f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558282c7eb90 con 0x558282c71700 2024-09-15T22:14:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.774+0000 7f196360f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558282b8df20 con 0x558282c70de0 2024-09-15T22:14:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.774+0000 7f196360f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558282c7ed10 con 0x558282c7bfc0 2024-09-15T22:14:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.774+0000 7f196360f740 10 client.0 _ll_register_callbacks cb 0x558282b57030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:14:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.774+0000 7f195a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 0x558282c78c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.774+0000 7f195a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 0x558282c78c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48446/0 (socket says 172.21.15.45:48446) 2024-09-15T22:14:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.774+0000 7f195a59c640 1 -- 172.21.15.45:0/441648589 learned_addr learned my addr 172.21.15.45:0/441648589 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.774+0000 7f195b59e640 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c70de0 0x558282c7b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f195a59c640 1 -- 172.21.15.45:0/441648589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c7bfc0 msgr2=0x558282c79150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f195b59e640 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c7bfc0 0x558282c79150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f195a59c640 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c7bfc0 0x558282c79150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f195a59c640 1 -- 172.21.15.45:0/441648589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c70de0 msgr2=0x558282c7b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f195a59c640 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c70de0 0x558282c7b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f195a59c640 1 -- 172.21.15.45:0/441648589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582829442b0 con 0x558282c71700 2024-09-15T22:14:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f195b59e640 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c70de0 0x558282c7b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:14:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f195a59c640 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 0x558282c78c10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1950013710 tx=0x7f1950013bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5051a5c902fe76 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f193eff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:14:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f193eff5640 1 -- 172.21.15.45:0/441648589 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1950011960 con 0x558282c71700 2024-09-15T22:14:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f193eff5640 1 -- 172.21.15.45:0/441648589 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f1950011b00 con 0x558282c71700 2024-09-15T22:14:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f196360f740 1 -- 172.21.15.45:0/441648589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1954036070 con 0x558282c71700 2024-09-15T22:14:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f193eff5640 1 -- 172.21.15.45:0/441648589 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1950011d00 con 0x558282c71700 2024-09-15T22:14:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f196360f740 10 client.14715 fetch_fsmap learned FSMap version 17 2024-09-15T22:14:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f196360f740 1 -- 172.21.15.45:0/441648589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x558282c8a560 con 0x558282c71700 2024-09-15T22:14:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f193eff5640 1 -- 172.21.15.45:0/441648589 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1954036070 con 0x558282c71700 2024-09-15T22:14:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.775+0000 7f193eff5640 1 -- 172.21.15.45:0/441648589 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f195001a070 con 0x558282c71700 2024-09-15T22:14:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.776+0000 7f196360f740 10 client.14715 fetch_fsmap finished waiting for FSMap version 17 2024-09-15T22:14:26.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.776+0000 7f196360f740 10 client.14715 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:14:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.776+0000 7f196360f740 20 client.14715 populate_metadata read hostname 'smithi045' 2024-09-15T22:14:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.776+0000 7f196360f740 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558282c8cc20 0x558282c8e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.776+0000 7f196360f740 4 client.14715 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:14:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.776+0000 7f196360f740 1 -- 172.21.15.45:0/441648589 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558282be0600 con 0x558282c8cc20 2024-09-15T22:14:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.776+0000 7f195b59e640 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558282c8cc20 0x558282c8e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.776+0000 7f193eff5640 10 client.14715 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:14:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.776+0000 7f195b59e640 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558282c8cc20 0x558282c8e090 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb291a9dc283aae8 server_cookie=a07a76810e0cf617 in_seq=0 out_seq=0 2024-09-15T22:14:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f193eff5640 1 -- 172.21.15.45:0/441648589 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558282be0600 con 0x558282c8cc20 2024-09-15T22:14:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f193eff5640 10 client.14715 handle_command_reply: tid=0 2024-09-15T22:14:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f196360f740 1 client.14715 shutdown 2024-09-15T22:14:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f196360f740 1 -- 172.21.15.45:0/441648589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 msgr2=0x558282c78c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f196360f740 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 0x558282c78c10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1950013710 tx=0x7f1950013bd0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f196360f740 1 -- 172.21.15.45:0/441648589 shutdown_connections 2024-09-15T22:14:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f196360f740 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558282c8cc20 0x558282c8e090 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f196360f740 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c7bfc0 0x558282c79150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f196360f740 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 0x558282c78c10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f196360f740 1 --2- 172.21.15.45:0/441648589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c70de0 0x558282c7b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f196360f740 1 -- 172.21.15.45:0/441648589 >> 172.21.15.45:0/441648589 conn(0x558282c6d370 msgr2=0x558282c68020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f193eff5640 0 client.14715 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:14:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f196360f740 1 -- 172.21.15.45:0/441648589 shutdown_connections 2024-09-15T22:14:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f196360f740 1 -- 172.21.15.45:0/441648589 wait complete. 2024-09-15T22:14:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.777+0000 7f196360f740 20 client.14715 trim_cache size 0 max 16384 2024-09-15T22:14:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f196360f740 1 Processor -- start 2024-09-15T22:14:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f196360f740 1 -- start start 2024-09-15T22:14:26.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f196360f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c70de0 0x558282c8c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f196360f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c71700 0x558282c8d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f196360f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c7bfc0 0x558282c74080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f196360f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558282c8c3d0 con 0x558282c7bfc0 2024-09-15T22:14:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f196360f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558282c8caa0 con 0x558282c70de0 2024-09-15T22:14:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f196360f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558282c8d170 con 0x558282c71700 2024-09-15T22:14:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f195b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c7bfc0 0x558282c74080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f195b59e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c7bfc0 0x558282c74080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48456/0 (socket says 172.21.15.45:48456) 2024-09-15T22:14:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f195b59e640 1 -- 172.21.15.45:0/1594589206 learned_addr learned my addr 172.21.15.45:0/1594589206 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f195b59e640 1 --2- 172.21.15.45:0/1594589206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c70de0 0x558282c8c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f195a59c640 1 --2- 172.21.15.45:0/1594589206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c71700 0x558282c8d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f195b59e640 1 -- 172.21.15.45:0/1594589206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c71700 msgr2=0x558282c8d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f195b59e640 1 --2- 172.21.15.45:0/1594589206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c71700 0x558282c8d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f195b59e640 1 -- 172.21.15.45:0/1594589206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c70de0 msgr2=0x558282c8c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f195b59e640 1 --2- 172.21.15.45:0/1594589206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c70de0 0x558282c8c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f195b59e640 1 -- 172.21.15.45:0/1594589206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558282c7b4e0 con 0x558282c7bfc0 2024-09-15T22:14:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.796+0000 7f195b59e640 1 --2- 172.21.15.45:0/1594589206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c7bfc0 0x558282c74080 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1954009960 tx=0x7f1954009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a98e5edaddd06cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.797+0000 7f1940ff9640 1 -- 172.21.15.45:0/1594589206 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195405f070 con 0x558282c7bfc0 2024-09-15T22:14:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.797+0000 7f1940ff9640 1 -- 172.21.15.45:0/1594589206 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1954036040 con 0x558282c7bfc0 2024-09-15T22:14:26.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.797+0000 7f1940ff9640 1 -- 172.21.15.45:0/1594589206 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954048040 con 0x558282c7bfc0 2024-09-15T22:14:26.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.797+0000 7f196360f740 1 -- 172.21.15.45:0/1594589206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c7bfc0 msgr2=0x558282c74080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.797+0000 7f196360f740 1 --2- 172.21.15.45:0/1594589206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c7bfc0 0x558282c74080 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1954009960 tx=0x7f1954009360 comp rx=0 tx=0).stop 2024-09-15T22:14:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.797+0000 7f196360f740 1 -- 172.21.15.45:0/1594589206 shutdown_connections 2024-09-15T22:14:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.797+0000 7f196360f740 1 --2- 172.21.15.45:0/1594589206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c7bfc0 0x558282c74080 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.797+0000 7f196360f740 1 --2- 172.21.15.45:0/1594589206 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c71700 0x558282c8d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.797+0000 7f196360f740 1 --2- 172.21.15.45:0/1594589206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c70de0 0x558282c8c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.797+0000 7f196360f740 1 -- 172.21.15.45:0/1594589206 >> 172.21.15.45:0/1594589206 conn(0x558282c6d370 msgr2=0x558282c73970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.797+0000 7f196360f740 1 -- 172.21.15.45:0/1594589206 shutdown_connections 2024-09-15T22:14:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.797+0000 7f196360f740 1 -- 172.21.15.45:0/1594589206 wait complete. 2024-09-15T22:14:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.798+0000 7f196360f740 1 -- start start 2024-09-15T22:14:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.798+0000 7f196360f740 1 Processor -- start 2024-09-15T22:14:26.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.798+0000 7f196360f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c70de0 0x558282c96880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.798+0000 7f196360f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 0x558282c8f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.798+0000 7f196360f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c7bfc0 0x558282c8f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.798+0000 7f196360f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558282c8df10 con 0x558282c71700 2024-09-15T22:14:26.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.798+0000 7f196360f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558282c8d840 con 0x558282c7bfc0 2024-09-15T22:14:26.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.798+0000 7f196360f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558282c8e5e0 con 0x558282c70de0 2024-09-15T22:14:26.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.798+0000 7f196360f740 10 client.0 _ll_register_callbacks cb 0x7f19500097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:14:26.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.798+0000 7f195a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 0x558282c8f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.798+0000 7f195a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 0x558282c8f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48464/0 (socket says 172.21.15.45:48464) 2024-09-15T22:14:26.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.798+0000 7f195a59c640 1 -- 172.21.15.45:0/1077040893 learned_addr learned my addr 172.21.15.45:0/1077040893 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:26.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.798+0000 7f195b59e640 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c70de0 0x558282c96880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f195a59c640 1 -- 172.21.15.45:0/1077040893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c70de0 msgr2=0x558282c96880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:26.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f195b59e640 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c7bfc0 0x558282c8f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f195a59c640 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c70de0 0x558282c96880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f195a59c640 1 -- 172.21.15.45:0/1077040893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c7bfc0 msgr2=0x558282c8f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:14:26.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f195a59c640 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c7bfc0 0x558282c8f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f195a59c640 1 -- 172.21.15.45:0/1077040893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558282c8fd90 con 0x558282c71700 2024-09-15T22:14:26.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f195b59e640 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c7bfc0 0x558282c8f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:26.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f195a59c640 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 0x558282c8f290 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1950016040 tx=0x7f1950005cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528ac9c7e1610714 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:26.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f193eff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:14:26.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f193eff5640 1 -- 172.21.15.45:0/1077040893 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195001b8c0 con 0x558282c71700 2024-09-15T22:14:26.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f193eff5640 1 -- 172.21.15.45:0/1077040893 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f195001ba60 con 0x558282c71700 2024-09-15T22:14:26.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f196360f740 1 -- 172.21.15.45:0/1077040893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1954036040 con 0x558282c71700 2024-09-15T22:14:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f193eff5640 1 -- 172.21.15.45:0/1077040893 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f1950039050 con 0x558282c71700 2024-09-15T22:14:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f196360f740 10 client.14721 fetch_fsmap learned FSMap version 17 2024-09-15T22:14:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f196360f740 1 -- 172.21.15.45:0/1077040893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x558282cf60b0 con 0x558282c71700 2024-09-15T22:14:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.799+0000 7f193eff5640 1 -- 172.21.15.45:0/1077040893 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1950030070 con 0x558282c71700 2024-09-15T22:14:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.800+0000 7f193eff5640 1 -- 172.21.15.45:0/1077040893 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f195001a050 con 0x558282c71700 2024-09-15T22:14:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.800+0000 7f196360f740 10 client.14721 fetch_fsmap finished waiting for FSMap version 17 2024-09-15T22:14:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.800+0000 7f196360f740 10 client.14721 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:14:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.800+0000 7f196360f740 20 client.14721 populate_metadata read hostname 'smithi045' 2024-09-15T22:14:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.800+0000 7f196360f740 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558282cfac50 0x558282cf9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.800+0000 7f196360f740 4 client.14721 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:14:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.800+0000 7f196360f740 1 -- 172.21.15.45:0/1077040893 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "status"}) -- 0x7f1954036040 con 0x558282cfac50 2024-09-15T22:14:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.800+0000 7f195b59e640 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558282cfac50 0x558282cf9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:26.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.800+0000 7f193eff5640 10 client.14721 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:14:26.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.800+0000 7f195b59e640 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558282cfac50 0x558282cf9960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d22632b3cb002c15 server_cookie=21c4f36a8b7e8239 in_seq=0 out_seq=0 2024-09-15T22:14:26.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.800+0000 7f193eff5640 1 -- 172.21.15.45:0/1077040893 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x7f1954036040 con 0x558282cfac50 2024-09-15T22:14:26.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.800+0000 7f193eff5640 10 client.14721 handle_command_reply: tid=0 2024-09-15T22:14:26.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f196360f740 1 client.14721 shutdown 2024-09-15T22:14:26.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f196360f740 1 -- 172.21.15.45:0/1077040893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 msgr2=0x558282c8f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:26.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f196360f740 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 0x558282c8f290 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1950016040 tx=0x7f1950005cd0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f196360f740 1 -- 172.21.15.45:0/1077040893 shutdown_connections 2024-09-15T22:14:26.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f196360f740 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558282cfac50 0x558282cf9960 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f196360f740 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558282c7bfc0 0x558282c8f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f196360f740 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558282c71700 0x558282c8f290 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f196360f740 1 --2- 172.21.15.45:0/1077040893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558282c70de0 0x558282c96880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f196360f740 1 -- 172.21.15.45:0/1077040893 >> 172.21.15.45:0/1077040893 conn(0x558282c6d370 msgr2=0x558282c72800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:26.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f193eff5640 0 client.14721 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:14:26.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f196360f740 1 -- 172.21.15.45:0/1077040893 shutdown_connections 2024-09-15T22:14:26.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f196360f740 1 -- 172.21.15.45:0/1077040893 wait complete. 2024-09-15T22:14:26.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f196360f740 20 client.14721 trim_cache size 0 max 16384 2024-09-15T22:14:26.820 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:14:26.820 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "a1911414-73ae-11ef-bceb-c7b262605968", 2024-09-15T22:14:26.821 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2024-09-15T22:14:26.821 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24476, 2024-09-15T22:14:26.821 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-09-15T22:14:26.821 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-09-15T22:14:26.821 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-09-15T22:14:26.821 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 18.994234581000001, 2024-09-15T22:14:26.821 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 17, 2024-09-15T22:14:26.821 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 87, 2024-09-15T22:14:26.821 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 87, 2024-09-15T22:14:26.821 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 29.560312574000001 2024-09-15T22:14:26.822 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:14:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f1961236640 1 -- 172.21.15.45:0/2492222621 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f19440a3240 msgr2=0x7f19440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f1961236640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f19440a3240 0x7f19440a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f194c0cd620 tx=0x7f194c0d5530 comp rx=0 tx=0).stop 2024-09-15T22:14:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.801+0000 7f1961236640 1 -- 172.21.15.45:0/2492222621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195c100a80 msgr2=0x7f195c199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.802+0000 7f1961236640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195c100a80 0x7f195c199310 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f194c00d950 tx=0x7f194c00de10 comp rx=0 tx=0).stop 2024-09-15T22:14:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.802+0000 7f1961236640 1 -- 172.21.15.45:0/2492222621 shutdown_connections 2024-09-15T22:14:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.802+0000 7f1961236640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f19440a3240 0x7f19440a5700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.802+0000 7f1961236640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195c106a80 0x7f195c1a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.802+0000 7f1961236640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f195c101420 0x7f195c199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.802+0000 7f1961236640 1 --2- 172.21.15.45:0/2492222621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195c100a80 0x7f195c199310 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.802+0000 7f1961236640 1 -- 172.21.15.45:0/2492222621 >> 172.21.15.45:0/2492222621 conn(0x7f195c0fc7a0 msgr2=0x7f195c0fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.802+0000 7f1961236640 1 -- 172.21.15.45:0/2492222621 shutdown_connections 2024-09-15T22:14:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:26.802+0000 7f1961236640 1 -- 172.21.15.45:0/2492222621 wait complete. 2024-09-15T22:14:27.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:26 smithi045 ceph-mon[31180]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:27.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:26 smithi165 ceph-mon[35551]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:27.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:26 smithi100 ceph-mon[35319]: pgmap v292: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:27.628 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:14:27.628 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:14:27.628 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-15T22:14:27.886 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.416+0000 7f7429184640 1 -- 172.21.15.45:0/3965608742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7424100a80 msgr2=0x7f7424100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.416+0000 7f7429184640 1 --2- 172.21.15.45:0/3965608742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7424100a80 0x7f7424100ee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7418009930 tx=0x7f741802a420 comp rx=0 tx=0).stop 2024-09-15T22:14:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.416+0000 7f7429184640 1 -- 172.21.15.45:0/3965608742 shutdown_connections 2024-09-15T22:14:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.416+0000 7f7429184640 1 --2- 172.21.15.45:0/3965608742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7424101420 0x7f742410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.416+0000 7f7429184640 1 --2- 172.21.15.45:0/3965608742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7424100a80 0x7f7424100ee0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.416+0000 7f7429184640 1 --2- 172.21.15.45:0/3965608742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7424106a80 0x7f7424106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.416+0000 7f7429184640 1 -- 172.21.15.45:0/3965608742 >> 172.21.15.45:0/3965608742 conn(0x7f74240fc7a0 msgr2=0x7f74240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.416+0000 7f7429184640 1 -- 172.21.15.45:0/3965608742 shutdown_connections 2024-09-15T22:14:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.416+0000 7f7429184640 1 -- 172.21.15.45:0/3965608742 wait complete. 2024-09-15T22:14:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.417+0000 7f7429184640 1 Processor -- start 2024-09-15T22:14:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.417+0000 7f7429184640 1 -- start start 2024-09-15T22:14:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f7429184640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7424100a80 0x7f74241993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f7429184640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7424101420 0x7f74241998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:28.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f7429184640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7424106a80 0x7f74241a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f7429184640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7424110fe0 con 0x7f7424101420 2024-09-15T22:14:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f7429184640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7424110e60 con 0x7f7424106a80 2024-09-15T22:14:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f7429184640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7424111160 con 0x7f7424100a80 2024-09-15T22:14:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f742259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7424101420 0x7f74241998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f742259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7424101420 0x7f74241998f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48494/0 (socket says 172.21.15.45:48494) 2024-09-15T22:14:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f742259c640 1 -- 172.21.15.45:0/585077864 learned_addr learned my addr 172.21.15.45:0/585077864 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f742359e640 1 --2- 172.21.15.45:0/585077864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7424106a80 0x7f74241a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f742259c640 1 -- 172.21.15.45:0/585077864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7424100a80 msgr2=0x7f74241993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f742259c640 1 --2- 172.21.15.45:0/585077864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7424100a80 0x7f74241993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f742259c640 1 -- 172.21.15.45:0/585077864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7424106a80 msgr2=0x7f74241a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f742259c640 1 --2- 172.21.15.45:0/585077864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7424106a80 0x7f74241a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:28.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f742259c640 1 -- 172.21.15.45:0/585077864 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74241a4970 con 0x7f7424101420 2024-09-15T22:14:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f742259c640 1 --2- 172.21.15.45:0/585077864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7424101420 0x7f74241998f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7418009230 tx=0x7f7418004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f740bfff640 1 -- 172.21.15.45:0/585077864 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741803f030 con 0x7f7424101420 2024-09-15T22:14:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f740bfff640 1 -- 172.21.15.45:0/585077864 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7418003af0 con 0x7f7424101420 2024-09-15T22:14:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f7429184640 1 -- 172.21.15.45:0/585077864 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74241a4b40 con 0x7f7424101420 2024-09-15T22:14:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.418+0000 7f740bfff640 1 -- 172.21.15.45:0/585077864 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418035070 con 0x7f7424101420 2024-09-15T22:14:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.419+0000 7f7429184640 1 -- 172.21.15.45:0/585077864 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74241a4ff0 con 0x7f7424101420 2024-09-15T22:14:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.420+0000 7f7429184640 1 -- 172.21.15.45:0/585077864 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7424100ee0 con 0x7f7424101420 2024-09-15T22:14:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.421+0000 7f740bfff640 1 -- 172.21.15.45:0/585077864 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7418042030 con 0x7f7424101420 2024-09-15T22:14:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.422+0000 7f740bfff640 1 --2- 172.21.15.45:0/585077864 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f740c0a3240 0x7f740c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.422+0000 7f7422d9d640 1 --2- 172.21.15.45:0/585077864 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f740c0a3240 0x7f740c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.422+0000 7f740bfff640 1 -- 172.21.15.45:0/585077864 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f74180f0730 con 0x7f7424101420 2024-09-15T22:14:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.422+0000 7f7422d9d640 1 --2- 172.21.15.45:0/585077864 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f740c0a3240 0x7f740c0a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7414009710 tx=0x7f7414006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:28.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.425+0000 7f740bfff640 1 -- 172.21.15.45:0/585077864 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f74180bd2d0 con 0x7f7424101420 2024-09-15T22:14:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.637+0000 7f7429184640 1 -- 172.21.15.45:0/585077864 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f74241a5220 con 0x7f7424101420 2024-09-15T22:14:28.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.637+0000 7f740bfff640 1 -- 172.21.15.45:0/585077864 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f74180bcbd0 con 0x7f7424101420 2024-09-15T22:14:28.639 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T22:14:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.640+0000 7f7429184640 1 -- 172.21.15.45:0/585077864 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f740c0a3240 msgr2=0x7f740c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.640+0000 7f7429184640 1 --2- 172.21.15.45:0/585077864 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f740c0a3240 0x7f740c0a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7414009710 tx=0x7f7414006c90 comp rx=0 tx=0).stop 2024-09-15T22:14:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.640+0000 7f7429184640 1 -- 172.21.15.45:0/585077864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7424101420 msgr2=0x7f74241998f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.640+0000 7f7429184640 1 --2- 172.21.15.45:0/585077864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7424101420 0x7f74241998f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7418009230 tx=0x7f7418004270 comp rx=0 tx=0).stop 2024-09-15T22:14:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.640+0000 7f7429184640 1 -- 172.21.15.45:0/585077864 shutdown_connections 2024-09-15T22:14:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.640+0000 7f7429184640 1 --2- 172.21.15.45:0/585077864 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f740c0a3240 0x7f740c0a5700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.640+0000 7f7429184640 1 --2- 172.21.15.45:0/585077864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7424106a80 0x7f74241a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.640+0000 7f7429184640 1 --2- 172.21.15.45:0/585077864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7424101420 0x7f74241998f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.640+0000 7f7429184640 1 --2- 172.21.15.45:0/585077864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7424100a80 0x7f74241993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:28.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.640+0000 7f7429184640 1 -- 172.21.15.45:0/585077864 >> 172.21.15.45:0/585077864 conn(0x7f74240fc7a0 msgr2=0x7f74240fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:28.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.640+0000 7f7429184640 1 -- 172.21.15.45:0/585077864 shutdown_connections 2024-09-15T22:14:28.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:28.640+0000 7f7429184640 1 -- 172.21.15.45:0/585077864 wait complete. 2024-09-15T22:14:29.001 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:28 smithi045 ceph-mon[31180]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:29.001 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:28 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/585077864' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:14:29.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:28 smithi165 ceph-mon[35551]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:29.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:28 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/585077864' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:14:29.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:28 smithi100 ceph-mon[35319]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:29.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:28 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/585077864' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:14:29.493 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:14:29.493 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:14:29.493 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2024-09-15T22:14:29.493 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-15T22:14:29.493 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:14:29.493 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:14:29.494 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:14:29.494 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:14:29.494 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-15T22:14:29.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:14:29.494 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2024-09-15T22:14:29.512 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:14:29.512 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:14:29.512 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:14:29.512 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:14:29.512 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2024-09-15T22:14:29.512 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:14:29.512 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:14:29.512 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:14:29.512 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2024-09-15T22:14:29.513 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:14:29.513 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:14:29.513 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2024-09-15T22:14:29.513 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:14:29.513 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2024-09-15T22:14:29.513 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2024-09-15T22:14:29.513 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-15T22:14:29.513 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42312sec preferred_lft 42312sec 2024-09-15T22:14:29.514 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2024-09-15T22:14:29.514 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:14:29.514 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:14:29.514 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2024-09-15T22:14:29.514 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2024-09-15T22:14:29.515 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:14:29.515 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:14:29.515 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-15T22:14:29.515 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:14:29.515 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2024-09-15T22:14:29.515 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2024-09-15T22:14:29.515 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:14:29.515 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-15T22:14:29.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:14:29.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:14:29.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:14:29.714 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:14:29.740 INFO:teuthology.orchestra.run.smithi045.stdout:1 2024-09-15T22:14:29.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:14:29.741 DEBUG:teuthology.orchestra.run.smithi045:> route 2024-09-15T22:14:29.815 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2024-09-15T22:14:29.816 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:14:29.816 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-15T22:14:29.816 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-15T22:14:29.816 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:14:29.816 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:14:29.816 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-15T22:14:29.816 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:14:29.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:14:29.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:14:29.817 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-15T22:14:29.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:14:30.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:14:30.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:14:30.101 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-09-15T22:14:30.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:14:30.118 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2024-09-15T22:14:30.174 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:14:30.174 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-15T22:14:30.174 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:14:30.174 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-15T22:14:30.174 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-15T22:14:30.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:14:30.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:14:30.293 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-15T22:14:30.294 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:14:30.294 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-15T22:14:30.294 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-15T22:14:30.294 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:14:30.294 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-15T22:14:30.294 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-15T22:14:30.294 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-15T22:14:30.294 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-15T22:14:30.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:14:30.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:14:30.424 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:14:30.424 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-15T22:14:30.424 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2024-09-15T22:14:30.424 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:14:30.424 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-15T22:14:30.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:14:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:14:30.502 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-15T22:14:30.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:14:30.503 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:14:30.518 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-15T22:14:30.518 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:14:30.519 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:14:30.574 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2024-09-15T22:14:30.641 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:14:30.700 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2024-09-15T22:14:30.701 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2024-09-15T22:14:30.701 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2024-09-15T22:14:30.701 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2024-09-15T22:14:30.701 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2024-09-15T22:14:30.701 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2024-09-15T22:14:30.701 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2024-09-15T22:14:30.701 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2024-09-15T22:14:30.701 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2024-09-15T22:14:30.701 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2024-09-15T22:14:30.701 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2024-09-15T22:14:30.701 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/selinux 2024-09-15T22:14:30.702 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:14:30.702 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2024-09-15T22:14:30.702 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2024-09-15T22:14:30.702 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2024-09-15T22:14:30.702 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2024-09-15T22:14:30.702 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2024-09-15T22:14:30.702 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2024-09-15T22:14:30.702 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T22:14:30.702 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T22:14:30.702 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T22:14:30.702 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T22:14:30.702 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2024-09-15T22:14:30.702 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2024-09-15T22:14:30.703 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay 2024-09-15T22:14:30.703 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/3c2c80644d5271903ac25571f75437397ce6c70b9b384ca9bdac6c171df65578/merged 2024-09-15T22:14:30.703 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/adf2304755a376d132f8506c84ad33d2bb83849fa568fdc021ad8bc28e78e41b/merged 2024-09-15T22:14:30.703 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/0 2024-09-15T22:14:30.703 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:14:30.703 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/3511c9b4d217674732fbda1717fbb7632d830b5ac244ca996f42a62910bf9abb/merged 2024-09-15T22:14:30.703 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/713260c8492dabd9fb6c7ab9013903da1eeb4ce0e69736215e9c4c4b53c120d4/merged 2024-09-15T22:14:30.703 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/ae82ac43c992ce8c5e77f9c960da5317079ec05dd5ac08e6da9b3d4e9a2bdff3/merged 2024-09-15T22:14:30.703 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/b076042a64cfd115395d23a62add092ddd2cd4d091b98c27ca5f09ce6ebac381/merged 2024-09-15T22:14:30.703 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/05bd1dec864f59bf00f58423df84c485ef07d6140fe4d0d02832a0c2ebca9f65/merged 2024-09-15T22:14:30.703 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/a0550e1d20f5175b60313edacc2641e66c060b2d352541a4705c2c8668f02a2c/merged 2024-09-15T22:14:30.703 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/33ef9a76f38b557ebd1e09e829a6c404a869fa70a13cfc4e71842239d56519b8/merged 2024-09-15T22:14:30.704 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/afd261bd7631876361a3cae837bdda2b1eda9b10cf3d423efe985555848608be/merged 2024-09-15T22:14:30.704 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2024-09-15T22:14:30.704 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:14:30.704 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:14:30.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:14:30.704 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2024-09-15T22:14:30.756 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T22:14:30.757 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-15T22:14:30.799 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2024-09-15T22:14:30.826 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:14:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2024-09-15T22:14:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2024-09-15T22:14:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2024-09-15T22:14:30.884 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2024-09-15T22:14:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2024-09-15T22:14:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2024-09-15T22:14:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2024-09-15T22:14:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2024-09-15T22:14:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2024-09-15T22:14:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2024-09-15T22:14:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2024-09-15T22:14:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/selinux 2024-09-15T22:14:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:14:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2024-09-15T22:14:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2024-09-15T22:14:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2024-09-15T22:14:30.885 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2024-09-15T22:14:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2024-09-15T22:14:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2024-09-15T22:14:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T22:14:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T22:14:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T22:14:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T22:14:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2024-09-15T22:14:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2024-09-15T22:14:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay 2024-09-15T22:14:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/3c2c80644d5271903ac25571f75437397ce6c70b9b384ca9bdac6c171df65578/merged 2024-09-15T22:14:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/adf2304755a376d132f8506c84ad33d2bb83849fa568fdc021ad8bc28e78e41b/merged 2024-09-15T22:14:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/0 2024-09-15T22:14:30.886 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:14:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/3511c9b4d217674732fbda1717fbb7632d830b5ac244ca996f42a62910bf9abb/merged 2024-09-15T22:14:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/713260c8492dabd9fb6c7ab9013903da1eeb4ce0e69736215e9c4c4b53c120d4/merged 2024-09-15T22:14:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/ae82ac43c992ce8c5e77f9c960da5317079ec05dd5ac08e6da9b3d4e9a2bdff3/merged 2024-09-15T22:14:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/b076042a64cfd115395d23a62add092ddd2cd4d091b98c27ca5f09ce6ebac381/merged 2024-09-15T22:14:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/05bd1dec864f59bf00f58423df84c485ef07d6140fe4d0d02832a0c2ebca9f65/merged 2024-09-15T22:14:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/a0550e1d20f5175b60313edacc2641e66c060b2d352541a4705c2c8668f02a2c/merged 2024-09-15T22:14:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/33ef9a76f38b557ebd1e09e829a6c404a869fa70a13cfc4e71842239d56519b8/merged 2024-09-15T22:14:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/afd261bd7631876361a3cae837bdda2b1eda9b10cf3d423efe985555848608be/merged 2024-09-15T22:14:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2024-09-15T22:14:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:14:30.887 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:14:30.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:14:30.888 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2024-09-15T22:14:30.939 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:2024-09-15T22:14:30.937+0000 7fd6f13f7480 -1 init, newargv = 0x55de646bbb50 newargc=15 2024-09-15T22:14:30.940 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[75867]: starting ceph client 2024-09-15T22:14:30.946 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[75867]: starting fuse 2024-09-15T22:14:31.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:30 smithi045 ceph-mon[31180]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:31.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:30 smithi165 ceph-mon[35551]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:31.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:30 smithi100 ceph-mon[35319]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:14:32.042 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2024-09-15T22:14:32.076 DEBUG:teuthology.orchestra.run.smithi045:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:14:32.136 INFO:teuthology.orchestra.run.smithi045.stdout:/proc 2024-09-15T22:14:32.136 INFO:teuthology.orchestra.run.smithi045.stdout:/sys 2024-09-15T22:14:32.136 INFO:teuthology.orchestra.run.smithi045.stdout:/dev 2024-09-15T22:14:32.136 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/security 2024-09-15T22:14:32.137 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/shm 2024-09-15T22:14:32.137 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/pts 2024-09-15T22:14:32.137 INFO:teuthology.orchestra.run.smithi045.stdout:/run 2024-09-15T22:14:32.137 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/cgroup 2024-09-15T22:14:32.137 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/pstore 2024-09-15T22:14:32.137 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/bpf 2024-09-15T22:14:32.137 INFO:teuthology.orchestra.run.smithi045.stdout:/ 2024-09-15T22:14:32.137 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/selinux 2024-09-15T22:14:32.137 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:14:32.137 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/debug 2024-09-15T22:14:32.138 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/mqueue 2024-09-15T22:14:32.138 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/tracing 2024-09-15T22:14:32.138 INFO:teuthology.orchestra.run.smithi045.stdout:/dev/hugepages 2024-09-15T22:14:32.138 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/fs/fuse/connections 2024-09-15T22:14:32.138 INFO:teuthology.orchestra.run.smithi045.stdout:/sys/kernel/config 2024-09-15T22:14:32.138 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T22:14:32.138 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T22:14:32.138 INFO:teuthology.orchestra.run.smithi045.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T22:14:32.138 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T22:14:32.138 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/1000 2024-09-15T22:14:32.138 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/ceph 2024-09-15T22:14:32.138 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay 2024-09-15T22:14:32.138 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/3c2c80644d5271903ac25571f75437397ce6c70b9b384ca9bdac6c171df65578/merged 2024-09-15T22:14:32.139 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/adf2304755a376d132f8506c84ad33d2bb83849fa568fdc021ad8bc28e78e41b/merged 2024-09-15T22:14:32.139 INFO:teuthology.orchestra.run.smithi045.stdout:/run/user/0 2024-09-15T22:14:32.139 INFO:teuthology.orchestra.run.smithi045.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:14:32.139 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/3511c9b4d217674732fbda1717fbb7632d830b5ac244ca996f42a62910bf9abb/merged 2024-09-15T22:14:32.139 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/713260c8492dabd9fb6c7ab9013903da1eeb4ce0e69736215e9c4c4b53c120d4/merged 2024-09-15T22:14:32.139 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/ae82ac43c992ce8c5e77f9c960da5317079ec05dd5ac08e6da9b3d4e9a2bdff3/merged 2024-09-15T22:14:32.139 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/b076042a64cfd115395d23a62add092ddd2cd4d091b98c27ca5f09ce6ebac381/merged 2024-09-15T22:14:32.140 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/05bd1dec864f59bf00f58423df84c485ef07d6140fe4d0d02832a0c2ebca9f65/merged 2024-09-15T22:14:32.140 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/a0550e1d20f5175b60313edacc2641e66c060b2d352541a4705c2c8668f02a2c/merged 2024-09-15T22:14:32.140 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/33ef9a76f38b557ebd1e09e829a6c404a869fa70a13cfc4e71842239d56519b8/merged 2024-09-15T22:14:32.140 INFO:teuthology.orchestra.run.smithi045.stdout:/var/lib/containers/storage/overlay/afd261bd7631876361a3cae837bdda2b1eda9b10cf3d423efe985555848608be/merged 2024-09-15T22:14:32.140 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns 2024-09-15T22:14:32.140 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:14:32.140 INFO:teuthology.orchestra.run.smithi045.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:14:32.140 INFO:teuthology.orchestra.run.smithi045.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-15T22:14:32.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:14:32.140 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2024-09-15T22:14:32.196 INFO:teuthology.orchestra.run.smithi045.stdout:120 2024-09-15T22:14:32.196 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-15T22:14:32.197 DEBUG:teuthology.orchestra.run.smithi045:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:14:32.197 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2024-09-15T22:14:32.197 DEBUG:teuthology.orchestra.run.smithi045:> import re 2024-09-15T22:14:32.197 DEBUG:teuthology.orchestra.run.smithi045:> import os 2024-09-15T22:14:32.198 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2024-09-15T22:14:32.198 DEBUG:teuthology.orchestra.run.smithi045:> 2024-09-15T22:14:32.198 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2024-09-15T22:14:32.199 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-15T22:14:32.199 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2024-09-15T22:14:32.199 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-15T22:14:32.199 DEBUG:teuthology.orchestra.run.smithi045:> 2024-09-15T22:14:32.199 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2024-09-15T22:14:32.199 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2024-09-15T22:14:32.200 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2024-09-15T22:14:32.200 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2024-09-15T22:14:32.200 DEBUG:teuthology.orchestra.run.smithi045:> 2024-09-15T22:14:32.200 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2024-09-15T22:14:32.200 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:14:32.201 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:14:32.201 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:14:32.201 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2024-09-15T22:14:32.201 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2024-09-15T22:14:32.201 DEBUG:teuthology.orchestra.run.smithi045:> return f 2024-09-15T22:14:32.201 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:14:32.201 DEBUG:teuthology.orchestra.run.smithi045:> 2024-09-15T22:14:32.202 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.admin")) 2024-09-15T22:14:32.202 DEBUG:teuthology.orchestra.run.smithi045:> ' 2024-09-15T22:14:32.324 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.admin.75867.asok 2024-09-15T22:14:32.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:14:32.335 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75867.asok 2024-09-15T22:14:32.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:14:32.336 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75867.asok status 2024-09-15T22:14:32.475 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:14:32.476 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2024-09-15T22:14:32.476 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:14:32.476 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:14:32.476 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "admin", 2024-09-15T22:14:32.476 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2024-09-15T22:14:32.476 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-15T22:14:32.476 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "75867", 2024-09-15T22:14:32.476 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2024-09-15T22:14:32.476 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:14:32.476 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2024-09-15T22:14:32.476 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 14733, 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 14733 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3064951967 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2024-09-15T22:14:32.477 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-09-15T22:14:32.478 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2024-09-15T22:14:32.478 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3064951967 2024-09-15T22:14:32.478 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:14:32.478 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.14733 192.168.0.1:0/3064951967", 2024-09-15T22:14:32.478 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/3064951967", 2024-09-15T22:14:32.478 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2024-09-15T22:14:32.478 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 17, 2024-09-15T22:14:32.478 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 87, 2024-09-15T22:14:32.478 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:14:32.478 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2024-09-15T22:14:32.478 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2024-09-15T22:14:32.478 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:14:32.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:14:32.484 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2024-09-15T22:14:32.484 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:14:32.501 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2024-09-15T22:14:32.501 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:14:32.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:14:32.501 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:14:32.568 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-15T22:14:32.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:14:32.784 INFO:teuthology.orchestra.run.smithi045.stdout:# file: . 2024-09-15T22:14:32.784 INFO:teuthology.orchestra.run.smithi045.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-15T22:14:32.784 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:14:32.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:14:32.791 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:14:32.791 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:14:32.809 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T22:14:33.105 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:33.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:32 smithi165 ceph-mon[35551]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:14:33.227 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:32 smithi045 ceph-mon[31180]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:14:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:32 smithi100 ceph-mon[35319]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:14:33.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.601+0000 7fca8248c640 1 -- 172.21.15.45:0/1104219060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c100e20 msgr2=0x7fca7c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:33.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.601+0000 7fca8248c640 1 --2- 172.21.15.45:0/1104219060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c100e20 0x7fca7c101200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009900 tx=0x7fca6c02a480 comp rx=0 tx=0).stop 2024-09-15T22:14:33.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.601+0000 7fca8248c640 1 -- 172.21.15.45:0/1104219060 shutdown_connections 2024-09-15T22:14:33.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.601+0000 7fca8248c640 1 --2- 172.21.15.45:0/1104219060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca7c102ef0 0x7fca7c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:33.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.601+0000 7fca8248c640 1 --2- 172.21.15.45:0/1104219060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca7c102570 0x7fca7c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:33.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.601+0000 7fca8248c640 1 --2- 172.21.15.45:0/1104219060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c100e20 0x7fca7c101200 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:33.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.601+0000 7fca8248c640 1 -- 172.21.15.45:0/1104219060 >> 172.21.15.45:0/1104219060 conn(0x7fca7c0fc7d0 msgr2=0x7fca7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:33.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.601+0000 7fca8248c640 1 -- 172.21.15.45:0/1104219060 shutdown_connections 2024-09-15T22:14:33.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.601+0000 7fca8248c640 1 -- 172.21.15.45:0/1104219060 wait complete. 2024-09-15T22:14:33.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.602+0000 7fca8248c640 1 Processor -- start 2024-09-15T22:14:33.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.602+0000 7fca8248c640 1 -- start start 2024-09-15T22:14:33.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.602+0000 7fca8248c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca7c100e20 0x7fca7c1a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:33.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.602+0000 7fca8248c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c102570 0x7fca7c1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:33.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.602+0000 7fca8248c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca7c102ef0 0x7fca7c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:33.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.602+0000 7fca8248c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c1110c0 con 0x7fca7c102570 2024-09-15T22:14:33.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.602+0000 7fca8248c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c110f40 con 0x7fca7c102ef0 2024-09-15T22:14:33.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.602+0000 7fca8248c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c111240 con 0x7fca7c100e20 2024-09-15T22:14:33.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.602+0000 7fca73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c102570 0x7fca7c1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:33.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.602+0000 7fca73fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c102570 0x7fca7c1a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48514/0 (socket says 172.21.15.45:48514) 2024-09-15T22:14:33.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.602+0000 7fca73fff640 1 -- 172.21.15.45:0/201833584 learned_addr learned my addr 172.21.15.45:0/201833584 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.602+0000 7fca80a29640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca7c102ef0 0x7fca7c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.603+0000 7fca7bfff640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca7c100e20 0x7fca7c1a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.603+0000 7fca73fff640 1 -- 172.21.15.45:0/201833584 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca7c100e20 msgr2=0x7fca7c1a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.603+0000 7fca73fff640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca7c100e20 0x7fca7c1a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.603+0000 7fca73fff640 1 -- 172.21.15.45:0/201833584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca7c102ef0 msgr2=0x7fca7c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.603+0000 7fca73fff640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca7c102ef0 0x7fca7c19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.603+0000 7fca73fff640 1 -- 172.21.15.45:0/201833584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c19aef0 con 0x7fca7c102570 2024-09-15T22:14:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.603+0000 7fca80a29640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca7c102ef0 0x7fca7c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:14:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.603+0000 7fca73fff640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c102570 0x7fca7c1a0af0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fca6400d950 tx=0x7fca6400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.603+0000 7fca79ffb640 1 -- 172.21.15.45:0/201833584 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64017070 con 0x7fca7c102570 2024-09-15T22:14:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.603+0000 7fca8248c640 1 -- 172.21.15.45:0/201833584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7c19b1e0 con 0x7fca7c102570 2024-09-15T22:14:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.603+0000 7fca79ffb640 1 -- 172.21.15.45:0/201833584 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca64009c30 con 0x7fca7c102570 2024-09-15T22:14:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.603+0000 7fca79ffb640 1 -- 172.21.15.45:0/201833584 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6400f740 con 0x7fca7c102570 2024-09-15T22:14:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.603+0000 7fca8248c640 1 -- 172.21.15.45:0/201833584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7c1a7530 con 0x7fca7c102570 2024-09-15T22:14:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.604+0000 7fca8248c640 1 -- 172.21.15.45:0/201833584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca7c1021b0 con 0x7fca7c102570 2024-09-15T22:14:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.605+0000 7fca79ffb640 1 -- 172.21.15.45:0/201833584 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fca64010a80 con 0x7fca7c102570 2024-09-15T22:14:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.606+0000 7fca79ffb640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca680a3240 0x7fca680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.606+0000 7fca7bfff640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca680a3240 0x7fca680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.606+0000 7fca79ffb640 1 -- 172.21.15.45:0/201833584 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fca640cfc20 con 0x7fca7c102570 2024-09-15T22:14:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.606+0000 7fca7bfff640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca680a3240 0x7fca680a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fca6c02a9a0 tx=0x7fca6c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.610+0000 7fca79ffb640 1 -- 172.21.15.45:0/201833584 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca64009de0 con 0x7fca7c102570 2024-09-15T22:14:33.801 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.798+0000 7fca8248c640 1 -- 172.21.15.45:0/201833584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fca7c19bbb0 con 0x7fca7c102570 2024-09-15T22:14:33.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.799+0000 7fca79ffb640 1 -- 172.21.15.45:0/201833584 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+592 (secure 0 0 0) 0x7fca6409c6a0 con 0x7fca7c102570 2024-09-15T22:14:33.802 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/3319321559 2024-09-16T22:07:15.327784+0000 2024-09-15T22:14:33.802 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/3319321559 2024-09-16T22:07:15.327784+0000 2024-09-15T22:14:33.802 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3960156552 2024-09-16T22:07:15.327784+0000 2024-09-15T22:14:33.802 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/2191835021 2024-09-16T22:06:51.521483+0000 2024-09-15T22:14:33.802 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3598420664 2024-09-16T22:07:15.327784+0000 2024-09-15T22:14:33.802 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3822069605 2024-09-16T22:07:15.327784+0000 2024-09-15T22:14:33.802 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2207608114 2024-09-16T22:06:51.521483+0000 2024-09-15T22:14:33.802 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/1499253284 2024-09-16T22:06:51.521483+0000 2024-09-15T22:14:33.803 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/2191835021 2024-09-16T22:06:51.521483+0000 2024-09-15T22:14:33.803 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3237288220 2024-09-16T22:06:51.521483+0000 2024-09-15T22:14:33.803 INFO:teuthology.orchestra.run.smithi045.stderr:listed 10 entries 2024-09-15T22:14:33.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.801+0000 7fca8248c640 1 -- 172.21.15.45:0/201833584 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca680a3240 msgr2=0x7fca680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:33.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.801+0000 7fca8248c640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca680a3240 0x7fca680a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fca6c02a9a0 tx=0x7fca6c005fd0 comp rx=0 tx=0).stop 2024-09-15T22:14:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.801+0000 7fca8248c640 1 -- 172.21.15.45:0/201833584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c102570 msgr2=0x7fca7c1a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.801+0000 7fca8248c640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c102570 0x7fca7c1a0af0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fca6400d950 tx=0x7fca6400de10 comp rx=0 tx=0).stop 2024-09-15T22:14:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.801+0000 7fca8248c640 1 -- 172.21.15.45:0/201833584 shutdown_connections 2024-09-15T22:14:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.801+0000 7fca8248c640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca680a3240 0x7fca680a5700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.801+0000 7fca8248c640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca7c102ef0 0x7fca7c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.801+0000 7fca8248c640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c102570 0x7fca7c1a0af0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.801+0000 7fca8248c640 1 --2- 172.21.15.45:0/201833584 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca7c100e20 0x7fca7c1a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.801+0000 7fca8248c640 1 -- 172.21.15.45:0/201833584 >> 172.21.15.45:0/201833584 conn(0x7fca7c0fc7d0 msgr2=0x7fca7c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.801+0000 7fca8248c640 1 -- 172.21.15.45:0/201833584 shutdown_connections 2024-09-15T22:14:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:33.801+0000 7fca8248c640 1 -- 172.21.15.45:0/201833584 wait complete. 2024-09-15T22:14:34.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:33 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/201833584' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:14:34.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:33 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/201833584' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:14:34.255 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:33 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/201833584' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:14:34.613 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:14:34.613 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:14:34.632 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T22:14:34.932 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:35.173 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:34 smithi045 ceph-mon[31180]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:14:35.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:34 smithi165 ceph-mon[35551]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:14:35.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:34 smithi100 ceph-mon[35319]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:14:35.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.394+0000 7f7783414640 1 -- 172.21.15.45:0/800618337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777c102790 msgr2=0x7f777c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:35.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.394+0000 7f7783414640 1 --2- 172.21.15.45:0/800618337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777c102790 0x7f777c1067e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f776c009900 tx=0x7f776c02a410 comp rx=0 tx=0).stop 2024-09-15T22:14:35.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.394+0000 7f7783414640 1 -- 172.21.15.45:0/800618337 shutdown_connections 2024-09-15T22:14:35.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.394+0000 7f7783414640 1 --2- 172.21.15.45:0/800618337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f777c106f10 0x7f777c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:35.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.394+0000 7f7783414640 1 --2- 172.21.15.45:0/800618337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777c102790 0x7f777c1067e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:35.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.394+0000 7f7783414640 1 --2- 172.21.15.45:0/800618337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f777c101de0 0x7f777c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:35.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.394+0000 7f7783414640 1 -- 172.21.15.45:0/800618337 >> 172.21.15.45:0/800618337 conn(0x7f777c0fd8c0 msgr2=0x7f777c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:35.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.394+0000 7f7783414640 1 -- 172.21.15.45:0/800618337 shutdown_connections 2024-09-15T22:14:35.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.394+0000 7f7783414640 1 -- 172.21.15.45:0/800618337 wait complete. 2024-09-15T22:14:35.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.394+0000 7f7783414640 1 Processor -- start 2024-09-15T22:14:35.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.394+0000 7f7783414640 1 -- start start 2024-09-15T22:14:35.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f7783414640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777c101de0 0x7f777c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:35.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f7783414640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f777c102790 0x7f777c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:35.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f7783414640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f777c106f10 0x7f777c19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:35.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f7783414640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f777c1120d0 con 0x7f777c101de0 2024-09-15T22:14:35.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f7783414640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f777c111f50 con 0x7f777c106f10 2024-09-15T22:14:35.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f7783414640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f777c112250 con 0x7f777c102790 2024-09-15T22:14:35.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77811b0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777c101de0 0x7f777c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77811b0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777c101de0 0x7f777c1985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45920/0 (socket says 172.21.15.45:45920) 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77811b0640 1 -- 172.21.15.45:0/2064116011 learned_addr learned my addr 172.21.15.45:0/2064116011 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77819b1640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f777c106f10 0x7f777c19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77811b0640 1 -- 172.21.15.45:0/2064116011 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f777c102790 msgr2=0x7f777c198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77809af640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f777c102790 0x7f777c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77811b0640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f777c102790 0x7f777c198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77811b0640 1 -- 172.21.15.45:0/2064116011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f777c106f10 msgr2=0x7f777c19cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77811b0640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f777c106f10 0x7f777c19cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77811b0640 1 -- 172.21.15.45:0/2064116011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777c19d5a0 con 0x7f777c101de0 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77809af640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f777c102790 0x7f777c198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77811b0640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777c101de0 0x7f777c1985f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f777800b4a0 tx=0x7f777800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77727fc640 1 -- 172.21.15.45:0/2064116011 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778014070 con 0x7f777c101de0 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f7783414640 1 -- 172.21.15.45:0/2064116011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777c19d890 con 0x7f777c101de0 2024-09-15T22:14:35.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77727fc640 1 -- 172.21.15.45:0/2064116011 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7778010b10 con 0x7f777c101de0 2024-09-15T22:14:35.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f77727fc640 1 -- 172.21.15.45:0/2064116011 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778017d60 con 0x7f777c101de0 2024-09-15T22:14:35.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.395+0000 7f7783414640 1 -- 172.21.15.45:0/2064116011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f777c1a5170 con 0x7f777c101de0 2024-09-15T22:14:35.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.397+0000 7f7783414640 1 -- 172.21.15.45:0/2064116011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f777c1021c0 con 0x7f777c101de0 2024-09-15T22:14:35.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.398+0000 7f77727fc640 1 -- 172.21.15.45:0/2064116011 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7778017070 con 0x7f777c101de0 2024-09-15T22:14:35.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.399+0000 7f77727fc640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f77680a3240 0x7f77680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:35.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.399+0000 7f77809af640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f77680a3240 0x7f77680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:35.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.399+0000 7f77727fc640 1 -- 172.21.15.45:0/2064116011 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f77780cf370 con 0x7f777c101de0 2024-09-15T22:14:35.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.399+0000 7f77809af640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f77680a3240 0x7f77680a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f776c000c00 tx=0x7f776c032d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:35.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.402+0000 7f77727fc640 1 -- 172.21.15.45:0/2064116011 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f777809be50 con 0x7f777c101de0 2024-09-15T22:14:35.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.591+0000 7f7783414640 1 -- 172.21.15.45:0/2064116011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f777c10a0f0 con 0x7f777c101de0 2024-09-15T22:14:35.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.591+0000 7f77727fc640 1 -- 172.21.15.45:0/2064116011 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+592 (secure 0 0 0) 0x7f777809b750 con 0x7f777c101de0 2024-09-15T22:14:35.594 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/3319321559 2024-09-16T22:07:15.327784+0000 2024-09-15T22:14:35.594 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/3319321559 2024-09-16T22:07:15.327784+0000 2024-09-15T22:14:35.594 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3960156552 2024-09-16T22:07:15.327784+0000 2024-09-15T22:14:35.594 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/2191835021 2024-09-16T22:06:51.521483+0000 2024-09-15T22:14:35.594 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3598420664 2024-09-16T22:07:15.327784+0000 2024-09-15T22:14:35.594 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3822069605 2024-09-16T22:07:15.327784+0000 2024-09-15T22:14:35.594 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2207608114 2024-09-16T22:06:51.521483+0000 2024-09-15T22:14:35.594 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/1499253284 2024-09-16T22:06:51.521483+0000 2024-09-15T22:14:35.594 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/2191835021 2024-09-16T22:06:51.521483+0000 2024-09-15T22:14:35.594 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3237288220 2024-09-16T22:06:51.521483+0000 2024-09-15T22:14:35.595 INFO:teuthology.orchestra.run.smithi045.stderr:listed 10 entries 2024-09-15T22:14:35.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.593+0000 7f7783414640 1 -- 172.21.15.45:0/2064116011 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f77680a3240 msgr2=0x7f77680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:35.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.593+0000 7f7783414640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f77680a3240 0x7f77680a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f776c000c00 tx=0x7f776c032d60 comp rx=0 tx=0).stop 2024-09-15T22:14:35.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.593+0000 7f7783414640 1 -- 172.21.15.45:0/2064116011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777c101de0 msgr2=0x7f777c1985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:35.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.593+0000 7f7783414640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777c101de0 0x7f777c1985f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f777800b4a0 tx=0x7f777800b960 comp rx=0 tx=0).stop 2024-09-15T22:14:35.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.594+0000 7f7783414640 1 -- 172.21.15.45:0/2064116011 shutdown_connections 2024-09-15T22:14:35.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.594+0000 7f7783414640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f77680a3240 0x7f77680a5700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:35.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.594+0000 7f7783414640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f777c106f10 0x7f777c19cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:35.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.594+0000 7f7783414640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f777c102790 0x7f777c198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:35.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.594+0000 7f7783414640 1 --2- 172.21.15.45:0/2064116011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f777c101de0 0x7f777c1985f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:35.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.594+0000 7f7783414640 1 -- 172.21.15.45:0/2064116011 >> 172.21.15.45:0/2064116011 conn(0x7f777c0fd8c0 msgr2=0x7f777c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:35.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.594+0000 7f7783414640 1 -- 172.21.15.45:0/2064116011 shutdown_connections 2024-09-15T22:14:35.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:35.594+0000 7f7783414640 1 -- 172.21.15.45:0/2064116011 wait complete. 2024-09-15T22:14:36.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:35 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2064116011' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:14:36.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:35 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2064116011' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:14:36.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:35 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2064116011' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:14:36.419 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2024-09-15T22:14:36.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:14:36.420 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:14:36.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[75867]: fuse finished with error 0 and tester_r 0 2024-09-15T22:14:36.450 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:14:36.529 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2024-09-15T22:14:36.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:14:36.529 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-15T22:14:36.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:14:36.855 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:37.144 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:36 smithi045 ceph-mon[31180]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:14:37.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:36 smithi165 ceph-mon[35551]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:14:37.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:36 smithi100 ceph-mon[35319]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-15T22:14:37.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.494+0000 7f6a54e73640 1 -- 172.21.15.45:0/2628050653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a50101420 msgr2=0x7f6a5010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:37.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.494+0000 7f6a54e73640 1 --2- 172.21.15.45:0/2628050653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a50101420 0x7f6a5010d950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009cd0 tx=0x7f6a4802a8e0 comp rx=0 tx=0).stop 2024-09-15T22:14:37.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.495+0000 7f6a54e73640 1 -- 172.21.15.45:0/2628050653 shutdown_connections 2024-09-15T22:14:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.495+0000 7f6a54e73640 1 --2- 172.21.15.45:0/2628050653 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a50101420 0x7f6a5010d950 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.495+0000 7f6a54e73640 1 --2- 172.21.15.45:0/2628050653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a50100a80 0x7f6a50100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.495+0000 7f6a54e73640 1 --2- 172.21.15.45:0/2628050653 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a50106a80 0x7f6a50106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.495+0000 7f6a54e73640 1 -- 172.21.15.45:0/2628050653 >> 172.21.15.45:0/2628050653 conn(0x7f6a500fc7a0 msgr2=0x7f6a500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.495+0000 7f6a54e73640 1 -- 172.21.15.45:0/2628050653 shutdown_connections 2024-09-15T22:14:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.495+0000 7f6a54e73640 1 -- 172.21.15.45:0/2628050653 wait complete. 2024-09-15T22:14:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.495+0000 7f6a54e73640 1 Processor -- start 2024-09-15T22:14:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.495+0000 7f6a54e73640 1 -- start start 2024-09-15T22:14:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a54e73640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a50100a80 0x7f6a501973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a54e73640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a50101420 0x7f6a50197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a54e73640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a50106a80 0x7f6a5019bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a54e73640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6a50110fa0 con 0x7f6a50100a80 2024-09-15T22:14:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a54e73640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6a50110e20 con 0x7f6a50101420 2024-09-15T22:14:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a54e73640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6a50111120 con 0x7f6a50106a80 2024-09-15T22:14:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a4e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a50100a80 0x7f6a501973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a4e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a50100a80 0x7f6a501973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45932/0 (socket says 172.21.15.45:45932) 2024-09-15T22:14:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a4e59c640 1 -- 172.21.15.45:0/1919253008 learned_addr learned my addr 172.21.15.45:0/1919253008 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a4ed9d640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a50106a80 0x7f6a5019bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a4dd9b640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a50101420 0x7f6a50197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a4e59c640 1 -- 172.21.15.45:0/1919253008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a50106a80 msgr2=0x7f6a5019bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a4e59c640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a50106a80 0x7f6a5019bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a4e59c640 1 -- 172.21.15.45:0/1919253008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a50101420 msgr2=0x7f6a50197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a4e59c640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a50101420 0x7f6a50197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a4e59c640 1 -- 172.21.15.45:0/1919253008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5019c370 con 0x7f6a50100a80 2024-09-15T22:14:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a4dd9b640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a50101420 0x7f6a50197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.496+0000 7f6a4e59c640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a50100a80 0x7f6a501973c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000c970 tx=0x7f6a4000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.497+0000 7f6a3f7fe640 1 -- 172.21.15.45:0/1919253008 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40007bb0 con 0x7f6a50100a80 2024-09-15T22:14:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.497+0000 7f6a54e73640 1 -- 172.21.15.45:0/1919253008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5019c660 con 0x7f6a50100a80 2024-09-15T22:14:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.497+0000 7f6a3f7fe640 1 -- 172.21.15.45:0/1919253008 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a40007d50 con 0x7f6a50100a80 2024-09-15T22:14:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.497+0000 7f6a3f7fe640 1 -- 172.21.15.45:0/1919253008 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000f4b0 con 0x7f6a50100a80 2024-09-15T22:14:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.497+0000 7f6a54e73640 1 -- 172.21.15.45:0/1919253008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a501a3f40 con 0x7f6a50100a80 2024-09-15T22:14:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.498+0000 7f6a54e73640 1 -- 172.21.15.45:0/1919253008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a50100ee0 con 0x7f6a50100a80 2024-09-15T22:14:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.499+0000 7f6a3f7fe640 1 -- 172.21.15.45:0/1919253008 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6a400046c0 con 0x7f6a50100a80 2024-09-15T22:14:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.500+0000 7f6a3f7fe640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f6a380a3240 0x7f6a380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.500+0000 7f6a4dd9b640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f6a380a3240 0x7f6a380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.500+0000 7f6a3f7fe640 1 -- 172.21.15.45:0/1919253008 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f6a400cf9b0 con 0x7f6a50100a80 2024-09-15T22:14:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.500+0000 7f6a4dd9b640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f6a380a3240 0x7f6a380a5700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a500feca0 tx=0x7f6a44005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.504+0000 7f6a3f7fe640 1 -- 172.21.15.45:0/1919253008 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a40014030 con 0x7f6a50100a80 2024-09-15T22:14:37.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.679+0000 7f6a54e73640 1 -- 172.21.15.45:0/1919253008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a501a41a0 con 0x7f6a50100a80 2024-09-15T22:14:37.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.680+0000 7f6a3f7fe640 1 -- 172.21.15.45:0/1919253008 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24190 (secure 0 0 0) 0x7f6a4009c430 con 0x7f6a50100a80 2024-09-15T22:14:37.683 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:14:37.683 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:14:16.455664+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:14:37.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.683+0000 7f6a54e73640 1 -- 172.21.15.45:0/1919253008 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f6a380a3240 msgr2=0x7f6a380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:37.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.683+0000 7f6a54e73640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f6a380a3240 0x7f6a380a5700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a500feca0 tx=0x7f6a44005e50 comp rx=0 tx=0).stop 2024-09-15T22:14:37.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.683+0000 7f6a54e73640 1 -- 172.21.15.45:0/1919253008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a50100a80 msgr2=0x7f6a501973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:37.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.683+0000 7f6a54e73640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a50100a80 0x7f6a501973c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000c970 tx=0x7f6a4000ce30 comp rx=0 tx=0).stop 2024-09-15T22:14:37.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.683+0000 7f6a54e73640 1 -- 172.21.15.45:0/1919253008 shutdown_connections 2024-09-15T22:14:37.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.683+0000 7f6a54e73640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f6a380a3240 0x7f6a380a5700 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:37.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.683+0000 7f6a54e73640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6a50106a80 0x7f6a5019bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:37.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.683+0000 7f6a54e73640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6a50101420 0x7f6a50197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:37.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.683+0000 7f6a54e73640 1 --2- 172.21.15.45:0/1919253008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a50100a80 0x7f6a501973c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:37.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.683+0000 7f6a54e73640 1 -- 172.21.15.45:0/1919253008 >> 172.21.15.45:0/1919253008 conn(0x7f6a500fc7a0 msgr2=0x7f6a500fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:37.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.683+0000 7f6a54e73640 1 -- 172.21.15.45:0/1919253008 shutdown_connections 2024-09-15T22:14:37.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:37.683+0000 7f6a54e73640 1 -- 172.21.15.45:0/1919253008 wait complete. 2024-09-15T22:14:37.985 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:37 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1919253008' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:38.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:37 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1919253008' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:38.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:37 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1919253008' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:38.407 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:14:38.668 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:39.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:38 smithi045 ceph-mon[31180]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T22:14:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.156+0000 7f1888717640 1 -- 172.21.15.45:0/271897452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1880101de0 msgr2=0x7f18801021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.156+0000 7f1888717640 1 --2- 172.21.15.45:0/271897452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1880101de0 0x7f18801021c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f187c009900 tx=0x7f187c02a410 comp rx=0 tx=0).stop 2024-09-15T22:14:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.156+0000 7f1888717640 1 -- 172.21.15.45:0/271897452 shutdown_connections 2024-09-15T22:14:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.156+0000 7f1888717640 1 --2- 172.21.15.45:0/271897452 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1880106f10 0x7f188010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.156+0000 7f1888717640 1 --2- 172.21.15.45:0/271897452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1880102790 0x7f18801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.156+0000 7f1888717640 1 --2- 172.21.15.45:0/271897452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1880101de0 0x7f18801021c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.156+0000 7f1888717640 1 -- 172.21.15.45:0/271897452 >> 172.21.15.45:0/271897452 conn(0x7f18800fd8c0 msgr2=0x7f18800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.156+0000 7f1888717640 1 -- 172.21.15.45:0/271897452 shutdown_connections 2024-09-15T22:14:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.156+0000 7f1888717640 1 -- 172.21.15.45:0/271897452 wait complete. 2024-09-15T22:14:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.156+0000 7f1888717640 1 Processor -- start 2024-09-15T22:14:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f1888717640 1 -- start start 2024-09-15T22:14:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f1888717640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1880101de0 0x7f1880198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f1888717640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1880102790 0x7f1880198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f1888717640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1880106f10 0x7f188019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f1888717640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f18801120d0 con 0x7f1880101de0 2024-09-15T22:14:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f1888717640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1880111f50 con 0x7f1880106f10 2024-09-15T22:14:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f1888717640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1880112250 con 0x7f1880102790 2024-09-15T22:14:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f18864b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1880101de0 0x7f1880198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f18864b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1880101de0 0x7f1880198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45938/0 (socket says 172.21.15.45:45938) 2024-09-15T22:14:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f18864b3640 1 -- 172.21.15.45:0/2815904987 learned_addr learned my addr 172.21.15.45:0/2815904987 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f18864b3640 1 -- 172.21.15.45:0/2815904987 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1880102790 msgr2=0x7f1880198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f1886cb4640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1880106f10 0x7f188019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f18864b3640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1880102790 0x7f1880198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f18864b3640 1 -- 172.21.15.45:0/2815904987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1880106f10 msgr2=0x7f188019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f18864b3640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1880106f10 0x7f188019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f18864b3640 1 -- 172.21.15.45:0/2815904987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188019d4c0 con 0x7f1880101de0 2024-09-15T22:14:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f1886cb4640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1880106f10 0x7f188019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.157+0000 7f18864b3640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1880101de0 0x7f1880198510 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f187c006010 tx=0x7f187c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.158+0000 7f18777fe640 1 -- 172.21.15.45:0/2815904987 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c03f030 con 0x7f1880101de0 2024-09-15T22:14:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.158+0000 7f18777fe640 1 -- 172.21.15.45:0/2815904987 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f187c003d00 con 0x7f1880101de0 2024-09-15T22:14:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.158+0000 7f1888717640 1 -- 172.21.15.45:0/2815904987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188019d750 con 0x7f1880101de0 2024-09-15T22:14:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.158+0000 7f18777fe640 1 -- 172.21.15.45:0/2815904987 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187c035070 con 0x7f1880101de0 2024-09-15T22:14:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.158+0000 7f1888717640 1 -- 172.21.15.45:0/2815904987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18801a5090 con 0x7f1880101de0 2024-09-15T22:14:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.159+0000 7f1888717640 1 -- 172.21.15.45:0/2815904987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18801021c0 con 0x7f1880101de0 2024-09-15T22:14:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.160+0000 7f18777fe640 1 -- 172.21.15.45:0/2815904987 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f187c042030 con 0x7f1880101de0 2024-09-15T22:14:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.160+0000 7f18777fe640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f186c0a32c0 0x7f186c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.161+0000 7f1885cb2640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f186c0a32c0 0x7f186c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.161+0000 7f18777fe640 1 -- 172.21.15.45:0/2815904987 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f187c0f01b0 con 0x7f1880101de0 2024-09-15T22:14:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.161+0000 7f1885cb2640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f186c0a32c0 0x7f186c0a5780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1870005fd0 tx=0x7f1870005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.164+0000 7f18777fe640 1 -- 172.21.15.45:0/2815904987 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f187c0bcd50 con 0x7f1880101de0 2024-09-15T22:14:39.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:38 smithi165 ceph-mon[35551]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T22:14:39.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:38 smithi100 ceph-mon[35319]: pgmap v298: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T22:14:39.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.339+0000 7f1888717640 1 -- 172.21.15.45:0/2815904987 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f188010a0f0 con 0x7f1880101de0 2024-09-15T22:14:39.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.341+0000 7f18777fe640 1 -- 172.21.15.45:0/2815904987 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24190 (secure 0 0 0) 0x7f187c0bc650 con 0x7f1880101de0 2024-09-15T22:14:39.343 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:14:39.343 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:14:16.455664+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:14:39.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.343+0000 7f1888717640 1 -- 172.21.15.45:0/2815904987 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f186c0a32c0 msgr2=0x7f186c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.343+0000 7f1888717640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f186c0a32c0 0x7f186c0a5780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1870005fd0 tx=0x7f1870005850 comp rx=0 tx=0).stop 2024-09-15T22:14:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.343+0000 7f1888717640 1 -- 172.21.15.45:0/2815904987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1880101de0 msgr2=0x7f1880198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.343+0000 7f1888717640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1880101de0 0x7f1880198510 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f187c006010 tx=0x7f187c0042f0 comp rx=0 tx=0).stop 2024-09-15T22:14:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.343+0000 7f1888717640 1 -- 172.21.15.45:0/2815904987 shutdown_connections 2024-09-15T22:14:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.343+0000 7f1888717640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f186c0a32c0 0x7f186c0a5780 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.343+0000 7f1888717640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1880106f10 0x7f188019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.343+0000 7f1888717640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1880102790 0x7f1880198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.343+0000 7f1888717640 1 --2- 172.21.15.45:0/2815904987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1880101de0 0x7f1880198510 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.343+0000 7f1888717640 1 -- 172.21.15.45:0/2815904987 >> 172.21.15.45:0/2815904987 conn(0x7f18800fd8c0 msgr2=0x7f18800fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.343+0000 7f1888717640 1 -- 172.21.15.45:0/2815904987 shutdown_connections 2024-09-15T22:14:39.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:39.343+0000 7f1888717640 1 -- 172.21.15.45:0/2815904987 wait complete. 2024-09-15T22:14:40.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:39 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2815904987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:40.175 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:14:40.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:39 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2815904987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:40.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:39 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2815904987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:40.440 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:40.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.937+0000 7fe7e034f640 1 -- 172.21.15.45:0/2037078252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d8102d30 msgr2=0x7fe7d8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.937+0000 7fe7e034f640 1 --2- 172.21.15.45:0/2037078252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d8102d30 0x7fe7d8103110 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4009930 tx=0x7fe7d402a420 comp rx=0 tx=0).stop 2024-09-15T22:14:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.937+0000 7fe7e034f640 1 -- 172.21.15.45:0/2037078252 shutdown_connections 2024-09-15T22:14:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.937+0000 7fe7e034f640 1 --2- 172.21.15.45:0/2037078252 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7d81082a0 0x7fe7d810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.937+0000 7fe7e034f640 1 --2- 172.21.15.45:0/2037078252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d81036e0 0x7fe7d8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.937+0000 7fe7e034f640 1 --2- 172.21.15.45:0/2037078252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d8102d30 0x7fe7d8103110 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.937+0000 7fe7e034f640 1 -- 172.21.15.45:0/2037078252 >> 172.21.15.45:0/2037078252 conn(0x7fe7d80fc7d0 msgr2=0x7fe7d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.937+0000 7fe7e034f640 1 -- 172.21.15.45:0/2037078252 shutdown_connections 2024-09-15T22:14:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.937+0000 7fe7e034f640 1 -- 172.21.15.45:0/2037078252 wait complete. 2024-09-15T22:14:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.937+0000 7fe7e034f640 1 Processor -- start 2024-09-15T22:14:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7e034f640 1 -- start start 2024-09-15T22:14:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7e034f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7d8102d30 0x7fe7d8198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:40.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7e034f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d81036e0 0x7fe7d8198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:40.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7e034f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d81082a0 0x7fe7d819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:40.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7e034f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d81121e0 con 0x7fe7d81036e0 2024-09-15T22:14:40.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7e034f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d8112060 con 0x7fe7d81082a0 2024-09-15T22:14:40.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7e034f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d8112360 con 0x7fe7d8102d30 2024-09-15T22:14:40.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7dd8ea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d81036e0 0x7fe7d8198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:40.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7dd8ea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d81036e0 0x7fe7d8198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45948/0 (socket says 172.21.15.45:45948) 2024-09-15T22:14:40.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7dd8ea640 1 -- 172.21.15.45:0/2688025383 learned_addr learned my addr 172.21.15.45:0/2688025383 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:40.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7de8ec640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d81082a0 0x7fe7d819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:40.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7de0eb640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7d8102d30 0x7fe7d8198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:40.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7dd8ea640 1 -- 172.21.15.45:0/2688025383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7d8102d30 msgr2=0x7fe7d8198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:40.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7dd8ea640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7d8102d30 0x7fe7d8198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:40.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7dd8ea640 1 -- 172.21.15.45:0/2688025383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d81082a0 msgr2=0x7fe7d819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:40.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7dd8ea640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d81082a0 0x7fe7d819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:40.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7dd8ea640 1 -- 172.21.15.45:0/2688025383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d819d620 con 0x7fe7d81036e0 2024-09-15T22:14:40.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7de0eb640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7d8102d30 0x7fe7d8198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:40.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.938+0000 7fe7dd8ea640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d81036e0 0x7fe7d8198bb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00d740 tx=0x7fe7cc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:40.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.939+0000 7fe7cb7fe640 1 -- 172.21.15.45:0/2688025383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc017070 con 0x7fe7d81036e0 2024-09-15T22:14:40.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.939+0000 7fe7cb7fe640 1 -- 172.21.15.45:0/2688025383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe7cc00de50 con 0x7fe7d81036e0 2024-09-15T22:14:40.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.939+0000 7fe7e034f640 1 -- 172.21.15.45:0/2688025383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d819d910 con 0x7fe7d81036e0 2024-09-15T22:14:40.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.939+0000 7fe7cb7fe640 1 -- 172.21.15.45:0/2688025383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00f740 con 0x7fe7d81036e0 2024-09-15T22:14:40.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.939+0000 7fe7e034f640 1 -- 172.21.15.45:0/2688025383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d81a51f0 con 0x7fe7d81036e0 2024-09-15T22:14:40.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.940+0000 7fe7e034f640 1 -- 172.21.15.45:0/2688025383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d806a850 con 0x7fe7d81036e0 2024-09-15T22:14:40.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.942+0000 7fe7cb7fe640 1 -- 172.21.15.45:0/2688025383 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe7cc01a070 con 0x7fe7d81036e0 2024-09-15T22:14:40.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.942+0000 7fe7cb7fe640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe7c40a3240 0x7fe7c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:40.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.942+0000 7fe7cb7fe640 1 -- 172.21.15.45:0/2688025383 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fe7cc0cf510 con 0x7fe7d81036e0 2024-09-15T22:14:40.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.942+0000 7fe7de0eb640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe7c40a3240 0x7fe7c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:40.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.943+0000 7fe7de0eb640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe7c40a3240 0x7fe7c40a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4000c00 tx=0x7fe7d4032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:40.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:40.946+0000 7fe7cb7fe640 1 -- 172.21.15.45:0/2688025383 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe7cc09bff0 con 0x7fe7d81036e0 2024-09-15T22:14:41.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.160+0000 7fe7e034f640 1 -- 172.21.15.45:0/2688025383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe7d8103110 con 0x7fe7d81036e0 2024-09-15T22:14:41.163 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:40 smithi045 ceph-mon[31180]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T22:14:41.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:40 smithi165 ceph-mon[35551]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T22:14:41.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:40 smithi100 ceph-mon[35319]: pgmap v299: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T22:14:41.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.913+0000 7fe7cb7fe640 1 -- 172.21.15.45:0/2688025383 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fe7d8103110 con 0x7fe7d81036e0 2024-09-15T22:14:41.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.916+0000 7fe7e034f640 1 -- 172.21.15.45:0/2688025383 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe7c40a3240 msgr2=0x7fe7c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:41.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.916+0000 7fe7e034f640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe7c40a3240 0x7fe7c40a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4000c00 tx=0x7fe7d4032c80 comp rx=0 tx=0).stop 2024-09-15T22:14:41.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.916+0000 7fe7e034f640 1 -- 172.21.15.45:0/2688025383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d81036e0 msgr2=0x7fe7d8198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:41.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.916+0000 7fe7e034f640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d81036e0 0x7fe7d8198bb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00d740 tx=0x7fe7cc00dc00 comp rx=0 tx=0).stop 2024-09-15T22:14:41.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.916+0000 7fe7e034f640 1 -- 172.21.15.45:0/2688025383 shutdown_connections 2024-09-15T22:14:41.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.916+0000 7fe7e034f640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe7c40a3240 0x7fe7c40a5700 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:41.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.917+0000 7fe7e034f640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7d81082a0 0x7fe7d819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:41.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.917+0000 7fe7e034f640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7d81036e0 0x7fe7d8198bb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:41.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.917+0000 7fe7e034f640 1 --2- 172.21.15.45:0/2688025383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe7d8102d30 0x7fe7d8198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:41.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.917+0000 7fe7e034f640 1 -- 172.21.15.45:0/2688025383 >> 172.21.15.45:0/2688025383 conn(0x7fe7d80fc7d0 msgr2=0x7fe7d8105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:41.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.917+0000 7fe7e034f640 1 -- 172.21.15.45:0/2688025383 shutdown_connections 2024-09-15T22:14:41.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:41.917+0000 7fe7e034f640 1 -- 172.21.15.45:0/2688025383 wait complete. 2024-09-15T22:14:42.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:41 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2688025383' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:14:42.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:41 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2688025383' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:14:42.288 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:41 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2688025383' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T22:14:42.726 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-15T22:14:42.726 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-15T22:14:42.990 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:43.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:42 smithi045 ceph-mon[31180]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T22:14:43.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:42 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2688025383' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:14:43.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:42 smithi045 ceph-mon[31180]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:43.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:42 smithi165 ceph-mon[35551]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T22:14:43.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:42 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2688025383' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:14:43.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:42 smithi165 ceph-mon[35551]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:43.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:42 smithi100 ceph-mon[35319]: pgmap v300: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T22:14:43.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:42 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2688025383' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T22:14:43.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:42 smithi100 ceph-mon[35319]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:43.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.504+0000 7fd03bbb2640 1 -- 172.21.15.45:0/824505614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0341027a0 msgr2=0x7fd0341067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:43.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.504+0000 7fd03bbb2640 1 --2- 172.21.15.45:0/824505614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0341027a0 0x7fd0341067f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd030009900 tx=0x7fd03002a410 comp rx=0 tx=0).stop 2024-09-15T22:14:43.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.505+0000 7fd03bbb2640 1 -- 172.21.15.45:0/824505614 shutdown_connections 2024-09-15T22:14:43.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.505+0000 7fd03bbb2640 1 --2- 172.21.15.45:0/824505614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd034106f20 0x7fd03410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:43.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.505+0000 7fd03bbb2640 1 --2- 172.21.15.45:0/824505614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0341027a0 0x7fd0341067f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:43.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.505+0000 7fd03bbb2640 1 --2- 172.21.15.45:0/824505614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd034101df0 0x7fd0341021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:43.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.505+0000 7fd03bbb2640 1 -- 172.21.15.45:0/824505614 >> 172.21.15.45:0/824505614 conn(0x7fd0340fd8f0 msgr2=0x7fd0340ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:43.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.505+0000 7fd03bbb2640 1 -- 172.21.15.45:0/824505614 shutdown_connections 2024-09-15T22:14:43.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.505+0000 7fd03bbb2640 1 -- 172.21.15.45:0/824505614 wait complete. 2024-09-15T22:14:43.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.505+0000 7fd03bbb2640 1 Processor -- start 2024-09-15T22:14:43.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.505+0000 7fd03bbb2640 1 -- start start 2024-09-15T22:14:43.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03bbb2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd034101df0 0x7fd034198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:43.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03bbb2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0341027a0 0x7fd034198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:43.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03bbb2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd034106f20 0x7fd03419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:43.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03bbb2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd0341120a0 con 0x7fd034101df0 2024-09-15T22:14:43.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03bbb2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd034111f20 con 0x7fd0341027a0 2024-09-15T22:14:43.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03bbb2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd034112220 con 0x7fd034106f20 2024-09-15T22:14:43.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03994e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd034101df0 0x7fd034198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:43.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03994e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd034101df0 0x7fd034198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45970/0 (socket says 172.21.15.45:45970) 2024-09-15T22:14:43.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03994e640 1 -- 172.21.15.45:0/3306285561 learned_addr learned my addr 172.21.15.45:0/3306285561 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:43.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03914d640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0341027a0 0x7fd034198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:43.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03a14f640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd034106f20 0x7fd03419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:43.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03994e640 1 -- 172.21.15.45:0/3306285561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd034106f20 msgr2=0x7fd03419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:43.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03994e640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd034106f20 0x7fd03419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03994e640 1 -- 172.21.15.45:0/3306285561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0341027a0 msgr2=0x7fd034198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03994e640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0341027a0 0x7fd034198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03994e640 1 -- 172.21.15.45:0/3306285561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03419d4b0 con 0x7fd034101df0 2024-09-15T22:14:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03914d640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0341027a0 0x7fd034198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:14:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.506+0000 7fd03994e640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd034101df0 0x7fd034198500 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd02800d950 tx=0x7fd02800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.507+0000 7fd026ffd640 1 -- 172.21.15.45:0/3306285561 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028017030 con 0x7fd034101df0 2024-09-15T22:14:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.507+0000 7fd03bbb2640 1 -- 172.21.15.45:0/3306285561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03419d7a0 con 0x7fd034101df0 2024-09-15T22:14:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.507+0000 7fd026ffd640 1 -- 172.21.15.45:0/3306285561 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd028004020 con 0x7fd034101df0 2024-09-15T22:14:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.507+0000 7fd026ffd640 1 -- 172.21.15.45:0/3306285561 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028004a00 con 0x7fd034101df0 2024-09-15T22:14:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.507+0000 7fd03bbb2640 1 -- 172.21.15.45:0/3306285561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0341a5080 con 0x7fd034101df0 2024-09-15T22:14:43.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.508+0000 7fd03bbb2640 1 -- 172.21.15.45:0/3306285561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0341021d0 con 0x7fd034101df0 2024-09-15T22:14:43.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.510+0000 7fd026ffd640 1 -- 172.21.15.45:0/3306285561 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd0280041d0 con 0x7fd034101df0 2024-09-15T22:14:43.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.511+0000 7fd026ffd640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd0200a3240 0x7fd0200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:43.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.511+0000 7fd03914d640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd0200a3240 0x7fd0200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:43.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.511+0000 7fd026ffd640 1 -- 172.21.15.45:0/3306285561 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fd0280cfbb0 con 0x7fd034101df0 2024-09-15T22:14:43.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.512+0000 7fd03914d640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd0200a3240 0x7fd0200a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd0340fdd10 tx=0x7fd030005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:43.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.514+0000 7fd026ffd640 1 -- 172.21.15.45:0/3306285561 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd02809c690 con 0x7fd034101df0 2024-09-15T22:14:43.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.731+0000 7fd03bbb2640 1 -- 172.21.15.45:0/3306285561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fd03410a130 con 0x7fd034101df0 2024-09-15T22:14:43.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.920+0000 7fd026ffd640 1 -- 172.21.15.45:0/3306285561 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7fd02809bf90 con 0x7fd034101df0 2024-09-15T22:14:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.922+0000 7fd03bbb2640 1 -- 172.21.15.45:0/3306285561 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd0200a3240 msgr2=0x7fd0200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.922+0000 7fd03bbb2640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd0200a3240 0x7fd0200a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd0340fdd10 tx=0x7fd030005a20 comp rx=0 tx=0).stop 2024-09-15T22:14:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.922+0000 7fd03bbb2640 1 -- 172.21.15.45:0/3306285561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd034101df0 msgr2=0x7fd034198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.922+0000 7fd03bbb2640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd034101df0 0x7fd034198500 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd02800d950 tx=0x7fd02800de10 comp rx=0 tx=0).stop 2024-09-15T22:14:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.922+0000 7fd03bbb2640 1 -- 172.21.15.45:0/3306285561 shutdown_connections 2024-09-15T22:14:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.922+0000 7fd03bbb2640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd0200a3240 0x7fd0200a5700 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.922+0000 7fd03bbb2640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd034106f20 0x7fd03419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.922+0000 7fd03bbb2640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0341027a0 0x7fd034198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.922+0000 7fd03bbb2640 1 --2- 172.21.15.45:0/3306285561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd034101df0 0x7fd034198500 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.922+0000 7fd03bbb2640 1 -- 172.21.15.45:0/3306285561 >> 172.21.15.45:0/3306285561 conn(0x7fd0340fd8f0 msgr2=0x7fd0340fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.923+0000 7fd03bbb2640 1 -- 172.21.15.45:0/3306285561 shutdown_connections 2024-09-15T22:14:43.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:43.923+0000 7fd03bbb2640 1 -- 172.21.15.45:0/3306285561 wait complete. 2024-09-15T22:14:44.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:43 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3306285561' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:14:44.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:43 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3306285561' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:14:44.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:43 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3306285561' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T22:14:44.737 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-15T22:14:44.994 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:45.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:44 smithi165 ceph-mon[35551]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-15T22:14:45.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:44 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3306285561' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:14:45.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:44 smithi165 ceph-mon[35551]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:45.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:44 smithi165 ceph-mon[35551]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T22:14:45.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:44 smithi100 ceph-mon[35319]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-15T22:14:45.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:44 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3306285561' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:14:45.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:44 smithi100 ceph-mon[35319]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:45.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:44 smithi100 ceph-mon[35319]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T22:14:45.272 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:44 smithi045 ceph-mon[31180]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-15T22:14:45.272 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:44 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3306285561' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T22:14:45.272 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:44 smithi045 ceph-mon[31180]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-15T22:14:45.272 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:44 smithi045 ceph-mon[31180]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T22:14:45.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.531+0000 7f35057b3640 1 -- 172.21.15.45:0/4261434575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3500106f10 msgr2=0x7f350010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.531+0000 7f35057b3640 1 --2- 172.21.15.45:0/4261434575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3500106f10 0x7f350010ea90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009ca0 tx=0x7f34f802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.532+0000 7f35057b3640 1 -- 172.21.15.45:0/4261434575 shutdown_connections 2024-09-15T22:14:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.532+0000 7f35057b3640 1 --2- 172.21.15.45:0/4261434575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3500106f10 0x7f350010ea90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.532+0000 7f35057b3640 1 --2- 172.21.15.45:0/4261434575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3500102790 0x7f35001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.532+0000 7f35057b3640 1 --2- 172.21.15.45:0/4261434575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3500101de0 0x7f35001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.532+0000 7f35057b3640 1 -- 172.21.15.45:0/4261434575 >> 172.21.15.45:0/4261434575 conn(0x7f35000fd8c0 msgr2=0x7f35000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.532+0000 7f35057b3640 1 -- 172.21.15.45:0/4261434575 shutdown_connections 2024-09-15T22:14:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.532+0000 7f35057b3640 1 -- 172.21.15.45:0/4261434575 wait complete. 2024-09-15T22:14:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.532+0000 7f35057b3640 1 Processor -- start 2024-09-15T22:14:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f35057b3640 1 -- start start 2024-09-15T22:14:45.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f35057b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3500101de0 0x7f35000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f35057b3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3500102790 0x7f3500074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f35057b3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3500106f10 0x7f3500074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f35057b3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f35001120e0 con 0x7f3500101de0 2024-09-15T22:14:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f35057b3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3500111f60 con 0x7f3500106f10 2024-09-15T22:14:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f35057b3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3500112260 con 0x7f3500102790 2024-09-15T22:14:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f34feffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3500101de0 0x7f35000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f34feffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3500101de0 0x7f35000744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43452/0 (socket says 172.21.15.45:43452) 2024-09-15T22:14:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f34feffd640 1 -- 172.21.15.45:0/1025326765 learned_addr learned my addr 172.21.15.45:0/1025326765 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f34ff7fe640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3500106f10 0x7f3500074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f34f67fc640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3500102790 0x7f3500074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f34feffd640 1 -- 172.21.15.45:0/1025326765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3500102790 msgr2=0x7f3500074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f34feffd640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3500102790 0x7f3500074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f34feffd640 1 -- 172.21.15.45:0/1025326765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3500106f10 msgr2=0x7f3500074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f34feffd640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3500106f10 0x7f3500074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.533+0000 7f34feffd640 1 -- 172.21.15.45:0/1025326765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35001a6a10 con 0x7f3500101de0 2024-09-15T22:14:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.534+0000 7f34feffd640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3500101de0 0x7f35000744f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f34f000c970 tx=0x7f34f000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.534+0000 7f34fcff9640 1 -- 172.21.15.45:0/1025326765 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f0007bb0 con 0x7f3500101de0 2024-09-15T22:14:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.534+0000 7f34fcff9640 1 -- 172.21.15.45:0/1025326765 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f34f0007d50 con 0x7f3500101de0 2024-09-15T22:14:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.534+0000 7f35057b3640 1 -- 172.21.15.45:0/1025326765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35001a6d00 con 0x7f3500101de0 2024-09-15T22:14:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.534+0000 7f34fcff9640 1 -- 172.21.15.45:0/1025326765 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f000f4b0 con 0x7f3500101de0 2024-09-15T22:14:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.534+0000 7f35057b3640 1 -- 172.21.15.45:0/1025326765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35001a71e0 con 0x7f3500101de0 2024-09-15T22:14:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.535+0000 7f35057b3640 1 -- 172.21.15.45:0/1025326765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35001021c0 con 0x7f3500101de0 2024-09-15T22:14:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.536+0000 7f34fcff9640 1 -- 172.21.15.45:0/1025326765 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f34f00046c0 con 0x7f3500101de0 2024-09-15T22:14:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.537+0000 7f34fcff9640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f34ec0a32c0 0x7f34ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:45.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.537+0000 7f34fcff9640 1 -- 172.21.15.45:0/1025326765 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f34f00cf7b0 con 0x7f3500101de0 2024-09-15T22:14:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.537+0000 7f34f67fc640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f34ec0a32c0 0x7f34ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.538+0000 7f34f67fc640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f34ec0a32c0 0x7f34ec0a5780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f35001087b0 tx=0x7f34e8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:45.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.543+0000 7f34fcff9640 1 -- 172.21.15.45:0/1025326765 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f34f0014030 con 0x7f3500101de0 2024-09-15T22:14:45.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.758+0000 7f35057b3640 1 -- 172.21.15.45:0/1025326765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f35001a7580 con 0x7f3500101de0 2024-09-15T22:14:45.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.927+0000 7f34fcff9640 1 -- 172.21.15.45:0/1025326765 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f34f009bc40 con 0x7f3500101de0 2024-09-15T22:14:45.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.930+0000 7f35057b3640 1 -- 172.21.15.45:0/1025326765 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f34ec0a32c0 msgr2=0x7f34ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:45.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.930+0000 7f35057b3640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f34ec0a32c0 0x7f34ec0a5780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f35001087b0 tx=0x7f34e8005f90 comp rx=0 tx=0).stop 2024-09-15T22:14:45.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.930+0000 7f35057b3640 1 -- 172.21.15.45:0/1025326765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3500101de0 msgr2=0x7f35000744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:45.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.930+0000 7f35057b3640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3500101de0 0x7f35000744f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f34f000c970 tx=0x7f34f000ce30 comp rx=0 tx=0).stop 2024-09-15T22:14:45.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.930+0000 7f35057b3640 1 -- 172.21.15.45:0/1025326765 shutdown_connections 2024-09-15T22:14:45.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.930+0000 7f35057b3640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f34ec0a32c0 0x7f34ec0a5780 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.930+0000 7f35057b3640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3500106f10 0x7f3500074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.930+0000 7f35057b3640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3500102790 0x7f3500074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.930+0000 7f35057b3640 1 --2- 172.21.15.45:0/1025326765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3500101de0 0x7f35000744f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.930+0000 7f35057b3640 1 -- 172.21.15.45:0/1025326765 >> 172.21.15.45:0/1025326765 conn(0x7f35000fd8c0 msgr2=0x7f35000ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.930+0000 7f35057b3640 1 -- 172.21.15.45:0/1025326765 shutdown_connections 2024-09-15T22:14:45.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:45.930+0000 7f35057b3640 1 -- 172.21.15.45:0/1025326765 wait complete. 2024-09-15T22:14:46.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:45 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1025326765' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:14:46.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:45 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1025326765' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:14:46.292 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:45 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1025326765' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T22:14:46.699 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-15T22:14:46.700 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-15T22:14:46.961 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:47.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:46 smithi165 ceph-mon[35551]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 255 B/s wr, 0 op/s 2024-09-15T22:14:47.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:46 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1025326765' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:14:47.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:46 smithi165 ceph-mon[35551]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T22:14:47.221 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:46 smithi045 ceph-mon[31180]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 255 B/s wr, 0 op/s 2024-09-15T22:14:47.221 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:46 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1025326765' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:14:47.221 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:46 smithi045 ceph-mon[31180]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T22:14:47.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:46 smithi100 ceph-mon[35319]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 255 B/s wr, 0 op/s 2024-09-15T22:14:47.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:46 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1025326765' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T22:14:47.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:46 smithi100 ceph-mon[35319]: fsmap cephfs:1 {0=b=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T22:14:47.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.450+0000 7ff364fc1640 1 -- 172.21.15.45:0/185856419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360106f50 msgr2=0x7ff36010eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:47.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.450+0000 7ff364fc1640 1 --2- 172.21.15.45:0/185856419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360106f50 0x7ff36010eaf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff350009930 tx=0x7ff35002a420 comp rx=0 tx=0).stop 2024-09-15T22:14:47.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.450+0000 7ff364fc1640 1 -- 172.21.15.45:0/185856419 shutdown_connections 2024-09-15T22:14:47.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.450+0000 7ff364fc1640 1 --2- 172.21.15.45:0/185856419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360106f50 0x7ff36010eaf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:47.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.450+0000 7ff364fc1640 1 --2- 172.21.15.45:0/185856419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff360100ca0 0x7ff360106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:47.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.450+0000 7ff364fc1640 1 --2- 172.21.15.45:0/185856419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff3601002f0 0x7ff3601006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:47.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.450+0000 7ff364fc1640 1 -- 172.21.15.45:0/185856419 >> 172.21.15.45:0/185856419 conn(0x7ff360077210 msgr2=0x7ff3600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:47.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.450+0000 7ff364fc1640 1 -- 172.21.15.45:0/185856419 shutdown_connections 2024-09-15T22:14:47.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.450+0000 7ff364fc1640 1 -- 172.21.15.45:0/185856419 wait complete. 2024-09-15T22:14:47.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff364fc1640 1 Processor -- start 2024-09-15T22:14:47.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff364fc1640 1 -- start start 2024-09-15T22:14:47.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff364fc1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3601002f0 0x7ff360198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:47.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff364fc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360100ca0 0x7ff360198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:47.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff364fc1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff360106f50 0x7ff36019ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:47.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff364fc1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff360112140 con 0x7ff360100ca0 2024-09-15T22:14:47.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff364fc1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff360111fc0 con 0x7ff3601002f0 2024-09-15T22:14:47.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff364fc1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff3601122c0 con 0x7ff360106f50 2024-09-15T22:14:47.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff35dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360100ca0 0x7ff360198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:47.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff35dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360100ca0 0x7ff360198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43458/0 (socket says 172.21.15.45:43458) 2024-09-15T22:14:47.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff35dd9b640 1 -- 172.21.15.45:0/3923190985 learned_addr learned my addr 172.21.15.45:0/3923190985 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:47.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff35ed9d640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff360106f50 0x7ff36019ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:47.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff35e59c640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3601002f0 0x7ff360198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:47.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff35dd9b640 1 -- 172.21.15.45:0/3923190985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff360106f50 msgr2=0x7ff36019ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:47.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff35dd9b640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff360106f50 0x7ff36019ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:47.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff35dd9b640 1 -- 172.21.15.45:0/3923190985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3601002f0 msgr2=0x7ff360198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:47.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.451+0000 7ff35dd9b640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3601002f0 0x7ff360198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.452+0000 7ff35dd9b640 1 -- 172.21.15.45:0/3923190985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36019d520 con 0x7ff360100ca0 2024-09-15T22:14:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.452+0000 7ff35dd9b640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360100ca0 0x7ff360198ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff34800b450 tx=0x7ff34800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.452+0000 7ff3577fe640 1 -- 172.21.15.45:0/3923190985 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348015020 con 0x7ff360100ca0 2024-09-15T22:14:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.452+0000 7ff364fc1640 1 -- 172.21.15.45:0/3923190985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36019d810 con 0x7ff360100ca0 2024-09-15T22:14:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.452+0000 7ff3577fe640 1 -- 172.21.15.45:0/3923190985 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff348011d90 con 0x7ff360100ca0 2024-09-15T22:14:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.452+0000 7ff3577fe640 1 -- 172.21.15.45:0/3923190985 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34800f340 con 0x7ff360100ca0 2024-09-15T22:14:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.452+0000 7ff364fc1640 1 -- 172.21.15.45:0/3923190985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3601a50f0 con 0x7ff360100ca0 2024-09-15T22:14:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.453+0000 7ff364fc1640 1 -- 172.21.15.45:0/3923190985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3601006d0 con 0x7ff360100ca0 2024-09-15T22:14:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.454+0000 7ff3577fe640 1 -- 172.21.15.45:0/3923190985 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff348018020 con 0x7ff360100ca0 2024-09-15T22:14:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.455+0000 7ff3577fe640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff34c0a3240 0x7ff34c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.455+0000 7ff3577fe640 1 -- 172.21.15.45:0/3923190985 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7ff3480cfac0 con 0x7ff360100ca0 2024-09-15T22:14:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.455+0000 7ff35e59c640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff34c0a3240 0x7ff34c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:47.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.455+0000 7ff35e59c640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff34c0a3240 0x7ff34c0a5700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff358007350 tx=0x7ff3580072e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:47.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.458+0000 7ff3577fe640 1 -- 172.21.15.45:0/3923190985 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff34801f020 con 0x7ff360100ca0 2024-09-15T22:14:47.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.658+0000 7ff364fc1640 1 -- 172.21.15.45:0/3923190985 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff360062630 con 0x7ff34c0a3240 2024-09-15T22:14:47.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.677+0000 7ff3577fe640 1 -- 172.21.15.45:0/3923190985 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff360062630 con 0x7ff34c0a3240 2024-09-15T22:14:47.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.679+0000 7ff364fc1640 1 -- 172.21.15.45:0/3923190985 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff34c0a3240 msgr2=0x7ff34c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:47.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.679+0000 7ff364fc1640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff34c0a3240 0x7ff34c0a5700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff358007350 tx=0x7ff3580072e0 comp rx=0 tx=0).stop 2024-09-15T22:14:47.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.679+0000 7ff364fc1640 1 -- 172.21.15.45:0/3923190985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360100ca0 msgr2=0x7ff360198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.679+0000 7ff364fc1640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360100ca0 0x7ff360198ab0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff34800b450 tx=0x7ff34800b910 comp rx=0 tx=0).stop 2024-09-15T22:14:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.679+0000 7ff364fc1640 1 -- 172.21.15.45:0/3923190985 shutdown_connections 2024-09-15T22:14:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.679+0000 7ff364fc1640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff34c0a3240 0x7ff34c0a5700 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.679+0000 7ff364fc1640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff360106f50 0x7ff36019ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.679+0000 7ff364fc1640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff360100ca0 0x7ff360198ab0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.679+0000 7ff364fc1640 1 --2- 172.21.15.45:0/3923190985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3601002f0 0x7ff360198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.679+0000 7ff364fc1640 1 -- 172.21.15.45:0/3923190985 >> 172.21.15.45:0/3923190985 conn(0x7ff360077210 msgr2=0x7ff360105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.679+0000 7ff364fc1640 1 -- 172.21.15.45:0/3923190985 shutdown_connections 2024-09-15T22:14:47.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:47.679+0000 7ff364fc1640 1 -- 172.21.15.45:0/3923190985 wait complete. 2024-09-15T22:14:47.800 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:14:47 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:14:47.663+0000 7f0928e6c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:14:47.800 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:14:47 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:14:47.663+0000 7f0928e6c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:14:47.800 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:14:47 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:14:47.663+0000 7f0928e6c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:14:47.800 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:14:47 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:14:47.663+0000 7f0928e6c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:14:47.800 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:14:47 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:14:47.663+0000 7f0928e6c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:14:48.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-15T22:14:48.654 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:49.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:48 smithi045 ceph-mon[31180]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-15T22:14:49.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:48 smithi045 ceph-mon[31180]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.178+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/349663031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e24103ff0 msgr2=0x7f8e241043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.178+0000 7f8e2bcf0640 1 --2- 172.21.15.45:0/349663031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e24103ff0 0x7f8e241043d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009ca0 tx=0x7f8e1402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:14:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.178+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/349663031 shutdown_connections 2024-09-15T22:14:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.178+0000 7f8e2bcf0640 1 --2- 172.21.15.45:0/349663031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e24109120 0x7f8e24110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.178+0000 7f8e2bcf0640 1 --2- 172.21.15.45:0/349663031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e241049a0 0x7f8e241089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.178+0000 7f8e2bcf0640 1 --2- 172.21.15.45:0/349663031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e24103ff0 0x7f8e241043d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.178+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/349663031 >> 172.21.15.45:0/349663031 conn(0x7f8e240ffa90 msgr2=0x7f8e24101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.178+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/349663031 shutdown_connections 2024-09-15T22:14:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.178+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/349663031 wait complete. 2024-09-15T22:14:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e2bcf0640 1 Processor -- start 2024-09-15T22:14:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e2bcf0640 1 -- start start 2024-09-15T22:14:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e2bcf0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e24103ff0 0x7f8e2419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e2bcf0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e241049a0 0x7f8e2419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e2bcf0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e24109120 0x7f8e2419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e2bcf0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8e241142a0 con 0x7f8e24103ff0 2024-09-15T22:14:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e2bcf0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8e24114120 con 0x7f8e24109120 2024-09-15T22:14:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e2bcf0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8e24114420 con 0x7f8e241049a0 2024-09-15T22:14:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e29a8c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e24103ff0 0x7f8e2419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e29a8c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e24103ff0 0x7f8e2419a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43490/0 (socket says 172.21.15.45:43490) 2024-09-15T22:14:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e29a8c640 1 -- 172.21.15.45:0/3700894534 learned_addr learned my addr 172.21.15.45:0/3700894534 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e2a28d640 1 --2- 172.21.15.45:0/3700894534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e24109120 0x7f8e2419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e29a8c640 1 -- 172.21.15.45:0/3700894534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e241049a0 msgr2=0x7f8e2419ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e29a8c640 1 --2- 172.21.15.45:0/3700894534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e241049a0 0x7f8e2419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e29a8c640 1 -- 172.21.15.45:0/3700894534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e24109120 msgr2=0x7f8e2419efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e29a8c640 1 --2- 172.21.15.45:0/3700894534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e24109120 0x7f8e2419efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.179+0000 7f8e29a8c640 1 -- 172.21.15.45:0/3700894534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2419f6b0 con 0x7f8e24103ff0 2024-09-15T22:14:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.180+0000 7f8e29a8c640 1 --2- 172.21.15.45:0/3700894534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e24103ff0 0x7f8e2419a700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8e1402ade0 tx=0x7f8e140319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.180+0000 7f8e22ffd640 1 -- 172.21.15.45:0/3700894534 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14003b70 con 0x7f8e24103ff0 2024-09-15T22:14:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.180+0000 7f8e22ffd640 1 -- 172.21.15.45:0/3700894534 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8e14003d10 con 0x7f8e24103ff0 2024-09-15T22:14:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.180+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/3700894534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e2419f940 con 0x7f8e24103ff0 2024-09-15T22:14:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.180+0000 7f8e22ffd640 1 -- 172.21.15.45:0/3700894534 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1402fd10 con 0x7f8e24103ff0 2024-09-15T22:14:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.180+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/3700894534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e241a7280 con 0x7f8e24103ff0 2024-09-15T22:14:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.181+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/3700894534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e241043d0 con 0x7f8e24103ff0 2024-09-15T22:14:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.182+0000 7f8e22ffd640 1 -- 172.21.15.45:0/3700894534 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8e14004050 con 0x7f8e24103ff0 2024-09-15T22:14:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.183+0000 7f8e22ffd640 1 --2- 172.21.15.45:0/3700894534 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8e0c0a32c0 0x7f8e0c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.183+0000 7f8e2928b640 1 --2- 172.21.15.45:0/3700894534 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8e0c0a32c0 0x7f8e0c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.183+0000 7f8e22ffd640 1 -- 172.21.15.45:0/3700894534 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f8e140f0f70 con 0x7f8e24103ff0 2024-09-15T22:14:49.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.183+0000 7f8e2928b640 1 --2- 172.21.15.45:0/3700894534 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8e0c0a32c0 0x7f8e0c0a5780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8e18005fd0 tx=0x7f8e18005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:49.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.187+0000 7f8e22ffd640 1 -- 172.21.15.45:0/3700894534 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8e140bdae0 con 0x7f8e24103ff0 2024-09-15T22:14:49.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:48 smithi165 ceph-mon[35551]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-15T22:14:49.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:48 smithi165 ceph-mon[35551]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:48 smithi100 ceph-mon[35319]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-09-15T22:14:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:48 smithi100 ceph-mon[35319]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.386+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/3700894534 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8e24062630 con 0x7f8e0c0a32c0 2024-09-15T22:14:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.410+0000 7f8e22ffd640 1 -- 172.21.15.45:0/3700894534 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8e24062630 con 0x7f8e0c0a32c0 2024-09-15T22:14:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.412+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/3700894534 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8e0c0a32c0 msgr2=0x7f8e0c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.412+0000 7f8e2bcf0640 1 --2- 172.21.15.45:0/3700894534 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8e0c0a32c0 0x7f8e0c0a5780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8e18005fd0 tx=0x7f8e18005850 comp rx=0 tx=0).stop 2024-09-15T22:14:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.412+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/3700894534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e24103ff0 msgr2=0x7f8e2419a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.412+0000 7f8e2bcf0640 1 --2- 172.21.15.45:0/3700894534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e24103ff0 0x7f8e2419a700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8e1402ade0 tx=0x7f8e140319f0 comp rx=0 tx=0).stop 2024-09-15T22:14:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.412+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/3700894534 shutdown_connections 2024-09-15T22:14:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.412+0000 7f8e2bcf0640 1 --2- 172.21.15.45:0/3700894534 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8e0c0a32c0 0x7f8e0c0a5780 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.412+0000 7f8e2bcf0640 1 --2- 172.21.15.45:0/3700894534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e24109120 0x7f8e2419efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.412+0000 7f8e2bcf0640 1 --2- 172.21.15.45:0/3700894534 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8e241049a0 0x7f8e2419ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.412+0000 7f8e2bcf0640 1 --2- 172.21.15.45:0/3700894534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e24103ff0 0x7f8e2419a700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.412+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/3700894534 >> 172.21.15.45:0/3700894534 conn(0x7f8e240ffa90 msgr2=0x7f8e24100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.412+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/3700894534 shutdown_connections 2024-09-15T22:14:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:49.412+0000 7f8e2bcf0640 1 -- 172.21.15.45:0/3700894534 wait complete. 2024-09-15T22:14:50.251 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-15T22:14:50.511 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:51.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.027+0000 7f30a59ab640 1 -- 172.21.15.45:0/1888321358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a0103660 msgr2=0x7f30a010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:51.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.027+0000 7f30a59ab640 1 --2- 172.21.15.45:0/1888321358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a0103660 0x7f30a010bb50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3094009900 tx=0x7f309402a480 comp rx=0 tx=0).stop 2024-09-15T22:14:51.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.027+0000 7f30a59ab640 1 -- 172.21.15.45:0/1888321358 shutdown_connections 2024-09-15T22:14:51.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.027+0000 7f30a59ab640 1 --2- 172.21.15.45:0/1888321358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30a010c170 0x7f30a010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:51.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.027+0000 7f30a59ab640 1 --2- 172.21.15.45:0/1888321358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a0103660 0x7f30a010bb50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:51.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.027+0000 7f30a59ab640 1 --2- 172.21.15.45:0/1888321358 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30a0102d40 0x7f30a0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:51.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.027+0000 7f30a59ab640 1 -- 172.21.15.45:0/1888321358 >> 172.21.15.45:0/1888321358 conn(0x7f30a00fc7a0 msgr2=0x7f30a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:51.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.027+0000 7f30a59ab640 1 -- 172.21.15.45:0/1888321358 shutdown_connections 2024-09-15T22:14:51.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.027+0000 7f30a59ab640 1 -- 172.21.15.45:0/1888321358 wait complete. 2024-09-15T22:14:51.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.028+0000 7f30a59ab640 1 Processor -- start 2024-09-15T22:14:51.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.028+0000 7f30a59ab640 1 -- start start 2024-09-15T22:14:51.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.028+0000 7f30a59ab640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30a0102d40 0x7f30a01009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:51.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.028+0000 7f30a59ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a0103660 0x7f30a0100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:51.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.028+0000 7f30a59ab640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30a010c170 0x7f30a0101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:51.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.028+0000 7f30a59ab640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f30a0112090 con 0x7f30a0103660 2024-09-15T22:14:51.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.028+0000 7f30a59ab640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f30a0111f10 con 0x7f30a0102d40 2024-09-15T22:14:51.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.028+0000 7f30a59ab640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f30a0112210 con 0x7f30a010c170 2024-09-15T22:14:51.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.028+0000 7f309e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a0103660 0x7f30a0100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:51.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.028+0000 7f309e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a0103660 0x7f30a0100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43504/0 (socket says 172.21.15.45:43504) 2024-09-15T22:14:51.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.028+0000 7f309e7fc640 1 -- 172.21.15.45:0/127209387 learned_addr learned my addr 172.21.15.45:0/127209387 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:51.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.029+0000 7f309effd640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30a0102d40 0x7f30a01009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:51.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.029+0000 7f309e7fc640 1 -- 172.21.15.45:0/127209387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30a010c170 msgr2=0x7f30a0101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:51.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.029+0000 7f309e7fc640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30a010c170 0x7f30a0101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:51.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.029+0000 7f309e7fc640 1 -- 172.21.15.45:0/127209387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30a0102d40 msgr2=0x7f30a01009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:51.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.029+0000 7f309e7fc640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30a0102d40 0x7f30a01009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:51.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.029+0000 7f309e7fc640 1 -- 172.21.15.45:0/127209387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a01a6a10 con 0x7f30a0103660 2024-09-15T22:14:51.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.029+0000 7f309effd640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30a0102d40 0x7f30a01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:51.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.029+0000 7f309e7fc640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a0103660 0x7f30a0100ee0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3094006010 tx=0x7f30940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:51.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.029+0000 7f30a49a9640 1 -- 172.21.15.45:0/127209387 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309403f030 con 0x7f30a0103660 2024-09-15T22:14:51.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.029+0000 7f30a49a9640 1 -- 172.21.15.45:0/127209387 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3094003d00 con 0x7f30a0103660 2024-09-15T22:14:51.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.029+0000 7f30a59ab640 1 -- 172.21.15.45:0/127209387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a01a6ca0 con 0x7f30a0103660 2024-09-15T22:14:51.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.029+0000 7f30a49a9640 1 -- 172.21.15.45:0/127209387 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094035070 con 0x7f30a0103660 2024-09-15T22:14:51.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.029+0000 7f30a59ab640 1 -- 172.21.15.45:0/127209387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a01a7180 con 0x7f30a0103660 2024-09-15T22:14:51.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.030+0000 7f30a59ab640 1 -- 172.21.15.45:0/127209387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30a0103120 con 0x7f30a0103660 2024-09-15T22:14:51.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.031+0000 7f30a49a9640 1 -- 172.21.15.45:0/127209387 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3094042030 con 0x7f30a0103660 2024-09-15T22:14:51.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.032+0000 7f30a49a9640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f30880a32d0 0x7f30880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:51.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.032+0000 7f309effd640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f30880a32d0 0x7f30880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:51.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.032+0000 7f30a49a9640 1 -- 172.21.15.45:0/127209387 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f30940f0150 con 0x7f30a0103660 2024-09-15T22:14:51.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.033+0000 7f309effd640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f30880a32d0 0x7f30880a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3090009b40 tx=0x7f3090005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:51.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.036+0000 7f30a49a9640 1 -- 172.21.15.45:0/127209387 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f30940bcad0 con 0x7f30a0103660 2024-09-15T22:14:51.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:50 smithi165 ceph-mon[35551]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:51.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:50 smithi165 ceph-mon[35551]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:14:51.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:50 smithi165 ceph-mon[35551]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:14:51.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.239+0000 7f30a59ab640 1 -- 172.21.15.45:0/127209387 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f30a0062630 con 0x7f30880a32d0 2024-09-15T22:14:51.242 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:50 smithi045 ceph-mon[31180]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:51.242 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:50 smithi045 ceph-mon[31180]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:14:51.242 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:50 smithi045 ceph-mon[31180]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:14:51.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:50 smithi100 ceph-mon[35319]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:51.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:50 smithi100 ceph-mon[35319]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:14:51.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:50 smithi100 ceph-mon[35319]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T22:14:51.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.244+0000 7f30a49a9640 1 -- 172.21.15.45:0/127209387 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f30a0062630 con 0x7f30880a32d0 2024-09-15T22:14:51.247 INFO:teuthology.orchestra.run.smithi045.stdout:/volumes/qa/sv_0/ac1a0916-b23c-46ab-9453-52325145a34a 2024-09-15T22:14:51.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.246+0000 7f30a59ab640 1 -- 172.21.15.45:0/127209387 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f30880a32d0 msgr2=0x7f30880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:51.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.246+0000 7f30a59ab640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f30880a32d0 0x7f30880a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3090009b40 tx=0x7f3090005e50 comp rx=0 tx=0).stop 2024-09-15T22:14:51.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.246+0000 7f30a59ab640 1 -- 172.21.15.45:0/127209387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a0103660 msgr2=0x7f30a0100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:51.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.246+0000 7f30a59ab640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a0103660 0x7f30a0100ee0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3094006010 tx=0x7f30940042f0 comp rx=0 tx=0).stop 2024-09-15T22:14:51.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.246+0000 7f30a59ab640 1 -- 172.21.15.45:0/127209387 shutdown_connections 2024-09-15T22:14:51.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.246+0000 7f30a59ab640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f30880a32d0 0x7f30880a5790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:51.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.246+0000 7f30a59ab640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30a010c170 0x7f30a0101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:51.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.246+0000 7f30a59ab640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30a0103660 0x7f30a0100ee0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:51.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.246+0000 7f30a59ab640 1 --2- 172.21.15.45:0/127209387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30a0102d40 0x7f30a01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:51.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.246+0000 7f30a59ab640 1 -- 172.21.15.45:0/127209387 >> 172.21.15.45:0/127209387 conn(0x7f30a00fc7a0 msgr2=0x7f30a00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:51.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.247+0000 7f30a59ab640 1 -- 172.21.15.45:0/127209387 shutdown_connections 2024-09-15T22:14:51.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:51.247+0000 7f30a59ab640 1 -- 172.21.15.45:0/127209387 wait complete. 2024-09-15T22:14:51.925 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-15T22:14:52.183 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:52.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:51 smithi165 ceph-mon[35551]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:52.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:51 smithi100 ceph-mon[35319]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:52.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:51 smithi045 ceph-mon[31180]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:52.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.656+0000 7f01d39f0640 1 -- 172.21.15.45:0/1364073124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc074f40 msgr2=0x7f01cc10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:52.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.656+0000 7f01d39f0640 1 --2- 172.21.15.45:0/1364073124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc074f40 0x7f01cc10de80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f01bc009900 tx=0x7f01bc02a480 comp rx=0 tx=0).stop 2024-09-15T22:14:52.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.656+0000 7f01d39f0640 1 -- 172.21.15.45:0/1364073124 shutdown_connections 2024-09-15T22:14:52.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.656+0000 7f01d39f0640 1 --2- 172.21.15.45:0/1364073124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01cc10e3c0 0x7f01cc110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:52.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.656+0000 7f01d39f0640 1 --2- 172.21.15.45:0/1364073124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc074f40 0x7f01cc10de80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:52.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.656+0000 7f01d39f0640 1 --2- 172.21.15.45:0/1364073124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01cc074620 0x7f01cc074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:52.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.656+0000 7f01d39f0640 1 -- 172.21.15.45:0/1364073124 >> 172.21.15.45:0/1364073124 conn(0x7f01cc0fd8c0 msgr2=0x7f01cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:52.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.656+0000 7f01d39f0640 1 -- 172.21.15.45:0/1364073124 shutdown_connections 2024-09-15T22:14:52.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.656+0000 7f01d39f0640 1 -- 172.21.15.45:0/1364073124 wait complete. 2024-09-15T22:14:52.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.657+0000 7f01d39f0640 1 Processor -- start 2024-09-15T22:14:52.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.657+0000 7f01d39f0640 1 -- start start 2024-09-15T22:14:52.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.657+0000 7f01d39f0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01cc074620 0x7f01cc1a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:52.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.657+0000 7f01d39f0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01cc074f40 0x7f01cc1a0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:52.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.657+0000 7f01d39f0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc10e3c0 0x7f01cc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:52.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.657+0000 7f01d39f0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc114290 con 0x7f01cc10e3c0 2024-09-15T22:14:52.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.657+0000 7f01d39f0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc114110 con 0x7f01cc074620 2024-09-15T22:14:52.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.657+0000 7f01d39f0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc114410 con 0x7f01cc074f40 2024-09-15T22:14:52.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.657+0000 7f01d1f8d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc10e3c0 0x7f01cc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:52.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.657+0000 7f01d1f8d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc10e3c0 0x7f01cc19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43522/0 (socket says 172.21.15.45:43522) 2024-09-15T22:14:52.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.657+0000 7f01d1f8d640 1 -- 172.21.15.45:0/951176399 learned_addr learned my addr 172.21.15.45:0/951176399 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:52.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.657+0000 7f01d0f8b640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01cc074f40 0x7f01cc1a0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:52.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.658+0000 7f01d178c640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01cc074620 0x7f01cc1a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:52.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.658+0000 7f01d1f8d640 1 -- 172.21.15.45:0/951176399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01cc074f40 msgr2=0x7f01cc1a0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:52.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.658+0000 7f01d1f8d640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01cc074f40 0x7f01cc1a0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:52.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.658+0000 7f01d1f8d640 1 -- 172.21.15.45:0/951176399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01cc074620 msgr2=0x7f01cc1a03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:52.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.658+0000 7f01d1f8d640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01cc074620 0x7f01cc1a03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:52.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.658+0000 7f01d1f8d640 1 -- 172.21.15.45:0/951176399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01cc19acc0 con 0x7f01cc10e3c0 2024-09-15T22:14:52.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.658+0000 7f01d1f8d640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc10e3c0 0x7f01cc19a590 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f01c400cad0 tx=0x7f01c400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:52.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.658+0000 7f01c27fc640 1 -- 172.21.15.45:0/951176399 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c400ae20 con 0x7f01cc10e3c0 2024-09-15T22:14:52.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.658+0000 7f01d39f0640 1 -- 172.21.15.45:0/951176399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01cc19afb0 con 0x7f01cc10e3c0 2024-09-15T22:14:52.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.658+0000 7f01c27fc640 1 -- 172.21.15.45:0/951176399 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f01c4004b20 con 0x7f01cc10e3c0 2024-09-15T22:14:52.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.658+0000 7f01c27fc640 1 -- 172.21.15.45:0/951176399 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c400f780 con 0x7f01cc10e3c0 2024-09-15T22:14:52.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.658+0000 7f01d39f0640 1 -- 172.21.15.45:0/951176399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01cc1a72a0 con 0x7f01cc10e3c0 2024-09-15T22:14:52.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.659+0000 7f01d39f0640 1 -- 172.21.15.45:0/951176399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01cc074a00 con 0x7f01cc10e3c0 2024-09-15T22:14:52.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.660+0000 7f01c27fc640 1 -- 172.21.15.45:0/951176399 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f01c4004cd0 con 0x7f01cc10e3c0 2024-09-15T22:14:52.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.661+0000 7f01c27fc640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f01b80a32d0 0x7f01b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:52.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.661+0000 7f01c27fc640 1 -- 172.21.15.45:0/951176399 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f01c40cfcd0 con 0x7f01cc10e3c0 2024-09-15T22:14:52.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.661+0000 7f01d178c640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f01b80a32d0 0x7f01b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:52.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.662+0000 7f01d178c640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f01b80a32d0 0x7f01b80a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f01c800bbe0 tx=0x7f01c800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:52.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.665+0000 7f01c27fc640 1 -- 172.21.15.45:0/951176399 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01c4014030 con 0x7f01cc10e3c0 2024-09-15T22:14:52.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.871+0000 7f01d39f0640 1 -- 172.21.15.45:0/951176399 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f01cc062630 con 0x7f01b80a32d0 2024-09-15T22:14:52.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.893+0000 7f01c27fc640 1 -- 172.21.15.45:0/951176399 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f01cc062630 con 0x7f01b80a32d0 2024-09-15T22:14:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.895+0000 7f01d39f0640 1 -- 172.21.15.45:0/951176399 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f01b80a32d0 msgr2=0x7f01b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.895+0000 7f01d39f0640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f01b80a32d0 0x7f01b80a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f01c800bbe0 tx=0x7f01c800b390 comp rx=0 tx=0).stop 2024-09-15T22:14:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.895+0000 7f01d39f0640 1 -- 172.21.15.45:0/951176399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc10e3c0 msgr2=0x7f01cc19a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.895+0000 7f01d39f0640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc10e3c0 0x7f01cc19a590 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f01c400cad0 tx=0x7f01c400cf90 comp rx=0 tx=0).stop 2024-09-15T22:14:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.895+0000 7f01d39f0640 1 -- 172.21.15.45:0/951176399 shutdown_connections 2024-09-15T22:14:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.895+0000 7f01d39f0640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f01b80a32d0 0x7f01b80a5790 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.895+0000 7f01d39f0640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01cc10e3c0 0x7f01cc19a590 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.895+0000 7f01d39f0640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f01cc074f40 0x7f01cc1a0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.895+0000 7f01d39f0640 1 --2- 172.21.15.45:0/951176399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01cc074620 0x7f01cc1a03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.895+0000 7f01d39f0640 1 -- 172.21.15.45:0/951176399 >> 172.21.15.45:0/951176399 conn(0x7f01cc0fd8c0 msgr2=0x7f01cc0ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.895+0000 7f01d39f0640 1 -- 172.21.15.45:0/951176399 shutdown_connections 2024-09-15T22:14:52.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:52.895+0000 7f01d39f0640 1 -- 172.21.15.45:0/951176399 wait complete. 2024-09-15T22:14:53.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:52 smithi165 ceph-mon[35551]: pgmap v305: 129 pgs: 129 active+clean; 601 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2024-09-15T22:14:53.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:52 smithi100 ceph-mon[35319]: pgmap v305: 129 pgs: 129 active+clean; 601 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2024-09-15T22:14:53.267 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:52 smithi045 ceph-mon[31180]: pgmap v305: 129 pgs: 129 active+clean; 601 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2024-09-15T22:14:53.721 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-15T22:14:53.990 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:54.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:53 smithi165 ceph-mon[35551]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:54.239 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:53 smithi045 ceph-mon[31180]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:54.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:53 smithi100 ceph-mon[35319]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:54.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.466+0000 7fcfce70e640 1 -- 172.21.15.45:0/1838805995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc8101de0 msgr2=0x7fcfc81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:54.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.466+0000 7fcfce70e640 1 --2- 172.21.15.45:0/1838805995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc8101de0 0x7fcfc81021c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009900 tx=0x7fcfb802a410 comp rx=0 tx=0).stop 2024-09-15T22:14:54.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.466+0000 7fcfce70e640 1 -- 172.21.15.45:0/1838805995 shutdown_connections 2024-09-15T22:14:54.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.466+0000 7fcfce70e640 1 --2- 172.21.15.45:0/1838805995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfc8106f10 0x7fcfc810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.466+0000 7fcfce70e640 1 --2- 172.21.15.45:0/1838805995 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc8102790 0x7fcfc81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.466+0000 7fcfce70e640 1 --2- 172.21.15.45:0/1838805995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc8101de0 0x7fcfc81021c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.466+0000 7fcfce70e640 1 -- 172.21.15.45:0/1838805995 >> 172.21.15.45:0/1838805995 conn(0x7fcfc80fd8e0 msgr2=0x7fcfc80ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:54.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.466+0000 7fcfce70e640 1 -- 172.21.15.45:0/1838805995 shutdown_connections 2024-09-15T22:14:54.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.466+0000 7fcfce70e640 1 -- 172.21.15.45:0/1838805995 wait complete. 2024-09-15T22:14:54.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.467+0000 7fcfce70e640 1 Processor -- start 2024-09-15T22:14:54.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.467+0000 7fcfce70e640 1 -- start start 2024-09-15T22:14:54.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.467+0000 7fcfce70e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfc8101de0 0x7fcfc80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:54.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.467+0000 7fcfce70e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc8102790 0x7fcfc8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:54.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.467+0000 7fcfce70e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc8106f10 0x7fcfc8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:54.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.467+0000 7fcfce70e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc8112150 con 0x7fcfc8106f10 2024-09-15T22:14:54.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.467+0000 7fcfce70e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc8111fd0 con 0x7fcfc8101de0 2024-09-15T22:14:54.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.467+0000 7fcfce70e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81122d0 con 0x7fcfc8102790 2024-09-15T22:14:54.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.467+0000 7fcfcccab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc8106f10 0x7fcfc8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:54.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.467+0000 7fcfcccab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc8106f10 0x7fcfc8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41100/0 (socket says 172.21.15.45:41100) 2024-09-15T22:14:54.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.467+0000 7fcfcccab640 1 -- 172.21.15.45:0/2135619045 learned_addr learned my addr 172.21.15.45:0/2135619045 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:54.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.467+0000 7fcfc77fe640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc8102790 0x7fcfc8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:54.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.467+0000 7fcfc7fff640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfc8101de0 0x7fcfc80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:54.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.468+0000 7fcfcccab640 1 -- 172.21.15.45:0/2135619045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc8102790 msgr2=0x7fcfc8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:54.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.468+0000 7fcfcccab640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc8102790 0x7fcfc8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.468+0000 7fcfcccab640 1 -- 172.21.15.45:0/2135619045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfc8101de0 msgr2=0x7fcfc80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:54.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.468+0000 7fcfcccab640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfc8101de0 0x7fcfc80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.468+0000 7fcfcccab640 1 -- 172.21.15.45:0/2135619045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc81a6af0 con 0x7fcfc8106f10 2024-09-15T22:14:54.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.468+0000 7fcfcccab640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc8106f10 0x7fcfc8074f70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000b970 tx=0x7fcfc000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:54.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.468+0000 7fcfc57fa640 1 -- 172.21.15.45:0/2135619045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0019070 con 0x7fcfc8106f10 2024-09-15T22:14:54.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.468+0000 7fcfc57fa640 1 -- 172.21.15.45:0/2135619045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcfc0014440 con 0x7fcfc8106f10 2024-09-15T22:14:54.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.468+0000 7fcfce70e640 1 -- 172.21.15.45:0/2135619045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc81a6de0 con 0x7fcfc8106f10 2024-09-15T22:14:54.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.468+0000 7fcfc57fa640 1 -- 172.21.15.45:0/2135619045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc00075d0 con 0x7fcfc8106f10 2024-09-15T22:14:54.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.468+0000 7fcfce70e640 1 -- 172.21.15.45:0/2135619045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc81a7290 con 0x7fcfc8106f10 2024-09-15T22:14:54.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.469+0000 7fcfce70e640 1 -- 172.21.15.45:0/2135619045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfc8102240 con 0x7fcfc8106f10 2024-09-15T22:14:54.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.470+0000 7fcfc57fa640 1 -- 172.21.15.45:0/2135619045 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcfc001c070 con 0x7fcfc8106f10 2024-09-15T22:14:54.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.471+0000 7fcfc57fa640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fcfb00a32d0 0x7fcfb00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:54.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.471+0000 7fcfc57fa640 1 -- 172.21.15.45:0/2135619045 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fcfc00cf060 con 0x7fcfc8106f10 2024-09-15T22:14:54.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.471+0000 7fcfc7fff640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fcfb00a32d0 0x7fcfb00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:54.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.472+0000 7fcfc7fff640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fcfb00a32d0 0x7fcfb00a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009230 tx=0x7fcfb80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:54.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.475+0000 7fcfc57fa640 1 -- 172.21.15.45:0/2135619045 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcfc009b4a0 con 0x7fcfc8106f10 2024-09-15T22:14:54.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.679+0000 7fcfce70e640 1 -- 172.21.15.45:0/2135619045 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fcfc810a160 con 0x7fcfb00a32d0 2024-09-15T22:14:54.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.683+0000 7fcfc57fa640 1 -- 172.21.15.45:0/2135619045 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fcfb8031810 con 0x7fcfb00a32d0 2024-09-15T22:14:54.685 INFO:teuthology.orchestra.run.smithi045.stdout:/volumes/qa/sv_1/c2ba8ff1-799c-49b4-bbce-3a895390aaa4 2024-09-15T22:14:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.685+0000 7fcfce70e640 1 -- 172.21.15.45:0/2135619045 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fcfb00a32d0 msgr2=0x7fcfb00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.685+0000 7fcfce70e640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fcfb00a32d0 0x7fcfb00a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009230 tx=0x7fcfb80058d0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.685+0000 7fcfce70e640 1 -- 172.21.15.45:0/2135619045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc8106f10 msgr2=0x7fcfc8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:54.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.685+0000 7fcfce70e640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc8106f10 0x7fcfc8074f70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000b970 tx=0x7fcfc000bd70 comp rx=0 tx=0).stop 2024-09-15T22:14:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.685+0000 7fcfce70e640 1 -- 172.21.15.45:0/2135619045 shutdown_connections 2024-09-15T22:14:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.685+0000 7fcfce70e640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fcfb00a32d0 0x7fcfb00a5790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.685+0000 7fcfce70e640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfc8106f10 0x7fcfc8074f70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.685+0000 7fcfce70e640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcfc8102790 0x7fcfc8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.685+0000 7fcfce70e640 1 --2- 172.21.15.45:0/2135619045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfc8101de0 0x7fcfc80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.685+0000 7fcfce70e640 1 -- 172.21.15.45:0/2135619045 >> 172.21.15.45:0/2135619045 conn(0x7fcfc80fd8e0 msgr2=0x7fcfc80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.685+0000 7fcfce70e640 1 -- 172.21.15.45:0/2135619045 shutdown_connections 2024-09-15T22:14:54.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:54.685+0000 7fcfce70e640 1 -- 172.21.15.45:0/2135619045 wait complete. 2024-09-15T22:14:55.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:54 smithi165 ceph-mon[35551]: pgmap v306: 129 pgs: 129 active+clean; 601 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-15T22:14:55.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:54 smithi100 ceph-mon[35319]: pgmap v306: 129 pgs: 129 active+clean; 601 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-15T22:14:55.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:54 smithi045 ceph-mon[31180]: pgmap v306: 129 pgs: 129 active+clean; 601 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-15T22:14:55.385 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:14:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.139+0000 7f7534a46640 1 -- 172.21.15.45:0/3213264233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7530100ca0 msgr2=0x7f7530106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.139+0000 7f7534a46640 1 --2- 172.21.15.45:0/3213264233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7530100ca0 0x7f7530106840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7524009930 tx=0x7f752402a420 comp rx=0 tx=0).stop 2024-09-15T22:14:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.140+0000 7f7534a46640 1 -- 172.21.15.45:0/3213264233 shutdown_connections 2024-09-15T22:14:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.140+0000 7f7534a46640 1 --2- 172.21.15.45:0/3213264233 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7530106f50 0x7f753010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.140+0000 7f7534a46640 1 --2- 172.21.15.45:0/3213264233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7530100ca0 0x7f7530106840 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.140+0000 7f7534a46640 1 --2- 172.21.15.45:0/3213264233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75301002f0 0x7f75301006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:56.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.140+0000 7f7534a46640 1 -- 172.21.15.45:0/3213264233 >> 172.21.15.45:0/3213264233 conn(0x7f7530077210 msgr2=0x7f75300fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.140+0000 7f7534a46640 1 -- 172.21.15.45:0/3213264233 shutdown_connections 2024-09-15T22:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.140+0000 7f7534a46640 1 -- 172.21.15.45:0/3213264233 wait complete. 2024-09-15T22:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.140+0000 7f7534a46640 1 Processor -- start 2024-09-15T22:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.140+0000 7f7534a46640 1 -- start start 2024-09-15T22:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f7534a46640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75301002f0 0x7f75301986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f7534a46640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7530100ca0 0x7f7530198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f7534a46640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7530106f50 0x7f753019cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f7534a46640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7530112120 con 0x7f75301002f0 2024-09-15T22:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f7534a46640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7530111fa0 con 0x7f7530106f50 2024-09-15T22:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f7534a46640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f75301122a0 con 0x7f7530100ca0 2024-09-15T22:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f752e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75301002f0 0x7f75301986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f752e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75301002f0 0x7f75301986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41128/0 (socket says 172.21.15.45:41128) 2024-09-15T22:14:56.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f752e59c640 1 -- 172.21.15.45:0/3782517955 learned_addr learned my addr 172.21.15.45:0/3782517955 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f752dd9b640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7530100ca0 0x7f7530198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f752ed9d640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7530106f50 0x7f753019cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f752e59c640 1 -- 172.21.15.45:0/3782517955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7530100ca0 msgr2=0x7f7530198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f752e59c640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7530100ca0 0x7f7530198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f752e59c640 1 -- 172.21.15.45:0/3782517955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7530106f50 msgr2=0x7f753019cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f752e59c640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7530106f50 0x7f753019cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f752e59c640 1 -- 172.21.15.45:0/3782517955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f753019d650 con 0x7f75301002f0 2024-09-15T22:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f752ed9d640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7530106f50 0x7f753019cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.141+0000 7f752e59c640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75301002f0 0x7f75301986a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f752000e9f0 tx=0x7f752000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.142+0000 7f751f7fe640 1 -- 172.21.15.45:0/3782517955 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752000cd80 con 0x7f75301002f0 2024-09-15T22:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.142+0000 7f7534a46640 1 -- 172.21.15.45:0/3782517955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f753019d940 con 0x7f75301002f0 2024-09-15T22:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.142+0000 7f751f7fe640 1 -- 172.21.15.45:0/3782517955 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7520010930 con 0x7f75301002f0 2024-09-15T22:14:56.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.142+0000 7f751f7fe640 1 -- 172.21.15.45:0/3782517955 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7520018b00 con 0x7f75301002f0 2024-09-15T22:14:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.142+0000 7f7534a46640 1 -- 172.21.15.45:0/3782517955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75301a5220 con 0x7f75301002f0 2024-09-15T22:14:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.143+0000 7f7534a46640 1 -- 172.21.15.45:0/3782517955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75301006d0 con 0x7f75301002f0 2024-09-15T22:14:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.144+0000 7f751f7fe640 1 -- 172.21.15.45:0/3782517955 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7520018ca0 con 0x7f75301002f0 2024-09-15T22:14:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.145+0000 7f751f7fe640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f75180a32d0 0x7f75180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.145+0000 7f752dd9b640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f75180a32d0 0x7f75180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.145+0000 7f751f7fe640 1 -- 172.21.15.45:0/3782517955 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f75200d01c0 con 0x7f75301002f0 2024-09-15T22:14:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.145+0000 7f752dd9b640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f75180a32d0 0x7f75180a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7524006010 tx=0x7f7524009610 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:56.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.149+0000 7f751f7fe640 1 -- 172.21.15.45:0/3782517955 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f752009cb40 con 0x7f75301002f0 2024-09-15T22:14:56.171 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:55 smithi045 ceph-mon[31180]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:56.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:55 smithi165 ceph-mon[35551]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:56.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:55 smithi100 ceph-mon[35319]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:14:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.366+0000 7f7534a46640 1 -- 172.21.15.45:0/3782517955 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7530199a00 con 0x7f75301002f0 2024-09-15T22:14:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.366+0000 7f751f7fe640 1 -- 172.21.15.45:0/3782517955 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f752009c440 con 0x7f75301002f0 2024-09-15T22:14:56.369 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:14:56.369 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:14:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:14:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.369+0000 7f7534a46640 1 -- 172.21.15.45:0/3782517955 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f75180a32d0 msgr2=0x7f75180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.369+0000 7f7534a46640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f75180a32d0 0x7f75180a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7524006010 tx=0x7f7524009610 comp rx=0 tx=0).stop 2024-09-15T22:14:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.369+0000 7f7534a46640 1 -- 172.21.15.45:0/3782517955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75301002f0 msgr2=0x7f75301986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.369+0000 7f7534a46640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75301002f0 0x7f75301986a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f752000e9f0 tx=0x7f752000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:14:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.369+0000 7f7534a46640 1 -- 172.21.15.45:0/3782517955 shutdown_connections 2024-09-15T22:14:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.369+0000 7f7534a46640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f75180a32d0 0x7f75180a5790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.369+0000 7f7534a46640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7530106f50 0x7f753019cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:56.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.369+0000 7f7534a46640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7530100ca0 0x7f7530198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:56.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.369+0000 7f7534a46640 1 --2- 172.21.15.45:0/3782517955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75301002f0 0x7f75301986a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:56.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.369+0000 7f7534a46640 1 -- 172.21.15.45:0/3782517955 >> 172.21.15.45:0/3782517955 conn(0x7f7530077210 msgr2=0x7f75300fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:56.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.369+0000 7f7534a46640 1 -- 172.21.15.45:0/3782517955 shutdown_connections 2024-09-15T22:14:56.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:56.369+0000 7f7534a46640 1 -- 172.21.15.45:0/3782517955 wait complete. 2024-09-15T22:14:57.093 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:14:57.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:56 smithi165 ceph-mon[35551]: pgmap v307: 129 pgs: 129 active+clean; 601 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-15T22:14:57.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:56 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3782517955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:14:57.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:56 smithi100 ceph-mon[35319]: pgmap v307: 129 pgs: 129 active+clean; 601 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-15T22:14:57.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:56 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3782517955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:14:57.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:56 smithi045 ceph-mon[31180]: pgmap v307: 129 pgs: 129 active+clean; 601 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-15T22:14:57.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:56 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3782517955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:14:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.833+0000 7ff06bb79640 1 -- 172.21.15.45:0/1100718241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff064102ef0 msgr2=0x7ff06410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.833+0000 7ff06bb79640 1 --2- 172.21.15.45:0/1100718241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff064102ef0 0x7ff06410da40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff05c009ca0 tx=0x7ff05c02a950 comp rx=0 tx=0).stop 2024-09-15T22:14:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.833+0000 7ff06bb79640 1 -- 172.21.15.45:0/1100718241 shutdown_connections 2024-09-15T22:14:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.833+0000 7ff06bb79640 1 --2- 172.21.15.45:0/1100718241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff064102ef0 0x7ff06410da40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.833+0000 7ff06bb79640 1 --2- 172.21.15.45:0/1100718241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff064102570 0x7ff0641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.833+0000 7ff06bb79640 1 --2- 172.21.15.45:0/1100718241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff064100e20 0x7ff064101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.833+0000 7ff06bb79640 1 -- 172.21.15.45:0/1100718241 >> 172.21.15.45:0/1100718241 conn(0x7ff0640fc7d0 msgr2=0x7ff0640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:57.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.833+0000 7ff06bb79640 1 -- 172.21.15.45:0/1100718241 shutdown_connections 2024-09-15T22:14:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.833+0000 7ff06bb79640 1 -- 172.21.15.45:0/1100718241 wait complete. 2024-09-15T22:14:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.833+0000 7ff06bb79640 1 Processor -- start 2024-09-15T22:14:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.833+0000 7ff06bb79640 1 -- start start 2024-09-15T22:14:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06bb79640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff064100e20 0x7ff0641992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06bb79640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff064102570 0x7ff064199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06bb79640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff064102ef0 0x7ff0641a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06bb79640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff0641110a0 con 0x7ff064102ef0 2024-09-15T22:14:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06bb79640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff064110f20 con 0x7ff064100e20 2024-09-15T22:14:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06bb79640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff064111220 con 0x7ff064102570 2024-09-15T22:14:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06a116640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff064102ef0 0x7ff0641a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06a116640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff064102ef0 0x7ff0641a4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41154/0 (socket says 172.21.15.45:41154) 2024-09-15T22:14:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06a116640 1 -- 172.21.15.45:0/1247048077 learned_addr learned my addr 172.21.15.45:0/1247048077 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:57.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff069114640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff064102570 0x7ff064199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff069915640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff064100e20 0x7ff0641992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06a116640 1 -- 172.21.15.45:0/1247048077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff064102570 msgr2=0x7ff064199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06a116640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff064102570 0x7ff064199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06a116640 1 -- 172.21.15.45:0/1247048077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff064100e20 msgr2=0x7ff0641992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06a116640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff064100e20 0x7ff0641992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06a116640 1 -- 172.21.15.45:0/1247048077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0641a48b0 con 0x7ff064102ef0 2024-09-15T22:14:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06a116640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff064102ef0 0x7ff0641a4370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff05c005cc0 tx=0x7ff05c030e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff05affd640 1 -- 172.21.15.45:0/1247048077 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c034040 con 0x7ff064102ef0 2024-09-15T22:14:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff05affd640 1 -- 172.21.15.45:0/1247048077 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff05c030940 con 0x7ff064102ef0 2024-09-15T22:14:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff06bb79640 1 -- 172.21.15.45:0/1247048077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0641a4a80 con 0x7ff064102ef0 2024-09-15T22:14:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.834+0000 7ff05affd640 1 -- 172.21.15.45:0/1247048077 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff05c0456e0 con 0x7ff064102ef0 2024-09-15T22:14:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.835+0000 7ff06bb79640 1 -- 172.21.15.45:0/1247048077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0641a4f30 con 0x7ff064102ef0 2024-09-15T22:14:57.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.835+0000 7ff06bb79640 1 -- 172.21.15.45:0/1247048077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff064101200 con 0x7ff064102ef0 2024-09-15T22:14:57.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.837+0000 7ff05affd640 1 -- 172.21.15.45:0/1247048077 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff05c037020 con 0x7ff064102ef0 2024-09-15T22:14:57.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.837+0000 7ff05affd640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff0500a3350 0x7ff0500a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:57.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.838+0000 7ff05affd640 1 -- 172.21.15.45:0/1247048077 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7ff05c0f0e70 con 0x7ff064102ef0 2024-09-15T22:14:57.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.838+0000 7ff069915640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff0500a3350 0x7ff0500a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:57.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.838+0000 7ff069915640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff0500a3350 0x7ff0500a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff0600058c0 tx=0x7ff06000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:57.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:57.841+0000 7ff05affd640 1 -- 172.21.15.45:0/1247048077 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff05c0bd900 con 0x7ff064102ef0 2024-09-15T22:14:58.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.018+0000 7ff06bb79640 1 -- 172.21.15.45:0/1247048077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0641a5160 con 0x7ff064102ef0 2024-09-15T22:14:58.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.019+0000 7ff05affd640 1 -- 172.21.15.45:0/1247048077 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24190 (secure 0 0 0) 0x7ff05c044e80 con 0x7ff064102ef0 2024-09-15T22:14:58.022 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:14:58.022 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:14:16.455664+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:14:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.021+0000 7ff06bb79640 1 -- 172.21.15.45:0/1247048077 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff0500a3350 msgr2=0x7ff0500a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.021+0000 7ff06bb79640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff0500a3350 0x7ff0500a5810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff0600058c0 tx=0x7ff06000a4c0 comp rx=0 tx=0).stop 2024-09-15T22:14:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.021+0000 7ff06bb79640 1 -- 172.21.15.45:0/1247048077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff064102ef0 msgr2=0x7ff0641a4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.021+0000 7ff06bb79640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff064102ef0 0x7ff0641a4370 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff05c005cc0 tx=0x7ff05c030e30 comp rx=0 tx=0).stop 2024-09-15T22:14:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.022+0000 7ff06bb79640 1 -- 172.21.15.45:0/1247048077 shutdown_connections 2024-09-15T22:14:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.022+0000 7ff06bb79640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff0500a3350 0x7ff0500a5810 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.022+0000 7ff06bb79640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff064102ef0 0x7ff0641a4370 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.022+0000 7ff06bb79640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff064102570 0x7ff064199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.022+0000 7ff06bb79640 1 --2- 172.21.15.45:0/1247048077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff064100e20 0x7ff0641992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:58.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.022+0000 7ff06bb79640 1 -- 172.21.15.45:0/1247048077 >> 172.21.15.45:0/1247048077 conn(0x7ff0640fc7d0 msgr2=0x7ff064106760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:58.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.022+0000 7ff06bb79640 1 -- 172.21.15.45:0/1247048077 shutdown_connections 2024-09-15T22:14:58.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:58.022+0000 7ff06bb79640 1 -- 172.21.15.45:0/1247048077 wait complete. 2024-09-15T22:14:58.735 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T22:14:58.735 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:14:59.001 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:14:59.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:58 smithi045 ceph-mon[31180]: pgmap v308: 129 pgs: 129 active+clean; 620 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-15T22:14:59.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:14:58 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1247048077' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:59.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:58 smithi165 ceph-mon[35551]: pgmap v308: 129 pgs: 129 active+clean; 620 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-15T22:14:59.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:14:58 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1247048077' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:59.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:58 smithi100 ceph-mon[35319]: pgmap v308: 129 pgs: 129 active+clean; 620 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-15T22:14:59.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:14:58 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1247048077' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:14:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.493+0000 7fbb14996640 1 -- 172.21.15.45:0/2372864280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb10108300 msgr2=0x7fbb1010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.493+0000 7fbb14996640 1 --2- 172.21.15.45:0/2372864280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb10108300 0x7fbb1010ec70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009930 tx=0x7fbb0802a440 comp rx=0 tx=0).stop 2024-09-15T22:14:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.493+0000 7fbb14996640 1 -- 172.21.15.45:0/2372864280 shutdown_connections 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.493+0000 7fbb14996640 1 --2- 172.21.15.45:0/2372864280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb10108300 0x7fbb1010ec70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.493+0000 7fbb14996640 1 --2- 172.21.15.45:0/2372864280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb10103780 0x7fbb10107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.493+0000 7fbb14996640 1 --2- 172.21.15.45:0/2372864280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb10102dd0 0x7fbb101031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.493+0000 7fbb14996640 1 -- 172.21.15.45:0/2372864280 >> 172.21.15.45:0/2372864280 conn(0x7fbb100fc7d0 msgr2=0x7fbb100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.493+0000 7fbb14996640 1 -- 172.21.15.45:0/2372864280 shutdown_connections 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.493+0000 7fbb14996640 1 -- 172.21.15.45:0/2372864280 wait complete. 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.494+0000 7fbb14996640 1 Processor -- start 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.494+0000 7fbb14996640 1 -- start start 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.494+0000 7fbb14996640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb10102dd0 0x7fbb10198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.494+0000 7fbb14996640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb10103780 0x7fbb10198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.494+0000 7fbb14996640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb10108300 0x7fbb1019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.494+0000 7fbb14996640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbb10112230 con 0x7fbb10103780 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.494+0000 7fbb14996640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101120b0 con 0x7fbb10108300 2024-09-15T22:14:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.494+0000 7fbb14996640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbb101123b0 con 0x7fbb10102dd0 2024-09-15T22:14:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.494+0000 7fbb0dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb10103780 0x7fbb10198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.494+0000 7fbb0dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb10103780 0x7fbb10198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41176/0 (socket says 172.21.15.45:41176) 2024-09-15T22:14:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.494+0000 7fbb0dd9b640 1 -- 172.21.15.45:0/1312787405 learned_addr learned my addr 172.21.15.45:0/1312787405 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:14:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.495+0000 7fbb0e59c640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb10102dd0 0x7fbb10198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.495+0000 7fbb0ed9d640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb10108300 0x7fbb1019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.495+0000 7fbb0dd9b640 1 -- 172.21.15.45:0/1312787405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb10102dd0 msgr2=0x7fbb10198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.495+0000 7fbb0dd9b640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb10102dd0 0x7fbb10198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.495+0000 7fbb0dd9b640 1 -- 172.21.15.45:0/1312787405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb10108300 msgr2=0x7fbb1019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.495+0000 7fbb0dd9b640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb10108300 0x7fbb1019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.495+0000 7fbb0dd9b640 1 -- 172.21.15.45:0/1312787405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb1019d5b0 con 0x7fbb10103780 2024-09-15T22:14:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.495+0000 7fbb0dd9b640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb10103780 0x7fbb10198b40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbb04006fd0 tx=0x7fbb0400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.495+0000 7fbaff7fe640 1 -- 172.21.15.45:0/1312787405 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04011830 con 0x7fbb10103780 2024-09-15T22:14:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.495+0000 7fbb14996640 1 -- 172.21.15.45:0/1312787405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb1019d8a0 con 0x7fbb10103780 2024-09-15T22:14:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.495+0000 7fbaff7fe640 1 -- 172.21.15.45:0/1312787405 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbb04016070 con 0x7fbb10103780 2024-09-15T22:14:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.495+0000 7fbaff7fe640 1 -- 172.21.15.45:0/1312787405 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0400f2e0 con 0x7fbb10103780 2024-09-15T22:14:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.495+0000 7fbb14996640 1 -- 172.21.15.45:0/1312787405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb101a5180 con 0x7fbb10103780 2024-09-15T22:14:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.496+0000 7fbb14996640 1 -- 172.21.15.45:0/1312787405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb101031b0 con 0x7fbb10103780 2024-09-15T22:14:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.497+0000 7fbaff7fe640 1 -- 172.21.15.45:0/1312787405 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbb040119d0 con 0x7fbb10103780 2024-09-15T22:14:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.498+0000 7fbaff7fe640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbaf80a32d0 0x7fbaf80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:14:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.498+0000 7fbb0e59c640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbaf80a32d0 0x7fbaf80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:14:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.498+0000 7fbaff7fe640 1 -- 172.21.15.45:0/1312787405 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fbb040cf1e0 con 0x7fbb10103780 2024-09-15T22:14:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.499+0000 7fbb0e59c640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbaf80a32d0 0x7fbaf80a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbb00007ec0 tx=0x7fbb000075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:14:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.502+0000 7fbaff7fe640 1 -- 172.21.15.45:0/1312787405 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbb0409bc10 con 0x7fbb10103780 2024-09-15T22:14:59.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.677+0000 7fbb14996640 1 -- 172.21.15.45:0/1312787405 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb100fea70 con 0x7fbaf80a32d0 2024-09-15T22:14:59.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.686+0000 7fbaff7fe640 1 -- 172.21.15.45:0/1312787405 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340266 (secure 0 0 0) 0x7fbb100fea70 con 0x7fbaf80a32d0 2024-09-15T22:14:59.692 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:14:59.694 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-09-15T22:14:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.690+0000 7fbb14996640 1 -- 172.21.15.45:0/1312787405 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbaf80a32d0 msgr2=0x7fbaf80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.690+0000 7fbb14996640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbaf80a32d0 0x7fbaf80a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbb00007ec0 tx=0x7fbb000075b0 comp rx=0 tx=0).stop 2024-09-15T22:14:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.690+0000 7fbb14996640 1 -- 172.21.15.45:0/1312787405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb10103780 msgr2=0x7fbb10198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:14:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.690+0000 7fbb14996640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb10103780 0x7fbb10198b40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbb04006fd0 tx=0x7fbb0400b8e0 comp rx=0 tx=0).stop 2024-09-15T22:14:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.690+0000 7fbb14996640 1 -- 172.21.15.45:0/1312787405 shutdown_connections 2024-09-15T22:14:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.690+0000 7fbb14996640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fbaf80a32d0 0x7fbaf80a5790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.690+0000 7fbb14996640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb10108300 0x7fbb1019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.690+0000 7fbb14996640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb10103780 0x7fbb10198b40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.690+0000 7fbb14996640 1 --2- 172.21.15.45:0/1312787405 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbb10102dd0 0x7fbb10198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:14:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.690+0000 7fbb14996640 1 -- 172.21.15.45:0/1312787405 >> 172.21.15.45:0/1312787405 conn(0x7fbb100fc7d0 msgr2=0x7fbb100fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:14:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.690+0000 7fbb14996640 1 -- 172.21.15.45:0/1312787405 shutdown_connections 2024-09-15T22:14:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:14:59.690+0000 7fbb14996640 1 -- 172.21.15.45:0/1312787405 wait complete. 2024-09-15T22:15:00.437 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-15T22:14:59.423969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634745,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":173,"num_read_kb":183,"num_write":255,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":408468,"kb_used_data":13444,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124533356,"statfs":{"total":1151940427776,"available":1151522156544,"internally_reserved":0,"allocated":13766656,"data_stored":7706771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39735,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":50,"num_write":25,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003428"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.101096+0000","last_change":"2024-09-15T22:14:04.718966+0000","last_active":"2024-09-15T22:14:17.101096+0000","last_peered":"2024-09-15T22:14:17.101096+0000","last_clean":"2024-09-15T22:14:17.101096+0000","last_became_active":"2024-09-15T22:14:04.718743+0000","last_became_peered":"2024-09-15T22:14:04.718743+0000","last_unstale":"2024-09-15T22:14:17.101096+0000","last_undegraded":"2024-09-15T22:14:17.101096+0000","last_fullsized":"2024-09-15T22:14:17.101096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:24:01.767801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980835+0000","last_change":"2024-09-15T22:14:06.814802+0000","last_active":"2024-09-15T22:14:17.980835+0000","last_peered":"2024-09-15T22:14:17.980835+0000","last_clean":"2024-09-15T22:14:17.980835+0000","last_became_active":"2024-09-15T22:14:06.814495+0000","last_became_peered":"2024-09-15T22:14:06.814495+0000","last_unstale":"2024-09-15T22:14:17.980835+0000","last_undegraded":"2024-09-15T22:14:17.980835+0000","last_fullsized":"2024-09-15T22:14:17.980835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:45.384412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799484+0000","last_change":"2024-09-15T22:14:13.847669+0000","last_active":"2024-09-15T22:14:17.799484+0000","last_peered":"2024-09-15T22:14:17.799484+0000","last_clean":"2024-09-15T22:14:17.799484+0000","last_became_active":"2024-09-15T22:14:13.847315+0000","last_became_peered":"2024-09-15T22:14:13.847315+0000","last_unstale":"2024-09-15T22:14:17.799484+0000","last_undegraded":"2024-09-15T22:14:17.799484+0000","last_fullsized":"2024-09-15T22:14:17.799484+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:50.609272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981038+0000","last_change":"2024-09-15T22:14:05.017101+0000","last_active":"2024-09-15T22:14:17.981038+0000","last_peered":"2024-09-15T22:14:17.981038+0000","last_clean":"2024-09-15T22:14:17.981038+0000","last_became_active":"2024-09-15T22:14:05.016748+0000","last_became_peered":"2024-09-15T22:14:05.016748+0000","last_unstale":"2024-09-15T22:14:17.981038+0000","last_undegraded":"2024-09-15T22:14:17.981038+0000","last_fullsized":"2024-09-15T22:14:17.981038+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:11.211291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845620+0000","last_change":"2024-09-15T22:14:06.815112+0000","last_active":"2024-09-15T22:14:16.845620+0000","last_peered":"2024-09-15T22:14:16.845620+0000","last_clean":"2024-09-15T22:14:16.845620+0000","last_became_active":"2024-09-15T22:14:06.814556+0000","last_became_peered":"2024-09-15T22:14:06.814556+0000","last_unstale":"2024-09-15T22:14:16.845620+0000","last_undegraded":"2024-09-15T22:14:16.845620+0000","last_fullsized":"2024-09-15T22:14:16.845620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:24.733336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.672872+0000","last_change":"2024-09-15T22:14:13.845829+0000","last_active":"2024-09-15T22:14:17.672872+0000","last_peered":"2024-09-15T22:14:17.672872+0000","last_clean":"2024-09-15T22:14:17.672872+0000","last_became_active":"2024-09-15T22:14:13.844958+0000","last_became_peered":"2024-09-15T22:14:13.844958+0000","last_unstale":"2024-09-15T22:14:17.672872+0000","last_undegraded":"2024-09-15T22:14:17.672872+0000","last_fullsized":"2024-09-15T22:14:17.672872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:37.944143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846777+0000","last_change":"2024-09-15T22:14:04.720255+0000","last_active":"2024-09-15T22:14:16.846777+0000","last_peered":"2024-09-15T22:14:16.846777+0000","last_clean":"2024-09-15T22:14:16.846777+0000","last_became_active":"2024-09-15T22:14:04.719907+0000","last_became_peered":"2024-09-15T22:14:04.719907+0000","last_unstale":"2024-09-15T22:14:16.846777+0000","last_undegraded":"2024-09-15T22:14:16.846777+0000","last_fullsized":"2024-09-15T22:14:16.846777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:12.510139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.159012+0000","last_change":"2024-09-15T22:14:06.808322+0000","last_active":"2024-09-15T22:14:17.159012+0000","last_peered":"2024-09-15T22:14:17.159012+0000","last_clean":"2024-09-15T22:14:17.159012+0000","last_became_active":"2024-09-15T22:14:06.807398+0000","last_became_peered":"2024-09-15T22:14:06.807398+0000","last_unstale":"2024-09-15T22:14:17.159012+0000","last_undegraded":"2024-09-15T22:14:17.159012+0000","last_fullsized":"2024-09-15T22:14:17.159012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:11.677800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673004+0000","last_change":"2024-09-15T22:14:13.849713+0000","last_active":"2024-09-15T22:14:17.673004+0000","last_peered":"2024-09-15T22:14:17.673004+0000","last_clean":"2024-09-15T22:14:17.673004+0000","last_became_active":"2024-09-15T22:14:13.849311+0000","last_became_peered":"2024-09-15T22:14:13.849311+0000","last_unstale":"2024-09-15T22:14:17.673004+0000","last_undegraded":"2024-09-15T22:14:17.673004+0000","last_fullsized":"2024-09-15T22:14:17.673004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:17.782013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846680+0000","last_change":"2024-09-15T22:14:04.721694+0000","last_active":"2024-09-15T22:14:16.846680+0000","last_peered":"2024-09-15T22:14:16.846680+0000","last_clean":"2024-09-15T22:14:16.846680+0000","last_became_active":"2024-09-15T22:14:04.721321+0000","last_became_peered":"2024-09-15T22:14:04.721321+0000","last_unstale":"2024-09-15T22:14:16.846680+0000","last_undegraded":"2024-09-15T22:14:16.846680+0000","last_fullsized":"2024-09-15T22:14:16.846680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:47.817565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981931+0000","last_change":"2024-09-15T22:14:06.809564+0000","last_active":"2024-09-15T22:14:17.981931+0000","last_peered":"2024-09-15T22:14:17.981931+0000","last_clean":"2024-09-15T22:14:17.981931+0000","last_became_active":"2024-09-15T22:14:06.809102+0000","last_became_peered":"2024-09-15T22:14:06.809102+0000","last_unstale":"2024-09-15T22:14:17.981931+0000","last_undegraded":"2024-09-15T22:14:17.981931+0000","last_fullsized":"2024-09-15T22:14:17.981931+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:55.306791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673043+0000","last_change":"2024-09-15T22:14:13.849839+0000","last_active":"2024-09-15T22:14:17.673043+0000","last_peered":"2024-09-15T22:14:17.673043+0000","last_clean":"2024-09-15T22:14:17.673043+0000","last_became_active":"2024-09-15T22:14:13.849415+0000","last_became_peered":"2024-09-15T22:14:13.849415+0000","last_unstale":"2024-09-15T22:14:17.673043+0000","last_undegraded":"2024-09-15T22:14:17.673043+0000","last_fullsized":"2024-09-15T22:14:17.673043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:20.336406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848472+0000","last_change":"2024-09-15T22:14:06.815506+0000","last_active":"2024-09-15T22:14:16.848472+0000","last_peered":"2024-09-15T22:14:16.848472+0000","last_clean":"2024-09-15T22:14:16.848472+0000","last_became_active":"2024-09-15T22:14:06.815066+0000","last_became_peered":"2024-09-15T22:14:06.815066+0000","last_unstale":"2024-09-15T22:14:16.848472+0000","last_undegraded":"2024-09-15T22:14:16.848472+0000","last_fullsized":"2024-09-15T22:14:16.848472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:42.182268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846385+0000","last_change":"2024-09-15T22:14:04.721403+0000","last_active":"2024-09-15T22:14:16.846385+0000","last_peered":"2024-09-15T22:14:16.846385+0000","last_clean":"2024-09-15T22:14:16.846385+0000","last_became_active":"2024-09-15T22:14:04.721049+0000","last_became_peered":"2024-09-15T22:14:04.721049+0000","last_unstale":"2024-09-15T22:14:16.846385+0000","last_undegraded":"2024-09-15T22:14:16.846385+0000","last_fullsized":"2024-09-15T22:14:16.846385+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:39.860926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673188+0000","last_change":"2024-09-15T22:14:14.280656+0000","last_active":"2024-09-15T22:14:17.673188+0000","last_peered":"2024-09-15T22:14:17.673188+0000","last_clean":"2024-09-15T22:14:17.673188+0000","last_became_active":"2024-09-15T22:14:14.280230+0000","last_became_peered":"2024-09-15T22:14:14.280230+0000","last_unstale":"2024-09-15T22:14:17.673188+0000","last_undegraded":"2024-09-15T22:14:17.673188+0000","last_fullsized":"2024-09-15T22:14:17.673188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:47.531799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980836+0000","last_change":"2024-09-15T22:14:06.805575+0000","last_active":"2024-09-15T22:14:17.980836+0000","last_peered":"2024-09-15T22:14:17.980836+0000","last_clean":"2024-09-15T22:14:17.980836+0000","last_became_active":"2024-09-15T22:14:06.804515+0000","last_became_peered":"2024-09-15T22:14:06.804515+0000","last_unstale":"2024-09-15T22:14:17.980836+0000","last_undegraded":"2024-09-15T22:14:17.980836+0000","last_fullsized":"2024-09-15T22:14:17.980836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.560964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799765+0000","last_change":"2024-09-15T22:14:04.717221+0000","last_active":"2024-09-15T22:14:17.799765+0000","last_peered":"2024-09-15T22:14:17.799765+0000","last_clean":"2024-09-15T22:14:17.799765+0000","last_became_active":"2024-09-15T22:14:04.716845+0000","last_became_peered":"2024-09-15T22:14:04.716845+0000","last_unstale":"2024-09-15T22:14:17.799765+0000","last_undegraded":"2024-09-15T22:14:17.799765+0000","last_fullsized":"2024-09-15T22:14:17.799765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.073229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673305+0000","last_change":"2024-09-15T22:14:13.847822+0000","last_active":"2024-09-15T22:14:17.673305+0000","last_peered":"2024-09-15T22:14:17.673305+0000","last_clean":"2024-09-15T22:14:17.673305+0000","last_became_active":"2024-09-15T22:14:13.847332+0000","last_became_peered":"2024-09-15T22:14:13.847332+0000","last_unstale":"2024-09-15T22:14:17.673305+0000","last_undegraded":"2024-09-15T22:14:17.673305+0000","last_fullsized":"2024-09-15T22:14:17.673305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:18.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193127+0000","last_change":"2024-09-15T22:14:06.814033+0000","last_active":"2024-09-15T22:14:17.193127+0000","last_peered":"2024-09-15T22:14:17.193127+0000","last_clean":"2024-09-15T22:14:17.193127+0000","last_became_active":"2024-09-15T22:14:06.813458+0000","last_became_peered":"2024-09-15T22:14:06.813458+0000","last_unstale":"2024-09-15T22:14:17.193127+0000","last_undegraded":"2024-09-15T22:14:17.193127+0000","last_fullsized":"2024-09-15T22:14:17.193127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:16.484113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980817+0000","last_change":"2024-09-15T22:14:04.715797+0000","last_active":"2024-09-15T22:14:17.980817+0000","last_peered":"2024-09-15T22:14:17.980817+0000","last_clean":"2024-09-15T22:14:17.980817+0000","last_became_active":"2024-09-15T22:14:04.715478+0000","last_became_peered":"2024-09-15T22:14:04.715478+0000","last_unstale":"2024-09-15T22:14:17.980817+0000","last_undegraded":"2024-09-15T22:14:17.980817+0000","last_fullsized":"2024-09-15T22:14:17.980817+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:39.432873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100927+0000","last_change":"2024-09-15T22:14:13.853461+0000","last_active":"2024-09-15T22:14:17.100927+0000","last_peered":"2024-09-15T22:14:17.100927+0000","last_clean":"2024-09-15T22:14:17.100927+0000","last_became_active":"2024-09-15T22:14:13.852896+0000","last_became_peered":"2024-09-15T22:14:13.852896+0000","last_unstale":"2024-09-15T22:14:17.100927+0000","last_undegraded":"2024-09-15T22:14:17.100927+0000","last_fullsized":"2024-09-15T22:14:17.100927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:41.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846194+0000","last_change":"2024-09-15T22:14:06.814990+0000","last_active":"2024-09-15T22:14:16.846194+0000","last_peered":"2024-09-15T22:14:16.846194+0000","last_clean":"2024-09-15T22:14:16.846194+0000","last_became_active":"2024-09-15T22:14:06.814646+0000","last_became_peered":"2024-09-15T22:14:06.814646+0000","last_unstale":"2024-09-15T22:14:16.846194+0000","last_undegraded":"2024-09-15T22:14:16.846194+0000","last_fullsized":"2024-09-15T22:14:16.846194+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:04.717207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.158786+0000","last_change":"2024-09-15T22:14:05.017599+0000","last_active":"2024-09-15T22:14:17.158786+0000","last_peered":"2024-09-15T22:14:17.158786+0000","last_clean":"2024-09-15T22:14:17.158786+0000","last_became_active":"2024-09-15T22:14:05.017296+0000","last_became_peered":"2024-09-15T22:14:05.017296+0000","last_unstale":"2024-09-15T22:14:17.158786+0000","last_undegraded":"2024-09-15T22:14:17.158786+0000","last_fullsized":"2024-09-15T22:14:17.158786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:11.427372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673382+0000","last_change":"2024-09-15T22:14:14.281453+0000","last_active":"2024-09-15T22:14:17.673382+0000","last_peered":"2024-09-15T22:14:17.673382+0000","last_clean":"2024-09-15T22:14:17.673382+0000","last_became_active":"2024-09-15T22:14:14.280814+0000","last_became_peered":"2024-09-15T22:14:14.280814+0000","last_unstale":"2024-09-15T22:14:17.673382+0000","last_undegraded":"2024-09-15T22:14:17.673382+0000","last_fullsized":"2024-09-15T22:14:17.673382+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:43:40.890979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845393+0000","last_change":"2024-09-15T22:14:06.816619+0000","last_active":"2024-09-15T22:14:16.845393+0000","last_peered":"2024-09-15T22:14:16.845393+0000","last_clean":"2024-09-15T22:14:16.845393+0000","last_became_active":"2024-09-15T22:14:06.814421+0000","last_became_peered":"2024-09-15T22:14:06.814421+0000","last_unstale":"2024-09-15T22:14:16.845393+0000","last_undegraded":"2024-09-15T22:14:16.845393+0000","last_fullsized":"2024-09-15T22:14:16.845393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:00.329802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673565+0000","last_change":"2024-09-15T22:14:05.197752+0000","last_active":"2024-09-15T22:14:17.673565+0000","last_peered":"2024-09-15T22:14:17.673565+0000","last_clean":"2024-09-15T22:14:17.673565+0000","last_became_active":"2024-09-15T22:14:05.197399+0000","last_became_peered":"2024-09-15T22:14:05.197399+0000","last_unstale":"2024-09-15T22:14:17.673565+0000","last_undegraded":"2024-09-15T22:14:17.673565+0000","last_fullsized":"2024-09-15T22:14:17.673565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:19.781842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799751+0000","last_change":"2024-09-15T22:14:13.847474+0000","last_active":"2024-09-15T22:14:17.799751+0000","last_peered":"2024-09-15T22:14:17.799751+0000","last_clean":"2024-09-15T22:14:17.799751+0000","last_became_active":"2024-09-15T22:14:13.847032+0000","last_became_peered":"2024-09-15T22:14:13.847032+0000","last_unstale":"2024-09-15T22:14:17.799751+0000","last_undegraded":"2024-09-15T22:14:17.799751+0000","last_fullsized":"2024-09-15T22:14:17.799751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:21.049024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981050+0000","last_change":"2024-09-15T22:14:06.809104+0000","last_active":"2024-09-15T22:14:17.981050+0000","last_peered":"2024-09-15T22:14:17.981050+0000","last_clean":"2024-09-15T22:14:17.981050+0000","last_became_active":"2024-09-15T22:14:06.808735+0000","last_became_peered":"2024-09-15T22:14:06.808735+0000","last_unstale":"2024-09-15T22:14:17.981050+0000","last_undegraded":"2024-09-15T22:14:17.981050+0000","last_fullsized":"2024-09-15T22:14:17.981050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:46.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'6","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:53.818635+0000","last_change":"2024-09-15T22:14:04.712546+0000","last_active":"2024-09-15T22:14:53.818635+0000","last_peered":"2024-09-15T22:14:53.818635+0000","last_clean":"2024-09-15T22:14:53.818635+0000","last_became_active":"2024-09-15T22:14:04.712222+0000","last_became_peered":"2024-09-15T22:14:04.712222+0000","last_unstale":"2024-09-15T22:14:53.818635+0000","last_undegraded":"2024-09-15T22:14:53.818635+0000","last_fullsized":"2024-09-15T22:14:53.818635+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:00.993810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980486+0000","last_change":"2024-09-15T22:14:14.280905+0000","last_active":"2024-09-15T22:14:17.980486+0000","last_peered":"2024-09-15T22:14:17.980486+0000","last_clean":"2024-09-15T22:14:17.980486+0000","last_became_active":"2024-09-15T22:14:14.280368+0000","last_became_peered":"2024-09-15T22:14:14.280368+0000","last_unstale":"2024-09-15T22:14:17.980486+0000","last_undegraded":"2024-09-15T22:14:17.980486+0000","last_fullsized":"2024-09-15T22:14:17.980486+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:52.812589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925608+0000","last_change":"2024-09-15T22:14:06.816231+0000","last_active":"2024-09-15T22:14:17.925608+0000","last_peered":"2024-09-15T22:14:17.925608+0000","last_clean":"2024-09-15T22:14:17.925608+0000","last_became_active":"2024-09-15T22:14:06.815884+0000","last_became_peered":"2024-09-15T22:14:06.815884+0000","last_unstale":"2024-09-15T22:14:17.925608+0000","last_undegraded":"2024-09-15T22:14:17.925608+0000","last_fullsized":"2024-09-15T22:14:17.925608+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:30.076077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846814+0000","last_change":"2024-09-15T22:14:05.017745+0000","last_active":"2024-09-15T22:14:16.846814+0000","last_peered":"2024-09-15T22:14:16.846814+0000","last_clean":"2024-09-15T22:14:16.846814+0000","last_became_active":"2024-09-15T22:14:05.017064+0000","last_became_peered":"2024-09-15T22:14:05.017064+0000","last_unstale":"2024-09-15T22:14:16.846814+0000","last_undegraded":"2024-09-15T22:14:16.846814+0000","last_fullsized":"2024-09-15T22:14:16.846814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:44.038448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193190+0000","last_change":"2024-09-15T22:14:13.853195+0000","last_active":"2024-09-15T22:14:17.193190+0000","last_peered":"2024-09-15T22:14:17.193190+0000","last_clean":"2024-09-15T22:14:17.193190+0000","last_became_active":"2024-09-15T22:14:13.852803+0000","last_became_peered":"2024-09-15T22:14:13.852803+0000","last_unstale":"2024-09-15T22:14:17.193190+0000","last_undegraded":"2024-09-15T22:14:17.193190+0000","last_fullsized":"2024-09-15T22:14:17.193190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:20.737509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981413+0000","last_change":"2024-09-15T22:14:06.805448+0000","last_active":"2024-09-15T22:14:17.981413+0000","last_peered":"2024-09-15T22:14:17.981413+0000","last_clean":"2024-09-15T22:14:17.981413+0000","last_became_active":"2024-09-15T22:14:06.804965+0000","last_became_peered":"2024-09-15T22:14:06.804965+0000","last_unstale":"2024-09-15T22:14:17.981413+0000","last_undegraded":"2024-09-15T22:14:17.981413+0000","last_fullsized":"2024-09-15T22:14:17.981413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:29.831888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100799+0000","last_change":"2024-09-15T22:14:05.017438+0000","last_active":"2024-09-15T22:14:17.100799+0000","last_peered":"2024-09-15T22:14:17.100799+0000","last_clean":"2024-09-15T22:14:17.100799+0000","last_became_active":"2024-09-15T22:14:05.017050+0000","last_became_peered":"2024-09-15T22:14:05.017050+0000","last_unstale":"2024-09-15T22:14:17.100799+0000","last_undegraded":"2024-09-15T22:14:17.100799+0000","last_fullsized":"2024-09-15T22:14:17.100799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:35.608774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846309+0000","last_change":"2024-09-15T22:14:14.281096+0000","last_active":"2024-09-15T22:14:16.846309+0000","last_peered":"2024-09-15T22:14:16.846309+0000","last_clean":"2024-09-15T22:14:16.846309+0000","last_became_active":"2024-09-15T22:14:14.280381+0000","last_became_peered":"2024-09-15T22:14:14.280381+0000","last_unstale":"2024-09-15T22:14:16.846309+0000","last_undegraded":"2024-09-15T22:14:16.846309+0000","last_fullsized":"2024-09-15T22:14:16.846309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:44.686080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981252+0000","last_change":"2024-09-15T22:14:06.812046+0000","last_active":"2024-09-15T22:14:17.981252+0000","last_peered":"2024-09-15T22:14:17.981252+0000","last_clean":"2024-09-15T22:14:17.981252+0000","last_became_active":"2024-09-15T22:14:06.811721+0000","last_became_peered":"2024-09-15T22:14:06.811721+0000","last_unstale":"2024-09-15T22:14:17.981252+0000","last_undegraded":"2024-09-15T22:14:17.981252+0000","last_fullsized":"2024-09-15T22:14:17.981252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:13.244973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848584+0000","last_change":"2024-09-15T22:14:04.720940+0000","last_active":"2024-09-15T22:14:16.848584+0000","last_peered":"2024-09-15T22:14:16.848584+0000","last_clean":"2024-09-15T22:14:16.848584+0000","last_became_active":"2024-09-15T22:14:04.720624+0000","last_became_peered":"2024-09-15T22:14:04.720624+0000","last_unstale":"2024-09-15T22:14:16.848584+0000","last_undegraded":"2024-09-15T22:14:16.848584+0000","last_fullsized":"2024-09-15T22:14:16.848584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:29.823784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925466+0000","last_change":"2024-09-15T22:14:13.848882+0000","last_active":"2024-09-15T22:14:17.925466+0000","last_peered":"2024-09-15T22:14:17.925466+0000","last_clean":"2024-09-15T22:14:17.925466+0000","last_became_active":"2024-09-15T22:14:13.848512+0000","last_became_peered":"2024-09-15T22:14:13.848512+0000","last_unstale":"2024-09-15T22:14:17.925466+0000","last_undegraded":"2024-09-15T22:14:17.925466+0000","last_fullsized":"2024-09-15T22:14:17.925466+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:44.050344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981511+0000","last_change":"2024-09-15T22:14:06.813915+0000","last_active":"2024-09-15T22:14:17.981511+0000","last_peered":"2024-09-15T22:14:17.981511+0000","last_clean":"2024-09-15T22:14:17.981511+0000","last_became_active":"2024-09-15T22:14:06.811803+0000","last_became_peered":"2024-09-15T22:14:06.811803+0000","last_unstale":"2024-09-15T22:14:17.981511+0000","last_undegraded":"2024-09-15T22:14:17.981511+0000","last_fullsized":"2024-09-15T22:14:17.981511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:42.117747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925236+0000","last_change":"2024-09-15T22:14:05.017360+0000","last_active":"2024-09-15T22:14:17.925236+0000","last_peered":"2024-09-15T22:14:17.925236+0000","last_clean":"2024-09-15T22:14:17.925236+0000","last_became_active":"2024-09-15T22:14:05.017004+0000","last_became_peered":"2024-09-15T22:14:05.017004+0000","last_unstale":"2024-09-15T22:14:17.925236+0000","last_undegraded":"2024-09-15T22:14:17.925236+0000","last_fullsized":"2024-09-15T22:14:17.925236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:01.366513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925719+0000","last_change":"2024-09-15T22:14:14.280215+0000","last_active":"2024-09-15T22:14:17.925719+0000","last_peered":"2024-09-15T22:14:17.925719+0000","last_clean":"2024-09-15T22:14:17.925719+0000","last_became_active":"2024-09-15T22:14:14.279750+0000","last_became_peered":"2024-09-15T22:14:14.279750+0000","last_unstale":"2024-09-15T22:14:17.925719+0000","last_undegraded":"2024-09-15T22:14:17.925719+0000","last_fullsized":"2024-09-15T22:14:17.925719+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:58.827582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925110+0000","last_change":"2024-09-15T22:14:06.812410+0000","last_active":"2024-09-15T22:14:17.925110+0000","last_peered":"2024-09-15T22:14:17.925110+0000","last_clean":"2024-09-15T22:14:17.925110+0000","last_became_active":"2024-09-15T22:14:06.812032+0000","last_became_peered":"2024-09-15T22:14:06.812032+0000","last_unstale":"2024-09-15T22:14:17.925110+0000","last_undegraded":"2024-09-15T22:14:17.925110+0000","last_fullsized":"2024-09-15T22:14:17.925110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:48.100213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848382+0000","last_change":"2024-09-15T22:14:04.719678+0000","last_active":"2024-09-15T22:14:16.848382+0000","last_peered":"2024-09-15T22:14:16.848382+0000","last_clean":"2024-09-15T22:14:16.848382+0000","last_became_active":"2024-09-15T22:14:04.719352+0000","last_became_peered":"2024-09-15T22:14:04.719352+0000","last_unstale":"2024-09-15T22:14:16.848382+0000","last_undegraded":"2024-09-15T22:14:16.848382+0000","last_fullsized":"2024-09-15T22:14:16.848382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.061957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.982002+0000","last_change":"2024-09-15T22:14:14.281314+0000","last_active":"2024-09-15T22:14:17.982002+0000","last_peered":"2024-09-15T22:14:17.982002+0000","last_clean":"2024-09-15T22:14:17.982002+0000","last_became_active":"2024-09-15T22:14:14.280859+0000","last_became_peered":"2024-09-15T22:14:14.280859+0000","last_unstale":"2024-09-15T22:14:17.982002+0000","last_undegraded":"2024-09-15T22:14:17.982002+0000","last_fullsized":"2024-09-15T22:14:17.982002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:18.796767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980738+0000","last_change":"2024-09-15T22:14:06.807101+0000","last_active":"2024-09-15T22:14:17.980738+0000","last_peered":"2024-09-15T22:14:17.980738+0000","last_clean":"2024-09-15T22:14:17.980738+0000","last_became_active":"2024-09-15T22:14:06.806801+0000","last_became_peered":"2024-09-15T22:14:06.806801+0000","last_unstale":"2024-09-15T22:14:17.980738+0000","last_undegraded":"2024-09-15T22:14:17.980738+0000","last_fullsized":"2024-09-15T22:14:17.980738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:48.096428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673321+0000","last_change":"2024-09-15T22:14:04.718038+0000","last_active":"2024-09-15T22:14:17.673321+0000","last_peered":"2024-09-15T22:14:17.673321+0000","last_clean":"2024-09-15T22:14:17.673321+0000","last_became_active":"2024-09-15T22:14:04.717683+0000","last_became_peered":"2024-09-15T22:14:04.717683+0000","last_unstale":"2024-09-15T22:14:17.673321+0000","last_undegraded":"2024-09-15T22:14:17.673321+0000","last_fullsized":"2024-09-15T22:14:17.673321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:23.557077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":353,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848614+0000","last_change":"2024-09-15T22:12:55.022635+0000","last_active":"2024-09-15T22:14:16.848614+0000","last_peered":"2024-09-15T22:14:16.848614+0000","last_clean":"2024-09-15T22:14:16.848614+0000","last_became_active":"2024-09-15T22:12:55.022132+0000","last_became_peered":"2024-09-15T22:12:55.022132+0000","last_unstale":"2024-09-15T22:14:16.848614+0000","last_undegraded":"2024-09-15T22:14:16.848614+0000","last_fullsized":"2024-09-15T22:14:16.848614+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_clean_scrub_stamp":"2024-09-15T22:09:30.115505+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:50.060169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848908+0000","last_change":"2024-09-15T22:14:13.849547+0000","last_active":"2024-09-15T22:14:16.848908+0000","last_peered":"2024-09-15T22:14:16.848908+0000","last_clean":"2024-09-15T22:14:16.848908+0000","last_became_active":"2024-09-15T22:14:13.849091+0000","last_became_peered":"2024-09-15T22:14:13.849091+0000","last_unstale":"2024-09-15T22:14:16.848908+0000","last_undegraded":"2024-09-15T22:14:16.848908+0000","last_fullsized":"2024-09-15T22:14:16.848908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:49.450958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848973+0000","last_change":"2024-09-15T22:14:06.816340+0000","last_active":"2024-09-15T22:14:16.848973+0000","last_peered":"2024-09-15T22:14:16.848973+0000","last_clean":"2024-09-15T22:14:16.848973+0000","last_became_active":"2024-09-15T22:14:06.815712+0000","last_became_peered":"2024-09-15T22:14:06.815712+0000","last_unstale":"2024-09-15T22:14:16.848973+0000","last_undegraded":"2024-09-15T22:14:16.848973+0000","last_fullsized":"2024-09-15T22:14:16.848973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:43.598512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799897+0000","last_change":"2024-09-15T22:14:05.197487+0000","last_active":"2024-09-15T22:14:17.799897+0000","last_peered":"2024-09-15T22:14:17.799897+0000","last_clean":"2024-09-15T22:14:17.799897+0000","last_became_active":"2024-09-15T22:14:05.197098+0000","last_became_peered":"2024-09-15T22:14:05.197098+0000","last_unstale":"2024-09-15T22:14:17.799897+0000","last_undegraded":"2024-09-15T22:14:17.799897+0000","last_fullsized":"2024-09-15T22:14:17.799897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:31.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.158919+0000","last_change":"2024-09-15T22:14:13.849594+0000","last_active":"2024-09-15T22:14:17.158919+0000","last_peered":"2024-09-15T22:14:17.158919+0000","last_clean":"2024-09-15T22:14:17.158919+0000","last_became_active":"2024-09-15T22:14:13.849157+0000","last_became_peered":"2024-09-15T22:14:13.849157+0000","last_unstale":"2024-09-15T22:14:17.158919+0000","last_undegraded":"2024-09-15T22:14:17.158919+0000","last_fullsized":"2024-09-15T22:14:17.158919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:49.994107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848773+0000","last_change":"2024-09-15T22:14:06.814312+0000","last_active":"2024-09-15T22:14:16.848773+0000","last_peered":"2024-09-15T22:14:16.848773+0000","last_clean":"2024-09-15T22:14:16.848773+0000","last_became_active":"2024-09-15T22:14:06.813959+0000","last_became_peered":"2024-09-15T22:14:06.813959+0000","last_unstale":"2024-09-15T22:14:16.848773+0000","last_undegraded":"2024-09-15T22:14:16.848773+0000","last_fullsized":"2024-09-15T22:14:16.848773+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:36.924162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.982195+0000","last_change":"2024-09-15T22:14:04.713307+0000","last_active":"2024-09-15T22:14:17.982195+0000","last_peered":"2024-09-15T22:14:17.982195+0000","last_clean":"2024-09-15T22:14:17.982195+0000","last_became_active":"2024-09-15T22:14:04.712996+0000","last_became_peered":"2024-09-15T22:14:04.712996+0000","last_unstale":"2024-09-15T22:14:17.982195+0000","last_undegraded":"2024-09-15T22:14:17.982195+0000","last_fullsized":"2024-09-15T22:14:17.982195+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:37.298679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845274+0000","last_change":"2024-09-15T22:14:13.846087+0000","last_active":"2024-09-15T22:14:16.845274+0000","last_peered":"2024-09-15T22:14:16.845274+0000","last_clean":"2024-09-15T22:14:16.845274+0000","last_became_active":"2024-09-15T22:14:13.845731+0000","last_became_peered":"2024-09-15T22:14:13.845731+0000","last_unstale":"2024-09-15T22:14:16.845274+0000","last_undegraded":"2024-09-15T22:14:16.845274+0000","last_fullsized":"2024-09-15T22:14:16.845274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:24.621330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848886+0000","last_change":"2024-09-15T22:14:06.809456+0000","last_active":"2024-09-15T22:14:16.848886+0000","last_peered":"2024-09-15T22:14:16.848886+0000","last_clean":"2024-09-15T22:14:16.848886+0000","last_became_active":"2024-09-15T22:14:06.809141+0000","last_became_peered":"2024-09-15T22:14:06.809141+0000","last_unstale":"2024-09-15T22:14:16.848886+0000","last_undegraded":"2024-09-15T22:14:16.848886+0000","last_fullsized":"2024-09-15T22:14:16.848886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:30.186800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925763+0000","last_change":"2024-09-15T22:14:04.715399+0000","last_active":"2024-09-15T22:14:17.925763+0000","last_peered":"2024-09-15T22:14:17.925763+0000","last_clean":"2024-09-15T22:14:17.925763+0000","last_became_active":"2024-09-15T22:14:04.715043+0000","last_became_peered":"2024-09-15T22:14:04.715043+0000","last_unstale":"2024-09-15T22:14:17.925763+0000","last_undegraded":"2024-09-15T22:14:17.925763+0000","last_fullsized":"2024-09-15T22:14:17.925763+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:13.860413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981239+0000","last_change":"2024-09-15T22:14:13.851594+0000","last_active":"2024-09-15T22:14:17.981239+0000","last_peered":"2024-09-15T22:14:17.981239+0000","last_clean":"2024-09-15T22:14:17.981239+0000","last_became_active":"2024-09-15T22:14:13.851154+0000","last_became_peered":"2024-09-15T22:14:13.851154+0000","last_unstale":"2024-09-15T22:14:17.981239+0000","last_undegraded":"2024-09-15T22:14:17.981239+0000","last_fullsized":"2024-09-15T22:14:17.981239+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:43.343808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193476+0000","last_change":"2024-09-15T22:14:06.817281+0000","last_active":"2024-09-15T22:14:17.193476+0000","last_peered":"2024-09-15T22:14:17.193476+0000","last_clean":"2024-09-15T22:14:17.193476+0000","last_became_active":"2024-09-15T22:14:06.816936+0000","last_became_peered":"2024-09-15T22:14:06.816936+0000","last_unstale":"2024-09-15T22:14:17.193476+0000","last_undegraded":"2024-09-15T22:14:17.193476+0000","last_fullsized":"2024-09-15T22:14:17.193476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:40.049677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846794+0000","last_change":"2024-09-15T22:14:04.719550+0000","last_active":"2024-09-15T22:14:16.846794+0000","last_peered":"2024-09-15T22:14:16.846794+0000","last_clean":"2024-09-15T22:14:16.846794+0000","last_became_active":"2024-09-15T22:14:04.719273+0000","last_became_peered":"2024-09-15T22:14:04.719273+0000","last_unstale":"2024-09-15T22:14:16.846794+0000","last_undegraded":"2024-09-15T22:14:16.846794+0000","last_fullsized":"2024-09-15T22:14:16.846794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:20.973615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981357+0000","last_change":"2024-09-15T22:14:13.851420+0000","last_active":"2024-09-15T22:14:17.981357+0000","last_peered":"2024-09-15T22:14:17.981357+0000","last_clean":"2024-09-15T22:14:17.981357+0000","last_became_active":"2024-09-15T22:14:13.851051+0000","last_became_peered":"2024-09-15T22:14:13.851051+0000","last_unstale":"2024-09-15T22:14:17.981357+0000","last_undegraded":"2024-09-15T22:14:17.981357+0000","last_fullsized":"2024-09-15T22:14:17.981357+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:11.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981520+0000","last_change":"2024-09-15T22:14:06.809609+0000","last_active":"2024-09-15T22:14:17.981520+0000","last_peered":"2024-09-15T22:14:17.981520+0000","last_clean":"2024-09-15T22:14:17.981520+0000","last_became_active":"2024-09-15T22:14:06.809213+0000","last_became_peered":"2024-09-15T22:14:06.809213+0000","last_unstale":"2024-09-15T22:14:17.981520+0000","last_undegraded":"2024-09-15T22:14:17.981520+0000","last_fullsized":"2024-09-15T22:14:17.981520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:11.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846277+0000","last_change":"2024-09-15T22:14:05.017559+0000","last_active":"2024-09-15T22:14:16.846277+0000","last_peered":"2024-09-15T22:14:16.846277+0000","last_clean":"2024-09-15T22:14:16.846277+0000","last_became_active":"2024-09-15T22:14:05.017121+0000","last_became_peered":"2024-09-15T22:14:05.017121+0000","last_unstale":"2024-09-15T22:14:16.846277+0000","last_undegraded":"2024-09-15T22:14:16.846277+0000","last_fullsized":"2024-09-15T22:14:16.846277+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:29:06.442532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925817+0000","last_change":"2024-09-15T22:14:13.847835+0000","last_active":"2024-09-15T22:14:17.925817+0000","last_peered":"2024-09-15T22:14:17.925817+0000","last_clean":"2024-09-15T22:14:17.925817+0000","last_became_active":"2024-09-15T22:14:13.847437+0000","last_became_peered":"2024-09-15T22:14:13.847437+0000","last_unstale":"2024-09-15T22:14:17.925817+0000","last_undegraded":"2024-09-15T22:14:17.925817+0000","last_fullsized":"2024-09-15T22:14:17.925817+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:48.036495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848310+0000","last_change":"2024-09-15T22:14:06.813191+0000","last_active":"2024-09-15T22:14:16.848310+0000","last_peered":"2024-09-15T22:14:16.848310+0000","last_clean":"2024-09-15T22:14:16.848310+0000","last_became_active":"2024-09-15T22:14:06.812861+0000","last_became_peered":"2024-09-15T22:14:06.812861+0000","last_unstale":"2024-09-15T22:14:16.848310+0000","last_undegraded":"2024-09-15T22:14:16.848310+0000","last_fullsized":"2024-09-15T22:14:16.848310+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:51.487591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673098+0000","last_change":"2024-09-15T22:14:04.718431+0000","last_active":"2024-09-15T22:14:17.673098+0000","last_peered":"2024-09-15T22:14:17.673098+0000","last_clean":"2024-09-15T22:14:17.673098+0000","last_became_active":"2024-09-15T22:14:04.718109+0000","last_became_peered":"2024-09-15T22:14:04.718109+0000","last_unstale":"2024-09-15T22:14:17.673098+0000","last_undegraded":"2024-09-15T22:14:17.673098+0000","last_fullsized":"2024-09-15T22:14:17.673098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:10.408634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100939+0000","last_change":"2024-09-15T22:14:13.845179+0000","last_active":"2024-09-15T22:14:17.100939+0000","last_peered":"2024-09-15T22:14:17.100939+0000","last_clean":"2024-09-15T22:14:17.100939+0000","last_became_active":"2024-09-15T22:14:13.844795+0000","last_became_peered":"2024-09-15T22:14:13.844795+0000","last_unstale":"2024-09-15T22:14:17.100939+0000","last_undegraded":"2024-09-15T22:14:17.100939+0000","last_fullsized":"2024-09-15T22:14:17.100939+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:24.113536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848583+0000","last_change":"2024-09-15T22:14:06.809687+0000","last_active":"2024-09-15T22:14:16.848583+0000","last_peered":"2024-09-15T22:14:16.848583+0000","last_clean":"2024-09-15T22:14:16.848583+0000","last_became_active":"2024-09-15T22:14:06.809383+0000","last_became_peered":"2024-09-15T22:14:06.809383+0000","last_unstale":"2024-09-15T22:14:16.848583+0000","last_undegraded":"2024-09-15T22:14:16.848583+0000","last_fullsized":"2024-09-15T22:14:16.848583+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:19.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981650+0000","last_change":"2024-09-15T22:14:04.720577+0000","last_active":"2024-09-15T22:14:17.981650+0000","last_peered":"2024-09-15T22:14:17.981650+0000","last_clean":"2024-09-15T22:14:17.981650+0000","last_became_active":"2024-09-15T22:14:04.720235+0000","last_became_peered":"2024-09-15T22:14:04.720235+0000","last_unstale":"2024-09-15T22:14:17.981650+0000","last_undegraded":"2024-09-15T22:14:17.981650+0000","last_fullsized":"2024-09-15T22:14:17.981650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:17.501061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193223+0000","last_change":"2024-09-15T22:14:13.854841+0000","last_active":"2024-09-15T22:14:17.193223+0000","last_peered":"2024-09-15T22:14:17.193223+0000","last_clean":"2024-09-15T22:14:17.193223+0000","last_became_active":"2024-09-15T22:14:13.854336+0000","last_became_peered":"2024-09-15T22:14:13.854336+0000","last_unstale":"2024-09-15T22:14:17.193223+0000","last_undegraded":"2024-09-15T22:14:17.193223+0000","last_fullsized":"2024-09-15T22:14:17.193223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:13.819532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925270+0000","last_change":"2024-09-15T22:14:06.806829+0000","last_active":"2024-09-15T22:14:17.925270+0000","last_peered":"2024-09-15T22:14:17.925270+0000","last_clean":"2024-09-15T22:14:17.925270+0000","last_became_active":"2024-09-15T22:14:06.806521+0000","last_became_peered":"2024-09-15T22:14:06.806521+0000","last_unstale":"2024-09-15T22:14:17.925270+0000","last_undegraded":"2024-09-15T22:14:17.925270+0000","last_fullsized":"2024-09-15T22:14:17.925270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:50.983246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799818+0000","last_change":"2024-09-15T22:14:04.717722+0000","last_active":"2024-09-15T22:14:17.799818+0000","last_peered":"2024-09-15T22:14:17.799818+0000","last_clean":"2024-09-15T22:14:17.799818+0000","last_became_active":"2024-09-15T22:14:04.717201+0000","last_became_peered":"2024-09-15T22:14:04.717201+0000","last_unstale":"2024-09-15T22:14:17.799818+0000","last_undegraded":"2024-09-15T22:14:17.799818+0000","last_fullsized":"2024-09-15T22:14:17.799818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:50.545847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981979+0000","last_change":"2024-09-15T22:14:13.852874+0000","last_active":"2024-09-15T22:14:17.981979+0000","last_peered":"2024-09-15T22:14:17.981979+0000","last_clean":"2024-09-15T22:14:17.981979+0000","last_became_active":"2024-09-15T22:14:13.852426+0000","last_became_peered":"2024-09-15T22:14:13.852426+0000","last_unstale":"2024-09-15T22:14:17.981979+0000","last_undegraded":"2024-09-15T22:14:17.981979+0000","last_fullsized":"2024-09-15T22:14:17.981979+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:02:19.215156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846682+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:14:16.846682+0000","last_peered":"2024-09-15T22:14:16.846682+0000","last_clean":"2024-09-15T22:14:16.846682+0000","last_became_active":"2024-09-15T22:14:06.809013+0000","last_became_peered":"2024-09-15T22:14:06.809013+0000","last_unstale":"2024-09-15T22:14:16.846682+0000","last_undegraded":"2024-09-15T22:14:16.846682+0000","last_fullsized":"2024-09-15T22:14:16.846682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:47.830385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'23","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:55.956879+0000","last_change":"2024-09-15T22:14:04.721020+0000","last_active":"2024-09-15T22:14:55.956879+0000","last_peered":"2024-09-15T22:14:55.956879+0000","last_clean":"2024-09-15T22:14:55.956879+0000","last_became_active":"2024-09-15T22:14:04.720613+0000","last_became_peered":"2024-09-15T22:14:04.720613+0000","last_unstale":"2024-09-15T22:14:55.956879+0000","last_undegraded":"2024-09-15T22:14:55.956879+0000","last_fullsized":"2024-09-15T22:14:55.956879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:42.719346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43345,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":58,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100547+0000","last_change":"2024-09-15T22:14:13.854250+0000","last_active":"2024-09-15T22:14:17.100547+0000","last_peered":"2024-09-15T22:14:17.100547+0000","last_clean":"2024-09-15T22:14:17.100547+0000","last_became_active":"2024-09-15T22:14:13.852972+0000","last_became_peered":"2024-09-15T22:14:13.852972+0000","last_unstale":"2024-09-15T22:14:17.100547+0000","last_undegraded":"2024-09-15T22:14:17.100547+0000","last_fullsized":"2024-09-15T22:14:17.100547+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:50:45.301446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.159052+0000","last_change":"2024-09-15T22:14:06.813789+0000","last_active":"2024-09-15T22:14:17.159052+0000","last_peered":"2024-09-15T22:14:17.159052+0000","last_clean":"2024-09-15T22:14:17.159052+0000","last_became_active":"2024-09-15T22:14:06.813501+0000","last_became_peered":"2024-09-15T22:14:06.813501+0000","last_unstale":"2024-09-15T22:14:17.159052+0000","last_undegraded":"2024-09-15T22:14:17.159052+0000","last_fullsized":"2024-09-15T22:14:17.159052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:40.032952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.982127+0000","last_change":"2024-09-15T22:14:05.018957+0000","last_active":"2024-09-15T22:14:17.982127+0000","last_peered":"2024-09-15T22:14:17.982127+0000","last_clean":"2024-09-15T22:14:17.982127+0000","last_became_active":"2024-09-15T22:14:05.018602+0000","last_became_peered":"2024-09-15T22:14:05.018602+0000","last_unstale":"2024-09-15T22:14:17.982127+0000","last_undegraded":"2024-09-15T22:14:17.982127+0000","last_fullsized":"2024-09-15T22:14:17.982127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:48.839341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673193+0000","last_change":"2024-09-15T22:14:13.848666+0000","last_active":"2024-09-15T22:14:17.673193+0000","last_peered":"2024-09-15T22:14:17.673193+0000","last_clean":"2024-09-15T22:14:17.673193+0000","last_became_active":"2024-09-15T22:14:13.848202+0000","last_became_peered":"2024-09-15T22:14:13.848202+0000","last_unstale":"2024-09-15T22:14:17.673193+0000","last_undegraded":"2024-09-15T22:14:17.673193+0000","last_fullsized":"2024-09-15T22:14:17.673193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:15.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845650+0000","last_change":"2024-09-15T22:14:06.814876+0000","last_active":"2024-09-15T22:14:16.845650+0000","last_peered":"2024-09-15T22:14:16.845650+0000","last_clean":"2024-09-15T22:14:16.845650+0000","last_became_active":"2024-09-15T22:14:06.814120+0000","last_became_peered":"2024-09-15T22:14:06.814120+0000","last_unstale":"2024-09-15T22:14:16.845650+0000","last_undegraded":"2024-09-15T22:14:16.845650+0000","last_fullsized":"2024-09-15T22:14:16.845650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:37.417618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848901+0000","last_change":"2024-09-15T22:14:04.719281+0000","last_active":"2024-09-15T22:14:16.848901+0000","last_peered":"2024-09-15T22:14:16.848901+0000","last_clean":"2024-09-15T22:14:16.848901+0000","last_became_active":"2024-09-15T22:14:04.718856+0000","last_became_peered":"2024-09-15T22:14:04.718856+0000","last_unstale":"2024-09-15T22:14:16.848901+0000","last_undegraded":"2024-09-15T22:14:16.848901+0000","last_fullsized":"2024-09-15T22:14:16.848901+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:22.137825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100405+0000","last_change":"2024-09-15T22:14:13.847398+0000","last_active":"2024-09-15T22:14:17.100405+0000","last_peered":"2024-09-15T22:14:17.100405+0000","last_clean":"2024-09-15T22:14:17.100405+0000","last_became_active":"2024-09-15T22:14:13.846870+0000","last_became_peered":"2024-09-15T22:14:13.846870+0000","last_unstale":"2024-09-15T22:14:17.100405+0000","last_undegraded":"2024-09-15T22:14:17.100405+0000","last_fullsized":"2024-09-15T22:14:17.100405+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:58.872716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.159318+0000","last_change":"2024-09-15T22:14:06.810412+0000","last_active":"2024-09-15T22:14:17.159318+0000","last_peered":"2024-09-15T22:14:17.159318+0000","last_clean":"2024-09-15T22:14:17.159318+0000","last_became_active":"2024-09-15T22:14:06.809669+0000","last_became_peered":"2024-09-15T22:14:06.809669+0000","last_unstale":"2024-09-15T22:14:17.159318+0000","last_undegraded":"2024-09-15T22:14:17.159318+0000","last_fullsized":"2024-09-15T22:14:17.159318+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:44.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981333+0000","last_change":"2024-09-15T22:14:04.715509+0000","last_active":"2024-09-15T22:14:17.981333+0000","last_peered":"2024-09-15T22:14:17.981333+0000","last_clean":"2024-09-15T22:14:17.981333+0000","last_became_active":"2024-09-15T22:14:04.715169+0000","last_became_peered":"2024-09-15T22:14:04.715169+0000","last_unstale":"2024-09-15T22:14:17.981333+0000","last_undegraded":"2024-09-15T22:14:17.981333+0000","last_fullsized":"2024-09-15T22:14:17.981333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:21.884103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980982+0000","last_change":"2024-09-15T22:14:13.849616+0000","last_active":"2024-09-15T22:14:17.980982+0000","last_peered":"2024-09-15T22:14:17.980982+0000","last_clean":"2024-09-15T22:14:17.980982+0000","last_became_active":"2024-09-15T22:14:13.849246+0000","last_became_peered":"2024-09-15T22:14:13.849246+0000","last_unstale":"2024-09-15T22:14:17.980982+0000","last_undegraded":"2024-09-15T22:14:17.980982+0000","last_fullsized":"2024-09-15T22:14:17.980982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:45.404227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845232+0000","last_change":"2024-09-15T22:14:13.844375+0000","last_active":"2024-09-15T22:14:16.845232+0000","last_peered":"2024-09-15T22:14:16.845232+0000","last_clean":"2024-09-15T22:14:16.845232+0000","last_became_active":"2024-09-15T22:14:13.843918+0000","last_became_peered":"2024-09-15T22:14:13.843918+0000","last_unstale":"2024-09-15T22:14:16.845232+0000","last_undegraded":"2024-09-15T22:14:16.845232+0000","last_fullsized":"2024-09-15T22:14:16.845232+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:32.190119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100520+0000","last_change":"2024-09-15T22:14:06.809534+0000","last_active":"2024-09-15T22:14:17.100520+0000","last_peered":"2024-09-15T22:14:17.100520+0000","last_clean":"2024-09-15T22:14:17.100520+0000","last_became_active":"2024-09-15T22:14:06.809147+0000","last_became_peered":"2024-09-15T22:14:06.809147+0000","last_unstale":"2024-09-15T22:14:17.100520+0000","last_undegraded":"2024-09-15T22:14:17.100520+0000","last_fullsized":"2024-09-15T22:14:17.100520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:14.930542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981608+0000","last_change":"2024-09-15T22:14:04.715347+0000","last_active":"2024-09-15T22:14:17.981608+0000","last_peered":"2024-09-15T22:14:17.981608+0000","last_clean":"2024-09-15T22:14:17.981608+0000","last_became_active":"2024-09-15T22:14:04.715049+0000","last_became_peered":"2024-09-15T22:14:04.715049+0000","last_unstale":"2024-09-15T22:14:17.981608+0000","last_undegraded":"2024-09-15T22:14:17.981608+0000","last_fullsized":"2024-09-15T22:14:17.981608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:04.943344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193552+0000","last_change":"2024-09-15T22:14:13.852397+0000","last_active":"2024-09-15T22:14:17.193552+0000","last_peered":"2024-09-15T22:14:17.193552+0000","last_clean":"2024-09-15T22:14:17.193552+0000","last_became_active":"2024-09-15T22:14:13.851863+0000","last_became_peered":"2024-09-15T22:14:13.851863+0000","last_unstale":"2024-09-15T22:14:17.193552+0000","last_undegraded":"2024-09-15T22:14:17.193552+0000","last_fullsized":"2024-09-15T22:14:17.193552+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:38.242241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980592+0000","last_change":"2024-09-15T22:14:06.809084+0000","last_active":"2024-09-15T22:14:17.980592+0000","last_peered":"2024-09-15T22:14:17.980592+0000","last_clean":"2024-09-15T22:14:17.980592+0000","last_became_active":"2024-09-15T22:14:06.808725+0000","last_became_peered":"2024-09-15T22:14:06.808725+0000","last_unstale":"2024-09-15T22:14:17.980592+0000","last_undegraded":"2024-09-15T22:14:17.980592+0000","last_fullsized":"2024-09-15T22:14:17.980592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:37.451661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925119+0000","last_change":"2024-09-15T22:14:04.714279+0000","last_active":"2024-09-15T22:14:17.925119+0000","last_peered":"2024-09-15T22:14:17.925119+0000","last_clean":"2024-09-15T22:14:17.925119+0000","last_became_active":"2024-09-15T22:14:04.713751+0000","last_became_peered":"2024-09-15T22:14:04.713751+0000","last_unstale":"2024-09-15T22:14:17.925119+0000","last_undegraded":"2024-09-15T22:14:17.925119+0000","last_fullsized":"2024-09-15T22:14:17.925119+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:34.268701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981221+0000","last_change":"2024-09-15T22:14:04.716417+0000","last_active":"2024-09-15T22:14:17.981221+0000","last_peered":"2024-09-15T22:14:17.981221+0000","last_clean":"2024-09-15T22:14:17.981221+0000","last_became_active":"2024-09-15T22:14:04.716096+0000","last_became_peered":"2024-09-15T22:14:04.716096+0000","last_unstale":"2024-09-15T22:14:17.981221+0000","last_undegraded":"2024-09-15T22:14:17.981221+0000","last_fullsized":"2024-09-15T22:14:17.981221+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:30.819060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981765+0000","last_change":"2024-09-15T22:14:06.810505+0000","last_active":"2024-09-15T22:14:17.981765+0000","last_peered":"2024-09-15T22:14:17.981765+0000","last_clean":"2024-09-15T22:14:17.981765+0000","last_became_active":"2024-09-15T22:14:06.810190+0000","last_became_peered":"2024-09-15T22:14:06.810190+0000","last_unstale":"2024-09-15T22:14:17.981765+0000","last_undegraded":"2024-09-15T22:14:17.981765+0000","last_fullsized":"2024-09-15T22:14:17.981765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:00:40.708454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799646+0000","last_change":"2024-09-15T22:14:13.851371+0000","last_active":"2024-09-15T22:14:17.799646+0000","last_peered":"2024-09-15T22:14:17.799646+0000","last_clean":"2024-09-15T22:14:17.799646+0000","last_became_active":"2024-09-15T22:14:13.850976+0000","last_became_peered":"2024-09-15T22:14:13.850976+0000","last_unstale":"2024-09-15T22:14:17.799646+0000","last_undegraded":"2024-09-15T22:14:17.799646+0000","last_fullsized":"2024-09-15T22:14:17.799646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:28.779584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981837+0000","last_change":"2024-09-15T22:14:04.718682+0000","last_active":"2024-09-15T22:14:17.981837+0000","last_peered":"2024-09-15T22:14:17.981837+0000","last_clean":"2024-09-15T22:14:17.981837+0000","last_became_active":"2024-09-15T22:14:04.718313+0000","last_became_peered":"2024-09-15T22:14:04.718313+0000","last_unstale":"2024-09-15T22:14:17.981837+0000","last_undegraded":"2024-09-15T22:14:17.981837+0000","last_fullsized":"2024-09-15T22:14:17.981837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:47.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846404+0000","last_change":"2024-09-15T22:14:06.819632+0000","last_active":"2024-09-15T22:14:16.846404+0000","last_peered":"2024-09-15T22:14:16.846404+0000","last_clean":"2024-09-15T22:14:16.846404+0000","last_became_active":"2024-09-15T22:14:06.819135+0000","last_became_peered":"2024-09-15T22:14:06.819135+0000","last_unstale":"2024-09-15T22:14:16.846404+0000","last_undegraded":"2024-09-15T22:14:16.846404+0000","last_fullsized":"2024-09-15T22:14:16.846404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:35.708318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799854+0000","last_change":"2024-09-15T22:14:13.851367+0000","last_active":"2024-09-15T22:14:17.799854+0000","last_peered":"2024-09-15T22:14:17.799854+0000","last_clean":"2024-09-15T22:14:17.799854+0000","last_became_active":"2024-09-15T22:14:13.850999+0000","last_became_peered":"2024-09-15T22:14:13.850999+0000","last_unstale":"2024-09-15T22:14:17.799854+0000","last_undegraded":"2024-09-15T22:14:17.799854+0000","last_fullsized":"2024-09-15T22:14:17.799854+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:40:03.957622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193039+0000","last_change":"2024-09-15T22:14:06.817213+0000","last_active":"2024-09-15T22:14:17.193039+0000","last_peered":"2024-09-15T22:14:17.193039+0000","last_clean":"2024-09-15T22:14:17.193039+0000","last_became_active":"2024-09-15T22:14:06.816828+0000","last_became_peered":"2024-09-15T22:14:06.816828+0000","last_unstale":"2024-09-15T22:14:17.193039+0000","last_undegraded":"2024-09-15T22:14:17.193039+0000","last_fullsized":"2024-09-15T22:14:17.193039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:55.042256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799809+0000","last_change":"2024-09-15T22:14:06.814832+0000","last_active":"2024-09-15T22:14:17.799809+0000","last_peered":"2024-09-15T22:14:17.799809+0000","last_clean":"2024-09-15T22:14:17.799809+0000","last_became_active":"2024-09-15T22:14:06.814500+0000","last_became_peered":"2024-09-15T22:14:06.814500+0000","last_unstale":"2024-09-15T22:14:17.799809+0000","last_undegraded":"2024-09-15T22:14:17.799809+0000","last_fullsized":"2024-09-15T22:14:17.799809+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:43.623629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799484+0000","last_change":"2024-09-15T22:14:06.809464+0000","last_active":"2024-09-15T22:14:17.799484+0000","last_peered":"2024-09-15T22:14:17.799484+0000","last_clean":"2024-09-15T22:14:17.799484+0000","last_became_active":"2024-09-15T22:14:06.809160+0000","last_became_peered":"2024-09-15T22:14:06.809160+0000","last_unstale":"2024-09-15T22:14:17.799484+0000","last_undegraded":"2024-09-15T22:14:17.799484+0000","last_fullsized":"2024-09-15T22:14:17.799484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:04.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845383+0000","last_change":"2024-09-15T22:14:06.814428+0000","last_active":"2024-09-15T22:14:16.845383+0000","last_peered":"2024-09-15T22:14:16.845383+0000","last_clean":"2024-09-15T22:14:16.845383+0000","last_became_active":"2024-09-15T22:14:06.814100+0000","last_became_peered":"2024-09-15T22:14:06.814100+0000","last_unstale":"2024-09-15T22:14:16.845383+0000","last_undegraded":"2024-09-15T22:14:16.845383+0000","last_fullsized":"2024-09-15T22:14:16.845383+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:33.606766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925569+0000","last_change":"2024-09-15T22:14:06.815638+0000","last_active":"2024-09-15T22:14:17.925569+0000","last_peered":"2024-09-15T22:14:17.925569+0000","last_clean":"2024-09-15T22:14:17.925569+0000","last_became_active":"2024-09-15T22:14:06.815327+0000","last_became_peered":"2024-09-15T22:14:06.815327+0000","last_unstale":"2024-09-15T22:14:17.925569+0000","last_undegraded":"2024-09-15T22:14:17.925569+0000","last_fullsized":"2024-09-15T22:14:17.925569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:07.679547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193434+0000","last_change":"2024-09-15T22:14:06.818629+0000","last_active":"2024-09-15T22:14:17.193434+0000","last_peered":"2024-09-15T22:14:17.193434+0000","last_clean":"2024-09-15T22:14:17.193434+0000","last_became_active":"2024-09-15T22:14:06.818315+0000","last_became_peered":"2024-09-15T22:14:06.818315+0000","last_unstale":"2024-09-15T22:14:17.193434+0000","last_undegraded":"2024-09-15T22:14:17.193434+0000","last_fullsized":"2024-09-15T22:14:17.193434+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:36.286343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.800050+0000","last_change":"2024-09-15T22:14:06.819667+0000","last_active":"2024-09-15T22:14:17.800050+0000","last_peered":"2024-09-15T22:14:17.800050+0000","last_clean":"2024-09-15T22:14:17.800050+0000","last_became_active":"2024-09-15T22:14:06.819389+0000","last_became_peered":"2024-09-15T22:14:06.819389+0000","last_unstale":"2024-09-15T22:14:17.800050+0000","last_undegraded":"2024-09-15T22:14:17.800050+0000","last_fullsized":"2024-09-15T22:14:17.800050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:16.571088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980949+0000","last_change":"2024-09-15T22:14:06.809927+0000","last_active":"2024-09-15T22:14:17.980949+0000","last_peered":"2024-09-15T22:14:17.980949+0000","last_clean":"2024-09-15T22:14:17.980949+0000","last_became_active":"2024-09-15T22:14:06.809633+0000","last_became_peered":"2024-09-15T22:14:06.809633+0000","last_unstale":"2024-09-15T22:14:17.980949+0000","last_undegraded":"2024-09-15T22:14:17.980949+0000","last_fullsized":"2024-09-15T22:14:17.980949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:12.428738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981363+0000","last_change":"2024-09-15T22:14:06.801454+0000","last_active":"2024-09-15T22:14:17.981363+0000","last_peered":"2024-09-15T22:14:17.981363+0000","last_clean":"2024-09-15T22:14:17.981363+0000","last_became_active":"2024-09-15T22:14:06.801105+0000","last_became_peered":"2024-09-15T22:14:06.801105+0000","last_unstale":"2024-09-15T22:14:17.981363+0000","last_undegraded":"2024-09-15T22:14:17.981363+0000","last_fullsized":"2024-09-15T22:14:17.981363+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:32.457428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980619+0000","last_change":"2024-09-15T22:14:06.812603+0000","last_active":"2024-09-15T22:14:17.980619+0000","last_peered":"2024-09-15T22:14:17.980619+0000","last_clean":"2024-09-15T22:14:17.980619+0000","last_became_active":"2024-09-15T22:14:06.812208+0000","last_became_peered":"2024-09-15T22:14:06.812208+0000","last_unstale":"2024-09-15T22:14:17.980619+0000","last_undegraded":"2024-09-15T22:14:17.980619+0000","last_fullsized":"2024-09-15T22:14:17.980619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:55.327481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.159017+0000","last_change":"2024-09-15T22:14:06.811783+0000","last_active":"2024-09-15T22:14:17.159017+0000","last_peered":"2024-09-15T22:14:17.159017+0000","last_clean":"2024-09-15T22:14:17.159017+0000","last_became_active":"2024-09-15T22:14:06.811208+0000","last_became_peered":"2024-09-15T22:14:06.811208+0000","last_unstale":"2024-09-15T22:14:17.159017+0000","last_undegraded":"2024-09-15T22:14:17.159017+0000","last_fullsized":"2024-09-15T22:14:17.159017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:15.576776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925425+0000","last_change":"2024-09-15T22:14:06.818608+0000","last_active":"2024-09-15T22:14:17.925425+0000","last_peered":"2024-09-15T22:14:17.925425+0000","last_clean":"2024-09-15T22:14:17.925425+0000","last_became_active":"2024-09-15T22:14:06.818283+0000","last_became_peered":"2024-09-15T22:14:06.818283+0000","last_unstale":"2024-09-15T22:14:17.925425+0000","last_undegraded":"2024-09-15T22:14:17.925425+0000","last_fullsized":"2024-09-15T22:14:17.925425+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:02.477461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193201+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:14:17.193201+0000","last_peered":"2024-09-15T22:14:17.193201+0000","last_clean":"2024-09-15T22:14:17.193201+0000","last_became_active":"2024-09-15T22:14:06.809043+0000","last_became_peered":"2024-09-15T22:14:06.809043+0000","last_unstale":"2024-09-15T22:14:17.193201+0000","last_undegraded":"2024-09-15T22:14:17.193201+0000","last_fullsized":"2024-09-15T22:14:17.193201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:58.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799999+0000","last_change":"2024-09-15T22:14:06.814875+0000","last_active":"2024-09-15T22:14:17.799999+0000","last_peered":"2024-09-15T22:14:17.799999+0000","last_clean":"2024-09-15T22:14:17.799999+0000","last_became_active":"2024-09-15T22:14:06.814543+0000","last_became_peered":"2024-09-15T22:14:06.814543+0000","last_unstale":"2024-09-15T22:14:17.799999+0000","last_undegraded":"2024-09-15T22:14:17.799999+0000","last_fullsized":"2024-09-15T22:14:17.799999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:57.465965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100919+0000","last_change":"2024-09-15T22:14:06.810655+0000","last_active":"2024-09-15T22:14:17.100919+0000","last_peered":"2024-09-15T22:14:17.100919+0000","last_clean":"2024-09-15T22:14:17.100919+0000","last_became_active":"2024-09-15T22:14:06.810159+0000","last_became_peered":"2024-09-15T22:14:06.810159+0000","last_unstale":"2024-09-15T22:14:17.100919+0000","last_undegraded":"2024-09-15T22:14:17.100919+0000","last_fullsized":"2024-09-15T22:14:17.100919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:17.368982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193687+0000","last_change":"2024-09-15T22:14:06.815048+0000","last_active":"2024-09-15T22:14:17.193687+0000","last_peered":"2024-09-15T22:14:17.193687+0000","last_clean":"2024-09-15T22:14:17.193687+0000","last_became_active":"2024-09-15T22:14:06.814744+0000","last_became_peered":"2024-09-15T22:14:06.814744+0000","last_unstale":"2024-09-15T22:14:17.193687+0000","last_undegraded":"2024-09-15T22:14:17.193687+0000","last_fullsized":"2024-09-15T22:14:17.193687+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:26.927942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.158674+0000","last_change":"2024-09-15T22:14:06.811672+0000","last_active":"2024-09-15T22:14:17.158674+0000","last_peered":"2024-09-15T22:14:17.158674+0000","last_clean":"2024-09-15T22:14:17.158674+0000","last_became_active":"2024-09-15T22:14:06.811300+0000","last_became_peered":"2024-09-15T22:14:06.811300+0000","last_unstale":"2024-09-15T22:14:17.158674+0000","last_undegraded":"2024-09-15T22:14:17.158674+0000","last_fullsized":"2024-09-15T22:14:17.158674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:46.223584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845032+0000","last_change":"2024-09-15T22:14:06.814495+0000","last_active":"2024-09-15T22:14:16.845032+0000","last_peered":"2024-09-15T22:14:16.845032+0000","last_clean":"2024-09-15T22:14:16.845032+0000","last_became_active":"2024-09-15T22:14:06.814142+0000","last_became_peered":"2024-09-15T22:14:06.814142+0000","last_unstale":"2024-09-15T22:14:16.845032+0000","last_undegraded":"2024-09-15T22:14:16.845032+0000","last_fullsized":"2024-09-15T22:14:16.845032+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:20.374348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.844998+0000","last_change":"2024-09-15T22:14:06.811063+0000","last_active":"2024-09-15T22:14:16.844998+0000","last_peered":"2024-09-15T22:14:16.844998+0000","last_clean":"2024-09-15T22:14:16.844998+0000","last_became_active":"2024-09-15T22:14:06.810700+0000","last_became_peered":"2024-09-15T22:14:06.810700+0000","last_unstale":"2024-09-15T22:14:16.844998+0000","last_undegraded":"2024-09-15T22:14:16.844998+0000","last_fullsized":"2024-09-15T22:14:16.844998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:11.250590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925400+0000","last_change":"2024-09-15T22:14:06.816896+0000","last_active":"2024-09-15T22:14:17.925400+0000","last_peered":"2024-09-15T22:14:17.925400+0000","last_clean":"2024-09-15T22:14:17.925400+0000","last_became_active":"2024-09-15T22:14:06.816559+0000","last_became_peered":"2024-09-15T22:14:06.816559+0000","last_unstale":"2024-09-15T22:14:17.925400+0000","last_undegraded":"2024-09-15T22:14:17.925400+0000","last_fullsized":"2024-09-15T22:14:17.925400+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:17.965490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673377+0000","last_change":"2024-09-15T22:14:06.813984+0000","last_active":"2024-09-15T22:14:17.673377+0000","last_peered":"2024-09-15T22:14:17.673377+0000","last_clean":"2024-09-15T22:14:17.673377+0000","last_became_active":"2024-09-15T22:14:06.813586+0000","last_became_peered":"2024-09-15T22:14:06.813586+0000","last_unstale":"2024-09-15T22:14:17.673377+0000","last_undegraded":"2024-09-15T22:14:17.673377+0000","last_fullsized":"2024-09-15T22:14:17.673377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:34.335741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848969+0000","last_change":"2024-09-15T22:14:06.816047+0000","last_active":"2024-09-15T22:14:16.848969+0000","last_peered":"2024-09-15T22:14:16.848969+0000","last_clean":"2024-09-15T22:14:16.848969+0000","last_became_active":"2024-09-15T22:14:06.815244+0000","last_became_peered":"2024-09-15T22:14:06.815244+0000","last_unstale":"2024-09-15T22:14:16.848969+0000","last_undegraded":"2024-09-15T22:14:16.848969+0000","last_fullsized":"2024-09-15T22:14:16.848969+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:30.469382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981635+0000","last_change":"2024-09-15T22:14:06.813254+0000","last_active":"2024-09-15T22:14:17.981635+0000","last_peered":"2024-09-15T22:14:17.981635+0000","last_clean":"2024-09-15T22:14:17.981635+0000","last_became_active":"2024-09-15T22:14:06.812921+0000","last_became_peered":"2024-09-15T22:14:06.812921+0000","last_unstale":"2024-09-15T22:14:17.981635+0000","last_undegraded":"2024-09-15T22:14:17.981635+0000","last_fullsized":"2024-09-15T22:14:17.981635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:40.674246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.159398+0000","last_change":"2024-09-15T22:14:06.817016+0000","last_active":"2024-09-15T22:14:17.159398+0000","last_peered":"2024-09-15T22:14:17.159398+0000","last_clean":"2024-09-15T22:14:17.159398+0000","last_became_active":"2024-09-15T22:14:06.816256+0000","last_became_peered":"2024-09-15T22:14:06.816256+0000","last_unstale":"2024-09-15T22:14:17.159398+0000","last_undegraded":"2024-09-15T22:14:17.159398+0000","last_fullsized":"2024-09-15T22:14:17.159398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:37.092156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980563+0000","last_change":"2024-09-15T22:14:06.797435+0000","last_active":"2024-09-15T22:14:17.980563+0000","last_peered":"2024-09-15T22:14:17.980563+0000","last_clean":"2024-09-15T22:14:17.980563+0000","last_became_active":"2024-09-15T22:14:06.797135+0000","last_became_peered":"2024-09-15T22:14:06.797135+0000","last_unstale":"2024-09-15T22:14:17.980563+0000","last_undegraded":"2024-09-15T22:14:17.980563+0000","last_fullsized":"2024-09-15T22:14:17.980563+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:37.326281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848376+0000","last_change":"2024-09-15T22:14:06.814902+0000","last_active":"2024-09-15T22:14:16.848376+0000","last_peered":"2024-09-15T22:14:16.848376+0000","last_clean":"2024-09-15T22:14:16.848376+0000","last_became_active":"2024-09-15T22:14:06.814563+0000","last_became_peered":"2024-09-15T22:14:06.814563+0000","last_unstale":"2024-09-15T22:14:16.848376+0000","last_undegraded":"2024-09-15T22:14:16.848376+0000","last_fullsized":"2024-09-15T22:14:16.848376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:02.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981167+0000","last_change":"2024-09-15T22:14:06.807444+0000","last_active":"2024-09-15T22:14:17.981167+0000","last_peered":"2024-09-15T22:14:17.981167+0000","last_clean":"2024-09-15T22:14:17.981167+0000","last_became_active":"2024-09-15T22:14:06.807083+0000","last_became_peered":"2024-09-15T22:14:06.807083+0000","last_unstale":"2024-09-15T22:14:17.981167+0000","last_undegraded":"2024-09-15T22:14:17.981167+0000","last_fullsized":"2024-09-15T22:14:17.981167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:07.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846341+0000","last_change":"2024-09-15T22:14:06.811851+0000","last_active":"2024-09-15T22:14:16.846341+0000","last_peered":"2024-09-15T22:14:16.846341+0000","last_clean":"2024-09-15T22:14:16.846341+0000","last_became_active":"2024-09-15T22:14:06.811451+0000","last_became_peered":"2024-09-15T22:14:06.811451+0000","last_unstale":"2024-09-15T22:14:16.846341+0000","last_undegraded":"2024-09-15T22:14:16.846341+0000","last_fullsized":"2024-09-15T22:14:16.846341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:51.389555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673252+0000","last_change":"2024-09-15T22:14:06.812520+0000","last_active":"2024-09-15T22:14:17.673252+0000","last_peered":"2024-09-15T22:14:17.673252+0000","last_clean":"2024-09-15T22:14:17.673252+0000","last_became_active":"2024-09-15T22:14:06.812222+0000","last_became_peered":"2024-09-15T22:14:06.812222+0000","last_unstale":"2024-09-15T22:14:17.673252+0000","last_undegraded":"2024-09-15T22:14:17.673252+0000","last_fullsized":"2024-09-15T22:14:17.673252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:01.589678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845163+0000","last_change":"2024-09-15T22:14:06.808649+0000","last_active":"2024-09-15T22:14:16.845163+0000","last_peered":"2024-09-15T22:14:16.845163+0000","last_clean":"2024-09-15T22:14:16.845163+0000","last_became_active":"2024-09-15T22:14:06.808278+0000","last_became_peered":"2024-09-15T22:14:06.808278+0000","last_unstale":"2024-09-15T22:14:16.845163+0000","last_undegraded":"2024-09-15T22:14:16.845163+0000","last_fullsized":"2024-09-15T22:14:16.845163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:32.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845336+0000","last_change":"2024-09-15T22:14:06.811593+0000","last_active":"2024-09-15T22:14:16.845336+0000","last_peered":"2024-09-15T22:14:16.845336+0000","last_clean":"2024-09-15T22:14:16.845336+0000","last_became_active":"2024-09-15T22:14:06.811285+0000","last_became_peered":"2024-09-15T22:14:06.811285+0000","last_unstale":"2024-09-15T22:14:16.845336+0000","last_undegraded":"2024-09-15T22:14:16.845336+0000","last_fullsized":"2024-09-15T22:14:16.845336+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:36.482554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193621+0000","last_change":"2024-09-15T22:14:06.816084+0000","last_active":"2024-09-15T22:14:17.193621+0000","last_peered":"2024-09-15T22:14:17.193621+0000","last_clean":"2024-09-15T22:14:17.193621+0000","last_became_active":"2024-09-15T22:14:06.815461+0000","last_became_peered":"2024-09-15T22:14:06.815461+0000","last_unstale":"2024-09-15T22:14:17.193621+0000","last_undegraded":"2024-09-15T22:14:17.193621+0000","last_fullsized":"2024-09-15T22:14:17.193621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:57.455608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44143,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":37,"num_read_kb":64,"num_write":72,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":165195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547223,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":482238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776155,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1634304,"data_stored":1112049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939680,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":486916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168614,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":482842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430250,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1581056,"data_stored":1077284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593776,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":478142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822709,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36892,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708260,"statfs":{"total":95995035648,"available":95957258240,"internally_reserved":0,"allocated":1585152,"data_stored":1072788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986233,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":482260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215167,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":478246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":537904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1044480,"data_stored":537870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40468,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704684,"statfs":{"total":95995035648,"available":95953596416,"internally_reserved":0,"allocated":978944,"data_stored":478232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":43539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:15:00.443 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:15:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:01.116 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:00 smithi045 ceph-mon[31180]: pgmap v309: 129 pgs: 129 active+clean; 620 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-09-15T22:15:01.116 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:00 smithi045 ceph-mon[31180]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:15:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.195+0000 7f52643d4640 1 -- 172.21.15.45:0/4172462936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c102790 msgr2=0x7f525c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.195+0000 7f52643d4640 1 --2- 172.21.15.45:0/4172462936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c102790 0x7f525c1067e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f524c009900 tx=0x7f524c02a410 comp rx=0 tx=0).stop 2024-09-15T22:15:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.196+0000 7f52643d4640 1 -- 172.21.15.45:0/4172462936 shutdown_connections 2024-09-15T22:15:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.196+0000 7f52643d4640 1 --2- 172.21.15.45:0/4172462936 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f525c106f10 0x7f525c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.196+0000 7f52643d4640 1 --2- 172.21.15.45:0/4172462936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c102790 0x7f525c1067e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.196+0000 7f52643d4640 1 --2- 172.21.15.45:0/4172462936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c101de0 0x7f525c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.196+0000 7f52643d4640 1 -- 172.21.15.45:0/4172462936 >> 172.21.15.45:0/4172462936 conn(0x7f525c0fd8c0 msgr2=0x7f525c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.196+0000 7f52643d4640 1 -- 172.21.15.45:0/4172462936 shutdown_connections 2024-09-15T22:15:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.196+0000 7f52643d4640 1 -- 172.21.15.45:0/4172462936 wait complete. 2024-09-15T22:15:01.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.196+0000 7f52643d4640 1 Processor -- start 2024-09-15T22:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.196+0000 7f52643d4640 1 -- start start 2024-09-15T22:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.196+0000 7f52643d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c101de0 0x7f525c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.196+0000 7f52643d4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f525c102790 0x7f525c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f52643d4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c106f10 0x7f525c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f52643d4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f525c112090 con 0x7f525c101de0 2024-09-15T22:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f52643d4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f525c111f10 con 0x7f525c106f10 2024-09-15T22:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f52643d4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f525c112210 con 0x7f525c102790 2024-09-15T22:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f5262170640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c101de0 0x7f525c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f5262170640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c101de0 0x7f525c1984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41184/0 (socket says 172.21.15.45:41184) 2024-09-15T22:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f5262170640 1 -- 172.21.15.45:0/125137581 learned_addr learned my addr 172.21.15.45:0/125137581 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f526196f640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f525c102790 0x7f525c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f5262971640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c106f10 0x7f525c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:01.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f5262170640 1 -- 172.21.15.45:0/125137581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f525c102790 msgr2=0x7f525c198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f5262170640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f525c102790 0x7f525c198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f5262170640 1 -- 172.21.15.45:0/125137581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c106f10 msgr2=0x7f525c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f5262170640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c106f10 0x7f525c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f5262170640 1 -- 172.21.15.45:0/125137581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c19d480 con 0x7f525c101de0 2024-09-15T22:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f526196f640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f525c102790 0x7f525c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f5262170640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c101de0 0x7f525c1984d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f525800e9f0 tx=0x7f525800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f52537fe640 1 -- 172.21.15.45:0/125137581 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525800cd80 con 0x7f525c101de0 2024-09-15T22:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f52643d4640 1 -- 172.21.15.45:0/125137581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c19d770 con 0x7f525c101de0 2024-09-15T22:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f52537fe640 1 -- 172.21.15.45:0/125137581 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5258010930 con 0x7f525c101de0 2024-09-15T22:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f52537fe640 1 -- 172.21.15.45:0/125137581 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5258018b00 con 0x7f525c101de0 2024-09-15T22:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.197+0000 7f52643d4640 1 -- 172.21.15.45:0/125137581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c1a5050 con 0x7f525c101de0 2024-09-15T22:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.198+0000 7f52643d4640 1 -- 172.21.15.45:0/125137581 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c1021c0 con 0x7f525c101de0 2024-09-15T22:15:01.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.200+0000 7f52537fe640 1 -- 172.21.15.45:0/125137581 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5258018ca0 con 0x7f525c101de0 2024-09-15T22:15:01.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.201+0000 7f52537fe640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f52480a32d0 0x7f52480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:01.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.201+0000 7f526196f640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f52480a32d0 0x7f52480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:01.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.201+0000 7f52537fe640 1 -- 172.21.15.45:0/125137581 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f52580d0590 con 0x7f525c101de0 2024-09-15T22:15:01.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.201+0000 7f526196f640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f52480a32d0 0x7f52480a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f525c0fdce0 tx=0x7f524c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:01.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.204+0000 7f52537fe640 1 -- 172.21.15.45:0/125137581 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f525809ceb0 con 0x7f525c101de0 2024-09-15T22:15:01.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:00 smithi100 ceph-mon[35319]: pgmap v309: 129 pgs: 129 active+clean; 620 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-09-15T22:15:01.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:00 smithi100 ceph-mon[35319]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:15:01.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.375+0000 7f52643d4640 1 -- 172.21.15.45:0/125137581 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f525c062630 con 0x7f52480a32d0 2024-09-15T22:15:01.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.383+0000 7f52537fe640 1 -- 172.21.15.45:0/125137581 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340266 (secure 0 0 0) 0x7f525c062630 con 0x7f52480a32d0 2024-09-15T22:15:01.388 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:15:01.390 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-09-15T22:15:01.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.387+0000 7f52643d4640 1 -- 172.21.15.45:0/125137581 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f52480a32d0 msgr2=0x7f52480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:01.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.387+0000 7f52643d4640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f52480a32d0 0x7f52480a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f525c0fdce0 tx=0x7f524c005a20 comp rx=0 tx=0).stop 2024-09-15T22:15:01.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.387+0000 7f52643d4640 1 -- 172.21.15.45:0/125137581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c101de0 msgr2=0x7f525c1984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:01.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.387+0000 7f52643d4640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c101de0 0x7f525c1984d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f525800e9f0 tx=0x7f525800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:15:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.387+0000 7f52643d4640 1 -- 172.21.15.45:0/125137581 shutdown_connections 2024-09-15T22:15:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.387+0000 7f52643d4640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f52480a32d0 0x7f52480a5790 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.387+0000 7f52643d4640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f525c106f10 0x7f525c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.387+0000 7f52643d4640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f525c102790 0x7f525c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.387+0000 7f52643d4640 1 --2- 172.21.15.45:0/125137581 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f525c101de0 0x7f525c1984d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.387+0000 7f52643d4640 1 -- 172.21.15.45:0/125137581 >> 172.21.15.45:0/125137581 conn(0x7f525c0fd8c0 msgr2=0x7f525c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.387+0000 7f52643d4640 1 -- 172.21.15.45:0/125137581 shutdown_connections 2024-09-15T22:15:01.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:01.387+0000 7f52643d4640 1 -- 172.21.15.45:0/125137581 wait complete. 2024-09-15T22:15:01.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:00 smithi165 ceph-mon[35551]: pgmap v309: 129 pgs: 129 active+clean; 620 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-09-15T22:15:01.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:00 smithi165 ceph-mon[35551]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:15:02.076 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-15T22:14:59.423969+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":634745,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":173,"num_read_kb":183,"num_write":255,"num_write_kb":3007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":408468,"kb_used_data":13444,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124533356,"statfs":{"total":1151940427776,"available":1151522156544,"internally_reserved":0,"allocated":13766656,"data_stored":7706771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39735,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":50,"num_write":25,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003428"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.101096+0000","last_change":"2024-09-15T22:14:04.718966+0000","last_active":"2024-09-15T22:14:17.101096+0000","last_peered":"2024-09-15T22:14:17.101096+0000","last_clean":"2024-09-15T22:14:17.101096+0000","last_became_active":"2024-09-15T22:14:04.718743+0000","last_became_peered":"2024-09-15T22:14:04.718743+0000","last_unstale":"2024-09-15T22:14:17.101096+0000","last_undegraded":"2024-09-15T22:14:17.101096+0000","last_fullsized":"2024-09-15T22:14:17.101096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:24:01.767801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980835+0000","last_change":"2024-09-15T22:14:06.814802+0000","last_active":"2024-09-15T22:14:17.980835+0000","last_peered":"2024-09-15T22:14:17.980835+0000","last_clean":"2024-09-15T22:14:17.980835+0000","last_became_active":"2024-09-15T22:14:06.814495+0000","last_became_peered":"2024-09-15T22:14:06.814495+0000","last_unstale":"2024-09-15T22:14:17.980835+0000","last_undegraded":"2024-09-15T22:14:17.980835+0000","last_fullsized":"2024-09-15T22:14:17.980835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:45.384412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799484+0000","last_change":"2024-09-15T22:14:13.847669+0000","last_active":"2024-09-15T22:14:17.799484+0000","last_peered":"2024-09-15T22:14:17.799484+0000","last_clean":"2024-09-15T22:14:17.799484+0000","last_became_active":"2024-09-15T22:14:13.847315+0000","last_became_peered":"2024-09-15T22:14:13.847315+0000","last_unstale":"2024-09-15T22:14:17.799484+0000","last_undegraded":"2024-09-15T22:14:17.799484+0000","last_fullsized":"2024-09-15T22:14:17.799484+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:50.609272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981038+0000","last_change":"2024-09-15T22:14:05.017101+0000","last_active":"2024-09-15T22:14:17.981038+0000","last_peered":"2024-09-15T22:14:17.981038+0000","last_clean":"2024-09-15T22:14:17.981038+0000","last_became_active":"2024-09-15T22:14:05.016748+0000","last_became_peered":"2024-09-15T22:14:05.016748+0000","last_unstale":"2024-09-15T22:14:17.981038+0000","last_undegraded":"2024-09-15T22:14:17.981038+0000","last_fullsized":"2024-09-15T22:14:17.981038+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:11.211291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845620+0000","last_change":"2024-09-15T22:14:06.815112+0000","last_active":"2024-09-15T22:14:16.845620+0000","last_peered":"2024-09-15T22:14:16.845620+0000","last_clean":"2024-09-15T22:14:16.845620+0000","last_became_active":"2024-09-15T22:14:06.814556+0000","last_became_peered":"2024-09-15T22:14:06.814556+0000","last_unstale":"2024-09-15T22:14:16.845620+0000","last_undegraded":"2024-09-15T22:14:16.845620+0000","last_fullsized":"2024-09-15T22:14:16.845620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:24.733336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.672872+0000","last_change":"2024-09-15T22:14:13.845829+0000","last_active":"2024-09-15T22:14:17.672872+0000","last_peered":"2024-09-15T22:14:17.672872+0000","last_clean":"2024-09-15T22:14:17.672872+0000","last_became_active":"2024-09-15T22:14:13.844958+0000","last_became_peered":"2024-09-15T22:14:13.844958+0000","last_unstale":"2024-09-15T22:14:17.672872+0000","last_undegraded":"2024-09-15T22:14:17.672872+0000","last_fullsized":"2024-09-15T22:14:17.672872+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:37.944143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846777+0000","last_change":"2024-09-15T22:14:04.720255+0000","last_active":"2024-09-15T22:14:16.846777+0000","last_peered":"2024-09-15T22:14:16.846777+0000","last_clean":"2024-09-15T22:14:16.846777+0000","last_became_active":"2024-09-15T22:14:04.719907+0000","last_became_peered":"2024-09-15T22:14:04.719907+0000","last_unstale":"2024-09-15T22:14:16.846777+0000","last_undegraded":"2024-09-15T22:14:16.846777+0000","last_fullsized":"2024-09-15T22:14:16.846777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:12.510139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.159012+0000","last_change":"2024-09-15T22:14:06.808322+0000","last_active":"2024-09-15T22:14:17.159012+0000","last_peered":"2024-09-15T22:14:17.159012+0000","last_clean":"2024-09-15T22:14:17.159012+0000","last_became_active":"2024-09-15T22:14:06.807398+0000","last_became_peered":"2024-09-15T22:14:06.807398+0000","last_unstale":"2024-09-15T22:14:17.159012+0000","last_undegraded":"2024-09-15T22:14:17.159012+0000","last_fullsized":"2024-09-15T22:14:17.159012+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:11.677800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673004+0000","last_change":"2024-09-15T22:14:13.849713+0000","last_active":"2024-09-15T22:14:17.673004+0000","last_peered":"2024-09-15T22:14:17.673004+0000","last_clean":"2024-09-15T22:14:17.673004+0000","last_became_active":"2024-09-15T22:14:13.849311+0000","last_became_peered":"2024-09-15T22:14:13.849311+0000","last_unstale":"2024-09-15T22:14:17.673004+0000","last_undegraded":"2024-09-15T22:14:17.673004+0000","last_fullsized":"2024-09-15T22:14:17.673004+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:17.782013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846680+0000","last_change":"2024-09-15T22:14:04.721694+0000","last_active":"2024-09-15T22:14:16.846680+0000","last_peered":"2024-09-15T22:14:16.846680+0000","last_clean":"2024-09-15T22:14:16.846680+0000","last_became_active":"2024-09-15T22:14:04.721321+0000","last_became_peered":"2024-09-15T22:14:04.721321+0000","last_unstale":"2024-09-15T22:14:16.846680+0000","last_undegraded":"2024-09-15T22:14:16.846680+0000","last_fullsized":"2024-09-15T22:14:16.846680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:47.817565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981931+0000","last_change":"2024-09-15T22:14:06.809564+0000","last_active":"2024-09-15T22:14:17.981931+0000","last_peered":"2024-09-15T22:14:17.981931+0000","last_clean":"2024-09-15T22:14:17.981931+0000","last_became_active":"2024-09-15T22:14:06.809102+0000","last_became_peered":"2024-09-15T22:14:06.809102+0000","last_unstale":"2024-09-15T22:14:17.981931+0000","last_undegraded":"2024-09-15T22:14:17.981931+0000","last_fullsized":"2024-09-15T22:14:17.981931+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:55.306791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673043+0000","last_change":"2024-09-15T22:14:13.849839+0000","last_active":"2024-09-15T22:14:17.673043+0000","last_peered":"2024-09-15T22:14:17.673043+0000","last_clean":"2024-09-15T22:14:17.673043+0000","last_became_active":"2024-09-15T22:14:13.849415+0000","last_became_peered":"2024-09-15T22:14:13.849415+0000","last_unstale":"2024-09-15T22:14:17.673043+0000","last_undegraded":"2024-09-15T22:14:17.673043+0000","last_fullsized":"2024-09-15T22:14:17.673043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:20.336406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848472+0000","last_change":"2024-09-15T22:14:06.815506+0000","last_active":"2024-09-15T22:14:16.848472+0000","last_peered":"2024-09-15T22:14:16.848472+0000","last_clean":"2024-09-15T22:14:16.848472+0000","last_became_active":"2024-09-15T22:14:06.815066+0000","last_became_peered":"2024-09-15T22:14:06.815066+0000","last_unstale":"2024-09-15T22:14:16.848472+0000","last_undegraded":"2024-09-15T22:14:16.848472+0000","last_fullsized":"2024-09-15T22:14:16.848472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:42.182268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846385+0000","last_change":"2024-09-15T22:14:04.721403+0000","last_active":"2024-09-15T22:14:16.846385+0000","last_peered":"2024-09-15T22:14:16.846385+0000","last_clean":"2024-09-15T22:14:16.846385+0000","last_became_active":"2024-09-15T22:14:04.721049+0000","last_became_peered":"2024-09-15T22:14:04.721049+0000","last_unstale":"2024-09-15T22:14:16.846385+0000","last_undegraded":"2024-09-15T22:14:16.846385+0000","last_fullsized":"2024-09-15T22:14:16.846385+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:39.860926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673188+0000","last_change":"2024-09-15T22:14:14.280656+0000","last_active":"2024-09-15T22:14:17.673188+0000","last_peered":"2024-09-15T22:14:17.673188+0000","last_clean":"2024-09-15T22:14:17.673188+0000","last_became_active":"2024-09-15T22:14:14.280230+0000","last_became_peered":"2024-09-15T22:14:14.280230+0000","last_unstale":"2024-09-15T22:14:17.673188+0000","last_undegraded":"2024-09-15T22:14:17.673188+0000","last_fullsized":"2024-09-15T22:14:17.673188+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:47.531799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980836+0000","last_change":"2024-09-15T22:14:06.805575+0000","last_active":"2024-09-15T22:14:17.980836+0000","last_peered":"2024-09-15T22:14:17.980836+0000","last_clean":"2024-09-15T22:14:17.980836+0000","last_became_active":"2024-09-15T22:14:06.804515+0000","last_became_peered":"2024-09-15T22:14:06.804515+0000","last_unstale":"2024-09-15T22:14:17.980836+0000","last_undegraded":"2024-09-15T22:14:17.980836+0000","last_fullsized":"2024-09-15T22:14:17.980836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.560964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799765+0000","last_change":"2024-09-15T22:14:04.717221+0000","last_active":"2024-09-15T22:14:17.799765+0000","last_peered":"2024-09-15T22:14:17.799765+0000","last_clean":"2024-09-15T22:14:17.799765+0000","last_became_active":"2024-09-15T22:14:04.716845+0000","last_became_peered":"2024-09-15T22:14:04.716845+0000","last_unstale":"2024-09-15T22:14:17.799765+0000","last_undegraded":"2024-09-15T22:14:17.799765+0000","last_fullsized":"2024-09-15T22:14:17.799765+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.073229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673305+0000","last_change":"2024-09-15T22:14:13.847822+0000","last_active":"2024-09-15T22:14:17.673305+0000","last_peered":"2024-09-15T22:14:17.673305+0000","last_clean":"2024-09-15T22:14:17.673305+0000","last_became_active":"2024-09-15T22:14:13.847332+0000","last_became_peered":"2024-09-15T22:14:13.847332+0000","last_unstale":"2024-09-15T22:14:17.673305+0000","last_undegraded":"2024-09-15T22:14:17.673305+0000","last_fullsized":"2024-09-15T22:14:17.673305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:18.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193127+0000","last_change":"2024-09-15T22:14:06.814033+0000","last_active":"2024-09-15T22:14:17.193127+0000","last_peered":"2024-09-15T22:14:17.193127+0000","last_clean":"2024-09-15T22:14:17.193127+0000","last_became_active":"2024-09-15T22:14:06.813458+0000","last_became_peered":"2024-09-15T22:14:06.813458+0000","last_unstale":"2024-09-15T22:14:17.193127+0000","last_undegraded":"2024-09-15T22:14:17.193127+0000","last_fullsized":"2024-09-15T22:14:17.193127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:16.484113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980817+0000","last_change":"2024-09-15T22:14:04.715797+0000","last_active":"2024-09-15T22:14:17.980817+0000","last_peered":"2024-09-15T22:14:17.980817+0000","last_clean":"2024-09-15T22:14:17.980817+0000","last_became_active":"2024-09-15T22:14:04.715478+0000","last_became_peered":"2024-09-15T22:14:04.715478+0000","last_unstale":"2024-09-15T22:14:17.980817+0000","last_undegraded":"2024-09-15T22:14:17.980817+0000","last_fullsized":"2024-09-15T22:14:17.980817+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:39.432873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100927+0000","last_change":"2024-09-15T22:14:13.853461+0000","last_active":"2024-09-15T22:14:17.100927+0000","last_peered":"2024-09-15T22:14:17.100927+0000","last_clean":"2024-09-15T22:14:17.100927+0000","last_became_active":"2024-09-15T22:14:13.852896+0000","last_became_peered":"2024-09-15T22:14:13.852896+0000","last_unstale":"2024-09-15T22:14:17.100927+0000","last_undegraded":"2024-09-15T22:14:17.100927+0000","last_fullsized":"2024-09-15T22:14:17.100927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:41.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846194+0000","last_change":"2024-09-15T22:14:06.814990+0000","last_active":"2024-09-15T22:14:16.846194+0000","last_peered":"2024-09-15T22:14:16.846194+0000","last_clean":"2024-09-15T22:14:16.846194+0000","last_became_active":"2024-09-15T22:14:06.814646+0000","last_became_peered":"2024-09-15T22:14:06.814646+0000","last_unstale":"2024-09-15T22:14:16.846194+0000","last_undegraded":"2024-09-15T22:14:16.846194+0000","last_fullsized":"2024-09-15T22:14:16.846194+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:04.717207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.158786+0000","last_change":"2024-09-15T22:14:05.017599+0000","last_active":"2024-09-15T22:14:17.158786+0000","last_peered":"2024-09-15T22:14:17.158786+0000","last_clean":"2024-09-15T22:14:17.158786+0000","last_became_active":"2024-09-15T22:14:05.017296+0000","last_became_peered":"2024-09-15T22:14:05.017296+0000","last_unstale":"2024-09-15T22:14:17.158786+0000","last_undegraded":"2024-09-15T22:14:17.158786+0000","last_fullsized":"2024-09-15T22:14:17.158786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:11.427372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673382+0000","last_change":"2024-09-15T22:14:14.281453+0000","last_active":"2024-09-15T22:14:17.673382+0000","last_peered":"2024-09-15T22:14:17.673382+0000","last_clean":"2024-09-15T22:14:17.673382+0000","last_became_active":"2024-09-15T22:14:14.280814+0000","last_became_peered":"2024-09-15T22:14:14.280814+0000","last_unstale":"2024-09-15T22:14:17.673382+0000","last_undegraded":"2024-09-15T22:14:17.673382+0000","last_fullsized":"2024-09-15T22:14:17.673382+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:43:40.890979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845393+0000","last_change":"2024-09-15T22:14:06.816619+0000","last_active":"2024-09-15T22:14:16.845393+0000","last_peered":"2024-09-15T22:14:16.845393+0000","last_clean":"2024-09-15T22:14:16.845393+0000","last_became_active":"2024-09-15T22:14:06.814421+0000","last_became_peered":"2024-09-15T22:14:06.814421+0000","last_unstale":"2024-09-15T22:14:16.845393+0000","last_undegraded":"2024-09-15T22:14:16.845393+0000","last_fullsized":"2024-09-15T22:14:16.845393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:00.329802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673565+0000","last_change":"2024-09-15T22:14:05.197752+0000","last_active":"2024-09-15T22:14:17.673565+0000","last_peered":"2024-09-15T22:14:17.673565+0000","last_clean":"2024-09-15T22:14:17.673565+0000","last_became_active":"2024-09-15T22:14:05.197399+0000","last_became_peered":"2024-09-15T22:14:05.197399+0000","last_unstale":"2024-09-15T22:14:17.673565+0000","last_undegraded":"2024-09-15T22:14:17.673565+0000","last_fullsized":"2024-09-15T22:14:17.673565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:19.781842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799751+0000","last_change":"2024-09-15T22:14:13.847474+0000","last_active":"2024-09-15T22:14:17.799751+0000","last_peered":"2024-09-15T22:14:17.799751+0000","last_clean":"2024-09-15T22:14:17.799751+0000","last_became_active":"2024-09-15T22:14:13.847032+0000","last_became_peered":"2024-09-15T22:14:13.847032+0000","last_unstale":"2024-09-15T22:14:17.799751+0000","last_undegraded":"2024-09-15T22:14:17.799751+0000","last_fullsized":"2024-09-15T22:14:17.799751+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:21.049024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981050+0000","last_change":"2024-09-15T22:14:06.809104+0000","last_active":"2024-09-15T22:14:17.981050+0000","last_peered":"2024-09-15T22:14:17.981050+0000","last_clean":"2024-09-15T22:14:17.981050+0000","last_became_active":"2024-09-15T22:14:06.808735+0000","last_became_peered":"2024-09-15T22:14:06.808735+0000","last_unstale":"2024-09-15T22:14:17.981050+0000","last_undegraded":"2024-09-15T22:14:17.981050+0000","last_fullsized":"2024-09-15T22:14:17.981050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:46.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'6","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:53.818635+0000","last_change":"2024-09-15T22:14:04.712546+0000","last_active":"2024-09-15T22:14:53.818635+0000","last_peered":"2024-09-15T22:14:53.818635+0000","last_clean":"2024-09-15T22:14:53.818635+0000","last_became_active":"2024-09-15T22:14:04.712222+0000","last_became_peered":"2024-09-15T22:14:04.712222+0000","last_unstale":"2024-09-15T22:14:53.818635+0000","last_undegraded":"2024-09-15T22:14:53.818635+0000","last_fullsized":"2024-09-15T22:14:53.818635+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:00.993810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980486+0000","last_change":"2024-09-15T22:14:14.280905+0000","last_active":"2024-09-15T22:14:17.980486+0000","last_peered":"2024-09-15T22:14:17.980486+0000","last_clean":"2024-09-15T22:14:17.980486+0000","last_became_active":"2024-09-15T22:14:14.280368+0000","last_became_peered":"2024-09-15T22:14:14.280368+0000","last_unstale":"2024-09-15T22:14:17.980486+0000","last_undegraded":"2024-09-15T22:14:17.980486+0000","last_fullsized":"2024-09-15T22:14:17.980486+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:52.812589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925608+0000","last_change":"2024-09-15T22:14:06.816231+0000","last_active":"2024-09-15T22:14:17.925608+0000","last_peered":"2024-09-15T22:14:17.925608+0000","last_clean":"2024-09-15T22:14:17.925608+0000","last_became_active":"2024-09-15T22:14:06.815884+0000","last_became_peered":"2024-09-15T22:14:06.815884+0000","last_unstale":"2024-09-15T22:14:17.925608+0000","last_undegraded":"2024-09-15T22:14:17.925608+0000","last_fullsized":"2024-09-15T22:14:17.925608+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:30.076077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846814+0000","last_change":"2024-09-15T22:14:05.017745+0000","last_active":"2024-09-15T22:14:16.846814+0000","last_peered":"2024-09-15T22:14:16.846814+0000","last_clean":"2024-09-15T22:14:16.846814+0000","last_became_active":"2024-09-15T22:14:05.017064+0000","last_became_peered":"2024-09-15T22:14:05.017064+0000","last_unstale":"2024-09-15T22:14:16.846814+0000","last_undegraded":"2024-09-15T22:14:16.846814+0000","last_fullsized":"2024-09-15T22:14:16.846814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:44.038448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193190+0000","last_change":"2024-09-15T22:14:13.853195+0000","last_active":"2024-09-15T22:14:17.193190+0000","last_peered":"2024-09-15T22:14:17.193190+0000","last_clean":"2024-09-15T22:14:17.193190+0000","last_became_active":"2024-09-15T22:14:13.852803+0000","last_became_peered":"2024-09-15T22:14:13.852803+0000","last_unstale":"2024-09-15T22:14:17.193190+0000","last_undegraded":"2024-09-15T22:14:17.193190+0000","last_fullsized":"2024-09-15T22:14:17.193190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:20.737509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981413+0000","last_change":"2024-09-15T22:14:06.805448+0000","last_active":"2024-09-15T22:14:17.981413+0000","last_peered":"2024-09-15T22:14:17.981413+0000","last_clean":"2024-09-15T22:14:17.981413+0000","last_became_active":"2024-09-15T22:14:06.804965+0000","last_became_peered":"2024-09-15T22:14:06.804965+0000","last_unstale":"2024-09-15T22:14:17.981413+0000","last_undegraded":"2024-09-15T22:14:17.981413+0000","last_fullsized":"2024-09-15T22:14:17.981413+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:29.831888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100799+0000","last_change":"2024-09-15T22:14:05.017438+0000","last_active":"2024-09-15T22:14:17.100799+0000","last_peered":"2024-09-15T22:14:17.100799+0000","last_clean":"2024-09-15T22:14:17.100799+0000","last_became_active":"2024-09-15T22:14:05.017050+0000","last_became_peered":"2024-09-15T22:14:05.017050+0000","last_unstale":"2024-09-15T22:14:17.100799+0000","last_undegraded":"2024-09-15T22:14:17.100799+0000","last_fullsized":"2024-09-15T22:14:17.100799+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:35.608774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846309+0000","last_change":"2024-09-15T22:14:14.281096+0000","last_active":"2024-09-15T22:14:16.846309+0000","last_peered":"2024-09-15T22:14:16.846309+0000","last_clean":"2024-09-15T22:14:16.846309+0000","last_became_active":"2024-09-15T22:14:14.280381+0000","last_became_peered":"2024-09-15T22:14:14.280381+0000","last_unstale":"2024-09-15T22:14:16.846309+0000","last_undegraded":"2024-09-15T22:14:16.846309+0000","last_fullsized":"2024-09-15T22:14:16.846309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:44.686080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981252+0000","last_change":"2024-09-15T22:14:06.812046+0000","last_active":"2024-09-15T22:14:17.981252+0000","last_peered":"2024-09-15T22:14:17.981252+0000","last_clean":"2024-09-15T22:14:17.981252+0000","last_became_active":"2024-09-15T22:14:06.811721+0000","last_became_peered":"2024-09-15T22:14:06.811721+0000","last_unstale":"2024-09-15T22:14:17.981252+0000","last_undegraded":"2024-09-15T22:14:17.981252+0000","last_fullsized":"2024-09-15T22:14:17.981252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:13.244973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848584+0000","last_change":"2024-09-15T22:14:04.720940+0000","last_active":"2024-09-15T22:14:16.848584+0000","last_peered":"2024-09-15T22:14:16.848584+0000","last_clean":"2024-09-15T22:14:16.848584+0000","last_became_active":"2024-09-15T22:14:04.720624+0000","last_became_peered":"2024-09-15T22:14:04.720624+0000","last_unstale":"2024-09-15T22:14:16.848584+0000","last_undegraded":"2024-09-15T22:14:16.848584+0000","last_fullsized":"2024-09-15T22:14:16.848584+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:29.823784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925466+0000","last_change":"2024-09-15T22:14:13.848882+0000","last_active":"2024-09-15T22:14:17.925466+0000","last_peered":"2024-09-15T22:14:17.925466+0000","last_clean":"2024-09-15T22:14:17.925466+0000","last_became_active":"2024-09-15T22:14:13.848512+0000","last_became_peered":"2024-09-15T22:14:13.848512+0000","last_unstale":"2024-09-15T22:14:17.925466+0000","last_undegraded":"2024-09-15T22:14:17.925466+0000","last_fullsized":"2024-09-15T22:14:17.925466+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:44.050344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981511+0000","last_change":"2024-09-15T22:14:06.813915+0000","last_active":"2024-09-15T22:14:17.981511+0000","last_peered":"2024-09-15T22:14:17.981511+0000","last_clean":"2024-09-15T22:14:17.981511+0000","last_became_active":"2024-09-15T22:14:06.811803+0000","last_became_peered":"2024-09-15T22:14:06.811803+0000","last_unstale":"2024-09-15T22:14:17.981511+0000","last_undegraded":"2024-09-15T22:14:17.981511+0000","last_fullsized":"2024-09-15T22:14:17.981511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:42.117747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925236+0000","last_change":"2024-09-15T22:14:05.017360+0000","last_active":"2024-09-15T22:14:17.925236+0000","last_peered":"2024-09-15T22:14:17.925236+0000","last_clean":"2024-09-15T22:14:17.925236+0000","last_became_active":"2024-09-15T22:14:05.017004+0000","last_became_peered":"2024-09-15T22:14:05.017004+0000","last_unstale":"2024-09-15T22:14:17.925236+0000","last_undegraded":"2024-09-15T22:14:17.925236+0000","last_fullsized":"2024-09-15T22:14:17.925236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:01.366513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925719+0000","last_change":"2024-09-15T22:14:14.280215+0000","last_active":"2024-09-15T22:14:17.925719+0000","last_peered":"2024-09-15T22:14:17.925719+0000","last_clean":"2024-09-15T22:14:17.925719+0000","last_became_active":"2024-09-15T22:14:14.279750+0000","last_became_peered":"2024-09-15T22:14:14.279750+0000","last_unstale":"2024-09-15T22:14:17.925719+0000","last_undegraded":"2024-09-15T22:14:17.925719+0000","last_fullsized":"2024-09-15T22:14:17.925719+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:58.827582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925110+0000","last_change":"2024-09-15T22:14:06.812410+0000","last_active":"2024-09-15T22:14:17.925110+0000","last_peered":"2024-09-15T22:14:17.925110+0000","last_clean":"2024-09-15T22:14:17.925110+0000","last_became_active":"2024-09-15T22:14:06.812032+0000","last_became_peered":"2024-09-15T22:14:06.812032+0000","last_unstale":"2024-09-15T22:14:17.925110+0000","last_undegraded":"2024-09-15T22:14:17.925110+0000","last_fullsized":"2024-09-15T22:14:17.925110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:48.100213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848382+0000","last_change":"2024-09-15T22:14:04.719678+0000","last_active":"2024-09-15T22:14:16.848382+0000","last_peered":"2024-09-15T22:14:16.848382+0000","last_clean":"2024-09-15T22:14:16.848382+0000","last_became_active":"2024-09-15T22:14:04.719352+0000","last_became_peered":"2024-09-15T22:14:04.719352+0000","last_unstale":"2024-09-15T22:14:16.848382+0000","last_undegraded":"2024-09-15T22:14:16.848382+0000","last_fullsized":"2024-09-15T22:14:16.848382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.061957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.982002+0000","last_change":"2024-09-15T22:14:14.281314+0000","last_active":"2024-09-15T22:14:17.982002+0000","last_peered":"2024-09-15T22:14:17.982002+0000","last_clean":"2024-09-15T22:14:17.982002+0000","last_became_active":"2024-09-15T22:14:14.280859+0000","last_became_peered":"2024-09-15T22:14:14.280859+0000","last_unstale":"2024-09-15T22:14:17.982002+0000","last_undegraded":"2024-09-15T22:14:17.982002+0000","last_fullsized":"2024-09-15T22:14:17.982002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:18.796767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980738+0000","last_change":"2024-09-15T22:14:06.807101+0000","last_active":"2024-09-15T22:14:17.980738+0000","last_peered":"2024-09-15T22:14:17.980738+0000","last_clean":"2024-09-15T22:14:17.980738+0000","last_became_active":"2024-09-15T22:14:06.806801+0000","last_became_peered":"2024-09-15T22:14:06.806801+0000","last_unstale":"2024-09-15T22:14:17.980738+0000","last_undegraded":"2024-09-15T22:14:17.980738+0000","last_fullsized":"2024-09-15T22:14:17.980738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:48.096428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673321+0000","last_change":"2024-09-15T22:14:04.718038+0000","last_active":"2024-09-15T22:14:17.673321+0000","last_peered":"2024-09-15T22:14:17.673321+0000","last_clean":"2024-09-15T22:14:17.673321+0000","last_became_active":"2024-09-15T22:14:04.717683+0000","last_became_peered":"2024-09-15T22:14:04.717683+0000","last_unstale":"2024-09-15T22:14:17.673321+0000","last_undegraded":"2024-09-15T22:14:17.673321+0000","last_fullsized":"2024-09-15T22:14:17.673321+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:23.557077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":353,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848614+0000","last_change":"2024-09-15T22:12:55.022635+0000","last_active":"2024-09-15T22:14:16.848614+0000","last_peered":"2024-09-15T22:14:16.848614+0000","last_clean":"2024-09-15T22:14:16.848614+0000","last_became_active":"2024-09-15T22:12:55.022132+0000","last_became_peered":"2024-09-15T22:12:55.022132+0000","last_unstale":"2024-09-15T22:14:16.848614+0000","last_undegraded":"2024-09-15T22:14:16.848614+0000","last_fullsized":"2024-09-15T22:14:16.848614+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_clean_scrub_stamp":"2024-09-15T22:09:30.115505+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:50.060169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848908+0000","last_change":"2024-09-15T22:14:13.849547+0000","last_active":"2024-09-15T22:14:16.848908+0000","last_peered":"2024-09-15T22:14:16.848908+0000","last_clean":"2024-09-15T22:14:16.848908+0000","last_became_active":"2024-09-15T22:14:13.849091+0000","last_became_peered":"2024-09-15T22:14:13.849091+0000","last_unstale":"2024-09-15T22:14:16.848908+0000","last_undegraded":"2024-09-15T22:14:16.848908+0000","last_fullsized":"2024-09-15T22:14:16.848908+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:49.450958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848973+0000","last_change":"2024-09-15T22:14:06.816340+0000","last_active":"2024-09-15T22:14:16.848973+0000","last_peered":"2024-09-15T22:14:16.848973+0000","last_clean":"2024-09-15T22:14:16.848973+0000","last_became_active":"2024-09-15T22:14:06.815712+0000","last_became_peered":"2024-09-15T22:14:06.815712+0000","last_unstale":"2024-09-15T22:14:16.848973+0000","last_undegraded":"2024-09-15T22:14:16.848973+0000","last_fullsized":"2024-09-15T22:14:16.848973+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:43.598512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799897+0000","last_change":"2024-09-15T22:14:05.197487+0000","last_active":"2024-09-15T22:14:17.799897+0000","last_peered":"2024-09-15T22:14:17.799897+0000","last_clean":"2024-09-15T22:14:17.799897+0000","last_became_active":"2024-09-15T22:14:05.197098+0000","last_became_peered":"2024-09-15T22:14:05.197098+0000","last_unstale":"2024-09-15T22:14:17.799897+0000","last_undegraded":"2024-09-15T22:14:17.799897+0000","last_fullsized":"2024-09-15T22:14:17.799897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:31.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.158919+0000","last_change":"2024-09-15T22:14:13.849594+0000","last_active":"2024-09-15T22:14:17.158919+0000","last_peered":"2024-09-15T22:14:17.158919+0000","last_clean":"2024-09-15T22:14:17.158919+0000","last_became_active":"2024-09-15T22:14:13.849157+0000","last_became_peered":"2024-09-15T22:14:13.849157+0000","last_unstale":"2024-09-15T22:14:17.158919+0000","last_undegraded":"2024-09-15T22:14:17.158919+0000","last_fullsized":"2024-09-15T22:14:17.158919+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:49.994107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848773+0000","last_change":"2024-09-15T22:14:06.814312+0000","last_active":"2024-09-15T22:14:16.848773+0000","last_peered":"2024-09-15T22:14:16.848773+0000","last_clean":"2024-09-15T22:14:16.848773+0000","last_became_active":"2024-09-15T22:14:06.813959+0000","last_became_peered":"2024-09-15T22:14:06.813959+0000","last_unstale":"2024-09-15T22:14:16.848773+0000","last_undegraded":"2024-09-15T22:14:16.848773+0000","last_fullsized":"2024-09-15T22:14:16.848773+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:36.924162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.982195+0000","last_change":"2024-09-15T22:14:04.713307+0000","last_active":"2024-09-15T22:14:17.982195+0000","last_peered":"2024-09-15T22:14:17.982195+0000","last_clean":"2024-09-15T22:14:17.982195+0000","last_became_active":"2024-09-15T22:14:04.712996+0000","last_became_peered":"2024-09-15T22:14:04.712996+0000","last_unstale":"2024-09-15T22:14:17.982195+0000","last_undegraded":"2024-09-15T22:14:17.982195+0000","last_fullsized":"2024-09-15T22:14:17.982195+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:37.298679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845274+0000","last_change":"2024-09-15T22:14:13.846087+0000","last_active":"2024-09-15T22:14:16.845274+0000","last_peered":"2024-09-15T22:14:16.845274+0000","last_clean":"2024-09-15T22:14:16.845274+0000","last_became_active":"2024-09-15T22:14:13.845731+0000","last_became_peered":"2024-09-15T22:14:13.845731+0000","last_unstale":"2024-09-15T22:14:16.845274+0000","last_undegraded":"2024-09-15T22:14:16.845274+0000","last_fullsized":"2024-09-15T22:14:16.845274+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:24.621330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848886+0000","last_change":"2024-09-15T22:14:06.809456+0000","last_active":"2024-09-15T22:14:16.848886+0000","last_peered":"2024-09-15T22:14:16.848886+0000","last_clean":"2024-09-15T22:14:16.848886+0000","last_became_active":"2024-09-15T22:14:06.809141+0000","last_became_peered":"2024-09-15T22:14:06.809141+0000","last_unstale":"2024-09-15T22:14:16.848886+0000","last_undegraded":"2024-09-15T22:14:16.848886+0000","last_fullsized":"2024-09-15T22:14:16.848886+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:30.186800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925763+0000","last_change":"2024-09-15T22:14:04.715399+0000","last_active":"2024-09-15T22:14:17.925763+0000","last_peered":"2024-09-15T22:14:17.925763+0000","last_clean":"2024-09-15T22:14:17.925763+0000","last_became_active":"2024-09-15T22:14:04.715043+0000","last_became_peered":"2024-09-15T22:14:04.715043+0000","last_unstale":"2024-09-15T22:14:17.925763+0000","last_undegraded":"2024-09-15T22:14:17.925763+0000","last_fullsized":"2024-09-15T22:14:17.925763+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:13.860413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981239+0000","last_change":"2024-09-15T22:14:13.851594+0000","last_active":"2024-09-15T22:14:17.981239+0000","last_peered":"2024-09-15T22:14:17.981239+0000","last_clean":"2024-09-15T22:14:17.981239+0000","last_became_active":"2024-09-15T22:14:13.851154+0000","last_became_peered":"2024-09-15T22:14:13.851154+0000","last_unstale":"2024-09-15T22:14:17.981239+0000","last_undegraded":"2024-09-15T22:14:17.981239+0000","last_fullsized":"2024-09-15T22:14:17.981239+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:43.343808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193476+0000","last_change":"2024-09-15T22:14:06.817281+0000","last_active":"2024-09-15T22:14:17.193476+0000","last_peered":"2024-09-15T22:14:17.193476+0000","last_clean":"2024-09-15T22:14:17.193476+0000","last_became_active":"2024-09-15T22:14:06.816936+0000","last_became_peered":"2024-09-15T22:14:06.816936+0000","last_unstale":"2024-09-15T22:14:17.193476+0000","last_undegraded":"2024-09-15T22:14:17.193476+0000","last_fullsized":"2024-09-15T22:14:17.193476+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:40.049677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846794+0000","last_change":"2024-09-15T22:14:04.719550+0000","last_active":"2024-09-15T22:14:16.846794+0000","last_peered":"2024-09-15T22:14:16.846794+0000","last_clean":"2024-09-15T22:14:16.846794+0000","last_became_active":"2024-09-15T22:14:04.719273+0000","last_became_peered":"2024-09-15T22:14:04.719273+0000","last_unstale":"2024-09-15T22:14:16.846794+0000","last_undegraded":"2024-09-15T22:14:16.846794+0000","last_fullsized":"2024-09-15T22:14:16.846794+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:20.973615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981357+0000","last_change":"2024-09-15T22:14:13.851420+0000","last_active":"2024-09-15T22:14:17.981357+0000","last_peered":"2024-09-15T22:14:17.981357+0000","last_clean":"2024-09-15T22:14:17.981357+0000","last_became_active":"2024-09-15T22:14:13.851051+0000","last_became_peered":"2024-09-15T22:14:13.851051+0000","last_unstale":"2024-09-15T22:14:17.981357+0000","last_undegraded":"2024-09-15T22:14:17.981357+0000","last_fullsized":"2024-09-15T22:14:17.981357+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:11.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981520+0000","last_change":"2024-09-15T22:14:06.809609+0000","last_active":"2024-09-15T22:14:17.981520+0000","last_peered":"2024-09-15T22:14:17.981520+0000","last_clean":"2024-09-15T22:14:17.981520+0000","last_became_active":"2024-09-15T22:14:06.809213+0000","last_became_peered":"2024-09-15T22:14:06.809213+0000","last_unstale":"2024-09-15T22:14:17.981520+0000","last_undegraded":"2024-09-15T22:14:17.981520+0000","last_fullsized":"2024-09-15T22:14:17.981520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:11.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846277+0000","last_change":"2024-09-15T22:14:05.017559+0000","last_active":"2024-09-15T22:14:16.846277+0000","last_peered":"2024-09-15T22:14:16.846277+0000","last_clean":"2024-09-15T22:14:16.846277+0000","last_became_active":"2024-09-15T22:14:05.017121+0000","last_became_peered":"2024-09-15T22:14:05.017121+0000","last_unstale":"2024-09-15T22:14:16.846277+0000","last_undegraded":"2024-09-15T22:14:16.846277+0000","last_fullsized":"2024-09-15T22:14:16.846277+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:29:06.442532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925817+0000","last_change":"2024-09-15T22:14:13.847835+0000","last_active":"2024-09-15T22:14:17.925817+0000","last_peered":"2024-09-15T22:14:17.925817+0000","last_clean":"2024-09-15T22:14:17.925817+0000","last_became_active":"2024-09-15T22:14:13.847437+0000","last_became_peered":"2024-09-15T22:14:13.847437+0000","last_unstale":"2024-09-15T22:14:17.925817+0000","last_undegraded":"2024-09-15T22:14:17.925817+0000","last_fullsized":"2024-09-15T22:14:17.925817+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:48.036495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848310+0000","last_change":"2024-09-15T22:14:06.813191+0000","last_active":"2024-09-15T22:14:16.848310+0000","last_peered":"2024-09-15T22:14:16.848310+0000","last_clean":"2024-09-15T22:14:16.848310+0000","last_became_active":"2024-09-15T22:14:06.812861+0000","last_became_peered":"2024-09-15T22:14:06.812861+0000","last_unstale":"2024-09-15T22:14:16.848310+0000","last_undegraded":"2024-09-15T22:14:16.848310+0000","last_fullsized":"2024-09-15T22:14:16.848310+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:51.487591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673098+0000","last_change":"2024-09-15T22:14:04.718431+0000","last_active":"2024-09-15T22:14:17.673098+0000","last_peered":"2024-09-15T22:14:17.673098+0000","last_clean":"2024-09-15T22:14:17.673098+0000","last_became_active":"2024-09-15T22:14:04.718109+0000","last_became_peered":"2024-09-15T22:14:04.718109+0000","last_unstale":"2024-09-15T22:14:17.673098+0000","last_undegraded":"2024-09-15T22:14:17.673098+0000","last_fullsized":"2024-09-15T22:14:17.673098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:10.408634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100939+0000","last_change":"2024-09-15T22:14:13.845179+0000","last_active":"2024-09-15T22:14:17.100939+0000","last_peered":"2024-09-15T22:14:17.100939+0000","last_clean":"2024-09-15T22:14:17.100939+0000","last_became_active":"2024-09-15T22:14:13.844795+0000","last_became_peered":"2024-09-15T22:14:13.844795+0000","last_unstale":"2024-09-15T22:14:17.100939+0000","last_undegraded":"2024-09-15T22:14:17.100939+0000","last_fullsized":"2024-09-15T22:14:17.100939+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:24.113536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848583+0000","last_change":"2024-09-15T22:14:06.809687+0000","last_active":"2024-09-15T22:14:16.848583+0000","last_peered":"2024-09-15T22:14:16.848583+0000","last_clean":"2024-09-15T22:14:16.848583+0000","last_became_active":"2024-09-15T22:14:06.809383+0000","last_became_peered":"2024-09-15T22:14:06.809383+0000","last_unstale":"2024-09-15T22:14:16.848583+0000","last_undegraded":"2024-09-15T22:14:16.848583+0000","last_fullsized":"2024-09-15T22:14:16.848583+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:19.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981650+0000","last_change":"2024-09-15T22:14:04.720577+0000","last_active":"2024-09-15T22:14:17.981650+0000","last_peered":"2024-09-15T22:14:17.981650+0000","last_clean":"2024-09-15T22:14:17.981650+0000","last_became_active":"2024-09-15T22:14:04.720235+0000","last_became_peered":"2024-09-15T22:14:04.720235+0000","last_unstale":"2024-09-15T22:14:17.981650+0000","last_undegraded":"2024-09-15T22:14:17.981650+0000","last_fullsized":"2024-09-15T22:14:17.981650+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:17.501061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193223+0000","last_change":"2024-09-15T22:14:13.854841+0000","last_active":"2024-09-15T22:14:17.193223+0000","last_peered":"2024-09-15T22:14:17.193223+0000","last_clean":"2024-09-15T22:14:17.193223+0000","last_became_active":"2024-09-15T22:14:13.854336+0000","last_became_peered":"2024-09-15T22:14:13.854336+0000","last_unstale":"2024-09-15T22:14:17.193223+0000","last_undegraded":"2024-09-15T22:14:17.193223+0000","last_fullsized":"2024-09-15T22:14:17.193223+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:13.819532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925270+0000","last_change":"2024-09-15T22:14:06.806829+0000","last_active":"2024-09-15T22:14:17.925270+0000","last_peered":"2024-09-15T22:14:17.925270+0000","last_clean":"2024-09-15T22:14:17.925270+0000","last_became_active":"2024-09-15T22:14:06.806521+0000","last_became_peered":"2024-09-15T22:14:06.806521+0000","last_unstale":"2024-09-15T22:14:17.925270+0000","last_undegraded":"2024-09-15T22:14:17.925270+0000","last_fullsized":"2024-09-15T22:14:17.925270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:50.983246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799818+0000","last_change":"2024-09-15T22:14:04.717722+0000","last_active":"2024-09-15T22:14:17.799818+0000","last_peered":"2024-09-15T22:14:17.799818+0000","last_clean":"2024-09-15T22:14:17.799818+0000","last_became_active":"2024-09-15T22:14:04.717201+0000","last_became_peered":"2024-09-15T22:14:04.717201+0000","last_unstale":"2024-09-15T22:14:17.799818+0000","last_undegraded":"2024-09-15T22:14:17.799818+0000","last_fullsized":"2024-09-15T22:14:17.799818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:50.545847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981979+0000","last_change":"2024-09-15T22:14:13.852874+0000","last_active":"2024-09-15T22:14:17.981979+0000","last_peered":"2024-09-15T22:14:17.981979+0000","last_clean":"2024-09-15T22:14:17.981979+0000","last_became_active":"2024-09-15T22:14:13.852426+0000","last_became_peered":"2024-09-15T22:14:13.852426+0000","last_unstale":"2024-09-15T22:14:17.981979+0000","last_undegraded":"2024-09-15T22:14:17.981979+0000","last_fullsized":"2024-09-15T22:14:17.981979+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:02:19.215156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846682+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:14:16.846682+0000","last_peered":"2024-09-15T22:14:16.846682+0000","last_clean":"2024-09-15T22:14:16.846682+0000","last_became_active":"2024-09-15T22:14:06.809013+0000","last_became_peered":"2024-09-15T22:14:06.809013+0000","last_unstale":"2024-09-15T22:14:16.846682+0000","last_undegraded":"2024-09-15T22:14:16.846682+0000","last_fullsized":"2024-09-15T22:14:16.846682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:47.830385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'23","reported_seq":84,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:55.956879+0000","last_change":"2024-09-15T22:14:04.721020+0000","last_active":"2024-09-15T22:14:55.956879+0000","last_peered":"2024-09-15T22:14:55.956879+0000","last_clean":"2024-09-15T22:14:55.956879+0000","last_became_active":"2024-09-15T22:14:04.720613+0000","last_became_peered":"2024-09-15T22:14:04.720613+0000","last_unstale":"2024-09-15T22:14:55.956879+0000","last_undegraded":"2024-09-15T22:14:55.956879+0000","last_fullsized":"2024-09-15T22:14:55.956879+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:42.719346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43345,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":58,"num_write":23,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100547+0000","last_change":"2024-09-15T22:14:13.854250+0000","last_active":"2024-09-15T22:14:17.100547+0000","last_peered":"2024-09-15T22:14:17.100547+0000","last_clean":"2024-09-15T22:14:17.100547+0000","last_became_active":"2024-09-15T22:14:13.852972+0000","last_became_peered":"2024-09-15T22:14:13.852972+0000","last_unstale":"2024-09-15T22:14:17.100547+0000","last_undegraded":"2024-09-15T22:14:17.100547+0000","last_fullsized":"2024-09-15T22:14:17.100547+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:50:45.301446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.159052+0000","last_change":"2024-09-15T22:14:06.813789+0000","last_active":"2024-09-15T22:14:17.159052+0000","last_peered":"2024-09-15T22:14:17.159052+0000","last_clean":"2024-09-15T22:14:17.159052+0000","last_became_active":"2024-09-15T22:14:06.813501+0000","last_became_peered":"2024-09-15T22:14:06.813501+0000","last_unstale":"2024-09-15T22:14:17.159052+0000","last_undegraded":"2024-09-15T22:14:17.159052+0000","last_fullsized":"2024-09-15T22:14:17.159052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:40.032952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.982127+0000","last_change":"2024-09-15T22:14:05.018957+0000","last_active":"2024-09-15T22:14:17.982127+0000","last_peered":"2024-09-15T22:14:17.982127+0000","last_clean":"2024-09-15T22:14:17.982127+0000","last_became_active":"2024-09-15T22:14:05.018602+0000","last_became_peered":"2024-09-15T22:14:05.018602+0000","last_unstale":"2024-09-15T22:14:17.982127+0000","last_undegraded":"2024-09-15T22:14:17.982127+0000","last_fullsized":"2024-09-15T22:14:17.982127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:48.839341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673193+0000","last_change":"2024-09-15T22:14:13.848666+0000","last_active":"2024-09-15T22:14:17.673193+0000","last_peered":"2024-09-15T22:14:17.673193+0000","last_clean":"2024-09-15T22:14:17.673193+0000","last_became_active":"2024-09-15T22:14:13.848202+0000","last_became_peered":"2024-09-15T22:14:13.848202+0000","last_unstale":"2024-09-15T22:14:17.673193+0000","last_undegraded":"2024-09-15T22:14:17.673193+0000","last_fullsized":"2024-09-15T22:14:17.673193+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:15.739785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845650+0000","last_change":"2024-09-15T22:14:06.814876+0000","last_active":"2024-09-15T22:14:16.845650+0000","last_peered":"2024-09-15T22:14:16.845650+0000","last_clean":"2024-09-15T22:14:16.845650+0000","last_became_active":"2024-09-15T22:14:06.814120+0000","last_became_peered":"2024-09-15T22:14:06.814120+0000","last_unstale":"2024-09-15T22:14:16.845650+0000","last_undegraded":"2024-09-15T22:14:16.845650+0000","last_fullsized":"2024-09-15T22:14:16.845650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:37.417618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848901+0000","last_change":"2024-09-15T22:14:04.719281+0000","last_active":"2024-09-15T22:14:16.848901+0000","last_peered":"2024-09-15T22:14:16.848901+0000","last_clean":"2024-09-15T22:14:16.848901+0000","last_became_active":"2024-09-15T22:14:04.718856+0000","last_became_peered":"2024-09-15T22:14:04.718856+0000","last_unstale":"2024-09-15T22:14:16.848901+0000","last_undegraded":"2024-09-15T22:14:16.848901+0000","last_fullsized":"2024-09-15T22:14:16.848901+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:22.137825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100405+0000","last_change":"2024-09-15T22:14:13.847398+0000","last_active":"2024-09-15T22:14:17.100405+0000","last_peered":"2024-09-15T22:14:17.100405+0000","last_clean":"2024-09-15T22:14:17.100405+0000","last_became_active":"2024-09-15T22:14:13.846870+0000","last_became_peered":"2024-09-15T22:14:13.846870+0000","last_unstale":"2024-09-15T22:14:17.100405+0000","last_undegraded":"2024-09-15T22:14:17.100405+0000","last_fullsized":"2024-09-15T22:14:17.100405+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:58.872716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.159318+0000","last_change":"2024-09-15T22:14:06.810412+0000","last_active":"2024-09-15T22:14:17.159318+0000","last_peered":"2024-09-15T22:14:17.159318+0000","last_clean":"2024-09-15T22:14:17.159318+0000","last_became_active":"2024-09-15T22:14:06.809669+0000","last_became_peered":"2024-09-15T22:14:06.809669+0000","last_unstale":"2024-09-15T22:14:17.159318+0000","last_undegraded":"2024-09-15T22:14:17.159318+0000","last_fullsized":"2024-09-15T22:14:17.159318+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:44.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981333+0000","last_change":"2024-09-15T22:14:04.715509+0000","last_active":"2024-09-15T22:14:17.981333+0000","last_peered":"2024-09-15T22:14:17.981333+0000","last_clean":"2024-09-15T22:14:17.981333+0000","last_became_active":"2024-09-15T22:14:04.715169+0000","last_became_peered":"2024-09-15T22:14:04.715169+0000","last_unstale":"2024-09-15T22:14:17.981333+0000","last_undegraded":"2024-09-15T22:14:17.981333+0000","last_fullsized":"2024-09-15T22:14:17.981333+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:21.884103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980982+0000","last_change":"2024-09-15T22:14:13.849616+0000","last_active":"2024-09-15T22:14:17.980982+0000","last_peered":"2024-09-15T22:14:17.980982+0000","last_clean":"2024-09-15T22:14:17.980982+0000","last_became_active":"2024-09-15T22:14:13.849246+0000","last_became_peered":"2024-09-15T22:14:13.849246+0000","last_unstale":"2024-09-15T22:14:17.980982+0000","last_undegraded":"2024-09-15T22:14:17.980982+0000","last_fullsized":"2024-09-15T22:14:17.980982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:45.404227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845232+0000","last_change":"2024-09-15T22:14:13.844375+0000","last_active":"2024-09-15T22:14:16.845232+0000","last_peered":"2024-09-15T22:14:16.845232+0000","last_clean":"2024-09-15T22:14:16.845232+0000","last_became_active":"2024-09-15T22:14:13.843918+0000","last_became_peered":"2024-09-15T22:14:13.843918+0000","last_unstale":"2024-09-15T22:14:16.845232+0000","last_undegraded":"2024-09-15T22:14:16.845232+0000","last_fullsized":"2024-09-15T22:14:16.845232+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:32.190119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100520+0000","last_change":"2024-09-15T22:14:06.809534+0000","last_active":"2024-09-15T22:14:17.100520+0000","last_peered":"2024-09-15T22:14:17.100520+0000","last_clean":"2024-09-15T22:14:17.100520+0000","last_became_active":"2024-09-15T22:14:06.809147+0000","last_became_peered":"2024-09-15T22:14:06.809147+0000","last_unstale":"2024-09-15T22:14:17.100520+0000","last_undegraded":"2024-09-15T22:14:17.100520+0000","last_fullsized":"2024-09-15T22:14:17.100520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:14.930542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981608+0000","last_change":"2024-09-15T22:14:04.715347+0000","last_active":"2024-09-15T22:14:17.981608+0000","last_peered":"2024-09-15T22:14:17.981608+0000","last_clean":"2024-09-15T22:14:17.981608+0000","last_became_active":"2024-09-15T22:14:04.715049+0000","last_became_peered":"2024-09-15T22:14:04.715049+0000","last_unstale":"2024-09-15T22:14:17.981608+0000","last_undegraded":"2024-09-15T22:14:17.981608+0000","last_fullsized":"2024-09-15T22:14:17.981608+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:04.943344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193552+0000","last_change":"2024-09-15T22:14:13.852397+0000","last_active":"2024-09-15T22:14:17.193552+0000","last_peered":"2024-09-15T22:14:17.193552+0000","last_clean":"2024-09-15T22:14:17.193552+0000","last_became_active":"2024-09-15T22:14:13.851863+0000","last_became_peered":"2024-09-15T22:14:13.851863+0000","last_unstale":"2024-09-15T22:14:17.193552+0000","last_undegraded":"2024-09-15T22:14:17.193552+0000","last_fullsized":"2024-09-15T22:14:17.193552+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:38.242241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980592+0000","last_change":"2024-09-15T22:14:06.809084+0000","last_active":"2024-09-15T22:14:17.980592+0000","last_peered":"2024-09-15T22:14:17.980592+0000","last_clean":"2024-09-15T22:14:17.980592+0000","last_became_active":"2024-09-15T22:14:06.808725+0000","last_became_peered":"2024-09-15T22:14:06.808725+0000","last_unstale":"2024-09-15T22:14:17.980592+0000","last_undegraded":"2024-09-15T22:14:17.980592+0000","last_fullsized":"2024-09-15T22:14:17.980592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:37.451661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925119+0000","last_change":"2024-09-15T22:14:04.714279+0000","last_active":"2024-09-15T22:14:17.925119+0000","last_peered":"2024-09-15T22:14:17.925119+0000","last_clean":"2024-09-15T22:14:17.925119+0000","last_became_active":"2024-09-15T22:14:04.713751+0000","last_became_peered":"2024-09-15T22:14:04.713751+0000","last_unstale":"2024-09-15T22:14:17.925119+0000","last_undegraded":"2024-09-15T22:14:17.925119+0000","last_fullsized":"2024-09-15T22:14:17.925119+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:34.268701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981221+0000","last_change":"2024-09-15T22:14:04.716417+0000","last_active":"2024-09-15T22:14:17.981221+0000","last_peered":"2024-09-15T22:14:17.981221+0000","last_clean":"2024-09-15T22:14:17.981221+0000","last_became_active":"2024-09-15T22:14:04.716096+0000","last_became_peered":"2024-09-15T22:14:04.716096+0000","last_unstale":"2024-09-15T22:14:17.981221+0000","last_undegraded":"2024-09-15T22:14:17.981221+0000","last_fullsized":"2024-09-15T22:14:17.981221+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:30.819060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981765+0000","last_change":"2024-09-15T22:14:06.810505+0000","last_active":"2024-09-15T22:14:17.981765+0000","last_peered":"2024-09-15T22:14:17.981765+0000","last_clean":"2024-09-15T22:14:17.981765+0000","last_became_active":"2024-09-15T22:14:06.810190+0000","last_became_peered":"2024-09-15T22:14:06.810190+0000","last_unstale":"2024-09-15T22:14:17.981765+0000","last_undegraded":"2024-09-15T22:14:17.981765+0000","last_fullsized":"2024-09-15T22:14:17.981765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:00:40.708454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799646+0000","last_change":"2024-09-15T22:14:13.851371+0000","last_active":"2024-09-15T22:14:17.799646+0000","last_peered":"2024-09-15T22:14:17.799646+0000","last_clean":"2024-09-15T22:14:17.799646+0000","last_became_active":"2024-09-15T22:14:13.850976+0000","last_became_peered":"2024-09-15T22:14:13.850976+0000","last_unstale":"2024-09-15T22:14:17.799646+0000","last_undegraded":"2024-09-15T22:14:17.799646+0000","last_fullsized":"2024-09-15T22:14:17.799646+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:28.779584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981837+0000","last_change":"2024-09-15T22:14:04.718682+0000","last_active":"2024-09-15T22:14:17.981837+0000","last_peered":"2024-09-15T22:14:17.981837+0000","last_clean":"2024-09-15T22:14:17.981837+0000","last_became_active":"2024-09-15T22:14:04.718313+0000","last_became_peered":"2024-09-15T22:14:04.718313+0000","last_unstale":"2024-09-15T22:14:17.981837+0000","last_undegraded":"2024-09-15T22:14:17.981837+0000","last_fullsized":"2024-09-15T22:14:17.981837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:47.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846404+0000","last_change":"2024-09-15T22:14:06.819632+0000","last_active":"2024-09-15T22:14:16.846404+0000","last_peered":"2024-09-15T22:14:16.846404+0000","last_clean":"2024-09-15T22:14:16.846404+0000","last_became_active":"2024-09-15T22:14:06.819135+0000","last_became_peered":"2024-09-15T22:14:06.819135+0000","last_unstale":"2024-09-15T22:14:16.846404+0000","last_undegraded":"2024-09-15T22:14:16.846404+0000","last_fullsized":"2024-09-15T22:14:16.846404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:35.708318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799854+0000","last_change":"2024-09-15T22:14:13.851367+0000","last_active":"2024-09-15T22:14:17.799854+0000","last_peered":"2024-09-15T22:14:17.799854+0000","last_clean":"2024-09-15T22:14:17.799854+0000","last_became_active":"2024-09-15T22:14:13.850999+0000","last_became_peered":"2024-09-15T22:14:13.850999+0000","last_unstale":"2024-09-15T22:14:17.799854+0000","last_undegraded":"2024-09-15T22:14:17.799854+0000","last_fullsized":"2024-09-15T22:14:17.799854+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:40:03.957622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193039+0000","last_change":"2024-09-15T22:14:06.817213+0000","last_active":"2024-09-15T22:14:17.193039+0000","last_peered":"2024-09-15T22:14:17.193039+0000","last_clean":"2024-09-15T22:14:17.193039+0000","last_became_active":"2024-09-15T22:14:06.816828+0000","last_became_peered":"2024-09-15T22:14:06.816828+0000","last_unstale":"2024-09-15T22:14:17.193039+0000","last_undegraded":"2024-09-15T22:14:17.193039+0000","last_fullsized":"2024-09-15T22:14:17.193039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:55.042256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799809+0000","last_change":"2024-09-15T22:14:06.814832+0000","last_active":"2024-09-15T22:14:17.799809+0000","last_peered":"2024-09-15T22:14:17.799809+0000","last_clean":"2024-09-15T22:14:17.799809+0000","last_became_active":"2024-09-15T22:14:06.814500+0000","last_became_peered":"2024-09-15T22:14:06.814500+0000","last_unstale":"2024-09-15T22:14:17.799809+0000","last_undegraded":"2024-09-15T22:14:17.799809+0000","last_fullsized":"2024-09-15T22:14:17.799809+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:43.623629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799484+0000","last_change":"2024-09-15T22:14:06.809464+0000","last_active":"2024-09-15T22:14:17.799484+0000","last_peered":"2024-09-15T22:14:17.799484+0000","last_clean":"2024-09-15T22:14:17.799484+0000","last_became_active":"2024-09-15T22:14:06.809160+0000","last_became_peered":"2024-09-15T22:14:06.809160+0000","last_unstale":"2024-09-15T22:14:17.799484+0000","last_undegraded":"2024-09-15T22:14:17.799484+0000","last_fullsized":"2024-09-15T22:14:17.799484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:04.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845383+0000","last_change":"2024-09-15T22:14:06.814428+0000","last_active":"2024-09-15T22:14:16.845383+0000","last_peered":"2024-09-15T22:14:16.845383+0000","last_clean":"2024-09-15T22:14:16.845383+0000","last_became_active":"2024-09-15T22:14:06.814100+0000","last_became_peered":"2024-09-15T22:14:06.814100+0000","last_unstale":"2024-09-15T22:14:16.845383+0000","last_undegraded":"2024-09-15T22:14:16.845383+0000","last_fullsized":"2024-09-15T22:14:16.845383+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:33.606766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925569+0000","last_change":"2024-09-15T22:14:06.815638+0000","last_active":"2024-09-15T22:14:17.925569+0000","last_peered":"2024-09-15T22:14:17.925569+0000","last_clean":"2024-09-15T22:14:17.925569+0000","last_became_active":"2024-09-15T22:14:06.815327+0000","last_became_peered":"2024-09-15T22:14:06.815327+0000","last_unstale":"2024-09-15T22:14:17.925569+0000","last_undegraded":"2024-09-15T22:14:17.925569+0000","last_fullsized":"2024-09-15T22:14:17.925569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:07.679547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193434+0000","last_change":"2024-09-15T22:14:06.818629+0000","last_active":"2024-09-15T22:14:17.193434+0000","last_peered":"2024-09-15T22:14:17.193434+0000","last_clean":"2024-09-15T22:14:17.193434+0000","last_became_active":"2024-09-15T22:14:06.818315+0000","last_became_peered":"2024-09-15T22:14:06.818315+0000","last_unstale":"2024-09-15T22:14:17.193434+0000","last_undegraded":"2024-09-15T22:14:17.193434+0000","last_fullsized":"2024-09-15T22:14:17.193434+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:36.286343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.800050+0000","last_change":"2024-09-15T22:14:06.819667+0000","last_active":"2024-09-15T22:14:17.800050+0000","last_peered":"2024-09-15T22:14:17.800050+0000","last_clean":"2024-09-15T22:14:17.800050+0000","last_became_active":"2024-09-15T22:14:06.819389+0000","last_became_peered":"2024-09-15T22:14:06.819389+0000","last_unstale":"2024-09-15T22:14:17.800050+0000","last_undegraded":"2024-09-15T22:14:17.800050+0000","last_fullsized":"2024-09-15T22:14:17.800050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:16.571088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980949+0000","last_change":"2024-09-15T22:14:06.809927+0000","last_active":"2024-09-15T22:14:17.980949+0000","last_peered":"2024-09-15T22:14:17.980949+0000","last_clean":"2024-09-15T22:14:17.980949+0000","last_became_active":"2024-09-15T22:14:06.809633+0000","last_became_peered":"2024-09-15T22:14:06.809633+0000","last_unstale":"2024-09-15T22:14:17.980949+0000","last_undegraded":"2024-09-15T22:14:17.980949+0000","last_fullsized":"2024-09-15T22:14:17.980949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:12.428738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981363+0000","last_change":"2024-09-15T22:14:06.801454+0000","last_active":"2024-09-15T22:14:17.981363+0000","last_peered":"2024-09-15T22:14:17.981363+0000","last_clean":"2024-09-15T22:14:17.981363+0000","last_became_active":"2024-09-15T22:14:06.801105+0000","last_became_peered":"2024-09-15T22:14:06.801105+0000","last_unstale":"2024-09-15T22:14:17.981363+0000","last_undegraded":"2024-09-15T22:14:17.981363+0000","last_fullsized":"2024-09-15T22:14:17.981363+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:32.457428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980619+0000","last_change":"2024-09-15T22:14:06.812603+0000","last_active":"2024-09-15T22:14:17.980619+0000","last_peered":"2024-09-15T22:14:17.980619+0000","last_clean":"2024-09-15T22:14:17.980619+0000","last_became_active":"2024-09-15T22:14:06.812208+0000","last_became_peered":"2024-09-15T22:14:06.812208+0000","last_unstale":"2024-09-15T22:14:17.980619+0000","last_undegraded":"2024-09-15T22:14:17.980619+0000","last_fullsized":"2024-09-15T22:14:17.980619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:55.327481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.159017+0000","last_change":"2024-09-15T22:14:06.811783+0000","last_active":"2024-09-15T22:14:17.159017+0000","last_peered":"2024-09-15T22:14:17.159017+0000","last_clean":"2024-09-15T22:14:17.159017+0000","last_became_active":"2024-09-15T22:14:06.811208+0000","last_became_peered":"2024-09-15T22:14:06.811208+0000","last_unstale":"2024-09-15T22:14:17.159017+0000","last_undegraded":"2024-09-15T22:14:17.159017+0000","last_fullsized":"2024-09-15T22:14:17.159017+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:15.576776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925425+0000","last_change":"2024-09-15T22:14:06.818608+0000","last_active":"2024-09-15T22:14:17.925425+0000","last_peered":"2024-09-15T22:14:17.925425+0000","last_clean":"2024-09-15T22:14:17.925425+0000","last_became_active":"2024-09-15T22:14:06.818283+0000","last_became_peered":"2024-09-15T22:14:06.818283+0000","last_unstale":"2024-09-15T22:14:17.925425+0000","last_undegraded":"2024-09-15T22:14:17.925425+0000","last_fullsized":"2024-09-15T22:14:17.925425+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:02.477461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193201+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:14:17.193201+0000","last_peered":"2024-09-15T22:14:17.193201+0000","last_clean":"2024-09-15T22:14:17.193201+0000","last_became_active":"2024-09-15T22:14:06.809043+0000","last_became_peered":"2024-09-15T22:14:06.809043+0000","last_unstale":"2024-09-15T22:14:17.193201+0000","last_undegraded":"2024-09-15T22:14:17.193201+0000","last_fullsized":"2024-09-15T22:14:17.193201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:58.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.799999+0000","last_change":"2024-09-15T22:14:06.814875+0000","last_active":"2024-09-15T22:14:17.799999+0000","last_peered":"2024-09-15T22:14:17.799999+0000","last_clean":"2024-09-15T22:14:17.799999+0000","last_became_active":"2024-09-15T22:14:06.814543+0000","last_became_peered":"2024-09-15T22:14:06.814543+0000","last_unstale":"2024-09-15T22:14:17.799999+0000","last_undegraded":"2024-09-15T22:14:17.799999+0000","last_fullsized":"2024-09-15T22:14:17.799999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:57.465965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.100919+0000","last_change":"2024-09-15T22:14:06.810655+0000","last_active":"2024-09-15T22:14:17.100919+0000","last_peered":"2024-09-15T22:14:17.100919+0000","last_clean":"2024-09-15T22:14:17.100919+0000","last_became_active":"2024-09-15T22:14:06.810159+0000","last_became_peered":"2024-09-15T22:14:06.810159+0000","last_unstale":"2024-09-15T22:14:17.100919+0000","last_undegraded":"2024-09-15T22:14:17.100919+0000","last_fullsized":"2024-09-15T22:14:17.100919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:17.368982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193687+0000","last_change":"2024-09-15T22:14:06.815048+0000","last_active":"2024-09-15T22:14:17.193687+0000","last_peered":"2024-09-15T22:14:17.193687+0000","last_clean":"2024-09-15T22:14:17.193687+0000","last_became_active":"2024-09-15T22:14:06.814744+0000","last_became_peered":"2024-09-15T22:14:06.814744+0000","last_unstale":"2024-09-15T22:14:17.193687+0000","last_undegraded":"2024-09-15T22:14:17.193687+0000","last_fullsized":"2024-09-15T22:14:17.193687+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:26.927942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.158674+0000","last_change":"2024-09-15T22:14:06.811672+0000","last_active":"2024-09-15T22:14:17.158674+0000","last_peered":"2024-09-15T22:14:17.158674+0000","last_clean":"2024-09-15T22:14:17.158674+0000","last_became_active":"2024-09-15T22:14:06.811300+0000","last_became_peered":"2024-09-15T22:14:06.811300+0000","last_unstale":"2024-09-15T22:14:17.158674+0000","last_undegraded":"2024-09-15T22:14:17.158674+0000","last_fullsized":"2024-09-15T22:14:17.158674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:46.223584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845032+0000","last_change":"2024-09-15T22:14:06.814495+0000","last_active":"2024-09-15T22:14:16.845032+0000","last_peered":"2024-09-15T22:14:16.845032+0000","last_clean":"2024-09-15T22:14:16.845032+0000","last_became_active":"2024-09-15T22:14:06.814142+0000","last_became_peered":"2024-09-15T22:14:06.814142+0000","last_unstale":"2024-09-15T22:14:16.845032+0000","last_undegraded":"2024-09-15T22:14:16.845032+0000","last_fullsized":"2024-09-15T22:14:16.845032+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:20.374348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.844998+0000","last_change":"2024-09-15T22:14:06.811063+0000","last_active":"2024-09-15T22:14:16.844998+0000","last_peered":"2024-09-15T22:14:16.844998+0000","last_clean":"2024-09-15T22:14:16.844998+0000","last_became_active":"2024-09-15T22:14:06.810700+0000","last_became_peered":"2024-09-15T22:14:06.810700+0000","last_unstale":"2024-09-15T22:14:16.844998+0000","last_undegraded":"2024-09-15T22:14:16.844998+0000","last_fullsized":"2024-09-15T22:14:16.844998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:11.250590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.925400+0000","last_change":"2024-09-15T22:14:06.816896+0000","last_active":"2024-09-15T22:14:17.925400+0000","last_peered":"2024-09-15T22:14:17.925400+0000","last_clean":"2024-09-15T22:14:17.925400+0000","last_became_active":"2024-09-15T22:14:06.816559+0000","last_became_peered":"2024-09-15T22:14:06.816559+0000","last_unstale":"2024-09-15T22:14:17.925400+0000","last_undegraded":"2024-09-15T22:14:17.925400+0000","last_fullsized":"2024-09-15T22:14:17.925400+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:17.965490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673377+0000","last_change":"2024-09-15T22:14:06.813984+0000","last_active":"2024-09-15T22:14:17.673377+0000","last_peered":"2024-09-15T22:14:17.673377+0000","last_clean":"2024-09-15T22:14:17.673377+0000","last_became_active":"2024-09-15T22:14:06.813586+0000","last_became_peered":"2024-09-15T22:14:06.813586+0000","last_unstale":"2024-09-15T22:14:17.673377+0000","last_undegraded":"2024-09-15T22:14:17.673377+0000","last_fullsized":"2024-09-15T22:14:17.673377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:34.335741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848969+0000","last_change":"2024-09-15T22:14:06.816047+0000","last_active":"2024-09-15T22:14:16.848969+0000","last_peered":"2024-09-15T22:14:16.848969+0000","last_clean":"2024-09-15T22:14:16.848969+0000","last_became_active":"2024-09-15T22:14:06.815244+0000","last_became_peered":"2024-09-15T22:14:06.815244+0000","last_unstale":"2024-09-15T22:14:16.848969+0000","last_undegraded":"2024-09-15T22:14:16.848969+0000","last_fullsized":"2024-09-15T22:14:16.848969+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:30.469382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981635+0000","last_change":"2024-09-15T22:14:06.813254+0000","last_active":"2024-09-15T22:14:17.981635+0000","last_peered":"2024-09-15T22:14:17.981635+0000","last_clean":"2024-09-15T22:14:17.981635+0000","last_became_active":"2024-09-15T22:14:06.812921+0000","last_became_peered":"2024-09-15T22:14:06.812921+0000","last_unstale":"2024-09-15T22:14:17.981635+0000","last_undegraded":"2024-09-15T22:14:17.981635+0000","last_fullsized":"2024-09-15T22:14:17.981635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:40.674246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.159398+0000","last_change":"2024-09-15T22:14:06.817016+0000","last_active":"2024-09-15T22:14:17.159398+0000","last_peered":"2024-09-15T22:14:17.159398+0000","last_clean":"2024-09-15T22:14:17.159398+0000","last_became_active":"2024-09-15T22:14:06.816256+0000","last_became_peered":"2024-09-15T22:14:06.816256+0000","last_unstale":"2024-09-15T22:14:17.159398+0000","last_undegraded":"2024-09-15T22:14:17.159398+0000","last_fullsized":"2024-09-15T22:14:17.159398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:37.092156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.980563+0000","last_change":"2024-09-15T22:14:06.797435+0000","last_active":"2024-09-15T22:14:17.980563+0000","last_peered":"2024-09-15T22:14:17.980563+0000","last_clean":"2024-09-15T22:14:17.980563+0000","last_became_active":"2024-09-15T22:14:06.797135+0000","last_became_peered":"2024-09-15T22:14:06.797135+0000","last_unstale":"2024-09-15T22:14:17.980563+0000","last_undegraded":"2024-09-15T22:14:17.980563+0000","last_fullsized":"2024-09-15T22:14:17.980563+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:37.326281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.848376+0000","last_change":"2024-09-15T22:14:06.814902+0000","last_active":"2024-09-15T22:14:16.848376+0000","last_peered":"2024-09-15T22:14:16.848376+0000","last_clean":"2024-09-15T22:14:16.848376+0000","last_became_active":"2024-09-15T22:14:06.814563+0000","last_became_peered":"2024-09-15T22:14:06.814563+0000","last_unstale":"2024-09-15T22:14:16.848376+0000","last_undegraded":"2024-09-15T22:14:16.848376+0000","last_fullsized":"2024-09-15T22:14:16.848376+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:02.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.981167+0000","last_change":"2024-09-15T22:14:06.807444+0000","last_active":"2024-09-15T22:14:17.981167+0000","last_peered":"2024-09-15T22:14:17.981167+0000","last_clean":"2024-09-15T22:14:17.981167+0000","last_became_active":"2024-09-15T22:14:06.807083+0000","last_became_peered":"2024-09-15T22:14:06.807083+0000","last_unstale":"2024-09-15T22:14:17.981167+0000","last_undegraded":"2024-09-15T22:14:17.981167+0000","last_fullsized":"2024-09-15T22:14:17.981167+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:07.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.846341+0000","last_change":"2024-09-15T22:14:06.811851+0000","last_active":"2024-09-15T22:14:16.846341+0000","last_peered":"2024-09-15T22:14:16.846341+0000","last_clean":"2024-09-15T22:14:16.846341+0000","last_became_active":"2024-09-15T22:14:06.811451+0000","last_became_peered":"2024-09-15T22:14:06.811451+0000","last_unstale":"2024-09-15T22:14:16.846341+0000","last_undegraded":"2024-09-15T22:14:16.846341+0000","last_fullsized":"2024-09-15T22:14:16.846341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:51.389555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.673252+0000","last_change":"2024-09-15T22:14:06.812520+0000","last_active":"2024-09-15T22:14:17.673252+0000","last_peered":"2024-09-15T22:14:17.673252+0000","last_clean":"2024-09-15T22:14:17.673252+0000","last_became_active":"2024-09-15T22:14:06.812222+0000","last_became_peered":"2024-09-15T22:14:06.812222+0000","last_unstale":"2024-09-15T22:14:17.673252+0000","last_undegraded":"2024-09-15T22:14:17.673252+0000","last_fullsized":"2024-09-15T22:14:17.673252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:01.589678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845163+0000","last_change":"2024-09-15T22:14:06.808649+0000","last_active":"2024-09-15T22:14:16.845163+0000","last_peered":"2024-09-15T22:14:16.845163+0000","last_clean":"2024-09-15T22:14:16.845163+0000","last_became_active":"2024-09-15T22:14:06.808278+0000","last_became_peered":"2024-09-15T22:14:06.808278+0000","last_unstale":"2024-09-15T22:14:16.845163+0000","last_undegraded":"2024-09-15T22:14:16.845163+0000","last_fullsized":"2024-09-15T22:14:16.845163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:32.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:16.845336+0000","last_change":"2024-09-15T22:14:06.811593+0000","last_active":"2024-09-15T22:14:16.845336+0000","last_peered":"2024-09-15T22:14:16.845336+0000","last_clean":"2024-09-15T22:14:16.845336+0000","last_became_active":"2024-09-15T22:14:06.811285+0000","last_became_peered":"2024-09-15T22:14:06.811285+0000","last_unstale":"2024-09-15T22:14:16.845336+0000","last_undegraded":"2024-09-15T22:14:16.845336+0000","last_fullsized":"2024-09-15T22:14:16.845336+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:36.482554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-15T22:14:17.193621+0000","last_change":"2024-09-15T22:14:06.816084+0000","last_active":"2024-09-15T22:14:17.193621+0000","last_peered":"2024-09-15T22:14:17.193621+0000","last_clean":"2024-09-15T22:14:17.193621+0000","last_became_active":"2024-09-15T22:14:06.815461+0000","last_became_peered":"2024-09-15T22:14:06.815461+0000","last_unstale":"2024-09-15T22:14:17.193621+0000","last_undegraded":"2024-09-15T22:14:17.193621+0000","last_fullsized":"2024-09-15T22:14:17.193621+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:57.455608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":44143,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":37,"num_read_kb":64,"num_write":72,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":165195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547223,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":482238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776155,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1634304,"data_stored":1112049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939680,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":486916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168614,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":482842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430250,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1581056,"data_stored":1077284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593776,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":974848,"data_stored":478142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822709,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36892,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708260,"statfs":{"total":95995035648,"available":95957258240,"internally_reserved":0,"allocated":1585152,"data_stored":1072788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986233,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":482260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215167,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":478246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36368,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708784,"statfs":{"total":95995035648,"available":95957794816,"internally_reserved":0,"allocated":1048576,"data_stored":537904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1044480,"data_stored":537870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40468,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704684,"statfs":{"total":95995035648,"available":95953596416,"internally_reserved":0,"allocated":978944,"data_stored":478232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":59762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":43539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:15:02.082 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T22:15:02.082 INFO:tasks.cephadm:Setting up client nodes... 2024-09-15T22:15:02.082 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-15T22:15:02.339 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:02.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.818+0000 7f83d1349640 1 -- 172.21.15.45:0/1756558856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83cc1037d0 msgr2=0x7f83cc10a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:02.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.818+0000 7f83d1349640 1 --2- 172.21.15.45:0/1756558856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83cc1037d0 0x7f83cc10a060 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009900 tx=0x7f83c002a410 comp rx=0 tx=0).stop 2024-09-15T22:15:02.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.818+0000 7f83d1349640 1 -- 172.21.15.45:0/1756558856 shutdown_connections 2024-09-15T22:15:02.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.818+0000 7f83d1349640 1 --2- 172.21.15.45:0/1756558856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83cc1037d0 0x7f83cc10a060 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:02.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.818+0000 7f83d1349640 1 --2- 172.21.15.45:0/1756558856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc102e10 0x7f83cc103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:02.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.818+0000 7f83d1349640 1 --2- 172.21.15.45:0/1756558856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83cc101c10 0x7f83cc102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:02.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.818+0000 7f83d1349640 1 -- 172.21.15.45:0/1756558856 >> 172.21.15.45:0/1756558856 conn(0x7f83cc0fd3c0 msgr2=0x7f83cc0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:02.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.818+0000 7f83d1349640 1 -- 172.21.15.45:0/1756558856 shutdown_connections 2024-09-15T22:15:02.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.818+0000 7f83d1349640 1 -- 172.21.15.45:0/1756558856 wait complete. 2024-09-15T22:15:02.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.818+0000 7f83d1349640 1 Processor -- start 2024-09-15T22:15:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83d1349640 1 -- start start 2024-09-15T22:15:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83d1349640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83cc101c10 0x7f83cc197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83d1349640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc102e10 0x7f83cc1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83d1349640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83cc1037d0 0x7f83cc19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83d1349640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc10da20 con 0x7f83cc101c10 2024-09-15T22:15:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83d1349640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc10d8a0 con 0x7f83cc102e10 2024-09-15T22:15:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83d1349640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc10dba0 con 0x7f83cc1037d0 2024-09-15T22:15:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83caffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83cc101c10 0x7f83cc197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83caffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83cc101c10 0x7f83cc197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41202/0 (socket says 172.21.15.45:41202) 2024-09-15T22:15:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83caffd640 1 -- 172.21.15.45:0/1640558257 learned_addr learned my addr 172.21.15.45:0/1640558257 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83ca7fc640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc102e10 0x7f83cc1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:02.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83cb7fe640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83cc1037d0 0x7f83cc19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:02.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83caffd640 1 -- 172.21.15.45:0/1640558257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83cc1037d0 msgr2=0x7f83cc19f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:02.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83caffd640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83cc1037d0 0x7f83cc19f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:02.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83caffd640 1 -- 172.21.15.45:0/1640558257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc102e10 msgr2=0x7f83cc1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:02.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83caffd640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc102e10 0x7f83cc1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:02.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.819+0000 7f83caffd640 1 -- 172.21.15.45:0/1640558257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc19fb90 con 0x7f83cc101c10 2024-09-15T22:15:02.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.820+0000 7f83ca7fc640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc102e10 0x7f83cc1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:15:02.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.820+0000 7f83caffd640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83cc101c10 0x7f83cc197f60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00e9c0 tx=0x7f83bc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:02.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.820+0000 7f83b3fff640 1 -- 172.21.15.45:0/1640558257 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00cd80 con 0x7f83cc101c10 2024-09-15T22:15:02.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.820+0000 7f83d1349640 1 -- 172.21.15.45:0/1640558257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83cc19fe80 con 0x7f83cc101c10 2024-09-15T22:15:02.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.820+0000 7f83b3fff640 1 -- 172.21.15.45:0/1640558257 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f83bc0035f0 con 0x7f83cc101c10 2024-09-15T22:15:02.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.820+0000 7f83b3fff640 1 -- 172.21.15.45:0/1640558257 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc010670 con 0x7f83cc101c10 2024-09-15T22:15:02.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.820+0000 7f83d1349640 1 -- 172.21.15.45:0/1640558257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83cc1a02d0 con 0x7f83cc101c10 2024-09-15T22:15:02.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.821+0000 7f83d1349640 1 -- 172.21.15.45:0/1640558257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83cc108ee0 con 0x7f83cc101c10 2024-09-15T22:15:02.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.822+0000 7f83b3fff640 1 -- 172.21.15.45:0/1640558257 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f83bc0037a0 con 0x7f83cc101c10 2024-09-15T22:15:02.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.823+0000 7f83b3fff640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f83b40a3300 0x7f83b40a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:02.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.823+0000 7f83ca7fc640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f83b40a3300 0x7f83b40a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:02.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.823+0000 7f83b3fff640 1 -- 172.21.15.45:0/1640558257 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f83bc0d0010 con 0x7f83cc101c10 2024-09-15T22:15:02.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.824+0000 7f83ca7fc640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f83b40a3300 0x7f83b40a57c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f83cc199480 tx=0x7f83c4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:02.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:02.827+0000 7f83b3fff640 1 -- 172.21.15.45:0/1640558257 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f83bc09c990 con 0x7f83cc101c10 2024-09-15T22:15:03.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:02 smithi045 ceph-mon[31180]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:15:03.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:02 smithi045 ceph-mon[31180]: pgmap v310: 129 pgs: 129 active+clean; 636 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2024-09-15T22:15:03.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.070+0000 7f83d1349640 1 -- 172.21.15.45:0/1640558257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f83cc02da30 con 0x7f83cc101c10 2024-09-15T22:15:03.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.072+0000 7f83b3fff640 1 -- 172.21.15.45:0/1640558257 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f83bc09c290 con 0x7f83cc101c10 2024-09-15T22:15:03.074 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2024-09-15T22:15:03.074 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQBnXOdmfWVGBBAAVYhd7vVPd72sLT//BQ+P7g== 2024-09-15T22:15:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.074+0000 7f83d1349640 1 -- 172.21.15.45:0/1640558257 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f83b40a3300 msgr2=0x7f83b40a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.074+0000 7f83d1349640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f83b40a3300 0x7f83b40a57c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f83cc199480 tx=0x7f83c4009500 comp rx=0 tx=0).stop 2024-09-15T22:15:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.074+0000 7f83d1349640 1 -- 172.21.15.45:0/1640558257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83cc101c10 msgr2=0x7f83cc197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.074+0000 7f83d1349640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83cc101c10 0x7f83cc197f60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00e9c0 tx=0x7f83bc00ee80 comp rx=0 tx=0).stop 2024-09-15T22:15:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.074+0000 7f83d1349640 1 -- 172.21.15.45:0/1640558257 shutdown_connections 2024-09-15T22:15:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.074+0000 7f83d1349640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f83b40a3300 0x7f83b40a57c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.074+0000 7f83d1349640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f83cc1037d0 0x7f83cc19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.074+0000 7f83d1349640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83cc102e10 0x7f83cc1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.074+0000 7f83d1349640 1 --2- 172.21.15.45:0/1640558257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83cc101c10 0x7f83cc197f60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.074+0000 7f83d1349640 1 -- 172.21.15.45:0/1640558257 >> 172.21.15.45:0/1640558257 conn(0x7f83cc0fd3c0 msgr2=0x7f83cc1060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.074+0000 7f83d1349640 1 -- 172.21.15.45:0/1640558257 shutdown_connections 2024-09-15T22:15:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:03.074+0000 7f83d1349640 1 -- 172.21.15.45:0/1640558257 wait complete. 2024-09-15T22:15:03.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:02 smithi100 ceph-mon[35319]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:15:03.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:02 smithi100 ceph-mon[35319]: pgmap v310: 129 pgs: 129 active+clean; 636 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2024-09-15T22:15:03.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:02 smithi165 ceph-mon[35551]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:15:03.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:02 smithi165 ceph-mon[35551]: pgmap v310: 129 pgs: 129 active+clean; 636 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2024-09-15T22:15:03.839 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:15:03.839 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-15T22:15:03.839 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T22:15:03.879 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T22:15:03.880 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-15T22:15:03.880 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-15T22:15:04.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:03 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1640558257' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:15:04.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:03 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1640558257' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:15:04.051 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:03 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:04.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:03 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1640558257' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:15:04.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:03 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1640558257' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:15:04.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:03 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:04.326 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:03 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1640558257' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T22:15:04.326 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:03 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1640558257' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T22:15:04.326 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:03 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:15:04.697 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:05.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.163+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2141472645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b38103670 msgr2=0x7f3b3810bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:05.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.163+0000 7f3b3d9d8640 1 --2- 172.21.15.45:0/2141472645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b38103670 0x7f3b3810bb60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009900 tx=0x7f3b2c02a480 comp rx=0 tx=0).stop 2024-09-15T22:15:05.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.163+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2141472645 shutdown_connections 2024-09-15T22:15:05.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.163+0000 7f3b3d9d8640 1 --2- 172.21.15.45:0/2141472645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b3810c180 0x7f3b3810e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.163+0000 7f3b3d9d8640 1 --2- 172.21.15.45:0/2141472645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b38103670 0x7f3b3810bb60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.163+0000 7f3b3d9d8640 1 --2- 172.21.15.45:0/2141472645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38102d50 0x7f3b38103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.163+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2141472645 >> 172.21.15.45:0/2141472645 conn(0x7f3b380fc7d0 msgr2=0x7f3b380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:05.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.163+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2141472645 shutdown_connections 2024-09-15T22:15:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.163+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2141472645 wait complete. 2024-09-15T22:15:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.164+0000 7f3b3d9d8640 1 Processor -- start 2024-09-15T22:15:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.164+0000 7f3b3d9d8640 1 -- start start 2024-09-15T22:15:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.164+0000 7f3b3d9d8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b38102d50 0x7f3b38198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.164+0000 7f3b3d9d8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38103670 0x7f3b38198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.164+0000 7f3b3d9d8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b3810c180 0x7f3b3819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.164+0000 7f3b3d9d8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3b381120a0 con 0x7f3b38102d50 2024-09-15T22:15:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.164+0000 7f3b3d9d8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b38111f20 con 0x7f3b38103670 2024-09-15T22:15:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.164+0000 7f3b3d9d8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b38112220 con 0x7f3b3810c180 2024-09-15T22:15:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.164+0000 7f3b36ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b38102d50 0x7f3b38198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b36ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b38102d50 0x7f3b38198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34186/0 (socket says 172.21.15.45:34186) 2024-09-15T22:15:05.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b36ffd640 1 -- 172.21.15.45:0/2831673026 learned_addr learned my addr 172.21.15.45:0/2831673026 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b367fc640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38103670 0x7f3b38198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b377fe640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b3810c180 0x7f3b3819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b367fc640 1 -- 172.21.15.45:0/2831673026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b3810c180 msgr2=0x7f3b3819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b367fc640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b3810c180 0x7f3b3819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b367fc640 1 -- 172.21.15.45:0/2831673026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b38102d50 msgr2=0x7f3b38198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b367fc640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b38102d50 0x7f3b38198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b367fc640 1 -- 172.21.15.45:0/2831673026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3819d530 con 0x7f3b38103670 2024-09-15T22:15:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b377fe640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b3810c180 0x7f3b3819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:15:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b367fc640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38103670 0x7f3b38198ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c005940 tx=0x7f3b2c032f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b3c9d6640 1 -- 172.21.15.45:0/2831673026 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c03f030 con 0x7f3b38103670 2024-09-15T22:15:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2831673026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3819d7c0 con 0x7f3b38103670 2024-09-15T22:15:05.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b3c9d6640 1 -- 172.21.15.45:0/2831673026 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3b2c0043d0 con 0x7f3b38103670 2024-09-15T22:15:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b3c9d6640 1 -- 172.21.15.45:0/2831673026 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c035070 con 0x7f3b38103670 2024-09-15T22:15:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.165+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2831673026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b381a5100 con 0x7f3b38103670 2024-09-15T22:15:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.166+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2831673026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b38103130 con 0x7f3b38103670 2024-09-15T22:15:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.168+0000 7f3b3c9d6640 1 -- 172.21.15.45:0/2831673026 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3b2c042030 con 0x7f3b38103670 2024-09-15T22:15:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.168+0000 7f3b3c9d6640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b200a32d0 0x7f3b200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.168+0000 7f3b36ffd640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b200a32d0 0x7f3b200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.168+0000 7f3b3c9d6640 1 -- 172.21.15.45:0/2831673026 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f3b2c0f01b0 con 0x7f3b38103670 2024-09-15T22:15:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.169+0000 7f3b36ffd640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b200a32d0 0x7f3b200a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009fd0 tx=0x7f3b28009720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:05.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.171+0000 7f3b3c9d6640 1 -- 172.21.15.45:0/2831673026 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b2c0bc480 con 0x7f3b38103670 2024-09-15T22:15:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.424+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2831673026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f3b38107220 con 0x7f3b38103670 2024-09-15T22:15:05.427 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:05 smithi045 ceph-mon[31180]: pgmap v311: 129 pgs: 129 active+clean; 636 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-15T22:15:05.427 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:05.427 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:05.427 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:05.427 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:05 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:05.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.429+0000 7f3b3c9d6640 1 -- 172.21.15.45:0/2831673026 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264050 (secure 0 0 0) 0x7f3b2c0c0780 con 0x7f3b38103670 2024-09-15T22:15:05.434 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:15:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.432+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2831673026 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b200a32d0 msgr2=0x7f3b200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.432+0000 7f3b3d9d8640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b200a32d0 0x7f3b200a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b28009fd0 tx=0x7f3b28009720 comp rx=0 tx=0).stop 2024-09-15T22:15:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.432+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2831673026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38103670 msgr2=0x7f3b38198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.432+0000 7f3b3d9d8640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38103670 0x7f3b38198ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c005940 tx=0x7f3b2c032f80 comp rx=0 tx=0).stop 2024-09-15T22:15:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.432+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2831673026 shutdown_connections 2024-09-15T22:15:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.433+0000 7f3b3d9d8640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b200a32d0 0x7f3b200a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.433+0000 7f3b3d9d8640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b3810c180 0x7f3b3819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.433+0000 7f3b3d9d8640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b38103670 0x7f3b38198ac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.433+0000 7f3b3d9d8640 1 --2- 172.21.15.45:0/2831673026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b38102d50 0x7f3b38198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.433+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2831673026 >> 172.21.15.45:0/2831673026 conn(0x7f3b380fc7d0 msgr2=0x7f3b380fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.433+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2831673026 shutdown_connections 2024-09-15T22:15:05.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:05.433+0000 7f3b3d9d8640 1 -- 172.21.15.45:0/2831673026 wait complete. 2024-09-15T22:15:05.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:05 smithi165 ceph-mon[35551]: pgmap v311: 129 pgs: 129 active+clean; 636 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-15T22:15:05.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:05.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:05.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:05.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:05 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:05 smithi100 ceph-mon[35319]: pgmap v311: 129 pgs: 129 active+clean; 636 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-15T22:15:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:05 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:06.183 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":1919238369},{"type":"v1","addr":"172.21.15.45:6801","nonce":1919238369}]},"active_addr":"172.21.15.45:6801/1919238369","active_change":"2024-09-15T22:07:15.327890+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.45:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":3286786467}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":3846204427}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":1080251242}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":4107707607}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":1461513797}]}]} 2024-09-15T22:15:06.188 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-15T22:15:06.189 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-15T22:15:06.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:15:06.456 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:06.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:06 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2831673026' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:15:06.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:06 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:06.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:06 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:06.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:06 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2831673026' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:15:06.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:06 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:06.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:06 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:06.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:06 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2831673026' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T22:15:06.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:06 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:06.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:06 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:06.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.924+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1602903672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d3c102790 msgr2=0x7f7d3c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:06.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.924+0000 7f7d41fa4640 1 --2- 172.21.15.45:0/1602903672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d3c102790 0x7f7d3c1067e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009900 tx=0x7f7d3002a410 comp rx=0 tx=0).stop 2024-09-15T22:15:06.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.924+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1602903672 shutdown_connections 2024-09-15T22:15:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.924+0000 7f7d41fa4640 1 --2- 172.21.15.45:0/1602903672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d3c106f10 0x7f7d3c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.924+0000 7f7d41fa4640 1 --2- 172.21.15.45:0/1602903672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d3c102790 0x7f7d3c1067e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.924+0000 7f7d41fa4640 1 --2- 172.21.15.45:0/1602903672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d3c101de0 0x7f7d3c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.924+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1602903672 >> 172.21.15.45:0/1602903672 conn(0x7f7d3c0fd8c0 msgr2=0x7f7d3c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.924+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1602903672 shutdown_connections 2024-09-15T22:15:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.924+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1602903672 wait complete. 2024-09-15T22:15:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.925+0000 7f7d41fa4640 1 Processor -- start 2024-09-15T22:15:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.925+0000 7f7d41fa4640 1 -- start start 2024-09-15T22:15:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.925+0000 7f7d41fa4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d3c101de0 0x7f7d3c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.925+0000 7f7d41fa4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d3c102790 0x7f7d3c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.925+0000 7f7d41fa4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d3c106f10 0x7f7d3c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.925+0000 7f7d41fa4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c112090 con 0x7f7d3c102790 2024-09-15T22:15:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.925+0000 7f7d41fa4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c111f10 con 0x7f7d3c101de0 2024-09-15T22:15:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.925+0000 7f7d41fa4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c112210 con 0x7f7d3c106f10 2024-09-15T22:15:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d3affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d3c102790 0x7f7d3c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d3affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d3c102790 0x7f7d3c198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34202/0 (socket says 172.21.15.45:34202) 2024-09-15T22:15:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d3affd640 1 -- 172.21.15.45:0/1226127504 learned_addr learned my addr 172.21.15.45:0/1226127504 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d3b7fe640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d3c101de0 0x7f7d3c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d3bfff640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d3c106f10 0x7f7d3c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d3affd640 1 -- 172.21.15.45:0/1226127504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d3c106f10 msgr2=0x7f7d3c19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d3affd640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d3c106f10 0x7f7d3c19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d3affd640 1 -- 172.21.15.45:0/1226127504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d3c101de0 msgr2=0x7f7d3c1984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d3affd640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d3c101de0 0x7f7d3c1984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d3affd640 1 -- 172.21.15.45:0/1226127504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c19d4a0 con 0x7f7d3c102790 2024-09-15T22:15:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d3bfff640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d3c106f10 0x7f7d3c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d3affd640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d3c102790 0x7f7d3c198a30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7d30006010 tx=0x7f7d300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d38ff9640 1 -- 172.21.15.45:0/1226127504 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3003f030 con 0x7f7d3c102790 2024-09-15T22:15:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d38ff9640 1 -- 172.21.15.45:0/1226127504 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d30003d00 con 0x7f7d3c102790 2024-09-15T22:15:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1226127504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3c19d730 con 0x7f7d3c102790 2024-09-15T22:15:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d38ff9640 1 -- 172.21.15.45:0/1226127504 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d30035070 con 0x7f7d3c102790 2024-09-15T22:15:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.926+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1226127504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d3c1a5070 con 0x7f7d3c102790 2024-09-15T22:15:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.928+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1226127504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d3c1021c0 con 0x7f7d3c102790 2024-09-15T22:15:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.929+0000 7f7d38ff9640 1 -- 172.21.15.45:0/1226127504 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7d30042030 con 0x7f7d3c102790 2024-09-15T22:15:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.929+0000 7f7d38ff9640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7d240a3350 0x7f7d240a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.929+0000 7f7d3b7fe640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7d240a3350 0x7f7d240a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.929+0000 7f7d38ff9640 1 -- 172.21.15.45:0/1226127504 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f7d300f01f0 con 0x7f7d3c102790 2024-09-15T22:15:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.930+0000 7f7d3b7fe640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7d240a3350 0x7f7d240a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c005fd0 tx=0x7f7d2c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:06.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:06.933+0000 7f7d38ff9640 1 -- 172.21.15.45:0/1226127504 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7d300bccd0 con 0x7f7d3c102790 2024-09-15T22:15:07.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.111+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1226127504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d3c10a120 con 0x7f7d3c102790 2024-09-15T22:15:07.114 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:07 smithi045 ceph-mon[31180]: pgmap v312: 129 pgs: 129 active+clean; 636 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-15T22:15:07.114 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:15:07.114 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:15:07.114 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:07.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.113+0000 7f7d38ff9640 1 -- 172.21.15.45:0/1226127504 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24190 (secure 0 0 0) 0x7f7d300bc5d0 con 0x7f7d3c102790 2024-09-15T22:15:07.115 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:15:07.115 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:14:16.455664+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:15:07.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.115+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1226127504 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7d240a3350 msgr2=0x7f7d240a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:07.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.115+0000 7f7d41fa4640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7d240a3350 0x7f7d240a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c005fd0 tx=0x7f7d2c00b390 comp rx=0 tx=0).stop 2024-09-15T22:15:07.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.115+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1226127504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d3c102790 msgr2=0x7f7d3c198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:07.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.115+0000 7f7d41fa4640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d3c102790 0x7f7d3c198a30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7d30006010 tx=0x7f7d300042f0 comp rx=0 tx=0).stop 2024-09-15T22:15:07.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.115+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1226127504 shutdown_connections 2024-09-15T22:15:07.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.115+0000 7f7d41fa4640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7d240a3350 0x7f7d240a5810 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:07.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.115+0000 7f7d41fa4640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7d3c106f10 0x7f7d3c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:07.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.115+0000 7f7d41fa4640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d3c102790 0x7f7d3c198a30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:07.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.115+0000 7f7d41fa4640 1 --2- 172.21.15.45:0/1226127504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d3c101de0 0x7f7d3c1984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:07.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.115+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1226127504 >> 172.21.15.45:0/1226127504 conn(0x7f7d3c0fd8c0 msgr2=0x7f7d3c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:07.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.115+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1226127504 shutdown_connections 2024-09-15T22:15:07.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:07.115+0000 7f7d41fa4640 1 -- 172.21.15.45:0/1226127504 wait complete. 2024-09-15T22:15:07.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:07 smithi165 ceph-mon[35551]: pgmap v312: 129 pgs: 129 active+clean; 636 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-15T22:15:07.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:15:07.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:15:07.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:07 smithi100 ceph-mon[35319]: pgmap v312: 129 pgs: 129 active+clean; 636 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.6 KiB/s wr, 3 op/s 2024-09-15T22:15:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:15:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:15:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:15:07.993 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-15T22:15:07.993 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:15:08.261 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:08.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:08 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1226127504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:15:08.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:08 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1226127504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:15:08.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:08 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1226127504' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:15:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.749+0000 7f90fb84b640 1 -- 172.21.15.45:0/766394227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90f41036e0 msgr2=0x7f90f410bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.749+0000 7f90fb84b640 1 --2- 172.21.15.45:0/766394227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90f41036e0 0x7f90f410bbd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009900 tx=0x7f90e802a480 comp rx=0 tx=0).stop 2024-09-15T22:15:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.749+0000 7f90fb84b640 1 -- 172.21.15.45:0/766394227 shutdown_connections 2024-09-15T22:15:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.749+0000 7f90fb84b640 1 --2- 172.21.15.45:0/766394227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90f410c1a0 0x7f90f410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.749+0000 7f90fb84b640 1 --2- 172.21.15.45:0/766394227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90f41036e0 0x7f90f410bbd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.749+0000 7f90fb84b640 1 --2- 172.21.15.45:0/766394227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f4102dc0 0x7f90f41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.749+0000 7f90fb84b640 1 -- 172.21.15.45:0/766394227 >> 172.21.15.45:0/766394227 conn(0x7f90f40fc7a0 msgr2=0x7f90f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:08.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.750+0000 7f90fb84b640 1 -- 172.21.15.45:0/766394227 shutdown_connections 2024-09-15T22:15:08.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.750+0000 7f90fb84b640 1 -- 172.21.15.45:0/766394227 wait complete. 2024-09-15T22:15:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.750+0000 7f90fb84b640 1 Processor -- start 2024-09-15T22:15:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.751+0000 7f90fb84b640 1 -- start start 2024-09-15T22:15:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.751+0000 7f90fb84b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f4102dc0 0x7f90f41a4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.751+0000 7f90fb84b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90f41036e0 0x7f90f41a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.751+0000 7f90fb84b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90f410c1a0 0x7f90f410ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.751+0000 7f90fb84b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f90f4112090 con 0x7f90f410c1a0 2024-09-15T22:15:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.751+0000 7f90fb84b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f90f4111f10 con 0x7f90f4102dc0 2024-09-15T22:15:08.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.751+0000 7f90fb84b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f90f4112210 con 0x7f90f41036e0 2024-09-15T22:15:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.751+0000 7f90f9de8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90f410c1a0 0x7f90f410ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.751+0000 7f90f9de8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90f410c1a0 0x7f90f410ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34224/0 (socket says 172.21.15.45:34224) 2024-09-15T22:15:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.751+0000 7f90f9de8640 1 -- 172.21.15.45:0/2715912292 learned_addr learned my addr 172.21.15.45:0/2715912292 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.751+0000 7f90f95e7640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f4102dc0 0x7f90f41a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.751+0000 7f90f8de6640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90f41036e0 0x7f90f41a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.752+0000 7f90f9de8640 1 -- 172.21.15.45:0/2715912292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90f41036e0 msgr2=0x7f90f41a4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.752+0000 7f90f9de8640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90f41036e0 0x7f90f41a4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.752+0000 7f90f9de8640 1 -- 172.21.15.45:0/2715912292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f4102dc0 msgr2=0x7f90f41a4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:08.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.752+0000 7f90f9de8640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f4102dc0 0x7f90f41a4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.752+0000 7f90f9de8640 1 -- 172.21.15.45:0/2715912292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f410b410 con 0x7f90f410c1a0 2024-09-15T22:15:08.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.752+0000 7f90f9de8640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90f410c1a0 0x7f90f410ac90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00d750 tx=0x7f90ec00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:08.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.752+0000 7f90f27fc640 1 -- 172.21.15.45:0/2715912292 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec017070 con 0x7f90f410c1a0 2024-09-15T22:15:08.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.752+0000 7f90fb84b640 1 -- 172.21.15.45:0/2715912292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f410b6a0 con 0x7f90f410c1a0 2024-09-15T22:15:08.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.752+0000 7f90f27fc640 1 -- 172.21.15.45:0/2715912292 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f90ec005520 con 0x7f90f410c1a0 2024-09-15T22:15:08.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.752+0000 7f90f27fc640 1 -- 172.21.15.45:0/2715912292 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec004e00 con 0x7f90f410c1a0 2024-09-15T22:15:08.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.752+0000 7f90fb84b640 1 -- 172.21.15.45:0/2715912292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f41ab5e0 con 0x7f90f410c1a0 2024-09-15T22:15:08.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.753+0000 7f90fb84b640 1 -- 172.21.15.45:0/2715912292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f406aff0 con 0x7f90f410c1a0 2024-09-15T22:15:08.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.754+0000 7f90f27fc640 1 -- 172.21.15.45:0/2715912292 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f90ec004fa0 con 0x7f90f410c1a0 2024-09-15T22:15:08.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.755+0000 7f90f27fc640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f90dc0a32d0 0x7f90dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:08.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.755+0000 7f90f95e7640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f90dc0a32d0 0x7f90dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:08.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.755+0000 7f90f27fc640 1 -- 172.21.15.45:0/2715912292 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f90ec0cf9e0 con 0x7f90f410c1a0 2024-09-15T22:15:08.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.756+0000 7f90f95e7640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f90dc0a32d0 0x7f90dc0a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f90e4007ec0 tx=0x7f90e40075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:08.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.759+0000 7f90f27fc640 1 -- 172.21.15.45:0/2715912292 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f90ec09bcb0 con 0x7f90f410c1a0 2024-09-15T22:15:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.935+0000 7f90fb84b640 1 -- 172.21.15.45:0/2715912292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90f41ab840 con 0x7f90f410c1a0 2024-09-15T22:15:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.936+0000 7f90f27fc640 1 -- 172.21.15.45:0/2715912292 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24190 (secure 0 0 0) 0x7f90ec09ffb0 con 0x7f90f410c1a0 2024-09-15T22:15:08.939 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:15:08.939 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:14:16.455664+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:15:08.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.938+0000 7f90fb84b640 1 -- 172.21.15.45:0/2715912292 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f90dc0a32d0 msgr2=0x7f90dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:08.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.938+0000 7f90fb84b640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f90dc0a32d0 0x7f90dc0a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f90e4007ec0 tx=0x7f90e40075b0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.938+0000 7f90fb84b640 1 -- 172.21.15.45:0/2715912292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90f410c1a0 msgr2=0x7f90f410ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.938+0000 7f90fb84b640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90f410c1a0 0x7f90f410ac90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f90ec00d750 tx=0x7f90ec00dc10 comp rx=0 tx=0).stop 2024-09-15T22:15:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.938+0000 7f90fb84b640 1 -- 172.21.15.45:0/2715912292 shutdown_connections 2024-09-15T22:15:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.938+0000 7f90fb84b640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f90dc0a32d0 0x7f90dc0a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.938+0000 7f90fb84b640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f90f410c1a0 0x7f90f410ac90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.938+0000 7f90fb84b640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f90f41036e0 0x7f90f41a4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.938+0000 7f90fb84b640 1 --2- 172.21.15.45:0/2715912292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90f4102dc0 0x7f90f41a4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.938+0000 7f90fb84b640 1 -- 172.21.15.45:0/2715912292 >> 172.21.15.45:0/2715912292 conn(0x7f90f40fc7a0 msgr2=0x7f90f40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.939+0000 7f90fb84b640 1 -- 172.21.15.45:0/2715912292 shutdown_connections 2024-09-15T22:15:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:08.939+0000 7f90fb84b640 1 -- 172.21.15.45:0/2715912292 wait complete. 2024-09-15T22:15:09.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:09 smithi045 ceph-mon[31180]: pgmap v313: 129 pgs: 129 active+clean; 640 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-15T22:15:09.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:09 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2715912292' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:15:09.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:09 smithi165 ceph-mon[35551]: pgmap v313: 129 pgs: 129 active+clean; 640 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-15T22:15:09.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:09 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2715912292' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:15:09.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:09 smithi100 ceph-mon[35319]: pgmap v313: 129 pgs: 129 active+clean; 640 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.0 KiB/s wr, 4 op/s 2024-09-15T22:15:09.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:09 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2715912292' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:15:09.591 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-15T22:15:09.591 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-15T22:15:09.592 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-15T22:15:09.592 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-15T22:15:09.592 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-15T22:15:09.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-15T22:15:09.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-15T22:15:09.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-15T22:15:09.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-15T22:15:09.595 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-15T22:15:09.595 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-15T22:15:09.596 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-15T22:15:10.393 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:10.394 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:10.439 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:10.440 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:10.440 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:10.442 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:10.443 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:10.447 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:10.448 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:10.449 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:10.453 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:10.458 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:11.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.129+0000 7fc6052a9640 1 -- 172.21.15.45:0/1662001575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc600106f10 msgr2=0x7fc60010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.129+0000 7fc6052a9640 1 --2- 172.21.15.45:0/1662001575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc600106f10 0x7fc60010ea90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009ca0 tx=0x7fc5f802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.129+0000 7fc6052a9640 1 -- 172.21.15.45:0/1662001575 shutdown_connections 2024-09-15T22:15:11.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.129+0000 7fc6052a9640 1 --2- 172.21.15.45:0/1662001575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc600106f10 0x7fc60010ea90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.129+0000 7fc6052a9640 1 --2- 172.21.15.45:0/1662001575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc600102790 0x7fc6001067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.129+0000 7fc6052a9640 1 --2- 172.21.15.45:0/1662001575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc600101de0 0x7fc6001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.129+0000 7fc6052a9640 1 -- 172.21.15.45:0/1662001575 >> 172.21.15.45:0/1662001575 conn(0x7fc6000fd8c0 msgr2=0x7fc6000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.129+0000 7fc6052a9640 1 -- 172.21.15.45:0/1662001575 shutdown_connections 2024-09-15T22:15:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.129+0000 7fc6052a9640 1 -- 172.21.15.45:0/1662001575 wait complete. 2024-09-15T22:15:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.129+0000 7fc6052a9640 1 Processor -- start 2024-09-15T22:15:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.130+0000 7fc6052a9640 1 -- start start 2024-09-15T22:15:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.130+0000 7fc6052a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc600101de0 0x7fc6001983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.130+0000 7fc6052a9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc600102790 0x7fc600198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.130+0000 7fc6052a9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc600106f10 0x7fc60019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.130+0000 7fc6052a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc600112090 con 0x7fc600101de0 2024-09-15T22:15:11.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.130+0000 7fc6052a9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc600111f10 con 0x7fc600102790 2024-09-15T22:15:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.130+0000 7fc6052a9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc600112210 con 0x7fc600106f10 2024-09-15T22:15:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.130+0000 7fc5feffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc600101de0 0x7fc6001983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.130+0000 7fc5feffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc600101de0 0x7fc6001983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34246/0 (socket says 172.21.15.45:34246) 2024-09-15T22:15:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.130+0000 7fc5feffd640 1 -- 172.21.15.45:0/595476663 learned_addr learned my addr 172.21.15.45:0/595476663 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.130+0000 7fc5fe7fc640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc600102790 0x7fc600198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.130+0000 7fc5ff7fe640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc600106f10 0x7fc60019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.131+0000 7fc5feffd640 1 -- 172.21.15.45:0/595476663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc600106f10 msgr2=0x7fc60019cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.131+0000 7fc5feffd640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc600106f10 0x7fc60019cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.131+0000 7fc5feffd640 1 -- 172.21.15.45:0/595476663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc600102790 msgr2=0x7fc600198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.131+0000 7fc5feffd640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc600102790 0x7fc600198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.131+0000 7fc5feffd640 1 -- 172.21.15.45:0/595476663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60019d380 con 0x7fc600101de0 2024-09-15T22:15:11.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.131+0000 7fc5fe7fc640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc600102790 0x7fc600198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:15:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.131+0000 7fc5ff7fe640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc600106f10 0x7fc60019cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:15:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.131+0000 7fc5feffd640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc600101de0 0x7fc6001983d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000d950 tx=0x7fc5f000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.131+0000 7fc5e7fff640 1 -- 172.21.15.45:0/595476663 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0017030 con 0x7fc600101de0 2024-09-15T22:15:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.131+0000 7fc5e7fff640 1 -- 172.21.15.45:0/595476663 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc5f0004020 con 0x7fc600101de0 2024-09-15T22:15:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.131+0000 7fc6052a9640 1 -- 172.21.15.45:0/595476663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60019d670 con 0x7fc600101de0 2024-09-15T22:15:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.131+0000 7fc5e7fff640 1 -- 172.21.15.45:0/595476663 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0004a00 con 0x7fc600101de0 2024-09-15T22:15:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.131+0000 7fc6052a9640 1 -- 172.21.15.45:0/595476663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6001a4f50 con 0x7fc600101de0 2024-09-15T22:15:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.132+0000 7fc6052a9640 1 -- 172.21.15.45:0/595476663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc6000feeb0 con 0x7fc600101de0 2024-09-15T22:15:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.133+0000 7fc5e7fff640 1 -- 172.21.15.45:0/595476663 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc5f00041d0 con 0x7fc600101de0 2024-09-15T22:15:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.134+0000 7fc5e7fff640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc5e80a32d0 0x7fc5e80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.134+0000 7fc5e7fff640 1 -- 172.21.15.45:0/595476663 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fc5f00cf7a0 con 0x7fc600101de0 2024-09-15T22:15:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.134+0000 7fc5fe7fc640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc5e80a32d0 0x7fc5e80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:11.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.134+0000 7fc5e7fff640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873] conn(0x7fc5e80ae000 0x7fc5e80b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.134+0000 7fc5e7fff640 1 -- 172.21.15.45:0/595476663 --> [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5e80b0b10 con 0x7fc5e80ae000 2024-09-15T22:15:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.134+0000 7fc5e7fff640 1 -- 172.21.15.45:0/595476663 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fc5f00d6050 con 0x7fc600101de0 2024-09-15T22:15:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.134+0000 7fc5ff7fe640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873] conn(0x7fc5e80ae000 0x7fc5e80b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.134+0000 7fc5fe7fc640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc5e80a32d0 0x7fc5e80a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc600108850 tx=0x7fc5f4005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.134+0000 7fc5ff7fe640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873] conn(0x7fc5e80ae000 0x7fc5e80b0440 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.135+0000 7fc5e7fff640 1 -- 172.21.15.45:0/595476663 <== osd.0 v2:172.21.15.45:6802/3943337873 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc5e80b0b10 con 0x7fc5e80ae000 2024-09-15T22:15:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.149+0000 7fc6052a9640 1 -- 172.21.15.45:0/595476663 --> [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc6001032c0 con 0x7fc5e80ae000 2024-09-15T22:15:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.149+0000 7fc5e7fff640 1 -- 172.21.15.45:0/595476663 <== osd.0 v2:172.21.15.45:6802/3943337873 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc6001032c0 con 0x7fc5e80ae000 2024-09-15T22:15:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.150+0000 7fc6052a9640 1 -- 172.21.15.45:0/595476663 >> [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873] conn(0x7fc5e80ae000 msgr2=0x7fc5e80b0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.150+0000 7fc6052a9640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873] conn(0x7fc5e80ae000 0x7fc5e80b0440 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.150+0000 7fc6052a9640 1 -- 172.21.15.45:0/595476663 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc5e80a32d0 msgr2=0x7fc5e80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.150+0000 7fc6052a9640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc5e80a32d0 0x7fc5e80a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc600108850 tx=0x7fc5f4005d20 comp rx=0 tx=0).stop 2024-09-15T22:15:11.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.150+0000 7fc6052a9640 1 -- 172.21.15.45:0/595476663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc600101de0 msgr2=0x7fc6001983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.150+0000 7fc6052a9640 1 --2- 172.21.15.45:0/595476663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc600101de0 0x7fc6001983d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000d950 tx=0x7fc5f000de10 comp rx=0 tx=0).stop 2024-09-15T22:15:11.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.150+0000 7fc5ff7fe640 1 -- 172.21.15.45:0/595476663 reap_dead start 2024-09-15T22:15:11.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.150+0000 7fc6052a9640 1 -- 172.21.15.45:0/595476663 shutdown_connections 2024-09-15T22:15:11.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.150+0000 7fc6052a9640 1 -- 172.21.15.45:0/595476663 >> 172.21.15.45:0/595476663 conn(0x7fc6000fd8c0 msgr2=0x7fc6000ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:11.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.150+0000 7fc6052a9640 1 -- 172.21.15.45:0/595476663 shutdown_connections 2024-09-15T22:15:11.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.150+0000 7fc6052a9640 1 -- 172.21.15.45:0/595476663 wait complete. 2024-09-15T22:15:11.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:11 smithi045 ceph-mon[31180]: pgmap v314: 129 pgs: 129 active+clean; 640 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-15T22:15:11.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:11 smithi165 ceph-mon[35551]: pgmap v314: 129 pgs: 129 active+clean; 640 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-15T22:15:11.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:11 smithi100 ceph-mon[35319]: pgmap v314: 129 pgs: 129 active+clean; 640 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.1 KiB/s wr, 3 op/s 2024-09-15T22:15:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.767+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/2911834754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7dc101420 msgr2=0x7fb7dc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.767+0000 7fb7e2fdf640 1 --2- 172.21.15.45:0/2911834754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7dc101420 0x7fb7dc10d950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009cd0 tx=0x7fb7d402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.767+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/2911834754 shutdown_connections 2024-09-15T22:15:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.767+0000 7fb7e2fdf640 1 --2- 172.21.15.45:0/2911834754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7dc101420 0x7fb7dc10d950 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.767+0000 7fb7e2fdf640 1 --2- 172.21.15.45:0/2911834754 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7dc100a80 0x7fb7dc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.767+0000 7fb7e2fdf640 1 --2- 172.21.15.45:0/2911834754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc106a80 0x7fb7dc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.767+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/2911834754 >> 172.21.15.45:0/2911834754 conn(0x7fb7dc0fc7a0 msgr2=0x7fb7dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.767+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/2911834754 shutdown_connections 2024-09-15T22:15:11.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.767+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/2911834754 wait complete. 2024-09-15T22:15:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.768+0000 7fb7e2fdf640 1 Processor -- start 2024-09-15T22:15:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.768+0000 7fb7e2fdf640 1 -- start start 2024-09-15T22:15:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.768+0000 7fb7e2fdf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7dc100a80 0x7fb7dc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.768+0000 7fb7e2fdf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc101420 0x7fb7dc198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.768+0000 7fb7e2fdf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7dc106a80 0x7fb7dc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.768+0000 7fb7e2fdf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc110fa0 con 0x7fb7dc106a80 2024-09-15T22:15:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.768+0000 7fb7e2fdf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc110e20 con 0x7fb7dc101420 2024-09-15T22:15:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.768+0000 7fb7e2fdf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb7dc111120 con 0x7fb7dc100a80 2024-09-15T22:15:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7e157c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7dc106a80 0x7fb7dc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7e157c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7dc106a80 0x7fb7dc19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34260/0 (socket says 172.21.15.45:34260) 2024-09-15T22:15:11.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7e157c640 1 -- 172.21.15.45:0/398633228 learned_addr learned my addr 172.21.15.45:0/398633228 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7dbfff640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc101420 0x7fb7dc198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7e0d7b640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7dc100a80 0x7fb7dc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7e157c640 1 -- 172.21.15.45:0/398633228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7dc100a80 msgr2=0x7fb7dc198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7e157c640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb7dc100a80 0x7fb7dc198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7e157c640 1 -- 172.21.15.45:0/398633228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc101420 msgr2=0x7fb7dc198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7e157c640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7dc101420 0x7fb7dc198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7e157c640 1 -- 172.21.15.45:0/398633228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7dc19d400 con 0x7fb7dc106a80 2024-09-15T22:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7e157c640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7dc106a80 0x7fb7dc19cd20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009df0 tx=0x7fb7d4032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7d9ffb640 1 -- 172.21.15.45:0/398633228 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4004240 con 0x7fb7dc106a80 2024-09-15T22:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7d9ffb640 1 -- 172.21.15.45:0/398633228 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb7d40305a0 con 0x7fb7dc106a80 2024-09-15T22:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/398633228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7dc19d690 con 0x7fb7dc106a80 2024-09-15T22:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.769+0000 7fb7d9ffb640 1 -- 172.21.15.45:0/398633228 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40466c0 con 0x7fb7dc106a80 2024-09-15T22:15:11.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.770+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/398633228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7dc1a4fd0 con 0x7fb7dc106a80 2024-09-15T22:15:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.770+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/398633228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb7dc062980 con 0x7fb7dc106a80 2024-09-15T22:15:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.772+0000 7fb7d9ffb640 1 -- 172.21.15.45:0/398633228 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb7d4030750 con 0x7fb7dc106a80 2024-09-15T22:15:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.772+0000 7fb7d9ffb640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb7cc0a32d0 0x7fb7cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.772+0000 7fb7d9ffb640 1 -- 172.21.15.45:0/398633228 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fb7d402e030 con 0x7fb7dc106a80 2024-09-15T22:15:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.772+0000 7fb7e0d7b640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb7cc0a32d0 0x7fb7cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.773+0000 7fb7d9ffb640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054] conn(0x7fb7cc0ae000 0x7fb7cc0b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:11.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.773+0000 7fb7d9ffb640 1 -- 172.21.15.45:0/398633228 --> [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7d403fec0 con 0x7fb7cc0ae000 2024-09-15T22:15:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.773+0000 7fb7d9ffb640 1 -- 172.21.15.45:0/398633228 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fb7d40f18e0 con 0x7fb7dc106a80 2024-09-15T22:15:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.773+0000 7fb7dbfff640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054] conn(0x7fb7cc0ae000 0x7fb7cc0b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.773+0000 7fb7e0d7b640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb7cc0a32d0 0x7fb7cc0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000cac0 tx=0x7fb7d000c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.773+0000 7fb7dbfff640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054] conn(0x7fb7cc0ae000 0x7fb7cc0b0440 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.774+0000 7fb7d9ffb640 1 -- 172.21.15.45:0/398633228 <== osd.11 v2:172.21.15.165:6824/1936678054 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7d403fec0 con 0x7fb7cc0ae000 2024-09-15T22:15:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.788+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/398633228 --> [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb7dc062e00 con 0x7fb7cc0ae000 2024-09-15T22:15:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.788+0000 7fb7d9ffb640 1 -- 172.21.15.45:0/398633228 <== osd.11 v2:172.21.15.165:6824/1936678054 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb7dc062e00 con 0x7fb7cc0ae000 2024-09-15T22:15:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.789+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/398633228 >> [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054] conn(0x7fb7cc0ae000 msgr2=0x7fb7cc0b0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.789+0000 7fb7e2fdf640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054] conn(0x7fb7cc0ae000 0x7fb7cc0b0440 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.789+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/398633228 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb7cc0a32d0 msgr2=0x7fb7cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.789+0000 7fb7e2fdf640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb7cc0a32d0 0x7fb7cc0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000cac0 tx=0x7fb7d000c4a0 comp rx=0 tx=0).stop 2024-09-15T22:15:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.789+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/398633228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7dc106a80 msgr2=0x7fb7dc19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.789+0000 7fb7e2fdf640 1 --2- 172.21.15.45:0/398633228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7dc106a80 0x7fb7dc19cd20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009df0 tx=0x7fb7d4032c00 comp rx=0 tx=0).stop 2024-09-15T22:15:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.789+0000 7fb7e157c640 1 -- 172.21.15.45:0/398633228 reap_dead start 2024-09-15T22:15:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.789+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/398633228 shutdown_connections 2024-09-15T22:15:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.789+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/398633228 >> 172.21.15.45:0/398633228 conn(0x7fb7dc0fc7a0 msgr2=0x7fb7dc06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.789+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/398633228 shutdown_connections 2024-09-15T22:15:11.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:11.789+0000 7fb7e2fdf640 1 -- 172.21.15.45:0/398633228 wait complete. 2024-09-15T22:15:12.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.702+0000 7fca81bcf640 1 -- 172.21.15.45:0/440075825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c1082a0 msgr2=0x7fca7c10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.702+0000 7fca81bcf640 1 --2- 172.21.15.45:0/440075825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c1082a0 0x7fca7c10ec40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fca74009cd0 tx=0x7fca7402a8e0 comp rx=0 tx=0).stop 2024-09-15T22:15:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.702+0000 7fca81bcf640 1 -- 172.21.15.45:0/440075825 shutdown_connections 2024-09-15T22:15:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.702+0000 7fca81bcf640 1 --2- 172.21.15.45:0/440075825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c1082a0 0x7fca7c10ec40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.702+0000 7fca81bcf640 1 --2- 172.21.15.45:0/440075825 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca7c1036e0 0x7fca7c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.702+0000 7fca81bcf640 1 --2- 172.21.15.45:0/440075825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca7c102d30 0x7fca7c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.702+0000 7fca81bcf640 1 -- 172.21.15.45:0/440075825 >> 172.21.15.45:0/440075825 conn(0x7fca7c0fc7d0 msgr2=0x7fca7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.702+0000 7fca81bcf640 1 -- 172.21.15.45:0/440075825 shutdown_connections 2024-09-15T22:15:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.702+0000 7fca81bcf640 1 -- 172.21.15.45:0/440075825 wait complete. 2024-09-15T22:15:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.702+0000 7fca81bcf640 1 Processor -- start 2024-09-15T22:15:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca81bcf640 1 -- start start 2024-09-15T22:15:12.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca81bcf640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca7c102d30 0x7fca7c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca81bcf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c1036e0 0x7fca7c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca81bcf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca7c1082a0 0x7fca7c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca81bcf640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c1121c0 con 0x7fca7c1036e0 2024-09-15T22:15:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca81bcf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c112040 con 0x7fca7c1082a0 2024-09-15T22:15:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca81bcf640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fca7c112340 con 0x7fca7c102d30 2024-09-15T22:15:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca7affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c1036e0 0x7fca7c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca7affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c1036e0 0x7fca7c198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34282/0 (socket says 172.21.15.45:34282) 2024-09-15T22:15:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca7affd640 1 -- 172.21.15.45:0/1538673915 learned_addr learned my addr 172.21.15.45:0/1538673915 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca7b7fe640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca7c102d30 0x7fca7c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca7bfff640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca7c1082a0 0x7fca7c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca7affd640 1 -- 172.21.15.45:0/1538673915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca7c102d30 msgr2=0x7fca7c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:12.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca7affd640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fca7c102d30 0x7fca7c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca7affd640 1 -- 172.21.15.45:0/1538673915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca7c1082a0 msgr2=0x7fca7c19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca7affd640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca7c1082a0 0x7fca7c19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca7affd640 1 -- 172.21.15.45:0/1538673915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7c19d5f0 con 0x7fca7c1036e0 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.703+0000 7fca7affd640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c1036e0 0x7fca7c198b80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fca7000d740 tx=0x7fca7000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.704+0000 7fca78ff9640 1 -- 172.21.15.45:0/1538673915 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70017070 con 0x7fca7c1036e0 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.704+0000 7fca78ff9640 1 -- 172.21.15.45:0/1538673915 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca7000de50 con 0x7fca7c1036e0 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.704+0000 7fca81bcf640 1 -- 172.21.15.45:0/1538673915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7c19d8e0 con 0x7fca7c1036e0 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.704+0000 7fca78ff9640 1 -- 172.21.15.45:0/1538673915 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7000f740 con 0x7fca7c1036e0 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.704+0000 7fca81bcf640 1 -- 172.21.15.45:0/1538673915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7c1a51c0 con 0x7fca7c1036e0 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.704+0000 7fca81bcf640 1 -- 172.21.15.45:0/1538673915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca7c062980 con 0x7fca7c1036e0 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.706+0000 7fca78ff9640 1 -- 172.21.15.45:0/1538673915 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fca7001a070 con 0x7fca7c1036e0 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.706+0000 7fca78ff9640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca640a32d0 0x7fca640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.707+0000 7fca7b7fe640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca640a32d0 0x7fca640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:12.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.707+0000 7fca78ff9640 1 -- 172.21.15.45:0/1538673915 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fca700cfad0 con 0x7fca7c1036e0 2024-09-15T22:15:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.707+0000 7fca78ff9640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026] conn(0x7fca640ae000 0x7fca640b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.707+0000 7fca78ff9640 1 -- 172.21.15.45:0/1538673915 --> [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca7001ee50 con 0x7fca640ae000 2024-09-15T22:15:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.707+0000 7fca78ff9640 1 -- 172.21.15.45:0/1538673915 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fca700cfe80 con 0x7fca7c1036e0 2024-09-15T22:15:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.707+0000 7fca7bfff640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026] conn(0x7fca640ae000 0x7fca640b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.707+0000 7fca7b7fe640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca640a32d0 0x7fca640a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009bd0 tx=0x7fca6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.707+0000 7fca7bfff640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026] conn(0x7fca640ae000 0x7fca640b0440 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:12.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.708+0000 7fca78ff9640 1 -- 172.21.15.45:0/1538673915 <== osd.6 v2:172.21.15.45:6818/480791026 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca7001ee50 con 0x7fca640ae000 2024-09-15T22:15:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.722+0000 7fca81bcf640 1 -- 172.21.15.45:0/1538673915 --> [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca7c062e00 con 0x7fca640ae000 2024-09-15T22:15:12.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.722+0000 7fca78ff9640 1 -- 172.21.15.45:0/1538673915 <== osd.6 v2:172.21.15.45:6818/480791026 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fca7c062e00 con 0x7fca640ae000 2024-09-15T22:15:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.722+0000 7fca81bcf640 1 -- 172.21.15.45:0/1538673915 >> [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026] conn(0x7fca640ae000 msgr2=0x7fca640b0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.722+0000 7fca81bcf640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026] conn(0x7fca640ae000 0x7fca640b0440 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.722+0000 7fca81bcf640 1 -- 172.21.15.45:0/1538673915 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca640a32d0 msgr2=0x7fca640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.722+0000 7fca81bcf640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca640a32d0 0x7fca640a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fca6c009bd0 tx=0x7fca6c005f90 comp rx=0 tx=0).stop 2024-09-15T22:15:12.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.722+0000 7fca81bcf640 1 -- 172.21.15.45:0/1538673915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c1036e0 msgr2=0x7fca7c198b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.722+0000 7fca81bcf640 1 --2- 172.21.15.45:0/1538673915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fca7c1036e0 0x7fca7c198b80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fca7000d740 tx=0x7fca7000dc00 comp rx=0 tx=0).stop 2024-09-15T22:15:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.723+0000 7fca7bfff640 1 -- 172.21.15.45:0/1538673915 reap_dead start 2024-09-15T22:15:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.723+0000 7fca81bcf640 1 -- 172.21.15.45:0/1538673915 shutdown_connections 2024-09-15T22:15:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.723+0000 7fca81bcf640 1 -- 172.21.15.45:0/1538673915 >> 172.21.15.45:0/1538673915 conn(0x7fca7c0fc7d0 msgr2=0x7fca7c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.723+0000 7fca81bcf640 1 -- 172.21.15.45:0/1538673915 shutdown_connections 2024-09-15T22:15:12.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:12.723+0000 7fca81bcf640 1 -- 172.21.15.45:0/1538673915 wait complete. 2024-09-15T22:15:13.376 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:13 smithi045 ceph-mon[31180]: pgmap v315: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 4 op/s 2024-09-15T22:15:13.405 INFO:teuthology.orchestra.run.smithi045.stdout:184683593780 2024-09-15T22:15:13.406 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-15T22:15:13.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:13 smithi165 ceph-mon[35551]: pgmap v315: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 4 op/s 2024-09-15T22:15:13.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:13 smithi100 ceph-mon[35319]: pgmap v315: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 2.3 KiB/s wr, 4 op/s 2024-09-15T22:15:13.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.855+0000 7f06e48e9640 1 -- 172.21.15.45:0/3056111357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e0102d30 msgr2=0x7f06e0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.855+0000 7f06e48e9640 1 --2- 172.21.15.45:0/3056111357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e0102d30 0x7f06e0103110 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009930 tx=0x7f06d002a420 comp rx=0 tx=0).stop 2024-09-15T22:15:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.855+0000 7f06e48e9640 1 -- 172.21.15.45:0/3056111357 shutdown_connections 2024-09-15T22:15:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.855+0000 7f06e48e9640 1 --2- 172.21.15.45:0/3056111357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06e01082a0 0x7f06e010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.855+0000 7f06e48e9640 1 --2- 172.21.15.45:0/3056111357 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06e01036e0 0x7f06e0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.855+0000 7f06e48e9640 1 --2- 172.21.15.45:0/3056111357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e0102d30 0x7f06e0103110 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.855+0000 7f06e48e9640 1 -- 172.21.15.45:0/3056111357 >> 172.21.15.45:0/3056111357 conn(0x7f06e00fc7d0 msgr2=0x7f06e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.855+0000 7f06e48e9640 1 -- 172.21.15.45:0/3056111357 shutdown_connections 2024-09-15T22:15:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.855+0000 7f06e48e9640 1 -- 172.21.15.45:0/3056111357 wait complete. 2024-09-15T22:15:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.856+0000 7f06e48e9640 1 Processor -- start 2024-09-15T22:15:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.856+0000 7f06e48e9640 1 -- start start 2024-09-15T22:15:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06e48e9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e0102d30 0x7f06e0198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06e48e9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06e01036e0 0x7f06e0198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06e48e9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06e01082a0 0x7f06e019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06e48e9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f06e01121c0 con 0x7f06e0102d30 2024-09-15T22:15:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06e48e9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0112040 con 0x7f06e01036e0 2024-09-15T22:15:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06e48e9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f06e0112340 con 0x7f06e01082a0 2024-09-15T22:15:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06de59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e0102d30 0x7f06e0198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06de59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e0102d30 0x7f06e0198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34300/0 (socket says 172.21.15.45:34300) 2024-09-15T22:15:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06de59c640 1 -- 172.21.15.45:0/77853331 learned_addr learned my addr 172.21.15.45:0/77853331 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06ded9d640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06e01082a0 0x7f06e019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06d7fff640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06e01036e0 0x7f06e0198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06de59c640 1 -- 172.21.15.45:0/77853331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06e01082a0 msgr2=0x7f06e019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06de59c640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f06e01082a0 0x7f06e019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06de59c640 1 -- 172.21.15.45:0/77853331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06e01036e0 msgr2=0x7f06e0198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06de59c640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06e01036e0 0x7f06e0198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.857+0000 7f06de59c640 1 -- 172.21.15.45:0/77853331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e019d5b0 con 0x7f06e0102d30 2024-09-15T22:15:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.858+0000 7f06de59c640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e0102d30 0x7f06e0198600 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009a50 tx=0x7f06d0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.858+0000 7f06d77fe640 1 -- 172.21.15.45:0/77853331 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d003f030 con 0x7f06e0102d30 2024-09-15T22:15:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.858+0000 7f06d77fe640 1 -- 172.21.15.45:0/77853331 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f06d0003af0 con 0x7f06e0102d30 2024-09-15T22:15:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.858+0000 7f06e48e9640 1 -- 172.21.15.45:0/77853331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e019d840 con 0x7f06e0102d30 2024-09-15T22:15:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.858+0000 7f06d77fe640 1 -- 172.21.15.45:0/77853331 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0035070 con 0x7f06e0102d30 2024-09-15T22:15:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.858+0000 7f06e48e9640 1 -- 172.21.15.45:0/77853331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e01008c0 con 0x7f06e0102d30 2024-09-15T22:15:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.859+0000 7f06e48e9640 1 -- 172.21.15.45:0/77853331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f06e0062900 con 0x7f06e0102d30 2024-09-15T22:15:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.860+0000 7f06d77fe640 1 -- 172.21.15.45:0/77853331 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f06d0042030 con 0x7f06e0102d30 2024-09-15T22:15:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.861+0000 7f06d77fe640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f06cc0a32d0 0x7f06cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.861+0000 7f06d7fff640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f06cc0a32d0 0x7f06cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.861+0000 7f06d77fe640 1 -- 172.21.15.45:0/77853331 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f06d00f05b0 con 0x7f06e0102d30 2024-09-15T22:15:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.861+0000 7f06d77fe640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686] conn(0x7f06cc0ae000 0x7f06cc0b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.861+0000 7f06d77fe640 1 -- 172.21.15.45:0/77853331 --> [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06d0037e50 con 0x7f06cc0ae000 2024-09-15T22:15:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.861+0000 7f06d77fe640 1 -- 172.21.15.45:0/77853331 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f06d00f7050 con 0x7f06e0102d30 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.861+0000 7f06ded9d640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686] conn(0x7f06cc0ae000 0x7f06cc0b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.861+0000 7f06d7fff640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f06cc0a32d0 0x7f06cc0a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f06c8005e10 tx=0x7f06c8005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.862+0000 7f06ded9d640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686] conn(0x7f06cc0ae000 0x7f06cc0b0440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.862+0000 7f06d77fe640 1 -- 172.21.15.45:0/77853331 <== osd.9 v2:172.21.15.45:6826/777631686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f06d0037e50 con 0x7f06cc0ae000 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.887+0000 7f06e48e9640 1 -- 172.21.15.45:0/77853331 --> [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f06e0062d80 con 0x7f06cc0ae000 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.888+0000 7f06d77fe640 1 -- 172.21.15.45:0/77853331 <== osd.9 v2:172.21.15.45:6826/777631686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f06e0062d80 con 0x7f06cc0ae000 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.888+0000 7f06e48e9640 1 -- 172.21.15.45:0/77853331 >> [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686] conn(0x7f06cc0ae000 msgr2=0x7f06cc0b0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.888+0000 7f06e48e9640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686] conn(0x7f06cc0ae000 0x7f06cc0b0440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.888+0000 7f06e48e9640 1 -- 172.21.15.45:0/77853331 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f06cc0a32d0 msgr2=0x7f06cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.888+0000 7f06e48e9640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f06cc0a32d0 0x7f06cc0a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f06c8005e10 tx=0x7f06c8005da0 comp rx=0 tx=0).stop 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.888+0000 7f06e48e9640 1 -- 172.21.15.45:0/77853331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e0102d30 msgr2=0x7f06e0198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.888+0000 7f06e48e9640 1 --2- 172.21.15.45:0/77853331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f06e0102d30 0x7f06e0198600 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009a50 tx=0x7f06d0004270 comp rx=0 tx=0).stop 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.888+0000 7f06ded9d640 1 -- 172.21.15.45:0/77853331 reap_dead start 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.888+0000 7f06e48e9640 1 -- 172.21.15.45:0/77853331 shutdown_connections 2024-09-15T22:15:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.888+0000 7f06e48e9640 1 -- 172.21.15.45:0/77853331 >> 172.21.15.45:0/77853331 conn(0x7f06e00fc7d0 msgr2=0x7f06e00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:13.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.888+0000 7f06e48e9640 1 -- 172.21.15.45:0/77853331 shutdown_connections 2024-09-15T22:15:13.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:13.888+0000 7f06e48e9640 1 -- 172.21.15.45:0/77853331 wait complete. 2024-09-15T22:15:14.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.397+0000 7f5499b34640 1 -- 172.21.15.45:0/2859314082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5494102570 msgr2=0x7f54941029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.397+0000 7f5499b34640 1 --2- 172.21.15.45:0/2859314082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5494102570 0x7f54941029b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5488009900 tx=0x7f548802a480 comp rx=0 tx=0).stop 2024-09-15T22:15:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.397+0000 7f5499b34640 1 -- 172.21.15.45:0/2859314082 shutdown_connections 2024-09-15T22:15:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.397+0000 7f5499b34640 1 --2- 172.21.15.45:0/2859314082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5494102ef0 0x7f549410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.397+0000 7f5499b34640 1 --2- 172.21.15.45:0/2859314082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5494102570 0x7f54941029b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.397+0000 7f5499b34640 1 --2- 172.21.15.45:0/2859314082 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5494100e20 0x7f5494101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.397+0000 7f5499b34640 1 -- 172.21.15.45:0/2859314082 >> 172.21.15.45:0/2859314082 conn(0x7f54940fc7d0 msgr2=0x7f54940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.397+0000 7f5499b34640 1 -- 172.21.15.45:0/2859314082 shutdown_connections 2024-09-15T22:15:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.397+0000 7f5499b34640 1 -- 172.21.15.45:0/2859314082 wait complete. 2024-09-15T22:15:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f5499b34640 1 Processor -- start 2024-09-15T22:15:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f5499b34640 1 -- start start 2024-09-15T22:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f5499b34640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5494100e20 0x7f54941984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f5499b34640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5494102570 0x7f5494198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f5499b34640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5494102ef0 0x7f549419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f5499b34640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f54941110a0 con 0x7f5494100e20 2024-09-15T22:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f5499b34640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5494110f20 con 0x7f5494102570 2024-09-15T22:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f5499b34640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5494111220 con 0x7f5494102ef0 2024-09-15T22:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f54937fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5494100e20 0x7f54941984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f54937fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5494100e20 0x7f54941984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44160/0 (socket says 172.21.15.45:44160) 2024-09-15T22:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f54937fe640 1 -- 172.21.15.45:0/4122287473 learned_addr learned my addr 172.21.15.45:0/4122287473 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f5493fff640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5494102ef0 0x7f549419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f5492ffd640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5494102570 0x7f5494198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f54937fe640 1 -- 172.21.15.45:0/4122287473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5494102ef0 msgr2=0x7f549419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f54937fe640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5494102ef0 0x7f549419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f54937fe640 1 -- 172.21.15.45:0/4122287473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5494102570 msgr2=0x7f5494198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.398+0000 7f54937fe640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5494102570 0x7f5494198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.399+0000 7f54937fe640 1 -- 172.21.15.45:0/4122287473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549419d480 con 0x7f5494100e20 2024-09-15T22:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.399+0000 7f5492ffd640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5494102570 0x7f5494198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.399+0000 7f54937fe640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5494100e20 0x7f54941984d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f548400c920 tx=0x7f548400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.399+0000 7f5490ff9640 1 -- 172.21.15.45:0/4122287473 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484007c70 con 0x7f5494100e20 2024-09-15T22:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.399+0000 7f5499b34640 1 -- 172.21.15.45:0/4122287473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f549419d770 con 0x7f5494100e20 2024-09-15T22:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.399+0000 7f5490ff9640 1 -- 172.21.15.45:0/4122287473 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5484007e10 con 0x7f5494100e20 2024-09-15T22:15:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.399+0000 7f5490ff9640 1 -- 172.21.15.45:0/4122287473 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5484018940 con 0x7f5494100e20 2024-09-15T22:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.399+0000 7f5499b34640 1 -- 172.21.15.45:0/4122287473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54941a5050 con 0x7f5494100e20 2024-09-15T22:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.400+0000 7f5499b34640 1 -- 172.21.15.45:0/4122287473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5494062980 con 0x7f5494100e20 2024-09-15T22:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.402+0000 7f5490ff9640 1 -- 172.21.15.45:0/4122287473 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5484018ae0 con 0x7f5494100e20 2024-09-15T22:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.403+0000 7f5490ff9640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f547c0a32d0 0x7f547c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.403+0000 7f5492ffd640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f547c0a32d0 0x7f547c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.403+0000 7f5490ff9640 1 -- 172.21.15.45:0/4122287473 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f54840d0310 con 0x7f5494100e20 2024-09-15T22:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.403+0000 7f5490ff9640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044] conn(0x7f547c0ae000 0x7f547c0b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.403+0000 7f5490ff9640 1 -- 172.21.15.45:0/4122287473 --> [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f547c0b0b10 con 0x7f547c0ae000 2024-09-15T22:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.403+0000 7f5490ff9640 1 -- 172.21.15.45:0/4122287473 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7f54840d0760 con 0x7f5494100e20 2024-09-15T22:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.403+0000 7f5493fff640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044] conn(0x7f547c0ae000 0x7f547c0b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.403+0000 7f5492ffd640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f547c0a32d0 0x7f547c0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5494105190 tx=0x7f5488005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.404+0000 7f5493fff640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044] conn(0x7f547c0ae000 0x7f547c0b0440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:14.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.405+0000 7f5490ff9640 1 -- 172.21.15.45:0/4122287473 <== osd.5 v2:172.21.15.165:6808/4262083044 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f547c0b0b10 con 0x7f547c0ae000 2024-09-15T22:15:14.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.418+0000 7f5499b34640 1 -- 172.21.15.45:0/4122287473 --> [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5494062d80 con 0x7f547c0ae000 2024-09-15T22:15:14.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.419+0000 7f5490ff9640 1 -- 172.21.15.45:0/4122287473 <== osd.5 v2:172.21.15.165:6808/4262083044 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5494062d80 con 0x7f547c0ae000 2024-09-15T22:15:14.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.419+0000 7f5499b34640 1 -- 172.21.15.45:0/4122287473 >> [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044] conn(0x7f547c0ae000 msgr2=0x7f547c0b0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:14.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.419+0000 7f5499b34640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044] conn(0x7f547c0ae000 0x7f547c0b0440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:14.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.419+0000 7f5499b34640 1 -- 172.21.15.45:0/4122287473 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f547c0a32d0 msgr2=0x7f547c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:14.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.419+0000 7f5499b34640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f547c0a32d0 0x7f547c0a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5494105190 tx=0x7f5488005a20 comp rx=0 tx=0).stop 2024-09-15T22:15:14.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.419+0000 7f5499b34640 1 -- 172.21.15.45:0/4122287473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5494100e20 msgr2=0x7f54941984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:14.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.419+0000 7f5499b34640 1 --2- 172.21.15.45:0/4122287473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5494100e20 0x7f54941984d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f548400c920 tx=0x7f548400cde0 comp rx=0 tx=0).stop 2024-09-15T22:15:14.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.419+0000 7f5493fff640 1 -- 172.21.15.45:0/4122287473 reap_dead start 2024-09-15T22:15:14.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.419+0000 7f5499b34640 1 -- 172.21.15.45:0/4122287473 shutdown_connections 2024-09-15T22:15:14.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.419+0000 7f5499b34640 1 -- 172.21.15.45:0/4122287473 >> 172.21.15.45:0/4122287473 conn(0x7f54940fc7d0 msgr2=0x7f549406a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:14.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.420+0000 7f5499b34640 1 -- 172.21.15.45:0/4122287473 shutdown_connections 2024-09-15T22:15:14.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.420+0000 7f5499b34640 1 -- 172.21.15.45:0/4122287473 wait complete. 2024-09-15T22:15:15.205 INFO:teuthology.orchestra.run.smithi045.stdout:34359738450 2024-09-15T22:15:15.205 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-15T22:15:15.401 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:15 smithi045 ceph-mon[31180]: pgmap v316: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:15:15.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:15 smithi165 ceph-mon[35551]: pgmap v316: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:15:15.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:15 smithi100 ceph-mon[35319]: pgmap v316: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:15:15.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.859+0000 7fc6af012640 1 -- 172.21.15.45:0/2986177767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8102790 msgr2=0x7fc6a81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.859+0000 7fc6af012640 1 --2- 172.21.15.45:0/2986177767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8102790 0x7fc6a81067e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009900 tx=0x7fc69c02a410 comp rx=0 tx=0).stop 2024-09-15T22:15:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.859+0000 7fc6af012640 1 -- 172.21.15.45:0/2986177767 shutdown_connections 2024-09-15T22:15:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.859+0000 7fc6af012640 1 --2- 172.21.15.45:0/2986177767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6a8106f10 0x7fc6a810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.859+0000 7fc6af012640 1 --2- 172.21.15.45:0/2986177767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8102790 0x7fc6a81067e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.859+0000 7fc6af012640 1 --2- 172.21.15.45:0/2986177767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6a8101de0 0x7fc6a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.859+0000 7fc6af012640 1 -- 172.21.15.45:0/2986177767 >> 172.21.15.45:0/2986177767 conn(0x7fc6a80fd8c0 msgr2=0x7fc6a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.860+0000 7fc6af012640 1 -- 172.21.15.45:0/2986177767 shutdown_connections 2024-09-15T22:15:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.860+0000 7fc6af012640 1 -- 172.21.15.45:0/2986177767 wait complete. 2024-09-15T22:15:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.860+0000 7fc6af012640 1 Processor -- start 2024-09-15T22:15:15.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.860+0000 7fc6af012640 1 -- start start 2024-09-15T22:15:15.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.860+0000 7fc6af012640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6a8101de0 0x7fc6a819a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:15.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.860+0000 7fc6af012640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6a8102790 0x7fc6a819ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:15.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.860+0000 7fc6af012640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8106f10 0x7fc6a819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:15.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.860+0000 7fc6af012640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a8112090 con 0x7fc6a8106f10 2024-09-15T22:15:15.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.860+0000 7fc6af012640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a8111f10 con 0x7fc6a8101de0 2024-09-15T22:15:15.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.860+0000 7fc6af012640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc6a8112210 con 0x7fc6a8102790 2024-09-15T22:15:15.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.860+0000 7fc6ad5af640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8106f10 0x7fc6a819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:15.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6ad5af640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8106f10 0x7fc6a819f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44170/0 (socket says 172.21.15.45:44170) 2024-09-15T22:15:15.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6ad5af640 1 -- 172.21.15.45:0/1547986280 learned_addr learned my addr 172.21.15.45:0/1547986280 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:15.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6acdae640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6a8101de0 0x7fc6a819a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:15.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6a7fff640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6a8102790 0x7fc6a819ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:15.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6ad5af640 1 -- 172.21.15.45:0/1547986280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6a8102790 msgr2=0x7fc6a819ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:15.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6ad5af640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc6a8102790 0x7fc6a819ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:15.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6ad5af640 1 -- 172.21.15.45:0/1547986280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6a8101de0 msgr2=0x7fc6a819a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:15.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6ad5af640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6a8101de0 0x7fc6a819a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:15.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6ad5af640 1 -- 172.21.15.45:0/1547986280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a819f6e0 con 0x7fc6a8106f10 2024-09-15T22:15:15.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6ad5af640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8106f10 0x7fc6a819f000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000eaa0 tx=0x7fc6a000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:15.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6a5ffb640 1 -- 172.21.15.45:0/1547986280 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a000cdb0 con 0x7fc6a8106f10 2024-09-15T22:15:15.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6a5ffb640 1 -- 172.21.15.45:0/1547986280 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc6a0004b20 con 0x7fc6a8106f10 2024-09-15T22:15:15.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6af012640 1 -- 172.21.15.45:0/1547986280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6a819f9d0 con 0x7fc6a8106f10 2024-09-15T22:15:15.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6a5ffb640 1 -- 172.21.15.45:0/1547986280 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0011760 con 0x7fc6a8106f10 2024-09-15T22:15:15.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.861+0000 7fc6af012640 1 -- 172.21.15.45:0/1547986280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6a81a72b0 con 0x7fc6a8106f10 2024-09-15T22:15:15.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.862+0000 7fc6af012640 1 -- 172.21.15.45:0/1547986280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc6a8075780 con 0x7fc6a8106f10 2024-09-15T22:15:15.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.864+0000 7fc6a5ffb640 1 -- 172.21.15.45:0/1547986280 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc6a0011900 con 0x7fc6a8106f10 2024-09-15T22:15:15.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.864+0000 7fc6a5ffb640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc6900a32d0 0x7fc6900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:15.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.864+0000 7fc6acdae640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc6900a32d0 0x7fc6900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.864+0000 7fc6a5ffb640 1 -- 172.21.15.45:0/1547986280 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fc6a00d0200 con 0x7fc6a8106f10 2024-09-15T22:15:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.864+0000 7fc6a5ffb640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440] conn(0x7fc6900ae000 0x7fc6900b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.865+0000 7fc6a5ffb640 1 -- 172.21.15.45:0/1547986280 --> [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6a0014ec0 con 0x7fc6900ae000 2024-09-15T22:15:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.865+0000 7fc6a5ffb640 1 -- 172.21.15.45:0/1547986280 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) ==== 24+0+0 (secure 0 0 0) 0x7fc6a00d0650 con 0x7fc6a8106f10 2024-09-15T22:15:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.865+0000 7fc6acdae640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc6900a32d0 0x7fc6900a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc698009bd0 tx=0x7fc698005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.865+0000 7fc6a7fff640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440] conn(0x7fc6900ae000 0x7fc6900b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.865+0000 7fc6a7fff640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440] conn(0x7fc6900ae000 0x7fc6900b0440 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.866+0000 7fc6a5ffb640 1 -- 172.21.15.45:0/1547986280 <== osd.1 v2:172.21.15.100:6800/1091448440 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc6a0014ec0 con 0x7fc6900ae000 2024-09-15T22:15:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.881+0000 7fc6af012640 1 -- 172.21.15.45:0/1547986280 --> [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc6a81032c0 con 0x7fc6900ae000 2024-09-15T22:15:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.882+0000 7fc6a5ffb640 1 -- 172.21.15.45:0/1547986280 <== osd.1 v2:172.21.15.100:6800/1091448440 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc6a81032c0 con 0x7fc6900ae000 2024-09-15T22:15:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.882+0000 7fc6af012640 1 -- 172.21.15.45:0/1547986280 >> [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440] conn(0x7fc6900ae000 msgr2=0x7fc6900b0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.882+0000 7fc6af012640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440] conn(0x7fc6900ae000 0x7fc6900b0440 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:15.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.882+0000 7fc6af012640 1 -- 172.21.15.45:0/1547986280 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc6900a32d0 msgr2=0x7fc6900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.882+0000 7fc6af012640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc6900a32d0 0x7fc6900a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc698009bd0 tx=0x7fc698005f90 comp rx=0 tx=0).stop 2024-09-15T22:15:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.882+0000 7fc6af012640 1 -- 172.21.15.45:0/1547986280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8106f10 msgr2=0x7fc6a819f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.882+0000 7fc6af012640 1 --2- 172.21.15.45:0/1547986280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6a8106f10 0x7fc6a819f000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000eaa0 tx=0x7fc6a000ef60 comp rx=0 tx=0).stop 2024-09-15T22:15:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.882+0000 7fc6ad5af640 1 -- 172.21.15.45:0/1547986280 reap_dead start 2024-09-15T22:15:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.883+0000 7fc6af012640 1 -- 172.21.15.45:0/1547986280 shutdown_connections 2024-09-15T22:15:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.883+0000 7fc6af012640 1 -- 172.21.15.45:0/1547986280 >> 172.21.15.45:0/1547986280 conn(0x7fc6a80fd8c0 msgr2=0x7fc6a80feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.883+0000 7fc6af012640 1 -- 172.21.15.45:0/1547986280 shutdown_connections 2024-09-15T22:15:15.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:14.883+0000 7fc6af012640 1 -- 172.21.15.45:0/1547986280 wait complete. 2024-09-15T22:15:16.173 INFO:teuthology.orchestra.run.smithi045.stdout:154618822713 2024-09-15T22:15:16.173 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-15T22:15:16.380 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:16 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-15T22:15:16.380 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:16 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-09-15T22:15:16.380 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:16 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-15T22:15:16.380 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:16 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-15T22:15:16.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:16 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]: dispatch 2024-09-15T22:15:16.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:16 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-15T22:15:16.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:16 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]: dispatch 2024-09-15T22:15:16.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:16 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]: dispatch 2024-09-15T22:15:16.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:16 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-15T22:15:16.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:16 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-09-15T22:15:16.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:16 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-15T22:15:16.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:16 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-09-15T22:15:16.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:16 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-15T22:15:16.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:16 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-15T22:15:16.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:16 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]: dispatch 2024-09-15T22:15:16.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:16 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-15T22:15:16.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:16 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]: dispatch 2024-09-15T22:15:16.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:16 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]: dispatch 2024-09-15T22:15:16.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:16 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-15T22:15:16.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:16 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-09-15T22:15:16.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:16 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-15T22:15:16.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:16 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]: dispatch 2024-09-15T22:15:16.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:16 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]: dispatch 2024-09-15T22:15:16.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:16 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2024-09-15T22:15:16.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:16 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]: dispatch 2024-09-15T22:15:16.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:16 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-09-15T22:15:16.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:16 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]: dispatch 2024-09-15T22:15:16.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:16 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]: dispatch 2024-09-15T22:15:16.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:16 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]: dispatch 2024-09-15T22:15:16.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:16 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-09-15T22:15:16.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.912+0000 7fcc020ff640 1 -- 172.21.15.45:0/2816436419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbfc10c170 msgr2=0x7fcbfc10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:16.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.912+0000 7fcc020ff640 1 --2- 172.21.15.45:0/2816436419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbfc10c170 0x7fcbfc10e610 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009ca0 tx=0x7fcbf402a950 comp rx=0 tx=0).stop 2024-09-15T22:15:16.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.912+0000 7fcc020ff640 1 -- 172.21.15.45:0/2816436419 shutdown_connections 2024-09-15T22:15:16.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.912+0000 7fcc020ff640 1 --2- 172.21.15.45:0/2816436419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbfc10c170 0x7fcbfc10e610 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:16.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.912+0000 7fcc020ff640 1 --2- 172.21.15.45:0/2816436419 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbfc103660 0x7fcbfc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:16.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.912+0000 7fcc020ff640 1 --2- 172.21.15.45:0/2816436419 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc102d40 0x7fcbfc103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:16.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.912+0000 7fcc020ff640 1 -- 172.21.15.45:0/2816436419 >> 172.21.15.45:0/2816436419 conn(0x7fcbfc0fc7a0 msgr2=0x7fcbfc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.912+0000 7fcc020ff640 1 -- 172.21.15.45:0/2816436419 shutdown_connections 2024-09-15T22:15:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.912+0000 7fcc020ff640 1 -- 172.21.15.45:0/2816436419 wait complete. 2024-09-15T22:15:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.913+0000 7fcc020ff640 1 Processor -- start 2024-09-15T22:15:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.913+0000 7fcc020ff640 1 -- start start 2024-09-15T22:15:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.913+0000 7fcc020ff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbfc102d40 0x7fcbfc1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.913+0000 7fcc020ff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc103660 0x7fcbfc100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.913+0000 7fcc020ff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbfc10c170 0x7fcbfc101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.913+0000 7fcc020ff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc112090 con 0x7fcbfc102d40 2024-09-15T22:15:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.913+0000 7fcc020ff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc111f10 con 0x7fcbfc103660 2024-09-15T22:15:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.913+0000 7fcc020ff640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcbfc112210 con 0x7fcbfc10c170 2024-09-15T22:15:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.913+0000 7fcbfb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbfc102d40 0x7fcbfc1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.913+0000 7fcbfb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbfc102d40 0x7fcbfc1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44184/0 (socket says 172.21.15.45:44184) 2024-09-15T22:15:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.913+0000 7fcbfb7fe640 1 -- 172.21.15.45:0/2666844188 learned_addr learned my addr 172.21.15.45:0/2666844188 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.913+0000 7fcbf2ffd640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc103660 0x7fcbfc100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.913+0000 7fcbfbfff640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbfc10c170 0x7fcbfc101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.914+0000 7fcbfb7fe640 1 -- 172.21.15.45:0/2666844188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbfc10c170 msgr2=0x7fcbfc101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.914+0000 7fcbfb7fe640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbfc10c170 0x7fcbfc101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.914+0000 7fcbfb7fe640 1 -- 172.21.15.45:0/2666844188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc103660 msgr2=0x7fcbfc100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.914+0000 7fcbfb7fe640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbfc103660 0x7fcbfc100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.914+0000 7fcbfb7fe640 1 -- 172.21.15.45:0/2666844188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbfc1a6970 con 0x7fcbfc102d40 2024-09-15T22:15:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.914+0000 7fcbfb7fe640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbfc102d40 0x7fcbfc1009a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00d950 tx=0x7fcbec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.914+0000 7fcbf97fa640 1 -- 172.21.15.45:0/2666844188 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec017070 con 0x7fcbfc102d40 2024-09-15T22:15:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.914+0000 7fcc020ff640 1 -- 172.21.15.45:0/2666844188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbfc1a6c60 con 0x7fcbfc102d40 2024-09-15T22:15:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.914+0000 7fcbf97fa640 1 -- 172.21.15.45:0/2666844188 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbec009c30 con 0x7fcbfc102d40 2024-09-15T22:15:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.914+0000 7fcbf97fa640 1 -- 172.21.15.45:0/2666844188 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbec00f740 con 0x7fcbfc102d40 2024-09-15T22:15:16.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.914+0000 7fcc020ff640 1 -- 172.21.15.45:0/2666844188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbfc1a71a0 con 0x7fcbfc102d40 2024-09-15T22:15:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.915+0000 7fcc020ff640 1 -- 172.21.15.45:0/2666844188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcbfc0fed90 con 0x7fcbfc102d40 2024-09-15T22:15:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.916+0000 7fcbf97fa640 1 -- 172.21.15.45:0/2666844188 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcbec010a80 con 0x7fcbfc102d40 2024-09-15T22:15:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.917+0000 7fcbf97fa640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fcbe80a32d0 0x7fcbe80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.917+0000 7fcbf2ffd640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fcbe80a32d0 0x7fcbe80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.917+0000 7fcbf97fa640 1 -- 172.21.15.45:0/2666844188 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fcbec0cfde0 con 0x7fcbfc102d40 2024-09-15T22:15:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.918+0000 7fcbf97fa640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014] conn(0x7fcbe80ae4a0 0x7fcbe80b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.918+0000 7fcbf97fa640 1 -- 172.21.15.45:0/2666844188 --> [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcbec016ec0 con 0x7fcbe80ae4a0 2024-09-15T22:15:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.918+0000 7fcbf97fa640 1 -- 172.21.15.45:0/2666844188 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7fcbec0d0190 con 0x7fcbfc102d40 2024-09-15T22:15:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.918+0000 7fcbf2ffd640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fcbe80a32d0 0x7fcbe80a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc102430 tx=0x7fcbe400b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.918+0000 7fcbfbfff640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014] conn(0x7fcbe80ae4a0 0x7fcbe80b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.918+0000 7fcbfbfff640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014] conn(0x7fcbe80ae4a0 0x7fcbe80b0940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:16.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.919+0000 7fcbf97fa640 1 -- 172.21.15.45:0/2666844188 <== osd.2 v2:172.21.15.165:6800/2589835014 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcbec016ec0 con 0x7fcbe80ae4a0 2024-09-15T22:15:16.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.933+0000 7fcc020ff640 1 -- 172.21.15.45:0/2666844188 --> [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcbfc06b070 con 0x7fcbe80ae4a0 2024-09-15T22:15:16.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.933+0000 7fcbf97fa640 1 -- 172.21.15.45:0/2666844188 <== osd.2 v2:172.21.15.165:6800/2589835014 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcbfc06b070 con 0x7fcbe80ae4a0 2024-09-15T22:15:16.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.934+0000 7fcc020ff640 1 -- 172.21.15.45:0/2666844188 >> [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014] conn(0x7fcbe80ae4a0 msgr2=0x7fcbe80b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:16.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.934+0000 7fcc020ff640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014] conn(0x7fcbe80ae4a0 0x7fcbe80b0940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:16.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.934+0000 7fcc020ff640 1 -- 172.21.15.45:0/2666844188 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fcbe80a32d0 msgr2=0x7fcbe80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:16.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.934+0000 7fcc020ff640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fcbe80a32d0 0x7fcbe80a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc102430 tx=0x7fcbe400b2e0 comp rx=0 tx=0).stop 2024-09-15T22:15:16.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.934+0000 7fcc020ff640 1 -- 172.21.15.45:0/2666844188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbfc102d40 msgr2=0x7fcbfc1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.934+0000 7fcc020ff640 1 --2- 172.21.15.45:0/2666844188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbfc102d40 0x7fcbfc1009a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00d950 tx=0x7fcbec00de10 comp rx=0 tx=0).stop 2024-09-15T22:15:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.934+0000 7fcbfbfff640 1 -- 172.21.15.45:0/2666844188 reap_dead start 2024-09-15T22:15:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.934+0000 7fcc020ff640 1 -- 172.21.15.45:0/2666844188 shutdown_connections 2024-09-15T22:15:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.934+0000 7fcc020ff640 1 -- 172.21.15.45:0/2666844188 >> 172.21.15.45:0/2666844188 conn(0x7fcbfc0fc7a0 msgr2=0x7fcbfc0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.934+0000 7fcc020ff640 1 -- 172.21.15.45:0/2666844188 shutdown_connections 2024-09-15T22:15:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:16.934+0000 7fcc020ff640 1 -- 172.21.15.45:0/2666844188 wait complete. 2024-09-15T22:15:17.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.347+0000 7f147c6d7640 1 -- 172.21.15.45:0/2952656960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f147410c170 msgr2=0x7f147410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:17.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.347+0000 7f147c6d7640 1 --2- 172.21.15.45:0/2952656960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f147410c170 0x7f147410e610 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f146c009ca0 tx=0x7f146c02a950 comp rx=0 tx=0).stop 2024-09-15T22:15:17.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.348+0000 7f147c6d7640 1 -- 172.21.15.45:0/2952656960 shutdown_connections 2024-09-15T22:15:17.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.348+0000 7f147c6d7640 1 --2- 172.21.15.45:0/2952656960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f147410c170 0x7f147410e610 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:17.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.348+0000 7f147c6d7640 1 --2- 172.21.15.45:0/2952656960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1474103660 0x7f147410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:17.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.348+0000 7f147c6d7640 1 --2- 172.21.15.45:0/2952656960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1474102d40 0x7f1474103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:17.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.348+0000 7f147c6d7640 1 -- 172.21.15.45:0/2952656960 >> 172.21.15.45:0/2952656960 conn(0x7f14740fc7a0 msgr2=0x7f14740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:17.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.348+0000 7f147c6d7640 1 -- 172.21.15.45:0/2952656960 shutdown_connections 2024-09-15T22:15:17.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.348+0000 7f147c6d7640 1 -- 172.21.15.45:0/2952656960 wait complete. 2024-09-15T22:15:17.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.348+0000 7f147c6d7640 1 Processor -- start 2024-09-15T22:15:17.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f147c6d7640 1 -- start start 2024-09-15T22:15:17.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f147c6d7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1474102d40 0x7f147419a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:17.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f147c6d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1474103660 0x7f147419ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:17.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f147c6d7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f147410c170 0x7f147419efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:17.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f147c6d7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1474112090 con 0x7f1474103660 2024-09-15T22:15:17.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f147c6d7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1474111f10 con 0x7f147410c170 2024-09-15T22:15:17.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f147c6d7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1474112210 con 0x7f1474102d40 2024-09-15T22:15:17.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f1479c72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1474103660 0x7f147419ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:17.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f1479c72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1474103660 0x7f147419ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44190/0 (socket says 172.21.15.45:44190) 2024-09-15T22:15:17.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f1479c72640 1 -- 172.21.15.45:0/2798106946 learned_addr learned my addr 172.21.15.45:0/2798106946 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:17.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f147a473640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1474102d40 0x7f147419a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:17.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f147ac74640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f147410c170 0x7f147419efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:17.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f1479c72640 1 -- 172.21.15.45:0/2798106946 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1474102d40 msgr2=0x7f147419a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:17.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f1479c72640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1474102d40 0x7f147419a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:17.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f1479c72640 1 -- 172.21.15.45:0/2798106946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f147410c170 msgr2=0x7f147419efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f1479c72640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f147410c170 0x7f147419efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f1479c72640 1 -- 172.21.15.45:0/2798106946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147419f6b0 con 0x7f1474103660 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.349+0000 7f1479c72640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1474103660 0x7f147419ac40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f146400e9f0 tx=0x7f146400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.350+0000 7f146b7fe640 1 -- 172.21.15.45:0/2798106946 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146400ccc0 con 0x7f1474103660 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.350+0000 7f146b7fe640 1 -- 172.21.15.45:0/2798106946 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f146400ce60 con 0x7f1474103660 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.350+0000 7f147c6d7640 1 -- 172.21.15.45:0/2798106946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147419f9a0 con 0x7f1474103660 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.350+0000 7f146b7fe640 1 -- 172.21.15.45:0/2798106946 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464010690 con 0x7f1474103660 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.350+0000 7f147c6d7640 1 -- 172.21.15.45:0/2798106946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14741a7280 con 0x7f1474103660 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.351+0000 7f147c6d7640 1 -- 172.21.15.45:0/2798106946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1474102450 con 0x7f1474103660 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.352+0000 7f146b7fe640 1 -- 172.21.15.45:0/2798106946 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f14640046c0 con 0x7f1474103660 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.353+0000 7f146b7fe640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f14600a32d0 0x7f14600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.353+0000 7f147a473640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f14600a32d0 0x7f14600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.353+0000 7f146b7fe640 1 -- 172.21.15.45:0/2798106946 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f14640d0660 con 0x7f1474103660 2024-09-15T22:15:17.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.353+0000 7f146b7fe640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991] conn(0x7f14600ae4a0 0x7f14600b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:17.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.353+0000 7f146b7fe640 1 -- 172.21.15.45:0/2798106946 --> [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14600b1010 con 0x7f14600ae4a0 2024-09-15T22:15:17.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.353+0000 7f146b7fe640 1 -- 172.21.15.45:0/2798106946 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f14640d0ab0 con 0x7f1474103660 2024-09-15T22:15:17.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.353+0000 7f147a473640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f14600a32d0 0x7f14600a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1470005fd0 tx=0x7f1470005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:17.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.353+0000 7f147ac74640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991] conn(0x7f14600ae4a0 0x7f14600b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:17.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.354+0000 7f147ac74640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991] conn(0x7f14600ae4a0 0x7f14600b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:17.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.355+0000 7f146b7fe640 1 -- 172.21.15.45:0/2798106946 <== osd.4 v2:172.21.15.100:6808/3961938991 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14600b1010 con 0x7f14600ae4a0 2024-09-15T22:15:17.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:17 smithi045 ceph-mon[31180]: pgmap v317: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:15:17.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-15T22:15:17.371 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-15T22:15:17.372 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-15T22:15:17.372 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-15T22:15:17.372 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]': finished 2024-09-15T22:15:17.372 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-15T22:15:17.372 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]': finished 2024-09-15T22:15:17.372 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-09-15T22:15:17.372 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-15T22:15:17.372 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:17 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-15T22:15:17.372 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:17 smithi045 ceph-mon[31180]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T22:15:17.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.370+0000 7f147c6d7640 1 -- 172.21.15.45:0/2798106946 --> [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f147406b070 con 0x7f14600ae4a0 2024-09-15T22:15:17.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.370+0000 7f146b7fe640 1 -- 172.21.15.45:0/2798106946 <== osd.4 v2:172.21.15.100:6808/3961938991 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f147406b070 con 0x7f14600ae4a0 2024-09-15T22:15:17.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.370+0000 7f147c6d7640 1 -- 172.21.15.45:0/2798106946 >> [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991] conn(0x7f14600ae4a0 msgr2=0x7f14600b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:17.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.370+0000 7f147c6d7640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991] conn(0x7f14600ae4a0 0x7f14600b0940 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:17.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.370+0000 7f147c6d7640 1 -- 172.21.15.45:0/2798106946 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f14600a32d0 msgr2=0x7f14600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:17.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.370+0000 7f147c6d7640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f14600a32d0 0x7f14600a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1470005fd0 tx=0x7f1470005850 comp rx=0 tx=0).stop 2024-09-15T22:15:17.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.370+0000 7f147c6d7640 1 -- 172.21.15.45:0/2798106946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1474103660 msgr2=0x7f147419ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:17.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.370+0000 7f147c6d7640 1 --2- 172.21.15.45:0/2798106946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1474103660 0x7f147419ac40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f146400e9f0 tx=0x7f146400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:15:17.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.370+0000 7f147ac74640 1 -- 172.21.15.45:0/2798106946 reap_dead start 2024-09-15T22:15:17.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.370+0000 7f147c6d7640 1 -- 172.21.15.45:0/2798106946 shutdown_connections 2024-09-15T22:15:17.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.370+0000 7f147c6d7640 1 -- 172.21.15.45:0/2798106946 >> 172.21.15.45:0/2798106946 conn(0x7f14740fc7a0 msgr2=0x7f147410d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:17.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.371+0000 7f147c6d7640 1 -- 172.21.15.45:0/2798106946 shutdown_connections 2024-09-15T22:15:17.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:17.371+0000 7f147c6d7640 1 -- 172.21.15.45:0/2798106946 wait complete. 2024-09-15T22:15:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:17 smithi165 ceph-mon[35551]: pgmap v317: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:15:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-15T22:15:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-15T22:15:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-15T22:15:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-15T22:15:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]': finished 2024-09-15T22:15:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-15T22:15:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]': finished 2024-09-15T22:15:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-09-15T22:15:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-15T22:15:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:17 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-15T22:15:17.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:17 smithi165 ceph-mon[35551]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T22:15:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:17 smithi100 ceph-mon[35319]: pgmap v317: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:15:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-15T22:15:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-15T22:15:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 6]}]': finished 2024-09-15T22:15:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2024-09-15T22:15:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 7]}]': finished 2024-09-15T22:15:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-09-15T22:15:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.11", "id": [5, 8]}]': finished 2024-09-15T22:15:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 10]}]': finished 2024-09-15T22:15:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.19", "id": [9, 8]}]': finished 2024-09-15T22:15:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:17 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-15T22:15:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:17 smithi100 ceph-mon[35319]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T22:15:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.180+0000 7f675b707640 1 -- 172.21.15.45:0/3783187242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6754102790 msgr2=0x7f67541067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.180+0000 7f675b707640 1 --2- 172.21.15.45:0/3783187242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6754102790 0x7f67541067e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6744009900 tx=0x7f674402a410 comp rx=0 tx=0).stop 2024-09-15T22:15:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.180+0000 7f675b707640 1 -- 172.21.15.45:0/3783187242 shutdown_connections 2024-09-15T22:15:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.180+0000 7f675b707640 1 --2- 172.21.15.45:0/3783187242 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6754106f10 0x7f675410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.180+0000 7f675b707640 1 --2- 172.21.15.45:0/3783187242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6754102790 0x7f67541067e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.180+0000 7f675b707640 1 --2- 172.21.15.45:0/3783187242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6754101de0 0x7f67541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.180+0000 7f675b707640 1 -- 172.21.15.45:0/3783187242 >> 172.21.15.45:0/3783187242 conn(0x7f67540fd8c0 msgr2=0x7f67540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.180+0000 7f675b707640 1 -- 172.21.15.45:0/3783187242 shutdown_connections 2024-09-15T22:15:18.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.180+0000 7f675b707640 1 -- 172.21.15.45:0/3783187242 wait complete. 2024-09-15T22:15:18.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.181+0000 7f675b707640 1 Processor -- start 2024-09-15T22:15:18.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.181+0000 7f675b707640 1 -- start start 2024-09-15T22:15:18.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.181+0000 7f675b707640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6754101de0 0x7f6754198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:18.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.181+0000 7f675b707640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6754102790 0x7f67541989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:18.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.181+0000 7f675b707640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6754106f10 0x7f675419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:18.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.181+0000 7f675b707640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6754112090 con 0x7f6754102790 2024-09-15T22:15:18.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.181+0000 7f675b707640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6754111f10 con 0x7f6754106f10 2024-09-15T22:15:18.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.181+0000 7f675b707640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6754112210 con 0x7f6754101de0 2024-09-15T22:15:18.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.181+0000 7f6758ca2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6754102790 0x7f67541989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:18.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.181+0000 7f6758ca2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6754102790 0x7f67541989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44214/0 (socket says 172.21.15.45:44214) 2024-09-15T22:15:18.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.181+0000 7f6758ca2640 1 -- 172.21.15.45:0/3969162410 learned_addr learned my addr 172.21.15.45:0/3969162410 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:18.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.181+0000 7f6759ca4640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6754106f10 0x7f675419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:18.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.181+0000 7f67594a3640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6754101de0 0x7f6754198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:18.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.182+0000 7f6758ca2640 1 -- 172.21.15.45:0/3969162410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6754101de0 msgr2=0x7f6754198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:18.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.182+0000 7f6758ca2640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6754101de0 0x7f6754198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:18.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.182+0000 7f6758ca2640 1 -- 172.21.15.45:0/3969162410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6754106f10 msgr2=0x7f675419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:18.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.182+0000 7f6758ca2640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6754106f10 0x7f675419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:18.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.182+0000 7f6758ca2640 1 -- 172.21.15.45:0/3969162410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675419d440 con 0x7f6754102790 2024-09-15T22:15:18.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.182+0000 7f6758ca2640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6754102790 0x7f67541989d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6744006010 tx=0x7f67440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:18.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.182+0000 7f674a7fc640 1 -- 172.21.15.45:0/3969162410 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f674403f030 con 0x7f6754102790 2024-09-15T22:15:18.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.182+0000 7f674a7fc640 1 -- 172.21.15.45:0/3969162410 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6744003d00 con 0x7f6754102790 2024-09-15T22:15:18.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.182+0000 7f675b707640 1 -- 172.21.15.45:0/3969162410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f675419d6d0 con 0x7f6754102790 2024-09-15T22:15:18.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.182+0000 7f674a7fc640 1 -- 172.21.15.45:0/3969162410 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6744035070 con 0x7f6754102790 2024-09-15T22:15:18.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.182+0000 7f675b707640 1 -- 172.21.15.45:0/3969162410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67541a5010 con 0x7f6754102790 2024-09-15T22:15:18.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.183+0000 7f675b707640 1 -- 172.21.15.45:0/3969162410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6754062980 con 0x7f6754102790 2024-09-15T22:15:18.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.184+0000 7f674a7fc640 1 -- 172.21.15.45:0/3969162410 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6744042030 con 0x7f6754102790 2024-09-15T22:15:18.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.185+0000 7f674a7fc640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f67400a32d0 0x7f67400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:18.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.185+0000 7f67594a3640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f67400a32d0 0x7f67400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:18.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.185+0000 7f674a7fc640 1 -- 172.21.15.45:0/3969162410 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f67440f0bf0 con 0x7f6754102790 2024-09-15T22:15:18.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.185+0000 7f674a7fc640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268] conn(0x7f67400ae4a0 0x7f67400b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:18.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.185+0000 7f674a7fc640 1 -- 172.21.15.45:0/3969162410 --> [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f67400b1010 con 0x7f67400ae4a0 2024-09-15T22:15:18.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.185+0000 7f674a7fc640 1 -- 172.21.15.45:0/3969162410 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f67440f1040 con 0x7f6754102790 2024-09-15T22:15:18.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.185+0000 7f6759ca4640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268] conn(0x7f67400ae4a0 0x7f67400b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:18.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.185+0000 7f67594a3640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f67400a32d0 0x7f67400a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f675000bbe0 tx=0x7f675000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:18.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.186+0000 7f6759ca4640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268] conn(0x7f67400ae4a0 0x7f67400b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:18.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.186+0000 7f674a7fc640 1 -- 172.21.15.45:0/3969162410 <== osd.3 v2:172.21.15.45:6810/3139088268 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f67400b1010 con 0x7f67400ae4a0 2024-09-15T22:15:18.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.200+0000 7f675b707640 1 -- 172.21.15.45:0/3969162410 --> [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6754062e00 con 0x7f67400ae4a0 2024-09-15T22:15:18.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.200+0000 7f674a7fc640 1 -- 172.21.15.45:0/3969162410 <== osd.3 v2:172.21.15.45:6810/3139088268 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6754062e00 con 0x7f67400ae4a0 2024-09-15T22:15:18.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.201+0000 7f675b707640 1 -- 172.21.15.45:0/3969162410 >> [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268] conn(0x7f67400ae4a0 msgr2=0x7f67400b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:18.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.201+0000 7f675b707640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268] conn(0x7f67400ae4a0 0x7f67400b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:18.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.201+0000 7f675b707640 1 -- 172.21.15.45:0/3969162410 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f67400a32d0 msgr2=0x7f67400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:18.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.201+0000 7f675b707640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f67400a32d0 0x7f67400a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f675000bbe0 tx=0x7f675000b390 comp rx=0 tx=0).stop 2024-09-15T22:15:18.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.201+0000 7f675b707640 1 -- 172.21.15.45:0/3969162410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6754102790 msgr2=0x7f67541989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:18.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.201+0000 7f675b707640 1 --2- 172.21.15.45:0/3969162410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6754102790 0x7f67541989d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6744006010 tx=0x7f67440042f0 comp rx=0 tx=0).stop 2024-09-15T22:15:18.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.201+0000 7f6759ca4640 1 -- 172.21.15.45:0/3969162410 reap_dead start 2024-09-15T22:15:18.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.201+0000 7f675b707640 1 -- 172.21.15.45:0/3969162410 shutdown_connections 2024-09-15T22:15:18.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.201+0000 7f675b707640 1 -- 172.21.15.45:0/3969162410 >> 172.21.15.45:0/3969162410 conn(0x7f67540fd8c0 msgr2=0x7f67540fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:18.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.201+0000 7f675b707640 1 -- 172.21.15.45:0/3969162410 shutdown_connections 2024-09-15T22:15:18.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.201+0000 7f675b707640 1 -- 172.21.15.45:0/3969162410 wait complete. 2024-09-15T22:15:18.373 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:18 smithi045 ceph-mon[31180]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T22:15:18.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:18 smithi165 ceph-mon[35551]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T22:15:18.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:18 smithi100 ceph-mon[35319]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T22:15:19.010 INFO:teuthology.orchestra.run.smithi045.stdout:322122547227 2024-09-15T22:15:19.010 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-15T22:15:19.391 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:19 smithi045 ceph-mon[31180]: pgmap v320: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-15T22:15:19.392 INFO:teuthology.orchestra.run.smithi045.stdout:77309411401 2024-09-15T22:15:19.393 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-15T22:15:19.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:19 smithi165 ceph-mon[35551]: pgmap v320: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-15T22:15:19.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:19 smithi100 ceph-mon[35319]: pgmap v320: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 383 B/s wr, 2 op/s 2024-09-15T22:15:19.806 INFO:teuthology.orchestra.run.smithi045.stdout:133143986238 2024-09-15T22:15:19.807 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-15T22:15:20.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.371+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/1705327950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b24103660 msgr2=0x7f3b2410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:20.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.371+0000 7f3b2b6a3640 1 --2- 172.21.15.45:0/1705327950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b24103660 0x7f3b2410bb50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009900 tx=0x7f3b1402a480 comp rx=0 tx=0).stop 2024-09-15T22:15:20.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.371+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/1705327950 shutdown_connections 2024-09-15T22:15:20.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.371+0000 7f3b2b6a3640 1 --2- 172.21.15.45:0/1705327950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b2410c170 0x7f3b2410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:20.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.371+0000 7f3b2b6a3640 1 --2- 172.21.15.45:0/1705327950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b24103660 0x7f3b2410bb50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:20.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.371+0000 7f3b2b6a3640 1 --2- 172.21.15.45:0/1705327950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b24102d40 0x7f3b24103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:20.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.371+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/1705327950 >> 172.21.15.45:0/1705327950 conn(0x7f3b240fc7a0 msgr2=0x7f3b240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:20.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.371+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/1705327950 shutdown_connections 2024-09-15T22:15:20.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.371+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/1705327950 wait complete. 2024-09-15T22:15:20.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.372+0000 7f3b2b6a3640 1 Processor -- start 2024-09-15T22:15:20.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.372+0000 7f3b2b6a3640 1 -- start start 2024-09-15T22:15:20.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.372+0000 7f3b2b6a3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b24102d40 0x7f3b241009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:20.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.372+0000 7f3b2b6a3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b24103660 0x7f3b24100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:20.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.372+0000 7f3b2b6a3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b2410c170 0x7f3b24101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:20.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.372+0000 7f3b2b6a3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3b24112090 con 0x7f3b24103660 2024-09-15T22:15:20.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.372+0000 7f3b2b6a3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3b24111f10 con 0x7f3b2410c170 2024-09-15T22:15:20.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.372+0000 7f3b2b6a3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3b24112210 con 0x7f3b24102d40 2024-09-15T22:15:20.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.372+0000 7f3b28c3e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b24103660 0x7f3b24100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:20.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.372+0000 7f3b28c3e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b24103660 0x7f3b24100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44234/0 (socket says 172.21.15.45:44234) 2024-09-15T22:15:20.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.372+0000 7f3b28c3e640 1 -- 172.21.15.45:0/4172170394 learned_addr learned my addr 172.21.15.45:0/4172170394 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:20.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.372+0000 7f3b2943f640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b24102d40 0x7f3b241009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:20.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.372+0000 7f3b29c40640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b2410c170 0x7f3b24101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:20.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.373+0000 7f3b28c3e640 1 -- 172.21.15.45:0/4172170394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b24102d40 msgr2=0x7f3b241009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:20.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.373+0000 7f3b28c3e640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3b24102d40 0x7f3b241009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:20.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.373+0000 7f3b28c3e640 1 -- 172.21.15.45:0/4172170394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b2410c170 msgr2=0x7f3b24101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:20.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.373+0000 7f3b28c3e640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b2410c170 0x7f3b24101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:20.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.373+0000 7f3b28c3e640 1 -- 172.21.15.45:0/4172170394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b241a69b0 con 0x7f3b24103660 2024-09-15T22:15:20.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.373+0000 7f3b28c3e640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b24103660 0x7f3b24100ee0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3b14006010 tx=0x7f3b140040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:20.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.373+0000 7f3b1a7fc640 1 -- 172.21.15.45:0/4172170394 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1403f030 con 0x7f3b24103660 2024-09-15T22:15:20.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.373+0000 7f3b1a7fc640 1 -- 172.21.15.45:0/4172170394 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3b140044c0 con 0x7f3b24103660 2024-09-15T22:15:20.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.373+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/4172170394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b241a6c40 con 0x7f3b24103660 2024-09-15T22:15:20.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.373+0000 7f3b1a7fc640 1 -- 172.21.15.45:0/4172170394 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14035070 con 0x7f3b24103660 2024-09-15T22:15:20.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.373+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/4172170394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b241a7170 con 0x7f3b24103660 2024-09-15T22:15:20.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.374+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/4172170394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b240fed50 con 0x7f3b24103660 2024-09-15T22:15:20.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.375+0000 7f3b1a7fc640 1 -- 172.21.15.45:0/4172170394 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3b14042030 con 0x7f3b24103660 2024-09-15T22:15:20.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.376+0000 7f3b1a7fc640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b100a3350 0x7f3b100a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:20.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.376+0000 7f3b2943f640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b100a3350 0x7f3b100a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:20.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.376+0000 7f3b1a7fc640 1 -- 172.21.15.45:0/4172170394 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f3b140f06e0 con 0x7f3b24103660 2024-09-15T22:15:20.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.376+0000 7f3b1a7fc640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304] conn(0x7f3b100ae520 0x7f3b100b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:20.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.376+0000 7f3b1a7fc640 1 -- 172.21.15.45:0/4172170394 --> [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b14001d30 con 0x7f3b100ae520 2024-09-15T22:15:20.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.376+0000 7f3b1a7fc640 1 -- 172.21.15.45:0/4172170394 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f3b140f0b30 con 0x7f3b24103660 2024-09-15T22:15:20.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.376+0000 7f3b2943f640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b100a3350 0x7f3b100a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009bd0 tx=0x7f3b20005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:20.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.377+0000 7f3b29c40640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304] conn(0x7f3b100ae520 0x7f3b100b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:20.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.377+0000 7f3b29c40640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304] conn(0x7f3b100ae520 0x7f3b100b09c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:20.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.378+0000 7f3b1a7fc640 1 -- 172.21.15.45:0/4172170394 <== osd.7 v2:172.21.15.100:6816/9412304 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b14001d30 con 0x7f3b100ae520 2024-09-15T22:15:20.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.392+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/4172170394 --> [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b2406b070 con 0x7f3b100ae520 2024-09-15T22:15:20.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.392+0000 7f3b1a7fc640 1 -- 172.21.15.45:0/4172170394 <== osd.7 v2:172.21.15.100:6816/9412304 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3b2406b070 con 0x7f3b100ae520 2024-09-15T22:15:20.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.393+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/4172170394 >> [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304] conn(0x7f3b100ae520 msgr2=0x7f3b100b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:20.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.393+0000 7f3b2b6a3640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304] conn(0x7f3b100ae520 0x7f3b100b09c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:20.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.393+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/4172170394 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b100a3350 msgr2=0x7f3b100a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:20.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.393+0000 7f3b2b6a3640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3b100a3350 0x7f3b100a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009bd0 tx=0x7f3b20005f90 comp rx=0 tx=0).stop 2024-09-15T22:15:20.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.393+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/4172170394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b24103660 msgr2=0x7f3b24100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:20.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.393+0000 7f3b2b6a3640 1 --2- 172.21.15.45:0/4172170394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b24103660 0x7f3b24100ee0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3b14006010 tx=0x7f3b140040c0 comp rx=0 tx=0).stop 2024-09-15T22:15:20.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.393+0000 7f3b29c40640 1 -- 172.21.15.45:0/4172170394 reap_dead start 2024-09-15T22:15:20.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.393+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/4172170394 shutdown_connections 2024-09-15T22:15:20.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.393+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/4172170394 >> 172.21.15.45:0/4172170394 conn(0x7f3b240fc7a0 msgr2=0x7f3b240fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:20.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.393+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/4172170394 shutdown_connections 2024-09-15T22:15:20.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:18.393+0000 7f3b2b6a3640 1 -- 172.21.15.45:0/4172170394 wait complete. 2024-09-15T22:15:20.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.802+0000 7fea7b43b640 1 -- 172.21.15.45:0/634365290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea74101280 msgr2=0x7fea7410df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.802+0000 7fea7b43b640 1 --2- 172.21.15.45:0/634365290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea74101280 0x7fea7410df40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fea68009900 tx=0x7fea6802a410 comp rx=0 tx=0).stop 2024-09-15T22:15:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.802+0000 7fea7b43b640 1 -- 172.21.15.45:0/634365290 shutdown_connections 2024-09-15T22:15:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.802+0000 7fea7b43b640 1 --2- 172.21.15.45:0/634365290 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea7410e480 0x7fea74110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.802+0000 7fea7b43b640 1 --2- 172.21.15.45:0/634365290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea74101280 0x7fea7410df40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.802+0000 7fea7b43b640 1 --2- 172.21.15.45:0/634365290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea741008d0 0x7fea74100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.802+0000 7fea7b43b640 1 -- 172.21.15.45:0/634365290 >> 172.21.15.45:0/634365290 conn(0x7fea740fc7a0 msgr2=0x7fea740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.802+0000 7fea7b43b640 1 -- 172.21.15.45:0/634365290 shutdown_connections 2024-09-15T22:15:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.802+0000 7fea7b43b640 1 -- 172.21.15.45:0/634365290 wait complete. 2024-09-15T22:15:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.803+0000 7fea7b43b640 1 Processor -- start 2024-09-15T22:15:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.803+0000 7fea7b43b640 1 -- start start 2024-09-15T22:15:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.803+0000 7fea7b43b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea741008d0 0x7fea7419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:20.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.803+0000 7fea7b43b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea74101280 0x7fea7419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:20.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.803+0000 7fea7b43b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea7410e480 0x7fea7419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:20.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.803+0000 7fea7b43b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fea741142c0 con 0x7fea741008d0 2024-09-15T22:15:20.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.803+0000 7fea7b43b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fea74114140 con 0x7fea74101280 2024-09-15T22:15:20.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.803+0000 7fea7b43b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fea74114440 con 0x7fea7410e480 2024-09-15T22:15:20.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.803+0000 7fea791d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea741008d0 0x7fea7419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:20.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.803+0000 7fea791d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea741008d0 0x7fea7419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44264/0 (socket says 172.21.15.45:44264) 2024-09-15T22:15:20.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.803+0000 7fea791d7640 1 -- 172.21.15.45:0/1731223486 learned_addr learned my addr 172.21.15.45:0/1731223486 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:20.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.803+0000 7fea799d8640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea7410e480 0x7fea7419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:20.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea789d6640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea74101280 0x7fea7419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea791d7640 1 -- 172.21.15.45:0/1731223486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea7410e480 msgr2=0x7fea7419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea791d7640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea7410e480 0x7fea7419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea791d7640 1 -- 172.21.15.45:0/1731223486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea74101280 msgr2=0x7fea7419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea791d7640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea74101280 0x7fea7419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea791d7640 1 -- 172.21.15.45:0/1731223486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7419f670 con 0x7fea741008d0 2024-09-15T22:15:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea799d8640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fea7410e480 0x7fea7419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:15:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea789d6640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea74101280 0x7fea7419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:15:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea791d7640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea741008d0 0x7fea7419a6c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fea6400cce0 tx=0x7fea6400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea727fc640 1 -- 172.21.15.45:0/1731223486 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6400f650 con 0x7fea741008d0 2024-09-15T22:15:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea727fc640 1 -- 172.21.15.45:0/1731223486 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea6400fcf0 con 0x7fea741008d0 2024-09-15T22:15:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea7b43b640 1 -- 172.21.15.45:0/1731223486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea7419f960 con 0x7fea741008d0 2024-09-15T22:15:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea727fc640 1 -- 172.21.15.45:0/1731223486 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea64018d20 con 0x7fea741008d0 2024-09-15T22:15:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.804+0000 7fea7b43b640 1 -- 172.21.15.45:0/1731223486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea741a7240 con 0x7fea741008d0 2024-09-15T22:15:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.805+0000 7fea7b43b640 1 -- 172.21.15.45:0/1731223486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fea7410f9a0 con 0x7fea741008d0 2024-09-15T22:15:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.806+0000 7fea727fc640 1 -- 172.21.15.45:0/1731223486 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fea6400f7f0 con 0x7fea741008d0 2024-09-15T22:15:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.807+0000 7fea727fc640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fea5c0a3350 0x7fea5c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.807+0000 7fea789d6640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fea5c0a3350 0x7fea5c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.807+0000 7fea727fc640 1 -- 172.21.15.45:0/1731223486 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fea640d0810 con 0x7fea741008d0 2024-09-15T22:15:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.807+0000 7fea727fc640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821] conn(0x7fea5c0ae520 0x7fea5c0b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.807+0000 7fea727fc640 1 -- 172.21.15.45:0/1731223486 --> [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea5c0b1090 con 0x7fea5c0ae520 2024-09-15T22:15:20.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.807+0000 7fea727fc640 1 -- 172.21.15.45:0/1731223486 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fea640d0c60 con 0x7fea741008d0 2024-09-15T22:15:20.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.808+0000 7fea789d6640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fea5c0a3350 0x7fea5c0a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fea68000c00 tx=0x7fea68032d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:20.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.808+0000 7fea799d8640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821] conn(0x7fea5c0ae520 0x7fea5c0b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:20.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.808+0000 7fea799d8640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821] conn(0x7fea5c0ae520 0x7fea5c0b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:20.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.809+0000 7fea727fc640 1 -- 172.21.15.45:0/1731223486 <== osd.8 v2:172.21.15.165:6816/134921821 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fea5c0b1090 con 0x7fea5c0ae520 2024-09-15T22:15:20.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.823+0000 7fea7b43b640 1 -- 172.21.15.45:0/1731223486 --> [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fea7406b070 con 0x7fea5c0ae520 2024-09-15T22:15:20.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.823+0000 7fea727fc640 1 -- 172.21.15.45:0/1731223486 <== osd.8 v2:172.21.15.165:6816/134921821 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fea7406b070 con 0x7fea5c0ae520 2024-09-15T22:15:20.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.824+0000 7fea7b43b640 1 -- 172.21.15.45:0/1731223486 >> [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821] conn(0x7fea5c0ae520 msgr2=0x7fea5c0b09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:20.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.824+0000 7fea7b43b640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821] conn(0x7fea5c0ae520 0x7fea5c0b09c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:20.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.824+0000 7fea7b43b640 1 -- 172.21.15.45:0/1731223486 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fea5c0a3350 msgr2=0x7fea5c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:20.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.824+0000 7fea7b43b640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fea5c0a3350 0x7fea5c0a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fea68000c00 tx=0x7fea68032d60 comp rx=0 tx=0).stop 2024-09-15T22:15:20.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.824+0000 7fea7b43b640 1 -- 172.21.15.45:0/1731223486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea741008d0 msgr2=0x7fea7419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:20.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.824+0000 7fea7b43b640 1 --2- 172.21.15.45:0/1731223486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea741008d0 0x7fea7419a6c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fea6400cce0 tx=0x7fea6400a620 comp rx=0 tx=0).stop 2024-09-15T22:15:20.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.824+0000 7fea799d8640 1 -- 172.21.15.45:0/1731223486 reap_dead start 2024-09-15T22:15:20.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.824+0000 7fea7b43b640 1 -- 172.21.15.45:0/1731223486 shutdown_connections 2024-09-15T22:15:20.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.824+0000 7fea7b43b640 1 -- 172.21.15.45:0/1731223486 >> 172.21.15.45:0/1731223486 conn(0x7fea740fc7a0 msgr2=0x7fea740feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:20.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.824+0000 7fea7b43b640 1 -- 172.21.15.45:0/1731223486 shutdown_connections 2024-09-15T22:15:20.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:20.824+0000 7fea7b43b640 1 -- 172.21.15.45:0/1731223486 wait complete. 2024-09-15T22:15:21.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:21 smithi165 ceph-mon[35551]: pgmap v321: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-15T22:15:21.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:21 smithi100 ceph-mon[35319]: pgmap v321: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-15T22:15:21.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:21 smithi045 ceph-mon[31180]: pgmap v321: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 1 op/s 2024-09-15T22:15:21.583 INFO:teuthology.orchestra.run.smithi045.stdout:270582939684 2024-09-15T22:15:21.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-15T22:15:22.060 INFO:teuthology.orchestra.run.smithi045.stdout:206158430255 2024-09-15T22:15:22.060 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-15T22:15:22.470 INFO:teuthology.orchestra.run.smithi045.stdout:103079215172 2024-09-15T22:15:22.470 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-15T22:15:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.643+0000 7ff5cdab6640 1 -- 172.21.15.45:0/454485851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c8100e20 msgr2=0x7ff5c8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.643+0000 7ff5cdab6640 1 --2- 172.21.15.45:0/454485851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c8100e20 0x7ff5c8101200 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009900 tx=0x7ff5b802a480 comp rx=0 tx=0).stop 2024-09-15T22:15:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.643+0000 7ff5cdab6640 1 -- 172.21.15.45:0/454485851 shutdown_connections 2024-09-15T22:15:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.643+0000 7ff5cdab6640 1 --2- 172.21.15.45:0/454485851 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5c8102ef0 0x7ff5c810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.643+0000 7ff5cdab6640 1 --2- 172.21.15.45:0/454485851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5c8102570 0x7ff5c81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.643+0000 7ff5cdab6640 1 --2- 172.21.15.45:0/454485851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c8100e20 0x7ff5c8101200 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.643+0000 7ff5cdab6640 1 -- 172.21.15.45:0/454485851 >> 172.21.15.45:0/454485851 conn(0x7ff5c80fc7d0 msgr2=0x7ff5c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.643+0000 7ff5cdab6640 1 -- 172.21.15.45:0/454485851 shutdown_connections 2024-09-15T22:15:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.643+0000 7ff5cdab6640 1 -- 172.21.15.45:0/454485851 wait complete. 2024-09-15T22:15:22.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.644+0000 7ff5cdab6640 1 Processor -- start 2024-09-15T22:15:22.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.644+0000 7ff5cdab6640 1 -- start start 2024-09-15T22:15:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.644+0000 7ff5cdab6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c8100e20 0x7ff5c8103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.644+0000 7ff5cdab6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5c8102570 0x7ff5c8103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.644+0000 7ff5cdab6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5c8102ef0 0x7ff5c81041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.644+0000 7ff5cdab6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c81110f0 con 0x7ff5c8100e20 2024-09-15T22:15:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.644+0000 7ff5cdab6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c8110f70 con 0x7ff5c8102570 2024-09-15T22:15:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5cdab6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c8111270 con 0x7ff5c8102ef0 2024-09-15T22:15:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5c77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c8100e20 0x7ff5c8103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5c77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c8100e20 0x7ff5c8103750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44290/0 (socket says 172.21.15.45:44290) 2024-09-15T22:15:22.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5c77fe640 1 -- 172.21.15.45:0/2313894241 learned_addr learned my addr 172.21.15.45:0/2313894241 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5beffd640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5c8102570 0x7ff5c8103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5c7fff640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5c8102ef0 0x7ff5c81041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5c77fe640 1 -- 172.21.15.45:0/2313894241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5c8102ef0 msgr2=0x7ff5c81041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5c77fe640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff5c8102ef0 0x7ff5c81041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5c77fe640 1 -- 172.21.15.45:0/2313894241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5c8102570 msgr2=0x7ff5c8103c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5c77fe640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5c8102570 0x7ff5c8103c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5c77fe640 1 -- 172.21.15.45:0/2313894241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c81a69e0 con 0x7ff5c8100e20 2024-09-15T22:15:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5c77fe640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c8100e20 0x7ff5c8103750 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8006010 tx=0x7ff5b80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5c57fa640 1 -- 172.21.15.45:0/2313894241 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b803f070 con 0x7ff5c8100e20 2024-09-15T22:15:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5c57fa640 1 -- 172.21.15.45:0/2313894241 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5b8005590 con 0x7ff5c8100e20 2024-09-15T22:15:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.645+0000 7ff5c57fa640 1 -- 172.21.15.45:0/2313894241 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8035030 con 0x7ff5c8100e20 2024-09-15T22:15:22.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.646+0000 7ff5cdab6640 1 -- 172.21.15.45:0/2313894241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c81a6c70 con 0x7ff5c8100e20 2024-09-15T22:15:22.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.646+0000 7ff5cdab6640 1 -- 172.21.15.45:0/2313894241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c81a7150 con 0x7ff5c8100e20 2024-09-15T22:15:22.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.647+0000 7ff5cdab6640 1 -- 172.21.15.45:0/2313894241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5c806aac0 con 0x7ff5c8100e20 2024-09-15T22:15:22.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.648+0000 7ff5c57fa640 1 -- 172.21.15.45:0/2313894241 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff5b8042070 con 0x7ff5c8100e20 2024-09-15T22:15:22.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.649+0000 7ff5c57fa640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff5b40a32d0 0x7ff5b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:22.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.649+0000 7ff5beffd640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff5b40a32d0 0x7ff5b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:22.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.650+0000 7ff5c57fa640 1 -- 172.21.15.45:0/2313894241 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff5b80f0aa0 con 0x7ff5c8100e20 2024-09-15T22:15:22.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.650+0000 7ff5c57fa640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547] conn(0x7ff5b40ae4a0 0x7ff5b40b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:22.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.650+0000 7ff5c57fa640 1 -- 172.21.15.45:0/2313894241 --> [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5b8038e90 con 0x7ff5b40ae4a0 2024-09-15T22:15:22.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.650+0000 7ff5c57fa640 1 -- 172.21.15.45:0/2313894241 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7ff5b80f0e50 con 0x7ff5c8100e20 2024-09-15T22:15:22.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.650+0000 7ff5beffd640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff5b40a32d0 0x7ff5b40a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff5c81051e0 tx=0x7ff5b000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.650+0000 7ff5c7fff640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547] conn(0x7ff5b40ae4a0 0x7ff5b40b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.651+0000 7ff5c7fff640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547] conn(0x7ff5b40ae4a0 0x7ff5b40b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:22.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.651+0000 7ff5c57fa640 1 -- 172.21.15.45:0/2313894241 <== osd.10 v2:172.21.15.100:6824/1659453547 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff5b8038e90 con 0x7ff5b40ae4a0 2024-09-15T22:15:22.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.666+0000 7ff5cdab6640 1 -- 172.21.15.45:0/2313894241 --> [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff5c81021b0 con 0x7ff5b40ae4a0 2024-09-15T22:15:22.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.667+0000 7ff5c57fa640 1 -- 172.21.15.45:0/2313894241 <== osd.10 v2:172.21.15.100:6824/1659453547 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff5c81021b0 con 0x7ff5b40ae4a0 2024-09-15T22:15:22.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.667+0000 7ff5cdab6640 1 -- 172.21.15.45:0/2313894241 >> [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547] conn(0x7ff5b40ae4a0 msgr2=0x7ff5b40b0940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.667+0000 7ff5cdab6640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547] conn(0x7ff5b40ae4a0 0x7ff5b40b0940 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.667+0000 7ff5cdab6640 1 -- 172.21.15.45:0/2313894241 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff5b40a32d0 msgr2=0x7ff5b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.667+0000 7ff5cdab6640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7ff5b40a32d0 0x7ff5b40a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff5c81051e0 tx=0x7ff5b000a2d0 comp rx=0 tx=0).stop 2024-09-15T22:15:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.667+0000 7ff5cdab6640 1 -- 172.21.15.45:0/2313894241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c8100e20 msgr2=0x7ff5c8103750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.667+0000 7ff5cdab6640 1 --2- 172.21.15.45:0/2313894241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c8100e20 0x7ff5c8103750 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8006010 tx=0x7ff5b80045e0 comp rx=0 tx=0).stop 2024-09-15T22:15:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.667+0000 7ff5c7fff640 1 -- 172.21.15.45:0/2313894241 reap_dead start 2024-09-15T22:15:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.667+0000 7ff5cdab6640 1 -- 172.21.15.45:0/2313894241 shutdown_connections 2024-09-15T22:15:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.667+0000 7ff5cdab6640 1 -- 172.21.15.45:0/2313894241 >> 172.21.15.45:0/2313894241 conn(0x7ff5c80fc7d0 msgr2=0x7ff5c806a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.667+0000 7ff5cdab6640 1 -- 172.21.15.45:0/2313894241 shutdown_connections 2024-09-15T22:15:22.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:22.667+0000 7ff5cdab6640 1 -- 172.21.15.45:0/2313894241 wait complete. 2024-09-15T22:15:23.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:23 smithi045 ceph-mon[31180]: pgmap v322: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:23.363 INFO:teuthology.orchestra.run.smithi045.stdout:240518168619 2024-09-15T22:15:23.363 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-15T22:15:23.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:23 smithi165 ceph-mon[35551]: pgmap v322: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:23 smithi100 ceph-mon[35319]: pgmap v322: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:23.815 INFO:teuthology.orchestra.run.smithi045.stdout:292057776161 2024-09-15T22:15:23.815 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-15T22:15:24.263 INFO:teuthology.orchestra.run.smithi045.stdout:55834574926 2024-09-15T22:15:24.264 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-15T22:15:24.368 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:24.374 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:24.379 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:24.386 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:24.387 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:24.387 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:24.397 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:24.398 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:24.398 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:24.466 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:25.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.137+0000 7f1259b12640 1 -- 172.21.15.45:0/1738484092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1254106f20 msgr2=0x7f125410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:25.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.137+0000 7f1259b12640 1 --2- 172.21.15.45:0/1738484092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1254106f20 0x7f125410eaa0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f124c009ca0 tx=0x7f124c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:15:25.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.137+0000 7f1259b12640 1 -- 172.21.15.45:0/1738484092 shutdown_connections 2024-09-15T22:15:25.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.137+0000 7f1259b12640 1 --2- 172.21.15.45:0/1738484092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1254106f20 0x7f125410eaa0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:25.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.137+0000 7f1259b12640 1 --2- 172.21.15.45:0/1738484092 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12541027a0 0x7f12541067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:25.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.137+0000 7f1259b12640 1 --2- 172.21.15.45:0/1738484092 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1254101df0 0x7f12541021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:25.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.137+0000 7f1259b12640 1 -- 172.21.15.45:0/1738484092 >> 172.21.15.45:0/1738484092 conn(0x7f12540fd8f0 msgr2=0x7f12540ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:25.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.137+0000 7f1259b12640 1 -- 172.21.15.45:0/1738484092 shutdown_connections 2024-09-15T22:15:25.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.137+0000 7f1259b12640 1 -- 172.21.15.45:0/1738484092 wait complete. 2024-09-15T22:15:25.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.138+0000 7f1259b12640 1 Processor -- start 2024-09-15T22:15:25.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.138+0000 7f1259b12640 1 -- start start 2024-09-15T22:15:25.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.138+0000 7f1259b12640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1254101df0 0x7f12540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:25.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.138+0000 7f1259b12640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12541027a0 0x7f1254074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:25.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.138+0000 7f1259b12640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1254106f20 0x7f1254074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:25.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.138+0000 7f1259b12640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f12541120a0 con 0x7f1254106f20 2024-09-15T22:15:25.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.138+0000 7f1259b12640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1254111f20 con 0x7f1254101df0 2024-09-15T22:15:25.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.138+0000 7f1259b12640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1254112220 con 0x7f12541027a0 2024-09-15T22:15:25.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.138+0000 7f1253fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1254106f20 0x7f1254074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:25.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1253fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1254106f20 0x7f1254074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43508/0 (socket says 172.21.15.45:43508) 2024-09-15T22:15:25.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1252ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12541027a0 0x7f1254074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:25.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1253fff640 1 -- 172.21.15.45:0/397151982 learned_addr learned my addr 172.21.15.45:0/397151982 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:25.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f12537fe640 1 --2- 172.21.15.45:0/397151982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1254101df0 0x7f12540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:25.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1253fff640 1 -- 172.21.15.45:0/397151982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12541027a0 msgr2=0x7f1254074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:25.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1253fff640 1 --2- 172.21.15.45:0/397151982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12541027a0 0x7f1254074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:25.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1253fff640 1 -- 172.21.15.45:0/397151982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1254101df0 msgr2=0x7f12540744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:25.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1253fff640 1 --2- 172.21.15.45:0/397151982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1254101df0 0x7f12540744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:25.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1253fff640 1 -- 172.21.15.45:0/397151982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12541a6960 con 0x7f1254106f20 2024-09-15T22:15:25.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1253fff640 1 --2- 172.21.15.45:0/397151982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1254106f20 0x7f1254074f70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f124c006010 tx=0x7f124c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:25.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1250ff9640 1 -- 172.21.15.45:0/397151982 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c02fa20 con 0x7f1254106f20 2024-09-15T22:15:25.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1250ff9640 1 -- 172.21.15.45:0/397151982 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f124c02fbc0 con 0x7f1254106f20 2024-09-15T22:15:25.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1259b12640 1 -- 172.21.15.45:0/397151982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12541a6bf0 con 0x7f1254106f20 2024-09-15T22:15:25.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1250ff9640 1 -- 172.21.15.45:0/397151982 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124c0467f0 con 0x7f1254106f20 2024-09-15T22:15:25.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.139+0000 7f1259b12640 1 -- 172.21.15.45:0/397151982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12541a7130 con 0x7f1254106f20 2024-09-15T22:15:25.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.140+0000 7f1259b12640 1 -- 172.21.15.45:0/397151982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12541021d0 con 0x7f1254106f20 2024-09-15T22:15:25.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.142+0000 7f1250ff9640 1 -- 172.21.15.45:0/397151982 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f124c046990 con 0x7f1254106f20 2024-09-15T22:15:25.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.142+0000 7f1250ff9640 1 --2- 172.21.15.45:0/397151982 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f123c0a32d0 0x7f123c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:25.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.142+0000 7f12537fe640 1 --2- 172.21.15.45:0/397151982 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f123c0a32d0 0x7f123c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:25.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.142+0000 7f1250ff9640 1 -- 172.21.15.45:0/397151982 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f124c0f1150 con 0x7f1254106f20 2024-09-15T22:15:25.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.143+0000 7f12537fe640 1 --2- 172.21.15.45:0/397151982 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f123c0a32d0 0x7f123c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1244009bd0 tx=0x7f1244005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:25.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.147+0000 7f1250ff9640 1 -- 172.21.15.45:0/397151982 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f124c0bda60 con 0x7f1254106f20 2024-09-15T22:15:25.193 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:25 smithi045 ceph-mon[31180]: pgmap v323: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:15:25.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.327+0000 7f1259b12640 1 -- 172.21.15.45:0/397151982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f125410a100 con 0x7f1254106f20 2024-09-15T22:15:25.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.328+0000 7f1250ff9640 1 -- 172.21.15.45:0/397151982 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f124c0bd360 con 0x7f1254106f20 2024-09-15T22:15:25.329 INFO:teuthology.orchestra.run.smithi045.stdout:34359738453 2024-09-15T22:15:25.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.330+0000 7f1259b12640 1 -- 172.21.15.45:0/397151982 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f123c0a32d0 msgr2=0x7f123c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:25.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.330+0000 7f1259b12640 1 --2- 172.21.15.45:0/397151982 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f123c0a32d0 0x7f123c0a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1244009bd0 tx=0x7f1244005f90 comp rx=0 tx=0).stop 2024-09-15T22:15:25.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.330+0000 7f1259b12640 1 -- 172.21.15.45:0/397151982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1254106f20 msgr2=0x7f1254074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:25.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.330+0000 7f1259b12640 1 --2- 172.21.15.45:0/397151982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1254106f20 0x7f1254074f70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f124c006010 tx=0x7f124c0319f0 comp rx=0 tx=0).stop 2024-09-15T22:15:25.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.330+0000 7f1259b12640 1 -- 172.21.15.45:0/397151982 shutdown_connections 2024-09-15T22:15:25.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.330+0000 7f1259b12640 1 --2- 172.21.15.45:0/397151982 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f123c0a32d0 0x7f123c0a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:25.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.330+0000 7f1259b12640 1 --2- 172.21.15.45:0/397151982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1254106f20 0x7f1254074f70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:25.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.330+0000 7f1259b12640 1 --2- 172.21.15.45:0/397151982 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f12541027a0 0x7f1254074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:25.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.330+0000 7f1259b12640 1 --2- 172.21.15.45:0/397151982 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1254101df0 0x7f12540744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:25.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.330+0000 7f1259b12640 1 -- 172.21.15.45:0/397151982 >> 172.21.15.45:0/397151982 conn(0x7f12540fd8f0 msgr2=0x7f12540fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:25.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.330+0000 7f1259b12640 1 -- 172.21.15.45:0/397151982 shutdown_connections 2024-09-15T22:15:25.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:25.330+0000 7f1259b12640 1 -- 172.21.15.45:0/397151982 wait complete. 2024-09-15T22:15:25.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:25 smithi165 ceph-mon[35551]: pgmap v323: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:15:25.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:25 smithi100 ceph-mon[35319]: pgmap v323: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:15:26.346 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:26 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/397151982' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:15:26.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:26 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/397151982' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:15:26.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:26 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/397151982' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T22:15:27.258 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:27 smithi045 ceph-mon[31180]: pgmap v324: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 658 B/s rd, 1 op/s 2024-09-15T22:15:27.259 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:27 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2847250937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:15:27.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:27 smithi165 ceph-mon[35551]: pgmap v324: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 658 B/s rd, 1 op/s 2024-09-15T22:15:27.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:27 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2847250937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:15:27.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.466+0000 7f0c604fa640 1 -- 172.21.15.45:0/3696162317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c58102d30 msgr2=0x7f0c58103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.466+0000 7f0c604fa640 1 --2- 172.21.15.45:0/3696162317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c58102d30 0x7f0c58103110 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009930 tx=0x7f0c5402a420 comp rx=0 tx=0).stop 2024-09-15T22:15:27.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.466+0000 7f0c604fa640 1 -- 172.21.15.45:0/3696162317 shutdown_connections 2024-09-15T22:15:27.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.466+0000 7f0c604fa640 1 --2- 172.21.15.45:0/3696162317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c581082a0 0x7f0c5810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.466+0000 7f0c604fa640 1 --2- 172.21.15.45:0/3696162317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c581036e0 0x7f0c58107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.466+0000 7f0c604fa640 1 --2- 172.21.15.45:0/3696162317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c58102d30 0x7f0c58103110 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.466+0000 7f0c604fa640 1 -- 172.21.15.45:0/3696162317 >> 172.21.15.45:0/3696162317 conn(0x7f0c580fc7d0 msgr2=0x7f0c580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:27.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.466+0000 7f0c604fa640 1 -- 172.21.15.45:0/3696162317 shutdown_connections 2024-09-15T22:15:27.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.466+0000 7f0c604fa640 1 -- 172.21.15.45:0/3696162317 wait complete. 2024-09-15T22:15:27.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.467+0000 7f0c604fa640 1 Processor -- start 2024-09-15T22:15:27.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.467+0000 7f0c604fa640 1 -- start start 2024-09-15T22:15:27.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.467+0000 7f0c604fa640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c58102d30 0x7f0c58100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.467+0000 7f0c604fa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c581036e0 0x7f0c58100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.467+0000 7f0c604fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c581082a0 0x7f0c58101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.467+0000 7f0c604fa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0c581121e0 con 0x7f0c581036e0 2024-09-15T22:15:27.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.467+0000 7f0c604fa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0c58112060 con 0x7f0c581082a0 2024-09-15T22:15:27.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.467+0000 7f0c604fa640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0c58112360 con 0x7f0c58102d30 2024-09-15T22:15:27.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.467+0000 7f0c5da95640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c581036e0 0x7f0c58100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.467+0000 7f0c5da95640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c581036e0 0x7f0c58100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43548/0 (socket says 172.21.15.45:43548) 2024-09-15T22:15:27.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.467+0000 7f0c5da95640 1 -- 172.21.15.45:0/2909113799 learned_addr learned my addr 172.21.15.45:0/2909113799 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:27.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.468+0000 7f0c5e296640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c58102d30 0x7f0c58100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.468+0000 7f0c5ea97640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c581082a0 0x7f0c58101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.468+0000 7f0c5da95640 1 -- 172.21.15.45:0/2909113799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c58102d30 msgr2=0x7f0c58100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.468+0000 7f0c5da95640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c58102d30 0x7f0c58100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.468+0000 7f0c5da95640 1 -- 172.21.15.45:0/2909113799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c581082a0 msgr2=0x7f0c58101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.468+0000 7f0c5da95640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c581082a0 0x7f0c58101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.468+0000 7f0c5da95640 1 -- 172.21.15.45:0/2909113799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c581a6b50 con 0x7f0c581036e0 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.468+0000 7f0c5da95640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c581036e0 0x7f0c58100ed0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800d750 tx=0x7f0c4800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.468+0000 7f0c4f7fe640 1 -- 172.21.15.45:0/2909113799 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48017070 con 0x7f0c581036e0 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.468+0000 7f0c4f7fe640 1 -- 172.21.15.45:0/2909113799 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0c48005520 con 0x7f0c581036e0 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.468+0000 7f0c604fa640 1 -- 172.21.15.45:0/2909113799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c581a6e40 con 0x7f0c581036e0 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.468+0000 7f0c4f7fe640 1 -- 172.21.15.45:0/2909113799 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48004e00 con 0x7f0c581036e0 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.468+0000 7f0c604fa640 1 -- 172.21.15.45:0/2909113799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c581a72f0 con 0x7f0c581036e0 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.469+0000 7f0c604fa640 1 -- 172.21.15.45:0/2909113799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c5806a850 con 0x7f0c581036e0 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.471+0000 7f0c4f7fe640 1 -- 172.21.15.45:0/2909113799 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0c48004fc0 con 0x7f0c581036e0 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.472+0000 7f0c4f7fe640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0c440a3350 0x7f0c440a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.472+0000 7f0c4f7fe640 1 -- 172.21.15.45:0/2909113799 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f0c480cfad0 con 0x7f0c581036e0 2024-09-15T22:15:27.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.472+0000 7f0c5e296640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0c440a3350 0x7f0c440a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.473+0000 7f0c5e296640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0c440a3350 0x7f0c440a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009900 tx=0x7f0c540058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:27.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.475+0000 7f0c4f7fe640 1 -- 172.21.15.45:0/2909113799 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0c4809bd60 con 0x7f0c581036e0 2024-09-15T22:15:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:27 smithi100 ceph-mon[35319]: pgmap v324: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 658 B/s rd, 1 op/s 2024-09-15T22:15:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:27 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2847250937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T22:15:27.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.655+0000 7f0c604fa640 1 -- 172.21.15.45:0/2909113799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0c58103110 con 0x7f0c581036e0 2024-09-15T22:15:27.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.656+0000 7f0c4f7fe640 1 -- 172.21.15.45:0/2909113799 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0c58103110 con 0x7f0c581036e0 2024-09-15T22:15:27.657 INFO:teuthology.orchestra.run.smithi045.stdout:206158430257 2024-09-15T22:15:27.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.658+0000 7f0c604fa640 1 -- 172.21.15.45:0/2909113799 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0c440a3350 msgr2=0x7f0c440a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.658+0000 7f0c604fa640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0c440a3350 0x7f0c440a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009900 tx=0x7f0c540058d0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.658+0000 7f0c604fa640 1 -- 172.21.15.45:0/2909113799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c581036e0 msgr2=0x7f0c58100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.658+0000 7f0c604fa640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c581036e0 0x7f0c58100ed0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800d750 tx=0x7f0c4800dc10 comp rx=0 tx=0).stop 2024-09-15T22:15:27.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.658+0000 7f0c604fa640 1 -- 172.21.15.45:0/2909113799 shutdown_connections 2024-09-15T22:15:27.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.658+0000 7f0c604fa640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f0c440a3350 0x7f0c440a5810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.658+0000 7f0c604fa640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c581082a0 0x7f0c58101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.658+0000 7f0c604fa640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c581036e0 0x7f0c58100ed0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.658+0000 7f0c604fa640 1 --2- 172.21.15.45:0/2909113799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0c58102d30 0x7f0c58100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.658+0000 7f0c604fa640 1 -- 172.21.15.45:0/2909113799 >> 172.21.15.45:0/2909113799 conn(0x7f0c580fc7d0 msgr2=0x7f0c58105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:27.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.658+0000 7f0c604fa640 1 -- 172.21.15.45:0/2909113799 shutdown_connections 2024-09-15T22:15:27.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.658+0000 7f0c604fa640 1 -- 172.21.15.45:0/2909113799 wait complete. 2024-09-15T22:15:27.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.810+0000 7fa18d917640 1 -- 172.21.15.45:0/1904315804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa188102d40 msgr2=0x7fa188103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.810+0000 7fa18d917640 1 --2- 172.21.15.45:0/1904315804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa188102d40 0x7fa188103120 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa178009ca0 tx=0x7fa17802a950 comp rx=0 tx=0).stop 2024-09-15T22:15:27.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.810+0000 7fa18d917640 1 -- 172.21.15.45:0/1904315804 shutdown_connections 2024-09-15T22:15:27.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.810+0000 7fa18d917640 1 --2- 172.21.15.45:0/1904315804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa18810c170 0x7fa18810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.810+0000 7fa18d917640 1 --2- 172.21.15.45:0/1904315804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa188103660 0x7fa18810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.810+0000 7fa18d917640 1 --2- 172.21.15.45:0/1904315804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa188102d40 0x7fa188103120 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.810+0000 7fa18d917640 1 -- 172.21.15.45:0/1904315804 >> 172.21.15.45:0/1904315804 conn(0x7fa1880fc7a0 msgr2=0x7fa1880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:27.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.810+0000 7fa18d917640 1 -- 172.21.15.45:0/1904315804 shutdown_connections 2024-09-15T22:15:27.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.810+0000 7fa18d917640 1 -- 172.21.15.45:0/1904315804 wait complete. 2024-09-15T22:15:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.810+0000 7fa18d917640 1 Processor -- start 2024-09-15T22:15:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa18d917640 1 -- start start 2024-09-15T22:15:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa18d917640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa188102d40 0x7fa18819a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa18d917640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa188103660 0x7fa18819abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa18d917640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa18810c170 0x7fa18819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa18d917640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa188112090 con 0x7fa188102d40 2024-09-15T22:15:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa18d917640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa188111f10 con 0x7fa188103660 2024-09-15T22:15:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa18d917640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa188112210 con 0x7fa18810c170 2024-09-15T22:15:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa186ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa188102d40 0x7fa18819a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa186ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa188102d40 0x7fa18819a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43582/0 (socket says 172.21.15.45:43582) 2024-09-15T22:15:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa186ffd640 1 -- 172.21.15.45:0/662356795 learned_addr learned my addr 172.21.15.45:0/662356795 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa1877fe640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa18810c170 0x7fa18819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa1867fc640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa188103660 0x7fa18819abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa186ffd640 1 -- 172.21.15.45:0/662356795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa18810c170 msgr2=0x7fa18819ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa186ffd640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa18810c170 0x7fa18819ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa186ffd640 1 -- 172.21.15.45:0/662356795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa188103660 msgr2=0x7fa18819abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa186ffd640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa188103660 0x7fa18819abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa186ffd640 1 -- 172.21.15.45:0/662356795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18819f620 con 0x7fa188102d40 2024-09-15T22:15:27.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.811+0000 7fa1867fc640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa188103660 0x7fa18819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:27.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.812+0000 7fa186ffd640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa188102d40 0x7fa18819a670 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa178005cc0 tx=0x7fa17802f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.812+0000 7fa18c915640 1 -- 172.21.15.45:0/662356795 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178034040 con 0x7fa188102d40 2024-09-15T22:15:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.812+0000 7fa18d917640 1 -- 172.21.15.45:0/662356795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18819f8b0 con 0x7fa188102d40 2024-09-15T22:15:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.812+0000 7fa18c915640 1 -- 172.21.15.45:0/662356795 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa178003e40 con 0x7fa188102d40 2024-09-15T22:15:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.812+0000 7fa18c915640 1 -- 172.21.15.45:0/662356795 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178039430 con 0x7fa188102d40 2024-09-15T22:15:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.812+0000 7fa18d917640 1 -- 172.21.15.45:0/662356795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1881a71f0 con 0x7fa188102d40 2024-09-15T22:15:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.813+0000 7fa18d917640 1 -- 172.21.15.45:0/662356795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa188103120 con 0x7fa188102d40 2024-09-15T22:15:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.814+0000 7fa18c915640 1 -- 172.21.15.45:0/662356795 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa178037020 con 0x7fa188102d40 2024-09-15T22:15:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.815+0000 7fa18c915640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa1700a32d0 0x7fa1700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.815+0000 7fa18c915640 1 -- 172.21.15.45:0/662356795 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fa1780f1050 con 0x7fa188102d40 2024-09-15T22:15:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.815+0000 7fa1867fc640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa1700a32d0 0x7fa1700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.816+0000 7fa1867fc640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa1700a32d0 0x7fa1700a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa17c005e10 tx=0x7fa17c005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:27.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.822+0000 7fa18c915640 1 -- 172.21.15.45:0/662356795 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa1780bd960 con 0x7fa188102d40 2024-09-15T22:15:27.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.690+0000 7f1119218640 1 -- 172.21.15.45:0/4156449979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11141036e0 msgr2=0x7f1114107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.690+0000 7f1119218640 1 --2- 172.21.15.45:0/4156449979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11141036e0 0x7f1114107b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1108009930 tx=0x7f110802a420 comp rx=0 tx=0).stop 2024-09-15T22:15:27.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.690+0000 7f1119218640 1 -- 172.21.15.45:0/4156449979 shutdown_connections 2024-09-15T22:15:27.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.690+0000 7f1119218640 1 --2- 172.21.15.45:0/4156449979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11141082a0 0x7f111410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.690+0000 7f1119218640 1 --2- 172.21.15.45:0/4156449979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11141036e0 0x7f1114107b90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.690+0000 7f1119218640 1 --2- 172.21.15.45:0/4156449979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1114102d30 0x7f1114103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.690+0000 7f1119218640 1 -- 172.21.15.45:0/4156449979 >> 172.21.15.45:0/4156449979 conn(0x7f11140fc7d0 msgr2=0x7f11140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:27.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.690+0000 7f1119218640 1 -- 172.21.15.45:0/4156449979 shutdown_connections 2024-09-15T22:15:27.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.690+0000 7f1119218640 1 -- 172.21.15.45:0/4156449979 wait complete. 2024-09-15T22:15:27.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f1119218640 1 Processor -- start 2024-09-15T22:15:27.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f1119218640 1 -- start start 2024-09-15T22:15:27.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f1119218640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1114102d30 0x7f1114100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f1119218640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11141036e0 0x7f1114100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f1119218640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11141082a0 0x7f1114101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f1119218640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1114112200 con 0x7f11141082a0 2024-09-15T22:15:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f1119218640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1114112080 con 0x7f1114102d30 2024-09-15T22:15:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f1119218640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1114112380 con 0x7f11141036e0 2024-09-15T22:15:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f111359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11141082a0 0x7f1114101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f111359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11141082a0 0x7f1114101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43564/0 (socket says 172.21.15.45:43564) 2024-09-15T22:15:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f111359e640 1 -- 172.21.15.45:0/650726472 learned_addr learned my addr 172.21.15.45:0/650726472 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f1112d9d640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1114102d30 0x7f1114100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f111259c640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11141036e0 0x7f1114100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f111359e640 1 -- 172.21.15.45:0/650726472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11141036e0 msgr2=0x7f1114100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f111359e640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11141036e0 0x7f1114100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f111359e640 1 -- 172.21.15.45:0/650726472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1114102d30 msgr2=0x7f1114100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.691+0000 7f111359e640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1114102d30 0x7f1114100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.940 INFO:teuthology.orchestra.run.smithi045.stdout:77309411403 2024-09-15T22:15:27.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.692+0000 7f111359e640 1 -- 172.21.15.45:0/650726472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11141a6bf0 con 0x7f11141082a0 2024-09-15T22:15:27.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.692+0000 7f1112d9d640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1114102d30 0x7f1114100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:27.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.692+0000 7f111359e640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11141082a0 0x7f1114101410 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f110c00b970 tx=0x7f110c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:27.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.692+0000 7f10fbfff640 1 -- 172.21.15.45:0/650726472 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c019070 con 0x7f11141082a0 2024-09-15T22:15:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.692+0000 7f1119218640 1 -- 172.21.15.45:0/650726472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11141a6ee0 con 0x7f11141082a0 2024-09-15T22:15:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.692+0000 7f10fbfff640 1 -- 172.21.15.45:0/650726472 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f110c00cb40 con 0x7f11141082a0 2024-09-15T22:15:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.692+0000 7f10fbfff640 1 -- 172.21.15.45:0/650726472 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c007700 con 0x7f11141082a0 2024-09-15T22:15:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.692+0000 7f1119218640 1 -- 172.21.15.45:0/650726472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11141a73a0 con 0x7f11141082a0 2024-09-15T22:15:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.693+0000 7f1119218640 1 -- 172.21.15.45:0/650726472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1114103110 con 0x7f11141082a0 2024-09-15T22:15:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.694+0000 7f10fbfff640 1 -- 172.21.15.45:0/650726472 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f110c01c070 con 0x7f11141082a0 2024-09-15T22:15:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.695+0000 7f10fbfff640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f10fc0a32d0 0x7f10fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.695+0000 7f1112d9d640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f10fc0a32d0 0x7f10fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.695+0000 7f10fbfff640 1 -- 172.21.15.45:0/650726472 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f110c0cf820 con 0x7f11141082a0 2024-09-15T22:15:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.695+0000 7f1112d9d640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f10fc0a32d0 0x7f10fc0a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1104009c20 tx=0x7f1104005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.698+0000 7f10fbfff640 1 -- 172.21.15.45:0/650726472 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f110c09c130 con 0x7f11141082a0 2024-09-15T22:15:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.883+0000 7f1119218640 1 -- 172.21.15.45:0/650726472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f111410a2b0 con 0x7f11141082a0 2024-09-15T22:15:27.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.883+0000 7f10fbfff640 1 -- 172.21.15.45:0/650726472 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f110c09ba30 con 0x7f11141082a0 2024-09-15T22:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.885+0000 7f1119218640 1 -- 172.21.15.45:0/650726472 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f10fc0a32d0 msgr2=0x7f10fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.885+0000 7f1119218640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f10fc0a32d0 0x7f10fc0a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1104009c20 tx=0x7f1104005f90 comp rx=0 tx=0).stop 2024-09-15T22:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.885+0000 7f1119218640 1 -- 172.21.15.45:0/650726472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11141082a0 msgr2=0x7f1114101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.885+0000 7f1119218640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11141082a0 0x7f1114101410 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f110c00b970 tx=0x7f110c00be30 comp rx=0 tx=0).stop 2024-09-15T22:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.885+0000 7f1119218640 1 -- 172.21.15.45:0/650726472 shutdown_connections 2024-09-15T22:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.885+0000 7f1119218640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f10fc0a32d0 0x7f10fc0a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.885+0000 7f1119218640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11141082a0 0x7f1114101410 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.885+0000 7f1119218640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f11141036e0 0x7f1114100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.885+0000 7f1119218640 1 --2- 172.21.15.45:0/650726472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1114102d30 0x7f1114100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.885+0000 7f1119218640 1 -- 172.21.15.45:0/650726472 >> 172.21.15.45:0/650726472 conn(0x7f11140fc7d0 msgr2=0x7f1114105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.885+0000 7f1119218640 1 -- 172.21.15.45:0/650726472 shutdown_connections 2024-09-15T22:15:27.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.886+0000 7f1119218640 1 -- 172.21.15.45:0/650726472 wait complete. 2024-09-15T22:15:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.007+0000 7fa18d917640 1 -- 172.21.15.45:0/662356795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa1881a73c0 con 0x7fa188102d40 2024-09-15T22:15:28.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.007+0000 7fa18c915640 1 -- 172.21.15.45:0/662356795 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa1780bd260 con 0x7fa188102d40 2024-09-15T22:15:28.008 INFO:teuthology.orchestra.run.smithi045.stdout:292057776161 2024-09-15T22:15:28.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.009+0000 7fa18d917640 1 -- 172.21.15.45:0/662356795 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa1700a32d0 msgr2=0x7fa1700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:28.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.009+0000 7fa18d917640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa1700a32d0 0x7fa1700a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa17c005e10 tx=0x7fa17c005da0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.009+0000 7fa18d917640 1 -- 172.21.15.45:0/662356795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa188102d40 msgr2=0x7fa18819a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:28.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.009+0000 7fa18d917640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa188102d40 0x7fa18819a670 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa178005cc0 tx=0x7fa17802f790 comp rx=0 tx=0).stop 2024-09-15T22:15:28.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.009+0000 7fa18d917640 1 -- 172.21.15.45:0/662356795 shutdown_connections 2024-09-15T22:15:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.009+0000 7fa18d917640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa1700a32d0 0x7fa1700a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.009+0000 7fa18d917640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa18810c170 0x7fa18819ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.009+0000 7fa18d917640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa188103660 0x7fa18819abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.009+0000 7fa18d917640 1 --2- 172.21.15.45:0/662356795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa188102d40 0x7fa18819a670 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.009+0000 7fa18d917640 1 -- 172.21.15.45:0/662356795 >> 172.21.15.45:0/662356795 conn(0x7fa1880fc7a0 msgr2=0x7fa18810d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.009+0000 7fa18d917640 1 -- 172.21.15.45:0/662356795 shutdown_connections 2024-09-15T22:15:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.009+0000 7fa18d917640 1 -- 172.21.15.45:0/662356795 wait complete. 2024-09-15T22:15:28.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.365+0000 7fd4686ab640 1 -- 172.21.15.45:0/749431416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd460102dd0 msgr2=0x7fd4601031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.365+0000 7fd4686ab640 1 --2- 172.21.15.45:0/749431416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd460102dd0 0x7fd4601031b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009930 tx=0x7fd45c02a420 comp rx=0 tx=0).stop 2024-09-15T22:15:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.365+0000 7fd4686ab640 1 -- 172.21.15.45:0/749431416 shutdown_connections 2024-09-15T22:15:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.365+0000 7fd4686ab640 1 --2- 172.21.15.45:0/749431416 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd460108300 0x7fd46010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.365+0000 7fd4686ab640 1 --2- 172.21.15.45:0/749431416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd460103780 0x7fd460107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.365+0000 7fd4686ab640 1 --2- 172.21.15.45:0/749431416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd460102dd0 0x7fd4601031b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.365+0000 7fd4686ab640 1 -- 172.21.15.45:0/749431416 >> 172.21.15.45:0/749431416 conn(0x7fd4600fc7d0 msgr2=0x7fd4600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.365+0000 7fd4686ab640 1 -- 172.21.15.45:0/749431416 shutdown_connections 2024-09-15T22:15:28.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.365+0000 7fd4686ab640 1 -- 172.21.15.45:0/749431416 wait complete. 2024-09-15T22:15:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd4686ab640 1 Processor -- start 2024-09-15T22:15:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd4686ab640 1 -- start start 2024-09-15T22:15:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd4686ab640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd460102dd0 0x7fd460198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd4686ab640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd460103780 0x7fd460198c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd4686ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd460108300 0x7fd46019cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd4686ab640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd4601122a0 con 0x7fd460108300 2024-09-15T22:15:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd4686ab640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd460112120 con 0x7fd460103780 2024-09-15T22:15:28.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd4686ab640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd460112420 con 0x7fd460102dd0 2024-09-15T22:15:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd466c48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd460108300 0x7fd46019cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd466c48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd460108300 0x7fd46019cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43592/0 (socket says 172.21.15.45:43592) 2024-09-15T22:15:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd466c48640 1 -- 172.21.15.45:0/34634722 learned_addr learned my addr 172.21.15.45:0/34634722 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd466447640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd460102dd0 0x7fd460198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd465c46640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd460103780 0x7fd460198c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd466c48640 1 -- 172.21.15.45:0/34634722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd460102dd0 msgr2=0x7fd460198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd466c48640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd460102dd0 0x7fd460198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd466c48640 1 -- 172.21.15.45:0/34634722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd460103780 msgr2=0x7fd460198c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd466c48640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd460103780 0x7fd460198c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.366+0000 7fd466c48640 1 -- 172.21.15.45:0/34634722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46019d6b0 con 0x7fd460108300 2024-09-15T22:15:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.367+0000 7fd466c48640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd460108300 0x7fd46019cfd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd45800b970 tx=0x7fd45800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.367+0000 7fd4577fe640 1 -- 172.21.15.45:0/34634722 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458019070 con 0x7fd460108300 2024-09-15T22:15:28.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.367+0000 7fd4686ab640 1 -- 172.21.15.45:0/34634722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd46019d9a0 con 0x7fd460108300 2024-09-15T22:15:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.367+0000 7fd4577fe640 1 -- 172.21.15.45:0/34634722 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd45800cb40 con 0x7fd460108300 2024-09-15T22:15:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.367+0000 7fd4577fe640 1 -- 172.21.15.45:0/34634722 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd458007700 con 0x7fd460108300 2024-09-15T22:15:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.367+0000 7fd4686ab640 1 -- 172.21.15.45:0/34634722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4601a5280 con 0x7fd460108300 2024-09-15T22:15:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.368+0000 7fd4686ab640 1 -- 172.21.15.45:0/34634722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd46006a7b0 con 0x7fd460108300 2024-09-15T22:15:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.369+0000 7fd4577fe640 1 -- 172.21.15.45:0/34634722 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd45801c070 con 0x7fd460108300 2024-09-15T22:15:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.370+0000 7fd4577fe640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd44c0a32d0 0x7fd44c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.370+0000 7fd466447640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd44c0a32d0 0x7fd44c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.370+0000 7fd4577fe640 1 -- 172.21.15.45:0/34634722 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fd4580cf2e0 con 0x7fd460108300 2024-09-15T22:15:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.371+0000 7fd466447640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd44c0a32d0 0x7fd44c0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd45c006010 tx=0x7fd45c005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:28.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.374+0000 7fd4577fe640 1 -- 172.21.15.45:0/34634722 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd45809b5a0 con 0x7fd460108300 2024-09-15T22:15:28.412 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:28 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3248616583' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:15:28.413 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:28 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2909113799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:15:28.413 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:28 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/650726472' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:15:28.413 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:28 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/662356795' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:15:28.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:28 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3248616583' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:15:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:28 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2909113799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:15:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:28 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/650726472' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:15:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:28 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/662356795' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:15:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:28 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3248616583' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T22:15:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:28 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2909113799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T22:15:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:28 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/650726472' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T22:15:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:28 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/662356795' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T22:15:28.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.554+0000 7fd4686ab640 1 -- 172.21.15.45:0/34634722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd46010a2e0 con 0x7fd460108300 2024-09-15T22:15:28.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.555+0000 7fd4577fe640 1 -- 172.21.15.45:0/34634722 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd45809f8a0 con 0x7fd460108300 2024-09-15T22:15:28.556 INFO:teuthology.orchestra.run.smithi045.stdout:133143986240 2024-09-15T22:15:28.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.557+0000 7fd4686ab640 1 -- 172.21.15.45:0/34634722 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd44c0a32d0 msgr2=0x7fd44c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:28.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.557+0000 7fd4686ab640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd44c0a32d0 0x7fd44c0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd45c006010 tx=0x7fd45c005e80 comp rx=0 tx=0).stop 2024-09-15T22:15:28.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.557+0000 7fd4686ab640 1 -- 172.21.15.45:0/34634722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd460108300 msgr2=0x7fd46019cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.557+0000 7fd4686ab640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd460108300 0x7fd46019cfd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd45800b970 tx=0x7fd45800be30 comp rx=0 tx=0).stop 2024-09-15T22:15:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.557+0000 7fd4686ab640 1 -- 172.21.15.45:0/34634722 shutdown_connections 2024-09-15T22:15:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.557+0000 7fd4686ab640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd44c0a32d0 0x7fd44c0a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.557+0000 7fd4686ab640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd460108300 0x7fd46019cfd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.557+0000 7fd4686ab640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd460103780 0x7fd460198c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.557+0000 7fd4686ab640 1 --2- 172.21.15.45:0/34634722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd460102dd0 0x7fd460198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.557+0000 7fd4686ab640 1 -- 172.21.15.45:0/34634722 >> 172.21.15.45:0/34634722 conn(0x7fd4600fc7d0 msgr2=0x7fd460106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.557+0000 7fd4686ab640 1 -- 172.21.15.45:0/34634722 shutdown_connections 2024-09-15T22:15:28.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:28.557+0000 7fd4686ab640 1 -- 172.21.15.45:0/34634722 wait complete. 2024-09-15T22:15:29.124 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776161 got 292057776161 for osd.10 2024-09-15T22:15:29.124 DEBUG:teuthology.parallel:result is None 2024-09-15T22:15:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.339+0000 7fd1247eb640 1 -- 172.21.15.45:0/3242852453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd11c100d00 msgr2=0x7fd11c106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.339+0000 7fd1247eb640 1 --2- 172.21.15.45:0/3242852453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd11c100d00 0x7fd11c106840 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd110009930 tx=0x7fd11002a420 comp rx=0 tx=0).stop 2024-09-15T22:15:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.339+0000 7fd1247eb640 1 -- 172.21.15.45:0/3242852453 shutdown_connections 2024-09-15T22:15:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.339+0000 7fd1247eb640 1 --2- 172.21.15.45:0/3242852453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd11c106f50 0x7fd11c10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.339+0000 7fd1247eb640 1 --2- 172.21.15.45:0/3242852453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd11c100d00 0x7fd11c106840 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.339+0000 7fd1247eb640 1 --2- 172.21.15.45:0/3242852453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd11c100350 0x7fd11c100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.339+0000 7fd1247eb640 1 -- 172.21.15.45:0/3242852453 >> 172.21.15.45:0/3242852453 conn(0x7fd11c077210 msgr2=0x7fd11c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:29.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.339+0000 7fd1247eb640 1 -- 172.21.15.45:0/3242852453 shutdown_connections 2024-09-15T22:15:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.339+0000 7fd1247eb640 1 -- 172.21.15.45:0/3242852453 wait complete. 2024-09-15T22:15:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.340+0000 7fd1247eb640 1 Processor -- start 2024-09-15T22:15:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.340+0000 7fd1247eb640 1 -- start start 2024-09-15T22:15:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.340+0000 7fd1247eb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd11c100350 0x7fd11c198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.340+0000 7fd1247eb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd11c100d00 0x7fd11c198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.340+0000 7fd1247eb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd11c106f50 0x7fd11c19ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.340+0000 7fd1247eb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c1120c0 con 0x7fd11c106f50 2024-09-15T22:15:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.340+0000 7fd1247eb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c111f40 con 0x7fd11c100350 2024-09-15T22:15:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.340+0000 7fd1247eb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c112240 con 0x7fd11c100d00 2024-09-15T22:15:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd122d88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd11c106f50 0x7fd11c19ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd122587640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd11c100350 0x7fd11c198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd122d88640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd11c106f50 0x7fd11c19ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43536/0 (socket says 172.21.15.45:43536) 2024-09-15T22:15:29.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd122d88640 1 -- 172.21.15.45:0/3248616583 learned_addr learned my addr 172.21.15.45:0/3248616583 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd121d86640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd11c100d00 0x7fd11c198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd122d88640 1 -- 172.21.15.45:0/3248616583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd11c100d00 msgr2=0x7fd11c198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd122d88640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd11c100d00 0x7fd11c198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd122d88640 1 -- 172.21.15.45:0/3248616583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd11c100350 msgr2=0x7fd11c198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd122d88640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd11c100350 0x7fd11c198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd122d88640 1 -- 172.21.15.45:0/3248616583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11c19d530 con 0x7fd11c106f50 2024-09-15T22:15:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd121d86640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd11c100d00 0x7fd11c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd122d88640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd11c106f50 0x7fd11c19ce50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd11400d750 tx=0x7fd11400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd11b7fe640 1 -- 172.21.15.45:0/3248616583 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd114017070 con 0x7fd11c106f50 2024-09-15T22:15:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd11b7fe640 1 -- 172.21.15.45:0/3248616583 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd114005520 con 0x7fd11c106f50 2024-09-15T22:15:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd1247eb640 1 -- 172.21.15.45:0/3248616583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd11c19d820 con 0x7fd11c106f50 2024-09-15T22:15:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd11b7fe640 1 -- 172.21.15.45:0/3248616583 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd114004e00 con 0x7fd11c106f50 2024-09-15T22:15:29.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.341+0000 7fd1247eb640 1 -- 172.21.15.45:0/3248616583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd11c1a5100 con 0x7fd11c106f50 2024-09-15T22:15:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.342+0000 7fd1247eb640 1 -- 172.21.15.45:0/3248616583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd11c103410 con 0x7fd11c106f50 2024-09-15T22:15:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.343+0000 7fd11b7fe640 1 -- 172.21.15.45:0/3248616583 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd114004fa0 con 0x7fd11c106f50 2024-09-15T22:15:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.344+0000 7fd11b7fe640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd1040a3350 0x7fd1040a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.344+0000 7fd11b7fe640 1 -- 172.21.15.45:0/3248616583 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fd1140cf6e0 con 0x7fd11c106f50 2024-09-15T22:15:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.344+0000 7fd122587640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd1040a3350 0x7fd1040a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.345+0000 7fd122587640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd1040a3350 0x7fd1040a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd10c005fd0 tx=0x7fd10c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.348+0000 7fd11b7fe640 1 -- 172.21.15.45:0/3248616583 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd11409bf40 con 0x7fd11c106f50 2024-09-15T22:15:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.528+0000 7fd1247eb640 1 -- 172.21.15.45:0/3248616583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd11c10a120 con 0x7fd11c106f50 2024-09-15T22:15:29.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.529+0000 7fd11b7fe640 1 -- 172.21.15.45:0/3248616583 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd11409b840 con 0x7fd11c106f50 2024-09-15T22:15:29.193 INFO:teuthology.orchestra.run.smithi045.stdout:154618822715 2024-09-15T22:15:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.531+0000 7fd1247eb640 1 -- 172.21.15.45:0/3248616583 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd1040a3350 msgr2=0x7fd1040a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.531+0000 7fd1247eb640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd1040a3350 0x7fd1040a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd10c005fd0 tx=0x7fd10c009680 comp rx=0 tx=0).stop 2024-09-15T22:15:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.531+0000 7fd1247eb640 1 -- 172.21.15.45:0/3248616583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd11c106f50 msgr2=0x7fd11c19ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.531+0000 7fd1247eb640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd11c106f50 0x7fd11c19ce50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd11400d750 tx=0x7fd11400dc10 comp rx=0 tx=0).stop 2024-09-15T22:15:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.531+0000 7fd1247eb640 1 -- 172.21.15.45:0/3248616583 shutdown_connections 2024-09-15T22:15:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.531+0000 7fd1247eb640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd1040a3350 0x7fd1040a5810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.531+0000 7fd1247eb640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd11c106f50 0x7fd11c19ce50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.531+0000 7fd1247eb640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd11c100d00 0x7fd11c198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.531+0000 7fd1247eb640 1 --2- 172.21.15.45:0/3248616583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd11c100350 0x7fd11c198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.531+0000 7fd1247eb640 1 -- 172.21.15.45:0/3248616583 >> 172.21.15.45:0/3248616583 conn(0x7fd11c077210 msgr2=0x7fd11c105860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:29.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.531+0000 7fd1247eb640 1 -- 172.21.15.45:0/3248616583 shutdown_connections 2024-09-15T22:15:29.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:27.531+0000 7fd1247eb640 1 -- 172.21.15.45:0/3248616583 wait complete. 2024-09-15T22:15:29.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:29 smithi045 ceph-mon[31180]: pgmap v325: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 992 B/s rd, 1 op/s 2024-09-15T22:15:29.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:29 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/34634722' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:15:29.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:29 smithi165 ceph-mon[35551]: pgmap v325: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 992 B/s rd, 1 op/s 2024-09-15T22:15:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:29 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/34634722' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:15:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:29 smithi100 ceph-mon[35319]: pgmap v325: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 992 B/s rd, 1 op/s 2024-09-15T22:15:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:29 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/34634722' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T22:15:29.836 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738450 got 34359738453 for osd.0 2024-09-15T22:15:29.836 DEBUG:teuthology.parallel:result is None 2024-09-15T22:15:29.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.755+0000 7fc3b9073640 1 -- 172.21.15.45:0/1900788579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b4103660 msgr2=0x7fc3b410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.755+0000 7fc3b9073640 1 --2- 172.21.15.45:0/1900788579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b4103660 0x7fc3b410bb50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009900 tx=0x7fc3a802a480 comp rx=0 tx=0).stop 2024-09-15T22:15:29.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.755+0000 7fc3b9073640 1 -- 172.21.15.45:0/1900788579 shutdown_connections 2024-09-15T22:15:29.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.755+0000 7fc3b9073640 1 --2- 172.21.15.45:0/1900788579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b410c170 0x7fc3b410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.755+0000 7fc3b9073640 1 --2- 172.21.15.45:0/1900788579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b4103660 0x7fc3b410bb50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.755+0000 7fc3b9073640 1 --2- 172.21.15.45:0/1900788579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b4102d40 0x7fc3b4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.755+0000 7fc3b9073640 1 -- 172.21.15.45:0/1900788579 >> 172.21.15.45:0/1900788579 conn(0x7fc3b40fc7a0 msgr2=0x7fc3b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.755+0000 7fc3b9073640 1 -- 172.21.15.45:0/1900788579 shutdown_connections 2024-09-15T22:15:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.755+0000 7fc3b9073640 1 -- 172.21.15.45:0/1900788579 wait complete. 2024-09-15T22:15:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.755+0000 7fc3b9073640 1 Processor -- start 2024-09-15T22:15:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b9073640 1 -- start start 2024-09-15T22:15:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b9073640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4102d40 0x7fc3b41985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b9073640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b4103660 0x7fc3b4198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b9073640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b410c170 0x7fc3b419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b9073640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b4112140 con 0x7fc3b410c170 2024-09-15T22:15:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b9073640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b4111fc0 con 0x7fc3b4102d40 2024-09-15T22:15:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b9073640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b41122c0 con 0x7fc3b4103660 2024-09-15T22:15:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b410c170 0x7fc3b419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4102d40 0x7fc3b41985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b410c170 0x7fc3b419ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43518/0 (socket says 172.21.15.45:43518) 2024-09-15T22:15:29.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b2d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4102d40 0x7fc3b41985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:51526/0 (socket says 172.21.15.45:51526) 2024-09-15T22:15:29.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b359e640 1 -- 172.21.15.45:0/2847250937 learned_addr learned my addr 172.21.15.45:0/2847250937 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:29.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b259c640 1 --2- 172.21.15.45:0/2847250937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b4103660 0x7fc3b4198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b2d9d640 1 -- 172.21.15.45:0/2847250937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b4103660 msgr2=0x7fc3b4198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b2d9d640 1 --2- 172.21.15.45:0/2847250937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b4103660 0x7fc3b4198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b2d9d640 1 -- 172.21.15.45:0/2847250937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b410c170 msgr2=0x7fc3b419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b2d9d640 1 --2- 172.21.15.45:0/2847250937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b410c170 0x7fc3b419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.756+0000 7fc3b2d9d640 1 -- 172.21.15.45:0/2847250937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b419d570 con 0x7fc3b4102d40 2024-09-15T22:15:29.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.757+0000 7fc3b2d9d640 1 --2- 172.21.15.45:0/2847250937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4102d40 0x7fc3b41985c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400b3f0 tx=0x7fc3a400b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:29.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.757+0000 7fc39bfff640 1 -- 172.21.15.45:0/2847250937 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4015020 con 0x7fc3b4102d40 2024-09-15T22:15:29.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.757+0000 7fc3b9073640 1 -- 172.21.15.45:0/2847250937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b419d860 con 0x7fc3b4102d40 2024-09-15T22:15:29.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.757+0000 7fc39bfff640 1 -- 172.21.15.45:0/2847250937 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc3a4011d30 con 0x7fc3b4102d40 2024-09-15T22:15:29.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.757+0000 7fc39bfff640 1 -- 172.21.15.45:0/2847250937 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a400f2e0 con 0x7fc3b4102d40 2024-09-15T22:15:29.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.757+0000 7fc3b9073640 1 -- 172.21.15.45:0/2847250937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b41a5140 con 0x7fc3b4102d40 2024-09-15T22:15:29.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.758+0000 7fc3b9073640 1 -- 172.21.15.45:0/2847250937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b4103120 con 0x7fc3b4102d40 2024-09-15T22:15:29.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.759+0000 7fc39bfff640 1 -- 172.21.15.45:0/2847250937 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc3a4018020 con 0x7fc3b4102d40 2024-09-15T22:15:29.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.760+0000 7fc39bfff640 1 --2- 172.21.15.45:0/2847250937 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc39c0a32d0 0x7fc39c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:29.915 INFO:teuthology.orchestra.run.smithi045.stdout:103079215174 2024-09-15T22:15:29.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.760+0000 7fc3b259c640 1 --2- 172.21.15.45:0/2847250937 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc39c0a32d0 0x7fc39c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:29.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.760+0000 7fc39bfff640 1 -- 172.21.15.45:0/2847250937 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fc3a40cf9b0 con 0x7fc3b4102d40 2024-09-15T22:15:29.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.760+0000 7fc3b259c640 1 --2- 172.21.15.45:0/2847250937 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc39c0a32d0 0x7fc39c0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8000c00 tx=0x7fc3a8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:29.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.763+0000 7fc39bfff640 1 -- 172.21.15.45:0/2847250937 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3a401f020 con 0x7fc3b4102d40 2024-09-15T22:15:29.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.947+0000 7fc3b9073640 1 -- 172.21.15.45:0/2847250937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc3b4199920 con 0x7fc3b4102d40 2024-09-15T22:15:29.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.947+0000 7fc39bfff640 1 -- 172.21.15.45:0/2847250937 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc3a409c2c0 con 0x7fc3b4102d40 2024-09-15T22:15:29.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.950+0000 7fc3b9073640 1 -- 172.21.15.45:0/2847250937 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc39c0a32d0 msgr2=0x7fc39c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.950+0000 7fc3b9073640 1 --2- 172.21.15.45:0/2847250937 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc39c0a32d0 0x7fc39c0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8000c00 tx=0x7fc3a8005a20 comp rx=0 tx=0).stop 2024-09-15T22:15:29.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.950+0000 7fc3b9073640 1 -- 172.21.15.45:0/2847250937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4102d40 msgr2=0x7fc3b41985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:29.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.950+0000 7fc3b9073640 1 --2- 172.21.15.45:0/2847250937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4102d40 0x7fc3b41985c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400b3f0 tx=0x7fc3a400b8b0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.950+0000 7fc3b9073640 1 -- 172.21.15.45:0/2847250937 shutdown_connections 2024-09-15T22:15:29.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.950+0000 7fc3b9073640 1 --2- 172.21.15.45:0/2847250937 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fc39c0a32d0 0x7fc39c0a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.950+0000 7fc3b9073640 1 --2- 172.21.15.45:0/2847250937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3b410c170 0x7fc3b419ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.950+0000 7fc3b9073640 1 --2- 172.21.15.45:0/2847250937 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc3b4103660 0x7fc3b4198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.950+0000 7fc3b9073640 1 --2- 172.21.15.45:0/2847250937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3b4102d40 0x7fc3b41985c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.950+0000 7fc3b9073640 1 -- 172.21.15.45:0/2847250937 >> 172.21.15.45:0/2847250937 conn(0x7fc3b40fc7a0 msgr2=0x7fc3b40fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.950+0000 7fc3b9073640 1 -- 172.21.15.45:0/2847250937 shutdown_connections 2024-09-15T22:15:29.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:26.950+0000 7fc3b9073640 1 -- 172.21.15.45:0/2847250937 wait complete. 2024-09-15T22:15:30.580 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215172 got 103079215174 for osd.3 2024-09-15T22:15:30.580 DEBUG:teuthology.parallel:result is None 2024-09-15T22:15:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.897+0000 7f08ad45d640 1 -- 172.21.15.45:0/2545592805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8106f10 msgr2=0x7f08a810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.897+0000 7f08ad45d640 1 --2- 172.21.15.45:0/2545592805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8106f10 0x7f08a810ea90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009ca0 tx=0x7f08a002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:15:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.897+0000 7f08ad45d640 1 -- 172.21.15.45:0/2545592805 shutdown_connections 2024-09-15T22:15:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.897+0000 7f08ad45d640 1 --2- 172.21.15.45:0/2545592805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8106f10 0x7f08a810ea90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.897+0000 7f08ad45d640 1 --2- 172.21.15.45:0/2545592805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08a8102790 0x7f08a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.897+0000 7f08ad45d640 1 --2- 172.21.15.45:0/2545592805 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08a8101de0 0x7f08a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.897+0000 7f08ad45d640 1 -- 172.21.15.45:0/2545592805 >> 172.21.15.45:0/2545592805 conn(0x7f08a80fd880 msgr2=0x7f08a80ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.897+0000 7f08ad45d640 1 -- 172.21.15.45:0/2545592805 shutdown_connections 2024-09-15T22:15:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.897+0000 7f08ad45d640 1 -- 172.21.15.45:0/2545592805 wait complete. 2024-09-15T22:15:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.898+0000 7f08ad45d640 1 Processor -- start 2024-09-15T22:15:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.898+0000 7f08ad45d640 1 -- start start 2024-09-15T22:15:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.898+0000 7f08ad45d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08a8101de0 0x7f08a80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.898+0000 7f08ad45d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08a8102790 0x7f08a8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.898+0000 7f08ad45d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8106f10 0x7f08a8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.898+0000 7f08ad45d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f08a8112090 con 0x7f08a8106f10 2024-09-15T22:15:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.898+0000 7f08ad45d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f08a8111f10 con 0x7f08a8102790 2024-09-15T22:15:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.898+0000 7f08ad45d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f08a8112210 con 0x7f08a8101de0 2024-09-15T22:15:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f08a77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8106f10 0x7f08a8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f08a77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8106f10 0x7f08a8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43614/0 (socket says 172.21.15.45:43614) 2024-09-15T22:15:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f08a77fe640 1 -- 172.21.15.45:0/1239016680 learned_addr learned my addr 172.21.15.45:0/1239016680 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f08a6ffd640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08a8101de0 0x7f08a80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f08a67fc640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08a8102790 0x7f08a8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f08a77fe640 1 -- 172.21.15.45:0/1239016680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08a8101de0 msgr2=0x7f08a80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f08a77fe640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08a8101de0 0x7f08a80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f08a77fe640 1 -- 172.21.15.45:0/1239016680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08a8102790 msgr2=0x7f08a8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f08a77fe640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08a8102790 0x7f08a8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f08a77fe640 1 -- 172.21.15.45:0/1239016680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a81a6950 con 0x7f08a8106f10 2024-09-15T22:15:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f08a77fe640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8106f10 0x7f08a8074f70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f08a0006010 tx=0x7f08a00319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f089ffff640 1 -- 172.21.15.45:0/1239016680 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a002fa20 con 0x7f08a8106f10 2024-09-15T22:15:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f089ffff640 1 -- 172.21.15.45:0/1239016680 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f08a002fbc0 con 0x7f08a8106f10 2024-09-15T22:15:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.899+0000 7f08ad45d640 1 -- 172.21.15.45:0/1239016680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a81a6be0 con 0x7f08a8106f10 2024-09-15T22:15:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.900+0000 7f089ffff640 1 -- 172.21.15.45:0/1239016680 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a0046860 con 0x7f08a8106f10 2024-09-15T22:15:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.900+0000 7f08ad45d640 1 -- 172.21.15.45:0/1239016680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a81a7120 con 0x7f08a8106f10 2024-09-15T22:15:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.901+0000 7f08ad45d640 1 -- 172.21.15.45:0/1239016680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a81021c0 con 0x7f08a8106f10 2024-09-15T22:15:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.902+0000 7f089ffff640 1 -- 172.21.15.45:0/1239016680 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f08a002fd70 con 0x7f08a8106f10 2024-09-15T22:15:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.903+0000 7f089ffff640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f08940a32d0 0x7f08940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.903+0000 7f089ffff640 1 -- 172.21.15.45:0/1239016680 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f08a00f1300 con 0x7f08a8106f10 2024-09-15T22:15:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.903+0000 7f08a6ffd640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f08940a32d0 0x7f08940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.903+0000 7f08a6ffd640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f08940a32d0 0x7f08940a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f089800bbe0 tx=0x7f089800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:30.906+0000 7f089ffff640 1 -- 172.21.15.45:0/1239016680 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f08a00bdda0 con 0x7f08a8106f10 2024-09-15T22:15:31.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.084+0000 7f08ad45d640 1 -- 172.21.15.45:0/1239016680 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f08a81a7350 con 0x7f08a8106f10 2024-09-15T22:15:31.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.084+0000 7f089ffff640 1 -- 172.21.15.45:0/1239016680 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f08a00bd6a0 con 0x7f08a8106f10 2024-09-15T22:15:31.085 INFO:teuthology.orchestra.run.smithi045.stdout:184683593783 2024-09-15T22:15:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.087+0000 7f08ad45d640 1 -- 172.21.15.45:0/1239016680 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f08940a32d0 msgr2=0x7f08940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.087+0000 7f08ad45d640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f08940a32d0 0x7f08940a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f089800bbe0 tx=0x7f089800b390 comp rx=0 tx=0).stop 2024-09-15T22:15:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.087+0000 7f08ad45d640 1 -- 172.21.15.45:0/1239016680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8106f10 msgr2=0x7f08a8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.087+0000 7f08ad45d640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8106f10 0x7f08a8074f70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f08a0006010 tx=0x7f08a00319f0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.087+0000 7f08ad45d640 1 -- 172.21.15.45:0/1239016680 shutdown_connections 2024-09-15T22:15:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.087+0000 7f08ad45d640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f08940a32d0 0x7f08940a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.087+0000 7f08ad45d640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08a8106f10 0x7f08a8074f70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.087+0000 7f08ad45d640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08a8102790 0x7f08a8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.087+0000 7f08ad45d640 1 --2- 172.21.15.45:0/1239016680 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08a8101de0 0x7f08a80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.087+0000 7f08ad45d640 1 -- 172.21.15.45:0/1239016680 >> 172.21.15.45:0/1239016680 conn(0x7f08a80fd880 msgr2=0x7f08a80ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.087+0000 7f08ad45d640 1 -- 172.21.15.45:0/1239016680 shutdown_connections 2024-09-15T22:15:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.087+0000 7f08ad45d640 1 -- 172.21.15.45:0/1239016680 wait complete. 2024-09-15T22:15:31.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:31 smithi165 ceph-mon[35551]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:31.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:31 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1239016680' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:15:31.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:31 smithi100 ceph-mon[35319]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:31.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:31 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1239016680' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:15:31.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:31 smithi045 ceph-mon[31180]: pgmap v326: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:31.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:31 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1239016680' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T22:15:31.563 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822713 got 154618822715 for osd.5 2024-09-15T22:15:31.564 DEBUG:teuthology.parallel:result is None 2024-09-15T22:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.776+0000 7fb52401a640 1 -- 172.21.15.45:0/655559984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c1055b0 msgr2=0x7fb51c10d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.776+0000 7fb52401a640 1 --2- 172.21.15.45:0/655559984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c1055b0 0x7fb51c10d130 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb514009ca0 tx=0x7fb51402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.776+0000 7fb52401a640 1 -- 172.21.15.45:0/655559984 shutdown_connections 2024-09-15T22:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.776+0000 7fb52401a640 1 --2- 172.21.15.45:0/655559984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c1055b0 0x7fb51c10d130 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.776+0000 7fb52401a640 1 --2- 172.21.15.45:0/655559984 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb51c100e30 0x7fb51c104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.776+0000 7fb52401a640 1 --2- 172.21.15.45:0/655559984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb51c100480 0x7fb51c100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.776+0000 7fb52401a640 1 -- 172.21.15.45:0/655559984 >> 172.21.15.45:0/655559984 conn(0x7fb51c077210 msgr2=0x7fb51c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.777+0000 7fb52401a640 1 -- 172.21.15.45:0/655559984 shutdown_connections 2024-09-15T22:15:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.777+0000 7fb52401a640 1 -- 172.21.15.45:0/655559984 wait complete. 2024-09-15T22:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.777+0000 7fb52401a640 1 Processor -- start 2024-09-15T22:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.777+0000 7fb52401a640 1 -- start start 2024-09-15T22:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.777+0000 7fb52401a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100480 0x7fb51c1973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.777+0000 7fb52401a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb51c100e30 0x7fb51c197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.777+0000 7fb52401a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb51c1055b0 0x7fb51c19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.777+0000 7fb52401a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c110fb0 con 0x7fb51c100480 2024-09-15T22:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.777+0000 7fb52401a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c110e30 con 0x7fb51c100e30 2024-09-15T22:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.777+0000 7fb52401a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb51c111130 con 0x7fb51c1055b0 2024-09-15T22:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb521db6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100480 0x7fb51c1973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb521db6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100480 0x7fb51c1973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43634/0 (socket says 172.21.15.45:43634) 2024-09-15T22:15:31.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb521db6640 1 -- 172.21.15.45:0/323119449 learned_addr learned my addr 172.21.15.45:0/323119449 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb5215b5640 1 --2- 172.21.15.45:0/323119449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb51c100e30 0x7fb51c197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb521db6640 1 -- 172.21.15.45:0/323119449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb51c1055b0 msgr2=0x7fb51c19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb521db6640 1 --2- 172.21.15.45:0/323119449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb51c1055b0 0x7fb51c19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb521db6640 1 -- 172.21.15.45:0/323119449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb51c100e30 msgr2=0x7fb51c197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb521db6640 1 --2- 172.21.15.45:0/323119449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb51c100e30 0x7fb51c197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb521db6640 1 -- 172.21.15.45:0/323119449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb51c19c370 con 0x7fb51c100480 2024-09-15T22:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb521db6640 1 --2- 172.21.15.45:0/323119449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100480 0x7fb51c1973c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb51800e9f0 tx=0x7fb51800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb512ffd640 1 -- 172.21.15.45:0/323119449 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb51800cd80 con 0x7fb51c100480 2024-09-15T22:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb52401a640 1 -- 172.21.15.45:0/323119449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb51c19c660 con 0x7fb51c100480 2024-09-15T22:15:31.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb512ffd640 1 -- 172.21.15.45:0/323119449 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb518010930 con 0x7fb51c100480 2024-09-15T22:15:31.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb512ffd640 1 -- 172.21.15.45:0/323119449 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb518018b00 con 0x7fb51c100480 2024-09-15T22:15:31.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.778+0000 7fb52401a640 1 -- 172.21.15.45:0/323119449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb51c1a3f40 con 0x7fb51c100480 2024-09-15T22:15:31.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.779+0000 7fb52401a640 1 -- 172.21.15.45:0/323119449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb51c100860 con 0x7fb51c100480 2024-09-15T22:15:31.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.781+0000 7fb512ffd640 1 -- 172.21.15.45:0/323119449 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb518018ca0 con 0x7fb51c100480 2024-09-15T22:15:31.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.781+0000 7fb512ffd640 1 --2- 172.21.15.45:0/323119449 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb5080a32d0 0x7fb5080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:31.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.781+0000 7fb5215b5640 1 --2- 172.21.15.45:0/323119449 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb5080a32d0 0x7fb5080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:31.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.781+0000 7fb512ffd640 1 -- 172.21.15.45:0/323119449 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fb5180d0570 con 0x7fb51c100480 2024-09-15T22:15:31.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.782+0000 7fb5215b5640 1 --2- 172.21.15.45:0/323119449 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb5080a32d0 0x7fb5080a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0ff630 tx=0x7fb50c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:31.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.785+0000 7fb512ffd640 1 -- 172.21.15.45:0/323119449 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb51809cdd0 con 0x7fb51c100480 2024-09-15T22:15:31.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.964+0000 7fb52401a640 1 -- 172.21.15.45:0/323119449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fb51c108200 con 0x7fb51c100480 2024-09-15T22:15:31.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.964+0000 7fb512ffd640 1 -- 172.21.15.45:0/323119449 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fb51809c6d0 con 0x7fb51c100480 2024-09-15T22:15:31.966 INFO:teuthology.orchestra.run.smithi045.stdout:322122547230 2024-09-15T22:15:31.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.966+0000 7fb52401a640 1 -- 172.21.15.45:0/323119449 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb5080a32d0 msgr2=0x7fb5080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:31.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.966+0000 7fb52401a640 1 --2- 172.21.15.45:0/323119449 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb5080a32d0 0x7fb5080a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb51c0ff630 tx=0x7fb50c00b390 comp rx=0 tx=0).stop 2024-09-15T22:15:31.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.966+0000 7fb52401a640 1 -- 172.21.15.45:0/323119449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100480 msgr2=0x7fb51c1973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:31.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.966+0000 7fb52401a640 1 --2- 172.21.15.45:0/323119449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100480 0x7fb51c1973c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb51800e9f0 tx=0x7fb51800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.966+0000 7fb52401a640 1 -- 172.21.15.45:0/323119449 shutdown_connections 2024-09-15T22:15:31.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.967+0000 7fb52401a640 1 --2- 172.21.15.45:0/323119449 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fb5080a32d0 0x7fb5080a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.967+0000 7fb52401a640 1 --2- 172.21.15.45:0/323119449 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb51c1055b0 0x7fb51c19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.967+0000 7fb52401a640 1 --2- 172.21.15.45:0/323119449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb51c100e30 0x7fb51c197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.967+0000 7fb52401a640 1 --2- 172.21.15.45:0/323119449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb51c100480 0x7fb51c1973c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:31.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.967+0000 7fb52401a640 1 -- 172.21.15.45:0/323119449 >> 172.21.15.45:0/323119449 conn(0x7fb51c077210 msgr2=0x7fb51c103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:31.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.967+0000 7fb52401a640 1 -- 172.21.15.45:0/323119449 shutdown_connections 2024-09-15T22:15:31.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:31.967+0000 7fb52401a640 1 -- 172.21.15.45:0/323119449 wait complete. 2024-09-15T22:15:32.241 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411401 got 77309411403 for osd.2 2024-09-15T22:15:32.241 DEBUG:teuthology.parallel:result is None 2024-09-15T22:15:32.359 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:32 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/323119449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:15:32.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:32 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/323119449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:15:32.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:32 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/323119449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T22:15:33.199 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547227 got 322122547230 for osd.11 2024-09-15T22:15:33.199 DEBUG:teuthology.parallel:result is None 2024-09-15T22:15:33.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:33 smithi165 ceph-mon[35551]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:33.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:33 smithi100 ceph-mon[35319]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:33.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:33 smithi045 ceph-mon[31180]: pgmap v327: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:33.609 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593780 got 184683593783 for osd.6 2024-09-15T22:15:33.609 DEBUG:teuthology.parallel:result is None 2024-09-15T22:15:33.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.780+0000 7fd52bafa640 1 -- 172.21.15.45:0/3306125476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd524074f40 msgr2=0x7fd52410de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:33.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.780+0000 7fd52bafa640 1 --2- 172.21.15.45:0/3306125476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd524074f40 0x7fd52410de80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd514009900 tx=0x7fd51402a480 comp rx=0 tx=0).stop 2024-09-15T22:15:33.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.780+0000 7fd52bafa640 1 -- 172.21.15.45:0/3306125476 shutdown_connections 2024-09-15T22:15:33.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.780+0000 7fd52bafa640 1 --2- 172.21.15.45:0/3306125476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd52410e3c0 0x7fd524110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.780+0000 7fd52bafa640 1 --2- 172.21.15.45:0/3306125476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd524074f40 0x7fd52410de80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.780+0000 7fd52bafa640 1 --2- 172.21.15.45:0/3306125476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd524074620 0x7fd524074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.780+0000 7fd52bafa640 1 -- 172.21.15.45:0/3306125476 >> 172.21.15.45:0/3306125476 conn(0x7fd5240fd8c0 msgr2=0x7fd5240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:33.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.781+0000 7fd52bafa640 1 -- 172.21.15.45:0/3306125476 shutdown_connections 2024-09-15T22:15:33.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.781+0000 7fd52bafa640 1 -- 172.21.15.45:0/3306125476 wait complete. 2024-09-15T22:15:33.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.781+0000 7fd52bafa640 1 Processor -- start 2024-09-15T22:15:33.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.781+0000 7fd52bafa640 1 -- start start 2024-09-15T22:15:33.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.781+0000 7fd52bafa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd524074620 0x7fd5241a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:33.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.781+0000 7fd52bafa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd524074f40 0x7fd5241a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:33.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.781+0000 7fd52bafa640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52410e3c0 0x7fd52419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.781+0000 7fd52bafa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd5241142b0 con 0x7fd524074620 2024-09-15T22:15:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd52bafa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd524114130 con 0x7fd524074f40 2024-09-15T22:15:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd52bafa640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd524114430 con 0x7fd52410e3c0 2024-09-15T22:15:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd529896640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd524074620 0x7fd5241a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd529896640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd524074620 0x7fd5241a03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43644/0 (socket says 172.21.15.45:43644) 2024-09-15T22:15:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd529896640 1 -- 172.21.15.45:0/34102421 learned_addr learned my addr 172.21.15.45:0/34102421 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd529095640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd524074f40 0x7fd5241a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd52a097640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52410e3c0 0x7fd52419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd529896640 1 -- 172.21.15.45:0/34102421 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52410e3c0 msgr2=0x7fd52419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd529896640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52410e3c0 0x7fd52419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd529896640 1 -- 172.21.15.45:0/34102421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd524074f40 msgr2=0x7fd5241a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd529896640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd524074f40 0x7fd5241a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd529896640 1 -- 172.21.15.45:0/34102421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd52419acd0 con 0x7fd524074620 2024-09-15T22:15:33.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd52a097640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52410e3c0 0x7fd52419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:15:33.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd529095640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd524074f40 0x7fd5241a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:33.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd529896640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd524074620 0x7fd5241a03e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd52000d770 tx=0x7fd52000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:33.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd51affd640 1 -- 172.21.15.45:0/34102421 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520017070 con 0x7fd524074620 2024-09-15T22:15:33.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd51affd640 1 -- 172.21.15.45:0/34102421 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd520005520 con 0x7fd524074620 2024-09-15T22:15:33.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd52bafa640 1 -- 172.21.15.45:0/34102421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd52419afc0 con 0x7fd524074620 2024-09-15T22:15:33.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd51affd640 1 -- 172.21.15.45:0/34102421 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520010460 con 0x7fd524074620 2024-09-15T22:15:33.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.782+0000 7fd52bafa640 1 -- 172.21.15.45:0/34102421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5241a72b0 con 0x7fd524074620 2024-09-15T22:15:33.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.783+0000 7fd52bafa640 1 -- 172.21.15.45:0/34102421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd524074a00 con 0x7fd524074620 2024-09-15T22:15:33.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.785+0000 7fd51affd640 1 -- 172.21.15.45:0/34102421 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd520004ea0 con 0x7fd524074620 2024-09-15T22:15:33.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.785+0000 7fd51affd640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd5100a32d0 0x7fd5100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:33.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.785+0000 7fd529095640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd5100a32d0 0x7fd5100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:33.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.785+0000 7fd51affd640 1 -- 172.21.15.45:0/34102421 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fd5200cfda0 con 0x7fd524074620 2024-09-15T22:15:33.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.786+0000 7fd529095640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd5100a32d0 0x7fd5100a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd52419b6e0 tx=0x7fd514005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:33.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.789+0000 7fd51affd640 1 -- 172.21.15.45:0/34102421 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd52009c600 con 0x7fd524074620 2024-09-15T22:15:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.968+0000 7fd52bafa640 1 -- 172.21.15.45:0/34102421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fd52402d7c0 con 0x7fd524074620 2024-09-15T22:15:33.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.968+0000 7fd51affd640 1 -- 172.21.15.45:0/34102421 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd52009bf00 con 0x7fd524074620 2024-09-15T22:15:33.971 INFO:teuthology.orchestra.run.smithi045.stdout:240518168622 2024-09-15T22:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.970+0000 7fd52bafa640 1 -- 172.21.15.45:0/34102421 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd5100a32d0 msgr2=0x7fd5100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.970+0000 7fd52bafa640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd5100a32d0 0x7fd5100a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd52419b6e0 tx=0x7fd514005a20 comp rx=0 tx=0).stop 2024-09-15T22:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.970+0000 7fd52bafa640 1 -- 172.21.15.45:0/34102421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd524074620 msgr2=0x7fd5241a03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.970+0000 7fd52bafa640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd524074620 0x7fd5241a03e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd52000d770 tx=0x7fd52000dc30 comp rx=0 tx=0).stop 2024-09-15T22:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.971+0000 7fd52bafa640 1 -- 172.21.15.45:0/34102421 shutdown_connections 2024-09-15T22:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.971+0000 7fd52bafa640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd5100a32d0 0x7fd5100a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.971+0000 7fd52bafa640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd52410e3c0 0x7fd52419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.971+0000 7fd52bafa640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd524074f40 0x7fd5241a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.971+0000 7fd52bafa640 1 --2- 172.21.15.45:0/34102421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd524074620 0x7fd5241a03e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.971+0000 7fd52bafa640 1 -- 172.21.15.45:0/34102421 >> 172.21.15.45:0/34102421 conn(0x7fd5240fd8c0 msgr2=0x7fd5240fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:33.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.971+0000 7fd52bafa640 1 -- 172.21.15.45:0/34102421 shutdown_connections 2024-09-15T22:15:33.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:33.971+0000 7fd52bafa640 1 -- 172.21.15.45:0/34102421 wait complete. 2024-09-15T22:15:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:34 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/34102421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:15:34.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:34 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/34102421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:15:34.486 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986238 got 133143986240 for osd.4 2024-09-15T22:15:34.486 DEBUG:teuthology.parallel:result is None 2024-09-15T22:15:34.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:34 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/34102421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T22:15:34.915 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:35.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:35 smithi045 ceph-mon[31180]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:35.402 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430255 got 206158430257 for osd.7 2024-09-15T22:15:35.403 DEBUG:teuthology.parallel:result is None 2024-09-15T22:15:35.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:35 smithi165 ceph-mon[35551]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:35.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:35 smithi100 ceph-mon[35319]: pgmap v328: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:35.800 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:35.834 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168619 got 240518168622 for osd.8 2024-09-15T22:15:35.835 DEBUG:teuthology.parallel:result is None 2024-09-15T22:15:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.260+0000 7f547907a640 1 -- 172.21.15.45:0/3089163353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5474102ef0 msgr2=0x7f547410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.260+0000 7f547907a640 1 --2- 172.21.15.45:0/3089163353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5474102ef0 0x7f547410da40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f546c009ca0 tx=0x7f546c02a950 comp rx=0 tx=0).stop 2024-09-15T22:15:36.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.260+0000 7f547907a640 1 -- 172.21.15.45:0/3089163353 shutdown_connections 2024-09-15T22:15:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.260+0000 7f547907a640 1 --2- 172.21.15.45:0/3089163353 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5474102ef0 0x7f547410da40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.260+0000 7f547907a640 1 --2- 172.21.15.45:0/3089163353 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5474102570 0x7f54741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.260+0000 7f547907a640 1 --2- 172.21.15.45:0/3089163353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5474100e20 0x7f5474101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.260+0000 7f547907a640 1 -- 172.21.15.45:0/3089163353 >> 172.21.15.45:0/3089163353 conn(0x7f54740fc7d0 msgr2=0x7f54740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.260+0000 7f547907a640 1 -- 172.21.15.45:0/3089163353 shutdown_connections 2024-09-15T22:15:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.260+0000 7f547907a640 1 -- 172.21.15.45:0/3089163353 wait complete. 2024-09-15T22:15:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.261+0000 7f547907a640 1 Processor -- start 2024-09-15T22:15:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.261+0000 7f547907a640 1 -- start start 2024-09-15T22:15:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.261+0000 7f547907a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5474100e20 0x7f54740fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.261+0000 7f547907a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5474102570 0x7f54740fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.261+0000 7f547907a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5474102ef0 0x7f54740fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:36.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.261+0000 7f547907a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f54741110a0 con 0x7f5474102570 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.261+0000 7f547907a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5474110f20 con 0x7f5474102ef0 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.261+0000 7f547907a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5474111220 con 0x7f5474100e20 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f546bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5474102570 0x7f54740fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f546bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5474102570 0x7f54740fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35290/0 (socket says 172.21.15.45:35290) 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f546bfff640 1 -- 172.21.15.45:0/264188234 learned_addr learned my addr 172.21.15.45:0/264188234 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f547359e640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5474102ef0 0x7f54740fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f5472d9d640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5474100e20 0x7f54740fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f546bfff640 1 -- 172.21.15.45:0/264188234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5474100e20 msgr2=0x7f54740fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f546bfff640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5474100e20 0x7f54740fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f546bfff640 1 -- 172.21.15.45:0/264188234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5474102ef0 msgr2=0x7f54740fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f546bfff640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5474102ef0 0x7f54740fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f546bfff640 1 -- 172.21.15.45:0/264188234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54741a6a50 con 0x7f5474102570 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f546bfff640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5474102570 0x7f54740fd1c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f545c00d770 tx=0x7f545c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:36.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f5470d99640 1 -- 172.21.15.45:0/264188234 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c017070 con 0x7f5474102570 2024-09-15T22:15:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f547907a640 1 -- 172.21.15.45:0/264188234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54741a6d40 con 0x7f5474102570 2024-09-15T22:15:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f5470d99640 1 -- 172.21.15.45:0/264188234 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f545c005520 con 0x7f5474102570 2024-09-15T22:15:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f5470d99640 1 -- 172.21.15.45:0/264188234 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c010460 con 0x7f5474102570 2024-09-15T22:15:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.262+0000 7f547907a640 1 -- 172.21.15.45:0/264188234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54741a71d0 con 0x7f5474102570 2024-09-15T22:15:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.263+0000 7f547907a640 1 -- 172.21.15.45:0/264188234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5474101200 con 0x7f5474102570 2024-09-15T22:15:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.265+0000 7f5470d99640 1 -- 172.21.15.45:0/264188234 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f545c004ea0 con 0x7f5474102570 2024-09-15T22:15:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.265+0000 7f5470d99640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f54600a32d0 0x7f54600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.265+0000 7f5470d99640 1 -- 172.21.15.45:0/264188234 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f545c0cfcc0 con 0x7f5474102570 2024-09-15T22:15:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.265+0000 7f5472d9d640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f54600a32d0 0x7f54600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.266+0000 7f5472d9d640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f54600a32d0 0x7f54600a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5464005fd0 tx=0x7f5464005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:36.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.268+0000 7f5470d99640 1 -- 172.21.15.45:0/264188234 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f545c09c520 con 0x7f5474102570 2024-09-15T22:15:36.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.451+0000 7f547907a640 1 -- 172.21.15.45:0/264188234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f54740fe1b0 con 0x7f5474102570 2024-09-15T22:15:36.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.451+0000 7f5470d99640 1 -- 172.21.15.45:0/264188234 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f54740fe1b0 con 0x7f5474102570 2024-09-15T22:15:36.453 INFO:teuthology.orchestra.run.smithi045.stdout:270582939688 2024-09-15T22:15:36.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.453+0000 7f547907a640 1 -- 172.21.15.45:0/264188234 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f54600a32d0 msgr2=0x7f54600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:36.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.453+0000 7f547907a640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f54600a32d0 0x7f54600a5790 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5464005fd0 tx=0x7f5464005850 comp rx=0 tx=0).stop 2024-09-15T22:15:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.453+0000 7f547907a640 1 -- 172.21.15.45:0/264188234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5474102570 msgr2=0x7f54740fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.453+0000 7f547907a640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5474102570 0x7f54740fd1c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f545c00d770 tx=0x7f545c00dc30 comp rx=0 tx=0).stop 2024-09-15T22:15:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.453+0000 7f547907a640 1 -- 172.21.15.45:0/264188234 shutdown_connections 2024-09-15T22:15:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.453+0000 7f547907a640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f54600a32d0 0x7f54600a5790 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.453+0000 7f547907a640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5474102ef0 0x7f54740fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.453+0000 7f547907a640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5474102570 0x7f54740fd1c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.453+0000 7f547907a640 1 --2- 172.21.15.45:0/264188234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5474100e20 0x7f54740fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.453+0000 7f547907a640 1 -- 172.21.15.45:0/264188234 >> 172.21.15.45:0/264188234 conn(0x7f54740fc7d0 msgr2=0x7f547406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.454+0000 7f547907a640 1 -- 172.21.15.45:0/264188234 shutdown_connections 2024-09-15T22:15:36.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:36.454+0000 7f547907a640 1 -- 172.21.15.45:0/264188234 wait complete. 2024-09-15T22:15:37.171 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:37 smithi045 ceph-mon[31180]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:15:37.172 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:37 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/264188234' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:15:37.204 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939684 got 270582939688 for osd.9 2024-09-15T22:15:37.204 DEBUG:teuthology.parallel:result is None 2024-09-15T22:15:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.401+0000 7f7f1814a640 1 -- 172.21.15.45:0/3816009377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f10102ef0 msgr2=0x7f7f1010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.401+0000 7f7f1814a640 1 --2- 172.21.15.45:0/3816009377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f10102ef0 0x7f7f1010da40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009ca0 tx=0x7f7f0802a950 comp rx=0 tx=0).stop 2024-09-15T22:15:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.401+0000 7f7f1814a640 1 -- 172.21.15.45:0/3816009377 shutdown_connections 2024-09-15T22:15:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.401+0000 7f7f1814a640 1 --2- 172.21.15.45:0/3816009377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f10102ef0 0x7f7f1010da40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.401+0000 7f7f1814a640 1 --2- 172.21.15.45:0/3816009377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f10102570 0x7f7f101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.401+0000 7f7f1814a640 1 --2- 172.21.15.45:0/3816009377 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f10100e20 0x7f7f10101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.401+0000 7f7f1814a640 1 -- 172.21.15.45:0/3816009377 >> 172.21.15.45:0/3816009377 conn(0x7f7f100fc7d0 msgr2=0x7f7f100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.401+0000 7f7f1814a640 1 -- 172.21.15.45:0/3816009377 shutdown_connections 2024-09-15T22:15:37.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.401+0000 7f7f1814a640 1 -- 172.21.15.45:0/3816009377 wait complete. 2024-09-15T22:15:37.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.402+0000 7f7f1814a640 1 Processor -- start 2024-09-15T22:15:37.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.402+0000 7f7f1814a640 1 -- start start 2024-09-15T22:15:37.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.402+0000 7f7f1814a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f10100e20 0x7f7f100fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:37.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.402+0000 7f7f1814a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f10102570 0x7f7f100fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:37.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.402+0000 7f7f1814a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f10102ef0 0x7f7f100fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:37.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.402+0000 7f7f1814a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7f101110a0 con 0x7f7f10100e20 2024-09-15T22:15:37.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.402+0000 7f7f1814a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7f10110f20 con 0x7f7f10102570 2024-09-15T22:15:37.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.402+0000 7f7f1814a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7f10111220 con 0x7f7f10102ef0 2024-09-15T22:15:37.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.402+0000 7f7f15ee6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f10100e20 0x7f7f100fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:37.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.402+0000 7f7f15ee6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f10100e20 0x7f7f100fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35308/0 (socket says 172.21.15.45:35308) 2024-09-15T22:15:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.402+0000 7f7f15ee6640 1 -- 172.21.15.45:0/3736813008 learned_addr learned my addr 172.21.15.45:0/3736813008 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.402+0000 7f7f166e7640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f10102ef0 0x7f7f100fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f156e5640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f10102570 0x7f7f100fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f15ee6640 1 -- 172.21.15.45:0/3736813008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f10102ef0 msgr2=0x7f7f100fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f15ee6640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f10102ef0 0x7f7f100fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f15ee6640 1 -- 172.21.15.45:0/3736813008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f10102570 msgr2=0x7f7f100fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f15ee6640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f10102570 0x7f7f100fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f15ee6640 1 -- 172.21.15.45:0/3736813008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f101a69f0 con 0x7f7f10100e20 2024-09-15T22:15:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f166e7640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f10102ef0 0x7f7f100fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f156e5640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f10102570 0x7f7f100fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f15ee6640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f10100e20 0x7f7f100fcc80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00c920 tx=0x7f7f0c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:37.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f06ffd640 1 -- 172.21.15.45:0/3736813008 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c007c70 con 0x7f7f10100e20 2024-09-15T22:15:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f06ffd640 1 -- 172.21.15.45:0/3736813008 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7f0c007e10 con 0x7f7f10100e20 2024-09-15T22:15:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f1814a640 1 -- 172.21.15.45:0/3736813008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f101a6ce0 con 0x7f7f10100e20 2024-09-15T22:15:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f06ffd640 1 -- 172.21.15.45:0/3736813008 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c018940 con 0x7f7f10100e20 2024-09-15T22:15:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.403+0000 7f7f1814a640 1 -- 172.21.15.45:0/3736813008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f101a71c0 con 0x7f7f10100e20 2024-09-15T22:15:37.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.404+0000 7f7f1814a640 1 -- 172.21.15.45:0/3736813008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f10101200 con 0x7f7f10100e20 2024-09-15T22:15:37.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.406+0000 7f7f06ffd640 1 -- 172.21.15.45:0/3736813008 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7f0c018be0 con 0x7f7f10100e20 2024-09-15T22:15:37.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.406+0000 7f7f06ffd640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7efc0a32d0 0x7f7efc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:37.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.407+0000 7f7f156e5640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7efc0a32d0 0x7f7efc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:37.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.407+0000 7f7f06ffd640 1 -- 172.21.15.45:0/3736813008 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f7f0c0cffd0 con 0x7f7f10100e20 2024-09-15T22:15:37.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.407+0000 7f7f156e5640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7efc0a32d0 0x7f7efc0a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7f100fe710 tx=0x7f7f00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:37.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.411+0000 7f7f06ffd640 1 -- 172.21.15.45:0/3736813008 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7f0c014030 con 0x7f7f10100e20 2024-09-15T22:15:37.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:37 smithi165 ceph-mon[35551]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:15:37.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:37 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/264188234' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:15:37.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:37 smithi100 ceph-mon[35319]: pgmap v329: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:15:37.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:37 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/264188234' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T22:15:37.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.589+0000 7f7f1814a640 1 -- 172.21.15.45:0/3736813008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7f1010a0a0 con 0x7f7f10100e20 2024-09-15T22:15:37.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.589+0000 7f7f06ffd640 1 -- 172.21.15.45:0/3736813008 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7f0c09c830 con 0x7f7f10100e20 2024-09-15T22:15:37.592 INFO:teuthology.orchestra.run.smithi045.stdout:55834574930 2024-09-15T22:15:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.592+0000 7f7f1814a640 1 -- 172.21.15.45:0/3736813008 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7efc0a32d0 msgr2=0x7f7efc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.592+0000 7f7f1814a640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7efc0a32d0 0x7f7efc0a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7f100fe710 tx=0x7f7f00005f90 comp rx=0 tx=0).stop 2024-09-15T22:15:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.592+0000 7f7f1814a640 1 -- 172.21.15.45:0/3736813008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f10100e20 msgr2=0x7f7f100fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.592+0000 7f7f1814a640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f10100e20 0x7f7f100fcc80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c00c920 tx=0x7f7f0c00cde0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.592+0000 7f7f1814a640 1 -- 172.21.15.45:0/3736813008 shutdown_connections 2024-09-15T22:15:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.592+0000 7f7f1814a640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f7efc0a32d0 0x7f7efc0a5790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.592+0000 7f7f1814a640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7f10102ef0 0x7f7f100fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.592+0000 7f7f1814a640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f10102570 0x7f7f100fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.592+0000 7f7f1814a640 1 --2- 172.21.15.45:0/3736813008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f10100e20 0x7f7f100fcc80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.592+0000 7f7f1814a640 1 -- 172.21.15.45:0/3736813008 >> 172.21.15.45:0/3736813008 conn(0x7f7f100fc7d0 msgr2=0x7f7f1006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.592+0000 7f7f1814a640 1 -- 172.21.15.45:0/3736813008 shutdown_connections 2024-09-15T22:15:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:37.592+0000 7f7f1814a640 1 -- 172.21.15.45:0/3736813008 wait complete. 2024-09-15T22:15:38.255 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574926 got 55834574930 for osd.1 2024-09-15T22:15:38.255 DEBUG:teuthology.parallel:result is None 2024-09-15T22:15:38.255 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T22:15:38.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:15:38.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:38 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3736813008' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:15:38.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:38 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3736813008' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:15:38.516 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:38 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3736813008' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T22:15:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.038+0000 7f00cad80640 1 -- 172.21.15.45:0/2314508753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00c4106f20 msgr2=0x7f00c410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.038+0000 7f00cad80640 1 --2- 172.21.15.45:0/2314508753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00c4106f20 0x7f00c410eaa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009ca0 tx=0x7f00bc02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:15:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.038+0000 7f00cad80640 1 -- 172.21.15.45:0/2314508753 shutdown_connections 2024-09-15T22:15:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.038+0000 7f00cad80640 1 --2- 172.21.15.45:0/2314508753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00c4106f20 0x7f00c410eaa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.038+0000 7f00cad80640 1 --2- 172.21.15.45:0/2314508753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00c41027a0 0x7f00c41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.038+0000 7f00cad80640 1 --2- 172.21.15.45:0/2314508753 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00c4101df0 0x7f00c41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.038+0000 7f00cad80640 1 -- 172.21.15.45:0/2314508753 >> 172.21.15.45:0/2314508753 conn(0x7f00c40fd8f0 msgr2=0x7f00c40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.038+0000 7f00cad80640 1 -- 172.21.15.45:0/2314508753 shutdown_connections 2024-09-15T22:15:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.038+0000 7f00cad80640 1 -- 172.21.15.45:0/2314508753 wait complete. 2024-09-15T22:15:39.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00cad80640 1 Processor -- start 2024-09-15T22:15:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00cad80640 1 -- start start 2024-09-15T22:15:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00cad80640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00c4101df0 0x7f00c4198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00cad80640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00c41027a0 0x7f00c4198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00cad80640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00c4106f20 0x7f00c419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00cad80640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f00c41120a0 con 0x7f00c41027a0 2024-09-15T22:15:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00cad80640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f00c4111f20 con 0x7f00c4106f20 2024-09-15T22:15:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00cad80640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f00c4112220 con 0x7f00c4101df0 2024-09-15T22:15:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00c3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00c41027a0 0x7f00c4198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00c3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00c41027a0 0x7f00c4198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35320/0 (socket says 172.21.15.45:35320) 2024-09-15T22:15:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00c3fff640 1 -- 172.21.15.45:0/3269713367 learned_addr learned my addr 172.21.15.45:0/3269713367 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00c8b1c640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00c4101df0 0x7f00c4198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:39.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00c931d640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00c4106f20 0x7f00c419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00c3fff640 1 -- 172.21.15.45:0/3269713367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00c4101df0 msgr2=0x7f00c4198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00c3fff640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00c4101df0 0x7f00c4198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00c3fff640 1 -- 172.21.15.45:0/3269713367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00c4106f20 msgr2=0x7f00c419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00c3fff640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00c4106f20 0x7f00c419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00c3fff640 1 -- 172.21.15.45:0/3269713367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c419d3d0 con 0x7f00c41027a0 2024-09-15T22:15:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.039+0000 7f00c931d640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00c4106f20 0x7f00c419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.040+0000 7f00c3fff640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00c41027a0 0x7f00c4198960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f00b000c920 tx=0x7f00b000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.040+0000 7f00c1ffb640 1 -- 172.21.15.45:0/3269713367 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0007c70 con 0x7f00c41027a0 2024-09-15T22:15:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.040+0000 7f00c1ffb640 1 -- 172.21.15.45:0/3269713367 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f00b0007e10 con 0x7f00c41027a0 2024-09-15T22:15:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.040+0000 7f00cad80640 1 -- 172.21.15.45:0/3269713367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c419d6c0 con 0x7f00c41027a0 2024-09-15T22:15:39.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.040+0000 7f00c1ffb640 1 -- 172.21.15.45:0/3269713367 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0018940 con 0x7f00c41027a0 2024-09-15T22:15:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.040+0000 7f00cad80640 1 -- 172.21.15.45:0/3269713367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c41a4fa0 con 0x7f00c41027a0 2024-09-15T22:15:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.041+0000 7f00cad80640 1 -- 172.21.15.45:0/3269713367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c41021d0 con 0x7f00c41027a0 2024-09-15T22:15:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.042+0000 7f00c1ffb640 1 -- 172.21.15.45:0/3269713367 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f00b0018b20 con 0x7f00c41027a0 2024-09-15T22:15:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.043+0000 7f00c1ffb640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00b40a32d0 0x7f00b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.043+0000 7f00c8b1c640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00b40a32d0 0x7f00b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.043+0000 7f00c1ffb640 1 -- 172.21.15.45:0/3269713367 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f00b00cff00 con 0x7f00c41027a0 2024-09-15T22:15:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.043+0000 7f00c8b1c640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00b40a32d0 0x7f00b40a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f00b8005fd0 tx=0x7f00b800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:39.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.047+0000 7f00c1ffb640 1 -- 172.21.15.45:0/3269713367 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f00b0014030 con 0x7f00c41027a0 2024-09-15T22:15:39.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.221+0000 7f00cad80640 1 -- 172.21.15.45:0/3269713367 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00c40feaa0 con 0x7f00b40a32d0 2024-09-15T22:15:39.224 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:39 smithi045 ceph-mon[31180]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-15T22:15:39.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.230+0000 7f00c1ffb640 1 -- 172.21.15.45:0/3269713367 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340279 (secure 0 0 0) 0x7f00c40feaa0 con 0x7f00b40a32d0 2024-09-15T22:15:39.235 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:15:39.237 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-09-15T22:15:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.233+0000 7f00cad80640 1 -- 172.21.15.45:0/3269713367 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00b40a32d0 msgr2=0x7f00b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.233+0000 7f00cad80640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00b40a32d0 0x7f00b40a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f00b8005fd0 tx=0x7f00b800b390 comp rx=0 tx=0).stop 2024-09-15T22:15:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.233+0000 7f00cad80640 1 -- 172.21.15.45:0/3269713367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00c41027a0 msgr2=0x7f00c4198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.233+0000 7f00cad80640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00c41027a0 0x7f00c4198960 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f00b000c920 tx=0x7f00b000cde0 comp rx=0 tx=0).stop 2024-09-15T22:15:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.233+0000 7f00cad80640 1 -- 172.21.15.45:0/3269713367 shutdown_connections 2024-09-15T22:15:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.233+0000 7f00cad80640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f00b40a32d0 0x7f00b40a5790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:39.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.233+0000 7f00cad80640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00c4106f20 0x7f00c419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:39.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.233+0000 7f00cad80640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00c41027a0 0x7f00c4198960 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:39.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.233+0000 7f00cad80640 1 --2- 172.21.15.45:0/3269713367 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f00c4101df0 0x7f00c4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:39.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.233+0000 7f00cad80640 1 -- 172.21.15.45:0/3269713367 >> 172.21.15.45:0/3269713367 conn(0x7f00c40fd8f0 msgr2=0x7f00c40fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:39.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.233+0000 7f00cad80640 1 -- 172.21.15.45:0/3269713367 shutdown_connections 2024-09-15T22:15:39.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:39.233+0000 7f00cad80640 1 -- 172.21.15.45:0/3269713367 wait complete. 2024-09-15T22:15:39.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:39 smithi165 ceph-mon[35551]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-15T22:15:39.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:39 smithi100 ceph-mon[35319]: pgmap v330: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2 op/s 2024-09-15T22:15:40.011 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":330,"stamp":"2024-09-15T22:15:37.434449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656531,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":254,"num_read_kb":245,"num_write":272,"num_write_kb":3035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":408944,"kb_used_data":13856,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124532880,"statfs":{"total":1151940427776,"available":1151521669120,"internally_reserved":0,"allocated":14188544,"data_stored":7966427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":13,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003229"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114125+0000","last_change":"2024-09-15T22:14:04.718966+0000","last_active":"2024-09-15T22:15:17.114125+0000","last_peered":"2024-09-15T22:15:17.114125+0000","last_clean":"2024-09-15T22:15:17.114125+0000","last_became_active":"2024-09-15T22:14:04.718743+0000","last_became_peered":"2024-09-15T22:14:04.718743+0000","last_unstale":"2024-09-15T22:15:17.114125+0000","last_undegraded":"2024-09-15T22:15:17.114125+0000","last_fullsized":"2024-09-15T22:15:17.114125+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:24:01.767801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116214+0000","last_change":"2024-09-15T22:14:06.814802+0000","last_active":"2024-09-15T22:15:17.116214+0000","last_peered":"2024-09-15T22:15:17.116214+0000","last_clean":"2024-09-15T22:15:17.116214+0000","last_became_active":"2024-09-15T22:14:06.814495+0000","last_became_peered":"2024-09-15T22:14:06.814495+0000","last_unstale":"2024-09-15T22:15:17.116214+0000","last_undegraded":"2024-09-15T22:15:17.116214+0000","last_fullsized":"2024-09-15T22:15:17.116214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:45.384412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.404082+0000","last_change":"2024-09-15T22:15:17.404082+0000","last_active":"2024-09-15T22:15:17.404082+0000","last_peered":"2024-09-15T22:15:17.404082+0000","last_clean":"2024-09-15T22:15:17.404082+0000","last_became_active":"2024-09-15T22:15:17.403590+0000","last_became_peered":"2024-09-15T22:15:17.403590+0000","last_unstale":"2024-09-15T22:15:17.404082+0000","last_undegraded":"2024-09-15T22:15:17.404082+0000","last_fullsized":"2024-09-15T22:15:17.404082+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:49.816560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116417+0000","last_change":"2024-09-15T22:14:05.017101+0000","last_active":"2024-09-15T22:15:17.116417+0000","last_peered":"2024-09-15T22:15:17.116417+0000","last_clean":"2024-09-15T22:15:17.116417+0000","last_became_active":"2024-09-15T22:14:05.016748+0000","last_became_peered":"2024-09-15T22:14:05.016748+0000","last_unstale":"2024-09-15T22:15:17.116417+0000","last_undegraded":"2024-09-15T22:15:17.116417+0000","last_fullsized":"2024-09-15T22:15:17.116417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:11.211291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402592+0000","last_change":"2024-09-15T22:14:06.815112+0000","last_active":"2024-09-15T22:15:17.402592+0000","last_peered":"2024-09-15T22:15:17.402592+0000","last_clean":"2024-09-15T22:15:17.402592+0000","last_became_active":"2024-09-15T22:14:06.814556+0000","last_became_peered":"2024-09-15T22:14:06.814556+0000","last_unstale":"2024-09-15T22:15:17.402592+0000","last_undegraded":"2024-09-15T22:15:17.402592+0000","last_fullsized":"2024-09-15T22:15:17.402592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:24.733336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115743+0000","last_change":"2024-09-15T22:14:13.845829+0000","last_active":"2024-09-15T22:15:17.115743+0000","last_peered":"2024-09-15T22:15:17.115743+0000","last_clean":"2024-09-15T22:15:17.115743+0000","last_became_active":"2024-09-15T22:14:13.844958+0000","last_became_peered":"2024-09-15T22:14:13.844958+0000","last_unstale":"2024-09-15T22:15:17.115743+0000","last_undegraded":"2024-09-15T22:15:17.115743+0000","last_fullsized":"2024-09-15T22:15:17.115743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:37.944143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218873+0000","last_change":"2024-09-15T22:14:04.720255+0000","last_active":"2024-09-15T22:15:17.218873+0000","last_peered":"2024-09-15T22:15:17.218873+0000","last_clean":"2024-09-15T22:15:17.218873+0000","last_became_active":"2024-09-15T22:14:04.719907+0000","last_became_peered":"2024-09-15T22:14:04.719907+0000","last_unstale":"2024-09-15T22:15:17.218873+0000","last_undegraded":"2024-09-15T22:15:17.218873+0000","last_fullsized":"2024-09-15T22:15:17.218873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:12.510139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.210939+0000","last_change":"2024-09-15T22:14:06.808322+0000","last_active":"2024-09-15T22:15:17.210939+0000","last_peered":"2024-09-15T22:15:17.210939+0000","last_clean":"2024-09-15T22:15:17.210939+0000","last_became_active":"2024-09-15T22:14:06.807398+0000","last_became_peered":"2024-09-15T22:14:06.807398+0000","last_unstale":"2024-09-15T22:15:17.210939+0000","last_undegraded":"2024-09-15T22:15:17.210939+0000","last_fullsized":"2024-09-15T22:15:17.210939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:11.677800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116786+0000","last_change":"2024-09-15T22:14:13.849713+0000","last_active":"2024-09-15T22:15:17.116786+0000","last_peered":"2024-09-15T22:15:17.116786+0000","last_clean":"2024-09-15T22:15:17.116786+0000","last_became_active":"2024-09-15T22:14:13.849311+0000","last_became_peered":"2024-09-15T22:14:13.849311+0000","last_unstale":"2024-09-15T22:15:17.116786+0000","last_undegraded":"2024-09-15T22:15:17.116786+0000","last_fullsized":"2024-09-15T22:15:17.116786+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:17.782013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218958+0000","last_change":"2024-09-15T22:14:04.721694+0000","last_active":"2024-09-15T22:15:17.218958+0000","last_peered":"2024-09-15T22:15:17.218958+0000","last_clean":"2024-09-15T22:15:17.218958+0000","last_became_active":"2024-09-15T22:14:04.721321+0000","last_became_peered":"2024-09-15T22:14:04.721321+0000","last_unstale":"2024-09-15T22:15:17.218958+0000","last_undegraded":"2024-09-15T22:15:17.218958+0000","last_fullsized":"2024-09-15T22:15:17.218958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:47.817565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118521+0000","last_change":"2024-09-15T22:14:06.809564+0000","last_active":"2024-09-15T22:15:17.118521+0000","last_peered":"2024-09-15T22:15:17.118521+0000","last_clean":"2024-09-15T22:15:17.118521+0000","last_became_active":"2024-09-15T22:14:06.809102+0000","last_became_peered":"2024-09-15T22:14:06.809102+0000","last_unstale":"2024-09-15T22:15:17.118521+0000","last_undegraded":"2024-09-15T22:15:17.118521+0000","last_fullsized":"2024-09-15T22:15:17.118521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:55.306791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115905+0000","last_change":"2024-09-15T22:14:13.849839+0000","last_active":"2024-09-15T22:15:17.115905+0000","last_peered":"2024-09-15T22:15:17.115905+0000","last_clean":"2024-09-15T22:15:17.115905+0000","last_became_active":"2024-09-15T22:14:13.849415+0000","last_became_peered":"2024-09-15T22:14:13.849415+0000","last_unstale":"2024-09-15T22:15:17.115905+0000","last_undegraded":"2024-09-15T22:15:17.115905+0000","last_fullsized":"2024-09-15T22:15:17.115905+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:20.336406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114391+0000","last_change":"2024-09-15T22:14:06.815506+0000","last_active":"2024-09-15T22:15:17.114391+0000","last_peered":"2024-09-15T22:15:17.114391+0000","last_clean":"2024-09-15T22:15:17.114391+0000","last_became_active":"2024-09-15T22:14:06.815066+0000","last_became_peered":"2024-09-15T22:14:06.815066+0000","last_unstale":"2024-09-15T22:15:17.114391+0000","last_undegraded":"2024-09-15T22:15:17.114391+0000","last_fullsized":"2024-09-15T22:15:17.114391+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:42.182268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218163+0000","last_change":"2024-09-15T22:14:04.721403+0000","last_active":"2024-09-15T22:15:17.218163+0000","last_peered":"2024-09-15T22:15:17.218163+0000","last_clean":"2024-09-15T22:15:17.218163+0000","last_became_active":"2024-09-15T22:14:04.721049+0000","last_became_peered":"2024-09-15T22:14:04.721049+0000","last_unstale":"2024-09-15T22:15:17.218163+0000","last_undegraded":"2024-09-15T22:15:17.218163+0000","last_fullsized":"2024-09-15T22:15:17.218163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:39.860926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116479+0000","last_change":"2024-09-15T22:14:14.280656+0000","last_active":"2024-09-15T22:15:17.116479+0000","last_peered":"2024-09-15T22:15:17.116479+0000","last_clean":"2024-09-15T22:15:17.116479+0000","last_became_active":"2024-09-15T22:14:14.280230+0000","last_became_peered":"2024-09-15T22:14:14.280230+0000","last_unstale":"2024-09-15T22:15:17.116479+0000","last_undegraded":"2024-09-15T22:15:17.116479+0000","last_fullsized":"2024-09-15T22:15:17.116479+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:47.531799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115951+0000","last_change":"2024-09-15T22:14:06.805575+0000","last_active":"2024-09-15T22:15:17.115951+0000","last_peered":"2024-09-15T22:15:17.115951+0000","last_clean":"2024-09-15T22:15:17.115951+0000","last_became_active":"2024-09-15T22:14:06.804515+0000","last_became_peered":"2024-09-15T22:14:06.804515+0000","last_unstale":"2024-09-15T22:15:17.115951+0000","last_undegraded":"2024-09-15T22:15:17.115951+0000","last_fullsized":"2024-09-15T22:15:17.115951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.560964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114246+0000","last_change":"2024-09-15T22:14:04.717221+0000","last_active":"2024-09-15T22:15:17.114246+0000","last_peered":"2024-09-15T22:15:17.114246+0000","last_clean":"2024-09-15T22:15:17.114246+0000","last_became_active":"2024-09-15T22:14:04.716845+0000","last_became_peered":"2024-09-15T22:14:04.716845+0000","last_unstale":"2024-09-15T22:15:17.114246+0000","last_undegraded":"2024-09-15T22:15:17.114246+0000","last_fullsized":"2024-09-15T22:15:17.114246+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.073229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116034+0000","last_change":"2024-09-15T22:14:13.847822+0000","last_active":"2024-09-15T22:15:17.116034+0000","last_peered":"2024-09-15T22:15:17.116034+0000","last_clean":"2024-09-15T22:15:17.116034+0000","last_became_active":"2024-09-15T22:14:13.847332+0000","last_became_peered":"2024-09-15T22:14:13.847332+0000","last_unstale":"2024-09-15T22:15:17.116034+0000","last_undegraded":"2024-09-15T22:15:17.116034+0000","last_fullsized":"2024-09-15T22:15:17.116034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:18.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117538+0000","last_change":"2024-09-15T22:14:06.814033+0000","last_active":"2024-09-15T22:15:17.117538+0000","last_peered":"2024-09-15T22:15:17.117538+0000","last_clean":"2024-09-15T22:15:17.117538+0000","last_became_active":"2024-09-15T22:14:06.813458+0000","last_became_peered":"2024-09-15T22:14:06.813458+0000","last_unstale":"2024-09-15T22:15:17.117538+0000","last_undegraded":"2024-09-15T22:15:17.117538+0000","last_fullsized":"2024-09-15T22:15:17.117538+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:16.484113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116472+0000","last_change":"2024-09-15T22:14:04.715797+0000","last_active":"2024-09-15T22:15:17.116472+0000","last_peered":"2024-09-15T22:15:17.116472+0000","last_clean":"2024-09-15T22:15:17.116472+0000","last_became_active":"2024-09-15T22:14:04.715478+0000","last_became_peered":"2024-09-15T22:14:04.715478+0000","last_unstale":"2024-09-15T22:15:17.116472+0000","last_undegraded":"2024-09-15T22:15:17.116472+0000","last_fullsized":"2024-09-15T22:15:17.116472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:39.432873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113941+0000","last_change":"2024-09-15T22:14:13.853461+0000","last_active":"2024-09-15T22:15:17.113941+0000","last_peered":"2024-09-15T22:15:17.113941+0000","last_clean":"2024-09-15T22:15:17.113941+0000","last_became_active":"2024-09-15T22:14:13.852896+0000","last_became_peered":"2024-09-15T22:14:13.852896+0000","last_unstale":"2024-09-15T22:15:17.113941+0000","last_undegraded":"2024-09-15T22:15:17.113941+0000","last_fullsized":"2024-09-15T22:15:17.113941+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:41.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218177+0000","last_change":"2024-09-15T22:14:06.814990+0000","last_active":"2024-09-15T22:15:17.218177+0000","last_peered":"2024-09-15T22:15:17.218177+0000","last_clean":"2024-09-15T22:15:17.218177+0000","last_became_active":"2024-09-15T22:14:06.814646+0000","last_became_peered":"2024-09-15T22:14:06.814646+0000","last_unstale":"2024-09-15T22:15:17.218177+0000","last_undegraded":"2024-09-15T22:15:17.218177+0000","last_fullsized":"2024-09-15T22:15:17.218177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:04.717207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.210923+0000","last_change":"2024-09-15T22:14:05.017599+0000","last_active":"2024-09-15T22:15:17.210923+0000","last_peered":"2024-09-15T22:15:17.210923+0000","last_clean":"2024-09-15T22:15:17.210923+0000","last_became_active":"2024-09-15T22:14:05.017296+0000","last_became_peered":"2024-09-15T22:14:05.017296+0000","last_unstale":"2024-09-15T22:15:17.210923+0000","last_undegraded":"2024-09-15T22:15:17.210923+0000","last_fullsized":"2024-09-15T22:15:17.210923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:11.427372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116307+0000","last_change":"2024-09-15T22:14:14.281453+0000","last_active":"2024-09-15T22:15:17.116307+0000","last_peered":"2024-09-15T22:15:17.116307+0000","last_clean":"2024-09-15T22:15:17.116307+0000","last_became_active":"2024-09-15T22:14:14.280814+0000","last_became_peered":"2024-09-15T22:14:14.280814+0000","last_unstale":"2024-09-15T22:15:17.116307+0000","last_undegraded":"2024-09-15T22:15:17.116307+0000","last_fullsized":"2024-09-15T22:15:17.116307+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:43:40.890979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401923+0000","last_change":"2024-09-15T22:14:06.816619+0000","last_active":"2024-09-15T22:15:17.401923+0000","last_peered":"2024-09-15T22:15:17.401923+0000","last_clean":"2024-09-15T22:15:17.401923+0000","last_became_active":"2024-09-15T22:14:06.814421+0000","last_became_peered":"2024-09-15T22:14:06.814421+0000","last_unstale":"2024-09-15T22:15:17.401923+0000","last_undegraded":"2024-09-15T22:15:17.401923+0000","last_fullsized":"2024-09-15T22:15:17.401923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:00.329802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116847+0000","last_change":"2024-09-15T22:14:05.197752+0000","last_active":"2024-09-15T22:15:17.116847+0000","last_peered":"2024-09-15T22:15:17.116847+0000","last_clean":"2024-09-15T22:15:17.116847+0000","last_became_active":"2024-09-15T22:14:05.197399+0000","last_became_peered":"2024-09-15T22:14:05.197399+0000","last_unstale":"2024-09-15T22:15:17.116847+0000","last_undegraded":"2024-09-15T22:15:17.116847+0000","last_fullsized":"2024-09-15T22:15:17.116847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:19.781842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115050+0000","last_change":"2024-09-15T22:14:13.847474+0000","last_active":"2024-09-15T22:15:17.115050+0000","last_peered":"2024-09-15T22:15:17.115050+0000","last_clean":"2024-09-15T22:15:17.115050+0000","last_became_active":"2024-09-15T22:14:13.847032+0000","last_became_peered":"2024-09-15T22:14:13.847032+0000","last_unstale":"2024-09-15T22:15:17.115050+0000","last_undegraded":"2024-09-15T22:15:17.115050+0000","last_fullsized":"2024-09-15T22:15:17.115050+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:21.049024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116505+0000","last_change":"2024-09-15T22:14:06.809104+0000","last_active":"2024-09-15T22:15:17.116505+0000","last_peered":"2024-09-15T22:15:17.116505+0000","last_clean":"2024-09-15T22:15:17.116505+0000","last_became_active":"2024-09-15T22:14:06.808735+0000","last_became_peered":"2024-09-15T22:14:06.808735+0000","last_unstale":"2024-09-15T22:15:17.116505+0000","last_undegraded":"2024-09-15T22:15:17.116505+0000","last_fullsized":"2024-09-15T22:15:17.116505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:46.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113915+0000","last_change":"2024-09-15T22:14:04.712546+0000","last_active":"2024-09-15T22:15:17.113915+0000","last_peered":"2024-09-15T22:15:17.113915+0000","last_clean":"2024-09-15T22:15:17.113915+0000","last_became_active":"2024-09-15T22:14:04.712222+0000","last_became_peered":"2024-09-15T22:14:04.712222+0000","last_unstale":"2024-09-15T22:15:17.113915+0000","last_undegraded":"2024-09-15T22:15:17.113915+0000","last_fullsized":"2024-09-15T22:15:17.113915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:00.993810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115640+0000","last_change":"2024-09-15T22:14:14.280905+0000","last_active":"2024-09-15T22:15:17.115640+0000","last_peered":"2024-09-15T22:15:17.115640+0000","last_clean":"2024-09-15T22:15:17.115640+0000","last_became_active":"2024-09-15T22:14:14.280368+0000","last_became_peered":"2024-09-15T22:14:14.280368+0000","last_unstale":"2024-09-15T22:15:17.115640+0000","last_undegraded":"2024-09-15T22:15:17.115640+0000","last_fullsized":"2024-09-15T22:15:17.115640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:52.812589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402324+0000","last_change":"2024-09-15T22:14:06.816231+0000","last_active":"2024-09-15T22:15:17.402324+0000","last_peered":"2024-09-15T22:15:17.402324+0000","last_clean":"2024-09-15T22:15:17.402324+0000","last_became_active":"2024-09-15T22:14:06.815884+0000","last_became_peered":"2024-09-15T22:14:06.815884+0000","last_unstale":"2024-09-15T22:15:17.402324+0000","last_undegraded":"2024-09-15T22:15:17.402324+0000","last_fullsized":"2024-09-15T22:15:17.402324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:30.076077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218954+0000","last_change":"2024-09-15T22:14:05.017745+0000","last_active":"2024-09-15T22:15:17.218954+0000","last_peered":"2024-09-15T22:15:17.218954+0000","last_clean":"2024-09-15T22:15:17.218954+0000","last_became_active":"2024-09-15T22:14:05.017064+0000","last_became_peered":"2024-09-15T22:14:05.017064+0000","last_unstale":"2024-09-15T22:15:17.218954+0000","last_undegraded":"2024-09-15T22:15:17.218954+0000","last_fullsized":"2024-09-15T22:15:17.218954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:44.038448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117610+0000","last_change":"2024-09-15T22:14:13.853195+0000","last_active":"2024-09-15T22:15:17.117610+0000","last_peered":"2024-09-15T22:15:17.117610+0000","last_clean":"2024-09-15T22:15:17.117610+0000","last_became_active":"2024-09-15T22:14:13.852803+0000","last_became_peered":"2024-09-15T22:14:13.852803+0000","last_unstale":"2024-09-15T22:15:17.117610+0000","last_undegraded":"2024-09-15T22:15:17.117610+0000","last_fullsized":"2024-09-15T22:15:17.117610+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:20.737509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.330657+0000","last_change":"2024-09-15T22:14:06.805448+0000","last_active":"2024-09-15T22:15:17.330657+0000","last_peered":"2024-09-15T22:15:17.330657+0000","last_clean":"2024-09-15T22:15:17.330657+0000","last_became_active":"2024-09-15T22:14:06.804965+0000","last_became_peered":"2024-09-15T22:14:06.804965+0000","last_unstale":"2024-09-15T22:15:17.330657+0000","last_undegraded":"2024-09-15T22:15:17.330657+0000","last_fullsized":"2024-09-15T22:15:17.330657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:29.831888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113846+0000","last_change":"2024-09-15T22:14:05.017438+0000","last_active":"2024-09-15T22:15:17.113846+0000","last_peered":"2024-09-15T22:15:17.113846+0000","last_clean":"2024-09-15T22:15:17.113846+0000","last_became_active":"2024-09-15T22:14:05.017050+0000","last_became_peered":"2024-09-15T22:14:05.017050+0000","last_unstale":"2024-09-15T22:15:17.113846+0000","last_undegraded":"2024-09-15T22:15:17.113846+0000","last_fullsized":"2024-09-15T22:15:17.113846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:35.608774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218072+0000","last_change":"2024-09-15T22:14:14.281096+0000","last_active":"2024-09-15T22:15:17.218072+0000","last_peered":"2024-09-15T22:15:17.218072+0000","last_clean":"2024-09-15T22:15:17.218072+0000","last_became_active":"2024-09-15T22:14:14.280381+0000","last_became_peered":"2024-09-15T22:14:14.280381+0000","last_unstale":"2024-09-15T22:15:17.218072+0000","last_undegraded":"2024-09-15T22:15:17.218072+0000","last_fullsized":"2024-09-15T22:15:17.218072+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:44.686080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.330694+0000","last_change":"2024-09-15T22:14:06.812046+0000","last_active":"2024-09-15T22:15:17.330694+0000","last_peered":"2024-09-15T22:15:17.330694+0000","last_clean":"2024-09-15T22:15:17.330694+0000","last_became_active":"2024-09-15T22:14:06.811721+0000","last_became_peered":"2024-09-15T22:14:06.811721+0000","last_unstale":"2024-09-15T22:15:17.330694+0000","last_undegraded":"2024-09-15T22:15:17.330694+0000","last_fullsized":"2024-09-15T22:15:17.330694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:13.244973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114559+0000","last_change":"2024-09-15T22:14:04.720940+0000","last_active":"2024-09-15T22:15:17.114559+0000","last_peered":"2024-09-15T22:15:17.114559+0000","last_clean":"2024-09-15T22:15:17.114559+0000","last_became_active":"2024-09-15T22:14:04.720624+0000","last_became_peered":"2024-09-15T22:14:04.720624+0000","last_unstale":"2024-09-15T22:15:17.114559+0000","last_undegraded":"2024-09-15T22:15:17.114559+0000","last_fullsized":"2024-09-15T22:15:17.114559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:29.823784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402410+0000","last_change":"2024-09-15T22:14:13.848882+0000","last_active":"2024-09-15T22:15:17.402410+0000","last_peered":"2024-09-15T22:15:17.402410+0000","last_clean":"2024-09-15T22:15:17.402410+0000","last_became_active":"2024-09-15T22:14:13.848512+0000","last_became_peered":"2024-09-15T22:14:13.848512+0000","last_unstale":"2024-09-15T22:15:17.402410+0000","last_undegraded":"2024-09-15T22:15:17.402410+0000","last_fullsized":"2024-09-15T22:15:17.402410+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:44.050344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117675+0000","last_change":"2024-09-15T22:14:06.813915+0000","last_active":"2024-09-15T22:15:17.117675+0000","last_peered":"2024-09-15T22:15:17.117675+0000","last_clean":"2024-09-15T22:15:17.117675+0000","last_became_active":"2024-09-15T22:14:06.811803+0000","last_became_peered":"2024-09-15T22:14:06.811803+0000","last_unstale":"2024-09-15T22:15:17.117675+0000","last_undegraded":"2024-09-15T22:15:17.117675+0000","last_fullsized":"2024-09-15T22:15:17.117675+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:42.117747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401966+0000","last_change":"2024-09-15T22:14:05.017360+0000","last_active":"2024-09-15T22:15:17.401966+0000","last_peered":"2024-09-15T22:15:17.401966+0000","last_clean":"2024-09-15T22:15:17.401966+0000","last_became_active":"2024-09-15T22:14:05.017004+0000","last_became_peered":"2024-09-15T22:14:05.017004+0000","last_unstale":"2024-09-15T22:15:17.401966+0000","last_undegraded":"2024-09-15T22:15:17.401966+0000","last_fullsized":"2024-09-15T22:15:17.401966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:01.366513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402590+0000","last_change":"2024-09-15T22:14:14.280215+0000","last_active":"2024-09-15T22:15:17.402590+0000","last_peered":"2024-09-15T22:15:17.402590+0000","last_clean":"2024-09-15T22:15:17.402590+0000","last_became_active":"2024-09-15T22:14:14.279750+0000","last_became_peered":"2024-09-15T22:14:14.279750+0000","last_unstale":"2024-09-15T22:15:17.402590+0000","last_undegraded":"2024-09-15T22:15:17.402590+0000","last_fullsized":"2024-09-15T22:15:17.402590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:58.827582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401779+0000","last_change":"2024-09-15T22:14:06.812410+0000","last_active":"2024-09-15T22:15:17.401779+0000","last_peered":"2024-09-15T22:15:17.401779+0000","last_clean":"2024-09-15T22:15:17.401779+0000","last_became_active":"2024-09-15T22:14:06.812032+0000","last_became_peered":"2024-09-15T22:14:06.812032+0000","last_unstale":"2024-09-15T22:15:17.401779+0000","last_undegraded":"2024-09-15T22:15:17.401779+0000","last_fullsized":"2024-09-15T22:15:17.401779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:48.100213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114334+0000","last_change":"2024-09-15T22:14:04.719678+0000","last_active":"2024-09-15T22:15:17.114334+0000","last_peered":"2024-09-15T22:15:17.114334+0000","last_clean":"2024-09-15T22:15:17.114334+0000","last_became_active":"2024-09-15T22:14:04.719352+0000","last_became_peered":"2024-09-15T22:14:04.719352+0000","last_unstale":"2024-09-15T22:15:17.114334+0000","last_undegraded":"2024-09-15T22:15:17.114334+0000","last_fullsized":"2024-09-15T22:15:17.114334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.061957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118172+0000","last_change":"2024-09-15T22:14:14.281314+0000","last_active":"2024-09-15T22:15:17.118172+0000","last_peered":"2024-09-15T22:15:17.118172+0000","last_clean":"2024-09-15T22:15:17.118172+0000","last_became_active":"2024-09-15T22:14:14.280859+0000","last_became_peered":"2024-09-15T22:14:14.280859+0000","last_unstale":"2024-09-15T22:15:17.118172+0000","last_undegraded":"2024-09-15T22:15:17.118172+0000","last_fullsized":"2024-09-15T22:15:17.118172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:18.796767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.212177+0000","last_change":"2024-09-15T22:15:17.211828+0000","last_active":"2024-09-15T22:15:17.212177+0000","last_peered":"2024-09-15T22:15:17.212177+0000","last_clean":"2024-09-15T22:15:17.212177+0000","last_became_active":"2024-09-15T22:15:17.211560+0000","last_became_peered":"2024-09-15T22:15:17.211560+0000","last_unstale":"2024-09-15T22:15:17.212177+0000","last_undegraded":"2024-09-15T22:15:17.212177+0000","last_fullsized":"2024-09-15T22:15:17.212177+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:59.944869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116954+0000","last_change":"2024-09-15T22:14:04.718038+0000","last_active":"2024-09-15T22:15:17.116954+0000","last_peered":"2024-09-15T22:15:17.116954+0000","last_clean":"2024-09-15T22:15:17.116954+0000","last_became_active":"2024-09-15T22:14:04.717683+0000","last_became_peered":"2024-09-15T22:14:04.717683+0000","last_unstale":"2024-09-15T22:15:17.116954+0000","last_undegraded":"2024-09-15T22:15:17.116954+0000","last_fullsized":"2024-09-15T22:15:17.116954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:23.557077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":357,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114527+0000","last_change":"2024-09-15T22:12:55.022635+0000","last_active":"2024-09-15T22:15:17.114527+0000","last_peered":"2024-09-15T22:15:17.114527+0000","last_clean":"2024-09-15T22:15:17.114527+0000","last_became_active":"2024-09-15T22:12:55.022132+0000","last_became_peered":"2024-09-15T22:12:55.022132+0000","last_unstale":"2024-09-15T22:15:17.114527+0000","last_undegraded":"2024-09-15T22:15:17.114527+0000","last_fullsized":"2024-09-15T22:15:17.114527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_clean_scrub_stamp":"2024-09-15T22:09:30.115505+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:50.060169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115245+0000","last_change":"2024-09-15T22:14:13.849547+0000","last_active":"2024-09-15T22:15:17.115245+0000","last_peered":"2024-09-15T22:15:17.115245+0000","last_clean":"2024-09-15T22:15:17.115245+0000","last_became_active":"2024-09-15T22:14:13.849091+0000","last_became_peered":"2024-09-15T22:14:13.849091+0000","last_unstale":"2024-09-15T22:15:17.115245+0000","last_undegraded":"2024-09-15T22:15:17.115245+0000","last_fullsized":"2024-09-15T22:15:17.115245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:49.450958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115014+0000","last_change":"2024-09-15T22:14:06.816340+0000","last_active":"2024-09-15T22:15:17.115014+0000","last_peered":"2024-09-15T22:15:17.115014+0000","last_clean":"2024-09-15T22:15:17.115014+0000","last_became_active":"2024-09-15T22:14:06.815712+0000","last_became_peered":"2024-09-15T22:14:06.815712+0000","last_unstale":"2024-09-15T22:15:17.115014+0000","last_undegraded":"2024-09-15T22:15:17.115014+0000","last_fullsized":"2024-09-15T22:15:17.115014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:43.598512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114651+0000","last_change":"2024-09-15T22:14:05.197487+0000","last_active":"2024-09-15T22:15:17.114651+0000","last_peered":"2024-09-15T22:15:17.114651+0000","last_clean":"2024-09-15T22:15:17.114651+0000","last_became_active":"2024-09-15T22:14:05.197098+0000","last_became_peered":"2024-09-15T22:14:05.197098+0000","last_unstale":"2024-09-15T22:15:17.114651+0000","last_undegraded":"2024-09-15T22:15:17.114651+0000","last_fullsized":"2024-09-15T22:15:17.114651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:31.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.211049+0000","last_change":"2024-09-15T22:14:13.849594+0000","last_active":"2024-09-15T22:15:17.211049+0000","last_peered":"2024-09-15T22:15:17.211049+0000","last_clean":"2024-09-15T22:15:17.211049+0000","last_became_active":"2024-09-15T22:14:13.849157+0000","last_became_peered":"2024-09-15T22:14:13.849157+0000","last_unstale":"2024-09-15T22:15:17.211049+0000","last_undegraded":"2024-09-15T22:15:17.211049+0000","last_fullsized":"2024-09-15T22:15:17.211049+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:49.994107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114822+0000","last_change":"2024-09-15T22:14:06.814312+0000","last_active":"2024-09-15T22:15:17.114822+0000","last_peered":"2024-09-15T22:15:17.114822+0000","last_clean":"2024-09-15T22:15:17.114822+0000","last_became_active":"2024-09-15T22:14:06.813959+0000","last_became_peered":"2024-09-15T22:14:06.813959+0000","last_unstale":"2024-09-15T22:15:17.114822+0000","last_undegraded":"2024-09-15T22:15:17.114822+0000","last_fullsized":"2024-09-15T22:15:17.114822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:36.924162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118837+0000","last_change":"2024-09-15T22:14:04.713307+0000","last_active":"2024-09-15T22:15:17.118837+0000","last_peered":"2024-09-15T22:15:17.118837+0000","last_clean":"2024-09-15T22:15:17.118837+0000","last_became_active":"2024-09-15T22:14:04.712996+0000","last_became_peered":"2024-09-15T22:14:04.712996+0000","last_unstale":"2024-09-15T22:15:17.118837+0000","last_undegraded":"2024-09-15T22:15:17.118837+0000","last_fullsized":"2024-09-15T22:15:17.118837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:37.298679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401687+0000","last_change":"2024-09-15T22:14:13.846087+0000","last_active":"2024-09-15T22:15:17.401687+0000","last_peered":"2024-09-15T22:15:17.401687+0000","last_clean":"2024-09-15T22:15:17.401687+0000","last_became_active":"2024-09-15T22:14:13.845731+0000","last_became_peered":"2024-09-15T22:14:13.845731+0000","last_unstale":"2024-09-15T22:15:17.401687+0000","last_undegraded":"2024-09-15T22:15:17.401687+0000","last_fullsized":"2024-09-15T22:15:17.401687+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:24.621330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115124+0000","last_change":"2024-09-15T22:14:06.809456+0000","last_active":"2024-09-15T22:15:17.115124+0000","last_peered":"2024-09-15T22:15:17.115124+0000","last_clean":"2024-09-15T22:15:17.115124+0000","last_became_active":"2024-09-15T22:14:06.809141+0000","last_became_peered":"2024-09-15T22:14:06.809141+0000","last_unstale":"2024-09-15T22:15:17.115124+0000","last_undegraded":"2024-09-15T22:15:17.115124+0000","last_fullsized":"2024-09-15T22:15:17.115124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:30.186800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402504+0000","last_change":"2024-09-15T22:14:04.715399+0000","last_active":"2024-09-15T22:15:17.402504+0000","last_peered":"2024-09-15T22:15:17.402504+0000","last_clean":"2024-09-15T22:15:17.402504+0000","last_became_active":"2024-09-15T22:14:04.715043+0000","last_became_peered":"2024-09-15T22:14:04.715043+0000","last_unstale":"2024-09-15T22:15:17.402504+0000","last_undegraded":"2024-09-15T22:15:17.402504+0000","last_fullsized":"2024-09-15T22:15:17.402504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:13.860413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117046+0000","last_change":"2024-09-15T22:14:13.851594+0000","last_active":"2024-09-15T22:15:17.117046+0000","last_peered":"2024-09-15T22:15:17.117046+0000","last_clean":"2024-09-15T22:15:17.117046+0000","last_became_active":"2024-09-15T22:14:13.851154+0000","last_became_peered":"2024-09-15T22:14:13.851154+0000","last_unstale":"2024-09-15T22:15:17.117046+0000","last_undegraded":"2024-09-15T22:15:17.117046+0000","last_fullsized":"2024-09-15T22:15:17.117046+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:43.343808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.219587+0000","last_change":"2024-09-15T22:15:17.219587+0000","last_active":"2024-09-15T22:15:17.219587+0000","last_peered":"2024-09-15T22:15:17.219587+0000","last_clean":"2024-09-15T22:15:17.219587+0000","last_became_active":"2024-09-15T22:15:17.219207+0000","last_became_peered":"2024-09-15T22:15:17.219207+0000","last_unstale":"2024-09-15T22:15:17.219587+0000","last_undegraded":"2024-09-15T22:15:17.219587+0000","last_fullsized":"2024-09-15T22:15:17.219587+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:34.267857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.219199+0000","last_change":"2024-09-15T22:14:04.719550+0000","last_active":"2024-09-15T22:15:17.219199+0000","last_peered":"2024-09-15T22:15:17.219199+0000","last_clean":"2024-09-15T22:15:17.219199+0000","last_became_active":"2024-09-15T22:14:04.719273+0000","last_became_peered":"2024-09-15T22:14:04.719273+0000","last_unstale":"2024-09-15T22:15:17.219199+0000","last_undegraded":"2024-09-15T22:15:17.219199+0000","last_fullsized":"2024-09-15T22:15:17.219199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:20.973615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117689+0000","last_change":"2024-09-15T22:14:13.851420+0000","last_active":"2024-09-15T22:15:17.117689+0000","last_peered":"2024-09-15T22:15:17.117689+0000","last_clean":"2024-09-15T22:15:17.117689+0000","last_became_active":"2024-09-15T22:14:13.851051+0000","last_became_peered":"2024-09-15T22:14:13.851051+0000","last_unstale":"2024-09-15T22:15:17.117689+0000","last_undegraded":"2024-09-15T22:15:17.117689+0000","last_fullsized":"2024-09-15T22:15:17.117689+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:11.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117835+0000","last_change":"2024-09-15T22:14:06.809609+0000","last_active":"2024-09-15T22:15:17.117835+0000","last_peered":"2024-09-15T22:15:17.117835+0000","last_clean":"2024-09-15T22:15:17.117835+0000","last_became_active":"2024-09-15T22:14:06.809213+0000","last_became_peered":"2024-09-15T22:14:06.809213+0000","last_unstale":"2024-09-15T22:15:17.117835+0000","last_undegraded":"2024-09-15T22:15:17.117835+0000","last_fullsized":"2024-09-15T22:15:17.117835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:11.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218201+0000","last_change":"2024-09-15T22:14:05.017559+0000","last_active":"2024-09-15T22:15:17.218201+0000","last_peered":"2024-09-15T22:15:17.218201+0000","last_clean":"2024-09-15T22:15:17.218201+0000","last_became_active":"2024-09-15T22:14:05.017121+0000","last_became_peered":"2024-09-15T22:14:05.017121+0000","last_unstale":"2024-09-15T22:15:17.218201+0000","last_undegraded":"2024-09-15T22:15:17.218201+0000","last_fullsized":"2024-09-15T22:15:17.218201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:29:06.442532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402444+0000","last_change":"2024-09-15T22:14:13.847835+0000","last_active":"2024-09-15T22:15:17.402444+0000","last_peered":"2024-09-15T22:15:17.402444+0000","last_clean":"2024-09-15T22:15:17.402444+0000","last_became_active":"2024-09-15T22:14:13.847437+0000","last_became_peered":"2024-09-15T22:14:13.847437+0000","last_unstale":"2024-09-15T22:15:17.402444+0000","last_undegraded":"2024-09-15T22:15:17.402444+0000","last_fullsized":"2024-09-15T22:15:17.402444+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:48.036495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114169+0000","last_change":"2024-09-15T22:14:06.813191+0000","last_active":"2024-09-15T22:15:17.114169+0000","last_peered":"2024-09-15T22:15:17.114169+0000","last_clean":"2024-09-15T22:15:17.114169+0000","last_became_active":"2024-09-15T22:14:06.812861+0000","last_became_peered":"2024-09-15T22:14:06.812861+0000","last_unstale":"2024-09-15T22:15:17.114169+0000","last_undegraded":"2024-09-15T22:15:17.114169+0000","last_fullsized":"2024-09-15T22:15:17.114169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:51.487591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115991+0000","last_change":"2024-09-15T22:14:04.718431+0000","last_active":"2024-09-15T22:15:17.115991+0000","last_peered":"2024-09-15T22:15:17.115991+0000","last_clean":"2024-09-15T22:15:17.115991+0000","last_became_active":"2024-09-15T22:14:04.718109+0000","last_became_peered":"2024-09-15T22:14:04.718109+0000","last_unstale":"2024-09-15T22:15:17.115991+0000","last_undegraded":"2024-09-15T22:15:17.115991+0000","last_fullsized":"2024-09-15T22:15:17.115991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:10.408634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114008+0000","last_change":"2024-09-15T22:14:13.845179+0000","last_active":"2024-09-15T22:15:17.114008+0000","last_peered":"2024-09-15T22:15:17.114008+0000","last_clean":"2024-09-15T22:15:17.114008+0000","last_became_active":"2024-09-15T22:14:13.844795+0000","last_became_peered":"2024-09-15T22:14:13.844795+0000","last_unstale":"2024-09-15T22:15:17.114008+0000","last_undegraded":"2024-09-15T22:15:17.114008+0000","last_fullsized":"2024-09-15T22:15:17.114008+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:24.113536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114356+0000","last_change":"2024-09-15T22:14:06.809687+0000","last_active":"2024-09-15T22:15:17.114356+0000","last_peered":"2024-09-15T22:15:17.114356+0000","last_clean":"2024-09-15T22:15:17.114356+0000","last_became_active":"2024-09-15T22:14:06.809383+0000","last_became_peered":"2024-09-15T22:14:06.809383+0000","last_unstale":"2024-09-15T22:15:17.114356+0000","last_undegraded":"2024-09-15T22:15:17.114356+0000","last_fullsized":"2024-09-15T22:15:17.114356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:19.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.119105+0000","last_change":"2024-09-15T22:14:04.720577+0000","last_active":"2024-09-15T22:15:17.119105+0000","last_peered":"2024-09-15T22:15:17.119105+0000","last_clean":"2024-09-15T22:15:17.119105+0000","last_became_active":"2024-09-15T22:14:04.720235+0000","last_became_peered":"2024-09-15T22:14:04.720235+0000","last_unstale":"2024-09-15T22:15:17.119105+0000","last_undegraded":"2024-09-15T22:15:17.119105+0000","last_fullsized":"2024-09-15T22:15:17.119105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:17.501061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117753+0000","last_change":"2024-09-15T22:14:13.854841+0000","last_active":"2024-09-15T22:15:17.117753+0000","last_peered":"2024-09-15T22:15:17.117753+0000","last_clean":"2024-09-15T22:15:17.117753+0000","last_became_active":"2024-09-15T22:14:13.854336+0000","last_became_peered":"2024-09-15T22:14:13.854336+0000","last_unstale":"2024-09-15T22:15:17.117753+0000","last_undegraded":"2024-09-15T22:15:17.117753+0000","last_fullsized":"2024-09-15T22:15:17.117753+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:13.819532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402349+0000","last_change":"2024-09-15T22:14:06.806829+0000","last_active":"2024-09-15T22:15:17.402349+0000","last_peered":"2024-09-15T22:15:17.402349+0000","last_clean":"2024-09-15T22:15:17.402349+0000","last_became_active":"2024-09-15T22:14:06.806521+0000","last_became_peered":"2024-09-15T22:14:06.806521+0000","last_unstale":"2024-09-15T22:15:17.402349+0000","last_undegraded":"2024-09-15T22:15:17.402349+0000","last_fullsized":"2024-09-15T22:15:17.402349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:50.983246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114670+0000","last_change":"2024-09-15T22:14:04.717722+0000","last_active":"2024-09-15T22:15:17.114670+0000","last_peered":"2024-09-15T22:15:17.114670+0000","last_clean":"2024-09-15T22:15:17.114670+0000","last_became_active":"2024-09-15T22:14:04.717201+0000","last_became_peered":"2024-09-15T22:14:04.717201+0000","last_unstale":"2024-09-15T22:15:17.114670+0000","last_undegraded":"2024-09-15T22:15:17.114670+0000","last_fullsized":"2024-09-15T22:15:17.114670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:50.545847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118218+0000","last_change":"2024-09-15T22:14:13.852874+0000","last_active":"2024-09-15T22:15:17.118218+0000","last_peered":"2024-09-15T22:15:17.118218+0000","last_clean":"2024-09-15T22:15:17.118218+0000","last_became_active":"2024-09-15T22:14:13.852426+0000","last_became_peered":"2024-09-15T22:14:13.852426+0000","last_unstale":"2024-09-15T22:15:17.118218+0000","last_undegraded":"2024-09-15T22:15:17.118218+0000","last_fullsized":"2024-09-15T22:15:17.118218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:02:19.215156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218763+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:15:17.218763+0000","last_peered":"2024-09-15T22:15:17.218763+0000","last_clean":"2024-09-15T22:15:17.218763+0000","last_became_active":"2024-09-15T22:14:06.809013+0000","last_became_peered":"2024-09-15T22:14:06.809013+0000","last_unstale":"2024-09-15T22:15:17.218763+0000","last_undegraded":"2024-09-15T22:15:17.218763+0000","last_fullsized":"2024-09-15T22:15:17.218763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:47.830385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'32","reported_seq":178,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:35.019936+0000","last_change":"2024-09-15T22:14:04.721020+0000","last_active":"2024-09-15T22:15:35.019936+0000","last_peered":"2024-09-15T22:15:35.019936+0000","last_clean":"2024-09-15T22:15:35.019936+0000","last_became_active":"2024-09-15T22:14:04.720613+0000","last_became_peered":"2024-09-15T22:14:04.720613+0000","last_unstale":"2024-09-15T22:15:35.019936+0000","last_undegraded":"2024-09-15T22:15:35.019936+0000","last_fullsized":"2024-09-15T22:15:35.019936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:42.719346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65131,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":120,"num_write":32,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113593+0000","last_change":"2024-09-15T22:14:13.854250+0000","last_active":"2024-09-15T22:15:17.113593+0000","last_peered":"2024-09-15T22:15:17.113593+0000","last_clean":"2024-09-15T22:15:17.113593+0000","last_became_active":"2024-09-15T22:14:13.852972+0000","last_became_peered":"2024-09-15T22:14:13.852972+0000","last_unstale":"2024-09-15T22:15:17.113593+0000","last_undegraded":"2024-09-15T22:15:17.113593+0000","last_fullsized":"2024-09-15T22:15:17.113593+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:50:45.301446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.211076+0000","last_change":"2024-09-15T22:14:06.813789+0000","last_active":"2024-09-15T22:15:17.211076+0000","last_peered":"2024-09-15T22:15:17.211076+0000","last_clean":"2024-09-15T22:15:17.211076+0000","last_became_active":"2024-09-15T22:14:06.813501+0000","last_became_peered":"2024-09-15T22:14:06.813501+0000","last_unstale":"2024-09-15T22:15:17.211076+0000","last_undegraded":"2024-09-15T22:15:17.211076+0000","last_fullsized":"2024-09-15T22:15:17.211076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:40.032952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118679+0000","last_change":"2024-09-15T22:14:05.018957+0000","last_active":"2024-09-15T22:15:17.118679+0000","last_peered":"2024-09-15T22:15:17.118679+0000","last_clean":"2024-09-15T22:15:17.118679+0000","last_became_active":"2024-09-15T22:14:05.018602+0000","last_became_peered":"2024-09-15T22:14:05.018602+0000","last_unstale":"2024-09-15T22:15:17.118679+0000","last_undegraded":"2024-09-15T22:15:17.118679+0000","last_fullsized":"2024-09-15T22:15:17.118679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:48.839341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.332417+0000","last_change":"2024-09-15T22:15:17.332417+0000","last_active":"2024-09-15T22:15:17.332417+0000","last_peered":"2024-09-15T22:15:17.332417+0000","last_clean":"2024-09-15T22:15:17.332417+0000","last_became_active":"2024-09-15T22:15:17.331771+0000","last_became_peered":"2024-09-15T22:15:17.331771+0000","last_unstale":"2024-09-15T22:15:17.332417+0000","last_undegraded":"2024-09-15T22:15:17.332417+0000","last_fullsized":"2024-09-15T22:15:17.332417+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:08.575035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402622+0000","last_change":"2024-09-15T22:14:06.814876+0000","last_active":"2024-09-15T22:15:17.402622+0000","last_peered":"2024-09-15T22:15:17.402622+0000","last_clean":"2024-09-15T22:15:17.402622+0000","last_became_active":"2024-09-15T22:14:06.814120+0000","last_became_peered":"2024-09-15T22:14:06.814120+0000","last_unstale":"2024-09-15T22:15:17.402622+0000","last_undegraded":"2024-09-15T22:15:17.402622+0000","last_fullsized":"2024-09-15T22:15:17.402622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:37.417618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114938+0000","last_change":"2024-09-15T22:14:04.719281+0000","last_active":"2024-09-15T22:15:17.114938+0000","last_peered":"2024-09-15T22:15:17.114938+0000","last_clean":"2024-09-15T22:15:17.114938+0000","last_became_active":"2024-09-15T22:14:04.718856+0000","last_became_peered":"2024-09-15T22:14:04.718856+0000","last_unstale":"2024-09-15T22:15:17.114938+0000","last_undegraded":"2024-09-15T22:15:17.114938+0000","last_fullsized":"2024-09-15T22:15:17.114938+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:22.137825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113159+0000","last_change":"2024-09-15T22:14:13.847398+0000","last_active":"2024-09-15T22:15:17.113159+0000","last_peered":"2024-09-15T22:15:17.113159+0000","last_clean":"2024-09-15T22:15:17.113159+0000","last_became_active":"2024-09-15T22:14:13.846870+0000","last_became_peered":"2024-09-15T22:14:13.846870+0000","last_unstale":"2024-09-15T22:15:17.113159+0000","last_undegraded":"2024-09-15T22:15:17.113159+0000","last_fullsized":"2024-09-15T22:15:17.113159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:58.872716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.211648+0000","last_change":"2024-09-15T22:14:06.810412+0000","last_active":"2024-09-15T22:15:17.211648+0000","last_peered":"2024-09-15T22:15:17.211648+0000","last_clean":"2024-09-15T22:15:17.211648+0000","last_became_active":"2024-09-15T22:14:06.809669+0000","last_became_peered":"2024-09-15T22:14:06.809669+0000","last_unstale":"2024-09-15T22:15:17.211648+0000","last_undegraded":"2024-09-15T22:15:17.211648+0000","last_fullsized":"2024-09-15T22:15:17.211648+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:44.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.331016+0000","last_change":"2024-09-15T22:14:04.715509+0000","last_active":"2024-09-15T22:15:17.331016+0000","last_peered":"2024-09-15T22:15:17.331016+0000","last_clean":"2024-09-15T22:15:17.331016+0000","last_became_active":"2024-09-15T22:14:04.715169+0000","last_became_peered":"2024-09-15T22:14:04.715169+0000","last_unstale":"2024-09-15T22:15:17.331016+0000","last_undegraded":"2024-09-15T22:15:17.331016+0000","last_fullsized":"2024-09-15T22:15:17.331016+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:21.884103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.219519+0000","last_change":"2024-09-15T22:15:17.219519+0000","last_active":"2024-09-15T22:15:17.219519+0000","last_peered":"2024-09-15T22:15:17.219519+0000","last_clean":"2024-09-15T22:15:17.219519+0000","last_became_active":"2024-09-15T22:15:17.219106+0000","last_became_peered":"2024-09-15T22:15:17.219106+0000","last_unstale":"2024-09-15T22:15:17.219519+0000","last_undegraded":"2024-09-15T22:15:17.219519+0000","last_fullsized":"2024-09-15T22:15:17.219519+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:54:08.102329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401712+0000","last_change":"2024-09-15T22:14:13.844375+0000","last_active":"2024-09-15T22:15:17.401712+0000","last_peered":"2024-09-15T22:15:17.401712+0000","last_clean":"2024-09-15T22:15:17.401712+0000","last_became_active":"2024-09-15T22:14:13.843918+0000","last_became_peered":"2024-09-15T22:14:13.843918+0000","last_unstale":"2024-09-15T22:15:17.401712+0000","last_undegraded":"2024-09-15T22:15:17.401712+0000","last_fullsized":"2024-09-15T22:15:17.401712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:32.190119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113287+0000","last_change":"2024-09-15T22:14:06.809534+0000","last_active":"2024-09-15T22:15:17.113287+0000","last_peered":"2024-09-15T22:15:17.113287+0000","last_clean":"2024-09-15T22:15:17.113287+0000","last_became_active":"2024-09-15T22:14:06.809147+0000","last_became_peered":"2024-09-15T22:14:06.809147+0000","last_unstale":"2024-09-15T22:15:17.113287+0000","last_undegraded":"2024-09-15T22:15:17.113287+0000","last_fullsized":"2024-09-15T22:15:17.113287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:14.930542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118007+0000","last_change":"2024-09-15T22:14:04.715347+0000","last_active":"2024-09-15T22:15:17.118007+0000","last_peered":"2024-09-15T22:15:17.118007+0000","last_clean":"2024-09-15T22:15:17.118007+0000","last_became_active":"2024-09-15T22:14:04.715049+0000","last_became_peered":"2024-09-15T22:14:04.715049+0000","last_unstale":"2024-09-15T22:15:17.118007+0000","last_undegraded":"2024-09-15T22:15:17.118007+0000","last_fullsized":"2024-09-15T22:15:17.118007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:04.943344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118740+0000","last_change":"2024-09-15T22:14:13.852397+0000","last_active":"2024-09-15T22:15:17.118740+0000","last_peered":"2024-09-15T22:15:17.118740+0000","last_clean":"2024-09-15T22:15:17.118740+0000","last_became_active":"2024-09-15T22:14:13.851863+0000","last_became_peered":"2024-09-15T22:14:13.851863+0000","last_unstale":"2024-09-15T22:15:17.118740+0000","last_undegraded":"2024-09-15T22:15:17.118740+0000","last_fullsized":"2024-09-15T22:15:17.118740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:38.242241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115763+0000","last_change":"2024-09-15T22:14:06.809084+0000","last_active":"2024-09-15T22:15:17.115763+0000","last_peered":"2024-09-15T22:15:17.115763+0000","last_clean":"2024-09-15T22:15:17.115763+0000","last_became_active":"2024-09-15T22:14:06.808725+0000","last_became_peered":"2024-09-15T22:14:06.808725+0000","last_unstale":"2024-09-15T22:15:17.115763+0000","last_undegraded":"2024-09-15T22:15:17.115763+0000","last_fullsized":"2024-09-15T22:15:17.115763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:37.451661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401872+0000","last_change":"2024-09-15T22:14:04.714279+0000","last_active":"2024-09-15T22:15:17.401872+0000","last_peered":"2024-09-15T22:15:17.401872+0000","last_clean":"2024-09-15T22:15:17.401872+0000","last_became_active":"2024-09-15T22:14:04.713751+0000","last_became_peered":"2024-09-15T22:14:04.713751+0000","last_unstale":"2024-09-15T22:15:17.401872+0000","last_undegraded":"2024-09-15T22:15:17.401872+0000","last_fullsized":"2024-09-15T22:15:17.401872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:34.268701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.330638+0000","last_change":"2024-09-15T22:14:04.716417+0000","last_active":"2024-09-15T22:15:17.330638+0000","last_peered":"2024-09-15T22:15:17.330638+0000","last_clean":"2024-09-15T22:15:17.330638+0000","last_became_active":"2024-09-15T22:14:04.716096+0000","last_became_peered":"2024-09-15T22:14:04.716096+0000","last_unstale":"2024-09-15T22:15:17.330638+0000","last_undegraded":"2024-09-15T22:15:17.330638+0000","last_fullsized":"2024-09-15T22:15:17.330638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:30.819060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.403940+0000","last_change":"2024-09-15T22:15:17.403940+0000","last_active":"2024-09-15T22:15:17.403940+0000","last_peered":"2024-09-15T22:15:17.403940+0000","last_clean":"2024-09-15T22:15:17.403940+0000","last_became_active":"2024-09-15T22:15:17.403517+0000","last_became_peered":"2024-09-15T22:15:17.403517+0000","last_unstale":"2024-09-15T22:15:17.403940+0000","last_undegraded":"2024-09-15T22:15:17.403940+0000","last_fullsized":"2024-09-15T22:15:17.403940+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:49.602367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.404136+0000","last_change":"2024-09-15T22:15:17.404136+0000","last_active":"2024-09-15T22:15:17.404136+0000","last_peered":"2024-09-15T22:15:17.404136+0000","last_clean":"2024-09-15T22:15:17.404136+0000","last_became_active":"2024-09-15T22:15:17.403652+0000","last_became_peered":"2024-09-15T22:15:17.403652+0000","last_unstale":"2024-09-15T22:15:17.404136+0000","last_undegraded":"2024-09-15T22:15:17.404136+0000","last_fullsized":"2024-09-15T22:15:17.404136+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:31.518956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118541+0000","last_change":"2024-09-15T22:14:04.718682+0000","last_active":"2024-09-15T22:15:17.118541+0000","last_peered":"2024-09-15T22:15:17.118541+0000","last_clean":"2024-09-15T22:15:17.118541+0000","last_became_active":"2024-09-15T22:14:04.718313+0000","last_became_peered":"2024-09-15T22:14:04.718313+0000","last_unstale":"2024-09-15T22:15:17.118541+0000","last_undegraded":"2024-09-15T22:15:17.118541+0000","last_fullsized":"2024-09-15T22:15:17.118541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:47.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218353+0000","last_change":"2024-09-15T22:14:06.819632+0000","last_active":"2024-09-15T22:15:17.218353+0000","last_peered":"2024-09-15T22:15:17.218353+0000","last_clean":"2024-09-15T22:15:17.218353+0000","last_became_active":"2024-09-15T22:14:06.819135+0000","last_became_peered":"2024-09-15T22:14:06.819135+0000","last_unstale":"2024-09-15T22:15:17.218353+0000","last_undegraded":"2024-09-15T22:15:17.218353+0000","last_fullsized":"2024-09-15T22:15:17.218353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:35.708318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114475+0000","last_change":"2024-09-15T22:14:13.851367+0000","last_active":"2024-09-15T22:15:17.114475+0000","last_peered":"2024-09-15T22:15:17.114475+0000","last_clean":"2024-09-15T22:15:17.114475+0000","last_became_active":"2024-09-15T22:14:13.850999+0000","last_became_peered":"2024-09-15T22:14:13.850999+0000","last_unstale":"2024-09-15T22:15:17.114475+0000","last_undegraded":"2024-09-15T22:15:17.114475+0000","last_fullsized":"2024-09-15T22:15:17.114475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:40:03.957622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117444+0000","last_change":"2024-09-15T22:14:06.817213+0000","last_active":"2024-09-15T22:15:17.117444+0000","last_peered":"2024-09-15T22:15:17.117444+0000","last_clean":"2024-09-15T22:15:17.117444+0000","last_became_active":"2024-09-15T22:14:06.816828+0000","last_became_peered":"2024-09-15T22:14:06.816828+0000","last_unstale":"2024-09-15T22:15:17.117444+0000","last_undegraded":"2024-09-15T22:15:17.117444+0000","last_fullsized":"2024-09-15T22:15:17.117444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:55.042256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115253+0000","last_change":"2024-09-15T22:14:06.814832+0000","last_active":"2024-09-15T22:15:17.115253+0000","last_peered":"2024-09-15T22:15:17.115253+0000","last_clean":"2024-09-15T22:15:17.115253+0000","last_became_active":"2024-09-15T22:14:06.814500+0000","last_became_peered":"2024-09-15T22:14:06.814500+0000","last_unstale":"2024-09-15T22:15:17.115253+0000","last_undegraded":"2024-09-15T22:15:17.115253+0000","last_fullsized":"2024-09-15T22:15:17.115253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:43.623629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114097+0000","last_change":"2024-09-15T22:14:06.809464+0000","last_active":"2024-09-15T22:15:17.114097+0000","last_peered":"2024-09-15T22:15:17.114097+0000","last_clean":"2024-09-15T22:15:17.114097+0000","last_became_active":"2024-09-15T22:14:06.809160+0000","last_became_peered":"2024-09-15T22:14:06.809160+0000","last_unstale":"2024-09-15T22:15:17.114097+0000","last_undegraded":"2024-09-15T22:15:17.114097+0000","last_fullsized":"2024-09-15T22:15:17.114097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:04.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401782+0000","last_change":"2024-09-15T22:14:06.814428+0000","last_active":"2024-09-15T22:15:17.401782+0000","last_peered":"2024-09-15T22:15:17.401782+0000","last_clean":"2024-09-15T22:15:17.401782+0000","last_became_active":"2024-09-15T22:14:06.814100+0000","last_became_peered":"2024-09-15T22:14:06.814100+0000","last_unstale":"2024-09-15T22:15:17.401782+0000","last_undegraded":"2024-09-15T22:15:17.401782+0000","last_fullsized":"2024-09-15T22:15:17.401782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:33.606766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402224+0000","last_change":"2024-09-15T22:14:06.815638+0000","last_active":"2024-09-15T22:15:17.402224+0000","last_peered":"2024-09-15T22:15:17.402224+0000","last_clean":"2024-09-15T22:15:17.402224+0000","last_became_active":"2024-09-15T22:14:06.815327+0000","last_became_peered":"2024-09-15T22:14:06.815327+0000","last_unstale":"2024-09-15T22:15:17.402224+0000","last_undegraded":"2024-09-15T22:15:17.402224+0000","last_fullsized":"2024-09-15T22:15:17.402224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:07.679547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218238+0000","last_change":"2024-09-15T22:15:17.218238+0000","last_active":"2024-09-15T22:15:17.218238+0000","last_peered":"2024-09-15T22:15:17.218238+0000","last_clean":"2024-09-15T22:15:17.218238+0000","last_became_active":"2024-09-15T22:15:17.217852+0000","last_became_peered":"2024-09-15T22:15:17.217852+0000","last_unstale":"2024-09-15T22:15:17.218238+0000","last_undegraded":"2024-09-15T22:15:17.218238+0000","last_fullsized":"2024-09-15T22:15:17.218238+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:42.046956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115214+0000","last_change":"2024-09-15T22:14:06.819667+0000","last_active":"2024-09-15T22:15:17.115214+0000","last_peered":"2024-09-15T22:15:17.115214+0000","last_clean":"2024-09-15T22:15:17.115214+0000","last_became_active":"2024-09-15T22:14:06.819389+0000","last_became_peered":"2024-09-15T22:14:06.819389+0000","last_unstale":"2024-09-15T22:15:17.115214+0000","last_undegraded":"2024-09-15T22:15:17.115214+0000","last_fullsized":"2024-09-15T22:15:17.115214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:16.571088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118133+0000","last_change":"2024-09-15T22:15:17.118133+0000","last_active":"2024-09-15T22:15:17.118133+0000","last_peered":"2024-09-15T22:15:17.118133+0000","last_clean":"2024-09-15T22:15:17.118133+0000","last_became_active":"2024-09-15T22:15:17.117802+0000","last_became_peered":"2024-09-15T22:15:17.117802+0000","last_unstale":"2024-09-15T22:15:17.118133+0000","last_undegraded":"2024-09-15T22:15:17.118133+0000","last_fullsized":"2024-09-15T22:15:17.118133+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:21.523149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117550+0000","last_change":"2024-09-15T22:14:06.801454+0000","last_active":"2024-09-15T22:15:17.117550+0000","last_peered":"2024-09-15T22:15:17.117550+0000","last_clean":"2024-09-15T22:15:17.117550+0000","last_became_active":"2024-09-15T22:14:06.801105+0000","last_became_peered":"2024-09-15T22:14:06.801105+0000","last_unstale":"2024-09-15T22:15:17.117550+0000","last_undegraded":"2024-09-15T22:15:17.117550+0000","last_fullsized":"2024-09-15T22:15:17.117550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:32.457428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116340+0000","last_change":"2024-09-15T22:14:06.812603+0000","last_active":"2024-09-15T22:15:17.116340+0000","last_peered":"2024-09-15T22:15:17.116340+0000","last_clean":"2024-09-15T22:15:17.116340+0000","last_became_active":"2024-09-15T22:14:06.812208+0000","last_became_peered":"2024-09-15T22:14:06.812208+0000","last_unstale":"2024-09-15T22:15:17.116340+0000","last_undegraded":"2024-09-15T22:15:17.116340+0000","last_fullsized":"2024-09-15T22:15:17.116340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:55.327481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.211250+0000","last_change":"2024-09-15T22:14:06.811783+0000","last_active":"2024-09-15T22:15:17.211250+0000","last_peered":"2024-09-15T22:15:17.211250+0000","last_clean":"2024-09-15T22:15:17.211250+0000","last_became_active":"2024-09-15T22:14:06.811208+0000","last_became_peered":"2024-09-15T22:14:06.811208+0000","last_unstale":"2024-09-15T22:15:17.211250+0000","last_undegraded":"2024-09-15T22:15:17.211250+0000","last_fullsized":"2024-09-15T22:15:17.211250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:15.576776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402755+0000","last_change":"2024-09-15T22:14:06.818608+0000","last_active":"2024-09-15T22:15:17.402755+0000","last_peered":"2024-09-15T22:15:17.402755+0000","last_clean":"2024-09-15T22:15:17.402755+0000","last_became_active":"2024-09-15T22:14:06.818283+0000","last_became_peered":"2024-09-15T22:14:06.818283+0000","last_unstale":"2024-09-15T22:15:17.402755+0000","last_undegraded":"2024-09-15T22:15:17.402755+0000","last_fullsized":"2024-09-15T22:15:17.402755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:02.477461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117862+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:15:17.117862+0000","last_peered":"2024-09-15T22:15:17.117862+0000","last_clean":"2024-09-15T22:15:17.117862+0000","last_became_active":"2024-09-15T22:14:06.809043+0000","last_became_peered":"2024-09-15T22:14:06.809043+0000","last_unstale":"2024-09-15T22:15:17.117862+0000","last_undegraded":"2024-09-15T22:15:17.117862+0000","last_fullsized":"2024-09-15T22:15:17.117862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:58.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114731+0000","last_change":"2024-09-15T22:14:06.814875+0000","last_active":"2024-09-15T22:15:17.114731+0000","last_peered":"2024-09-15T22:15:17.114731+0000","last_clean":"2024-09-15T22:15:17.114731+0000","last_became_active":"2024-09-15T22:14:06.814543+0000","last_became_peered":"2024-09-15T22:14:06.814543+0000","last_unstale":"2024-09-15T22:15:17.114731+0000","last_undegraded":"2024-09-15T22:15:17.114731+0000","last_fullsized":"2024-09-15T22:15:17.114731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:57.465965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113872+0000","last_change":"2024-09-15T22:14:06.810655+0000","last_active":"2024-09-15T22:15:17.113872+0000","last_peered":"2024-09-15T22:15:17.113872+0000","last_clean":"2024-09-15T22:15:17.113872+0000","last_became_active":"2024-09-15T22:14:06.810159+0000","last_became_peered":"2024-09-15T22:14:06.810159+0000","last_unstale":"2024-09-15T22:15:17.113872+0000","last_undegraded":"2024-09-15T22:15:17.113872+0000","last_fullsized":"2024-09-15T22:15:17.113872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:17.368982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.119054+0000","last_change":"2024-09-15T22:14:06.815048+0000","last_active":"2024-09-15T22:15:17.119054+0000","last_peered":"2024-09-15T22:15:17.119054+0000","last_clean":"2024-09-15T22:15:17.119054+0000","last_became_active":"2024-09-15T22:14:06.814744+0000","last_became_peered":"2024-09-15T22:14:06.814744+0000","last_unstale":"2024-09-15T22:15:17.119054+0000","last_undegraded":"2024-09-15T22:15:17.119054+0000","last_fullsized":"2024-09-15T22:15:17.119054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:26.927942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.210769+0000","last_change":"2024-09-15T22:14:06.811672+0000","last_active":"2024-09-15T22:15:17.210769+0000","last_peered":"2024-09-15T22:15:17.210769+0000","last_clean":"2024-09-15T22:15:17.210769+0000","last_became_active":"2024-09-15T22:14:06.811300+0000","last_became_peered":"2024-09-15T22:14:06.811300+0000","last_unstale":"2024-09-15T22:15:17.210769+0000","last_undegraded":"2024-09-15T22:15:17.210769+0000","last_fullsized":"2024-09-15T22:15:17.210769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:46.223584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401676+0000","last_change":"2024-09-15T22:14:06.814495+0000","last_active":"2024-09-15T22:15:17.401676+0000","last_peered":"2024-09-15T22:15:17.401676+0000","last_clean":"2024-09-15T22:15:17.401676+0000","last_became_active":"2024-09-15T22:14:06.814142+0000","last_became_peered":"2024-09-15T22:14:06.814142+0000","last_unstale":"2024-09-15T22:15:17.401676+0000","last_undegraded":"2024-09-15T22:15:17.401676+0000","last_fullsized":"2024-09-15T22:15:17.401676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:20.374348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401520+0000","last_change":"2024-09-15T22:14:06.811063+0000","last_active":"2024-09-15T22:15:17.401520+0000","last_peered":"2024-09-15T22:15:17.401520+0000","last_clean":"2024-09-15T22:15:17.401520+0000","last_became_active":"2024-09-15T22:14:06.810700+0000","last_became_peered":"2024-09-15T22:14:06.810700+0000","last_unstale":"2024-09-15T22:15:17.401520+0000","last_undegraded":"2024-09-15T22:15:17.401520+0000","last_fullsized":"2024-09-15T22:15:17.401520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:11.250590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402708+0000","last_change":"2024-09-15T22:14:06.816896+0000","last_active":"2024-09-15T22:15:17.402708+0000","last_peered":"2024-09-15T22:15:17.402708+0000","last_clean":"2024-09-15T22:15:17.402708+0000","last_became_active":"2024-09-15T22:14:06.816559+0000","last_became_peered":"2024-09-15T22:14:06.816559+0000","last_unstale":"2024-09-15T22:15:17.402708+0000","last_undegraded":"2024-09-15T22:15:17.402708+0000","last_fullsized":"2024-09-15T22:15:17.402708+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:17.965490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116284+0000","last_change":"2024-09-15T22:14:06.813984+0000","last_active":"2024-09-15T22:15:17.116284+0000","last_peered":"2024-09-15T22:15:17.116284+0000","last_clean":"2024-09-15T22:15:17.116284+0000","last_became_active":"2024-09-15T22:14:06.813586+0000","last_became_peered":"2024-09-15T22:14:06.813586+0000","last_unstale":"2024-09-15T22:15:17.116284+0000","last_undegraded":"2024-09-15T22:15:17.116284+0000","last_fullsized":"2024-09-15T22:15:17.116284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:34.335741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114898+0000","last_change":"2024-09-15T22:14:06.816047+0000","last_active":"2024-09-15T22:15:17.114898+0000","last_peered":"2024-09-15T22:15:17.114898+0000","last_clean":"2024-09-15T22:15:17.114898+0000","last_became_active":"2024-09-15T22:14:06.815244+0000","last_became_peered":"2024-09-15T22:14:06.815244+0000","last_unstale":"2024-09-15T22:15:17.114898+0000","last_undegraded":"2024-09-15T22:15:17.114898+0000","last_fullsized":"2024-09-15T22:15:17.114898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:30.469382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.331051+0000","last_change":"2024-09-15T22:14:06.813254+0000","last_active":"2024-09-15T22:15:17.331051+0000","last_peered":"2024-09-15T22:15:17.331051+0000","last_clean":"2024-09-15T22:15:17.331051+0000","last_became_active":"2024-09-15T22:14:06.812921+0000","last_became_peered":"2024-09-15T22:14:06.812921+0000","last_unstale":"2024-09-15T22:15:17.331051+0000","last_undegraded":"2024-09-15T22:15:17.331051+0000","last_fullsized":"2024-09-15T22:15:17.331051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:40.674246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.211772+0000","last_change":"2024-09-15T22:14:06.817016+0000","last_active":"2024-09-15T22:15:17.211772+0000","last_peered":"2024-09-15T22:15:17.211772+0000","last_clean":"2024-09-15T22:15:17.211772+0000","last_became_active":"2024-09-15T22:14:06.816256+0000","last_became_peered":"2024-09-15T22:14:06.816256+0000","last_unstale":"2024-09-15T22:15:17.211772+0000","last_undegraded":"2024-09-15T22:15:17.211772+0000","last_fullsized":"2024-09-15T22:15:17.211772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:37.092156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.331450+0000","last_change":"2024-09-15T22:15:17.331108+0000","last_active":"2024-09-15T22:15:17.331450+0000","last_peered":"2024-09-15T22:15:17.331450+0000","last_clean":"2024-09-15T22:15:17.331450+0000","last_became_active":"2024-09-15T22:15:17.330765+0000","last_became_peered":"2024-09-15T22:15:17.330765+0000","last_unstale":"2024-09-15T22:15:17.331450+0000","last_undegraded":"2024-09-15T22:15:17.331450+0000","last_fullsized":"2024-09-15T22:15:17.331450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:37.975326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114225+0000","last_change":"2024-09-15T22:14:06.814902+0000","last_active":"2024-09-15T22:15:17.114225+0000","last_peered":"2024-09-15T22:15:17.114225+0000","last_clean":"2024-09-15T22:15:17.114225+0000","last_became_active":"2024-09-15T22:14:06.814563+0000","last_became_peered":"2024-09-15T22:14:06.814563+0000","last_unstale":"2024-09-15T22:15:17.114225+0000","last_undegraded":"2024-09-15T22:15:17.114225+0000","last_fullsized":"2024-09-15T22:15:17.114225+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:02.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.330534+0000","last_change":"2024-09-15T22:14:06.807444+0000","last_active":"2024-09-15T22:15:17.330534+0000","last_peered":"2024-09-15T22:15:17.330534+0000","last_clean":"2024-09-15T22:15:17.330534+0000","last_became_active":"2024-09-15T22:14:06.807083+0000","last_became_peered":"2024-09-15T22:14:06.807083+0000","last_unstale":"2024-09-15T22:15:17.330534+0000","last_undegraded":"2024-09-15T22:15:17.330534+0000","last_fullsized":"2024-09-15T22:15:17.330534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:07.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218033+0000","last_change":"2024-09-15T22:14:06.811851+0000","last_active":"2024-09-15T22:15:17.218033+0000","last_peered":"2024-09-15T22:15:17.218033+0000","last_clean":"2024-09-15T22:15:17.218033+0000","last_became_active":"2024-09-15T22:14:06.811451+0000","last_became_peered":"2024-09-15T22:14:06.811451+0000","last_unstale":"2024-09-15T22:15:17.218033+0000","last_undegraded":"2024-09-15T22:15:17.218033+0000","last_fullsized":"2024-09-15T22:15:17.218033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:51.389555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116394+0000","last_change":"2024-09-15T22:14:06.812520+0000","last_active":"2024-09-15T22:15:17.116394+0000","last_peered":"2024-09-15T22:15:17.116394+0000","last_clean":"2024-09-15T22:15:17.116394+0000","last_became_active":"2024-09-15T22:14:06.812222+0000","last_became_peered":"2024-09-15T22:14:06.812222+0000","last_unstale":"2024-09-15T22:15:17.116394+0000","last_undegraded":"2024-09-15T22:15:17.116394+0000","last_fullsized":"2024-09-15T22:15:17.116394+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:01.589678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401960+0000","last_change":"2024-09-15T22:14:06.808649+0000","last_active":"2024-09-15T22:15:17.401960+0000","last_peered":"2024-09-15T22:15:17.401960+0000","last_clean":"2024-09-15T22:15:17.401960+0000","last_became_active":"2024-09-15T22:14:06.808278+0000","last_became_peered":"2024-09-15T22:14:06.808278+0000","last_unstale":"2024-09-15T22:15:17.401960+0000","last_undegraded":"2024-09-15T22:15:17.401960+0000","last_fullsized":"2024-09-15T22:15:17.401960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:32.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401821+0000","last_change":"2024-09-15T22:14:06.811593+0000","last_active":"2024-09-15T22:15:17.401821+0000","last_peered":"2024-09-15T22:15:17.401821+0000","last_clean":"2024-09-15T22:15:17.401821+0000","last_became_active":"2024-09-15T22:14:06.811285+0000","last_became_peered":"2024-09-15T22:14:06.811285+0000","last_unstale":"2024-09-15T22:15:17.401821+0000","last_undegraded":"2024-09-15T22:15:17.401821+0000","last_fullsized":"2024-09-15T22:15:17.401821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:36.482554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118997+0000","last_change":"2024-09-15T22:14:06.816084+0000","last_active":"2024-09-15T22:15:17.118997+0000","last_peered":"2024-09-15T22:15:17.118997+0000","last_clean":"2024-09-15T22:15:17.118997+0000","last_became_active":"2024-09-15T22:14:06.815461+0000","last_became_peered":"2024-09-15T22:14:06.815461+0000","last_unstale":"2024-09-15T22:15:17.118997+0000","last_undegraded":"2024-09-15T22:15:17.118997+0000","last_fullsized":"2024-09-15T22:15:17.118997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:57.455608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65929,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":118,"num_read_kb":126,"num_write":89,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":197787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547232,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1011712,"data_stored":501160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776164,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1687552,"data_stored":1152757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939689,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":505838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168623,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1019904,"data_stored":501764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430259,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1613824,"data_stored":1096206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593785,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":497064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1617920,"data_stored":1091710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986242,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1015808,"data_stored":501182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215176,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1015808,"data_stored":497168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411405,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1085440,"data_stored":562229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1081344,"data_stored":562195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40496,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704656,"statfs":{"total":95995035648,"available":95953567744,"internally_reserved":0,"allocated":1011712,"data_stored":497154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":65165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:15:40.018 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:15:40.286 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:40.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:40 smithi045 ceph-mon[31180]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:15:40.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:40 smithi165 ceph-mon[35551]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:15:40.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:40 smithi100 ceph-mon[35319]: from='client.15009 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:15:40.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.784+0000 7f2396cfc640 1 -- 172.21.15.45:0/4186383163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2390103660 msgr2=0x7f239010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:40.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.784+0000 7f2396cfc640 1 --2- 172.21.15.45:0/4186383163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2390103660 0x7f239010bb50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2384009900 tx=0x7f238402a480 comp rx=0 tx=0).stop 2024-09-15T22:15:40.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.784+0000 7f2396cfc640 1 -- 172.21.15.45:0/4186383163 shutdown_connections 2024-09-15T22:15:40.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.784+0000 7f2396cfc640 1 --2- 172.21.15.45:0/4186383163 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f239010c170 0x7f239010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.784+0000 7f2396cfc640 1 --2- 172.21.15.45:0/4186383163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2390103660 0x7f239010bb50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.784+0000 7f2396cfc640 1 --2- 172.21.15.45:0/4186383163 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2390102d40 0x7f2390103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.784+0000 7f2396cfc640 1 -- 172.21.15.45:0/4186383163 >> 172.21.15.45:0/4186383163 conn(0x7f23900fc7a0 msgr2=0x7f23900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:40.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.785+0000 7f2396cfc640 1 -- 172.21.15.45:0/4186383163 shutdown_connections 2024-09-15T22:15:40.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.785+0000 7f2396cfc640 1 -- 172.21.15.45:0/4186383163 wait complete. 2024-09-15T22:15:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.785+0000 7f2396cfc640 1 Processor -- start 2024-09-15T22:15:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.785+0000 7f2396cfc640 1 -- start start 2024-09-15T22:15:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.785+0000 7f2396cfc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2390102d40 0x7f239019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.785+0000 7f2396cfc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2390103660 0x7f239019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.785+0000 7f2396cfc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f239010c170 0x7f239019efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.785+0000 7f2396cfc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2390112090 con 0x7f239010c170 2024-09-15T22:15:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.785+0000 7f2396cfc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2390111f10 con 0x7f2390103660 2024-09-15T22:15:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.785+0000 7f2396cfc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2390112210 con 0x7f2390102d40 2024-09-15T22:15:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f2395299640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f239010c170 0x7f239019efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f2395299640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f239010c170 0x7f239019efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35340/0 (socket says 172.21.15.45:35340) 2024-09-15T22:15:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f2395299640 1 -- 172.21.15.45:0/1995551919 learned_addr learned my addr 172.21.15.45:0/1995551919 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:40.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f238ffff640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2390103660 0x7f239019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f2394a98640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2390102d40 0x7f239019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f2395299640 1 -- 172.21.15.45:0/1995551919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2390102d40 msgr2=0x7f239019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f2395299640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2390102d40 0x7f239019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f2395299640 1 -- 172.21.15.45:0/1995551919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2390103660 msgr2=0x7f239019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f2395299640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2390103660 0x7f239019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f2395299640 1 -- 172.21.15.45:0/1995551919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f239019f690 con 0x7f239010c170 2024-09-15T22:15:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f2395299640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f239010c170 0x7f239019efb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f238800cce0 tx=0x7f238800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f238dffb640 1 -- 172.21.15.45:0/1995551919 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f238800f450 con 0x7f239010c170 2024-09-15T22:15:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f238dffb640 1 -- 172.21.15.45:0/1995551919 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f238800faf0 con 0x7f239010c170 2024-09-15T22:15:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f238dffb640 1 -- 172.21.15.45:0/1995551919 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2388018cc0 con 0x7f239010c170 2024-09-15T22:15:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.786+0000 7f2396cfc640 1 -- 172.21.15.45:0/1995551919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f239019f980 con 0x7f239010c170 2024-09-15T22:15:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.787+0000 7f2396cfc640 1 -- 172.21.15.45:0/1995551919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23901a7260 con 0x7f239010c170 2024-09-15T22:15:40.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.787+0000 7f2396cfc640 1 -- 172.21.15.45:0/1995551919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2390103120 con 0x7f239010c170 2024-09-15T22:15:40.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.789+0000 7f238dffb640 1 -- 172.21.15.45:0/1995551919 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f238800f5f0 con 0x7f239010c170 2024-09-15T22:15:40.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.789+0000 7f238dffb640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f23780a3350 0x7f23780a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:40.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.790+0000 7f2394a98640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f23780a3350 0x7f23780a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:40.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.790+0000 7f238dffb640 1 -- 172.21.15.45:0/1995551919 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f23880d01f0 con 0x7f239010c170 2024-09-15T22:15:40.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.790+0000 7f2394a98640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f23780a3350 0x7f23780a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2380005e10 tx=0x7f2380005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:40.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.794+0000 7f238dffb640 1 -- 172.21.15.45:0/1995551919 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2388014030 con 0x7f239010c170 2024-09-15T22:15:40.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.965+0000 7f2396cfc640 1 -- 172.21.15.45:0/1995551919 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2390102100 con 0x7f23780a3350 2024-09-15T22:15:40.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.974+0000 7f238dffb640 1 -- 172.21.15.45:0/1995551919 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340278 (secure 0 0 0) 0x7f2390102100 con 0x7f23780a3350 2024-09-15T22:15:40.979 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:15:40.981 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-09-15T22:15:40.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.977+0000 7f2396cfc640 1 -- 172.21.15.45:0/1995551919 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f23780a3350 msgr2=0x7f23780a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:40.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.977+0000 7f2396cfc640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f23780a3350 0x7f23780a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2380005e10 tx=0x7f2380005da0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.977+0000 7f2396cfc640 1 -- 172.21.15.45:0/1995551919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f239010c170 msgr2=0x7f239019efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:40.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.977+0000 7f2396cfc640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f239010c170 0x7f239019efb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f238800cce0 tx=0x7f238800a620 comp rx=0 tx=0).stop 2024-09-15T22:15:40.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.977+0000 7f2396cfc640 1 -- 172.21.15.45:0/1995551919 shutdown_connections 2024-09-15T22:15:40.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.977+0000 7f2396cfc640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f23780a3350 0x7f23780a5810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.977+0000 7f2396cfc640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f239010c170 0x7f239019efb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.977+0000 7f2396cfc640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2390103660 0x7f239019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.977+0000 7f2396cfc640 1 --2- 172.21.15.45:0/1995551919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2390102d40 0x7f239019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:40.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.977+0000 7f2396cfc640 1 -- 172.21.15.45:0/1995551919 >> 172.21.15.45:0/1995551919 conn(0x7f23900fc7a0 msgr2=0x7f23900feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:40.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.977+0000 7f2396cfc640 1 -- 172.21.15.45:0/1995551919 shutdown_connections 2024-09-15T22:15:40.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:40.977+0000 7f2396cfc640 1 -- 172.21.15.45:0/1995551919 wait complete. 2024-09-15T22:15:41.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:41 smithi045 ceph-mon[31180]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:15:41.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:41 smithi165 ceph-mon[35551]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:15:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:41 smithi100 ceph-mon[35319]: pgmap v331: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:15:41.806 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-15T22:15:39.435048+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656531,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":254,"num_read_kb":245,"num_write":272,"num_write_kb":3035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":408944,"kb_used_data":13856,"kb_used_omap":18,"kb_used_meta":394797,"kb_avail":1124532880,"statfs":{"total":1151940427776,"available":1151521669120,"internally_reserved":0,"allocated":14188544,"data_stored":7966427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":404272441},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":9,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003277"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114125+0000","last_change":"2024-09-15T22:14:04.718966+0000","last_active":"2024-09-15T22:15:17.114125+0000","last_peered":"2024-09-15T22:15:17.114125+0000","last_clean":"2024-09-15T22:15:17.114125+0000","last_became_active":"2024-09-15T22:14:04.718743+0000","last_became_peered":"2024-09-15T22:14:04.718743+0000","last_unstale":"2024-09-15T22:15:17.114125+0000","last_undegraded":"2024-09-15T22:15:17.114125+0000","last_fullsized":"2024-09-15T22:15:17.114125+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:24:01.767801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116214+0000","last_change":"2024-09-15T22:14:06.814802+0000","last_active":"2024-09-15T22:15:17.116214+0000","last_peered":"2024-09-15T22:15:17.116214+0000","last_clean":"2024-09-15T22:15:17.116214+0000","last_became_active":"2024-09-15T22:14:06.814495+0000","last_became_peered":"2024-09-15T22:14:06.814495+0000","last_unstale":"2024-09-15T22:15:17.116214+0000","last_undegraded":"2024-09-15T22:15:17.116214+0000","last_fullsized":"2024-09-15T22:15:17.116214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:45.384412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.404082+0000","last_change":"2024-09-15T22:15:17.404082+0000","last_active":"2024-09-15T22:15:17.404082+0000","last_peered":"2024-09-15T22:15:17.404082+0000","last_clean":"2024-09-15T22:15:17.404082+0000","last_became_active":"2024-09-15T22:15:17.403590+0000","last_became_peered":"2024-09-15T22:15:17.403590+0000","last_unstale":"2024-09-15T22:15:17.404082+0000","last_undegraded":"2024-09-15T22:15:17.404082+0000","last_fullsized":"2024-09-15T22:15:17.404082+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:49.816560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116417+0000","last_change":"2024-09-15T22:14:05.017101+0000","last_active":"2024-09-15T22:15:17.116417+0000","last_peered":"2024-09-15T22:15:17.116417+0000","last_clean":"2024-09-15T22:15:17.116417+0000","last_became_active":"2024-09-15T22:14:05.016748+0000","last_became_peered":"2024-09-15T22:14:05.016748+0000","last_unstale":"2024-09-15T22:15:17.116417+0000","last_undegraded":"2024-09-15T22:15:17.116417+0000","last_fullsized":"2024-09-15T22:15:17.116417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:11.211291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402592+0000","last_change":"2024-09-15T22:14:06.815112+0000","last_active":"2024-09-15T22:15:17.402592+0000","last_peered":"2024-09-15T22:15:17.402592+0000","last_clean":"2024-09-15T22:15:17.402592+0000","last_became_active":"2024-09-15T22:14:06.814556+0000","last_became_peered":"2024-09-15T22:14:06.814556+0000","last_unstale":"2024-09-15T22:15:17.402592+0000","last_undegraded":"2024-09-15T22:15:17.402592+0000","last_fullsized":"2024-09-15T22:15:17.402592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:24.733336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115743+0000","last_change":"2024-09-15T22:14:13.845829+0000","last_active":"2024-09-15T22:15:17.115743+0000","last_peered":"2024-09-15T22:15:17.115743+0000","last_clean":"2024-09-15T22:15:17.115743+0000","last_became_active":"2024-09-15T22:14:13.844958+0000","last_became_peered":"2024-09-15T22:14:13.844958+0000","last_unstale":"2024-09-15T22:15:17.115743+0000","last_undegraded":"2024-09-15T22:15:17.115743+0000","last_fullsized":"2024-09-15T22:15:17.115743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:37.944143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218873+0000","last_change":"2024-09-15T22:14:04.720255+0000","last_active":"2024-09-15T22:15:17.218873+0000","last_peered":"2024-09-15T22:15:17.218873+0000","last_clean":"2024-09-15T22:15:17.218873+0000","last_became_active":"2024-09-15T22:14:04.719907+0000","last_became_peered":"2024-09-15T22:14:04.719907+0000","last_unstale":"2024-09-15T22:15:17.218873+0000","last_undegraded":"2024-09-15T22:15:17.218873+0000","last_fullsized":"2024-09-15T22:15:17.218873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:12.510139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.210939+0000","last_change":"2024-09-15T22:14:06.808322+0000","last_active":"2024-09-15T22:15:17.210939+0000","last_peered":"2024-09-15T22:15:17.210939+0000","last_clean":"2024-09-15T22:15:17.210939+0000","last_became_active":"2024-09-15T22:14:06.807398+0000","last_became_peered":"2024-09-15T22:14:06.807398+0000","last_unstale":"2024-09-15T22:15:17.210939+0000","last_undegraded":"2024-09-15T22:15:17.210939+0000","last_fullsized":"2024-09-15T22:15:17.210939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:11.677800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116786+0000","last_change":"2024-09-15T22:14:13.849713+0000","last_active":"2024-09-15T22:15:17.116786+0000","last_peered":"2024-09-15T22:15:17.116786+0000","last_clean":"2024-09-15T22:15:17.116786+0000","last_became_active":"2024-09-15T22:14:13.849311+0000","last_became_peered":"2024-09-15T22:14:13.849311+0000","last_unstale":"2024-09-15T22:15:17.116786+0000","last_undegraded":"2024-09-15T22:15:17.116786+0000","last_fullsized":"2024-09-15T22:15:17.116786+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:17.782013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218958+0000","last_change":"2024-09-15T22:14:04.721694+0000","last_active":"2024-09-15T22:15:17.218958+0000","last_peered":"2024-09-15T22:15:17.218958+0000","last_clean":"2024-09-15T22:15:17.218958+0000","last_became_active":"2024-09-15T22:14:04.721321+0000","last_became_peered":"2024-09-15T22:14:04.721321+0000","last_unstale":"2024-09-15T22:15:17.218958+0000","last_undegraded":"2024-09-15T22:15:17.218958+0000","last_fullsized":"2024-09-15T22:15:17.218958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:47.817565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118521+0000","last_change":"2024-09-15T22:14:06.809564+0000","last_active":"2024-09-15T22:15:17.118521+0000","last_peered":"2024-09-15T22:15:17.118521+0000","last_clean":"2024-09-15T22:15:17.118521+0000","last_became_active":"2024-09-15T22:14:06.809102+0000","last_became_peered":"2024-09-15T22:14:06.809102+0000","last_unstale":"2024-09-15T22:15:17.118521+0000","last_undegraded":"2024-09-15T22:15:17.118521+0000","last_fullsized":"2024-09-15T22:15:17.118521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:55.306791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115905+0000","last_change":"2024-09-15T22:14:13.849839+0000","last_active":"2024-09-15T22:15:17.115905+0000","last_peered":"2024-09-15T22:15:17.115905+0000","last_clean":"2024-09-15T22:15:17.115905+0000","last_became_active":"2024-09-15T22:14:13.849415+0000","last_became_peered":"2024-09-15T22:14:13.849415+0000","last_unstale":"2024-09-15T22:15:17.115905+0000","last_undegraded":"2024-09-15T22:15:17.115905+0000","last_fullsized":"2024-09-15T22:15:17.115905+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:20.336406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114391+0000","last_change":"2024-09-15T22:14:06.815506+0000","last_active":"2024-09-15T22:15:17.114391+0000","last_peered":"2024-09-15T22:15:17.114391+0000","last_clean":"2024-09-15T22:15:17.114391+0000","last_became_active":"2024-09-15T22:14:06.815066+0000","last_became_peered":"2024-09-15T22:14:06.815066+0000","last_unstale":"2024-09-15T22:15:17.114391+0000","last_undegraded":"2024-09-15T22:15:17.114391+0000","last_fullsized":"2024-09-15T22:15:17.114391+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:42.182268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218163+0000","last_change":"2024-09-15T22:14:04.721403+0000","last_active":"2024-09-15T22:15:17.218163+0000","last_peered":"2024-09-15T22:15:17.218163+0000","last_clean":"2024-09-15T22:15:17.218163+0000","last_became_active":"2024-09-15T22:14:04.721049+0000","last_became_peered":"2024-09-15T22:14:04.721049+0000","last_unstale":"2024-09-15T22:15:17.218163+0000","last_undegraded":"2024-09-15T22:15:17.218163+0000","last_fullsized":"2024-09-15T22:15:17.218163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:39.860926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116479+0000","last_change":"2024-09-15T22:14:14.280656+0000","last_active":"2024-09-15T22:15:17.116479+0000","last_peered":"2024-09-15T22:15:17.116479+0000","last_clean":"2024-09-15T22:15:17.116479+0000","last_became_active":"2024-09-15T22:14:14.280230+0000","last_became_peered":"2024-09-15T22:14:14.280230+0000","last_unstale":"2024-09-15T22:15:17.116479+0000","last_undegraded":"2024-09-15T22:15:17.116479+0000","last_fullsized":"2024-09-15T22:15:17.116479+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:47.531799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115951+0000","last_change":"2024-09-15T22:14:06.805575+0000","last_active":"2024-09-15T22:15:17.115951+0000","last_peered":"2024-09-15T22:15:17.115951+0000","last_clean":"2024-09-15T22:15:17.115951+0000","last_became_active":"2024-09-15T22:14:06.804515+0000","last_became_peered":"2024-09-15T22:14:06.804515+0000","last_unstale":"2024-09-15T22:15:17.115951+0000","last_undegraded":"2024-09-15T22:15:17.115951+0000","last_fullsized":"2024-09-15T22:15:17.115951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.560964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114246+0000","last_change":"2024-09-15T22:14:04.717221+0000","last_active":"2024-09-15T22:15:17.114246+0000","last_peered":"2024-09-15T22:15:17.114246+0000","last_clean":"2024-09-15T22:15:17.114246+0000","last_became_active":"2024-09-15T22:14:04.716845+0000","last_became_peered":"2024-09-15T22:14:04.716845+0000","last_unstale":"2024-09-15T22:15:17.114246+0000","last_undegraded":"2024-09-15T22:15:17.114246+0000","last_fullsized":"2024-09-15T22:15:17.114246+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.073229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116034+0000","last_change":"2024-09-15T22:14:13.847822+0000","last_active":"2024-09-15T22:15:17.116034+0000","last_peered":"2024-09-15T22:15:17.116034+0000","last_clean":"2024-09-15T22:15:17.116034+0000","last_became_active":"2024-09-15T22:14:13.847332+0000","last_became_peered":"2024-09-15T22:14:13.847332+0000","last_unstale":"2024-09-15T22:15:17.116034+0000","last_undegraded":"2024-09-15T22:15:17.116034+0000","last_fullsized":"2024-09-15T22:15:17.116034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:18.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117538+0000","last_change":"2024-09-15T22:14:06.814033+0000","last_active":"2024-09-15T22:15:17.117538+0000","last_peered":"2024-09-15T22:15:17.117538+0000","last_clean":"2024-09-15T22:15:17.117538+0000","last_became_active":"2024-09-15T22:14:06.813458+0000","last_became_peered":"2024-09-15T22:14:06.813458+0000","last_unstale":"2024-09-15T22:15:17.117538+0000","last_undegraded":"2024-09-15T22:15:17.117538+0000","last_fullsized":"2024-09-15T22:15:17.117538+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:16.484113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116472+0000","last_change":"2024-09-15T22:14:04.715797+0000","last_active":"2024-09-15T22:15:17.116472+0000","last_peered":"2024-09-15T22:15:17.116472+0000","last_clean":"2024-09-15T22:15:17.116472+0000","last_became_active":"2024-09-15T22:14:04.715478+0000","last_became_peered":"2024-09-15T22:14:04.715478+0000","last_unstale":"2024-09-15T22:15:17.116472+0000","last_undegraded":"2024-09-15T22:15:17.116472+0000","last_fullsized":"2024-09-15T22:15:17.116472+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:39.432873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113941+0000","last_change":"2024-09-15T22:14:13.853461+0000","last_active":"2024-09-15T22:15:17.113941+0000","last_peered":"2024-09-15T22:15:17.113941+0000","last_clean":"2024-09-15T22:15:17.113941+0000","last_became_active":"2024-09-15T22:14:13.852896+0000","last_became_peered":"2024-09-15T22:14:13.852896+0000","last_unstale":"2024-09-15T22:15:17.113941+0000","last_undegraded":"2024-09-15T22:15:17.113941+0000","last_fullsized":"2024-09-15T22:15:17.113941+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:41.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218177+0000","last_change":"2024-09-15T22:14:06.814990+0000","last_active":"2024-09-15T22:15:17.218177+0000","last_peered":"2024-09-15T22:15:17.218177+0000","last_clean":"2024-09-15T22:15:17.218177+0000","last_became_active":"2024-09-15T22:14:06.814646+0000","last_became_peered":"2024-09-15T22:14:06.814646+0000","last_unstale":"2024-09-15T22:15:17.218177+0000","last_undegraded":"2024-09-15T22:15:17.218177+0000","last_fullsized":"2024-09-15T22:15:17.218177+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:04.717207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.210923+0000","last_change":"2024-09-15T22:14:05.017599+0000","last_active":"2024-09-15T22:15:17.210923+0000","last_peered":"2024-09-15T22:15:17.210923+0000","last_clean":"2024-09-15T22:15:17.210923+0000","last_became_active":"2024-09-15T22:14:05.017296+0000","last_became_peered":"2024-09-15T22:14:05.017296+0000","last_unstale":"2024-09-15T22:15:17.210923+0000","last_undegraded":"2024-09-15T22:15:17.210923+0000","last_fullsized":"2024-09-15T22:15:17.210923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:11.427372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116307+0000","last_change":"2024-09-15T22:14:14.281453+0000","last_active":"2024-09-15T22:15:17.116307+0000","last_peered":"2024-09-15T22:15:17.116307+0000","last_clean":"2024-09-15T22:15:17.116307+0000","last_became_active":"2024-09-15T22:14:14.280814+0000","last_became_peered":"2024-09-15T22:14:14.280814+0000","last_unstale":"2024-09-15T22:15:17.116307+0000","last_undegraded":"2024-09-15T22:15:17.116307+0000","last_fullsized":"2024-09-15T22:15:17.116307+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:43:40.890979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401923+0000","last_change":"2024-09-15T22:14:06.816619+0000","last_active":"2024-09-15T22:15:17.401923+0000","last_peered":"2024-09-15T22:15:17.401923+0000","last_clean":"2024-09-15T22:15:17.401923+0000","last_became_active":"2024-09-15T22:14:06.814421+0000","last_became_peered":"2024-09-15T22:14:06.814421+0000","last_unstale":"2024-09-15T22:15:17.401923+0000","last_undegraded":"2024-09-15T22:15:17.401923+0000","last_fullsized":"2024-09-15T22:15:17.401923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:00.329802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116847+0000","last_change":"2024-09-15T22:14:05.197752+0000","last_active":"2024-09-15T22:15:17.116847+0000","last_peered":"2024-09-15T22:15:17.116847+0000","last_clean":"2024-09-15T22:15:17.116847+0000","last_became_active":"2024-09-15T22:14:05.197399+0000","last_became_peered":"2024-09-15T22:14:05.197399+0000","last_unstale":"2024-09-15T22:15:17.116847+0000","last_undegraded":"2024-09-15T22:15:17.116847+0000","last_fullsized":"2024-09-15T22:15:17.116847+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:19.781842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115050+0000","last_change":"2024-09-15T22:14:13.847474+0000","last_active":"2024-09-15T22:15:17.115050+0000","last_peered":"2024-09-15T22:15:17.115050+0000","last_clean":"2024-09-15T22:15:17.115050+0000","last_became_active":"2024-09-15T22:14:13.847032+0000","last_became_peered":"2024-09-15T22:14:13.847032+0000","last_unstale":"2024-09-15T22:15:17.115050+0000","last_undegraded":"2024-09-15T22:15:17.115050+0000","last_fullsized":"2024-09-15T22:15:17.115050+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:21.049024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116505+0000","last_change":"2024-09-15T22:14:06.809104+0000","last_active":"2024-09-15T22:15:17.116505+0000","last_peered":"2024-09-15T22:15:17.116505+0000","last_clean":"2024-09-15T22:15:17.116505+0000","last_became_active":"2024-09-15T22:14:06.808735+0000","last_became_peered":"2024-09-15T22:14:06.808735+0000","last_unstale":"2024-09-15T22:15:17.116505+0000","last_undegraded":"2024-09-15T22:15:17.116505+0000","last_fullsized":"2024-09-15T22:15:17.116505+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:46.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'10","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113915+0000","last_change":"2024-09-15T22:14:04.712546+0000","last_active":"2024-09-15T22:15:17.113915+0000","last_peered":"2024-09-15T22:15:17.113915+0000","last_clean":"2024-09-15T22:15:17.113915+0000","last_became_active":"2024-09-15T22:14:04.712222+0000","last_became_peered":"2024-09-15T22:14:04.712222+0000","last_unstale":"2024-09-15T22:15:17.113915+0000","last_undegraded":"2024-09-15T22:15:17.113915+0000","last_fullsized":"2024-09-15T22:15:17.113915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:00.993810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115640+0000","last_change":"2024-09-15T22:14:14.280905+0000","last_active":"2024-09-15T22:15:17.115640+0000","last_peered":"2024-09-15T22:15:17.115640+0000","last_clean":"2024-09-15T22:15:17.115640+0000","last_became_active":"2024-09-15T22:14:14.280368+0000","last_became_peered":"2024-09-15T22:14:14.280368+0000","last_unstale":"2024-09-15T22:15:17.115640+0000","last_undegraded":"2024-09-15T22:15:17.115640+0000","last_fullsized":"2024-09-15T22:15:17.115640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:52.812589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402324+0000","last_change":"2024-09-15T22:14:06.816231+0000","last_active":"2024-09-15T22:15:17.402324+0000","last_peered":"2024-09-15T22:15:17.402324+0000","last_clean":"2024-09-15T22:15:17.402324+0000","last_became_active":"2024-09-15T22:14:06.815884+0000","last_became_peered":"2024-09-15T22:14:06.815884+0000","last_unstale":"2024-09-15T22:15:17.402324+0000","last_undegraded":"2024-09-15T22:15:17.402324+0000","last_fullsized":"2024-09-15T22:15:17.402324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:30.076077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218954+0000","last_change":"2024-09-15T22:14:05.017745+0000","last_active":"2024-09-15T22:15:17.218954+0000","last_peered":"2024-09-15T22:15:17.218954+0000","last_clean":"2024-09-15T22:15:17.218954+0000","last_became_active":"2024-09-15T22:14:05.017064+0000","last_became_peered":"2024-09-15T22:14:05.017064+0000","last_unstale":"2024-09-15T22:15:17.218954+0000","last_undegraded":"2024-09-15T22:15:17.218954+0000","last_fullsized":"2024-09-15T22:15:17.218954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:44.038448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117610+0000","last_change":"2024-09-15T22:14:13.853195+0000","last_active":"2024-09-15T22:15:17.117610+0000","last_peered":"2024-09-15T22:15:17.117610+0000","last_clean":"2024-09-15T22:15:17.117610+0000","last_became_active":"2024-09-15T22:14:13.852803+0000","last_became_peered":"2024-09-15T22:14:13.852803+0000","last_unstale":"2024-09-15T22:15:17.117610+0000","last_undegraded":"2024-09-15T22:15:17.117610+0000","last_fullsized":"2024-09-15T22:15:17.117610+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:20.737509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.330657+0000","last_change":"2024-09-15T22:14:06.805448+0000","last_active":"2024-09-15T22:15:17.330657+0000","last_peered":"2024-09-15T22:15:17.330657+0000","last_clean":"2024-09-15T22:15:17.330657+0000","last_became_active":"2024-09-15T22:14:06.804965+0000","last_became_peered":"2024-09-15T22:14:06.804965+0000","last_unstale":"2024-09-15T22:15:17.330657+0000","last_undegraded":"2024-09-15T22:15:17.330657+0000","last_fullsized":"2024-09-15T22:15:17.330657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:29.831888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113846+0000","last_change":"2024-09-15T22:14:05.017438+0000","last_active":"2024-09-15T22:15:17.113846+0000","last_peered":"2024-09-15T22:15:17.113846+0000","last_clean":"2024-09-15T22:15:17.113846+0000","last_became_active":"2024-09-15T22:14:05.017050+0000","last_became_peered":"2024-09-15T22:14:05.017050+0000","last_unstale":"2024-09-15T22:15:17.113846+0000","last_undegraded":"2024-09-15T22:15:17.113846+0000","last_fullsized":"2024-09-15T22:15:17.113846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:35.608774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218072+0000","last_change":"2024-09-15T22:14:14.281096+0000","last_active":"2024-09-15T22:15:17.218072+0000","last_peered":"2024-09-15T22:15:17.218072+0000","last_clean":"2024-09-15T22:15:17.218072+0000","last_became_active":"2024-09-15T22:14:14.280381+0000","last_became_peered":"2024-09-15T22:14:14.280381+0000","last_unstale":"2024-09-15T22:15:17.218072+0000","last_undegraded":"2024-09-15T22:15:17.218072+0000","last_fullsized":"2024-09-15T22:15:17.218072+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:44.686080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.330694+0000","last_change":"2024-09-15T22:14:06.812046+0000","last_active":"2024-09-15T22:15:17.330694+0000","last_peered":"2024-09-15T22:15:17.330694+0000","last_clean":"2024-09-15T22:15:17.330694+0000","last_became_active":"2024-09-15T22:14:06.811721+0000","last_became_peered":"2024-09-15T22:14:06.811721+0000","last_unstale":"2024-09-15T22:15:17.330694+0000","last_undegraded":"2024-09-15T22:15:17.330694+0000","last_fullsized":"2024-09-15T22:15:17.330694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:13.244973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114559+0000","last_change":"2024-09-15T22:14:04.720940+0000","last_active":"2024-09-15T22:15:17.114559+0000","last_peered":"2024-09-15T22:15:17.114559+0000","last_clean":"2024-09-15T22:15:17.114559+0000","last_became_active":"2024-09-15T22:14:04.720624+0000","last_became_peered":"2024-09-15T22:14:04.720624+0000","last_unstale":"2024-09-15T22:15:17.114559+0000","last_undegraded":"2024-09-15T22:15:17.114559+0000","last_fullsized":"2024-09-15T22:15:17.114559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:29.823784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402410+0000","last_change":"2024-09-15T22:14:13.848882+0000","last_active":"2024-09-15T22:15:17.402410+0000","last_peered":"2024-09-15T22:15:17.402410+0000","last_clean":"2024-09-15T22:15:17.402410+0000","last_became_active":"2024-09-15T22:14:13.848512+0000","last_became_peered":"2024-09-15T22:14:13.848512+0000","last_unstale":"2024-09-15T22:15:17.402410+0000","last_undegraded":"2024-09-15T22:15:17.402410+0000","last_fullsized":"2024-09-15T22:15:17.402410+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:44.050344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117675+0000","last_change":"2024-09-15T22:14:06.813915+0000","last_active":"2024-09-15T22:15:17.117675+0000","last_peered":"2024-09-15T22:15:17.117675+0000","last_clean":"2024-09-15T22:15:17.117675+0000","last_became_active":"2024-09-15T22:14:06.811803+0000","last_became_peered":"2024-09-15T22:14:06.811803+0000","last_unstale":"2024-09-15T22:15:17.117675+0000","last_undegraded":"2024-09-15T22:15:17.117675+0000","last_fullsized":"2024-09-15T22:15:17.117675+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:42.117747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401966+0000","last_change":"2024-09-15T22:14:05.017360+0000","last_active":"2024-09-15T22:15:17.401966+0000","last_peered":"2024-09-15T22:15:17.401966+0000","last_clean":"2024-09-15T22:15:17.401966+0000","last_became_active":"2024-09-15T22:14:05.017004+0000","last_became_peered":"2024-09-15T22:14:05.017004+0000","last_unstale":"2024-09-15T22:15:17.401966+0000","last_undegraded":"2024-09-15T22:15:17.401966+0000","last_fullsized":"2024-09-15T22:15:17.401966+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:01.366513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402590+0000","last_change":"2024-09-15T22:14:14.280215+0000","last_active":"2024-09-15T22:15:17.402590+0000","last_peered":"2024-09-15T22:15:17.402590+0000","last_clean":"2024-09-15T22:15:17.402590+0000","last_became_active":"2024-09-15T22:14:14.279750+0000","last_became_peered":"2024-09-15T22:14:14.279750+0000","last_unstale":"2024-09-15T22:15:17.402590+0000","last_undegraded":"2024-09-15T22:15:17.402590+0000","last_fullsized":"2024-09-15T22:15:17.402590+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:58.827582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401779+0000","last_change":"2024-09-15T22:14:06.812410+0000","last_active":"2024-09-15T22:15:17.401779+0000","last_peered":"2024-09-15T22:15:17.401779+0000","last_clean":"2024-09-15T22:15:17.401779+0000","last_became_active":"2024-09-15T22:14:06.812032+0000","last_became_peered":"2024-09-15T22:14:06.812032+0000","last_unstale":"2024-09-15T22:15:17.401779+0000","last_undegraded":"2024-09-15T22:15:17.401779+0000","last_fullsized":"2024-09-15T22:15:17.401779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:48.100213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114334+0000","last_change":"2024-09-15T22:14:04.719678+0000","last_active":"2024-09-15T22:15:17.114334+0000","last_peered":"2024-09-15T22:15:17.114334+0000","last_clean":"2024-09-15T22:15:17.114334+0000","last_became_active":"2024-09-15T22:14:04.719352+0000","last_became_peered":"2024-09-15T22:14:04.719352+0000","last_unstale":"2024-09-15T22:15:17.114334+0000","last_undegraded":"2024-09-15T22:15:17.114334+0000","last_fullsized":"2024-09-15T22:15:17.114334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.061957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118172+0000","last_change":"2024-09-15T22:14:14.281314+0000","last_active":"2024-09-15T22:15:17.118172+0000","last_peered":"2024-09-15T22:15:17.118172+0000","last_clean":"2024-09-15T22:15:17.118172+0000","last_became_active":"2024-09-15T22:14:14.280859+0000","last_became_peered":"2024-09-15T22:14:14.280859+0000","last_unstale":"2024-09-15T22:15:17.118172+0000","last_undegraded":"2024-09-15T22:15:17.118172+0000","last_fullsized":"2024-09-15T22:15:17.118172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:18.796767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.212177+0000","last_change":"2024-09-15T22:15:17.211828+0000","last_active":"2024-09-15T22:15:17.212177+0000","last_peered":"2024-09-15T22:15:17.212177+0000","last_clean":"2024-09-15T22:15:17.212177+0000","last_became_active":"2024-09-15T22:15:17.211560+0000","last_became_peered":"2024-09-15T22:15:17.211560+0000","last_unstale":"2024-09-15T22:15:17.212177+0000","last_undegraded":"2024-09-15T22:15:17.212177+0000","last_fullsized":"2024-09-15T22:15:17.212177+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:59.944869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116954+0000","last_change":"2024-09-15T22:14:04.718038+0000","last_active":"2024-09-15T22:15:17.116954+0000","last_peered":"2024-09-15T22:15:17.116954+0000","last_clean":"2024-09-15T22:15:17.116954+0000","last_became_active":"2024-09-15T22:14:04.717683+0000","last_became_peered":"2024-09-15T22:14:04.717683+0000","last_unstale":"2024-09-15T22:15:17.116954+0000","last_undegraded":"2024-09-15T22:15:17.116954+0000","last_fullsized":"2024-09-15T22:15:17.116954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:23.557077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":357,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114527+0000","last_change":"2024-09-15T22:12:55.022635+0000","last_active":"2024-09-15T22:15:17.114527+0000","last_peered":"2024-09-15T22:15:17.114527+0000","last_clean":"2024-09-15T22:15:17.114527+0000","last_became_active":"2024-09-15T22:12:55.022132+0000","last_became_peered":"2024-09-15T22:12:55.022132+0000","last_unstale":"2024-09-15T22:15:17.114527+0000","last_undegraded":"2024-09-15T22:15:17.114527+0000","last_fullsized":"2024-09-15T22:15:17.114527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_clean_scrub_stamp":"2024-09-15T22:09:30.115505+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:50.060169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115245+0000","last_change":"2024-09-15T22:14:13.849547+0000","last_active":"2024-09-15T22:15:17.115245+0000","last_peered":"2024-09-15T22:15:17.115245+0000","last_clean":"2024-09-15T22:15:17.115245+0000","last_became_active":"2024-09-15T22:14:13.849091+0000","last_became_peered":"2024-09-15T22:14:13.849091+0000","last_unstale":"2024-09-15T22:15:17.115245+0000","last_undegraded":"2024-09-15T22:15:17.115245+0000","last_fullsized":"2024-09-15T22:15:17.115245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:49.450958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115014+0000","last_change":"2024-09-15T22:14:06.816340+0000","last_active":"2024-09-15T22:15:17.115014+0000","last_peered":"2024-09-15T22:15:17.115014+0000","last_clean":"2024-09-15T22:15:17.115014+0000","last_became_active":"2024-09-15T22:14:06.815712+0000","last_became_peered":"2024-09-15T22:14:06.815712+0000","last_unstale":"2024-09-15T22:15:17.115014+0000","last_undegraded":"2024-09-15T22:15:17.115014+0000","last_fullsized":"2024-09-15T22:15:17.115014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:43.598512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114651+0000","last_change":"2024-09-15T22:14:05.197487+0000","last_active":"2024-09-15T22:15:17.114651+0000","last_peered":"2024-09-15T22:15:17.114651+0000","last_clean":"2024-09-15T22:15:17.114651+0000","last_became_active":"2024-09-15T22:14:05.197098+0000","last_became_peered":"2024-09-15T22:14:05.197098+0000","last_unstale":"2024-09-15T22:15:17.114651+0000","last_undegraded":"2024-09-15T22:15:17.114651+0000","last_fullsized":"2024-09-15T22:15:17.114651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:31.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.211049+0000","last_change":"2024-09-15T22:14:13.849594+0000","last_active":"2024-09-15T22:15:17.211049+0000","last_peered":"2024-09-15T22:15:17.211049+0000","last_clean":"2024-09-15T22:15:17.211049+0000","last_became_active":"2024-09-15T22:14:13.849157+0000","last_became_peered":"2024-09-15T22:14:13.849157+0000","last_unstale":"2024-09-15T22:15:17.211049+0000","last_undegraded":"2024-09-15T22:15:17.211049+0000","last_fullsized":"2024-09-15T22:15:17.211049+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:49.994107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114822+0000","last_change":"2024-09-15T22:14:06.814312+0000","last_active":"2024-09-15T22:15:17.114822+0000","last_peered":"2024-09-15T22:15:17.114822+0000","last_clean":"2024-09-15T22:15:17.114822+0000","last_became_active":"2024-09-15T22:14:06.813959+0000","last_became_peered":"2024-09-15T22:14:06.813959+0000","last_unstale":"2024-09-15T22:15:17.114822+0000","last_undegraded":"2024-09-15T22:15:17.114822+0000","last_fullsized":"2024-09-15T22:15:17.114822+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:36.924162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118837+0000","last_change":"2024-09-15T22:14:04.713307+0000","last_active":"2024-09-15T22:15:17.118837+0000","last_peered":"2024-09-15T22:15:17.118837+0000","last_clean":"2024-09-15T22:15:17.118837+0000","last_became_active":"2024-09-15T22:14:04.712996+0000","last_became_peered":"2024-09-15T22:14:04.712996+0000","last_unstale":"2024-09-15T22:15:17.118837+0000","last_undegraded":"2024-09-15T22:15:17.118837+0000","last_fullsized":"2024-09-15T22:15:17.118837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:37.298679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401687+0000","last_change":"2024-09-15T22:14:13.846087+0000","last_active":"2024-09-15T22:15:17.401687+0000","last_peered":"2024-09-15T22:15:17.401687+0000","last_clean":"2024-09-15T22:15:17.401687+0000","last_became_active":"2024-09-15T22:14:13.845731+0000","last_became_peered":"2024-09-15T22:14:13.845731+0000","last_unstale":"2024-09-15T22:15:17.401687+0000","last_undegraded":"2024-09-15T22:15:17.401687+0000","last_fullsized":"2024-09-15T22:15:17.401687+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:24.621330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115124+0000","last_change":"2024-09-15T22:14:06.809456+0000","last_active":"2024-09-15T22:15:17.115124+0000","last_peered":"2024-09-15T22:15:17.115124+0000","last_clean":"2024-09-15T22:15:17.115124+0000","last_became_active":"2024-09-15T22:14:06.809141+0000","last_became_peered":"2024-09-15T22:14:06.809141+0000","last_unstale":"2024-09-15T22:15:17.115124+0000","last_undegraded":"2024-09-15T22:15:17.115124+0000","last_fullsized":"2024-09-15T22:15:17.115124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:30.186800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402504+0000","last_change":"2024-09-15T22:14:04.715399+0000","last_active":"2024-09-15T22:15:17.402504+0000","last_peered":"2024-09-15T22:15:17.402504+0000","last_clean":"2024-09-15T22:15:17.402504+0000","last_became_active":"2024-09-15T22:14:04.715043+0000","last_became_peered":"2024-09-15T22:14:04.715043+0000","last_unstale":"2024-09-15T22:15:17.402504+0000","last_undegraded":"2024-09-15T22:15:17.402504+0000","last_fullsized":"2024-09-15T22:15:17.402504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:13.860413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117046+0000","last_change":"2024-09-15T22:14:13.851594+0000","last_active":"2024-09-15T22:15:17.117046+0000","last_peered":"2024-09-15T22:15:17.117046+0000","last_clean":"2024-09-15T22:15:17.117046+0000","last_became_active":"2024-09-15T22:14:13.851154+0000","last_became_peered":"2024-09-15T22:14:13.851154+0000","last_unstale":"2024-09-15T22:15:17.117046+0000","last_undegraded":"2024-09-15T22:15:17.117046+0000","last_fullsized":"2024-09-15T22:15:17.117046+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:43.343808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.219587+0000","last_change":"2024-09-15T22:15:17.219587+0000","last_active":"2024-09-15T22:15:17.219587+0000","last_peered":"2024-09-15T22:15:17.219587+0000","last_clean":"2024-09-15T22:15:17.219587+0000","last_became_active":"2024-09-15T22:15:17.219207+0000","last_became_peered":"2024-09-15T22:15:17.219207+0000","last_unstale":"2024-09-15T22:15:17.219587+0000","last_undegraded":"2024-09-15T22:15:17.219587+0000","last_fullsized":"2024-09-15T22:15:17.219587+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:34.267857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.219199+0000","last_change":"2024-09-15T22:14:04.719550+0000","last_active":"2024-09-15T22:15:17.219199+0000","last_peered":"2024-09-15T22:15:17.219199+0000","last_clean":"2024-09-15T22:15:17.219199+0000","last_became_active":"2024-09-15T22:14:04.719273+0000","last_became_peered":"2024-09-15T22:14:04.719273+0000","last_unstale":"2024-09-15T22:15:17.219199+0000","last_undegraded":"2024-09-15T22:15:17.219199+0000","last_fullsized":"2024-09-15T22:15:17.219199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:20.973615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117689+0000","last_change":"2024-09-15T22:14:13.851420+0000","last_active":"2024-09-15T22:15:17.117689+0000","last_peered":"2024-09-15T22:15:17.117689+0000","last_clean":"2024-09-15T22:15:17.117689+0000","last_became_active":"2024-09-15T22:14:13.851051+0000","last_became_peered":"2024-09-15T22:14:13.851051+0000","last_unstale":"2024-09-15T22:15:17.117689+0000","last_undegraded":"2024-09-15T22:15:17.117689+0000","last_fullsized":"2024-09-15T22:15:17.117689+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:11.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117835+0000","last_change":"2024-09-15T22:14:06.809609+0000","last_active":"2024-09-15T22:15:17.117835+0000","last_peered":"2024-09-15T22:15:17.117835+0000","last_clean":"2024-09-15T22:15:17.117835+0000","last_became_active":"2024-09-15T22:14:06.809213+0000","last_became_peered":"2024-09-15T22:14:06.809213+0000","last_unstale":"2024-09-15T22:15:17.117835+0000","last_undegraded":"2024-09-15T22:15:17.117835+0000","last_fullsized":"2024-09-15T22:15:17.117835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:11.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218201+0000","last_change":"2024-09-15T22:14:05.017559+0000","last_active":"2024-09-15T22:15:17.218201+0000","last_peered":"2024-09-15T22:15:17.218201+0000","last_clean":"2024-09-15T22:15:17.218201+0000","last_became_active":"2024-09-15T22:14:05.017121+0000","last_became_peered":"2024-09-15T22:14:05.017121+0000","last_unstale":"2024-09-15T22:15:17.218201+0000","last_undegraded":"2024-09-15T22:15:17.218201+0000","last_fullsized":"2024-09-15T22:15:17.218201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:29:06.442532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402444+0000","last_change":"2024-09-15T22:14:13.847835+0000","last_active":"2024-09-15T22:15:17.402444+0000","last_peered":"2024-09-15T22:15:17.402444+0000","last_clean":"2024-09-15T22:15:17.402444+0000","last_became_active":"2024-09-15T22:14:13.847437+0000","last_became_peered":"2024-09-15T22:14:13.847437+0000","last_unstale":"2024-09-15T22:15:17.402444+0000","last_undegraded":"2024-09-15T22:15:17.402444+0000","last_fullsized":"2024-09-15T22:15:17.402444+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:48.036495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114169+0000","last_change":"2024-09-15T22:14:06.813191+0000","last_active":"2024-09-15T22:15:17.114169+0000","last_peered":"2024-09-15T22:15:17.114169+0000","last_clean":"2024-09-15T22:15:17.114169+0000","last_became_active":"2024-09-15T22:14:06.812861+0000","last_became_peered":"2024-09-15T22:14:06.812861+0000","last_unstale":"2024-09-15T22:15:17.114169+0000","last_undegraded":"2024-09-15T22:15:17.114169+0000","last_fullsized":"2024-09-15T22:15:17.114169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:51.487591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115991+0000","last_change":"2024-09-15T22:14:04.718431+0000","last_active":"2024-09-15T22:15:17.115991+0000","last_peered":"2024-09-15T22:15:17.115991+0000","last_clean":"2024-09-15T22:15:17.115991+0000","last_became_active":"2024-09-15T22:14:04.718109+0000","last_became_peered":"2024-09-15T22:14:04.718109+0000","last_unstale":"2024-09-15T22:15:17.115991+0000","last_undegraded":"2024-09-15T22:15:17.115991+0000","last_fullsized":"2024-09-15T22:15:17.115991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:10.408634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114008+0000","last_change":"2024-09-15T22:14:13.845179+0000","last_active":"2024-09-15T22:15:17.114008+0000","last_peered":"2024-09-15T22:15:17.114008+0000","last_clean":"2024-09-15T22:15:17.114008+0000","last_became_active":"2024-09-15T22:14:13.844795+0000","last_became_peered":"2024-09-15T22:14:13.844795+0000","last_unstale":"2024-09-15T22:15:17.114008+0000","last_undegraded":"2024-09-15T22:15:17.114008+0000","last_fullsized":"2024-09-15T22:15:17.114008+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:24.113536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114356+0000","last_change":"2024-09-15T22:14:06.809687+0000","last_active":"2024-09-15T22:15:17.114356+0000","last_peered":"2024-09-15T22:15:17.114356+0000","last_clean":"2024-09-15T22:15:17.114356+0000","last_became_active":"2024-09-15T22:14:06.809383+0000","last_became_peered":"2024-09-15T22:14:06.809383+0000","last_unstale":"2024-09-15T22:15:17.114356+0000","last_undegraded":"2024-09-15T22:15:17.114356+0000","last_fullsized":"2024-09-15T22:15:17.114356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:19.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.119105+0000","last_change":"2024-09-15T22:14:04.720577+0000","last_active":"2024-09-15T22:15:17.119105+0000","last_peered":"2024-09-15T22:15:17.119105+0000","last_clean":"2024-09-15T22:15:17.119105+0000","last_became_active":"2024-09-15T22:14:04.720235+0000","last_became_peered":"2024-09-15T22:14:04.720235+0000","last_unstale":"2024-09-15T22:15:17.119105+0000","last_undegraded":"2024-09-15T22:15:17.119105+0000","last_fullsized":"2024-09-15T22:15:17.119105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:17.501061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117753+0000","last_change":"2024-09-15T22:14:13.854841+0000","last_active":"2024-09-15T22:15:17.117753+0000","last_peered":"2024-09-15T22:15:17.117753+0000","last_clean":"2024-09-15T22:15:17.117753+0000","last_became_active":"2024-09-15T22:14:13.854336+0000","last_became_peered":"2024-09-15T22:14:13.854336+0000","last_unstale":"2024-09-15T22:15:17.117753+0000","last_undegraded":"2024-09-15T22:15:17.117753+0000","last_fullsized":"2024-09-15T22:15:17.117753+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:13.819532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402349+0000","last_change":"2024-09-15T22:14:06.806829+0000","last_active":"2024-09-15T22:15:17.402349+0000","last_peered":"2024-09-15T22:15:17.402349+0000","last_clean":"2024-09-15T22:15:17.402349+0000","last_became_active":"2024-09-15T22:14:06.806521+0000","last_became_peered":"2024-09-15T22:14:06.806521+0000","last_unstale":"2024-09-15T22:15:17.402349+0000","last_undegraded":"2024-09-15T22:15:17.402349+0000","last_fullsized":"2024-09-15T22:15:17.402349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:50.983246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114670+0000","last_change":"2024-09-15T22:14:04.717722+0000","last_active":"2024-09-15T22:15:17.114670+0000","last_peered":"2024-09-15T22:15:17.114670+0000","last_clean":"2024-09-15T22:15:17.114670+0000","last_became_active":"2024-09-15T22:14:04.717201+0000","last_became_peered":"2024-09-15T22:14:04.717201+0000","last_unstale":"2024-09-15T22:15:17.114670+0000","last_undegraded":"2024-09-15T22:15:17.114670+0000","last_fullsized":"2024-09-15T22:15:17.114670+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:50.545847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118218+0000","last_change":"2024-09-15T22:14:13.852874+0000","last_active":"2024-09-15T22:15:17.118218+0000","last_peered":"2024-09-15T22:15:17.118218+0000","last_clean":"2024-09-15T22:15:17.118218+0000","last_became_active":"2024-09-15T22:14:13.852426+0000","last_became_peered":"2024-09-15T22:14:13.852426+0000","last_unstale":"2024-09-15T22:15:17.118218+0000","last_undegraded":"2024-09-15T22:15:17.118218+0000","last_fullsized":"2024-09-15T22:15:17.118218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:02:19.215156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218763+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:15:17.218763+0000","last_peered":"2024-09-15T22:15:17.218763+0000","last_clean":"2024-09-15T22:15:17.218763+0000","last_became_active":"2024-09-15T22:14:06.809013+0000","last_became_peered":"2024-09-15T22:14:06.809013+0000","last_unstale":"2024-09-15T22:15:17.218763+0000","last_undegraded":"2024-09-15T22:15:17.218763+0000","last_fullsized":"2024-09-15T22:15:17.218763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:47.830385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'32","reported_seq":178,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:35.019936+0000","last_change":"2024-09-15T22:14:04.721020+0000","last_active":"2024-09-15T22:15:35.019936+0000","last_peered":"2024-09-15T22:15:35.019936+0000","last_clean":"2024-09-15T22:15:35.019936+0000","last_became_active":"2024-09-15T22:14:04.720613+0000","last_became_peered":"2024-09-15T22:14:04.720613+0000","last_unstale":"2024-09-15T22:15:35.019936+0000","last_undegraded":"2024-09-15T22:15:35.019936+0000","last_fullsized":"2024-09-15T22:15:35.019936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:42.719346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65131,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":120,"num_write":32,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113593+0000","last_change":"2024-09-15T22:14:13.854250+0000","last_active":"2024-09-15T22:15:17.113593+0000","last_peered":"2024-09-15T22:15:17.113593+0000","last_clean":"2024-09-15T22:15:17.113593+0000","last_became_active":"2024-09-15T22:14:13.852972+0000","last_became_peered":"2024-09-15T22:14:13.852972+0000","last_unstale":"2024-09-15T22:15:17.113593+0000","last_undegraded":"2024-09-15T22:15:17.113593+0000","last_fullsized":"2024-09-15T22:15:17.113593+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:50:45.301446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.211076+0000","last_change":"2024-09-15T22:14:06.813789+0000","last_active":"2024-09-15T22:15:17.211076+0000","last_peered":"2024-09-15T22:15:17.211076+0000","last_clean":"2024-09-15T22:15:17.211076+0000","last_became_active":"2024-09-15T22:14:06.813501+0000","last_became_peered":"2024-09-15T22:14:06.813501+0000","last_unstale":"2024-09-15T22:15:17.211076+0000","last_undegraded":"2024-09-15T22:15:17.211076+0000","last_fullsized":"2024-09-15T22:15:17.211076+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:40.032952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118679+0000","last_change":"2024-09-15T22:14:05.018957+0000","last_active":"2024-09-15T22:15:17.118679+0000","last_peered":"2024-09-15T22:15:17.118679+0000","last_clean":"2024-09-15T22:15:17.118679+0000","last_became_active":"2024-09-15T22:14:05.018602+0000","last_became_peered":"2024-09-15T22:14:05.018602+0000","last_unstale":"2024-09-15T22:15:17.118679+0000","last_undegraded":"2024-09-15T22:15:17.118679+0000","last_fullsized":"2024-09-15T22:15:17.118679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:48.839341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.332417+0000","last_change":"2024-09-15T22:15:17.332417+0000","last_active":"2024-09-15T22:15:17.332417+0000","last_peered":"2024-09-15T22:15:17.332417+0000","last_clean":"2024-09-15T22:15:17.332417+0000","last_became_active":"2024-09-15T22:15:17.331771+0000","last_became_peered":"2024-09-15T22:15:17.331771+0000","last_unstale":"2024-09-15T22:15:17.332417+0000","last_undegraded":"2024-09-15T22:15:17.332417+0000","last_fullsized":"2024-09-15T22:15:17.332417+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:08.575035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402622+0000","last_change":"2024-09-15T22:14:06.814876+0000","last_active":"2024-09-15T22:15:17.402622+0000","last_peered":"2024-09-15T22:15:17.402622+0000","last_clean":"2024-09-15T22:15:17.402622+0000","last_became_active":"2024-09-15T22:14:06.814120+0000","last_became_peered":"2024-09-15T22:14:06.814120+0000","last_unstale":"2024-09-15T22:15:17.402622+0000","last_undegraded":"2024-09-15T22:15:17.402622+0000","last_fullsized":"2024-09-15T22:15:17.402622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:37.417618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114938+0000","last_change":"2024-09-15T22:14:04.719281+0000","last_active":"2024-09-15T22:15:17.114938+0000","last_peered":"2024-09-15T22:15:17.114938+0000","last_clean":"2024-09-15T22:15:17.114938+0000","last_became_active":"2024-09-15T22:14:04.718856+0000","last_became_peered":"2024-09-15T22:14:04.718856+0000","last_unstale":"2024-09-15T22:15:17.114938+0000","last_undegraded":"2024-09-15T22:15:17.114938+0000","last_fullsized":"2024-09-15T22:15:17.114938+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:22.137825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113159+0000","last_change":"2024-09-15T22:14:13.847398+0000","last_active":"2024-09-15T22:15:17.113159+0000","last_peered":"2024-09-15T22:15:17.113159+0000","last_clean":"2024-09-15T22:15:17.113159+0000","last_became_active":"2024-09-15T22:14:13.846870+0000","last_became_peered":"2024-09-15T22:14:13.846870+0000","last_unstale":"2024-09-15T22:15:17.113159+0000","last_undegraded":"2024-09-15T22:15:17.113159+0000","last_fullsized":"2024-09-15T22:15:17.113159+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:58.872716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.211648+0000","last_change":"2024-09-15T22:14:06.810412+0000","last_active":"2024-09-15T22:15:17.211648+0000","last_peered":"2024-09-15T22:15:17.211648+0000","last_clean":"2024-09-15T22:15:17.211648+0000","last_became_active":"2024-09-15T22:14:06.809669+0000","last_became_peered":"2024-09-15T22:14:06.809669+0000","last_unstale":"2024-09-15T22:15:17.211648+0000","last_undegraded":"2024-09-15T22:15:17.211648+0000","last_fullsized":"2024-09-15T22:15:17.211648+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:44.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.331016+0000","last_change":"2024-09-15T22:14:04.715509+0000","last_active":"2024-09-15T22:15:17.331016+0000","last_peered":"2024-09-15T22:15:17.331016+0000","last_clean":"2024-09-15T22:15:17.331016+0000","last_became_active":"2024-09-15T22:14:04.715169+0000","last_became_peered":"2024-09-15T22:14:04.715169+0000","last_unstale":"2024-09-15T22:15:17.331016+0000","last_undegraded":"2024-09-15T22:15:17.331016+0000","last_fullsized":"2024-09-15T22:15:17.331016+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:21.884103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.219519+0000","last_change":"2024-09-15T22:15:17.219519+0000","last_active":"2024-09-15T22:15:17.219519+0000","last_peered":"2024-09-15T22:15:17.219519+0000","last_clean":"2024-09-15T22:15:17.219519+0000","last_became_active":"2024-09-15T22:15:17.219106+0000","last_became_peered":"2024-09-15T22:15:17.219106+0000","last_unstale":"2024-09-15T22:15:17.219519+0000","last_undegraded":"2024-09-15T22:15:17.219519+0000","last_fullsized":"2024-09-15T22:15:17.219519+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:54:08.102329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401712+0000","last_change":"2024-09-15T22:14:13.844375+0000","last_active":"2024-09-15T22:15:17.401712+0000","last_peered":"2024-09-15T22:15:17.401712+0000","last_clean":"2024-09-15T22:15:17.401712+0000","last_became_active":"2024-09-15T22:14:13.843918+0000","last_became_peered":"2024-09-15T22:14:13.843918+0000","last_unstale":"2024-09-15T22:15:17.401712+0000","last_undegraded":"2024-09-15T22:15:17.401712+0000","last_fullsized":"2024-09-15T22:15:17.401712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:32.190119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113287+0000","last_change":"2024-09-15T22:14:06.809534+0000","last_active":"2024-09-15T22:15:17.113287+0000","last_peered":"2024-09-15T22:15:17.113287+0000","last_clean":"2024-09-15T22:15:17.113287+0000","last_became_active":"2024-09-15T22:14:06.809147+0000","last_became_peered":"2024-09-15T22:14:06.809147+0000","last_unstale":"2024-09-15T22:15:17.113287+0000","last_undegraded":"2024-09-15T22:15:17.113287+0000","last_fullsized":"2024-09-15T22:15:17.113287+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:14.930542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118007+0000","last_change":"2024-09-15T22:14:04.715347+0000","last_active":"2024-09-15T22:15:17.118007+0000","last_peered":"2024-09-15T22:15:17.118007+0000","last_clean":"2024-09-15T22:15:17.118007+0000","last_became_active":"2024-09-15T22:14:04.715049+0000","last_became_peered":"2024-09-15T22:14:04.715049+0000","last_unstale":"2024-09-15T22:15:17.118007+0000","last_undegraded":"2024-09-15T22:15:17.118007+0000","last_fullsized":"2024-09-15T22:15:17.118007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:04.943344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118740+0000","last_change":"2024-09-15T22:14:13.852397+0000","last_active":"2024-09-15T22:15:17.118740+0000","last_peered":"2024-09-15T22:15:17.118740+0000","last_clean":"2024-09-15T22:15:17.118740+0000","last_became_active":"2024-09-15T22:14:13.851863+0000","last_became_peered":"2024-09-15T22:14:13.851863+0000","last_unstale":"2024-09-15T22:15:17.118740+0000","last_undegraded":"2024-09-15T22:15:17.118740+0000","last_fullsized":"2024-09-15T22:15:17.118740+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:38.242241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115763+0000","last_change":"2024-09-15T22:14:06.809084+0000","last_active":"2024-09-15T22:15:17.115763+0000","last_peered":"2024-09-15T22:15:17.115763+0000","last_clean":"2024-09-15T22:15:17.115763+0000","last_became_active":"2024-09-15T22:14:06.808725+0000","last_became_peered":"2024-09-15T22:14:06.808725+0000","last_unstale":"2024-09-15T22:15:17.115763+0000","last_undegraded":"2024-09-15T22:15:17.115763+0000","last_fullsized":"2024-09-15T22:15:17.115763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:37.451661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401872+0000","last_change":"2024-09-15T22:14:04.714279+0000","last_active":"2024-09-15T22:15:17.401872+0000","last_peered":"2024-09-15T22:15:17.401872+0000","last_clean":"2024-09-15T22:15:17.401872+0000","last_became_active":"2024-09-15T22:14:04.713751+0000","last_became_peered":"2024-09-15T22:14:04.713751+0000","last_unstale":"2024-09-15T22:15:17.401872+0000","last_undegraded":"2024-09-15T22:15:17.401872+0000","last_fullsized":"2024-09-15T22:15:17.401872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:34.268701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.330638+0000","last_change":"2024-09-15T22:14:04.716417+0000","last_active":"2024-09-15T22:15:17.330638+0000","last_peered":"2024-09-15T22:15:17.330638+0000","last_clean":"2024-09-15T22:15:17.330638+0000","last_became_active":"2024-09-15T22:14:04.716096+0000","last_became_peered":"2024-09-15T22:14:04.716096+0000","last_unstale":"2024-09-15T22:15:17.330638+0000","last_undegraded":"2024-09-15T22:15:17.330638+0000","last_fullsized":"2024-09-15T22:15:17.330638+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:30.819060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.403940+0000","last_change":"2024-09-15T22:15:17.403940+0000","last_active":"2024-09-15T22:15:17.403940+0000","last_peered":"2024-09-15T22:15:17.403940+0000","last_clean":"2024-09-15T22:15:17.403940+0000","last_became_active":"2024-09-15T22:15:17.403517+0000","last_became_peered":"2024-09-15T22:15:17.403517+0000","last_unstale":"2024-09-15T22:15:17.403940+0000","last_undegraded":"2024-09-15T22:15:17.403940+0000","last_fullsized":"2024-09-15T22:15:17.403940+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:49.602367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.404136+0000","last_change":"2024-09-15T22:15:17.404136+0000","last_active":"2024-09-15T22:15:17.404136+0000","last_peered":"2024-09-15T22:15:17.404136+0000","last_clean":"2024-09-15T22:15:17.404136+0000","last_became_active":"2024-09-15T22:15:17.403652+0000","last_became_peered":"2024-09-15T22:15:17.403652+0000","last_unstale":"2024-09-15T22:15:17.404136+0000","last_undegraded":"2024-09-15T22:15:17.404136+0000","last_fullsized":"2024-09-15T22:15:17.404136+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:31.518956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118541+0000","last_change":"2024-09-15T22:14:04.718682+0000","last_active":"2024-09-15T22:15:17.118541+0000","last_peered":"2024-09-15T22:15:17.118541+0000","last_clean":"2024-09-15T22:15:17.118541+0000","last_became_active":"2024-09-15T22:14:04.718313+0000","last_became_peered":"2024-09-15T22:14:04.718313+0000","last_unstale":"2024-09-15T22:15:17.118541+0000","last_undegraded":"2024-09-15T22:15:17.118541+0000","last_fullsized":"2024-09-15T22:15:17.118541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:47.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218353+0000","last_change":"2024-09-15T22:14:06.819632+0000","last_active":"2024-09-15T22:15:17.218353+0000","last_peered":"2024-09-15T22:15:17.218353+0000","last_clean":"2024-09-15T22:15:17.218353+0000","last_became_active":"2024-09-15T22:14:06.819135+0000","last_became_peered":"2024-09-15T22:14:06.819135+0000","last_unstale":"2024-09-15T22:15:17.218353+0000","last_undegraded":"2024-09-15T22:15:17.218353+0000","last_fullsized":"2024-09-15T22:15:17.218353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:35.708318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114475+0000","last_change":"2024-09-15T22:14:13.851367+0000","last_active":"2024-09-15T22:15:17.114475+0000","last_peered":"2024-09-15T22:15:17.114475+0000","last_clean":"2024-09-15T22:15:17.114475+0000","last_became_active":"2024-09-15T22:14:13.850999+0000","last_became_peered":"2024-09-15T22:14:13.850999+0000","last_unstale":"2024-09-15T22:15:17.114475+0000","last_undegraded":"2024-09-15T22:15:17.114475+0000","last_fullsized":"2024-09-15T22:15:17.114475+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:40:03.957622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117444+0000","last_change":"2024-09-15T22:14:06.817213+0000","last_active":"2024-09-15T22:15:17.117444+0000","last_peered":"2024-09-15T22:15:17.117444+0000","last_clean":"2024-09-15T22:15:17.117444+0000","last_became_active":"2024-09-15T22:14:06.816828+0000","last_became_peered":"2024-09-15T22:14:06.816828+0000","last_unstale":"2024-09-15T22:15:17.117444+0000","last_undegraded":"2024-09-15T22:15:17.117444+0000","last_fullsized":"2024-09-15T22:15:17.117444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:55.042256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115253+0000","last_change":"2024-09-15T22:14:06.814832+0000","last_active":"2024-09-15T22:15:17.115253+0000","last_peered":"2024-09-15T22:15:17.115253+0000","last_clean":"2024-09-15T22:15:17.115253+0000","last_became_active":"2024-09-15T22:14:06.814500+0000","last_became_peered":"2024-09-15T22:14:06.814500+0000","last_unstale":"2024-09-15T22:15:17.115253+0000","last_undegraded":"2024-09-15T22:15:17.115253+0000","last_fullsized":"2024-09-15T22:15:17.115253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:43.623629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114097+0000","last_change":"2024-09-15T22:14:06.809464+0000","last_active":"2024-09-15T22:15:17.114097+0000","last_peered":"2024-09-15T22:15:17.114097+0000","last_clean":"2024-09-15T22:15:17.114097+0000","last_became_active":"2024-09-15T22:14:06.809160+0000","last_became_peered":"2024-09-15T22:14:06.809160+0000","last_unstale":"2024-09-15T22:15:17.114097+0000","last_undegraded":"2024-09-15T22:15:17.114097+0000","last_fullsized":"2024-09-15T22:15:17.114097+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:04.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401782+0000","last_change":"2024-09-15T22:14:06.814428+0000","last_active":"2024-09-15T22:15:17.401782+0000","last_peered":"2024-09-15T22:15:17.401782+0000","last_clean":"2024-09-15T22:15:17.401782+0000","last_became_active":"2024-09-15T22:14:06.814100+0000","last_became_peered":"2024-09-15T22:14:06.814100+0000","last_unstale":"2024-09-15T22:15:17.401782+0000","last_undegraded":"2024-09-15T22:15:17.401782+0000","last_fullsized":"2024-09-15T22:15:17.401782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:33.606766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402224+0000","last_change":"2024-09-15T22:14:06.815638+0000","last_active":"2024-09-15T22:15:17.402224+0000","last_peered":"2024-09-15T22:15:17.402224+0000","last_clean":"2024-09-15T22:15:17.402224+0000","last_became_active":"2024-09-15T22:14:06.815327+0000","last_became_peered":"2024-09-15T22:14:06.815327+0000","last_unstale":"2024-09-15T22:15:17.402224+0000","last_undegraded":"2024-09-15T22:15:17.402224+0000","last_fullsized":"2024-09-15T22:15:17.402224+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:07.679547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218238+0000","last_change":"2024-09-15T22:15:17.218238+0000","last_active":"2024-09-15T22:15:17.218238+0000","last_peered":"2024-09-15T22:15:17.218238+0000","last_clean":"2024-09-15T22:15:17.218238+0000","last_became_active":"2024-09-15T22:15:17.217852+0000","last_became_peered":"2024-09-15T22:15:17.217852+0000","last_unstale":"2024-09-15T22:15:17.218238+0000","last_undegraded":"2024-09-15T22:15:17.218238+0000","last_fullsized":"2024-09-15T22:15:17.218238+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:42.046956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.115214+0000","last_change":"2024-09-15T22:14:06.819667+0000","last_active":"2024-09-15T22:15:17.115214+0000","last_peered":"2024-09-15T22:15:17.115214+0000","last_clean":"2024-09-15T22:15:17.115214+0000","last_became_active":"2024-09-15T22:14:06.819389+0000","last_became_peered":"2024-09-15T22:14:06.819389+0000","last_unstale":"2024-09-15T22:15:17.115214+0000","last_undegraded":"2024-09-15T22:15:17.115214+0000","last_fullsized":"2024-09-15T22:15:17.115214+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:16.571088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118133+0000","last_change":"2024-09-15T22:15:17.118133+0000","last_active":"2024-09-15T22:15:17.118133+0000","last_peered":"2024-09-15T22:15:17.118133+0000","last_clean":"2024-09-15T22:15:17.118133+0000","last_became_active":"2024-09-15T22:15:17.117802+0000","last_became_peered":"2024-09-15T22:15:17.117802+0000","last_unstale":"2024-09-15T22:15:17.118133+0000","last_undegraded":"2024-09-15T22:15:17.118133+0000","last_fullsized":"2024-09-15T22:15:17.118133+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:21.523149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117550+0000","last_change":"2024-09-15T22:14:06.801454+0000","last_active":"2024-09-15T22:15:17.117550+0000","last_peered":"2024-09-15T22:15:17.117550+0000","last_clean":"2024-09-15T22:15:17.117550+0000","last_became_active":"2024-09-15T22:14:06.801105+0000","last_became_peered":"2024-09-15T22:14:06.801105+0000","last_unstale":"2024-09-15T22:15:17.117550+0000","last_undegraded":"2024-09-15T22:15:17.117550+0000","last_fullsized":"2024-09-15T22:15:17.117550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:32.457428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116340+0000","last_change":"2024-09-15T22:14:06.812603+0000","last_active":"2024-09-15T22:15:17.116340+0000","last_peered":"2024-09-15T22:15:17.116340+0000","last_clean":"2024-09-15T22:15:17.116340+0000","last_became_active":"2024-09-15T22:14:06.812208+0000","last_became_peered":"2024-09-15T22:14:06.812208+0000","last_unstale":"2024-09-15T22:15:17.116340+0000","last_undegraded":"2024-09-15T22:15:17.116340+0000","last_fullsized":"2024-09-15T22:15:17.116340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:55.327481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.211250+0000","last_change":"2024-09-15T22:14:06.811783+0000","last_active":"2024-09-15T22:15:17.211250+0000","last_peered":"2024-09-15T22:15:17.211250+0000","last_clean":"2024-09-15T22:15:17.211250+0000","last_became_active":"2024-09-15T22:14:06.811208+0000","last_became_peered":"2024-09-15T22:14:06.811208+0000","last_unstale":"2024-09-15T22:15:17.211250+0000","last_undegraded":"2024-09-15T22:15:17.211250+0000","last_fullsized":"2024-09-15T22:15:17.211250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:15.576776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402755+0000","last_change":"2024-09-15T22:14:06.818608+0000","last_active":"2024-09-15T22:15:17.402755+0000","last_peered":"2024-09-15T22:15:17.402755+0000","last_clean":"2024-09-15T22:15:17.402755+0000","last_became_active":"2024-09-15T22:14:06.818283+0000","last_became_peered":"2024-09-15T22:14:06.818283+0000","last_unstale":"2024-09-15T22:15:17.402755+0000","last_undegraded":"2024-09-15T22:15:17.402755+0000","last_fullsized":"2024-09-15T22:15:17.402755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:02.477461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.117862+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:15:17.117862+0000","last_peered":"2024-09-15T22:15:17.117862+0000","last_clean":"2024-09-15T22:15:17.117862+0000","last_became_active":"2024-09-15T22:14:06.809043+0000","last_became_peered":"2024-09-15T22:14:06.809043+0000","last_unstale":"2024-09-15T22:15:17.117862+0000","last_undegraded":"2024-09-15T22:15:17.117862+0000","last_fullsized":"2024-09-15T22:15:17.117862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:58.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114731+0000","last_change":"2024-09-15T22:14:06.814875+0000","last_active":"2024-09-15T22:15:17.114731+0000","last_peered":"2024-09-15T22:15:17.114731+0000","last_clean":"2024-09-15T22:15:17.114731+0000","last_became_active":"2024-09-15T22:14:06.814543+0000","last_became_peered":"2024-09-15T22:14:06.814543+0000","last_unstale":"2024-09-15T22:15:17.114731+0000","last_undegraded":"2024-09-15T22:15:17.114731+0000","last_fullsized":"2024-09-15T22:15:17.114731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:57.465965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.113872+0000","last_change":"2024-09-15T22:14:06.810655+0000","last_active":"2024-09-15T22:15:17.113872+0000","last_peered":"2024-09-15T22:15:17.113872+0000","last_clean":"2024-09-15T22:15:17.113872+0000","last_became_active":"2024-09-15T22:14:06.810159+0000","last_became_peered":"2024-09-15T22:14:06.810159+0000","last_unstale":"2024-09-15T22:15:17.113872+0000","last_undegraded":"2024-09-15T22:15:17.113872+0000","last_fullsized":"2024-09-15T22:15:17.113872+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:17.368982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.119054+0000","last_change":"2024-09-15T22:14:06.815048+0000","last_active":"2024-09-15T22:15:17.119054+0000","last_peered":"2024-09-15T22:15:17.119054+0000","last_clean":"2024-09-15T22:15:17.119054+0000","last_became_active":"2024-09-15T22:14:06.814744+0000","last_became_peered":"2024-09-15T22:14:06.814744+0000","last_unstale":"2024-09-15T22:15:17.119054+0000","last_undegraded":"2024-09-15T22:15:17.119054+0000","last_fullsized":"2024-09-15T22:15:17.119054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:26.927942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.210769+0000","last_change":"2024-09-15T22:14:06.811672+0000","last_active":"2024-09-15T22:15:17.210769+0000","last_peered":"2024-09-15T22:15:17.210769+0000","last_clean":"2024-09-15T22:15:17.210769+0000","last_became_active":"2024-09-15T22:14:06.811300+0000","last_became_peered":"2024-09-15T22:14:06.811300+0000","last_unstale":"2024-09-15T22:15:17.210769+0000","last_undegraded":"2024-09-15T22:15:17.210769+0000","last_fullsized":"2024-09-15T22:15:17.210769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:46.223584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401676+0000","last_change":"2024-09-15T22:14:06.814495+0000","last_active":"2024-09-15T22:15:17.401676+0000","last_peered":"2024-09-15T22:15:17.401676+0000","last_clean":"2024-09-15T22:15:17.401676+0000","last_became_active":"2024-09-15T22:14:06.814142+0000","last_became_peered":"2024-09-15T22:14:06.814142+0000","last_unstale":"2024-09-15T22:15:17.401676+0000","last_undegraded":"2024-09-15T22:15:17.401676+0000","last_fullsized":"2024-09-15T22:15:17.401676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:20.374348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401520+0000","last_change":"2024-09-15T22:14:06.811063+0000","last_active":"2024-09-15T22:15:17.401520+0000","last_peered":"2024-09-15T22:15:17.401520+0000","last_clean":"2024-09-15T22:15:17.401520+0000","last_became_active":"2024-09-15T22:14:06.810700+0000","last_became_peered":"2024-09-15T22:14:06.810700+0000","last_unstale":"2024-09-15T22:15:17.401520+0000","last_undegraded":"2024-09-15T22:15:17.401520+0000","last_fullsized":"2024-09-15T22:15:17.401520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:11.250590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.402708+0000","last_change":"2024-09-15T22:14:06.816896+0000","last_active":"2024-09-15T22:15:17.402708+0000","last_peered":"2024-09-15T22:15:17.402708+0000","last_clean":"2024-09-15T22:15:17.402708+0000","last_became_active":"2024-09-15T22:14:06.816559+0000","last_became_peered":"2024-09-15T22:14:06.816559+0000","last_unstale":"2024-09-15T22:15:17.402708+0000","last_undegraded":"2024-09-15T22:15:17.402708+0000","last_fullsized":"2024-09-15T22:15:17.402708+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:17.965490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116284+0000","last_change":"2024-09-15T22:14:06.813984+0000","last_active":"2024-09-15T22:15:17.116284+0000","last_peered":"2024-09-15T22:15:17.116284+0000","last_clean":"2024-09-15T22:15:17.116284+0000","last_became_active":"2024-09-15T22:14:06.813586+0000","last_became_peered":"2024-09-15T22:14:06.813586+0000","last_unstale":"2024-09-15T22:15:17.116284+0000","last_undegraded":"2024-09-15T22:15:17.116284+0000","last_fullsized":"2024-09-15T22:15:17.116284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:34.335741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114898+0000","last_change":"2024-09-15T22:14:06.816047+0000","last_active":"2024-09-15T22:15:17.114898+0000","last_peered":"2024-09-15T22:15:17.114898+0000","last_clean":"2024-09-15T22:15:17.114898+0000","last_became_active":"2024-09-15T22:14:06.815244+0000","last_became_peered":"2024-09-15T22:14:06.815244+0000","last_unstale":"2024-09-15T22:15:17.114898+0000","last_undegraded":"2024-09-15T22:15:17.114898+0000","last_fullsized":"2024-09-15T22:15:17.114898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:30.469382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.331051+0000","last_change":"2024-09-15T22:14:06.813254+0000","last_active":"2024-09-15T22:15:17.331051+0000","last_peered":"2024-09-15T22:15:17.331051+0000","last_clean":"2024-09-15T22:15:17.331051+0000","last_became_active":"2024-09-15T22:14:06.812921+0000","last_became_peered":"2024-09-15T22:14:06.812921+0000","last_unstale":"2024-09-15T22:15:17.331051+0000","last_undegraded":"2024-09-15T22:15:17.331051+0000","last_fullsized":"2024-09-15T22:15:17.331051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:40.674246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.211772+0000","last_change":"2024-09-15T22:14:06.817016+0000","last_active":"2024-09-15T22:15:17.211772+0000","last_peered":"2024-09-15T22:15:17.211772+0000","last_clean":"2024-09-15T22:15:17.211772+0000","last_became_active":"2024-09-15T22:14:06.816256+0000","last_became_peered":"2024-09-15T22:14:06.816256+0000","last_unstale":"2024-09-15T22:15:17.211772+0000","last_undegraded":"2024-09-15T22:15:17.211772+0000","last_fullsized":"2024-09-15T22:15:17.211772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:37.092156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.331450+0000","last_change":"2024-09-15T22:15:17.331108+0000","last_active":"2024-09-15T22:15:17.331450+0000","last_peered":"2024-09-15T22:15:17.331450+0000","last_clean":"2024-09-15T22:15:17.331450+0000","last_became_active":"2024-09-15T22:15:17.330765+0000","last_became_peered":"2024-09-15T22:15:17.330765+0000","last_unstale":"2024-09-15T22:15:17.331450+0000","last_undegraded":"2024-09-15T22:15:17.331450+0000","last_fullsized":"2024-09-15T22:15:17.331450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:37.975326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.114225+0000","last_change":"2024-09-15T22:14:06.814902+0000","last_active":"2024-09-15T22:15:17.114225+0000","last_peered":"2024-09-15T22:15:17.114225+0000","last_clean":"2024-09-15T22:15:17.114225+0000","last_became_active":"2024-09-15T22:14:06.814563+0000","last_became_peered":"2024-09-15T22:14:06.814563+0000","last_unstale":"2024-09-15T22:15:17.114225+0000","last_undegraded":"2024-09-15T22:15:17.114225+0000","last_fullsized":"2024-09-15T22:15:17.114225+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:02.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.330534+0000","last_change":"2024-09-15T22:14:06.807444+0000","last_active":"2024-09-15T22:15:17.330534+0000","last_peered":"2024-09-15T22:15:17.330534+0000","last_clean":"2024-09-15T22:15:17.330534+0000","last_became_active":"2024-09-15T22:14:06.807083+0000","last_became_peered":"2024-09-15T22:14:06.807083+0000","last_unstale":"2024-09-15T22:15:17.330534+0000","last_undegraded":"2024-09-15T22:15:17.330534+0000","last_fullsized":"2024-09-15T22:15:17.330534+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:07.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.218033+0000","last_change":"2024-09-15T22:14:06.811851+0000","last_active":"2024-09-15T22:15:17.218033+0000","last_peered":"2024-09-15T22:15:17.218033+0000","last_clean":"2024-09-15T22:15:17.218033+0000","last_became_active":"2024-09-15T22:14:06.811451+0000","last_became_peered":"2024-09-15T22:14:06.811451+0000","last_unstale":"2024-09-15T22:15:17.218033+0000","last_undegraded":"2024-09-15T22:15:17.218033+0000","last_fullsized":"2024-09-15T22:15:17.218033+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:51.389555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.116394+0000","last_change":"2024-09-15T22:14:06.812520+0000","last_active":"2024-09-15T22:15:17.116394+0000","last_peered":"2024-09-15T22:15:17.116394+0000","last_clean":"2024-09-15T22:15:17.116394+0000","last_became_active":"2024-09-15T22:14:06.812222+0000","last_became_peered":"2024-09-15T22:14:06.812222+0000","last_unstale":"2024-09-15T22:15:17.116394+0000","last_undegraded":"2024-09-15T22:15:17.116394+0000","last_fullsized":"2024-09-15T22:15:17.116394+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:01.589678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401960+0000","last_change":"2024-09-15T22:14:06.808649+0000","last_active":"2024-09-15T22:15:17.401960+0000","last_peered":"2024-09-15T22:15:17.401960+0000","last_clean":"2024-09-15T22:15:17.401960+0000","last_became_active":"2024-09-15T22:14:06.808278+0000","last_became_peered":"2024-09-15T22:14:06.808278+0000","last_unstale":"2024-09-15T22:15:17.401960+0000","last_undegraded":"2024-09-15T22:15:17.401960+0000","last_fullsized":"2024-09-15T22:15:17.401960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:32.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.401821+0000","last_change":"2024-09-15T22:14:06.811593+0000","last_active":"2024-09-15T22:15:17.401821+0000","last_peered":"2024-09-15T22:15:17.401821+0000","last_clean":"2024-09-15T22:15:17.401821+0000","last_became_active":"2024-09-15T22:14:06.811285+0000","last_became_peered":"2024-09-15T22:14:06.811285+0000","last_unstale":"2024-09-15T22:15:17.401821+0000","last_undegraded":"2024-09-15T22:15:17.401821+0000","last_fullsized":"2024-09-15T22:15:17.401821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:36.482554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T22:15:17.118997+0000","last_change":"2024-09-15T22:14:06.816084+0000","last_active":"2024-09-15T22:15:17.118997+0000","last_peered":"2024-09-15T22:15:17.118997+0000","last_clean":"2024-09-15T22:15:17.118997+0000","last_became_active":"2024-09-15T22:14:06.815461+0000","last_became_peered":"2024-09-15T22:14:06.815461+0000","last_unstale":"2024-09-15T22:15:17.118997+0000","last_undegraded":"2024-09-15T22:15:17.118997+0000","last_fullsized":"2024-09-15T22:15:17.118997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:57.455608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65929,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":118,"num_read_kb":126,"num_write":89,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":197787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547232,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1011712,"data_stored":501160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776164,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1687552,"data_stored":1152757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939689,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":505838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168623,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1019904,"data_stored":501764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430259,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1613824,"data_stored":1096206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593785,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1007616,"data_stored":497064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822718,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36932,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708220,"statfs":{"total":95995035648,"available":95957217280,"internally_reserved":0,"allocated":1617920,"data_stored":1091710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986242,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1015808,"data_stored":501182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215176,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1015808,"data_stored":497168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1085440,"data_stored":562229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1081344,"data_stored":562195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40496,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704656,"statfs":{"total":95995035648,"available":95953567744,"internally_reserved":0,"allocated":1011712,"data_stored":497154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":65165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:15:41.812 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T22:15:41.812 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T22:15:41.812 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-15T22:15:41.812 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-15T22:15:42.074 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:42.338 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:42 smithi045 ceph-mon[31180]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:15:42.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:42 smithi165 ceph-mon[35551]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:15:42.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:42 smithi100 ceph-mon[35319]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:15:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.561+0000 7fef699ef640 1 -- 172.21.15.45:0/3691339807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef641036e0 msgr2=0x7fef64107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.561+0000 7fef699ef640 1 --2- 172.21.15.45:0/3691339807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef641036e0 0x7fef64107b90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fef58009890 tx=0x7fef5802a380 comp rx=0 tx=0).stop 2024-09-15T22:15:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.561+0000 7fef699ef640 1 -- 172.21.15.45:0/3691339807 shutdown_connections 2024-09-15T22:15:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.561+0000 7fef699ef640 1 --2- 172.21.15.45:0/3691339807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef641082a0 0x7fef6410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.561+0000 7fef699ef640 1 --2- 172.21.15.45:0/3691339807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef641036e0 0x7fef64107b90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.561+0000 7fef699ef640 1 --2- 172.21.15.45:0/3691339807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef64102d30 0x7fef64103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.561+0000 7fef699ef640 1 -- 172.21.15.45:0/3691339807 >> 172.21.15.45:0/3691339807 conn(0x7fef640fc7d0 msgr2=0x7fef640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.561+0000 7fef699ef640 1 -- 172.21.15.45:0/3691339807 shutdown_connections 2024-09-15T22:15:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.561+0000 7fef699ef640 1 -- 172.21.15.45:0/3691339807 wait complete. 2024-09-15T22:15:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.562+0000 7fef699ef640 1 Processor -- start 2024-09-15T22:15:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.562+0000 7fef699ef640 1 -- start start 2024-09-15T22:15:42.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef699ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef64102d30 0x7fef641986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:42.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef699ef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef641036e0 0x7fef64198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:42.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef699ef640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef641082a0 0x7fef6419cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:42.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef699ef640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fef64112180 con 0x7fef64102d30 2024-09-15T22:15:42.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef699ef640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fef64112000 con 0x7fef641036e0 2024-09-15T22:15:42.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef699ef640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fef64112300 con 0x7fef641082a0 2024-09-15T22:15:42.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef62ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef64102d30 0x7fef641986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:42.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef62ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef64102d30 0x7fef641986c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35356/0 (socket says 172.21.15.45:35356) 2024-09-15T22:15:42.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef62ffd640 1 -- 172.21.15.45:0/3707970259 learned_addr learned my addr 172.21.15.45:0/3707970259 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:42.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef627fc640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef641036e0 0x7fef64198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:42.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef637fe640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef641082a0 0x7fef6419cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:42.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef62ffd640 1 -- 172.21.15.45:0/3707970259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef641082a0 msgr2=0x7fef6419cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef62ffd640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef641082a0 0x7fef6419cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef62ffd640 1 -- 172.21.15.45:0/3707970259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef641036e0 msgr2=0x7fef64198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef62ffd640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef641036e0 0x7fef64198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef62ffd640 1 -- 172.21.15.45:0/3707970259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6419d670 con 0x7fef64102d30 2024-09-15T22:15:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef627fc640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef641036e0 0x7fef64198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef637fe640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef641082a0 0x7fef6419cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.563+0000 7fef62ffd640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef64102d30 0x7fef641986c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fef5400e9c0 tx=0x7fef5400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.564+0000 7fef689ed640 1 -- 172.21.15.45:0/3707970259 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5400cde0 con 0x7fef64102d30 2024-09-15T22:15:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.564+0000 7fef689ed640 1 -- 172.21.15.45:0/3707970259 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef540035f0 con 0x7fef64102d30 2024-09-15T22:15:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.564+0000 7fef689ed640 1 -- 172.21.15.45:0/3707970259 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef54010670 con 0x7fef64102d30 2024-09-15T22:15:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.564+0000 7fef699ef640 1 -- 172.21.15.45:0/3707970259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef6419d960 con 0x7fef64102d30 2024-09-15T22:15:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.564+0000 7fef699ef640 1 -- 172.21.15.45:0/3707970259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef641a5240 con 0x7fef64102d30 2024-09-15T22:15:42.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.565+0000 7fef699ef640 1 -- 172.21.15.45:0/3707970259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef64103110 con 0x7fef64102d30 2024-09-15T22:15:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.566+0000 7fef689ed640 1 -- 172.21.15.45:0/3707970259 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fef540037a0 con 0x7fef64102d30 2024-09-15T22:15:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.567+0000 7fef689ed640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fef4c0a32d0 0x7fef4c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.567+0000 7fef627fc640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fef4c0a32d0 0x7fef4c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.567+0000 7fef689ed640 1 -- 172.21.15.45:0/3707970259 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fef540d0360 con 0x7fef64102d30 2024-09-15T22:15:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.567+0000 7fef627fc640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fef4c0a32d0 0x7fef4c0a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fef5802a970 tx=0x7fef580058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.570+0000 7fef689ed640 1 -- 172.21.15.45:0/3707970259 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef5409cc50 con 0x7fef64102d30 2024-09-15T22:15:42.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.785+0000 7fef699ef640 1 -- 172.21.15.45:0/3707970259 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fef6410a230 con 0x7fef64102d30 2024-09-15T22:15:42.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.785+0000 7fef689ed640 1 -- 172.21.15.45:0/3707970259 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fef5409c550 con 0x7fef64102d30 2024-09-15T22:15:42.787 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:15:42.788 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T22:15:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.787+0000 7fef699ef640 1 -- 172.21.15.45:0/3707970259 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fef4c0a32d0 msgr2=0x7fef4c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.787+0000 7fef699ef640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fef4c0a32d0 0x7fef4c0a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fef5802a970 tx=0x7fef580058b0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.787+0000 7fef699ef640 1 -- 172.21.15.45:0/3707970259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef64102d30 msgr2=0x7fef641986c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.787+0000 7fef699ef640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef64102d30 0x7fef641986c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fef5400e9c0 tx=0x7fef5400ee80 comp rx=0 tx=0).stop 2024-09-15T22:15:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.787+0000 7fef699ef640 1 -- 172.21.15.45:0/3707970259 shutdown_connections 2024-09-15T22:15:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.787+0000 7fef699ef640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fef4c0a32d0 0x7fef4c0a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.787+0000 7fef699ef640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef641082a0 0x7fef6419cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.787+0000 7fef699ef640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef641036e0 0x7fef64198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.787+0000 7fef699ef640 1 --2- 172.21.15.45:0/3707970259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef64102d30 0x7fef641986c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.787+0000 7fef699ef640 1 -- 172.21.15.45:0/3707970259 >> 172.21.15.45:0/3707970259 conn(0x7fef640fc7d0 msgr2=0x7fef64105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.788+0000 7fef699ef640 1 -- 172.21.15.45:0/3707970259 shutdown_connections 2024-09-15T22:15:42.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:42.788+0000 7fef699ef640 1 -- 172.21.15.45:0/3707970259 wait complete. 2024-09-15T22:15:43.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:43 smithi165 ceph-mon[35551]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:43.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:43 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3707970259' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:15:43.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:43 smithi100 ceph-mon[35319]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:43.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:43 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3707970259' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:15:43.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:43 smithi045 ceph-mon[31180]: pgmap v332: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:43.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:43 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3707970259' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T22:15:43.623 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-15T22:15:43.624 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:15:43.885 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:44.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.386+0000 7fa3f4a24640 1 -- 172.21.15.45:0/2185707707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f0101de0 msgr2=0x7fa3f01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:44.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.386+0000 7fa3f4a24640 1 --2- 172.21.15.45:0/2185707707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f0101de0 0x7fa3f01021c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009900 tx=0x7fa3e002a410 comp rx=0 tx=0).stop 2024-09-15T22:15:44.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.386+0000 7fa3f4a24640 1 -- 172.21.15.45:0/2185707707 shutdown_connections 2024-09-15T22:15:44.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.386+0000 7fa3f4a24640 1 --2- 172.21.15.45:0/2185707707 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3f0106f10 0x7fa3f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.386+0000 7fa3f4a24640 1 --2- 172.21.15.45:0/2185707707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f0102790 0x7fa3f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.386+0000 7fa3f4a24640 1 --2- 172.21.15.45:0/2185707707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f0101de0 0x7fa3f01021c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.386+0000 7fa3f4a24640 1 -- 172.21.15.45:0/2185707707 >> 172.21.15.45:0/2185707707 conn(0x7fa3f00fd8c0 msgr2=0x7fa3f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.386+0000 7fa3f4a24640 1 -- 172.21.15.45:0/2185707707 shutdown_connections 2024-09-15T22:15:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.386+0000 7fa3f4a24640 1 -- 172.21.15.45:0/2185707707 wait complete. 2024-09-15T22:15:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.387+0000 7fa3f4a24640 1 Processor -- start 2024-09-15T22:15:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.387+0000 7fa3f4a24640 1 -- start start 2024-09-15T22:15:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.387+0000 7fa3f4a24640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f0101de0 0x7fa3f019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.387+0000 7fa3f4a24640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3f0102790 0x7fa3f019acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.387+0000 7fa3f4a24640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f0106f10 0x7fa3f019dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.387+0000 7fa3f4a24640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0112090 con 0x7fa3f0106f10 2024-09-15T22:15:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.387+0000 7fa3f4a24640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0111f10 con 0x7fa3f0101de0 2024-09-15T22:15:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.387+0000 7fa3f4a24640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0112210 con 0x7fa3f0102790 2024-09-15T22:15:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3eed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f0106f10 0x7fa3f019dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3eed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f0106f10 0x7fa3f019dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50484/0 (socket says 172.21.15.45:50484) 2024-09-15T22:15:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3eed9d640 1 -- 172.21.15.45:0/1682215272 learned_addr learned my addr 172.21.15.45:0/1682215272 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3ee59c640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f0101de0 0x7fa3f019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3e7fff640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3f0102790 0x7fa3f019acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3eed9d640 1 -- 172.21.15.45:0/1682215272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3f0102790 msgr2=0x7fa3f019acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3eed9d640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3f0102790 0x7fa3f019acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3eed9d640 1 -- 172.21.15.45:0/1682215272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f0101de0 msgr2=0x7fa3f019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3eed9d640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f0101de0 0x7fa3f019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3eed9d640 1 -- 172.21.15.45:0/1682215272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f019e6d0 con 0x7fa3f0106f10 2024-09-15T22:15:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3e7fff640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3f0102790 0x7fa3f019acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:15:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3ee59c640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f0101de0 0x7fa3f019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3eed9d640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f0106f10 0x7fa3f019dfa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8009fd0 tx=0x7fa3e800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3e77fe640 1 -- 172.21.15.45:0/1682215272 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8017070 con 0x7fa3f0106f10 2024-09-15T22:15:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3e77fe640 1 -- 172.21.15.45:0/1682215272 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa3e8004020 con 0x7fa3f0106f10 2024-09-15T22:15:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3f4a24640 1 -- 172.21.15.45:0/1682215272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f019e9c0 con 0x7fa3f0106f10 2024-09-15T22:15:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3e77fe640 1 -- 172.21.15.45:0/1682215272 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e80106c0 con 0x7fa3f0106f10 2024-09-15T22:15:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.388+0000 7fa3f4a24640 1 -- 172.21.15.45:0/1682215272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f01a7330 con 0x7fa3f0106f10 2024-09-15T22:15:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.389+0000 7fa3f4a24640 1 -- 172.21.15.45:0/1682215272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f01021c0 con 0x7fa3f0106f10 2024-09-15T22:15:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.391+0000 7fa3e77fe640 1 -- 172.21.15.45:0/1682215272 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa3e80041d0 con 0x7fa3f0106f10 2024-09-15T22:15:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.392+0000 7fa3e77fe640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3dc0a3350 0x7fa3dc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.392+0000 7fa3e77fe640 1 -- 172.21.15.45:0/1682215272 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fa3e80cfb00 con 0x7fa3f0106f10 2024-09-15T22:15:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.392+0000 7fa3ee59c640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3dc0a3350 0x7fa3dc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.393+0000 7fa3ee59c640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3dc0a3350 0x7fa3dc0a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0005ab0 tx=0x7fa3e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.395+0000 7fa3e77fe640 1 -- 172.21.15.45:0/1682215272 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3e809c380 con 0x7fa3f0106f10 2024-09-15T22:15:44.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.608+0000 7fa3f4a24640 1 -- 172.21.15.45:0/1682215272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3f01a75d0 con 0x7fa3f0106f10 2024-09-15T22:15:44.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.609+0000 7fa3e77fe640 1 -- 172.21.15.45:0/1682215272 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fa3e809bc80 con 0x7fa3f0106f10 2024-09-15T22:15:44.611 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:15:44.611 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:15:44.611 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:15:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.611+0000 7fa3f4a24640 1 -- 172.21.15.45:0/1682215272 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3dc0a3350 msgr2=0x7fa3dc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.611+0000 7fa3f4a24640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3dc0a3350 0x7fa3dc0a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0005ab0 tx=0x7fa3e0005a20 comp rx=0 tx=0).stop 2024-09-15T22:15:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.611+0000 7fa3f4a24640 1 -- 172.21.15.45:0/1682215272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f0106f10 msgr2=0x7fa3f019dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.611+0000 7fa3f4a24640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f0106f10 0x7fa3f019dfa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8009fd0 tx=0x7fa3e800b260 comp rx=0 tx=0).stop 2024-09-15T22:15:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.611+0000 7fa3f4a24640 1 -- 172.21.15.45:0/1682215272 shutdown_connections 2024-09-15T22:15:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.611+0000 7fa3f4a24640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3dc0a3350 0x7fa3dc0a5810 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.611+0000 7fa3f4a24640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3f0106f10 0x7fa3f019dfa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.611+0000 7fa3f4a24640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa3f0102790 0x7fa3f019acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.611+0000 7fa3f4a24640 1 --2- 172.21.15.45:0/1682215272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3f0101de0 0x7fa3f019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.611+0000 7fa3f4a24640 1 -- 172.21.15.45:0/1682215272 >> 172.21.15.45:0/1682215272 conn(0x7fa3f00fd8c0 msgr2=0x7fa3f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.611+0000 7fa3f4a24640 1 -- 172.21.15.45:0/1682215272 shutdown_connections 2024-09-15T22:15:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:44.611+0000 7fa3f4a24640 1 -- 172.21.15.45:0/1682215272 wait complete. 2024-09-15T22:15:45.395 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:15:45.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:45 smithi100 ceph-mon[35319]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:15:45.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:45 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1682215272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:15:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:45 smithi045 ceph-mon[31180]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:15:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:45 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1682215272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:15:45.660 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:45.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:45 smithi165 ceph-mon[35551]: pgmap v333: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:15:45.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:45 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1682215272' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:15:46.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.086+0000 7fe56779e640 1 -- 172.21.15.45:0/1441417617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe56010c2f0 msgr2=0x7fe56010e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:46.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.086+0000 7fe56779e640 1 --2- 172.21.15.45:0/1441417617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe56010c2f0 0x7fe56010e790 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe558009900 tx=0x7fe55802a410 comp rx=0 tx=0).stop 2024-09-15T22:15:46.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.086+0000 7fe56779e640 1 -- 172.21.15.45:0/1441417617 shutdown_connections 2024-09-15T22:15:46.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.086+0000 7fe56779e640 1 --2- 172.21.15.45:0/1441417617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe56010c2f0 0x7fe56010e790 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.086+0000 7fe56779e640 1 --2- 172.21.15.45:0/1441417617 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe5601037a0 0x7fe56010bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.086+0000 7fe56779e640 1 --2- 172.21.15.45:0/1441417617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe560102df0 0x7fe5601031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.086+0000 7fe56779e640 1 -- 172.21.15.45:0/1441417617 >> 172.21.15.45:0/1441417617 conn(0x7fe5600fc7d0 msgr2=0x7fe5600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:46.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.086+0000 7fe56779e640 1 -- 172.21.15.45:0/1441417617 shutdown_connections 2024-09-15T22:15:46.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.086+0000 7fe56779e640 1 -- 172.21.15.45:0/1441417617 wait complete. 2024-09-15T22:15:46.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.086+0000 7fe56779e640 1 Processor -- start 2024-09-15T22:15:46.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe56779e640 1 -- start start 2024-09-15T22:15:46.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe56779e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe560102df0 0x7fe560198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:46.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe56779e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5601037a0 0x7fe560198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:46.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe56779e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe56010c2f0 0x7fe56019cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:46.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe56779e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe560112250 con 0x7fe5601037a0 2024-09-15T22:15:46.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe56779e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe5601120d0 con 0x7fe56010c2f0 2024-09-15T22:15:46.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe56779e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe5601123d0 con 0x7fe560102df0 2024-09-15T22:15:46.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe564d39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5601037a0 0x7fe560198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:46.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe564d39640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5601037a0 0x7fe560198b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50498/0 (socket says 172.21.15.45:50498) 2024-09-15T22:15:46.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe564d39640 1 -- 172.21.15.45:0/2336489744 learned_addr learned my addr 172.21.15.45:0/2336489744 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:46.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe56553a640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe560102df0 0x7fe560198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:46.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe565d3b640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe56010c2f0 0x7fe56019cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:46.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe564d39640 1 -- 172.21.15.45:0/2336489744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe560102df0 msgr2=0x7fe560198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:46.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe564d39640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe560102df0 0x7fe560198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe564d39640 1 -- 172.21.15.45:0/2336489744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe56010c2f0 msgr2=0x7fe56019cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:46.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe564d39640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe56010c2f0 0x7fe56019cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.087+0000 7fe564d39640 1 -- 172.21.15.45:0/2336489744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56019d600 con 0x7fe5601037a0 2024-09-15T22:15:46.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.088+0000 7fe564d39640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5601037a0 0x7fe560198b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe55000d750 tx=0x7fe55000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:46.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.088+0000 7fe5567fc640 1 -- 172.21.15.45:0/2336489744 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe550017070 con 0x7fe5601037a0 2024-09-15T22:15:46.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.088+0000 7fe5567fc640 1 -- 172.21.15.45:0/2336489744 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe550005520 con 0x7fe5601037a0 2024-09-15T22:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.088+0000 7fe56779e640 1 -- 172.21.15.45:0/2336489744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe56019d8f0 con 0x7fe5601037a0 2024-09-15T22:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.088+0000 7fe5567fc640 1 -- 172.21.15.45:0/2336489744 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe550004e00 con 0x7fe5601037a0 2024-09-15T22:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.088+0000 7fe56779e640 1 -- 172.21.15.45:0/2336489744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5601a51d0 con 0x7fe5601037a0 2024-09-15T22:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.089+0000 7fe56779e640 1 -- 172.21.15.45:0/2336489744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5601031d0 con 0x7fe5601037a0 2024-09-15T22:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.090+0000 7fe5567fc640 1 -- 172.21.15.45:0/2336489744 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe550005020 con 0x7fe5601037a0 2024-09-15T22:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.091+0000 7fe5567fc640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe54c0a32d0 0x7fe54c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.091+0000 7fe56553a640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe54c0a32d0 0x7fe54c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.091+0000 7fe5567fc640 1 -- 172.21.15.45:0/2336489744 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fe5500cf780 con 0x7fe5601037a0 2024-09-15T22:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.091+0000 7fe56553a640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe54c0a32d0 0x7fe54c0a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe55c005fd0 tx=0x7fe55c009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:46.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.095+0000 7fe5567fc640 1 -- 172.21.15.45:0/2336489744 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe55009b930 con 0x7fe5601037a0 2024-09-15T22:15:46.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.306+0000 7fe56779e640 1 -- 172.21.15.45:0/2336489744 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5601a53a0 con 0x7fe5601037a0 2024-09-15T22:15:46.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.307+0000 7fe5567fc640 1 -- 172.21.15.45:0/2336489744 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fe55009fc30 con 0x7fe5601037a0 2024-09-15T22:15:46.309 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:15:46.309 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:15:46.310 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:15:46.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.310+0000 7fe56779e640 1 -- 172.21.15.45:0/2336489744 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe54c0a32d0 msgr2=0x7fe54c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:46.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.310+0000 7fe56779e640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe54c0a32d0 0x7fe54c0a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe55c005fd0 tx=0x7fe55c009680 comp rx=0 tx=0).stop 2024-09-15T22:15:46.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.310+0000 7fe56779e640 1 -- 172.21.15.45:0/2336489744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5601037a0 msgr2=0x7fe560198b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:46.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.310+0000 7fe56779e640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5601037a0 0x7fe560198b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe55000d750 tx=0x7fe55000dc10 comp rx=0 tx=0).stop 2024-09-15T22:15:46.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.310+0000 7fe56779e640 1 -- 172.21.15.45:0/2336489744 shutdown_connections 2024-09-15T22:15:46.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.310+0000 7fe56779e640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fe54c0a32d0 0x7fe54c0a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.310+0000 7fe56779e640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe56010c2f0 0x7fe56019cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.310+0000 7fe56779e640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5601037a0 0x7fe560198b90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.310+0000 7fe56779e640 1 --2- 172.21.15.45:0/2336489744 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe560102df0 0x7fe560198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:46.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.310+0000 7fe56779e640 1 -- 172.21.15.45:0/2336489744 >> 172.21.15.45:0/2336489744 conn(0x7fe5600fc7d0 msgr2=0x7fe5600fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:46.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.310+0000 7fe56779e640 1 -- 172.21.15.45:0/2336489744 shutdown_connections 2024-09-15T22:15:46.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:46.310+0000 7fe56779e640 1 -- 172.21.15.45:0/2336489744 wait complete. 2024-09-15T22:15:46.949 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:15:47.207 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:47.478 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:47 smithi045 ceph-mon[31180]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:15:47.478 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:47 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2336489744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:15:47.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:47 smithi100 ceph-mon[35319]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:15:47.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:47 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2336489744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:15:47.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.694+0000 7f3e16984640 1 -- 172.21.15.45:0/2725787527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e10103660 msgr2=0x7f3e1010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:47.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.694+0000 7f3e16984640 1 --2- 172.21.15.45:0/2725787527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e10103660 0x7f3e1010bb50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009900 tx=0x7f3e0402a480 comp rx=0 tx=0).stop 2024-09-15T22:15:47.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.695+0000 7f3e16984640 1 -- 172.21.15.45:0/2725787527 shutdown_connections 2024-09-15T22:15:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.695+0000 7f3e16984640 1 --2- 172.21.15.45:0/2725787527 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e1010c170 0x7f3e1010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.695+0000 7f3e16984640 1 --2- 172.21.15.45:0/2725787527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e10103660 0x7f3e1010bb50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.695+0000 7f3e16984640 1 --2- 172.21.15.45:0/2725787527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e10102d40 0x7f3e10103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.695+0000 7f3e16984640 1 -- 172.21.15.45:0/2725787527 >> 172.21.15.45:0/2725787527 conn(0x7f3e100fc7a0 msgr2=0x7f3e100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.695+0000 7f3e16984640 1 -- 172.21.15.45:0/2725787527 shutdown_connections 2024-09-15T22:15:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.695+0000 7f3e16984640 1 -- 172.21.15.45:0/2725787527 wait complete. 2024-09-15T22:15:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.695+0000 7f3e16984640 1 Processor -- start 2024-09-15T22:15:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.695+0000 7f3e16984640 1 -- start start 2024-09-15T22:15:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e16984640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e10102d40 0x7f3e101009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e16984640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e10103660 0x7f3e10100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e16984640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1010c170 0x7f3e10101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e16984640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10112090 con 0x7f3e1010c170 2024-09-15T22:15:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e16984640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10111f10 con 0x7f3e10102d40 2024-09-15T22:15:47.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e16984640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3e10112210 con 0x7f3e10103660 2024-09-15T22:15:47.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e14f21640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1010c170 0x7f3e10101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:47.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e14f21640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1010c170 0x7f3e10101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50514/0 (socket says 172.21.15.45:50514) 2024-09-15T22:15:47.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e14f21640 1 -- 172.21.15.45:0/659753935 learned_addr learned my addr 172.21.15.45:0/659753935 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:47.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e0ffff640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e10102d40 0x7f3e101009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:47.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e0f7fe640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e10103660 0x7f3e10100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:47.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e14f21640 1 -- 172.21.15.45:0/659753935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e10103660 msgr2=0x7f3e10100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:47.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e14f21640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e10103660 0x7f3e10100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e14f21640 1 -- 172.21.15.45:0/659753935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e10102d40 msgr2=0x7f3e101009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:47.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e14f21640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e10102d40 0x7f3e101009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e14f21640 1 -- 172.21.15.45:0/659753935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e101a69f0 con 0x7f3e1010c170 2024-09-15T22:15:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e0ffff640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e10102d40 0x7f3e101009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:15:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e14f21640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1010c170 0x7f3e10101420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800cad0 tx=0x7f3e0800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e0d7fa640 1 -- 172.21.15.45:0/659753935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800ae20 con 0x7f3e1010c170 2024-09-15T22:15:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e0d7fa640 1 -- 172.21.15.45:0/659753935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3e08004b20 con 0x7f3e1010c170 2024-09-15T22:15:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.696+0000 7f3e16984640 1 -- 172.21.15.45:0/659753935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e101a6ce0 con 0x7f3e1010c170 2024-09-15T22:15:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.697+0000 7f3e0d7fa640 1 -- 172.21.15.45:0/659753935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0800f780 con 0x7f3e1010c170 2024-09-15T22:15:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.697+0000 7f3e16984640 1 -- 172.21.15.45:0/659753935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e101a71f0 con 0x7f3e1010c170 2024-09-15T22:15:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.698+0000 7f3e16984640 1 -- 172.21.15.45:0/659753935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e10103120 con 0x7f3e1010c170 2024-09-15T22:15:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.699+0000 7f3e0d7fa640 1 -- 172.21.15.45:0/659753935 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3e08004cd0 con 0x7f3e1010c170 2024-09-15T22:15:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.700+0000 7f3e0d7fa640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3df80a32d0 0x7f3df80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.700+0000 7f3e0ffff640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3df80a32d0 0x7f3df80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.700+0000 7f3e0d7fa640 1 -- 172.21.15.45:0/659753935 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f3e080cfd40 con 0x7f3e1010c170 2024-09-15T22:15:47.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.700+0000 7f3e0ffff640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3df80a32d0 0x7f3df80a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000bfd0 tx=0x7f3e0000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:47.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.704+0000 7f3e0d7fa640 1 -- 172.21.15.45:0/659753935 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3e08014030 con 0x7f3e1010c170 2024-09-15T22:15:47.718 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:47 smithi165 ceph-mon[35551]: pgmap v334: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:15:47.718 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:47 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2336489744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:15:47.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.881+0000 7f3e16984640 1 -- 172.21.15.45:0/659753935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e101071e0 con 0x7f3e1010c170 2024-09-15T22:15:47.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.883+0000 7f3e0d7fa640 1 -- 172.21.15.45:0/659753935 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24661 (secure 0 0 0) 0x7f3e0809bef0 con 0x7f3e1010c170 2024-09-15T22:15:47.885 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:15:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":89,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:15:17.105738+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":7}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:15:47.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.885+0000 7f3e16984640 1 -- 172.21.15.45:0/659753935 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3df80a32d0 msgr2=0x7f3df80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:47.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.885+0000 7f3e16984640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3df80a32d0 0x7f3df80a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000bfd0 tx=0x7f3e0000b390 comp rx=0 tx=0).stop 2024-09-15T22:15:47.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.885+0000 7f3e16984640 1 -- 172.21.15.45:0/659753935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1010c170 msgr2=0x7f3e10101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:47.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.885+0000 7f3e16984640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1010c170 0x7f3e10101420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800cad0 tx=0x7f3e0800cf90 comp rx=0 tx=0).stop 2024-09-15T22:15:47.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.885+0000 7f3e16984640 1 -- 172.21.15.45:0/659753935 shutdown_connections 2024-09-15T22:15:47.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.885+0000 7f3e16984640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f3df80a32d0 0x7f3df80a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.885+0000 7f3e16984640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e1010c170 0x7f3e10101420 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.885+0000 7f3e16984640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3e10103660 0x7f3e10100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.885+0000 7f3e16984640 1 --2- 172.21.15.45:0/659753935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e10102d40 0x7f3e101009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:47.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.885+0000 7f3e16984640 1 -- 172.21.15.45:0/659753935 >> 172.21.15.45:0/659753935 conn(0x7f3e100fc7a0 msgr2=0x7f3e100fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:47.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.885+0000 7f3e16984640 1 -- 172.21.15.45:0/659753935 shutdown_connections 2024-09-15T22:15:47.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:47.885+0000 7f3e16984640 1 -- 172.21.15.45:0/659753935 wait complete. 2024-09-15T22:15:48.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:48 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/659753935' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:15:48.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:48 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/659753935' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:15:48.567 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:15:48.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:48 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/659753935' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:15:48.827 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:49.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.311+0000 7f9d15700640 1 -- 172.21.15.45:0/3861789170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10102790 msgr2=0x7f9d101067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:49.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.311+0000 7f9d15700640 1 --2- 172.21.15.45:0/3861789170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10102790 0x7f9d101067e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009900 tx=0x7f9cf802a410 comp rx=0 tx=0).stop 2024-09-15T22:15:49.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.311+0000 7f9d15700640 1 -- 172.21.15.45:0/3861789170 shutdown_connections 2024-09-15T22:15:49.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.311+0000 7f9d15700640 1 --2- 172.21.15.45:0/3861789170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d10106f10 0x7f9d1010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:49.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.311+0000 7f9d15700640 1 --2- 172.21.15.45:0/3861789170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10102790 0x7f9d101067e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:49.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.311+0000 7f9d15700640 1 --2- 172.21.15.45:0/3861789170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d10101de0 0x7f9d101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:49.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.311+0000 7f9d15700640 1 -- 172.21.15.45:0/3861789170 >> 172.21.15.45:0/3861789170 conn(0x7f9d100fd8c0 msgr2=0x7f9d100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:49.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.311+0000 7f9d15700640 1 -- 172.21.15.45:0/3861789170 shutdown_connections 2024-09-15T22:15:49.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.311+0000 7f9d15700640 1 -- 172.21.15.45:0/3861789170 wait complete. 2024-09-15T22:15:49.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.312+0000 7f9d15700640 1 Processor -- start 2024-09-15T22:15:49.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.312+0000 7f9d15700640 1 -- start start 2024-09-15T22:15:49.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.312+0000 7f9d15700640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d10101de0 0x7f9d10198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.312+0000 7f9d15700640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10102790 0x7f9d101989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.312+0000 7f9d15700640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d10106f10 0x7f9d1019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.312+0000 7f9d15700640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101120e0 con 0x7f9d10102790 2024-09-15T22:15:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d15700640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10111f60 con 0x7f9d10106f10 2024-09-15T22:15:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d15700640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10112260 con 0x7f9d10101de0 2024-09-15T22:15:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d067fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10102790 0x7f9d101989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d0effd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d10101de0 0x7f9d10198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d067fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10102790 0x7f9d101989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50524/0 (socket says 172.21.15.45:50524) 2024-09-15T22:15:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d067fc640 1 -- 172.21.15.45:0/3726917930 learned_addr learned my addr 172.21.15.45:0/3726917930 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d0f7fe640 1 --2- 172.21.15.45:0/3726917930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d10106f10 0x7f9d1019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d067fc640 1 -- 172.21.15.45:0/3726917930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d10101de0 msgr2=0x7f9d10198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d067fc640 1 --2- 172.21.15.45:0/3726917930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d10101de0 0x7f9d10198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d067fc640 1 -- 172.21.15.45:0/3726917930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d10106f10 msgr2=0x7f9d1019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d067fc640 1 --2- 172.21.15.45:0/3726917930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d10106f10 0x7f9d1019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d067fc640 1 -- 172.21.15.45:0/3726917930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1019d430 con 0x7f9d10102790 2024-09-15T22:15:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d067fc640 1 --2- 172.21.15.45:0/3726917930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10102790 0x7f9d101989c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8004770 tx=0x7f9cf8032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d0cff9640 1 -- 172.21.15.45:0/3726917930 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf803f030 con 0x7f9d10102790 2024-09-15T22:15:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.313+0000 7f9d15700640 1 -- 172.21.15.45:0/3726917930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1019d6c0 con 0x7f9d10102790 2024-09-15T22:15:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.314+0000 7f9d0cff9640 1 -- 172.21.15.45:0/3726917930 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9cf8003d00 con 0x7f9d10102790 2024-09-15T22:15:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.314+0000 7f9d15700640 1 -- 172.21.15.45:0/3726917930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d101a5000 con 0x7f9d10102790 2024-09-15T22:15:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.314+0000 7f9d0cff9640 1 -- 172.21.15.45:0/3726917930 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8035070 con 0x7f9d10102790 2024-09-15T22:15:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.315+0000 7f9d15700640 1 -- 172.21.15.45:0/3726917930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d101021c0 con 0x7f9d10102790 2024-09-15T22:15:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.316+0000 7f9d0cff9640 1 -- 172.21.15.45:0/3726917930 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9cf8042030 con 0x7f9d10102790 2024-09-15T22:15:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.316+0000 7f9d0cff9640 1 --2- 172.21.15.45:0/3726917930 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f9cfc0a32d0 0x7f9cfc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.317+0000 7f9d0effd640 1 --2- 172.21.15.45:0/3726917930 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f9cfc0a32d0 0x7f9cfc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:49.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.317+0000 7f9d0cff9640 1 -- 172.21.15.45:0/3726917930 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f9cf80f0740 con 0x7f9d10102790 2024-09-15T22:15:49.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.317+0000 7f9d0effd640 1 --2- 172.21.15.45:0/3726917930 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f9cfc0a32d0 0x7f9cfc0a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000abe0 tx=0x7f9d0000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:49.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.319+0000 7f9d0cff9640 1 -- 172.21.15.45:0/3726917930 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9cf80bd060 con 0x7f9d10102790 2024-09-15T22:15:49.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:49 smithi100 ceph-mon[35319]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.531+0000 7f9d15700640 1 -- 172.21.15.45:0/3726917930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d101997e0 con 0x7f9d10102790 2024-09-15T22:15:49.533 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:49 smithi045 ceph-mon[31180]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.532+0000 7f9d0cff9640 1 -- 172.21.15.45:0/3726917930 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f9d101997e0 con 0x7f9d10102790 2024-09-15T22:15:49.534 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:15:49.534 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:15:49.535 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:15:49.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.534+0000 7f9d15700640 1 -- 172.21.15.45:0/3726917930 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f9cfc0a32d0 msgr2=0x7f9cfc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:49.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.534+0000 7f9d15700640 1 --2- 172.21.15.45:0/3726917930 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f9cfc0a32d0 0x7f9cfc0a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000abe0 tx=0x7f9d0000a2d0 comp rx=0 tx=0).stop 2024-09-15T22:15:49.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.534+0000 7f9d15700640 1 -- 172.21.15.45:0/3726917930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10102790 msgr2=0x7f9d101989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:49.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.534+0000 7f9d15700640 1 --2- 172.21.15.45:0/3726917930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10102790 0x7f9d101989c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8004770 tx=0x7f9cf8032c90 comp rx=0 tx=0).stop 2024-09-15T22:15:49.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.534+0000 7f9d15700640 1 -- 172.21.15.45:0/3726917930 shutdown_connections 2024-09-15T22:15:49.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.534+0000 7f9d15700640 1 --2- 172.21.15.45:0/3726917930 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f9cfc0a32d0 0x7f9cfc0a5790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:49.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.534+0000 7f9d15700640 1 --2- 172.21.15.45:0/3726917930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d10106f10 0x7f9d1019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:49.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.534+0000 7f9d15700640 1 --2- 172.21.15.45:0/3726917930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10102790 0x7f9d101989c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:49.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.534+0000 7f9d15700640 1 --2- 172.21.15.45:0/3726917930 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d10101de0 0x7f9d10198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:49.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.534+0000 7f9d15700640 1 -- 172.21.15.45:0/3726917930 >> 172.21.15.45:0/3726917930 conn(0x7f9d100fd8c0 msgr2=0x7f9d100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:49.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.534+0000 7f9d15700640 1 -- 172.21.15.45:0/3726917930 shutdown_connections 2024-09-15T22:15:49.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:49.534+0000 7f9d15700640 1 -- 172.21.15.45:0/3726917930 wait complete. 2024-09-15T22:15:49.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:49 smithi165 ceph-mon[35551]: pgmap v335: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:50.245 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T22:14:07.480609+0000', 'modified': '2024-09-15T22:14:45.759794+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.165:6839/2278031843', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6838', 'nonce': 2278031843}, {'type': 'v1', 'addr': '172.21.15.165:6839', 'nonce': 2278031843}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6839/1428203088', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 1428203088}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 1428203088}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24476, 'qdb_cluster': [24476]} 2024-09-15T22:15:50.245 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:15:50.246 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:15:50.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:50 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3726917930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:15:50.508 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:50.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:50 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3726917930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:15:50.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:50 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3726917930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:15:51.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.054+0000 7f5979ccc640 1 -- 172.21.15.45:0/1956797060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5974100480 msgr2=0x7f5974100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:51.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.054+0000 7f5979ccc640 1 --2- 172.21.15.45:0/1956797060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5974100480 0x7f5974100860 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5964009900 tx=0x7f596402a410 comp rx=0 tx=0).stop 2024-09-15T22:15:51.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.054+0000 7f5979ccc640 1 -- 172.21.15.45:0/1956797060 shutdown_connections 2024-09-15T22:15:51.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.054+0000 7f5979ccc640 1 --2- 172.21.15.45:0/1956797060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f59741055b0 0x7f597410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.054+0000 7f5979ccc640 1 --2- 172.21.15.45:0/1956797060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5974100e30 0x7f5974104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.054+0000 7f5979ccc640 1 --2- 172.21.15.45:0/1956797060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5974100480 0x7f5974100860 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.054+0000 7f5979ccc640 1 -- 172.21.15.45:0/1956797060 >> 172.21.15.45:0/1956797060 conn(0x7f5974077210 msgr2=0x7f59740fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:51.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.054+0000 7f5979ccc640 1 -- 172.21.15.45:0/1956797060 shutdown_connections 2024-09-15T22:15:51.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.054+0000 7f5979ccc640 1 -- 172.21.15.45:0/1956797060 wait complete. 2024-09-15T22:15:51.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.054+0000 7f5979ccc640 1 Processor -- start 2024-09-15T22:15:51.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.054+0000 7f5979ccc640 1 -- start start 2024-09-15T22:15:51.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.054+0000 7f5979ccc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5974100480 0x7f597410e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.054+0000 7f5979ccc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5974100e30 0x7f597410ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5979ccc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59741055b0 0x7f597410f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5979ccc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f59741120d0 con 0x7f59741055b0 2024-09-15T22:15:51.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5979ccc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5974111f50 con 0x7f5974100480 2024-09-15T22:15:51.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5979ccc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5974112250 con 0x7f5974100e30 2024-09-15T22:15:51.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5973fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59741055b0 0x7f597410f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5973fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59741055b0 0x7f597410f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50540/0 (socket says 172.21.15.45:50540) 2024-09-15T22:15:51.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5973fff640 1 -- 172.21.15.45:0/1508299127 learned_addr learned my addr 172.21.15.45:0/1508299127 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:51.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f59737fe640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5974100480 0x7f597410e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f596bfff640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5974100e30 0x7f597410ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5973fff640 1 -- 172.21.15.45:0/1508299127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5974100e30 msgr2=0x7f597410ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:51.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5973fff640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5974100e30 0x7f597410ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5973fff640 1 -- 172.21.15.45:0/1508299127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5974100480 msgr2=0x7f597410e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:51.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5973fff640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5974100480 0x7f597410e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5973fff640 1 -- 172.21.15.45:0/1508299127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59741a6a30 con 0x7f59741055b0 2024-09-15T22:15:51.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5973fff640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59741055b0 0x7f597410f2d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f596c00eaa0 tx=0x7f596c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:51.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f59717fa640 1 -- 172.21.15.45:0/1508299127 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c00cdb0 con 0x7f59741055b0 2024-09-15T22:15:51.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f59717fa640 1 -- 172.21.15.45:0/1508299127 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f596c004b20 con 0x7f59741055b0 2024-09-15T22:15:51.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f5979ccc640 1 -- 172.21.15.45:0/1508299127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59741a6d20 con 0x7f59741055b0 2024-09-15T22:15:51.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.055+0000 7f59717fa640 1 -- 172.21.15.45:0/1508299127 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596c011760 con 0x7f59741055b0 2024-09-15T22:15:51.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.056+0000 7f5979ccc640 1 -- 172.21.15.45:0/1508299127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59741a7260 con 0x7f59741055b0 2024-09-15T22:15:51.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.058+0000 7f59717fa640 1 -- 172.21.15.45:0/1508299127 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f596c004cd0 con 0x7f59741055b0 2024-09-15T22:15:51.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.058+0000 7f597c0a5740 1 Processor -- start 2024-09-15T22:15:51.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.058+0000 7f597c0a5740 1 -- start start 2024-09-15T22:15:51.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.058+0000 7f597c0a5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f6f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.058+0000 7f597c0a5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f92f0 0x55698f703670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.058+0000 7f597c0a5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f703bb0 0x55698f705fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.058+0000 7f597c0a5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55698f65f090 con 0x55698f6f89d0 2024-09-15T22:15:51.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.058+0000 7f597c0a5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55698f606a70 con 0x55698f6f92f0 2024-09-15T22:15:51.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.058+0000 7f597c0a5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55698f65b050 con 0x55698f703bb0 2024-09-15T22:15:51.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.058+0000 7f596bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f6f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.058+0000 7f596bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f6f8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50556/0 (socket says 172.21.15.45:50556) 2024-09-15T22:15:51.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.058+0000 7f596bfff640 1 -- 172.21.15.45:0/180833758 learned_addr learned my addr 172.21.15.45:0/180833758 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:51.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.058+0000 7f59737fe640 1 --2- 172.21.15.45:0/180833758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f92f0 0x55698f703670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.059+0000 7f596bfff640 1 --2- 172.21.15.45:0/180833758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f703bb0 0x55698f705fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.059+0000 7f59717fa640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f59600a32d0 0x7f59600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.059+0000 7f596bfff640 1 -- 172.21.15.45:0/180833758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f703bb0 msgr2=0x55698f705fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:51.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.059+0000 7f596bfff640 1 --2- 172.21.15.45:0/180833758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f703bb0 0x55698f705fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.059+0000 7f596bfff640 1 -- 172.21.15.45:0/180833758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f92f0 msgr2=0x55698f703670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:51.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.059+0000 7f596bfff640 1 --2- 172.21.15.45:0/180833758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f92f0 0x55698f703670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.059+0000 7f596bfff640 1 -- 172.21.15.45:0/180833758 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698f613130 con 0x55698f6f89d0 2024-09-15T22:15:51.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.059+0000 7f5973fff640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f59600a32d0 0x7f59600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.059+0000 7f59717fa640 1 -- 172.21.15.45:0/1508299127 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f596c0cffc0 con 0x7f59741055b0 2024-09-15T22:15:51.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.059+0000 7f596bfff640 1 --2- 172.21.15.45:0/180833758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f6f8db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f595c0058c0 tx=0x7f595c00b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90107aa413c279 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:51.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.059+0000 7f5969ffb640 1 -- 172.21.15.45:0/180833758 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c019020 con 0x55698f6f89d0 2024-09-15T22:15:51.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.059+0000 7f5969ffb640 1 -- 172.21.15.45:0/180833758 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f595c010b60 con 0x55698f6f89d0 2024-09-15T22:15:51.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.059+0000 7f5969ffb640 1 -- 172.21.15.45:0/180833758 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c00fcf0 con 0x55698f6f89d0 2024-09-15T22:15:51.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.060+0000 7f597c0a5740 1 -- 172.21.15.45:0/180833758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 msgr2=0x55698f6f8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:51.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.060+0000 7f5973fff640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f59600a32d0 0x7f59600a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f596c098af0 tx=0x7f596c01eb40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:51.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.060+0000 7f597c0a5740 1 --2- 172.21.15.45:0/180833758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f6f8db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f595c0058c0 tx=0x7f595c00b6b0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.060+0000 7f597c0a5740 1 -- 172.21.15.45:0/180833758 shutdown_connections 2024-09-15T22:15:51.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.060+0000 7f597c0a5740 1 --2- 172.21.15.45:0/180833758 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f703bb0 0x55698f705fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.060+0000 7f597c0a5740 1 --2- 172.21.15.45:0/180833758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f92f0 0x55698f703670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.060+0000 7f597c0a5740 1 --2- 172.21.15.45:0/180833758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f6f8db0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.060+0000 7f597c0a5740 1 -- 172.21.15.45:0/180833758 >> 172.21.15.45:0/180833758 conn(0x55698f6f4f60 msgr2=0x55698f6f5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:51.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.060+0000 7f597c0a5740 1 -- 172.21.15.45:0/180833758 shutdown_connections 2024-09-15T22:15:51.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.060+0000 7f597c0a5740 1 -- 172.21.15.45:0/180833758 wait complete. 2024-09-15T22:15:51.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.060+0000 7f597c0a5740 1 -- start start 2024-09-15T22:15:51.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.060+0000 7f597c0a5740 1 Processor -- start 2024-09-15T22:15:51.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f597c0a5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f7033c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f597c0a5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f92f0 0x55698f700710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f597c0a5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f703bb0 0x55698f700c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f597c0a5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55698f706780 con 0x55698f6f89d0 2024-09-15T22:15:51.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f597c0a5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55698f619f20 con 0x55698f6f92f0 2024-09-15T22:15:51.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f597c0a5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55698f706900 con 0x55698f703bb0 2024-09-15T22:15:51.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f597c0a5740 10 client.0 _ll_register_callbacks cb 0x55698f5e3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:15:51.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f596bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f7033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f596bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f7033c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50558/0 (socket says 172.21.15.45:50558) 2024-09-15T22:15:51.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f596bfff640 1 -- 172.21.15.45:0/3100315131 learned_addr learned my addr 172.21.15.45:0/3100315131 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:51.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f59737fe640 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f92f0 0x55698f700710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f596bfff640 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f703bb0 0x55698f700c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f596bfff640 1 -- 172.21.15.45:0/3100315131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f703bb0 msgr2=0x55698f700c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:51.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f596bfff640 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f703bb0 0x55698f700c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f596bfff640 1 -- 172.21.15.45:0/3100315131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f92f0 msgr2=0x55698f700710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:51.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f596bfff640 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f92f0 0x55698f700710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f596bfff640 1 -- 172.21.15.45:0/3100315131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55698f3d02b0 con 0x55698f6f89d0 2024-09-15T22:15:51.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f59737fe640 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f92f0 0x55698f700710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:51.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f596bfff640 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f7033c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f595c005d00 tx=0x7f595c005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec0bce68461f5eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:51.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f5952ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:15:51.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.061+0000 7f5952ffd640 1 -- 172.21.15.45:0/3100315131 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c019030 con 0x55698f6f89d0 2024-09-15T22:15:51.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f5952ffd640 1 -- 172.21.15.45:0/3100315131 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f595c004040 con 0x55698f6f89d0 2024-09-15T22:15:51.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f597c0a5740 1 -- 172.21.15.45:0/3100315131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f595c010b60 con 0x55698f6f89d0 2024-09-15T22:15:51.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f5952ffd640 1 -- 172.21.15.45:0/3100315131 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f595c032050 con 0x55698f6f89d0 2024-09-15T22:15:51.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f597c0a5740 10 client.15057 fetch_fsmap learned FSMap version 21 2024-09-15T22:15:51.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f597c0a5740 1 -- 172.21.15.45:0/3100315131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55698f712010 con 0x55698f6f89d0 2024-09-15T22:15:51.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f5952ffd640 1 -- 172.21.15.45:0/3100315131 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f595c010b60 con 0x55698f6f89d0 2024-09-15T22:15:51.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f5952ffd640 1 -- 172.21.15.45:0/3100315131 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f595c02b060 con 0x55698f6f89d0 2024-09-15T22:15:51.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f597c0a5740 10 client.15057 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:15:51.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f597c0a5740 10 client.15057 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:15:51.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f597c0a5740 20 client.15057 populate_metadata read hostname 'smithi045' 2024-09-15T22:15:51.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f597c0a5740 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55698f7143d0 0x55698f715840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f597c0a5740 4 client.15057 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:15:51.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f597c0a5740 1 -- 172.21.15.45:0/3100315131 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55698f66c600 con 0x55698f7143d0 2024-09-15T22:15:51.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.062+0000 7f59737fe640 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55698f7143d0 0x55698f715840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.063+0000 7f5952ffd640 10 client.15057 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:15:51.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.063+0000 7f59737fe640 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55698f7143d0 0x55698f715840 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9320ff9fea5b26b6 server_cookie=5d6fa7f0a538451b in_seq=0 out_seq=0 2024-09-15T22:15:51.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f5952ffd640 1 -- 172.21.15.45:0/3100315131 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55698f66c600 con 0x55698f7143d0 2024-09-15T22:15:51.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f5952ffd640 10 client.15057 handle_command_reply: tid=0 2024-09-15T22:15:51.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f597c0a5740 1 client.15057 shutdown 2024-09-15T22:15:51.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f597c0a5740 1 -- 172.21.15.45:0/3100315131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 msgr2=0x55698f7033c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:51.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f597c0a5740 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f7033c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f595c005d00 tx=0x7f595c005c50 comp rx=0 tx=0).stop 2024-09-15T22:15:51.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f597c0a5740 1 -- 172.21.15.45:0/3100315131 shutdown_connections 2024-09-15T22:15:51.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f597c0a5740 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55698f7143d0 0x55698f715840 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f597c0a5740 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f703bb0 0x55698f700c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f597c0a5740 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f92f0 0x55698f700710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f597c0a5740 1 --2- 172.21.15.45:0/3100315131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f7033c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f5952ffd640 0 client.15057 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:15:51.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f597c0a5740 1 -- 172.21.15.45:0/3100315131 >> 172.21.15.45:0/3100315131 conn(0x55698f6f4f60 msgr2=0x55698f6fac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:51.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f597c0a5740 1 -- 172.21.15.45:0/3100315131 shutdown_connections 2024-09-15T22:15:51.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f597c0a5740 1 -- 172.21.15.45:0/3100315131 wait complete. 2024-09-15T22:15:51.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.064+0000 7f597c0a5740 20 client.15057 trim_cache size 0 max 16384 2024-09-15T22:15:51.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.082+0000 7f597c0a5740 1 Processor -- start 2024-09-15T22:15:51.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.082+0000 7f597c0a5740 1 -- start start 2024-09-15T22:15:51.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.082+0000 7f597c0a5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f89d0 0x55698f715840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.082+0000 7f597c0a5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f6f92f0 0x55698f6fefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.082+0000 7f597c0a5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f703bb0 0x55698f6ff520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.082+0000 7f597c0a5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55698f713b80 con 0x55698f703bb0 2024-09-15T22:15:51.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.082+0000 7f597c0a5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55698f714250 con 0x55698f6f89d0 2024-09-15T22:15:51.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.082+0000 7f597c0a5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55698f714920 con 0x55698f6f92f0 2024-09-15T22:15:51.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.082+0000 7f596bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f703bb0 0x55698f6ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f596bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f703bb0 0x55698f6ff520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50560/0 (socket says 172.21.15.45:50560) 2024-09-15T22:15:51.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f596bfff640 1 -- 172.21.15.45:0/426438029 learned_addr learned my addr 172.21.15.45:0/426438029 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:51.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f596bfff640 1 --2- 172.21.15.45:0/426438029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f89d0 0x55698f715840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f596bfff640 1 -- 172.21.15.45:0/426438029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f6f92f0 msgr2=0x55698f6fefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:51.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f59737fe640 1 --2- 172.21.15.45:0/426438029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f6f92f0 0x55698f6fefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f596bfff640 1 --2- 172.21.15.45:0/426438029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f6f92f0 0x55698f6fefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f596bfff640 1 -- 172.21.15.45:0/426438029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f89d0 msgr2=0x55698f715840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:51.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f596bfff640 1 --2- 172.21.15.45:0/426438029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f89d0 0x55698f715840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f596bfff640 1 -- 172.21.15.45:0/426438029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55698f701230 con 0x55698f703bb0 2024-09-15T22:15:51.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f59737fe640 1 --2- 172.21.15.45:0/426438029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f6f92f0 0x55698f6fefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:15:51.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f596bfff640 1 --2- 172.21.15.45:0/426438029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f703bb0 0x55698f6ff520 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f595c003bb0 tx=0x7f595c003850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a3cef32840c6ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:51.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f59697fa640 1 -- 172.21.15.45:0/426438029 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c019040 con 0x55698f703bb0 2024-09-15T22:15:51.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f59697fa640 1 -- 172.21.15.45:0/426438029 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f595c005520 con 0x55698f703bb0 2024-09-15T22:15:51.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.083+0000 7f59697fa640 1 -- 172.21.15.45:0/426438029 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c010460 con 0x55698f703bb0 2024-09-15T22:15:51.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.084+0000 7f597c0a5740 1 -- 172.21.15.45:0/426438029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f703bb0 msgr2=0x55698f6ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:51.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.084+0000 7f597c0a5740 1 --2- 172.21.15.45:0/426438029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f703bb0 0x55698f6ff520 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f595c003bb0 tx=0x7f595c003850 comp rx=0 tx=0).stop 2024-09-15T22:15:51.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.084+0000 7f597c0a5740 1 -- 172.21.15.45:0/426438029 shutdown_connections 2024-09-15T22:15:51.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.084+0000 7f597c0a5740 1 --2- 172.21.15.45:0/426438029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f703bb0 0x55698f6ff520 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.084+0000 7f597c0a5740 1 --2- 172.21.15.45:0/426438029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f6f92f0 0x55698f6fefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.084+0000 7f597c0a5740 1 --2- 172.21.15.45:0/426438029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f6f89d0 0x55698f715840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.084+0000 7f597c0a5740 1 -- 172.21.15.45:0/426438029 >> 172.21.15.45:0/426438029 conn(0x55698f6f4f60 msgr2=0x55698f6f5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:51.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.084+0000 7f597c0a5740 1 -- 172.21.15.45:0/426438029 shutdown_connections 2024-09-15T22:15:51.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.084+0000 7f597c0a5740 1 -- 172.21.15.45:0/426438029 wait complete. 2024-09-15T22:15:51.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.084+0000 7f597c0a5740 1 -- start start 2024-09-15T22:15:51.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.084+0000 7f597c0a5740 1 Processor -- start 2024-09-15T22:15:51.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f597c0a5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f719010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f597c0a5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f6f92f0 0x55698f719550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f597c0a5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f703bb0 0x55698f77cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f597c0a5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55698f7156c0 con 0x55698f6f89d0 2024-09-15T22:15:51.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f597c0a5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55698f714ff0 con 0x55698f703bb0 2024-09-15T22:15:51.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f597c0a5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55698f715d90 con 0x55698f6f92f0 2024-09-15T22:15:51.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f597c0a5740 10 client.0 _ll_register_callbacks cb 0x7f595c013400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:15:51.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f596bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f719010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f596bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f719010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50572/0 (socket says 172.21.15.45:50572) 2024-09-15T22:15:51.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f596bfff640 1 -- 172.21.15.45:0/1691249203 learned_addr learned my addr 172.21.15.45:0/1691249203 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:51.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f59737fe640 1 --2- 172.21.15.45:0/1691249203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f6f92f0 0x55698f719550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f596bfff640 1 -- 172.21.15.45:0/1691249203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f6f92f0 msgr2=0x55698f719550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:51.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f596bfff640 1 --2- 172.21.15.45:0/1691249203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f6f92f0 0x55698f719550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f596bfff640 1 -- 172.21.15.45:0/1691249203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f703bb0 msgr2=0x55698f77cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:15:51.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f596bfff640 1 --2- 172.21.15.45:0/1691249203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f703bb0 0x55698f77cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f596bfff640 1 -- 172.21.15.45:0/1691249203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55698f6f4d90 con 0x55698f6f89d0 2024-09-15T22:15:51.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f596bfff640 1 --2- 172.21.15.45:0/1691249203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f719010 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f595c0059f0 tx=0x7f595c00bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451a8ff8915b14d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:51.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.085+0000 7f5952ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:15:51.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f5952ffd640 1 -- 172.21.15.45:0/1691249203 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c019040 con 0x55698f6f89d0 2024-09-15T22:15:51.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f5952ffd640 1 -- 172.21.15.45:0/1691249203 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f595c003be0 con 0x55698f6f89d0 2024-09-15T22:15:51.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f597c0a5740 1 -- 172.21.15.45:0/1691249203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f595c005520 con 0x55698f6f89d0 2024-09-15T22:15:51.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f5952ffd640 1 -- 172.21.15.45:0/1691249203 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f595c003de0 con 0x55698f6f89d0 2024-09-15T22:15:51.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f597c0a5740 10 client.15063 fetch_fsmap learned FSMap version 21 2024-09-15T22:15:51.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f597c0a5740 1 -- 172.21.15.45:0/1691249203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55698f77e100 con 0x55698f6f89d0 2024-09-15T22:15:51.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f5952ffd640 1 -- 172.21.15.45:0/1691249203 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f595c005520 con 0x55698f6f89d0 2024-09-15T22:15:51.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f5952ffd640 1 -- 172.21.15.45:0/1691249203 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f595c02b070 con 0x55698f6f89d0 2024-09-15T22:15:51.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f597c0a5740 10 client.15063 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:15:51.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f597c0a5740 10 client.15063 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:15:51.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f597c0a5740 20 client.15063 populate_metadata read hostname 'smithi045' 2024-09-15T22:15:51.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f597c0a5740 1 --2- 172.21.15.45:0/1691249203 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55698f782970 0x55698f781680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:51.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f597c0a5740 4 client.15063 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:15:51.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.086+0000 7f597c0a5740 1 -- 172.21.15.45:0/1691249203 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "status"}) -- 0x55698f666b10 con 0x55698f782970 2024-09-15T22:15:51.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f59737fe640 1 --2- 172.21.15.45:0/1691249203 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55698f782970 0x55698f781680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:51.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f59737fe640 1 --2- 172.21.15.45:0/1691249203 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55698f782970 0x55698f781680 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13aea7110ffa53c1 server_cookie=adcb72bad8879a84 in_seq=0 out_seq=0 2024-09-15T22:15:51.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f5952ffd640 10 client.15063 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:15:51.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f5952ffd640 1 -- 172.21.15.45:0/1691249203 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55698f666b10 con 0x55698f782970 2024-09-15T22:15:51.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f5952ffd640 10 client.15063 handle_command_reply: tid=0 2024-09-15T22:15:51.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f597c0a5740 1 client.15063 shutdown 2024-09-15T22:15:51.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f597c0a5740 1 -- 172.21.15.45:0/1691249203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 msgr2=0x55698f719010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:51.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f597c0a5740 1 --2- 172.21.15.45:0/1691249203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f719010 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f595c0059f0 tx=0x7f595c00bec0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f597c0a5740 1 -- 172.21.15.45:0/1691249203 shutdown_connections 2024-09-15T22:15:51.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f597c0a5740 1 --2- 172.21.15.45:0/1691249203 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55698f782970 0x55698f781680 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f597c0a5740 1 --2- 172.21.15.45:0/1691249203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55698f703bb0 0x55698f77cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f597c0a5740 1 --2- 172.21.15.45:0/1691249203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55698f6f92f0 0x55698f719550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f5952ffd640 0 client.15063 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:15:51.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f597c0a5740 1 --2- 172.21.15.45:0/1691249203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55698f6f89d0 0x55698f719010 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.087+0000 7f597c0a5740 1 -- 172.21.15.45:0/1691249203 >> 172.21.15.45:0/1691249203 conn(0x55698f6f4f60 msgr2=0x55698f6f3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:51.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f597c0a5740 1 -- 172.21.15.45:0/1691249203 shutdown_connections 2024-09-15T22:15:51.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f597c0a5740 1 -- 172.21.15.45:0/1691249203 wait complete. 2024-09-15T22:15:51.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f597c0a5740 20 client.15063 trim_cache size 0 max 16384 2024-09-15T22:15:51.096 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:15:51.096 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "a1911414-73ae-11ef-bceb-c7b262605968", 2024-09-15T22:15:51.096 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2024-09-15T22:15:51.096 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24476, 2024-09-15T22:15:51.096 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-09-15T22:15:51.096 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-09-15T22:15:51.096 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-09-15T22:15:51.096 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 103.281923827, 2024-09-15T22:15:51.097 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 21, 2024-09-15T22:15:51.097 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 89, 2024-09-15T22:15:51.097 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 87, 2024-09-15T22:15:51.097 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 113.847985761 2024-09-15T22:15:51.097 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:15:51.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f5979ccc640 1 -- 172.21.15.45:0/1508299127 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f59600a32d0 msgr2=0x7f59600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:51.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f5979ccc640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f59600a32d0 0x7f59600a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f596c098af0 tx=0x7f596c01eb40 comp rx=0 tx=0).stop 2024-09-15T22:15:51.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f5979ccc640 1 -- 172.21.15.45:0/1508299127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59741055b0 msgr2=0x7f597410f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:51.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f5979ccc640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59741055b0 0x7f597410f2d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f596c00eaa0 tx=0x7f596c00ef60 comp rx=0 tx=0).stop 2024-09-15T22:15:51.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f5979ccc640 1 -- 172.21.15.45:0/1508299127 shutdown_connections 2024-09-15T22:15:51.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f5979ccc640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f59600a32d0 0x7f59600a5790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f5979ccc640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59741055b0 0x7f597410f2d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f5979ccc640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5974100e30 0x7f597410ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f5979ccc640 1 --2- 172.21.15.45:0/1508299127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5974100480 0x7f597410e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:51.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f5979ccc640 1 -- 172.21.15.45:0/1508299127 >> 172.21.15.45:0/1508299127 conn(0x7f5974077210 msgr2=0x7f5974103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:51.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f5979ccc640 1 -- 172.21.15.45:0/1508299127 shutdown_connections 2024-09-15T22:15:51.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:51.088+0000 7f5979ccc640 1 -- 172.21.15.45:0/1508299127 wait complete. 2024-09-15T22:15:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:51 smithi100 ceph-mon[35319]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:51.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:51 smithi045 ceph-mon[31180]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:51.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:51 smithi165 ceph-mon[35551]: pgmap v336: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:51.861 INFO:tasks.cephadm:Setup complete, yielding 2024-09-15T22:15:51.862 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T22:15:51.873 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-15T22:15:51.873 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-15T22:15:52.132 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:52.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.603+0000 7f968b749640 1 -- 172.21.15.45:0/1602352475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96841026a0 msgr2=0x7f9684104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:52.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.603+0000 7f968b749640 1 --2- 172.21.15.45:0/1602352475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96841026a0 0x7f9684104a90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9678009900 tx=0x7f967802a410 comp rx=0 tx=0).stop 2024-09-15T22:15:52.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.603+0000 7f968b749640 1 -- 172.21.15.45:0/1602352475 shutdown_connections 2024-09-15T22:15:52.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.603+0000 7f968b749640 1 --2- 172.21.15.45:0/1602352475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9684107900 0x7f9684109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.603+0000 7f968b749640 1 --2- 172.21.15.45:0/1602352475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9684104fd0 0x7f96841073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.603+0000 7f968b749640 1 --2- 172.21.15.45:0/1602352475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96841026a0 0x7f9684104a90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.603+0000 7f968b749640 1 -- 172.21.15.45:0/1602352475 >> 172.21.15.45:0/1602352475 conn(0x7f96840fc2a0 msgr2=0x7f96840fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:52.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.603+0000 7f968b749640 1 -- 172.21.15.45:0/1602352475 shutdown_connections 2024-09-15T22:15:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.603+0000 7f968b749640 1 -- 172.21.15.45:0/1602352475 wait complete. 2024-09-15T22:15:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f968b749640 1 Processor -- start 2024-09-15T22:15:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f968b749640 1 -- start start 2024-09-15T22:15:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f968b749640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96841026a0 0x7f9684197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f968b749640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9684104fd0 0x7f96841984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f968b749640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9684107900 0x7f968419f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f968b749640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f968410d9f0 con 0x7f9684107900 2024-09-15T22:15:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f968b749640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f968410d870 con 0x7f9684104fd0 2024-09-15T22:15:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f968b749640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f968410db70 con 0x7f96841026a0 2024-09-15T22:15:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f9689ce6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9684107900 0x7f968419f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f9689ce6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9684107900 0x7f968419f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50586/0 (socket says 172.21.15.45:50586) 2024-09-15T22:15:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f9689ce6640 1 -- 172.21.15.45:0/1582547888 learned_addr learned my addr 172.21.15.45:0/1582547888 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:52.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f96894e5640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96841026a0 0x7f9684197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f9688ce4640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9684104fd0 0x7f96841984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f9689ce6640 1 -- 172.21.15.45:0/1582547888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96841026a0 msgr2=0x7f9684197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f9689ce6640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96841026a0 0x7f9684197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f9689ce6640 1 -- 172.21.15.45:0/1582547888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9684104fd0 msgr2=0x7f96841984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f9689ce6640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9684104fd0 0x7f96841984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f9689ce6640 1 -- 172.21.15.45:0/1582547888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968419fbe0 con 0x7f9684107900 2024-09-15T22:15:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.604+0000 7f9688ce4640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9684104fd0 0x7f96841984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:15:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.605+0000 7f9689ce6640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9684107900 0x7f968419f570 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f967c00cad0 tx=0x7f967c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.605+0000 7f96767fc640 1 -- 172.21.15.45:0/1582547888 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c00ae20 con 0x7f9684107900 2024-09-15T22:15:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.605+0000 7f96767fc640 1 -- 172.21.15.45:0/1582547888 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f967c004b20 con 0x7f9684107900 2024-09-15T22:15:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.605+0000 7f96767fc640 1 -- 172.21.15.45:0/1582547888 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967c00f780 con 0x7f9684107900 2024-09-15T22:15:52.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.605+0000 7f968b749640 1 -- 172.21.15.45:0/1582547888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968419fed0 con 0x7f9684107900 2024-09-15T22:15:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.605+0000 7f968b749640 1 -- 172.21.15.45:0/1582547888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96841a0330 con 0x7f9684107900 2024-09-15T22:15:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.606+0000 7f968b749640 1 -- 172.21.15.45:0/1582547888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96840fdd90 con 0x7f9684107900 2024-09-15T22:15:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.607+0000 7f96767fc640 1 -- 172.21.15.45:0/1582547888 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f967c004cd0 con 0x7f9684107900 2024-09-15T22:15:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.608+0000 7f96767fc640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f96700a3300 0x7f96700a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.608+0000 7f96894e5640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f96700a3300 0x7f96700a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.608+0000 7f96767fc640 1 -- 172.21.15.45:0/1582547888 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f967c0cfeb0 con 0x7f9684107900 2024-09-15T22:15:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.608+0000 7f96894e5640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f96700a3300 0x7f96700a57c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9678000c00 tx=0x7f9678005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:52.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.612+0000 7f96767fc640 1 -- 172.21.15.45:0/1582547888 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f967c014030 con 0x7f9684107900 2024-09-15T22:15:52.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.806+0000 7f968b749640 1 -- 172.21.15.45:0/1582547888 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f9684062630 con 0x7f96700a3300 2024-09-15T22:15:52.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.807+0000 7f96767fc640 1 -- 172.21.15.45:0/1582547888 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9684062630 con 0x7f96700a3300 2024-09-15T22:15:52.809 INFO:teuthology.orchestra.run.smithi045.stdout:Backend: cephadm 2024-09-15T22:15:52.809 INFO:teuthology.orchestra.run.smithi045.stdout:Available: Yes 2024-09-15T22:15:52.809 INFO:teuthology.orchestra.run.smithi045.stdout:Paused: No 2024-09-15T22:15:52.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.809+0000 7f968b749640 1 -- 172.21.15.45:0/1582547888 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f96700a3300 msgr2=0x7f96700a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:52.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.809+0000 7f968b749640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f96700a3300 0x7f96700a57c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9678000c00 tx=0x7f9678005be0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.809+0000 7f968b749640 1 -- 172.21.15.45:0/1582547888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9684107900 msgr2=0x7f968419f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.809+0000 7f968b749640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9684107900 0x7f968419f570 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f967c00cad0 tx=0x7f967c00cf90 comp rx=0 tx=0).stop 2024-09-15T22:15:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.809+0000 7f968b749640 1 -- 172.21.15.45:0/1582547888 shutdown_connections 2024-09-15T22:15:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.809+0000 7f968b749640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f96700a3300 0x7f96700a57c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.809+0000 7f968b749640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9684107900 0x7f968419f570 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.809+0000 7f968b749640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9684104fd0 0x7f96841984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.809+0000 7f968b749640 1 --2- 172.21.15.45:0/1582547888 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f96841026a0 0x7f9684197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.809+0000 7f968b749640 1 -- 172.21.15.45:0/1582547888 >> 172.21.15.45:0/1582547888 conn(0x7f96840fc2a0 msgr2=0x7f9684102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.809+0000 7f968b749640 1 -- 172.21.15.45:0/1582547888 shutdown_connections 2024-09-15T22:15:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:52.809+0000 7f968b749640 1 -- 172.21.15.45:0/1582547888 wait complete. 2024-09-15T22:15:53.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:53 smithi100 ceph-mon[35319]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:53.517 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:53 smithi165 ceph-mon[35551]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:53.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:53 smithi045 ceph-mon[31180]: pgmap v337: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:53.640 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-15T22:15:53.903 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:54.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:54 smithi045 ceph-mon[31180]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.422+0000 7f1bafea8640 1 -- 172.21.15.45:0/3954602709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba81026d0 msgr2=0x7f1ba8108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.422+0000 7f1bafea8640 1 --2- 172.21.15.45:0/3954602709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba81026d0 0x7f1ba8108f60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009ca0 tx=0x7f1ba002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:15:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.422+0000 7f1bafea8640 1 -- 172.21.15.45:0/3954602709 shutdown_connections 2024-09-15T22:15:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.422+0000 7f1bafea8640 1 --2- 172.21.15.45:0/3954602709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba81026d0 0x7f1ba8108f60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.422+0000 7f1bafea8640 1 --2- 172.21.15.45:0/3954602709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ba8101d10 0x7f1ba8102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.422+0000 7f1bafea8640 1 --2- 172.21.15.45:0/3954602709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba8100b10 0x7f1ba8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.422+0000 7f1bafea8640 1 -- 172.21.15.45:0/3954602709 >> 172.21.15.45:0/3954602709 conn(0x7f1ba80fc2a0 msgr2=0x7f1ba80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.422+0000 7f1bafea8640 1 -- 172.21.15.45:0/3954602709 shutdown_connections 2024-09-15T22:15:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.422+0000 7f1bafea8640 1 -- 172.21.15.45:0/3954602709 wait complete. 2024-09-15T22:15:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1bafea8640 1 Processor -- start 2024-09-15T22:15:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1bafea8640 1 -- start start 2024-09-15T22:15:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1bafea8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba8100b10 0x7f1ba8198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1bafea8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba8101d10 0x7f1ba8198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1bafea8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ba81026d0 0x7f1ba819f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1bafea8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba810c930 con 0x7f1ba8100b10 2024-09-15T22:15:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1bafea8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba810c7b0 con 0x7f1ba8101d10 2024-09-15T22:15:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1bafea8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba810cab0 con 0x7f1ba81026d0 2024-09-15T22:15:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1badc44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba8100b10 0x7f1ba8198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1badc44640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba8100b10 0x7f1ba8198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35392/0 (socket says 172.21.15.45:35392) 2024-09-15T22:15:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1badc44640 1 -- 172.21.15.45:0/43019171 learned_addr learned my addr 172.21.15.45:0/43019171 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1bad443640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba8101d10 0x7f1ba8198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1bae445640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ba81026d0 0x7f1ba819f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1badc44640 1 -- 172.21.15.45:0/43019171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ba81026d0 msgr2=0x7f1ba819f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1badc44640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ba81026d0 0x7f1ba819f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1badc44640 1 -- 172.21.15.45:0/43019171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba8101d10 msgr2=0x7f1ba8198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1badc44640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba8101d10 0x7f1ba8198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1badc44640 1 -- 172.21.15.45:0/43019171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba819fc40 con 0x7f1ba8100b10 2024-09-15T22:15:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.423+0000 7f1bae445640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ba81026d0 0x7f1ba819f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.424+0000 7f1badc44640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba8100b10 0x7f1ba8198010 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00e9c0 tx=0x7f1b9c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.424+0000 7f1b9affd640 1 -- 172.21.15.45:0/43019171 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c00ccc0 con 0x7f1ba8100b10 2024-09-15T22:15:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.424+0000 7f1b9affd640 1 -- 172.21.15.45:0/43019171 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1b9c0035f0 con 0x7f1ba8100b10 2024-09-15T22:15:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.424+0000 7f1bafea8640 1 -- 172.21.15.45:0/43019171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba819ff30 con 0x7f1ba8100b10 2024-09-15T22:15:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.424+0000 7f1b9affd640 1 -- 172.21.15.45:0/43019171 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c00ce60 con 0x7f1ba8100b10 2024-09-15T22:15:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.424+0000 7f1bafea8640 1 -- 172.21.15.45:0/43019171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba81a0400 con 0x7f1ba8100b10 2024-09-15T22:15:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.425+0000 7f1bafea8640 1 -- 172.21.15.45:0/43019171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba81a06c0 con 0x7f1ba8100b10 2024-09-15T22:15:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.426+0000 7f1b9affd640 1 -- 172.21.15.45:0/43019171 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1b9c0037a0 con 0x7f1ba8100b10 2024-09-15T22:15:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.427+0000 7f1b9affd640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f1b940a3300 0x7f1b940a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.427+0000 7f1b9affd640 1 -- 172.21.15.45:0/43019171 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f1b9c0d02d0 con 0x7f1ba8100b10 2024-09-15T22:15:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.427+0000 7f1bad443640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f1b940a3300 0x7f1b940a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.427+0000 7f1bad443640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f1b940a3300 0x7f1b940a57c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8199530 tx=0x7f1ba4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.431+0000 7f1b9affd640 1 -- 172.21.15.45:0/43019171 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b9c09cad0 con 0x7f1ba8100b10 2024-09-15T22:15:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.615+0000 7f1bafea8640 1 -- 172.21.15.45:0/43019171 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1ba80fe460 con 0x7f1b940a3300 2024-09-15T22:15:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.628+0000 7f1b9affd640 1 -- 172.21.15.45:0/43019171 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f1ba80fe460 con 0x7f1b940a3300 2024-09-15T22:15:54.631 INFO:teuthology.orchestra.run.smithi045.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-15T22:15:54.631 INFO:teuthology.orchestra.run.smithi045.stdout:mds.a smithi045 running (2m) 48s ago 2m 13.5M - 19.1.1-326-g8921c8ef f1455bd0219c cf5ec8b458b5 2024-09-15T22:15:54.631 INFO:teuthology.orchestra.run.smithi045.stdout:mds.b smithi100 running (117s) 49s ago 117s 26.2M - 19.1.1-326-g8921c8ef f1455bd0219c e5b7bff31d78 2024-09-15T22:15:54.631 INFO:teuthology.orchestra.run.smithi045.stdout:mds.c smithi165 running (2m) 49s ago 2m 16.4M - 19.1.1-326-g8921c8ef f1455bd0219c 0b145dea67f6 2024-09-15T22:15:54.631 INFO:teuthology.orchestra.run.smithi045.stdout:mds.d smithi045 running (2m) 48s ago 2m 14.4M - 19.1.1-326-g8921c8ef f1455bd0219c 467840f2b6d7 2024-09-15T22:15:54.631 INFO:teuthology.orchestra.run.smithi045.stdout:mds.e smithi100 running (2m) 49s ago 2m 15.9M - 19.1.1-326-g8921c8ef f1455bd0219c 4d9d404d9948 2024-09-15T22:15:54.631 INFO:teuthology.orchestra.run.smithi045.stdout:mds.f smithi165 running (2m) 49s ago 2m 16.5M - 19.1.1-326-g8921c8ef f1455bd0219c f5cdd361da5a 2024-09-15T22:15:54.631 INFO:teuthology.orchestra.run.smithi045.stdout:mds.g smithi045 running (2m) 48s ago 2m 13.4M - 19.1.1-326-g8921c8ef f1455bd0219c 083d3ffe532c 2024-09-15T22:15:54.631 INFO:teuthology.orchestra.run.smithi045.stdout:mds.h smithi100 running (2m) 49s ago 2m 14.2M - 19.1.1-326-g8921c8ef f1455bd0219c 2da772e7e964 2024-09-15T22:15:54.631 INFO:teuthology.orchestra.run.smithi045.stdout:mds.i smithi165 running (2m) 49s ago 2m 18.4M - 19.1.1-326-g8921c8ef f1455bd0219c cf15daafe55a 2024-09-15T22:15:54.632 INFO:teuthology.orchestra.run.smithi045.stdout:mds.j smithi045 running (2m) 48s ago 2m 16.0M - 19.1.1-326-g8921c8ef f1455bd0219c e7614a6af401 2024-09-15T22:15:54.632 INFO:teuthology.orchestra.run.smithi045.stdout:mds.k smithi100 running (2m) 49s ago 2m 13.7M - 19.1.1-326-g8921c8ef f1455bd0219c 3354fa9b1bc6 2024-09-15T22:15:54.632 INFO:teuthology.orchestra.run.smithi045.stdout:mds.l smithi165 running (2m) 49s ago 2m 16.8M - 19.1.1-326-g8921c8ef f1455bd0219c 334bfe979f6a 2024-09-15T22:15:54.632 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.x smithi045 *:9283,8765 running (9m) 48s ago 9m 508M - 19.1.1-326-g8921c8ef f1455bd0219c 918e77660f12 2024-09-15T22:15:54.632 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.y smithi100 *:8443,8765 running (7m) 49s ago 7m 443M - 19.1.1-326-g8921c8ef f1455bd0219c bf93c6228aa9 2024-09-15T22:15:54.632 INFO:teuthology.orchestra.run.smithi045.stdout:mgr.z smithi165 *:8443,8765 running (7m) 49s ago 7m 444M - 19.1.1-326-g8921c8ef f1455bd0219c 4fc695416bf1 2024-09-15T22:15:54.632 INFO:teuthology.orchestra.run.smithi045.stdout:mon.a smithi045 running (9m) 48s ago 9m 49.9M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 4d4f2538640b 2024-09-15T22:15:54.632 INFO:teuthology.orchestra.run.smithi045.stdout:mon.b smithi100 running (7m) 49s ago 7m 39.3M 2048M 19.1.1-326-g8921c8ef f1455bd0219c c6dc590835aa 2024-09-15T22:15:54.632 INFO:teuthology.orchestra.run.smithi045.stdout:mon.c smithi165 running (8m) 49s ago 8m 39.5M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 4efa1b799cd6 2024-09-15T22:15:54.632 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 smithi045 running (7m) 48s ago 7m 52.5M 4273M 19.1.1-326-g8921c8ef f1455bd0219c b5cffa46a394 2024-09-15T22:15:54.632 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 smithi100 running (7m) 49s ago 7m 55.3M 4271M 19.1.1-326-g8921c8ef f1455bd0219c 3026304882af 2024-09-15T22:15:54.632 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 smithi165 running (6m) 49s ago 6m 54.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 6b5fd80bb338 2024-09-15T22:15:54.632 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 smithi045 running (6m) 48s ago 6m 44.9M 4273M 19.1.1-326-g8921c8ef f1455bd0219c b54e5ad1c735 2024-09-15T22:15:54.633 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 smithi100 running (5m) 49s ago 5m 51.2M 4271M 19.1.1-326-g8921c8ef f1455bd0219c 06fbd92708ce 2024-09-15T22:15:54.633 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 smithi165 running (5m) 49s ago 5m 53.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c bdcaa3e2c7dd 2024-09-15T22:15:54.633 INFO:teuthology.orchestra.run.smithi045.stdout:osd.6 smithi045 running (4m) 48s ago 4m 50.6M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 82361f1c7750 2024-09-15T22:15:54.633 INFO:teuthology.orchestra.run.smithi045.stdout:osd.7 smithi100 running (4m) 49s ago 4m 44.4M 4271M 19.1.1-326-g8921c8ef f1455bd0219c 04c27f113d00 2024-09-15T22:15:54.633 INFO:teuthology.orchestra.run.smithi045.stdout:osd.8 smithi165 running (4m) 49s ago 4m 52.1M 4272M 19.1.1-326-g8921c8ef f1455bd0219c e30a20598b89 2024-09-15T22:15:54.633 INFO:teuthology.orchestra.run.smithi045.stdout:osd.9 smithi045 running (3m) 48s ago 3m 48.8M 4273M 19.1.1-326-g8921c8ef f1455bd0219c 6b40b36bd3b2 2024-09-15T22:15:54.633 INFO:teuthology.orchestra.run.smithi045.stdout:osd.10 smithi100 running (3m) 49s ago 3m 43.8M 4271M 19.1.1-326-g8921c8ef f1455bd0219c 732432cc0941 2024-09-15T22:15:54.633 INFO:teuthology.orchestra.run.smithi045.stdout:osd.11 smithi165 running (2m) 49s ago 2m 49.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 8d9f6e103897 2024-09-15T22:15:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.630+0000 7f1bafea8640 1 -- 172.21.15.45:0/43019171 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f1b940a3300 msgr2=0x7f1b940a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.630+0000 7f1bafea8640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f1b940a3300 0x7f1b940a57c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8199530 tx=0x7f1ba4009110 comp rx=0 tx=0).stop 2024-09-15T22:15:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.630+0000 7f1bafea8640 1 -- 172.21.15.45:0/43019171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba8100b10 msgr2=0x7f1ba8198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.630+0000 7f1bafea8640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba8100b10 0x7f1ba8198010 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00e9c0 tx=0x7f1b9c00edc0 comp rx=0 tx=0).stop 2024-09-15T22:15:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.630+0000 7f1bafea8640 1 -- 172.21.15.45:0/43019171 shutdown_connections 2024-09-15T22:15:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.631+0000 7f1bafea8640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f1b940a3300 0x7f1b940a57c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.631+0000 7f1bafea8640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1ba81026d0 0x7f1ba819f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.631+0000 7f1bafea8640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ba8101d10 0x7f1ba8198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.631+0000 7f1bafea8640 1 --2- 172.21.15.45:0/43019171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ba8100b10 0x7f1ba8198010 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.631+0000 7f1bafea8640 1 -- 172.21.15.45:0/43019171 >> 172.21.15.45:0/43019171 conn(0x7f1ba80fc2a0 msgr2=0x7f1ba80fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.631+0000 7f1bafea8640 1 -- 172.21.15.45:0/43019171 shutdown_connections 2024-09-15T22:15:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:54.631+0000 7f1bafea8640 1 -- 172.21.15.45:0/43019171 wait complete. 2024-09-15T22:15:54.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:54 smithi165 ceph-mon[35551]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:54.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:54 smithi100 ceph-mon[35319]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:55.411 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-15T22:15:55.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:55 smithi045 ceph-mon[31180]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:55.645 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:55 smithi100 ceph-mon[35319]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:55.670 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:55.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:55 smithi165 ceph-mon[35551]: pgmap v338: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:56.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.181+0000 7f8f34a2c640 1 -- 172.21.15.45:0/2245336750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f301026a0 msgr2=0x7f8f30104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:56.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.181+0000 7f8f34a2c640 1 --2- 172.21.15.45:0/2245336750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f301026a0 0x7f8f30104a90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009900 tx=0x7f8f2002a410 comp rx=0 tx=0).stop 2024-09-15T22:15:56.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.181+0000 7f8f34a2c640 1 -- 172.21.15.45:0/2245336750 shutdown_connections 2024-09-15T22:15:56.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.181+0000 7f8f34a2c640 1 --2- 172.21.15.45:0/2245336750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f30107900 0x7f8f30109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:56.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.181+0000 7f8f34a2c640 1 --2- 172.21.15.45:0/2245336750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f30104fd0 0x7f8f301073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:56.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.181+0000 7f8f34a2c640 1 --2- 172.21.15.45:0/2245336750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f301026a0 0x7f8f30104a90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:56.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.181+0000 7f8f34a2c640 1 -- 172.21.15.45:0/2245336750 >> 172.21.15.45:0/2245336750 conn(0x7f8f300fc2a0 msgr2=0x7f8f300fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:56.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.181+0000 7f8f34a2c640 1 -- 172.21.15.45:0/2245336750 shutdown_connections 2024-09-15T22:15:56.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.181+0000 7f8f34a2c640 1 -- 172.21.15.45:0/2245336750 wait complete. 2024-09-15T22:15:56.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.182+0000 7f8f34a2c640 1 Processor -- start 2024-09-15T22:15:56.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.182+0000 7f8f34a2c640 1 -- start start 2024-09-15T22:15:56.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.182+0000 7f8f34a2c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f301026a0 0x7f8f3019a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.182+0000 7f8f34a2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f30104fd0 0x7f8f3019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.182+0000 7f8f34a2c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f30107900 0x7f8f301a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.182+0000 7f8f34a2c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3010d9f0 con 0x7f8f30104fd0 2024-09-15T22:15:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.182+0000 7f8f34a2c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3010d870 con 0x7f8f30107900 2024-09-15T22:15:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.182+0000 7f8f34a2c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8f3010db70 con 0x7f8f301026a0 2024-09-15T22:15:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f2dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f30104fd0 0x7f8f3019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f2dd9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f30104fd0 0x7f8f3019a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35414/0 (socket says 172.21.15.45:35414) 2024-09-15T22:15:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f2dd9b640 1 -- 172.21.15.45:0/232873618 learned_addr learned my addr 172.21.15.45:0/232873618 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f2ed9d640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f30107900 0x7f8f301a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f2e59c640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f301026a0 0x7f8f3019a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f2dd9b640 1 -- 172.21.15.45:0/232873618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f301026a0 msgr2=0x7f8f3019a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:56.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f2dd9b640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f301026a0 0x7f8f3019a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:56.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f2dd9b640 1 -- 172.21.15.45:0/232873618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f30107900 msgr2=0x7f8f301a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:56.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f2dd9b640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f30107900 0x7f8f301a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:56.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f2dd9b640 1 -- 172.21.15.45:0/232873618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f301a1e30 con 0x7f8f30104fd0 2024-09-15T22:15:56.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f2dd9b640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f30104fd0 0x7f8f3019a740 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800e9c0 tx=0x7f8f1800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:56.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f277fe640 1 -- 172.21.15.45:0/232873618 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1800cd80 con 0x7f8f30104fd0 2024-09-15T22:15:56.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f34a2c640 1 -- 172.21.15.45:0/232873618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f301a2120 con 0x7f8f30104fd0 2024-09-15T22:15:56.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f277fe640 1 -- 172.21.15.45:0/232873618 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f18005520 con 0x7f8f30104fd0 2024-09-15T22:15:56.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.183+0000 7f8f277fe640 1 -- 172.21.15.45:0/232873618 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f18010690 con 0x7f8f30104fd0 2024-09-15T22:15:56.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.184+0000 7f8f34a2c640 1 -- 172.21.15.45:0/232873618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f301a2660 con 0x7f8f30104fd0 2024-09-15T22:15:56.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.184+0000 7f8f34a2c640 1 -- 172.21.15.45:0/232873618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f30109450 con 0x7f8f30104fd0 2024-09-15T22:15:56.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.186+0000 7f8f277fe640 1 -- 172.21.15.45:0/232873618 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8f180046c0 con 0x7f8f30104fd0 2024-09-15T22:15:56.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.186+0000 7f8f277fe640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8f1c0a3300 0x7f8f1c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:56.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.186+0000 7f8f277fe640 1 -- 172.21.15.45:0/232873618 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f8f180d0160 con 0x7f8f30104fd0 2024-09-15T22:15:56.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.186+0000 7f8f2e59c640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8f1c0a3300 0x7f8f1c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:56.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.187+0000 7f8f2e59c640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8f1c0a3300 0x7f8f1c0a57c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8f20006010 tx=0x7f8f20031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:56.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.191+0000 7f8f277fe640 1 -- 172.21.15.45:0/232873618 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8f1809c9c0 con 0x7f8f30104fd0 2024-09-15T22:15:56.387 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:56 smithi045 ceph-mon[31180]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:56.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.400+0000 7f8f34a2c640 1 -- 172.21.15.45:0/232873618 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f8f30062630 con 0x7f8f1c0a3300 2024-09-15T22:15:56.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.406+0000 7f8f277fe640 1 -- 172.21.15.45:0/232873618 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f8f30062630 con 0x7f8f1c0a3300 2024-09-15T22:15:56.408 INFO:teuthology.orchestra.run.smithi045.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-15T22:15:56.408 INFO:teuthology.orchestra.run.smithi045.stdout:mds.all 12/12 51s ago 2m smithi045=a;smithi045=d;smithi045=g;smithi045=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi165=c;smithi165=f;smithi165=i;smithi165=l;count:12 2024-09-15T22:15:56.408 INFO:teuthology.orchestra.run.smithi045.stdout:mgr 3/3 51s ago 7m smithi045=x;smithi100=y;smithi165=z;count:3 2024-09-15T22:15:56.409 INFO:teuthology.orchestra.run.smithi045.stdout:mon 3/3 51s ago 8m smithi045:172.21.15.45=a;smithi100:172.21.15.100=b;smithi165:172.21.15.165=c;count:3 2024-09-15T22:15:56.409 INFO:teuthology.orchestra.run.smithi045.stdout:osd 12 51s ago - 2024-09-15T22:15:56.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.408+0000 7f8f34a2c640 1 -- 172.21.15.45:0/232873618 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8f1c0a3300 msgr2=0x7f8f1c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.408+0000 7f8f34a2c640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8f1c0a3300 0x7f8f1c0a57c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8f20006010 tx=0x7f8f20031640 comp rx=0 tx=0).stop 2024-09-15T22:15:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.408+0000 7f8f34a2c640 1 -- 172.21.15.45:0/232873618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f30104fd0 msgr2=0x7f8f3019a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.408+0000 7f8f34a2c640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f30104fd0 0x7f8f3019a740 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800e9c0 tx=0x7f8f1800ee80 comp rx=0 tx=0).stop 2024-09-15T22:15:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.408+0000 7f8f34a2c640 1 -- 172.21.15.45:0/232873618 shutdown_connections 2024-09-15T22:15:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.408+0000 7f8f34a2c640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f8f1c0a3300 0x7f8f1c0a57c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.408+0000 7f8f34a2c640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f30107900 0x7f8f301a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.408+0000 7f8f34a2c640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f30104fd0 0x7f8f3019a740 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.408+0000 7f8f34a2c640 1 --2- 172.21.15.45:0/232873618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f301026a0 0x7f8f3019a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.408+0000 7f8f34a2c640 1 -- 172.21.15.45:0/232873618 >> 172.21.15.45:0/232873618 conn(0x7f8f300fc2a0 msgr2=0x7f8f30101d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.409+0000 7f8f34a2c640 1 -- 172.21.15.45:0/232873618 shutdown_connections 2024-09-15T22:15:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:56.409+0000 7f8f34a2c640 1 -- 172.21.15.45:0/232873618 wait complete. 2024-09-15T22:15:56.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:56 smithi165 ceph-mon[35551]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:56.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:56 smithi100 ceph-mon[35319]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:57.053 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-15T22:15:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:57.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:57 smithi045 ceph-mon[31180]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:57.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:57 smithi165 ceph-mon[35551]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:57.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:57 smithi100 ceph-mon[35319]: pgmap v339: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:15:57.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.772+0000 7fac3537c640 1 -- 172.21.15.45:0/418613196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30104f90 msgr2=0x7fac30107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:57.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.772+0000 7fac3537c640 1 --2- 172.21.15.45:0/418613196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30104f90 0x7fac30107380 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fac24009900 tx=0x7fac2402a410 comp rx=0 tx=0).stop 2024-09-15T22:15:57.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.773+0000 7fac3537c640 1 -- 172.21.15.45:0/418613196 shutdown_connections 2024-09-15T22:15:57.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.773+0000 7fac3537c640 1 --2- 172.21.15.45:0/418613196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac301078c0 0x7fac30109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:57.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.773+0000 7fac3537c640 1 --2- 172.21.15.45:0/418613196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac30104f90 0x7fac30107380 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:57.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.773+0000 7fac3537c640 1 --2- 172.21.15.45:0/418613196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac30102660 0x7fac30104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:57.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.773+0000 7fac3537c640 1 -- 172.21.15.45:0/418613196 >> 172.21.15.45:0/418613196 conn(0x7fac300fc280 msgr2=0x7fac300fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:57.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.773+0000 7fac3537c640 1 -- 172.21.15.45:0/418613196 shutdown_connections 2024-09-15T22:15:57.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.773+0000 7fac3537c640 1 -- 172.21.15.45:0/418613196 wait complete. 2024-09-15T22:15:57.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.773+0000 7fac3537c640 1 Processor -- start 2024-09-15T22:15:57.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.773+0000 7fac3537c640 1 -- start start 2024-09-15T22:15:57.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac3537c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac30102660 0x7fac30198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:57.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac3537c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac30104f90 0x7fac30198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:57.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac3537c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac301078c0 0x7fac3019f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:57.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac3537c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fac3010d9f0 con 0x7fac301078c0 2024-09-15T22:15:57.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac3537c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac3010d870 con 0x7fac30102660 2024-09-15T22:15:57.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac3537c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fac3010db70 con 0x7fac30104f90 2024-09-15T22:15:57.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac2f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac301078c0 0x7fac3019f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:57.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac2f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac301078c0 0x7fac3019f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35428/0 (socket says 172.21.15.45:35428) 2024-09-15T22:15:57.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac2f7fe640 1 -- 172.21.15.45:0/2257488160 learned_addr learned my addr 172.21.15.45:0/2257488160 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:57.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac2e7fc640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac30104f90 0x7fac30198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:57.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac2effd640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac30102660 0x7fac30198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:57.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac2f7fe640 1 -- 172.21.15.45:0/2257488160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac30104f90 msgr2=0x7fac30198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:57.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac2f7fe640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac30104f90 0x7fac30198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:57.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac2f7fe640 1 -- 172.21.15.45:0/2257488160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac30102660 msgr2=0x7fac30198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:57.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac2f7fe640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac30102660 0x7fac30198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:57.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac2f7fe640 1 -- 172.21.15.45:0/2257488160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3019fc70 con 0x7fac301078c0 2024-09-15T22:15:57.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac2effd640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac30102660 0x7fac30198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:15:57.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac2f7fe640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac301078c0 0x7fac3019f600 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fac28009fd0 tx=0x7fac2800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:57.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac17fff640 1 -- 172.21.15.45:0/2257488160 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28011830 con 0x7fac301078c0 2024-09-15T22:15:57.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac3537c640 1 -- 172.21.15.45:0/2257488160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3019ff60 con 0x7fac301078c0 2024-09-15T22:15:57.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac17fff640 1 -- 172.21.15.45:0/2257488160 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fac28016070 con 0x7fac301078c0 2024-09-15T22:15:57.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.774+0000 7fac17fff640 1 -- 172.21.15.45:0/2257488160 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2800f2e0 con 0x7fac301078c0 2024-09-15T22:15:57.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.775+0000 7fac3537c640 1 -- 172.21.15.45:0/2257488160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac301a0490 con 0x7fac301078c0 2024-09-15T22:15:57.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.776+0000 7fac3537c640 1 -- 172.21.15.45:0/2257488160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac300fdd70 con 0x7fac301078c0 2024-09-15T22:15:57.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.777+0000 7fac17fff640 1 -- 172.21.15.45:0/2257488160 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fac2801b460 con 0x7fac301078c0 2024-09-15T22:15:57.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.777+0000 7fac17fff640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fac180a3300 0x7fac180a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:57.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.778+0000 7fac17fff640 1 -- 172.21.15.45:0/2257488160 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fac280cf360 con 0x7fac301078c0 2024-09-15T22:15:57.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.778+0000 7fac2effd640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fac180a3300 0x7fac180a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:57.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.778+0000 7fac2effd640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fac180a3300 0x7fac180a57c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fac20005c40 tx=0x7fac2000a430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:57.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.782+0000 7fac17fff640 1 -- 172.21.15.45:0/2257488160 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac2809bcd0 con 0x7fac301078c0 2024-09-15T22:15:57.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.965+0000 7fac3537c640 1 -- 172.21.15.45:0/2257488160 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fac30062630 con 0x7fac180a3300 2024-09-15T22:15:57.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.966+0000 7fac17fff640 1 -- 172.21.15.45:0/2257488160 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fac30062630 con 0x7fac180a3300 2024-09-15T22:15:57.968 INFO:teuthology.orchestra.run.smithi045.stdout:HOST ADDR LABELS STATUS 2024-09-15T22:15:57.968 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045 172.21.15.45 2024-09-15T22:15:57.968 INFO:teuthology.orchestra.run.smithi045.stdout:smithi100 172.21.15.100 2024-09-15T22:15:57.968 INFO:teuthology.orchestra.run.smithi045.stdout:smithi165 172.21.15.165 2024-09-15T22:15:57.968 INFO:teuthology.orchestra.run.smithi045.stdout:3 hosts in cluster 2024-09-15T22:15:57.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.968+0000 7fac3537c640 1 -- 172.21.15.45:0/2257488160 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fac180a3300 msgr2=0x7fac180a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:57.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.968+0000 7fac3537c640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fac180a3300 0x7fac180a57c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fac20005c40 tx=0x7fac2000a430 comp rx=0 tx=0).stop 2024-09-15T22:15:57.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.968+0000 7fac3537c640 1 -- 172.21.15.45:0/2257488160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac301078c0 msgr2=0x7fac3019f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.968+0000 7fac3537c640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac301078c0 0x7fac3019f600 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fac28009fd0 tx=0x7fac2800b8e0 comp rx=0 tx=0).stop 2024-09-15T22:15:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.968+0000 7fac3537c640 1 -- 172.21.15.45:0/2257488160 shutdown_connections 2024-09-15T22:15:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.968+0000 7fac3537c640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fac180a3300 0x7fac180a57c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.968+0000 7fac3537c640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac301078c0 0x7fac3019f600 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.968+0000 7fac3537c640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fac30104f90 0x7fac30198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.968+0000 7fac3537c640 1 --2- 172.21.15.45:0/2257488160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac30102660 0x7fac30198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.968+0000 7fac3537c640 1 -- 172.21.15.45:0/2257488160 >> 172.21.15.45:0/2257488160 conn(0x7fac300fc280 msgr2=0x7fac30102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.968+0000 7fac3537c640 1 -- 172.21.15.45:0/2257488160 shutdown_connections 2024-09-15T22:15:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:57.968+0000 7fac3537c640 1 -- 172.21.15.45:0/2257488160 wait complete. 2024-09-15T22:15:58.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:58 smithi045 ceph-mon[31180]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:58.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:58 smithi165 ceph-mon[35551]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:58.721 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-15T22:15:58.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:58 smithi100 ceph-mon[35319]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:58.983 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:15:59.409 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:59 smithi045 ceph-mon[31180]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:59.409 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:15:59 smithi045 ceph-mon[31180]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.490+0000 7f76012bc640 1 -- 172.21.15.45:0/389263341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc100ad0 msgr2=0x7f75fc100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.490+0000 7f76012bc640 1 --2- 172.21.15.45:0/389263341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc100ad0 0x7f75fc100ed0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f75ec009900 tx=0x7f75ec02a410 comp rx=0 tx=0).stop 2024-09-15T22:15:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.490+0000 7f76012bc640 1 -- 172.21.15.45:0/389263341 shutdown_connections 2024-09-15T22:15:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.490+0000 7f76012bc640 1 --2- 172.21.15.45:0/389263341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75fc102690 0x7f75fc108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.490+0000 7f76012bc640 1 --2- 172.21.15.45:0/389263341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75fc101cd0 0x7f75fc102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.491+0000 7f76012bc640 1 --2- 172.21.15.45:0/389263341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc100ad0 0x7f75fc100ed0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.491+0000 7f76012bc640 1 -- 172.21.15.45:0/389263341 >> 172.21.15.45:0/389263341 conn(0x7f75fc0fc280 msgr2=0x7f75fc0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.491+0000 7f76012bc640 1 -- 172.21.15.45:0/389263341 shutdown_connections 2024-09-15T22:15:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.491+0000 7f76012bc640 1 -- 172.21.15.45:0/389263341 wait complete. 2024-09-15T22:15:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.491+0000 7f76012bc640 1 Processor -- start 2024-09-15T22:15:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.491+0000 7f76012bc640 1 -- start start 2024-09-15T22:15:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.491+0000 7f76012bc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75fc100ad0 0x7f75fc19a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.491+0000 7f76012bc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75fc101cd0 0x7f75fc19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.491+0000 7f76012bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc102690 0x7f75fc1a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.491+0000 7f76012bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc10c880 con 0x7f75fc102690 2024-09-15T22:15:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.491+0000 7f76012bc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc10c700 con 0x7f75fc101cd0 2024-09-15T22:15:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.491+0000 7f76012bc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc10ca00 con 0x7f75fc100ad0 2024-09-15T22:15:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc102690 0x7f75fc1a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc102690 0x7f75fc1a1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35450/0 (socket says 172.21.15.45:35450) 2024-09-15T22:15:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75fb7fe640 1 -- 172.21.15.45:0/2902667456 learned_addr learned my addr 172.21.15.45:0/2902667456 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:15:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75fa7fc640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75fc101cd0 0x7f75fc19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75faffd640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75fc100ad0 0x7f75fc19a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75fb7fe640 1 -- 172.21.15.45:0/2902667456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75fc100ad0 msgr2=0x7f75fc19a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75fb7fe640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75fc100ad0 0x7f75fc19a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75fb7fe640 1 -- 172.21.15.45:0/2902667456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75fc101cd0 msgr2=0x7f75fc19a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75fb7fe640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75fc101cd0 0x7f75fc19a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75fb7fe640 1 -- 172.21.15.45:0/2902667456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75fc1a1dc0 con 0x7f75fc102690 2024-09-15T22:15:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75faffd640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75fc100ad0 0x7f75fc19a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:15:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75fb7fe640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc102690 0x7f75fc1a1750 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f75f400cce0 tx=0x7f75f400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75e3fff640 1 -- 172.21.15.45:0/2902667456 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f400f450 con 0x7f75fc102690 2024-09-15T22:15:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75e3fff640 1 -- 172.21.15.45:0/2902667456 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f75f400faf0 con 0x7f75fc102690 2024-09-15T22:15:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f76012bc640 1 -- 172.21.15.45:0/2902667456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75fc1a20b0 con 0x7f75fc102690 2024-09-15T22:15:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f75e3fff640 1 -- 172.21.15.45:0/2902667456 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4018cc0 con 0x7f75fc102690 2024-09-15T22:15:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.492+0000 7f76012bc640 1 -- 172.21.15.45:0/2902667456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75fc1a25a0 con 0x7f75fc102690 2024-09-15T22:15:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.493+0000 7f76012bc640 1 -- 172.21.15.45:0/2902667456 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75fc1a2860 con 0x7f75fc102690 2024-09-15T22:15:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.495+0000 7f75e3fff640 1 -- 172.21.15.45:0/2902667456 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f75f400f5f0 con 0x7f75fc102690 2024-09-15T22:15:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.496+0000 7f75e3fff640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f75e40a3300 0x7f75e40a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:15:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.496+0000 7f75faffd640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f75e40a3300 0x7f75e40a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:15:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.496+0000 7f75e3fff640 1 -- 172.21.15.45:0/2902667456 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f75f40d0220 con 0x7f75fc102690 2024-09-15T22:15:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.496+0000 7f75faffd640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f75e40a3300 0x7f75e40a57c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000c00 tx=0x7f75ec009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:15:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.500+0000 7f75e3fff640 1 -- 172.21.15.45:0/2902667456 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f75f4014030 con 0x7f75fc102690 2024-09-15T22:15:59.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.684+0000 7f76012bc640 1 -- 172.21.15.45:0/2902667456 --> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f75fc1a2a30 con 0x7f75e40a3300 2024-09-15T22:15:59.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.685+0000 7f75e3fff640 1 -- 172.21.15.45:0/2902667456 <== mgr.14150 v2:172.21.15.45:6800/1919238369 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f75fc1a2a30 con 0x7f75e40a3300 2024-09-15T22:15:59.687 INFO:teuthology.orchestra.run.smithi045.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-15T22:15:59.687 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75120098480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-15T22:15:59.688 INFO:teuthology.orchestra.run.smithi045.stdout:smithi100 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WR400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-15T22:15:59.688 INFO:teuthology.orchestra.run.smithi045.stdout:smithi165 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CE400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-15T22:15:59.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.688+0000 7f76012bc640 1 -- 172.21.15.45:0/2902667456 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f75e40a3300 msgr2=0x7f75e40a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:59.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.688+0000 7f76012bc640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f75e40a3300 0x7f75e40a57c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f75ec000c00 tx=0x7f75ec009560 comp rx=0 tx=0).stop 2024-09-15T22:15:59.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.688+0000 7f76012bc640 1 -- 172.21.15.45:0/2902667456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc102690 msgr2=0x7f75fc1a1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:15:59.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.688+0000 7f76012bc640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc102690 0x7f75fc1a1750 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f75f400cce0 tx=0x7f75f400a620 comp rx=0 tx=0).stop 2024-09-15T22:15:59.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.688+0000 7f76012bc640 1 -- 172.21.15.45:0/2902667456 shutdown_connections 2024-09-15T22:15:59.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.688+0000 7f76012bc640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f75e40a3300 0x7f75e40a57c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.688+0000 7f76012bc640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75fc102690 0x7f75fc1a1750 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.688+0000 7f76012bc640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75fc101cd0 0x7f75fc19a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.688+0000 7f76012bc640 1 --2- 172.21.15.45:0/2902667456 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f75fc100ad0 0x7f75fc19a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:15:59.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.688+0000 7f76012bc640 1 -- 172.21.15.45:0/2902667456 >> 172.21.15.45:0/2902667456 conn(0x7f75fc0fc280 msgr2=0x7f75fc0fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:15:59.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.689+0000 7f76012bc640 1 -- 172.21.15.45:0/2902667456 shutdown_connections 2024-09-15T22:15:59.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:15:59.689+0000 7f76012bc640 1 -- 172.21.15.45:0/2902667456 wait complete. 2024-09-15T22:15:59.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:59 smithi165 ceph-mon[35551]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:59.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:15:59 smithi165 ceph-mon[35551]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:15:59.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:59 smithi100 ceph-mon[35319]: pgmap v340: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:15:59.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:15:59 smithi100 ceph-mon[35319]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:00.513 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T22:16:00.628 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-15T22:16:00.628 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-15T22:16:00.892 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:01 smithi045 ceph-mon[31180]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:16:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:01 smithi045 ceph-mon[31180]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:01.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.390+0000 7fa37b968640 1 -- 172.21.15.45:0/1306684146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3741026d0 msgr2=0x7fa374108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.390+0000 7fa37b968640 1 --2- 172.21.15.45:0/1306684146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3741026d0 0x7fa374108f60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009ca0 tx=0x7fa36c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.390+0000 7fa37b968640 1 -- 172.21.15.45:0/1306684146 shutdown_connections 2024-09-15T22:16:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.390+0000 7fa37b968640 1 --2- 172.21.15.45:0/1306684146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3741026d0 0x7fa374108f60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.390+0000 7fa37b968640 1 --2- 172.21.15.45:0/1306684146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa374101d10 0x7fa374102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.390+0000 7fa37b968640 1 --2- 172.21.15.45:0/1306684146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa374100b10 0x7fa374100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.390+0000 7fa37b968640 1 -- 172.21.15.45:0/1306684146 >> 172.21.15.45:0/1306684146 conn(0x7fa3740fc2a0 msgr2=0x7fa3740fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.390+0000 7fa37b968640 1 -- 172.21.15.45:0/1306684146 shutdown_connections 2024-09-15T22:16:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.390+0000 7fa37b968640 1 -- 172.21.15.45:0/1306684146 wait complete. 2024-09-15T22:16:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa37b968640 1 Processor -- start 2024-09-15T22:16:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa37b968640 1 -- start start 2024-09-15T22:16:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa37b968640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa374100b10 0x7fa37406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:01.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa37b968640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa374101d10 0x7fa37419cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa37b968640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3741026d0 0x7fa37419f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa37b968640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa37410c980 con 0x7fa3741026d0 2024-09-15T22:16:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa37b968640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa37410c800 con 0x7fa374101d10 2024-09-15T22:16:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa37b968640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa37410cb00 con 0x7fa374100b10 2024-09-15T22:16:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa379f05640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3741026d0 0x7fa37419f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa379f05640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3741026d0 0x7fa37419f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35468/0 (socket says 172.21.15.45:35468) 2024-09-15T22:16:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa379f05640 1 -- 172.21.15.45:0/1944179078 learned_addr learned my addr 172.21.15.45:0/1944179078 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa379704640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa374100b10 0x7fa37406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa378f03640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa374101d10 0x7fa37419cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa379f05640 1 -- 172.21.15.45:0/1944179078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa374100b10 msgr2=0x7fa37406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa379f05640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa374100b10 0x7fa37406b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa379f05640 1 -- 172.21.15.45:0/1944179078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa374101d10 msgr2=0x7fa37419cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa379f05640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa374101d10 0x7fa37419cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.391+0000 7fa379f05640 1 -- 172.21.15.45:0/1944179078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37419fc80 con 0x7fa3741026d0 2024-09-15T22:16:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.392+0000 7fa379f05640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3741026d0 0x7fa37419f370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa36c003ba0 tx=0x7fa36c003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.392+0000 7fa36a7fc640 1 -- 172.21.15.45:0/1944179078 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c004040 con 0x7fa3741026d0 2024-09-15T22:16:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.392+0000 7fa36a7fc640 1 -- 172.21.15.45:0/1944179078 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa36c0046e0 con 0x7fa3741026d0 2024-09-15T22:16:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.392+0000 7fa37b968640 1 -- 172.21.15.45:0/1944179078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37419feb0 con 0x7fa3741026d0 2024-09-15T22:16:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.392+0000 7fa36a7fc640 1 -- 172.21.15.45:0/1944179078 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0305c0 con 0x7fa3741026d0 2024-09-15T22:16:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.392+0000 7fa37b968640 1 -- 172.21.15.45:0/1944179078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3741a0440 con 0x7fa3741026d0 2024-09-15T22:16:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.393+0000 7fa37b968640 1 -- 172.21.15.45:0/1944179078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa374107e40 con 0x7fa3741026d0 2024-09-15T22:16:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.394+0000 7fa36a7fc640 1 -- 172.21.15.45:0/1944179078 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa36c02f610 con 0x7fa3741026d0 2024-09-15T22:16:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.395+0000 7fa36a7fc640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3600a32d0 0x7fa3600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:01.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.395+0000 7fa379704640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3600a32d0 0x7fa3600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:01.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.395+0000 7fa36a7fc640 1 -- 172.21.15.45:0/1944179078 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fa36c0f1480 con 0x7fa3741026d0 2024-09-15T22:16:01.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.396+0000 7fa379704640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3600a32d0 0x7fa3600a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa374101b70 tx=0x7fa37000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:01.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.399+0000 7fa36a7fc640 1 -- 172.21.15.45:0/1944179078 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa36c0bddf0 con 0x7fa3741026d0 2024-09-15T22:16:01.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.612+0000 7fa37b968640 1 -- 172.21.15.45:0/1944179078 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa37402da10 con 0x7fa3741026d0 2024-09-15T22:16:01.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.612+0000 7fa36a7fc640 1 -- 172.21.15.45:0/1944179078 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3054 (secure 0 0 0) 0x7fa36c0098b0 con 0x7fa3741026d0 2024-09-15T22:16:01.614 INFO:teuthology.orchestra.run.smithi045.stdout:e21 2024-09-15T22:16:01.615 INFO:teuthology.orchestra.run.smithi045.stdout:btime 2024-09-15T22:14:45:923329+0000 2024-09-15T22:16:01.615 INFO:teuthology.orchestra.run.smithi045.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T22:16:01.615 INFO:teuthology.orchestra.run.smithi045.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:16:01.615 INFO:teuthology.orchestra.run.smithi045.stdout:legacy client fscid: 1 2024-09-15T22:16:01.615 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:01.615 INFO:teuthology.orchestra.run.smithi045.stdout:Filesystem 'cephfs' (1) 2024-09-15T22:16:01.615 INFO:teuthology.orchestra.run.smithi045.stdout:fs_name cephfs 2024-09-15T22:16:01.615 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 21 2024-09-15T22:16:01.615 INFO:teuthology.orchestra.run.smithi045.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-15T22:16:01.615 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-15T22:14:07.480609+0000 2024-09-15T22:16:01.615 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-15T22:14:45.759794+0000 2024-09-15T22:16:01.615 INFO:teuthology.orchestra.run.smithi045.stdout:tableserver 0 2024-09-15T22:16:01.616 INFO:teuthology.orchestra.run.smithi045.stdout:root 0 2024-09-15T22:16:01.616 INFO:teuthology.orchestra.run.smithi045.stdout:session_timeout 300 2024-09-15T22:16:01.616 INFO:teuthology.orchestra.run.smithi045.stdout:session_autoclose 300 2024-09-15T22:16:01.616 INFO:teuthology.orchestra.run.smithi045.stdout:max_file_size 1099511627776 2024-09-15T22:16:01.616 INFO:teuthology.orchestra.run.smithi045.stdout:max_xattr_size 65536 2024-09-15T22:16:01.616 INFO:teuthology.orchestra.run.smithi045.stdout:required_client_features {} 2024-09-15T22:16:01.616 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure 0 2024-09-15T22:16:01.616 INFO:teuthology.orchestra.run.smithi045.stdout:last_failure_osd_epoch 0 2024-09-15T22:16:01.616 INFO:teuthology.orchestra.run.smithi045.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T22:16:01.616 INFO:teuthology.orchestra.run.smithi045.stdout:max_mds 1 2024-09-15T22:16:01.616 INFO:teuthology.orchestra.run.smithi045.stdout:in 0 2024-09-15T22:16:01.616 INFO:teuthology.orchestra.run.smithi045.stdout:up {0=24476} 2024-09-15T22:16:01.617 INFO:teuthology.orchestra.run.smithi045.stdout:failed 2024-09-15T22:16:01.617 INFO:teuthology.orchestra.run.smithi045.stdout:damaged 2024-09-15T22:16:01.617 INFO:teuthology.orchestra.run.smithi045.stdout:stopped 2024-09-15T22:16:01.617 INFO:teuthology.orchestra.run.smithi045.stdout:data_pools [3,4] 2024-09-15T22:16:01.617 INFO:teuthology.orchestra.run.smithi045.stdout:metadata_pool 2 2024-09-15T22:16:01.617 INFO:teuthology.orchestra.run.smithi045.stdout:inline_data disabled 2024-09-15T22:16:01.617 INFO:teuthology.orchestra.run.smithi045.stdout:balancer 2024-09-15T22:16:01.617 INFO:teuthology.orchestra.run.smithi045.stdout:bal_rank_mask -1 2024-09-15T22:16:01.617 INFO:teuthology.orchestra.run.smithi045.stdout:standby_count_wanted 0 2024-09-15T22:16:01.617 INFO:teuthology.orchestra.run.smithi045.stdout:qdb_cluster leader: 24476 members: 24476 2024-09-15T22:16:01.617 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b{0:24476} state up:active seq 4 addr [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:16:01.617 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.i{0:24469} state up:standby-replay seq 1 addr [v2:172.21.15.165:6838/2278031843,v1:172.21.15.165:6839/2278031843] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:16:01.617 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:01.618 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:01.618 INFO:teuthology.orchestra.run.smithi045.stdout:Standby daemons: 2024-09-15T22:16:01.618 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:01.618 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.j{-1:14538} state up:standby seq 1 addr [v2:172.21.15.45:6834/2368971397,v1:172.21.15.45:6835/2368971397] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:16:01.618 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d{-1:14550} state up:standby seq 1 addr [v2:172.21.15.45:6836/378260478,v1:172.21.15.45:6837/378260478] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:16:01.618 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.g{-1:14601} state up:standby seq 1 addr [v2:172.21.15.45:6838/3708053507,v1:172.21.15.45:6839/3708053507] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:16:01.618 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a{-1:14607} state up:standby seq 1 addr [v2:172.21.15.45:6840/1624795277,v1:172.21.15.45:6841/1624795277] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:16:01.618 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.k{-1:24404} state up:standby seq 1 addr [v2:172.21.15.100:6832/3112428521,v1:172.21.15.100:6833/3112428521] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:16:01.618 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.l{-1:24412} state up:standby seq 1 addr [v2:172.21.15.165:6832/3442116684,v1:172.21.15.165:6833/3442116684] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:16:01.618 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.e{-1:24434} state up:standby seq 1 addr [v2:172.21.15.100:6834/1950215908,v1:172.21.15.100:6835/1950215908] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:16:01.618 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.f{-1:24445} state up:standby seq 1 addr [v2:172.21.15.165:6834/2608811330,v1:172.21.15.165:6835/2608811330] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:16:01.619 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.h{-1:24449} state up:standby seq 1 addr [v2:172.21.15.100:6836/864108145,v1:172.21.15.100:6837/864108145] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:16:01.619 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c{-1:24451} state up:standby seq 1 addr [v2:172.21.15.165:6836/1072928476,v1:172.21.15.165:6837/1072928476] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T22:16:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:16:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.614+0000 7fa37b968640 1 -- 172.21.15.45:0/1944179078 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3600a32d0 msgr2=0x7fa3600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.614+0000 7fa37b968640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3600a32d0 0x7fa3600a5790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa374101b70 tx=0x7fa37000a2d0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.614+0000 7fa37b968640 1 -- 172.21.15.45:0/1944179078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3741026d0 msgr2=0x7fa37419f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.614+0000 7fa37b968640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3741026d0 0x7fa37419f370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa36c003ba0 tx=0x7fa36c003bd0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.614+0000 7fa37b968640 1 -- 172.21.15.45:0/1944179078 shutdown_connections 2024-09-15T22:16:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.614+0000 7fa37b968640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fa3600a32d0 0x7fa3600a5790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.614+0000 7fa37b968640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3741026d0 0x7fa37419f370 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.614+0000 7fa37b968640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa374101d10 0x7fa37419cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.614+0000 7fa37b968640 1 --2- 172.21.15.45:0/1944179078 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa374100b10 0x7fa37406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.614+0000 7fa37b968640 1 -- 172.21.15.45:0/1944179078 >> 172.21.15.45:0/1944179078 conn(0x7fa3740fc2a0 msgr2=0x7fa374105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:01.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.614+0000 7fa37b968640 1 -- 172.21.15.45:0/1944179078 shutdown_connections 2024-09-15T22:16:01.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:01.614+0000 7fa37b968640 1 -- 172.21.15.45:0/1944179078 wait complete. 2024-09-15T22:16:01.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:01 smithi165 ceph-mon[35551]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:16:01.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:01 smithi165 ceph-mon[35551]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:01.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:01 smithi100 ceph-mon[35319]: pgmap v341: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:16:01.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:01 smithi100 ceph-mon[35319]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:02.339 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:02 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1944179078' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:16:02.370 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-15T22:16:02.630 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:02.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:02 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1944179078' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:16:02.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:02 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1944179078' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T22:16:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.123+0000 7fd444756640 1 -- 172.21.15.45:0/1067368900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd43c1026d0 msgr2=0x7fd43c108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:03.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.123+0000 7fd444756640 1 --2- 172.21.15.45:0/1067368900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd43c1026d0 0x7fd43c108f60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd434009ca0 tx=0x7fd43402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 -- 172.21.15.45:0/1067368900 shutdown_connections 2024-09-15T22:16:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 --2- 172.21.15.45:0/1067368900 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd43c1026d0 0x7fd43c108f60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 --2- 172.21.15.45:0/1067368900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd43c101d10 0x7fd43c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 --2- 172.21.15.45:0/1067368900 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd43c100b10 0x7fd43c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 -- 172.21.15.45:0/1067368900 >> 172.21.15.45:0/1067368900 conn(0x7fd43c0fc2a0 msgr2=0x7fd43c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 -- 172.21.15.45:0/1067368900 shutdown_connections 2024-09-15T22:16:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 -- 172.21.15.45:0/1067368900 wait complete. 2024-09-15T22:16:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 Processor -- start 2024-09-15T22:16:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 -- start start 2024-09-15T22:16:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd43c100b10 0x7fd43c196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd43c101d10 0x7fd43c197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd43c1026d0 0x7fd43c19e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:03.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c10c950 con 0x7fd43c1026d0 2024-09-15T22:16:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c10c7d0 con 0x7fd43c100b10 2024-09-15T22:16:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.124+0000 7fd444756640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd43c10cad0 con 0x7fd43c101d10 2024-09-15T22:16:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd442cf3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd43c1026d0 0x7fd43c19e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd442cf3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd43c1026d0 0x7fd43c19e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35490/0 (socket says 172.21.15.45:35490) 2024-09-15T22:16:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd442cf3640 1 -- 172.21.15.45:0/2162481023 learned_addr learned my addr 172.21.15.45:0/2162481023 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd4424f2640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd43c100b10 0x7fd43c196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd441cf1640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd43c101d10 0x7fd43c197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd442cf3640 1 -- 172.21.15.45:0/2162481023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd43c101d10 msgr2=0x7fd43c197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd442cf3640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd43c101d10 0x7fd43c197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd442cf3640 1 -- 172.21.15.45:0/2162481023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd43c100b10 msgr2=0x7fd43c196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd442cf3640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd43c100b10 0x7fd43c196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd442cf3640 1 -- 172.21.15.45:0/2162481023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c19eb50 con 0x7fd43c1026d0 2024-09-15T22:16:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd442cf3640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd43c1026d0 0x7fd43c19e4e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd434009dc0 tx=0x7fd43402f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd4337fe640 1 -- 172.21.15.45:0/2162481023 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43402fe40 con 0x7fd43c1026d0 2024-09-15T22:16:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd444756640 1 -- 172.21.15.45:0/2162481023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd43c19ede0 con 0x7fd43c1026d0 2024-09-15T22:16:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd4337fe640 1 -- 172.21.15.45:0/2162481023 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd434031df0 con 0x7fd43c1026d0 2024-09-15T22:16:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd4337fe640 1 -- 172.21.15.45:0/2162481023 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434046ac0 con 0x7fd43c1026d0 2024-09-15T22:16:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.125+0000 7fd444756640 1 -- 172.21.15.45:0/2162481023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd43c19f310 con 0x7fd43c1026d0 2024-09-15T22:16:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.127+0000 7fd444756640 1 -- 172.21.15.45:0/2162481023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd43c107e90 con 0x7fd43c1026d0 2024-09-15T22:16:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.128+0000 7fd4337fe640 1 -- 172.21.15.45:0/2162481023 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd4340305c0 con 0x7fd43c1026d0 2024-09-15T22:16:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.128+0000 7fd4337fe640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd4280a3300 0x7fd4280a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.128+0000 7fd4337fe640 1 -- 172.21.15.45:0/2162481023 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fd4340f15e0 con 0x7fd43c1026d0 2024-09-15T22:16:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.128+0000 7fd4424f2640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd4280a3300 0x7fd4280a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:03.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.129+0000 7fd4424f2640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd4280a3300 0x7fd4280a57c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd43c101b70 tx=0x7fd438009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:03.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.132+0000 7fd4337fe640 1 -- 172.21.15.45:0/2162481023 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4340bdf50 con 0x7fd43c1026d0 2024-09-15T22:16:03.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:03 smithi045 ceph-mon[31180]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:16:03.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.313+0000 7fd444756640 1 -- 172.21.15.45:0/2162481023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fd43c02d7c0 con 0x7fd43c1026d0 2024-09-15T22:16:03.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.314+0000 7fd4337fe640 1 -- 172.21.15.45:0/2162481023 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v89) ==== 56+0+5592 (secure 0 0 0) 0x7fd4340bd850 con 0x7fd43c1026d0 2024-09-15T22:16:03.316 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 89 2024-09-15T22:16:03.316 INFO:teuthology.orchestra.run.smithi045.stdout:fsid a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:16:03.316 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-09-15T22:06:19.492307+0000 2024-09-15T22:16:03.316 INFO:teuthology.orchestra.run.smithi045.stdout:modified 2024-09-15T22:15:17.105738+0000 2024-09-15T22:16:03.316 INFO:teuthology.orchestra.run.smithi045.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-15T22:16:03.316 INFO:teuthology.orchestra.run.smithi045.stdout:crush_version 27 2024-09-15T22:16:03.316 INFO:teuthology.orchestra.run.smithi045.stdout:full_ratio 0.95 2024-09-15T22:16:03.317 INFO:teuthology.orchestra.run.smithi045.stdout:backfillfull_ratio 0.9 2024-09-15T22:16:03.317 INFO:teuthology.orchestra.run.smithi045.stdout:nearfull_ratio 0.85 2024-09-15T22:16:03.317 INFO:teuthology.orchestra.run.smithi045.stdout:require_min_compat_client luminous 2024-09-15T22:16:03.317 INFO:teuthology.orchestra.run.smithi045.stdout:min_compat_client luminous 2024-09-15T22:16:03.317 INFO:teuthology.orchestra.run.smithi045.stdout:require_osd_release squid 2024-09-15T22:16:03.317 INFO:teuthology.orchestra.run.smithi045.stdout:stretch_mode_enabled false 2024-09-15T22:16:03.317 INFO:teuthology.orchestra.run.smithi045.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-15T22:16:03.317 INFO:teuthology.orchestra.run.smithi045.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-15T22:16:03.317 INFO:teuthology.orchestra.run.smithi045.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-15T22:16:03.317 INFO:teuthology.orchestra.run.smithi045.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 87 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-15T22:16:03.317 INFO:teuthology.orchestra.run.smithi045.stdout:max_osd 12 2024-09-15T22:16:03.317 INFO:teuthology.orchestra.run.smithi045.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6802/3943337873,v1:172.21.15.45:6803/3943337873] [v2:172.21.15.45:6804/3943337873,v1:172.21.15.45:6805/3943337873] exists,up b217c815-c5e4-4bee-aa74-03c8aab8be70 2024-09-15T22:16:03.317 INFO:teuthology.orchestra.run.smithi045.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6800/1091448440,v1:172.21.15.100:6801/1091448440] [v2:172.21.15.100:6802/1091448440,v1:172.21.15.100:6803/1091448440] exists,up 611af0ab-00b8-49e8-96ed-41fcbed176ff 2024-09-15T22:16:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:osd.2 up in weight 1 up_from 18 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.165:6800/2589835014,v1:172.21.15.165:6801/2589835014] [v2:172.21.15.165:6802/2589835014,v1:172.21.15.165:6803/2589835014] exists,up bdf40a1b-1f33-4f51-bbed-bf9041598d50 2024-09-15T22:16:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:osd.3 up in weight 1 up_from 24 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6810/3139088268,v1:172.21.15.45:6811/3139088268] [v2:172.21.15.45:6812/3139088268,v1:172.21.15.45:6813/3139088268] exists,up 20a0d21e-2952-4e0b-b875-68e206fae18c 2024-09-15T22:16:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:osd.4 up in weight 1 up_from 31 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6808/3961938991,v1:172.21.15.100:6809/3961938991] [v2:172.21.15.100:6810/3961938991,v1:172.21.15.100:6811/3961938991] exists,up d6685935-6ac3-4dc3-acf3-f82480001576 2024-09-15T22:16:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:osd.5 up in weight 1 up_from 36 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.165:6808/4262083044,v1:172.21.15.165:6809/4262083044] [v2:172.21.15.165:6810/4262083044,v1:172.21.15.165:6811/4262083044] exists,up 6a2ef15e-6522-4412-903b-0ce607d86649 2024-09-15T22:16:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:osd.6 up in weight 1 up_from 43 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6818/480791026,v1:172.21.15.45:6819/480791026] [v2:172.21.15.45:6820/480791026,v1:172.21.15.45:6821/480791026] exists,up 4df95994-2453-4634-8409-c5c47d0992db 2024-09-15T22:16:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:osd.7 up in weight 1 up_from 48 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6816/9412304,v1:172.21.15.100:6817/9412304] [v2:172.21.15.100:6818/9412304,v1:172.21.15.100:6819/9412304] exists,up 72e67807-f145-4211-a378-764b37983824 2024-09-15T22:16:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:osd.8 up in weight 1 up_from 56 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.165:6816/134921821,v1:172.21.15.165:6817/134921821] [v2:172.21.15.165:6818/134921821,v1:172.21.15.165:6819/134921821] exists,up 4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5 2024-09-15T22:16:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:osd.9 up in weight 1 up_from 63 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.45:6826/777631686,v1:172.21.15.45:6827/777631686] [v2:172.21.15.45:6828/777631686,v1:172.21.15.45:6829/777631686] exists,up 2a072cad-a025-4de9-ae41-97459f416a66 2024-09-15T22:16:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:osd.10 up in weight 1 up_from 68 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6824/1659453547,v1:172.21.15.100:6825/1659453547] [v2:172.21.15.100:6826/1659453547,v1:172.21.15.100:6827/1659453547] exists,up 072c0003-c933-47ff-9866-53934143f598 2024-09-15T22:16:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:osd.11 up in weight 1 up_from 75 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.165:6824/1936678054,v1:172.21.15.165:6825/1936678054] [v2:172.21.15.165:6826/1936678054,v1:172.21.15.165:6827/1936678054] exists,up 5ad7e570-4045-4f50-aa81-4bf73af76c1d 2024-09-15T22:16:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 3.2 [3,9] 2024-09-15T22:16:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 3.e [4,8] 2024-09-15T22:16:03.318 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 3.1b [4,6] 2024-09-15T22:16:03.319 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 3.25 [5,9] 2024-09-15T22:16:03.319 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 3.27 [4,7] 2024-09-15T22:16:03.319 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 3.38 [3,9] 2024-09-15T22:16:03.319 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 4.11 [5,8] 2024-09-15T22:16:03.319 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 4.13 [9,10] 2024-09-15T22:16:03.319 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 4.19 [9,8] 2024-09-15T22:16:03.319 INFO:teuthology.orchestra.run.smithi045.stdout:pg_upmap_items 4.1c [9,8] 2024-09-15T22:16:03.319 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:6801/3319321559 expires 2024-09-16T22:07:15.327784+0000 2024-09-15T22:16:03.319 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:6800/3319321559 expires 2024-09-16T22:07:15.327784+0000 2024-09-15T22:16:03.319 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:0/3960156552 expires 2024-09-16T22:07:15.327784+0000 2024-09-15T22:16:03.319 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:6800/2191835021 expires 2024-09-16T22:06:51.521483+0000 2024-09-15T22:16:03.319 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:0/3598420664 expires 2024-09-16T22:07:15.327784+0000 2024-09-15T22:16:03.319 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:0/3822069605 expires 2024-09-16T22:07:15.327784+0000 2024-09-15T22:16:03.320 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:0/2207608114 expires 2024-09-16T22:06:51.521483+0000 2024-09-15T22:16:03.320 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:0/1499253284 expires 2024-09-16T22:06:51.521483+0000 2024-09-15T22:16:03.320 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:6801/2191835021 expires 2024-09-16T22:06:51.521483+0000 2024-09-15T22:16:03.320 INFO:teuthology.orchestra.run.smithi045.stdout:blocklist 172.21.15.45:0/3237288220 expires 2024-09-16T22:06:51.521483+0000 2024-09-15T22:16:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.316+0000 7fd444756640 1 -- 172.21.15.45:0/2162481023 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd4280a3300 msgr2=0x7fd4280a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.316+0000 7fd444756640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd4280a3300 0x7fd4280a57c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd43c101b70 tx=0x7fd438009110 comp rx=0 tx=0).stop 2024-09-15T22:16:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.316+0000 7fd444756640 1 -- 172.21.15.45:0/2162481023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd43c1026d0 msgr2=0x7fd43c19e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.316+0000 7fd444756640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd43c1026d0 0x7fd43c19e4e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd434009dc0 tx=0x7fd43402f840 comp rx=0 tx=0).stop 2024-09-15T22:16:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.316+0000 7fd444756640 1 -- 172.21.15.45:0/2162481023 shutdown_connections 2024-09-15T22:16:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.316+0000 7fd444756640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fd4280a3300 0x7fd4280a57c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.316+0000 7fd444756640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd43c1026d0 0x7fd43c19e4e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.316+0000 7fd444756640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd43c101d10 0x7fd43c197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.316+0000 7fd444756640 1 --2- 172.21.15.45:0/2162481023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd43c100b10 0x7fd43c196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.316+0000 7fd444756640 1 -- 172.21.15.45:0/2162481023 >> 172.21.15.45:0/2162481023 conn(0x7fd43c0fc2a0 msgr2=0x7fd43c105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.316+0000 7fd444756640 1 -- 172.21.15.45:0/2162481023 shutdown_connections 2024-09-15T22:16:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:03.316+0000 7fd444756640 1 -- 172.21.15.45:0/2162481023 wait complete. 2024-09-15T22:16:03.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:03 smithi165 ceph-mon[35551]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:16:03.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:03 smithi100 ceph-mon[35319]: pgmap v342: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:16:04.166 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-15T22:16:04.177 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:16:04.443 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:04.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:04 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2162481023' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:16:04.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:04 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2162481023' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:16:04.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:04 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2162481023' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T22:16:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.914+0000 7fdec7b47640 1 -- 172.21.15.45:0/2639479657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec0074eb0 msgr2=0x7fdec0112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.914+0000 7fdec7b47640 1 --2- 172.21.15.45:0/2639479657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec0074eb0 0x7fdec0112650 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4009900 tx=0x7fdeb402a480 comp rx=0 tx=0).stop 2024-09-15T22:16:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.914+0000 7fdec7b47640 1 -- 172.21.15.45:0/2639479657 shutdown_connections 2024-09-15T22:16:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.914+0000 7fdec7b47640 1 --2- 172.21.15.45:0/2639479657 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdec0112b90 0x7fdec0114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.914+0000 7fdec7b47640 1 --2- 172.21.15.45:0/2639479657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec0074eb0 0x7fdec0112650 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:04.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.914+0000 7fdec7b47640 1 --2- 172.21.15.45:0/2639479657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdec0074590 0x7fdec0074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.914+0000 7fdec7b47640 1 -- 172.21.15.45:0/2639479657 >> 172.21.15.45:0/2639479657 conn(0x7fdec00fd8c0 msgr2=0x7fdec00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.914+0000 7fdec7b47640 1 -- 172.21.15.45:0/2639479657 shutdown_connections 2024-09-15T22:16:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.914+0000 7fdec7b47640 1 -- 172.21.15.45:0/2639479657 wait complete. 2024-09-15T22:16:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec7b47640 1 Processor -- start 2024-09-15T22:16:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec7b47640 1 -- start start 2024-09-15T22:16:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec7b47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec0074590 0x7fdec01a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec7b47640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdec0074eb0 0x7fdec01a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec7b47640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdec0112b90 0x7fdec019e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec7b47640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdec0118700 con 0x7fdec0074590 2024-09-15T22:16:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec7b47640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdec0118580 con 0x7fdec0112b90 2024-09-15T22:16:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec7b47640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdec0118880 con 0x7fdec0074eb0 2024-09-15T22:16:04.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec58e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec0074590 0x7fdec01a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec58e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec0074590 0x7fdec01a4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33166/0 (socket says 172.21.15.45:33166) 2024-09-15T22:16:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec58e3640 1 -- 172.21.15.45:0/1003322126 learned_addr learned my addr 172.21.15.45:0/1003322126 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec50e2640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdec0074eb0 0x7fdec01a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec60e4640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdec0112b90 0x7fdec019e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec58e3640 1 -- 172.21.15.45:0/1003322126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdec0074eb0 msgr2=0x7fdec01a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec58e3640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdec0074eb0 0x7fdec01a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec58e3640 1 -- 172.21.15.45:0/1003322126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdec0112b90 msgr2=0x7fdec019e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec58e3640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdec0112b90 0x7fdec019e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.915+0000 7fdec58e3640 1 -- 172.21.15.45:0/1003322126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec019f080 con 0x7fdec0074590 2024-09-15T22:16:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.916+0000 7fdec58e3640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec0074590 0x7fdec01a4790 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000cce0 tx=0x7fdeb000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:04.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.916+0000 7fdebeffd640 1 -- 172.21.15.45:0/1003322126 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb000f650 con 0x7fdec0074590 2024-09-15T22:16:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.916+0000 7fdebeffd640 1 -- 172.21.15.45:0/1003322126 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdeb000fcf0 con 0x7fdec0074590 2024-09-15T22:16:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.916+0000 7fdec7b47640 1 -- 172.21.15.45:0/1003322126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec019f370 con 0x7fdec0074590 2024-09-15T22:16:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.916+0000 7fdebeffd640 1 -- 172.21.15.45:0/1003322126 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0018d20 con 0x7fdec0074590 2024-09-15T22:16:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.916+0000 7fdec7b47640 1 -- 172.21.15.45:0/1003322126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec01ab660 con 0x7fdec0074590 2024-09-15T22:16:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.917+0000 7fdec7b47640 1 -- 172.21.15.45:0/1003322126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec0074970 con 0x7fdec0074590 2024-09-15T22:16:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.918+0000 7fdebeffd640 1 -- 172.21.15.45:0/1003322126 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdeb000f7f0 con 0x7fdec0074590 2024-09-15T22:16:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.919+0000 7fdebeffd640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdea80a32d0 0x7fdea80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.919+0000 7fdec50e2640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdea80a32d0 0x7fdea80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.919+0000 7fdebeffd640 1 -- 172.21.15.45:0/1003322126 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fdeb00d0360 con 0x7fdec0074590 2024-09-15T22:16:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.919+0000 7fdec50e2640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdea80a32d0 0x7fdea80a5790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4000c00 tx=0x7fdeb4005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:04.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:04.923+0000 7fdebeffd640 1 -- 172.21.15.45:0/1003322126 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdeb0014030 con 0x7fdec0074590 2024-09-15T22:16:05.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.135+0000 7fdec7b47640 1 -- 172.21.15.45:0/1003322126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdec019fe80 con 0x7fdec0074590 2024-09-15T22:16:05.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.136+0000 7fdebeffd640 1 -- 172.21.15.45:0/1003322126 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fdec019fe80 con 0x7fdec0074590 2024-09-15T22:16:05.138 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:05.138 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:16:05.138 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.138+0000 7fdec7b47640 1 -- 172.21.15.45:0/1003322126 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdea80a32d0 msgr2=0x7fdea80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.138+0000 7fdec7b47640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdea80a32d0 0x7fdea80a5790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4000c00 tx=0x7fdeb4005e80 comp rx=0 tx=0).stop 2024-09-15T22:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.138+0000 7fdec7b47640 1 -- 172.21.15.45:0/1003322126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec0074590 msgr2=0x7fdec01a4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.138+0000 7fdec7b47640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec0074590 0x7fdec01a4790 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000cce0 tx=0x7fdeb000a620 comp rx=0 tx=0).stop 2024-09-15T22:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.138+0000 7fdec7b47640 1 -- 172.21.15.45:0/1003322126 shutdown_connections 2024-09-15T22:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.138+0000 7fdec7b47640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fdea80a32d0 0x7fdea80a5790 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.138+0000 7fdec7b47640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdec0112b90 0x7fdec019e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.138+0000 7fdec7b47640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdec0074eb0 0x7fdec01a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.138+0000 7fdec7b47640 1 --2- 172.21.15.45:0/1003322126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdec0074590 0x7fdec01a4790 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:05.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.138+0000 7fdec7b47640 1 -- 172.21.15.45:0/1003322126 >> 172.21.15.45:0/1003322126 conn(0x7fdec00fd8c0 msgr2=0x7fdec00feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:05.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.138+0000 7fdec7b47640 1 -- 172.21.15.45:0/1003322126 shutdown_connections 2024-09-15T22:16:05.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:05.138+0000 7fdec7b47640 1 -- 172.21.15.45:0/1003322126 wait complete. 2024-09-15T22:16:05.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:05 smithi045 ceph-mon[31180]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:16:05.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:05 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1003322126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:05.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:05 smithi165 ceph-mon[35551]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:16:05.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:05 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1003322126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:05.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:05 smithi100 ceph-mon[35319]: pgmap v343: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:16:05.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:05 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1003322126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:05.946 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:16:06.204 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:06.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.717+0000 7f5dad94f640 1 -- 172.21.15.45:0/3634155528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da8102780 msgr2=0x7f5da81067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:06.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.717+0000 7f5dad94f640 1 --2- 172.21.15.45:0/3634155528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da8102780 0x7f5da81067d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009900 tx=0x7f5d9c02a410 comp rx=0 tx=0).stop 2024-09-15T22:16:06.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.718+0000 7f5dad94f640 1 -- 172.21.15.45:0/3634155528 shutdown_connections 2024-09-15T22:16:06.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.718+0000 7f5dad94f640 1 --2- 172.21.15.45:0/3634155528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5da8106f00 0x7f5da810ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.718+0000 7f5dad94f640 1 --2- 172.21.15.45:0/3634155528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da8102780 0x7f5da81067d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.718+0000 7f5dad94f640 1 --2- 172.21.15.45:0/3634155528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5da8101dd0 0x7f5da81021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.718+0000 7f5dad94f640 1 -- 172.21.15.45:0/3634155528 >> 172.21.15.45:0/3634155528 conn(0x7f5da80fd8b0 msgr2=0x7f5da80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:06.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.718+0000 7f5dad94f640 1 -- 172.21.15.45:0/3634155528 shutdown_connections 2024-09-15T22:16:06.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.718+0000 7f5dad94f640 1 -- 172.21.15.45:0/3634155528 wait complete. 2024-09-15T22:16:06.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.718+0000 7f5dad94f640 1 Processor -- start 2024-09-15T22:16:06.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5dad94f640 1 -- start start 2024-09-15T22:16:06.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5dad94f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5da8101dd0 0x7f5da8198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:06.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5dad94f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5da8102780 0x7f5da8198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:06.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5dad94f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da8106f00 0x7f5da819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:06.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5dad94f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5da8112040 con 0x7f5da8106f00 2024-09-15T22:16:06.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5dad94f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5da8111ec0 con 0x7f5da8101dd0 2024-09-15T22:16:06.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5dad94f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5da81121c0 con 0x7f5da8102780 2024-09-15T22:16:06.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5da77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da8106f00 0x7f5da819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:06.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5da77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da8106f00 0x7f5da819cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33172/0 (socket says 172.21.15.45:33172) 2024-09-15T22:16:06.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5da77fe640 1 -- 172.21.15.45:0/804200695 learned_addr learned my addr 172.21.15.45:0/804200695 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:06.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5da67fc640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5da8102780 0x7f5da8198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:06.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5da6ffd640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5da8101dd0 0x7f5da8198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:06.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5da77fe640 1 -- 172.21.15.45:0/804200695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5da8102780 msgr2=0x7f5da8198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:06.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5da77fe640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5da8102780 0x7f5da8198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5da77fe640 1 -- 172.21.15.45:0/804200695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5da8101dd0 msgr2=0x7f5da8198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:06.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5da77fe640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5da8101dd0 0x7f5da8198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.719+0000 7f5da77fe640 1 -- 172.21.15.45:0/804200695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da819d5f0 con 0x7f5da8106f00 2024-09-15T22:16:06.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.720+0000 7f5da77fe640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da8106f00 0x7f5da819cf10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5da000eb10 tx=0x7f5da000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:06.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.720+0000 7f5dac94d640 1 -- 172.21.15.45:0/804200695 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0004b20 con 0x7f5da8106f00 2024-09-15T22:16:06.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.720+0000 7f5dac94d640 1 -- 172.21.15.45:0/804200695 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5da0004cc0 con 0x7f5da8106f00 2024-09-15T22:16:06.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.720+0000 7f5dad94f640 1 -- 172.21.15.45:0/804200695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da819d8e0 con 0x7f5da8106f00 2024-09-15T22:16:06.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.720+0000 7f5dac94d640 1 -- 172.21.15.45:0/804200695 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da00107f0 con 0x7f5da8106f00 2024-09-15T22:16:06.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.720+0000 7f5dad94f640 1 -- 172.21.15.45:0/804200695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da81a51c0 con 0x7f5da8106f00 2024-09-15T22:16:06.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.721+0000 7f5dad94f640 1 -- 172.21.15.45:0/804200695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da81032b0 con 0x7f5da8106f00 2024-09-15T22:16:06.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.722+0000 7f5dac94d640 1 -- 172.21.15.45:0/804200695 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5da0005020 con 0x7f5da8106f00 2024-09-15T22:16:06.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.723+0000 7f5dac94d640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f5d900a3350 0x7f5d900a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:06.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.723+0000 7f5da6ffd640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f5d900a3350 0x7f5d900a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:06.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.723+0000 7f5dac94d640 1 -- 172.21.15.45:0/804200695 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f5da00d02b0 con 0x7f5da8106f00 2024-09-15T22:16:06.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.724+0000 7f5da6ffd640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f5d900a3350 0x7f5d900a5810 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009bd0 tx=0x7f5d98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:06.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.728+0000 7f5dac94d640 1 -- 172.21.15.45:0/804200695 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5da009cb10 con 0x7f5da8106f00 2024-09-15T22:16:06.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.954+0000 7f5dad94f640 1 -- 172.21.15.45:0/804200695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5da810a140 con 0x7f5da8106f00 2024-09-15T22:16:06.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.954+0000 7f5dac94d640 1 -- 172.21.15.45:0/804200695 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f5da009c410 con 0x7f5da8106f00 2024-09-15T22:16:06.957 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:06.958 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:16:06.958 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:16:06.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.957+0000 7f5dad94f640 1 -- 172.21.15.45:0/804200695 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f5d900a3350 msgr2=0x7f5d900a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:06.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.957+0000 7f5dad94f640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f5d900a3350 0x7f5d900a5810 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009bd0 tx=0x7f5d98005f90 comp rx=0 tx=0).stop 2024-09-15T22:16:06.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.957+0000 7f5dad94f640 1 -- 172.21.15.45:0/804200695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da8106f00 msgr2=0x7f5da819cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:06.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.957+0000 7f5dad94f640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da8106f00 0x7f5da819cf10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5da000eb10 tx=0x7f5da000c2d0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.957+0000 7f5dad94f640 1 -- 172.21.15.45:0/804200695 shutdown_connections 2024-09-15T22:16:06.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.957+0000 7f5dad94f640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f5d900a3350 0x7f5d900a5810 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.957+0000 7f5dad94f640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5da8106f00 0x7f5da819cf10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.957+0000 7f5dad94f640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5da8102780 0x7f5da8198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.957+0000 7f5dad94f640 1 --2- 172.21.15.45:0/804200695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5da8101dd0 0x7f5da8198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:06.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.957+0000 7f5dad94f640 1 -- 172.21.15.45:0/804200695 >> 172.21.15.45:0/804200695 conn(0x7f5da80fd8b0 msgr2=0x7f5da80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:06.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.957+0000 7f5dad94f640 1 -- 172.21.15.45:0/804200695 shutdown_connections 2024-09-15T22:16:06.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:06.957+0000 7f5dad94f640 1 -- 172.21.15.45:0/804200695 wait complete. 2024-09-15T22:16:07.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:07 smithi165 ceph-mon[35551]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:16:07.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:07 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:07.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:07 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/804200695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:07 smithi100 ceph-mon[35319]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:16:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:07 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:07 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/804200695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:07 smithi045 ceph-mon[31180]: pgmap v344: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:16:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:07 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:07 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/804200695' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:08.404 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:16:08.699 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:09.096 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:08 smithi045 ceph-mon[31180]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:16:09.096 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:09.096 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:09.096 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:09.096 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:08 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:09.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.175+0000 7f4e28c70640 1 -- 172.21.15.45:0/2698833124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e24102790 msgr2=0x7f4e241067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:09.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.175+0000 7f4e28c70640 1 --2- 172.21.15.45:0/2698833124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e24102790 0x7f4e241067e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4e18009900 tx=0x7f4e1802a410 comp rx=0 tx=0).stop 2024-09-15T22:16:09.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.176+0000 7f4e28c70640 1 -- 172.21.15.45:0/2698833124 shutdown_connections 2024-09-15T22:16:09.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.176+0000 7f4e28c70640 1 --2- 172.21.15.45:0/2698833124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e24106f10 0x7f4e2410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.176+0000 7f4e28c70640 1 --2- 172.21.15.45:0/2698833124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e24102790 0x7f4e241067e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.176+0000 7f4e28c70640 1 --2- 172.21.15.45:0/2698833124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e24101de0 0x7f4e241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.176+0000 7f4e28c70640 1 -- 172.21.15.45:0/2698833124 >> 172.21.15.45:0/2698833124 conn(0x7f4e240fd8c0 msgr2=0x7f4e240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.176+0000 7f4e28c70640 1 -- 172.21.15.45:0/2698833124 shutdown_connections 2024-09-15T22:16:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.176+0000 7f4e28c70640 1 -- 172.21.15.45:0/2698833124 wait complete. 2024-09-15T22:16:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.176+0000 7f4e28c70640 1 Processor -- start 2024-09-15T22:16:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.176+0000 7f4e28c70640 1 -- start start 2024-09-15T22:16:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e28c70640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e24101de0 0x7f4e240744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e28c70640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e24102790 0x7f4e24074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e28c70640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e24106f10 0x7f4e24074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e28c70640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4e241120e0 con 0x7f4e24101de0 2024-09-15T22:16:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e28c70640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4e24111f60 con 0x7f4e24102790 2024-09-15T22:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e28c70640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4e24112260 con 0x7f4e24106f10 2024-09-15T22:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e2259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e24101de0 0x7f4e240744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e2259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e24101de0 0x7f4e240744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33194/0 (socket says 172.21.15.45:33194) 2024-09-15T22:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e2259c640 1 -- 172.21.15.45:0/1978714645 learned_addr learned my addr 172.21.15.45:0/1978714645 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e21d9b640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e24102790 0x7f4e24074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e22d9d640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e24106f10 0x7f4e24074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e2259c640 1 -- 172.21.15.45:0/1978714645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e24106f10 msgr2=0x7f4e24074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e2259c640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e24106f10 0x7f4e24074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e2259c640 1 -- 172.21.15.45:0/1978714645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e24102790 msgr2=0x7f4e24074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e2259c640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e24102790 0x7f4e24074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e2259c640 1 -- 172.21.15.45:0/1978714645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e241a69a0 con 0x7f4e24101de0 2024-09-15T22:16:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e2259c640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e24101de0 0x7f4e240744f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400d770 tx=0x7f4e1400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.177+0000 7f4e137fe640 1 -- 172.21.15.45:0/1978714645 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e14017070 con 0x7f4e24101de0 2024-09-15T22:16:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.178+0000 7f4e28c70640 1 -- 172.21.15.45:0/1978714645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e241a6c90 con 0x7f4e24101de0 2024-09-15T22:16:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.178+0000 7f4e137fe640 1 -- 172.21.15.45:0/1978714645 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4e14005520 con 0x7f4e24101de0 2024-09-15T22:16:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.178+0000 7f4e137fe640 1 -- 172.21.15.45:0/1978714645 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e14010460 con 0x7f4e24101de0 2024-09-15T22:16:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.178+0000 7f4e28c70640 1 -- 172.21.15.45:0/1978714645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e241a71a0 con 0x7f4e24101de0 2024-09-15T22:16:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.178+0000 7f4e28c70640 1 -- 172.21.15.45:0/1978714645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e241032c0 con 0x7f4e24101de0 2024-09-15T22:16:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.180+0000 7f4e137fe640 1 -- 172.21.15.45:0/1978714645 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4e14004ea0 con 0x7f4e24101de0 2024-09-15T22:16:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.180+0000 7f4e137fe640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4e0c0a32d0 0x7f4e0c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.180+0000 7f4e21d9b640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4e0c0a32d0 0x7f4e0c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.180+0000 7f4e137fe640 1 -- 172.21.15.45:0/1978714645 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f4e140cf900 con 0x7f4e24101de0 2024-09-15T22:16:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.181+0000 7f4e21d9b640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4e0c0a32d0 0x7f4e0c0a5790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4e18000c00 tx=0x7f4e18005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.185+0000 7f4e137fe640 1 -- 172.21.15.45:0/1978714645 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4e1409c160 con 0x7f4e24101de0 2024-09-15T22:16:09.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:08 smithi165 ceph-mon[35551]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:16:09.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:09.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:09.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:09.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:08 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:09.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:08 smithi100 ceph-mon[35319]: pgmap v345: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:16:09.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:09.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:09.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:09.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:08 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:09.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.366+0000 7f4e28c70640 1 -- 172.21.15.45:0/1978714645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e2410a0f0 con 0x7f4e24101de0 2024-09-15T22:16:09.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.369+0000 7f4e137fe640 1 -- 172.21.15.45:0/1978714645 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24661 (secure 0 0 0) 0x7f4e1409ba60 con 0x7f4e24101de0 2024-09-15T22:16:09.371 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:09.372 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":89,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:15:17.105738+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":7}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:16:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.371+0000 7f4e28c70640 1 -- 172.21.15.45:0/1978714645 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4e0c0a32d0 msgr2=0x7f4e0c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.371+0000 7f4e28c70640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4e0c0a32d0 0x7f4e0c0a5790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4e18000c00 tx=0x7f4e18005e80 comp rx=0 tx=0).stop 2024-09-15T22:16:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.371+0000 7f4e28c70640 1 -- 172.21.15.45:0/1978714645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e24101de0 msgr2=0x7f4e240744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.371+0000 7f4e28c70640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e24101de0 0x7f4e240744f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400d770 tx=0x7f4e1400dc30 comp rx=0 tx=0).stop 2024-09-15T22:16:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.371+0000 7f4e28c70640 1 -- 172.21.15.45:0/1978714645 shutdown_connections 2024-09-15T22:16:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.371+0000 7f4e28c70640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f4e0c0a32d0 0x7f4e0c0a5790 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.371+0000 7f4e28c70640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4e24106f10 0x7f4e24074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.371+0000 7f4e28c70640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e24102790 0x7f4e24074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.371+0000 7f4e28c70640 1 --2- 172.21.15.45:0/1978714645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e24101de0 0x7f4e240744f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.371+0000 7f4e28c70640 1 -- 172.21.15.45:0/1978714645 >> 172.21.15.45:0/1978714645 conn(0x7f4e240fd8c0 msgr2=0x7f4e240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.372+0000 7f4e28c70640 1 -- 172.21.15.45:0/1978714645 shutdown_connections 2024-09-15T22:16:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:09.372+0000 7f4e28c70640 1 -- 172.21.15.45:0/1978714645 wait complete. 2024-09-15T22:16:10.105 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T22:14:07.480609+0000', 'modified': '2024-09-15T22:14:45.759794+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.165:6839/2278031843', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6838', 'nonce': 2278031843}, {'type': 'v1', 'addr': '172.21.15.165:6839', 'nonce': 2278031843}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6839/1428203088', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 1428203088}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 1428203088}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24476, 'qdb_cluster': [24476]} 2024-09-15T22:16:10.105 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:16:10.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:16:10.364 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:10.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:10 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:10.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:10 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:10.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:10 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1978714645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:16:10.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:10 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:10.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:10 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:10.487 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:10 smithi045 ceph-mon[31180]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:10.722 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:10 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:10.723 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:10 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:10.723 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:10 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1978714645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:16:10.723 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:10 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:10.723 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:10 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:10.723 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:10 smithi165 ceph-mon[35551]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:10.748 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:10 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:10.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:10 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:10.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:10 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1978714645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:16:10.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:10 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:10.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:10 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:10.749 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:10 smithi100 ceph-mon[35319]: from='mgr.14150 172.21.15.45:0/2577413404' entity='mgr.x' 2024-09-15T22:16:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.878+0000 7f6966839640 1 -- 172.21.15.45:0/3888202070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6960106f10 msgr2=0x7f696010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.878+0000 7f6966839640 1 --2- 172.21.15.45:0/3888202070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6960106f10 0x7f696010ea90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6958009ca0 tx=0x7f695802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.878+0000 7f6966839640 1 -- 172.21.15.45:0/3888202070 shutdown_connections 2024-09-15T22:16:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.878+0000 7f6966839640 1 --2- 172.21.15.45:0/3888202070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6960106f10 0x7f696010ea90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.878+0000 7f6966839640 1 --2- 172.21.15.45:0/3888202070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6960102790 0x7f69601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.878+0000 7f6966839640 1 --2- 172.21.15.45:0/3888202070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6960101de0 0x7f69601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.878+0000 7f6966839640 1 -- 172.21.15.45:0/3888202070 >> 172.21.15.45:0/3888202070 conn(0x7f69600fd8c0 msgr2=0x7f69600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.878+0000 7f6966839640 1 -- 172.21.15.45:0/3888202070 shutdown_connections 2024-09-15T22:16:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.878+0000 7f6966839640 1 -- 172.21.15.45:0/3888202070 wait complete. 2024-09-15T22:16:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.879+0000 7f6966839640 1 Processor -- start 2024-09-15T22:16:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.879+0000 7f6966839640 1 -- start start 2024-09-15T22:16:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.879+0000 7f6966839640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6960101de0 0x7f69601984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.879+0000 7f6966839640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6960102790 0x7f6960198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.879+0000 7f6966839640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6960106f10 0x7f696019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.879+0000 7f6966839640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6960112090 con 0x7f6960101de0 2024-09-15T22:16:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.879+0000 7f6966839640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6960111f10 con 0x7f6960102790 2024-09-15T22:16:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.879+0000 7f6966839640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6960112210 con 0x7f6960106f10 2024-09-15T22:16:10.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6960101de0 0x7f69601984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6960101de0 0x7f69601984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33206/0 (socket says 172.21.15.45:33206) 2024-09-15T22:16:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695ffff640 1 -- 172.21.15.45:0/2852101391 learned_addr learned my addr 172.21.15.45:0/2852101391 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695f7fe640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6960102790 0x7f6960198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f6964dd6640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6960106f10 0x7f696019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695ffff640 1 -- 172.21.15.45:0/2852101391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6960106f10 msgr2=0x7f696019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695ffff640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6960106f10 0x7f696019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695ffff640 1 -- 172.21.15.45:0/2852101391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6960102790 msgr2=0x7f6960198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695ffff640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6960102790 0x7f6960198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695ffff640 1 -- 172.21.15.45:0/2852101391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696019d4a0 con 0x7f6960101de0 2024-09-15T22:16:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695f7fe640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6960102790 0x7f6960198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:10.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695ffff640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6960101de0 0x7f69601984f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f695000e9f0 tx=0x7f695000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695d7fa640 1 -- 172.21.15.45:0/2852101391 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695000cd80 con 0x7f6960101de0 2024-09-15T22:16:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695d7fa640 1 -- 172.21.15.45:0/2852101391 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6950005520 con 0x7f6960101de0 2024-09-15T22:16:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f6966839640 1 -- 172.21.15.45:0/2852101391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696019d790 con 0x7f6960101de0 2024-09-15T22:16:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f695d7fa640 1 -- 172.21.15.45:0/2852101391 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6950010690 con 0x7f6960101de0 2024-09-15T22:16:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.880+0000 7f6966839640 1 -- 172.21.15.45:0/2852101391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69601a5070 con 0x7f6960101de0 2024-09-15T22:16:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.883+0000 7f695d7fa640 1 -- 172.21.15.45:0/2852101391 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f69500046c0 con 0x7f6960101de0 2024-09-15T22:16:10.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.883+0000 7f6968c12740 1 Processor -- start 2024-09-15T22:16:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f6968c12740 1 -- start start 2024-09-15T22:16:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f6968c12740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e609d0 0x55aaf9e60db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f6968c12740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e6b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f6968c12740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e6dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f6968c12740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aaf9dc7090 con 0x55aaf9e612f0 2024-09-15T22:16:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f6968c12740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aaf9d6ea70 con 0x55aaf9e609d0 2024-09-15T22:16:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f6968c12740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55aaf9dc3050 con 0x55aaf9e6bbb0 2024-09-15T22:16:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f695ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e6b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f695ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e6b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33214/0 (socket says 172.21.15.45:33214) 2024-09-15T22:16:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f695ffff640 1 -- 172.21.15.45:0/4096814756 learned_addr learned my addr 172.21.15.45:0/4096814756 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f6964dd6640 1 --2- 172.21.15.45:0/4096814756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e609d0 0x55aaf9e60db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f695f7fe640 1 --2- 172.21.15.45:0/4096814756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e6dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f695d7fa640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f69480a3350 0x7f69480a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f6964dd6640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f69480a3350 0x7f69480a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.884+0000 7f695d7fa640 1 -- 172.21.15.45:0/2852101391 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f69500d01b0 con 0x7f6960101de0 2024-09-15T22:16:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.885+0000 7f695ffff640 1 -- 172.21.15.45:0/4096814756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 msgr2=0x55aaf9e6dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.885+0000 7f695ffff640 1 --2- 172.21.15.45:0/4096814756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e6dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.885+0000 7f695ffff640 1 -- 172.21.15.45:0/4096814756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e609d0 msgr2=0x55aaf9e60db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.885+0000 7f695ffff640 1 --2- 172.21.15.45:0/4096814756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e609d0 0x55aaf9e60db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.885+0000 7f695ffff640 1 -- 172.21.15.45:0/4096814756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaf9d7b130 con 0x55aaf9e612f0 2024-09-15T22:16:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.885+0000 7f695ffff640 1 --2- 172.21.15.45:0/4096814756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e6b670 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f69500cd740 tx=0x7f69500d3f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac7eda64c6ab901 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:10.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.885+0000 7f69467fc640 1 -- 172.21.15.45:0/4096814756 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695009c0e0 con 0x55aaf9e612f0 2024-09-15T22:16:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.885+0000 7f695f7fe640 1 --2- 172.21.15.45:0/4096814756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e6dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.885+0000 7f69467fc640 1 -- 172.21.15.45:0/4096814756 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f695009ca10 con 0x55aaf9e612f0 2024-09-15T22:16:10.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.885+0000 7f69467fc640 1 -- 172.21.15.45:0/4096814756 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695009bc70 con 0x55aaf9e612f0 2024-09-15T22:16:10.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.886+0000 7f6968c12740 1 -- 172.21.15.45:0/4096814756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 msgr2=0x55aaf9e6b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:10.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.886+0000 7f6968c12740 1 --2- 172.21.15.45:0/4096814756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e6b670 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f69500cd740 tx=0x7f69500d3f90 comp rx=0 tx=0).stop 2024-09-15T22:16:10.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.886+0000 7f6964dd6640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f69480a3350 0x7f69480a5810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6958006010 tx=0x7f695802a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.886+0000 7f6968c12740 1 -- 172.21.15.45:0/4096814756 shutdown_connections 2024-09-15T22:16:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.886+0000 7f6968c12740 1 --2- 172.21.15.45:0/4096814756 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e6dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.886+0000 7f6968c12740 1 --2- 172.21.15.45:0/4096814756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e6b670 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.886+0000 7f6968c12740 1 --2- 172.21.15.45:0/4096814756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e609d0 0x55aaf9e60db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.886+0000 7f6968c12740 1 -- 172.21.15.45:0/4096814756 >> 172.21.15.45:0/4096814756 conn(0x55aaf9e5cf60 msgr2=0x55aaf9e5d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.886+0000 7f6968c12740 1 -- 172.21.15.45:0/4096814756 shutdown_connections 2024-09-15T22:16:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.886+0000 7f6968c12740 1 -- 172.21.15.45:0/4096814756 wait complete. 2024-09-15T22:16:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.886+0000 7f6968c12740 1 -- start start 2024-09-15T22:16:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.886+0000 7f6968c12740 1 Processor -- start 2024-09-15T22:16:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f6968c12740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e609d0 0x55aaf9e6b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f6968c12740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e612f0 0x55aaf9e68840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f6968c12740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e68d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f6968c12740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aaf9e6e720 con 0x55aaf9e609d0 2024-09-15T22:16:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f6968c12740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aaf9d81f20 con 0x55aaf9e612f0 2024-09-15T22:16:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f6968c12740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55aaf9e6e8a0 con 0x55aaf9e6bbb0 2024-09-15T22:16:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f6968c12740 10 client.0 _ll_register_callbacks cb 0x55aaf9d4b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f695ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e609d0 0x55aaf9e6b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f695ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e609d0 0x55aaf9e6b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33230/0 (socket says 172.21.15.45:33230) 2024-09-15T22:16:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f695ffff640 1 -- 172.21.15.45:0/1614953996 learned_addr learned my addr 172.21.15.45:0/1614953996 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f695f7fe640 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e612f0 0x55aaf9e68840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f695ffff640 1 -- 172.21.15.45:0/1614953996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 msgr2=0x55aaf9e68d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f6964dd6640 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e68d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f695ffff640 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e68d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f695ffff640 1 -- 172.21.15.45:0/1614953996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e612f0 msgr2=0x55aaf9e68840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f695ffff640 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e612f0 0x55aaf9e68840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f695ffff640 1 -- 172.21.15.45:0/1614953996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaf9b382b0 con 0x55aaf9e609d0 2024-09-15T22:16:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f6964dd6640 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e68d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f695ffff640 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e609d0 0x55aaf9e6b4f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f695009c2a0 tx=0x7f69500d3b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae706443efce87c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.887+0000 7f693f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f693f7fe640 1 -- 172.21.15.45:0/1614953996 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695009be50 con 0x55aaf9e609d0 2024-09-15T22:16:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f693f7fe640 1 -- 172.21.15.45:0/1614953996 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f69500bc0f0 con 0x55aaf9e609d0 2024-09-15T22:16:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f6968c12740 1 -- 172.21.15.45:0/1614953996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f695009ca10 con 0x55aaf9e609d0 2024-09-15T22:16:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f693f7fe640 1 -- 172.21.15.45:0/1614953996 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f695009bc70 con 0x55aaf9e609d0 2024-09-15T22:16:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f6968c12740 10 client.15135 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f6968c12740 1 -- 172.21.15.45:0/1614953996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55aaf9e6e720 con 0x55aaf9e609d0 2024-09-15T22:16:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f693f7fe640 1 -- 172.21.15.45:0/1614953996 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f695009ca10 con 0x55aaf9e609d0 2024-09-15T22:16:10.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f693f7fe640 1 -- 172.21.15.45:0/1614953996 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f695009b760 con 0x55aaf9e609d0 2024-09-15T22:16:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f6968c12740 10 client.15135 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f6968c12740 10 client.15135 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:16:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f6968c12740 20 client.15135 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f6968c12740 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aaf9e80620 0x55aaf9e81a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f6968c12740 4 client.15135 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.888+0000 7f6968c12740 1 -- 172.21.15.45:0/1614953996 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aaf9dd4600 con 0x55aaf9e80620 2024-09-15T22:16:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.889+0000 7f695f7fe640 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aaf9e80620 0x55aaf9e81a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.889+0000 7f695f7fe640 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aaf9e80620 0x55aaf9e81a90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af82eed8bc14954d server_cookie=ec67917dd5674d0d in_seq=0 out_seq=0 2024-09-15T22:16:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.889+0000 7f693f7fe640 10 client.15135 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f693f7fe640 1 -- 172.21.15.45:0/1614953996 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aaf9dd4600 con 0x55aaf9e80620 2024-09-15T22:16:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f693f7fe640 10 client.15135 handle_command_reply: tid=0 2024-09-15T22:16:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f6968c12740 1 client.15135 shutdown 2024-09-15T22:16:10.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f6968c12740 1 -- 172.21.15.45:0/1614953996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e609d0 msgr2=0x55aaf9e6b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f6968c12740 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e609d0 0x55aaf9e6b4f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f695009c2a0 tx=0x7f69500d3b60 comp rx=0 tx=0).stop 2024-09-15T22:16:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f6968c12740 1 -- 172.21.15.45:0/1614953996 shutdown_connections 2024-09-15T22:16:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f6968c12740 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aaf9e80620 0x55aaf9e81a90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f6968c12740 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e68d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f6968c12740 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e612f0 0x55aaf9e68840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f6968c12740 1 --2- 172.21.15.45:0/1614953996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e609d0 0x55aaf9e6b4f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f693f7fe640 0 client.15135 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f6968c12740 1 -- 172.21.15.45:0/1614953996 >> 172.21.15.45:0/1614953996 conn(0x55aaf9e5cf60 msgr2=0x55aaf9e62c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f6968c12740 1 -- 172.21.15.45:0/1614953996 shutdown_connections 2024-09-15T22:16:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f6968c12740 1 -- 172.21.15.45:0/1614953996 wait complete. 2024-09-15T22:16:10.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.890+0000 7f6968c12740 20 client.15135 trim_cache size 0 max 16384 2024-09-15T22:16:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.908+0000 7f6968c12740 1 Processor -- start 2024-09-15T22:16:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.908+0000 7f6968c12740 1 -- start start 2024-09-15T22:16:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.908+0000 7f6968c12740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e609d0 0x55aaf9e65aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.908+0000 7f6968c12740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e65fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.908+0000 7f6968c12740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e89d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.908+0000 7f6968c12740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aaf9e7fdd0 con 0x55aaf9e612f0 2024-09-15T22:16:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.908+0000 7f6968c12740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aaf9e804a0 con 0x55aaf9e609d0 2024-09-15T22:16:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.908+0000 7f6968c12740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55aaf9e80b70 con 0x55aaf9e6bbb0 2024-09-15T22:16:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.908+0000 7f695f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e65fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.908+0000 7f695f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e65fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33242/0 (socket says 172.21.15.45:33242) 2024-09-15T22:16:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.909+0000 7f695f7fe640 1 -- 172.21.15.45:0/3002958830 learned_addr learned my addr 172.21.15.45:0/3002958830 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.909+0000 7f695ffff640 1 --2- 172.21.15.45:0/3002958830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e609d0 0x55aaf9e65aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.909+0000 7f6964dd6640 1 --2- 172.21.15.45:0/3002958830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e89d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.909+0000 7f695f7fe640 1 -- 172.21.15.45:0/3002958830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 msgr2=0x55aaf9e89d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.909+0000 7f695f7fe640 1 --2- 172.21.15.45:0/3002958830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e89d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.909+0000 7f695f7fe640 1 -- 172.21.15.45:0/3002958830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e609d0 msgr2=0x55aaf9e65aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.909+0000 7f695f7fe640 1 --2- 172.21.15.45:0/3002958830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e609d0 0x55aaf9e65aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.909+0000 7f695f7fe640 1 -- 172.21.15.45:0/3002958830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaf9e6b110 con 0x55aaf9e612f0 2024-09-15T22:16:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.909+0000 7f695ffff640 1 --2- 172.21.15.45:0/3002958830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e609d0 0x55aaf9e65aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.909+0000 7f695f7fe640 1 --2- 172.21.15.45:0/3002958830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e65fe0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6954000c00 tx=0x7f6954012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4b6b9f3be287ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.909+0000 7f6945ffb640 1 -- 172.21.15.45:0/3002958830 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954022030 con 0x55aaf9e612f0 2024-09-15T22:16:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.909+0000 7f6945ffb640 1 -- 172.21.15.45:0/3002958830 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6954005520 con 0x55aaf9e612f0 2024-09-15T22:16:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.909+0000 7f6945ffb640 1 -- 172.21.15.45:0/3002958830 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954010690 con 0x55aaf9e612f0 2024-09-15T22:16:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.910+0000 7f6968c12740 1 -- 172.21.15.45:0/3002958830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 msgr2=0x55aaf9e65fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.910+0000 7f6968c12740 1 --2- 172.21.15.45:0/3002958830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e65fe0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6954000c00 tx=0x7f6954012b00 comp rx=0 tx=0).stop 2024-09-15T22:16:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.910+0000 7f6968c12740 1 -- 172.21.15.45:0/3002958830 shutdown_connections 2024-09-15T22:16:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.910+0000 7f6968c12740 1 --2- 172.21.15.45:0/3002958830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e89d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.910+0000 7f6968c12740 1 --2- 172.21.15.45:0/3002958830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e65fe0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.910+0000 7f6968c12740 1 --2- 172.21.15.45:0/3002958830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e609d0 0x55aaf9e65aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.910+0000 7f6968c12740 1 -- 172.21.15.45:0/3002958830 >> 172.21.15.45:0/3002958830 conn(0x55aaf9e5cf60 msgr2=0x55aaf9e6a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.910+0000 7f6968c12740 1 -- 172.21.15.45:0/3002958830 shutdown_connections 2024-09-15T22:16:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.910+0000 7f6968c12740 1 -- 172.21.15.45:0/3002958830 wait complete. 2024-09-15T22:16:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.910+0000 7f6968c12740 1 -- start start 2024-09-15T22:16:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.910+0000 7f6968c12740 1 Processor -- start 2024-09-15T22:16:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f6968c12740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e609d0 0x55aaf9e8a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f6968c12740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e85770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f6968c12740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e85cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f6968c12740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aaf9e81910 con 0x55aaf9e612f0 2024-09-15T22:16:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f6968c12740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aaf9e81240 con 0x55aaf9e6bbb0 2024-09-15T22:16:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f6968c12740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55aaf9e81fe0 con 0x55aaf9e609d0 2024-09-15T22:16:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f6968c12740 10 client.0 _ll_register_callbacks cb 0x7f69500baf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f695f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e85770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f695f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e85770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33248/0 (socket says 172.21.15.45:33248) 2024-09-15T22:16:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f695f7fe640 1 -- 172.21.15.45:0/458071464 learned_addr learned my addr 172.21.15.45:0/458071464 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f695ffff640 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e609d0 0x55aaf9e8a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f6964dd6640 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e85cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f695f7fe640 1 -- 172.21.15.45:0/458071464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e609d0 msgr2=0x55aaf9e8a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f695f7fe640 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e609d0 0x55aaf9e8a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f695f7fe640 1 -- 172.21.15.45:0/458071464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e6bbb0 msgr2=0x55aaf9e85cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f695f7fe640 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e85cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f695f7fe640 1 -- 172.21.15.45:0/458071464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaf9e86490 con 0x55aaf9e612f0 2024-09-15T22:16:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f6964dd6640 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e85cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f695f7fe640 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e85770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f69540057c0 tx=0x7f6954005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bfbc2024b21278 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.911+0000 7f693f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f693f7fe640 1 -- 172.21.15.45:0/458071464 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69540046c0 con 0x55aaf9e612f0 2024-09-15T22:16:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f693f7fe640 1 -- 172.21.15.45:0/458071464 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6954004860 con 0x55aaf9e612f0 2024-09-15T22:16:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f6968c12740 1 -- 172.21.15.45:0/458071464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6954005520 con 0x55aaf9e612f0 2024-09-15T22:16:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f693f7fe640 1 -- 172.21.15.45:0/458071464 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6954004a60 con 0x55aaf9e612f0 2024-09-15T22:16:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f6968c12740 10 client.15141 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f6968c12740 1 -- 172.21.15.45:0/458071464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55aaf9eeace0 con 0x55aaf9e612f0 2024-09-15T22:16:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f693f7fe640 1 -- 172.21.15.45:0/458071464 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6954005520 con 0x55aaf9e612f0 2024-09-15T22:16:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f693f7fe640 1 -- 172.21.15.45:0/458071464 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6954010430 con 0x55aaf9e612f0 2024-09-15T22:16:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f6968c12740 10 client.15141 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f6968c12740 10 client.15141 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:16:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f6968c12740 20 client.15141 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f6968c12740 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aaf9eef470 0x55aaf9eee180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f6968c12740 4 client.15141 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:16:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.912+0000 7f6968c12740 1 -- 172.21.15.45:0/458071464 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "status"}) -- 0x55aaf9dceb10 con 0x55aaf9eef470 2024-09-15T22:16:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.913+0000 7f695ffff640 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aaf9eef470 0x55aaf9eee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.913+0000 7f693f7fe640 10 client.15141 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:10.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.913+0000 7f695ffff640 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aaf9eef470 0x55aaf9eee180 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d159597f3cc729c server_cookie=a1ca569eced2d876 in_seq=0 out_seq=0 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.913+0000 7f693f7fe640 1 -- 172.21.15.45:0/458071464 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55aaf9dceb10 con 0x55aaf9eef470 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.913+0000 7f693f7fe640 10 client.15141 handle_command_reply: tid=0 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.913+0000 7f6968c12740 1 client.15141 shutdown 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.913+0000 7f6968c12740 1 -- 172.21.15.45:0/458071464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 msgr2=0x55aaf9e85770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.913+0000 7f6968c12740 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e85770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f69540057c0 tx=0x7f6954005020 comp rx=0 tx=0).stop 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.913+0000 7f6968c12740 1 -- 172.21.15.45:0/458071464 shutdown_connections 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.913+0000 7f6968c12740 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aaf9eef470 0x55aaf9eee180 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.913+0000 7f6968c12740 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aaf9e6bbb0 0x55aaf9e85cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f693f7fe640 0 client.15141 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6968c12740 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aaf9e612f0 0x55aaf9e85770 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6968c12740 1 --2- 172.21.15.45:0/458071464 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aaf9e609d0 0x55aaf9e8a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6968c12740 1 -- 172.21.15.45:0/458071464 >> 172.21.15.45:0/458071464 conn(0x55aaf9e5cf60 msgr2=0x55aaf9e5b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6968c12740 1 -- 172.21.15.45:0/458071464 shutdown_connections 2024-09-15T22:16:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6968c12740 1 -- 172.21.15.45:0/458071464 wait complete. 2024-09-15T22:16:10.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6968c12740 20 client.15141 trim_cache size 0 max 16384 2024-09-15T22:16:10.922 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:16:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "a1911414-73ae-11ef-bceb-c7b262605968", 2024-09-15T22:16:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2024-09-15T22:16:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24476, 2024-09-15T22:16:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-09-15T22:16:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-09-15T22:16:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-09-15T22:16:10.922 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 123.107964833, 2024-09-15T22:16:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 21, 2024-09-15T22:16:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 89, 2024-09-15T22:16:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 87, 2024-09-15T22:16:10.923 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 133.67402642299999 2024-09-15T22:16:10.923 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:16:10.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6966839640 1 -- 172.21.15.45:0/2852101391 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f69480a3350 msgr2=0x7f69480a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:10.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6966839640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f69480a3350 0x7f69480a5810 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6958006010 tx=0x7f695802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6966839640 1 -- 172.21.15.45:0/2852101391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6960101de0 msgr2=0x7f69601984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:10.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6966839640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6960101de0 0x7f69601984f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f695000e9f0 tx=0x7f695000edf0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6966839640 1 -- 172.21.15.45:0/2852101391 shutdown_connections 2024-09-15T22:16:10.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6966839640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f69480a3350 0x7f69480a5810 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6966839640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6960106f10 0x7f696019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6966839640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6960102790 0x7f6960198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6966839640 1 --2- 172.21.15.45:0/2852101391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6960101de0 0x7f69601984f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:10.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6966839640 1 -- 172.21.15.45:0/2852101391 >> 172.21.15.45:0/2852101391 conn(0x7f69600fd8c0 msgr2=0x7f69600feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:10.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.914+0000 7f6966839640 1 -- 172.21.15.45:0/2852101391 shutdown_connections 2024-09-15T22:16:10.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:10.915+0000 7f6966839640 1 -- 172.21.15.45:0/2852101391 wait complete. 2024-09-15T22:16:11.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:11 smithi045 ceph-mon[31180]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:16:11.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:11 smithi165 ceph-mon[35551]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:16:11.721 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T22:16:11.730 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T22:16:11.730 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T22:16:11.731 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T22:16:11.731 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-15T22:16:11.731 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T22:16:11.732 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-15T22:16:11.732 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-15T22:16:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:11 smithi100 ceph-mon[35319]: pgmap v346: 129 pgs: 129 active+clean; 641 KiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:16:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.843+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/950735957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb0102680 msgr2=0x7f6eb0104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:11.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.843+0000 7f6eb6cf1640 1 --2- 172.21.15.45:0/950735957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb0102680 0x7f6eb0104a70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0009900 tx=0x7f6ea002a410 comp rx=0 tx=0).stop 2024-09-15T22:16:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.843+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/950735957 shutdown_connections 2024-09-15T22:16:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.843+0000 7f6eb6cf1640 1 --2- 172.21.15.45:0/950735957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb01078e0 0x7f6eb0109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.843+0000 7f6eb6cf1640 1 --2- 172.21.15.45:0/950735957 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6eb0104fb0 0x7f6eb01073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.843+0000 7f6eb6cf1640 1 --2- 172.21.15.45:0/950735957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb0102680 0x7f6eb0104a70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.843+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/950735957 >> 172.21.15.45:0/950735957 conn(0x7f6eb00fc1e0 msgr2=0x7f6eb00fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.843+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/950735957 shutdown_connections 2024-09-15T22:16:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.843+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/950735957 wait complete. 2024-09-15T22:16:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.844+0000 7f6eb6cf1640 1 Processor -- start 2024-09-15T22:16:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.844+0000 7f6eb6cf1640 1 -- start start 2024-09-15T22:16:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.844+0000 7f6eb6cf1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb0102680 0x7f6eb0101ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.844+0000 7f6eb6cf1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb0104fb0 0x7f6eb0100630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:11.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.844+0000 7f6eb6cf1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6eb01078e0 0x7f6eb0100b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.844+0000 7f6eb6cf1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb010d9b0 con 0x7f6eb0104fb0 2024-09-15T22:16:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.844+0000 7f6eb6cf1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb010d830 con 0x7f6eb0102680 2024-09-15T22:16:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.844+0000 7f6eb6cf1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb010db30 con 0x7f6eb01078e0 2024-09-15T22:16:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.844+0000 7f6eaffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb0104fb0 0x7f6eb0100630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.844+0000 7f6eb4a8d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb0102680 0x7f6eb0101ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.844+0000 7f6eaffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb0104fb0 0x7f6eb0100630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33268/0 (socket says 172.21.15.45:33268) 2024-09-15T22:16:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.844+0000 7f6eaffff640 1 -- 172.21.15.45:0/1669257128 learned_addr learned my addr 172.21.15.45:0/1669257128 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.844+0000 7f6eb528e640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6eb01078e0 0x7f6eb0100b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.845+0000 7f6eaffff640 1 -- 172.21.15.45:0/1669257128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6eb01078e0 msgr2=0x7f6eb0100b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.845+0000 7f6eaffff640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6eb01078e0 0x7f6eb0100b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.845+0000 7f6eaffff640 1 -- 172.21.15.45:0/1669257128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb0102680 msgr2=0x7f6eb0101ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.845+0000 7f6eaffff640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb0102680 0x7f6eb0101ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:11.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.845+0000 7f6eaffff640 1 -- 172.21.15.45:0/1669257128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb0101400 con 0x7f6eb0104fb0 2024-09-15T22:16:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.845+0000 7f6eb528e640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6eb01078e0 0x7f6eb0100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.845+0000 7f6eaffff640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb0104fb0 0x7f6eb0100630 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400b450 tx=0x7f6ea400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.845+0000 7f6eadffb640 1 -- 172.21.15.45:0/1669257128 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4015020 con 0x7f6eb0104fb0 2024-09-15T22:16:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.845+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/1669257128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb01a20a0 con 0x7f6eb0104fb0 2024-09-15T22:16:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.845+0000 7f6eadffb640 1 -- 172.21.15.45:0/1669257128 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ea4011d90 con 0x7f6eb0104fb0 2024-09-15T22:16:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.845+0000 7f6eadffb640 1 -- 172.21.15.45:0/1669257128 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400f340 con 0x7f6eb0104fb0 2024-09-15T22:16:11.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.845+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/1669257128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb01a2620 con 0x7f6eb0104fb0 2024-09-15T22:16:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.846+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/1669257128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb00fdcd0 con 0x7f6eb0104fb0 2024-09-15T22:16:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.847+0000 7f6eadffb640 1 -- 172.21.15.45:0/1669257128 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6ea4018020 con 0x7f6eb0104fb0 2024-09-15T22:16:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.848+0000 7f6eadffb640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f6e980a3390 0x7f6e980a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.848+0000 7f6eadffb640 1 -- 172.21.15.45:0/1669257128 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6ea40cf860 con 0x7f6eb0104fb0 2024-09-15T22:16:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.848+0000 7f6eb4a8d640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f6e980a3390 0x7f6e980a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:11.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.849+0000 7f6eb4a8d640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f6e980a3390 0x7f6e980a5850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0006010 tx=0x7f6ea0031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:11.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:11.852+0000 7f6eadffb640 1 -- 172.21.15.45:0/1669257128 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6ea401f020 con 0x7f6eb0104fb0 2024-09-15T22:16:12.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.079+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/1669257128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f6eb002da10 con 0x7f6eb0104fb0 2024-09-15T22:16:12.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.300+0000 7f6eadffb640 1 -- 172.21.15.45:0/1669257128 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7f6ea4084e20 con 0x7f6eb0104fb0 2024-09-15T22:16:12.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.302+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/1669257128 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f6e980a3390 msgr2=0x7f6e980a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:12.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.302+0000 7f6eb6cf1640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f6e980a3390 0x7f6e980a5850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6ea0006010 tx=0x7f6ea0031640 comp rx=0 tx=0).stop 2024-09-15T22:16:12.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.302+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/1669257128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb0104fb0 msgr2=0x7f6eb0100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:12.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.302+0000 7f6eb6cf1640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb0104fb0 0x7f6eb0100630 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400b450 tx=0x7f6ea400b910 comp rx=0 tx=0).stop 2024-09-15T22:16:12.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.302+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/1669257128 shutdown_connections 2024-09-15T22:16:12.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.302+0000 7f6eb6cf1640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7f6e980a3390 0x7f6e980a5850 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:12.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.302+0000 7f6eb6cf1640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6eb01078e0 0x7f6eb0100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:12.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.302+0000 7f6eb6cf1640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb0104fb0 0x7f6eb0100630 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:12.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.302+0000 7f6eb6cf1640 1 --2- 172.21.15.45:0/1669257128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6eb0102680 0x7f6eb0101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:12.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.302+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/1669257128 >> 172.21.15.45:0/1669257128 conn(0x7f6eb00fc1e0 msgr2=0x7f6eb0102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:12.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.302+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/1669257128 shutdown_connections 2024-09-15T22:16:12.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:12.302+0000 7f6eb6cf1640 1 -- 172.21.15.45:0/1669257128 wait complete. 2024-09-15T22:16:12.324 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:12 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1669257128' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-15T22:16:12.326 INFO:teuthology.run_tasks:Running task kclient... 2024-09-15T22:16:12.339 INFO:tasks.kclient:Mounting kernel clients... 2024-09-15T22:16:12.340 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-15T22:16:12.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:16:12.340 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-09-15T22:16:12.359 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-15T22:16:12.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:16:12.359 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:16:12.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:16:12.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2024-09-15T22:16:12.542 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'rbytes': False, 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-15T22:16:12.542 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:16:12.542 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:16:12.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-15T22:16:12.579 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: ignoring --setuser ceph since I am not root 2024-09-15T22:16:12.579 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: ignoring --setgroup ceph since I am not root 2024-09-15T22:16:12.579 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:12.469+0000 7fd0aabe9040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:16:12.579 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:12.532+0000 7fd0aabe9040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:16:12.658 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:12 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1669257128' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-15T22:16:12.658 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:12 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: ignoring --setuser ceph since I am not root 2024-09-15T22:16:12.658 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:12 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: ignoring --setgroup ceph since I am not root 2024-09-15T22:16:12.658 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:12 smithi100 ceph-mgr[36684]: -- 172.21.15.100:0/237493644 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558cfcc290e0 con 0x558cfcc06800 2024-09-15T22:16:12.658 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:12 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:12.454+0000 7fade4ef1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:16:12.658 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:12 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:12.510+0000 7fade4ef1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:16:12.659 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:12 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:12.656+0000 7fade4ef1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:16:12.659 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:12 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1669257128' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-15T22:16:12.659 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: ignoring --setuser ceph since I am not root 2024-09-15T22:16:12.659 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: ignoring --setgroup ceph since I am not root 2024-09-15T22:16:12.659 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:12 smithi165 ceph-mgr[37358]: -- 172.21.15.165:0/3201781728 <== mon.1 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5622b20a50e0 con 0x5622b2082800 2024-09-15T22:16:12.659 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:12.452+0000 7f3a9a861040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:16:12.660 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:12.509+0000 7f3a9a861040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:16:12.660 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:12.657+0000 7f3a9a861040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:16:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:12.953 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:12.701+0000 7fd0aabe9040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:16:12.953 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:12.777+0000 7fd0aabe9040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:16:12.953 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:12.951+0000 7fd0aabe9040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:16:12.964 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:12.726+0000 7f3a9a861040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:16:12.964 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:12.873+0000 7f3a9a861040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:16:12.994 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:12 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:12.723+0000 7fade4ef1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:16:12.994 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:12 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:12.871+0000 7fade4ef1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:16:13.265 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:13.103+0000 7fd0aabe9040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:16:13.303 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:13.016+0000 7f3a9a861040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:16:13.303 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:13 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:13.012+0000 7fade4ef1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:16:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.349+0000 7fcaa85c7640 1 -- 172.21.15.45:0/764602476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0100e20 msgr2=0x7fcaa0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.349+0000 7fcaa85c7640 1 --2- 172.21.15.45:0/764602476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0100e20 0x7fcaa0101200 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fca9c009900 tx=0x7fca9c02a480 comp rx=0 tx=0).stop 2024-09-15T22:16:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.349+0000 7fcaa85c7640 1 -- 172.21.15.45:0/764602476 shutdown_connections 2024-09-15T22:16:13.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.349+0000 7fcaa85c7640 1 --2- 172.21.15.45:0/764602476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcaa0102ef0 0x7fcaa010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.349+0000 7fcaa85c7640 1 --2- 172.21.15.45:0/764602476 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaa0102570 0x7fcaa01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.349+0000 7fcaa85c7640 1 --2- 172.21.15.45:0/764602476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0100e20 0x7fcaa0101200 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.349+0000 7fcaa85c7640 1 -- 172.21.15.45:0/764602476 >> 172.21.15.45:0/764602476 conn(0x7fcaa00fc7d0 msgr2=0x7fcaa00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.349+0000 7fcaa85c7640 1 -- 172.21.15.45:0/764602476 shutdown_connections 2024-09-15T22:16:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.349+0000 7fcaa85c7640 1 -- 172.21.15.45:0/764602476 wait complete. 2024-09-15T22:16:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.350+0000 7fcaa85c7640 1 Processor -- start 2024-09-15T22:16:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.350+0000 7fcaa85c7640 1 -- start start 2024-09-15T22:16:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.350+0000 7fcaa85c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0100e20 0x7fcaa01985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.350+0000 7fcaa85c7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcaa0102570 0x7fcaa0198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.350+0000 7fcaa85c7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaa0102ef0 0x7fcaa019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.350+0000 7fcaa85c7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa01110a0 con 0x7fcaa0100e20 2024-09-15T22:16:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.350+0000 7fcaa85c7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa0110f20 con 0x7fcaa0102570 2024-09-15T22:16:13.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.350+0000 7fcaa85c7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa0111220 con 0x7fcaa0102ef0 2024-09-15T22:16:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.350+0000 7fcaa6363640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0100e20 0x7fcaa01985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.350+0000 7fcaa6363640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0100e20 0x7fcaa01985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33298/0 (socket says 172.21.15.45:33298) 2024-09-15T22:16:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.350+0000 7fcaa6363640 1 -- 172.21.15.45:0/872374375 learned_addr learned my addr 172.21.15.45:0/872374375 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.350+0000 7fcaa5b62640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcaa0102570 0x7fcaa0198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.350+0000 7fcaa6b64640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaa0102ef0 0x7fcaa019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.351+0000 7fcaa6363640 1 -- 172.21.15.45:0/872374375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaa0102ef0 msgr2=0x7fcaa019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.351+0000 7fcaa6363640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaa0102ef0 0x7fcaa019ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.351+0000 7fcaa6363640 1 -- 172.21.15.45:0/872374375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcaa0102570 msgr2=0x7fcaa0198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.351+0000 7fcaa6363640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcaa0102570 0x7fcaa0198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.351+0000 7fcaa6363640 1 -- 172.21.15.45:0/872374375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa019d570 con 0x7fcaa0100e20 2024-09-15T22:16:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.351+0000 7fcaa6363640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0100e20 0x7fcaa01985c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fca9c006010 tx=0x7fca9c004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.351+0000 7fca977fe640 1 -- 172.21.15.45:0/872374375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c03f030 con 0x7fcaa0100e20 2024-09-15T22:16:13.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.351+0000 7fca977fe640 1 -- 172.21.15.45:0/872374375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca9c005500 con 0x7fcaa0100e20 2024-09-15T22:16:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.351+0000 7fcaa85c7640 1 -- 172.21.15.45:0/872374375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa019d800 con 0x7fcaa0100e20 2024-09-15T22:16:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.351+0000 7fca977fe640 1 -- 172.21.15.45:0/872374375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9c035070 con 0x7fcaa0100e20 2024-09-15T22:16:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.351+0000 7fcaa85c7640 1 -- 172.21.15.45:0/872374375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa01a5140 con 0x7fcaa0100e20 2024-09-15T22:16:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.352+0000 7fcaa85c7640 1 -- 172.21.15.45:0/872374375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa0101200 con 0x7fcaa0100e20 2024-09-15T22:16:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.354+0000 7fca977fe640 1 -- 172.21.15.45:0/872374375 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 18) ==== 138423+0+0 (secure 0 0 0) 0x7fca9c042030 con 0x7fcaa0100e20 2024-09-15T22:16:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.355+0000 7fca977fe640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca8c0a33a0 0x7fca8c0a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.355+0000 7fcaa5b62640 1 -- 172.21.15.45:0/872374375 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca8c0a33a0 msgr2=0x7fca8c0a5860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/1919238369 2024-09-15T22:16:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.355+0000 7fca977fe640 1 -- 172.21.15.45:0/872374375 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fca9c0f0890 con 0x7fcaa0100e20 2024-09-15T22:16:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.355+0000 7fcaa5b62640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca8c0a33a0 0x7fca8c0a5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:16:13.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.358+0000 7fca977fe640 1 -- 172.21.15.45:0/872374375 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fca9c0bca40 con 0x7fcaa0100e20 2024-09-15T22:16:13.545 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:13.479+0000 7fd0aabe9040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:16:13.546 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:13 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1669257128' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-15T22:16:13.546 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:13 smithi045 ceph-mon[31180]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-15T22:16:13.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.556+0000 7fcaa5b62640 1 -- 172.21.15.45:0/872374375 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca8c0a33a0 msgr2=0x7fca8c0a5860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.45:6800/1919238369 2024-09-15T22:16:13.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.556+0000 7fcaa5b62640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca8c0a33a0 0x7fca8c0a5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T22:16:13.575 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:13 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:13.328+0000 7fade4ef1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:16:13.575 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:13 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:13.390+0000 7fade4ef1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:16:13.575 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:13 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1669257128' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-15T22:16:13.575 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:13 smithi100 ceph-mon[35319]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-15T22:16:13.580 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:13 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1669257128' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-15T22:16:13.580 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:13 smithi165 ceph-mon[35551]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-15T22:16:13.580 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:13.331+0000 7f3a9a861040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:16:13.580 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:13.393+0000 7f3a9a861040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:16:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.610+0000 7fcaa85c7640 1 -- 172.21.15.45:0/872374375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcaa010a0a0 con 0x7fcaa0100e20 2024-09-15T22:16:13.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.611+0000 7fca977fe640 1 -- 172.21.15.45:0/872374375 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+88 (secure 0 0 0) 0x7fca9c0c0d40 con 0x7fcaa0100e20 2024-09-15T22:16:13.613 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T22:16:13.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.613+0000 7fcaa85c7640 1 -- 172.21.15.45:0/872374375 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca8c0a33a0 msgr2=0x7fca8c0a5860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:16:13.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.613+0000 7fcaa85c7640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca8c0a33a0 0x7fca8c0a5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:13.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.613+0000 7fcaa85c7640 1 -- 172.21.15.45:0/872374375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0100e20 msgr2=0x7fcaa01985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:13.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.613+0000 7fcaa85c7640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0100e20 0x7fcaa01985c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fca9c006010 tx=0x7fca9c004c00 comp rx=0 tx=0).stop 2024-09-15T22:16:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.613+0000 7fcaa85c7640 1 -- 172.21.15.45:0/872374375 shutdown_connections 2024-09-15T22:16:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.613+0000 7fcaa85c7640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.45:6800/1919238369,v1:172.21.15.45:6801/1919238369] conn(0x7fca8c0a33a0 0x7fca8c0a5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.613+0000 7fcaa85c7640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcaa0102ef0 0x7fcaa019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.613+0000 7fcaa85c7640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcaa0102570 0x7fcaa0198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.613+0000 7fcaa85c7640 1 --2- 172.21.15.45:0/872374375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcaa0100e20 0x7fcaa01985c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.613+0000 7fcaa85c7640 1 -- 172.21.15.45:0/872374375 >> 172.21.15.45:0/872374375 conn(0x7fcaa00fc7d0 msgr2=0x7fcaa006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.613+0000 7fcaa85c7640 1 -- 172.21.15.45:0/872374375 shutdown_connections 2024-09-15T22:16:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:13.613+0000 7fcaa85c7640 1 -- 172.21.15.45:0/872374375 wait complete. 2024-09-15T22:16:13.800 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:13.543+0000 7fd0aabe9040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:16:13.800 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:13.740+0000 7fd0aabe9040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:16:13.965 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:13.578+0000 7f3a9a861040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:16:13.994 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:13 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:13.573+0000 7fade4ef1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:16:14.341 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:16:14.342 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:16:14.342 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2024-09-15T22:16:14.342 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:16:14.342 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:16:14.342 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:16:14.342 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:16:14.342 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:16:14.342 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:16:14.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:16:14.342 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2024-09-15T22:16:14.399 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:16:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:16:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:16:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:16:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2024-09-15T22:16:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:16:14.400 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:16:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:16:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2024-09-15T22:16:14.400 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:16:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:16:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2024-09-15T22:16:14.400 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:16:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2024-09-15T22:16:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2024-09-15T22:16:14.400 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-15T22:16:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42207sec preferred_lft 42207sec 2024-09-15T22:16:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2024-09-15T22:16:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:16:14.401 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T22:16:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2024-09-15T22:16:14.401 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2024-09-15T22:16:14.401 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:16:14.401 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:16:14.401 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-15T22:16:14.402 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:16:14.402 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2024-09-15T22:16:14.402 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2024-09-15T22:16:14.402 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:16:14.402 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-15T22:16:14.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:16:14.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:16:14.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:16:14.553 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:16:14.575 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:14 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/872374375' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:16:14.578 INFO:teuthology.orchestra.run.smithi045.stdout:1 2024-09-15T22:16:14.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:16:14.581 DEBUG:teuthology.orchestra.run.smithi045:> route 2024-09-15T22:16:14.638 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2024-09-15T22:16:14.638 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:16:14.638 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-15T22:16:14.638 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-15T22:16:14.638 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:16:14.639 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:16:14.639 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-15T22:16:14.639 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:16:14.639 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:16:14.639 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:16:14.639 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-15T22:16:14.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:14 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/872374375' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:16:14.715 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:14 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:14.468+0000 7f3a9a861040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:16:14.715 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:14 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:14.539+0000 7f3a9a861040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:16:14.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:16:14.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:14 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/872374375' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T22:16:14.744 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:14 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:14.455+0000 7fade4ef1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:16:14.744 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:14 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:14.524+0000 7fade4ef1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:16:14.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:16:14.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:16:14.770 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-09-15T22:16:14.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:16:14.786 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2024-09-15T22:16:14.843 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:16:14.843 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-15T22:16:14.843 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:16:14.843 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T22:16:14.843 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-15T22:16:14.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:16:14.942 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:14 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:14.691+0000 7fd0aabe9040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:16:14.943 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:14 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:14.765+0000 7fd0aabe9040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:16:14.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:16:14.965 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T22:16:14.965 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:16:14.965 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-15T22:16:14.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T22:16:14.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:16:14.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T22:16:14.966 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T22:16:14.966 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T22:16:14.966 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-15T22:16:15.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:16:15.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:16:15.087 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:16:15.087 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-09-15T22:16:15.087 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2024-09-15T22:16:15.087 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:16:15.087 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-09-15T22:16:15.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:16:15.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:16:15.169 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:16:15.170 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:16:15.185 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:16:15.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:16:15.185 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:16:15.241 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-15T22:16:15.242 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-15T22:16:15.242 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/c2ba8ff1-799c-49b4-bbce-3a895390aaa4 2024-09-15T22:16:15.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:16:15.242 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/c2ba8ff1-799c-49b4-bbce-3a895390aaa4 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-15T22:16:15.327 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-15T22:16:15.328 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-15T22:16:15.493 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:15.234+0000 7fade4ef1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:16:15.494 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:15.350+0000 7fade4ef1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:16:15.504 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-15T22:16:15.504 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-15T22:16:15.504 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.100:3300,172.21.15.165:3300" 2024-09-15T22:16:15.504 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@a1911414-73ae-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/c2ba8ff1-799c-49b4-bbce-3a895390aaa4 2024-09-15T22:16:15.504 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.45:3300/172.21.15.100:3300/172.21.15.165:3300" will pass to kernel 2024-09-15T22:16:15.505 INFO:teuthology.orchestra.run.smithi045.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T22:16:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: You just mounted a file system that supports labels which does not 2024-09-15T22:16:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T22:16:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T22:16:15.505 INFO:teuthology.orchestra.run.smithi045.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T22:16:15.507 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:16:15.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:16:15.507 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:16:15.520 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:15.258+0000 7f3a9a861040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:16:15.521 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:15.375+0000 7f3a9a861040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:16:15.744 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:15.491+0000 7fade4ef1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:16:15.744 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:15.554+0000 7fade4ef1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:16:15.744 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:15.704+0000 7fade4ef1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:16:15.802 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:15.519+0000 7f3a9a861040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:16:15.802 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:15.581+0000 7f3a9a861040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:16:15.802 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:15.732+0000 7f3a9a861040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:16:15.802 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:15.800+0000 7f3a9a861040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:16:15.831 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:15 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:15.558+0000 7fd0aabe9040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T22:16:15.831 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:15 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:15.679+0000 7fd0aabe9040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:16:16.057 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:15.773+0000 7fade4ef1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:16:16.057 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:15.832+0000 7fade4ef1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:16:16.057 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:15.989+0000 7fade4ef1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:16:16.057 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:16 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:16.054+0000 7fade4ef1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:16:16.086 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:15.860+0000 7f3a9a861040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:16:16.087 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:16.019+0000 7f3a9a861040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:16:16.087 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:16.085+0000 7f3a9a861040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:16:16.123 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:15 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:15.829+0000 7fd0aabe9040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:16:16.123 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:15 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:15.893+0000 7fd0aabe9040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:16:16.124 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:16.050+0000 7fd0aabe9040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T22:16:16.124 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:16.121+0000 7fd0aabe9040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:16:16.323 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:16 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:16.121+0000 7fade4ef1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:16:16.323 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:16 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:16.204+0000 7fade4ef1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:16:16.324 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:16 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:16.262+0000 7fade4ef1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:16:16.324 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:16 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:16.321+0000 7fade4ef1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:16:16.357 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:16.153+0000 7f3a9a861040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:16:16.357 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:16.236+0000 7f3a9a861040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:16:16.357 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:16.296+0000 7f3a9a861040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:16:16.420 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:16.184+0000 7fd0aabe9040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:16:16.420 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:16.350+0000 7fd0aabe9040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:16:16.420 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:16.418+0000 7fd0aabe9040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:16:16.701 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:16.488+0000 7fd0aabe9040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:16:16.701 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:16.574+0000 7fd0aabe9040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:16:16.701 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:16.636+0000 7fd0aabe9040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:16:16.701 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:16.698+0000 7fd0aabe9040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:16:16.714 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:16.356+0000 7f3a9a861040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:16:17.464 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:16:17 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z[37354]: 2024-09-15T22:16:17.149+0000 7f3a9a861040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:16:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:17 smithi165 ceph-mon[35551]: Standby manager daemon y restarted 2024-09-15T22:16:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:17 smithi165 ceph-mon[35551]: Standby manager daemon y started 2024-09-15T22:16:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:17 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.100:0/3994879197' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:16:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:17 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.100:0/3994879197' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:16:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:17 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.100:0/3994879197' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:16:17.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:17 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.100:0/3994879197' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:16:17.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:17 smithi165 ceph-mon[35551]: Standby manager daemon z restarted 2024-09-15T22:16:17.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:17 smithi165 ceph-mon[35551]: Standby manager daemon z started 2024-09-15T22:16:17.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:17 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.165:0/2445484934' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:16:17.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:17 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.165:0/2445484934' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:16:17.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:17 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.165:0/2445484934' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:16:17.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:17 smithi165 ceph-mon[35551]: from='mgr.? 172.21.15.165:0/2445484934' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:16:17.494 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:16:17 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y[36680]: 2024-09-15T22:16:17.105+0000 7fade4ef1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:16:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:17 smithi100 ceph-mon[35319]: Standby manager daemon y restarted 2024-09-15T22:16:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:17 smithi100 ceph-mon[35319]: Standby manager daemon y started 2024-09-15T22:16:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:17 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.100:0/3994879197' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:16:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:17 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.100:0/3994879197' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:16:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:17 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.100:0/3994879197' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:16:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:17 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.100:0/3994879197' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:16:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:17 smithi100 ceph-mon[35319]: Standby manager daemon z restarted 2024-09-15T22:16:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:17 smithi100 ceph-mon[35319]: Standby manager daemon z started 2024-09-15T22:16:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:17 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.165:0/2445484934' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:16:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:17 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.165:0/2445484934' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:16:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:17 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.165:0/2445484934' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:16:17.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:17 smithi100 ceph-mon[35319]: from='mgr.? 172.21.15.165:0/2445484934' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:16:17.535 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-mon[31180]: Standby manager daemon y restarted 2024-09-15T22:16:17.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-mon[31180]: Standby manager daemon y started 2024-09-15T22:16:17.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.100:0/3994879197' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T22:16:17.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.100:0/3994879197' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:16:17.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.100:0/3994879197' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T22:16:17.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.100:0/3994879197' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:16:17.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-mon[31180]: Standby manager daemon z restarted 2024-09-15T22:16:17.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-mon[31180]: Standby manager daemon z started 2024-09-15T22:16:17.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/2445484934' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T22:16:17.536 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/2445484934' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T22:16:17.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/2445484934' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T22:16:17.537 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-mon[31180]: from='mgr.? 172.21.15.165:0/2445484934' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T22:16:17.563 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:16:17.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:16:17.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:16:17.659 INFO:teuthology.orchestra.run.smithi045.stdout:client24835 2024-09-15T22:16:17.659 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:16:17.659 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:16:17.678 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:16:17.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:16:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:16:17.799 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:17.533+0000 7fd0aabe9040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:16:17.805 INFO:teuthology.orchestra.run.smithi045.stdout:client24835 2024-09-15T22:16:17.805 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:16:17.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:16:17.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:16:17.887 INFO:teuthology.orchestra.run.smithi045.stdout:client24835 2024-09-15T22:16:17.887 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a1911414-73ae-11ef-bceb-c7b262605968.client24835/status') 2024-09-15T22:16:17.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:16:17.950 INFO:teuthology.orchestra.run.smithi045.stdout:instance: client.24835 (3)172.21.15.45:0/1687016810 2024-09-15T22:16:17.950 INFO:teuthology.orchestra.run.smithi045.stdout:blocklisted: false 2024-09-15T22:16:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records in 2024-09-15T22:16:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records out 2024-09-15T22:16:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:71 bytes copied, 2.5456e-05 s, 2.8 MB/s 2024-09-15T22:16:17.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:16:17.958 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-15T22:16:17.969 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-15T22:16:17.989 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:16:18.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.093+0000 7fb6f4e53640 1 -- 172.21.15.45:0/1848998591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f0104ec0 msgr2=0x7fb6f01072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.093+0000 7fb6f4e53640 1 --2- 172.21.15.45:0/1848998591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f0104ec0 0x7fb6f01072b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4009900 tx=0x7fb6e402a410 comp rx=0 tx=0).stop 2024-09-15T22:16:18.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.093+0000 7fb6f4e53640 1 -- 172.21.15.45:0/1848998591 shutdown_connections 2024-09-15T22:16:18.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.093+0000 7fb6f4e53640 1 --2- 172.21.15.45:0/1848998591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f01077f0 0x7fb6f0109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.093+0000 7fb6f4e53640 1 --2- 172.21.15.45:0/1848998591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f0104ec0 0x7fb6f01072b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.093+0000 7fb6f4e53640 1 --2- 172.21.15.45:0/1848998591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6f0102590 0x7fb6f0104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.093+0000 7fb6f4e53640 1 -- 172.21.15.45:0/1848998591 >> 172.21.15.45:0/1848998591 conn(0x7fb6f00fc170 msgr2=0x7fb6f00fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:18.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.093+0000 7fb6f4e53640 1 -- 172.21.15.45:0/1848998591 shutdown_connections 2024-09-15T22:16:18.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.093+0000 7fb6f4e53640 1 -- 172.21.15.45:0/1848998591 wait complete. 2024-09-15T22:16:18.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6f4e53640 1 Processor -- start 2024-09-15T22:16:18.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6f4e53640 1 -- start start 2024-09-15T22:16:18.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6f4e53640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f0102590 0x7fb6f0101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:18.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6f4e53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0104ec0 0x7fb6f0100540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:18.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6f4e53640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6f01077f0 0x7fb6f0100a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:18.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6f4e53640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f010d8e0 con 0x7fb6f0102590 2024-09-15T22:16:18.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6f4e53640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f010d760 con 0x7fb6f0104ec0 2024-09-15T22:16:18.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6f4e53640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f010da60 con 0x7fb6f01077f0 2024-09-15T22:16:18.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6ee59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f0102590 0x7fb6f0101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:18.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6ee59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f0102590 0x7fb6f0101f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51966/0 (socket says 172.21.15.45:51966) 2024-09-15T22:16:18.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6ee59c640 1 -- 172.21.15.45:0/3391965081 learned_addr learned my addr 172.21.15.45:0/3391965081 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:18.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6edd9b640 1 --2- 172.21.15.45:0/3391965081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0104ec0 0x7fb6f0100540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:18.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6eed9d640 1 --2- 172.21.15.45:0/3391965081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6f01077f0 0x7fb6f0100a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:18.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6ee59c640 1 -- 172.21.15.45:0/3391965081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6f01077f0 msgr2=0x7fb6f0100a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6ee59c640 1 --2- 172.21.15.45:0/3391965081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6f01077f0 0x7fb6f0100a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6ee59c640 1 -- 172.21.15.45:0/3391965081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0104ec0 msgr2=0x7fb6f0100540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6ee59c640 1 --2- 172.21.15.45:0/3391965081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0104ec0 0x7fb6f0100540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.094+0000 7fb6ee59c640 1 -- 172.21.15.45:0/3391965081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f0101310 con 0x7fb6f0102590 2024-09-15T22:16:18.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.095+0000 7fb6ee59c640 1 --2- 172.21.15.45:0/3391965081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f0102590 0x7fb6f0101f00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000d950 tx=0x7fb6e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:18.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.095+0000 7fb6df7fe640 1 -- 172.21.15.45:0/3391965081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0017070 con 0x7fb6f0102590 2024-09-15T22:16:18.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.095+0000 7fb6df7fe640 1 -- 172.21.15.45:0/3391965081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6e0009c30 con 0x7fb6f0102590 2024-09-15T22:16:18.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.095+0000 7fb6f4e53640 1 -- 172.21.15.45:0/3391965081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f01a20c0 con 0x7fb6f0102590 2024-09-15T22:16:18.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.095+0000 7fb6df7fe640 1 -- 172.21.15.45:0/3391965081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e000f740 con 0x7fb6f0102590 2024-09-15T22:16:18.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.095+0000 7fb6f4e53640 1 -- 172.21.15.45:0/3391965081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f01a2630 con 0x7fb6f0102590 2024-09-15T22:16:18.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.096+0000 7fb6f4e53640 1 -- 172.21.15.45:0/3391965081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f00fdc60 con 0x7fb6f0102590 2024-09-15T22:16:18.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.098+0000 7fb6df7fe640 1 -- 172.21.15.45:0/3391965081 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 20) ==== 138040+0+0 (secure 0 0 0) 0x7fb6e0010a80 con 0x7fb6f0102590 2024-09-15T22:16:18.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.100+0000 7fb6df7fe640 1 -- 172.21.15.45:0/3391965081 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fb6e00cf3a0 con 0x7fb6f0102590 2024-09-15T22:16:18.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.103+0000 7fb6df7fe640 1 -- 172.21.15.45:0/3391965081 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb6e0009de0 con 0x7fb6f0102590 2024-09-15T22:16:18.174 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:17.832+0000 7fd015441640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:16:18.174 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:17.832+0000 7fd015441640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:16:18.174 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:17.832+0000 7fd015441640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:16:18.174 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:17.832+0000 7fd015441640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:16:18.174 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:17.832+0000 7fd015441640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:16:18.174 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:17.832+0000 7fd01243b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:16:18.174 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:17.832+0000 7fd01243b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:16:18.174 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:17.832+0000 7fd01243b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:16:18.174 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:17.833+0000 7fd01243b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:16:18.174 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:17.833+0000 7fd01243b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:16:18.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-15T22:16:18.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: Active manager daemon x restarted 2024-09-15T22:16:18.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: Activating manager daemon x 2024-09-15T22:16:18.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: osdmap e90: 12 total, 12 up, 12 in 2024-09-15T22:16:18.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: mgrmap e20: x(active, starting, since 0.0111072s), standbys: z, y 2024-09-15T22:16:18.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:16:18.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:18.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:18.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:16:18.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:16:18.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:16:18.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:16:18.245 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:16:18.246 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:16:18.247 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:16:18.247 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:16:18.247 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:16:18.247 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:16:18.247 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:16:18.247 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:16:18.247 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:16:18.247 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:16:18.247 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:16:18.247 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:16:18.247 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:16:18.247 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: Manager daemon x is now available 2024-09-15T22:16:18.247 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:18.248 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:16:18.248 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:16:18.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.305+0000 7fb6f4e53640 1 -- 172.21.15.45:0/3391965081 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6f0062df0 con 0x7fb6f0102590 2024-09-15T22:16:18.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.308+0000 7fb6df7fe640 1 -- 172.21.15.45:0/3391965081 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25101 (secure 0 0 0) 0x7fb6e009b980 con 0x7fb6f0102590 2024-09-15T22:16:18.310 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:18.310 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":90,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:16:17.536229+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":7}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/1919238369":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/4107707607":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3286786467":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1080251242":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1461513797":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/1919238369":"2024-09-16T22:16:17.536196+0000","172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3846204427":"2024-09-16T22:16:17.536196+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:16:18.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.310+0000 7fb6f4e53640 1 -- 172.21.15.45:0/3391965081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f0102590 msgr2=0x7fb6f0101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.310+0000 7fb6f4e53640 1 --2- 172.21.15.45:0/3391965081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f0102590 0x7fb6f0101f00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb6e000d950 tx=0x7fb6e000de10 comp rx=0 tx=0).stop 2024-09-15T22:16:18.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.310+0000 7fb6f4e53640 1 -- 172.21.15.45:0/3391965081 shutdown_connections 2024-09-15T22:16:18.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.310+0000 7fb6f4e53640 1 --2- 172.21.15.45:0/3391965081 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb6f01077f0 0x7fb6f0100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.310+0000 7fb6f4e53640 1 --2- 172.21.15.45:0/3391965081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6f0104ec0 0x7fb6f0100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.310+0000 7fb6f4e53640 1 --2- 172.21.15.45:0/3391965081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f0102590 0x7fb6f0101f00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.310+0000 7fb6f4e53640 1 -- 172.21.15.45:0/3391965081 >> 172.21.15.45:0/3391965081 conn(0x7fb6f00fc170 msgr2=0x7fb6f0102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:18.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.310+0000 7fb6f4e53640 1 -- 172.21.15.45:0/3391965081 shutdown_connections 2024-09-15T22:16:18.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.310+0000 7fb6f4e53640 1 -- 172.21.15.45:0/3391965081 wait complete. 2024-09-15T22:16:18.323 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:09:29.838325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T22:14:03.430259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T22:14:05.780122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-15T22:14:12.253914+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-15T22:16:18.324 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:16:18.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.430+0000 7fef04ef1640 1 -- 172.21.15.45:0/3462498780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef00101650 msgr2=0x7fef00101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.430+0000 7fef04ef1640 1 --2- 172.21.15.45:0/3462498780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef00101650 0x7fef00101b00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feef8009ca0 tx=0x7feef802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.430+0000 7fef04ef1640 1 -- 172.21.15.45:0/3462498780 shutdown_connections 2024-09-15T22:16:18.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.430+0000 7fef04ef1640 1 --2- 172.21.15.45:0/3462498780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef00101650 0x7fef00101b00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.430+0000 7fef04ef1640 1 --2- 172.21.15.45:0/3462498780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef00100cb0 0x7fef00101110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.430+0000 7fef04ef1640 1 --2- 172.21.15.45:0/3462498780 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef00100370 0x7fef00100770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.430+0000 7fef04ef1640 1 -- 172.21.15.45:0/3462498780 >> 172.21.15.45:0/3462498780 conn(0x7fef000fc140 msgr2=0x7fef000fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:18.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.431+0000 7fef04ef1640 1 -- 172.21.15.45:0/3462498780 shutdown_connections 2024-09-15T22:16:18.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.431+0000 7fef04ef1640 1 -- 172.21.15.45:0/3462498780 wait complete. 2024-09-15T22:16:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.431+0000 7fef04ef1640 1 Processor -- start 2024-09-15T22:16:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7fef04ef1640 1 -- start start 2024-09-15T22:16:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7fef04ef1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef00100370 0x7fef0019a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7fef04ef1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef00100cb0 0x7fef0019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7fef04ef1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef00101650 0x7fef001a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7fef04ef1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fef0010fad0 con 0x7fef00100370 2024-09-15T22:16:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7fef04ef1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fef0010f950 con 0x7fef00100cb0 2024-09-15T22:16:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7fef04ef1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fef0010fc50 con 0x7fef00101650 2024-09-15T22:16:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7feefe59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef00100370 0x7fef0019a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7feefe59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef00100370 0x7fef0019a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51976/0 (socket says 172.21.15.45:51976) 2024-09-15T22:16:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7feefe59c640 1 -- 172.21.15.45:0/3711233013 learned_addr learned my addr 172.21.15.45:0/3711233013 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7feefdd9b640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef00100cb0 0x7fef0019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7feefed9d640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef00101650 0x7fef001a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7feefe59c640 1 -- 172.21.15.45:0/3711233013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef00101650 msgr2=0x7fef001a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7feefe59c640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef00101650 0x7fef001a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7feefe59c640 1 -- 172.21.15.45:0/3711233013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef00100cb0 msgr2=0x7fef0019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7feefe59c640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef00100cb0 0x7fef0019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7feefe59c640 1 -- 172.21.15.45:0/3711233013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef001a1cd0 con 0x7fef00100370 2024-09-15T22:16:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7feefdd9b640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef00100cb0 0x7fef0019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.432+0000 7feefe59c640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef00100370 0x7fef0019a0b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feef000e9f0 tx=0x7feef000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.433+0000 7feeef7fe640 1 -- 172.21.15.45:0/3711233013 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef000cd80 con 0x7fef00100370 2024-09-15T22:16:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.433+0000 7feeef7fe640 1 -- 172.21.15.45:0/3711233013 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feef0005520 con 0x7fef00100370 2024-09-15T22:16:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.433+0000 7fef04ef1640 1 -- 172.21.15.45:0/3711233013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef001a1fc0 con 0x7fef00100370 2024-09-15T22:16:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.433+0000 7feeef7fe640 1 -- 172.21.15.45:0/3711233013 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef0010690 con 0x7fef00100370 2024-09-15T22:16:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.433+0000 7fef04ef1640 1 -- 172.21.15.45:0/3711233013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef001a2420 con 0x7fef00100370 2024-09-15T22:16:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.434+0000 7fef04ef1640 1 -- 172.21.15.45:0/3711233013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef0010b0c0 con 0x7fef00100370 2024-09-15T22:16:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.435+0000 7feeef7fe640 1 -- 172.21.15.45:0/3711233013 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 20) ==== 138040+0+0 (secure 0 0 0) 0x7feef00046c0 con 0x7fef00100370 2024-09-15T22:16:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.436+0000 7feeef7fe640 1 -- 172.21.15.45:0/3711233013 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7feef00cfdf0 con 0x7fef00100370 2024-09-15T22:16:18.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.443+0000 7feeef7fe640 1 -- 172.21.15.45:0/3711233013 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feef00541b0 con 0x7fef00100370 2024-09-15T22:16:18.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-15T22:16:18.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: Active manager daemon x restarted 2024-09-15T22:16:18.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: Activating manager daemon x 2024-09-15T22:16:18.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: osdmap e90: 12 total, 12 up, 12 in 2024-09-15T22:16:18.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: mgrmap e20: x(active, starting, since 0.0111072s), standbys: z, y 2024-09-15T22:16:18.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:16:18.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:18.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:16:18.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:16:18.467 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:16:18.468 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:16:18.468 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:16:18.468 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: Manager daemon x is now available 2024-09-15T22:16:18.468 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:18.468 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:16:18.468 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:16:18.554 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-15T22:16:18.555 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: Active manager daemon x restarted 2024-09-15T22:16:18.555 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: Activating manager daemon x 2024-09-15T22:16:18.555 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: osdmap e90: 12 total, 12 up, 12 in 2024-09-15T22:16:18.555 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: mgrmap e20: x(active, starting, since 0.0111072s), standbys: z, y 2024-09-15T22:16:18.555 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T22:16:18.555 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T22:16:18.555 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T22:16:18.555 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T22:16:18.555 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T22:16:18.555 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T22:16:18.555 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T22:16:18.556 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T22:16:18.556 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T22:16:18.556 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T22:16:18.556 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T22:16:18.556 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T22:16:18.556 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T22:16:18.556 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:16:18.556 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:16:18.556 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T22:16:18.556 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T22:16:18.556 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T22:16:18.556 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T22:16:18.556 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T22:16:18.557 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T22:16:18.557 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T22:16:18.557 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T22:16:18.557 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T22:16:18.557 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T22:16:18.557 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T22:16:18.557 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T22:16:18.557 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T22:16:18.557 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T22:16:18.557 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T22:16:18.557 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T22:16:18.557 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T22:16:18.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T22:16:18.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: Manager daemon x is now available 2024-09-15T22:16:18.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:18.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T22:16:18.558 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T22:16:18.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.558+0000 7feeef7fe640 1 -- 172.21.15.45:0/3711233013 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7feef00980d0 con 0x7fef00100370 2024-09-15T22:16:18.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.559+0000 7feeef7fe640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7feee80ab600 0x7feee80ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:18.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.562+0000 7feefdd9b640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7feee80ab600 0x7feee80ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:18.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.565+0000 7feefdd9b640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7feee80ab600 0x7feee80ad9f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fef0019b5c0 tx=0x7feef4005f90 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:18.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.650+0000 7fef04ef1640 1 -- 172.21.15.45:0/3711233013 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fef0002da10 con 0x7fef00100370 2024-09-15T22:16:18.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.651+0000 7feeef7fe640 1 -- 172.21.15.45:0/3711233013 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7feef009ca80 con 0x7fef00100370 2024-09-15T22:16:18.653 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-09-15T22:16:18.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.653+0000 7fef04ef1640 1 -- 172.21.15.45:0/3711233013 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7feee80ab600 msgr2=0x7feee80ad9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.653+0000 7fef04ef1640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7feee80ab600 0x7feee80ad9f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fef0019b5c0 tx=0x7feef4005f90 comp rx=0 tx=0).stop 2024-09-15T22:16:18.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.653+0000 7fef04ef1640 1 -- 172.21.15.45:0/3711233013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef00100370 msgr2=0x7fef0019a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.653+0000 7fef04ef1640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef00100370 0x7fef0019a0b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feef000e9f0 tx=0x7feef000edf0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.653+0000 7fef04ef1640 1 -- 172.21.15.45:0/3711233013 shutdown_connections 2024-09-15T22:16:18.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.653+0000 7fef04ef1640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7feee80ab600 0x7feee80ad9f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.653+0000 7fef04ef1640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fef00101650 0x7fef001a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.653+0000 7fef04ef1640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef00100cb0 0x7fef0019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.653+0000 7fef04ef1640 1 --2- 172.21.15.45:0/3711233013 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef00100370 0x7fef0019a0b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.653+0000 7fef04ef1640 1 -- 172.21.15.45:0/3711233013 >> 172.21.15.45:0/3711233013 conn(0x7fef000fc140 msgr2=0x7fef000fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:18.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.653+0000 7fef04ef1640 1 -- 172.21.15.45:0/3711233013 shutdown_connections 2024-09-15T22:16:18.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.653+0000 7fef04ef1640 1 -- 172.21.15.45:0/3711233013 wait complete. 2024-09-15T22:16:18.668 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T22:16:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.775+0000 7f03d5267640 1 -- 172.21.15.45:0/680844983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d01025c0 msgr2=0x7f03d0108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.775+0000 7f03d5267640 1 --2- 172.21.15.45:0/680844983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d01025c0 0x7f03d0108e50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009ca0 tx=0x7f03c802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.775+0000 7f03d5267640 1 -- 172.21.15.45:0/680844983 shutdown_connections 2024-09-15T22:16:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.775+0000 7f03d5267640 1 --2- 172.21.15.45:0/680844983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d01025c0 0x7f03d0108e50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.775+0000 7f03d5267640 1 --2- 172.21.15.45:0/680844983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03d0101c00 0x7f03d0102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.775+0000 7f03d5267640 1 --2- 172.21.15.45:0/680844983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03d0100a10 0x7f03d0100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.775+0000 7f03d5267640 1 -- 172.21.15.45:0/680844983 >> 172.21.15.45:0/680844983 conn(0x7f03d00fc190 msgr2=0x7f03d00fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:18.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.775+0000 7f03d5267640 1 -- 172.21.15.45:0/680844983 shutdown_connections 2024-09-15T22:16:18.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.775+0000 7f03d5267640 1 -- 172.21.15.45:0/680844983 wait complete. 2024-09-15T22:16:18.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.775+0000 7f03d5267640 1 Processor -- start 2024-09-15T22:16:18.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.775+0000 7f03d5267640 1 -- start start 2024-09-15T22:16:18.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03d5267640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03d0100a10 0x7f03d0197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:18.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03d5267640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03d0101c00 0x7f03d0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03d5267640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d01025c0 0x7f03d019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03d5267640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f03d010c840 con 0x7f03d01025c0 2024-09-15T22:16:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03d5267640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f03d010c6c0 con 0x7f03d0100a10 2024-09-15T22:16:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03d5267640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f03d010c9c0 con 0x7f03d0101c00 2024-09-15T22:16:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03cf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d01025c0 0x7f03d019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03cf7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d01025c0 0x7f03d019f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51996/0 (socket says 172.21.15.45:51996) 2024-09-15T22:16:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03ceffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03d0100a10 0x7f03d0197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03cf7fe640 1 -- 172.21.15.45:0/2552356695 learned_addr learned my addr 172.21.15.45:0/2552356695 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03ce7fc640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03d0101c00 0x7f03d0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03ceffd640 1 -- 172.21.15.45:0/2552356695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03d0101c00 msgr2=0x7f03d0198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03ceffd640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03d0101c00 0x7f03d0198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03ceffd640 1 -- 172.21.15.45:0/2552356695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d01025c0 msgr2=0x7f03d019f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03ceffd640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d01025c0 0x7f03d019f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03ceffd640 1 -- 172.21.15.45:0/2552356695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d019fae0 con 0x7f03d0100a10 2024-09-15T22:16:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03cf7fe640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d01025c0 0x7f03d019f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.776+0000 7f03ceffd640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03d0100a10 0x7f03d0197ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f03c000e9c0 tx=0x7f03c000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.777+0000 7f03b7fff640 1 -- 172.21.15.45:0/2552356695 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c000ccc0 con 0x7f03d0100a10 2024-09-15T22:16:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.777+0000 7f03b7fff640 1 -- 172.21.15.45:0/2552356695 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f03c00035f0 con 0x7f03d0100a10 2024-09-15T22:16:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.777+0000 7f03d5267640 1 -- 172.21.15.45:0/2552356695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d019fdd0 con 0x7f03d0100a10 2024-09-15T22:16:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.777+0000 7f03b7fff640 1 -- 172.21.15.45:0/2552356695 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c000ce60 con 0x7f03d0100a10 2024-09-15T22:16:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.777+0000 7f03d5267640 1 -- 172.21.15.45:0/2552356695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d01a0290 con 0x7f03d0100a10 2024-09-15T22:16:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.777+0000 7f03d5267640 1 -- 172.21.15.45:0/2552356695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d01a0550 con 0x7f03d0100a10 2024-09-15T22:16:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.779+0000 7f03b7fff640 1 -- 172.21.15.45:0/2552356695 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f03c00037a0 con 0x7f03d0100a10 2024-09-15T22:16:18.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.780+0000 7f03b7fff640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f03b80a30d0 0x7f03b80a5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:18.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.780+0000 7f03ce7fc640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f03b80a30d0 0x7f03b80a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:18.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.780+0000 7f03b7fff640 1 -- 172.21.15.45:0/2552356695 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f03c00cff10 con 0x7f03d0100a10 2024-09-15T22:16:18.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.780+0000 7f03ce7fc640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f03b80a30d0 0x7f03b80a5590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f03d01993d0 tx=0x7f03c400b590 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:18.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.783+0000 7f03b7fff640 1 -- 172.21.15.45:0/2552356695 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f03c009cae0 con 0x7f03d0100a10 2024-09-15T22:16:18.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.959+0000 7f03d5267640 1 -- 172.21.15.45:0/2552356695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f03d01a0720 con 0x7f03d0100a10 2024-09-15T22:16:18.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.960+0000 7f03b7fff640 1 -- 172.21.15.45:0/2552356695 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f03c009c3e0 con 0x7f03d0100a10 2024-09-15T22:16:18.962 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-09-15T22:16:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.963+0000 7f03d5267640 1 -- 172.21.15.45:0/2552356695 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f03b80a30d0 msgr2=0x7f03b80a5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.963+0000 7f03d5267640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f03b80a30d0 0x7f03b80a5590 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f03d01993d0 tx=0x7f03c400b590 comp rx=0 tx=0).stop 2024-09-15T22:16:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.964+0000 7f03d5267640 1 -- 172.21.15.45:0/2552356695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03d0100a10 msgr2=0x7f03d0197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.964+0000 7f03d5267640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03d0100a10 0x7f03d0197ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f03c000e9c0 tx=0x7f03c000ee80 comp rx=0 tx=0).stop 2024-09-15T22:16:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.964+0000 7f03d5267640 1 -- 172.21.15.45:0/2552356695 shutdown_connections 2024-09-15T22:16:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.964+0000 7f03d5267640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f03b80a30d0 0x7f03b80a5590 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.964+0000 7f03d5267640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03d01025c0 0x7f03d019f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.964+0000 7f03d5267640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f03d0101c00 0x7f03d0198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.964+0000 7f03d5267640 1 --2- 172.21.15.45:0/2552356695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03d0100a10 0x7f03d0197ec0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.964+0000 7f03d5267640 1 -- 172.21.15.45:0/2552356695 >> 172.21.15.45:0/2552356695 conn(0x7f03d00fc190 msgr2=0x7f03d00fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.964+0000 7f03d5267640 1 -- 172.21.15.45:0/2552356695 shutdown_connections 2024-09-15T22:16:18.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:18.964+0000 7f03d5267640 1 -- 172.21.15.45:0/2552356695 wait complete. 2024-09-15T22:16:18.980 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T22:16:19.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.087+0000 7f31c7c53640 1 -- 172.21.15.45:0/3505631348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c0102d20 msgr2=0x7f31c01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:19.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.087+0000 7f31c7c53640 1 --2- 172.21.15.45:0/3505631348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c0102d20 0x7f31c01031a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009900 tx=0x7f31b402a410 comp rx=0 tx=0).stop 2024-09-15T22:16:19.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.087+0000 7f31c7c53640 1 -- 172.21.15.45:0/3505631348 shutdown_connections 2024-09-15T22:16:19.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.087+0000 7f31c7c53640 1 --2- 172.21.15.45:0/3505631348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31c01036e0 0x7f31c0109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.087+0000 7f31c7c53640 1 --2- 172.21.15.45:0/3505631348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c0102d20 0x7f31c01031a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.087+0000 7f31c7c53640 1 --2- 172.21.15.45:0/3505631348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31c0101b30 0x7f31c0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.087+0000 7f31c7c53640 1 -- 172.21.15.45:0/3505631348 >> 172.21.15.45:0/3505631348 conn(0x7f31c00fd2b0 msgr2=0x7f31c00ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:19.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.087+0000 7f31c7c53640 1 -- 172.21.15.45:0/3505631348 shutdown_connections 2024-09-15T22:16:19.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.087+0000 7f31c7c53640 1 -- 172.21.15.45:0/3505631348 wait complete. 2024-09-15T22:16:19.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.087+0000 7f31c7c53640 1 Processor -- start 2024-09-15T22:16:19.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c7c53640 1 -- start start 2024-09-15T22:16:19.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c7c53640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31c0101b30 0x7f31c0075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:19.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c7c53640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c0102d20 0x7f31c00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:19.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c7c53640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31c01036e0 0x7f31c0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:19.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c7c53640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f31c010d910 con 0x7f31c0102d20 2024-09-15T22:16:19.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c7c53640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f31c010d790 con 0x7f31c0101b30 2024-09-15T22:16:19.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c7c53640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f31c010da90 con 0x7f31c01036e0 2024-09-15T22:16:19.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c51ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c0102d20 0x7f31c00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:19.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c51ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c0102d20 0x7f31c00745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52020/0 (socket says 172.21.15.45:52020) 2024-09-15T22:16:19.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c51ee640 1 -- 172.21.15.45:0/1961321293 learned_addr learned my addr 172.21.15.45:0/1961321293 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:19.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c59ef640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31c0101b30 0x7f31c0075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:19.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c61f0640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31c01036e0 0x7f31c0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:19.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c51ee640 1 -- 172.21.15.45:0/1961321293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31c01036e0 msgr2=0x7f31c0074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:19.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c51ee640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31c01036e0 0x7f31c0074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c51ee640 1 -- 172.21.15.45:0/1961321293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31c0101b30 msgr2=0x7f31c0075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:19.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c51ee640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31c0101b30 0x7f31c0075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c51ee640 1 -- 172.21.15.45:0/1961321293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c00753b0 con 0x7f31c0102d20 2024-09-15T22:16:19.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31c51ee640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c0102d20 0x7f31c00745e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009a20 tx=0x7f31b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:19.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.088+0000 7f31beffd640 1 -- 172.21.15.45:0/1961321293 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b403f030 con 0x7f31c0102d20 2024-09-15T22:16:19.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.089+0000 7f31beffd640 1 -- 172.21.15.45:0/1961321293 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f31b4003d00 con 0x7f31c0102d20 2024-09-15T22:16:19.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.089+0000 7f31c7c53640 1 -- 172.21.15.45:0/1961321293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c01a2010 con 0x7f31c0102d20 2024-09-15T22:16:19.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.089+0000 7f31beffd640 1 -- 172.21.15.45:0/1961321293 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b4035070 con 0x7f31c0102d20 2024-09-15T22:16:19.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.089+0000 7f31c7c53640 1 -- 172.21.15.45:0/1961321293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c01a25b0 con 0x7f31c0102d20 2024-09-15T22:16:19.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.090+0000 7f31c7c53640 1 -- 172.21.15.45:0/1961321293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c0108f90 con 0x7f31c0102d20 2024-09-15T22:16:19.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.091+0000 7f31beffd640 1 -- 172.21.15.45:0/1961321293 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f31b4042030 con 0x7f31c0102d20 2024-09-15T22:16:19.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.092+0000 7f31beffd640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f31a80a30d0 0x7f31a80a5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:19.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.092+0000 7f31c59ef640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f31a80a30d0 0x7f31a80a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:19.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.092+0000 7f31beffd640 1 -- 172.21.15.45:0/1961321293 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f31b40f0310 con 0x7f31c0102d20 2024-09-15T22:16:19.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.092+0000 7f31c59ef640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f31a80a30d0 0x7f31a80a5590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f31c0102b80 tx=0x7f31b0009500 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:19.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.095+0000 7f31beffd640 1 -- 172.21.15.45:0/1961321293 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f31b40bce50 con 0x7f31c0102d20 2024-09-15T22:16:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.275+0000 7f31c7c53640 1 -- 172.21.15.45:0/1961321293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f31c002da10 con 0x7f31c0102d20 2024-09-15T22:16:19.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.275+0000 7f31beffd640 1 -- 172.21.15.45:0/1961321293 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f31b40bc750 con 0x7f31c0102d20 2024-09-15T22:16:19.277 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-09-15T22:16:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.277+0000 7f31c7c53640 1 -- 172.21.15.45:0/1961321293 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f31a80a30d0 msgr2=0x7f31a80a5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.277+0000 7f31c7c53640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f31a80a30d0 0x7f31a80a5590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f31c0102b80 tx=0x7f31b0009500 comp rx=0 tx=0).stop 2024-09-15T22:16:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.277+0000 7f31c7c53640 1 -- 172.21.15.45:0/1961321293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c0102d20 msgr2=0x7f31c00745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:19.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.277+0000 7f31c7c53640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c0102d20 0x7f31c00745e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009a20 tx=0x7f31b40042f0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.277+0000 7f31c7c53640 1 -- 172.21.15.45:0/1961321293 shutdown_connections 2024-09-15T22:16:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.277+0000 7f31c7c53640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f31a80a30d0 0x7f31a80a5590 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.277+0000 7f31c7c53640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f31c01036e0 0x7f31c0074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.277+0000 7f31c7c53640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31c0102d20 0x7f31c00745e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.277+0000 7f31c7c53640 1 --2- 172.21.15.45:0/1961321293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31c0101b30 0x7f31c0075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.277+0000 7f31c7c53640 1 -- 172.21.15.45:0/1961321293 >> 172.21.15.45:0/1961321293 conn(0x7f31c00fd2b0 msgr2=0x7f31c0106160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.277+0000 7f31c7c53640 1 -- 172.21.15.45:0/1961321293 shutdown_connections 2024-09-15T22:16:19.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.277+0000 7f31c7c53640 1 -- 172.21.15.45:0/1961321293 wait complete. 2024-09-15T22:16:19.289 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:19 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3391965081' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:16:19.289 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:19 smithi045 ceph-mon[31180]: mgrmap e21: x(active, since 1.02882s), standbys: z, y 2024-09-15T22:16:19.289 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:19 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3711233013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:16:19.289 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:19 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2552356695' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:16:19.290 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-15T22:16:19.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.410+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/369198324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b5810e0d0 msgr2=0x7f9b58114980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:19.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.410+0000 7f9b5d3fd640 1 --2- 172.21.15.45:0/369198324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b5810e0d0 0x7f9b58114980 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009ca0 tx=0x7f9b5002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.410+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/369198324 shutdown_connections 2024-09-15T22:16:19.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.410+0000 7f9b5d3fd640 1 --2- 172.21.15.45:0/369198324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b5810e0d0 0x7f9b58114980 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.410+0000 7f9b5d3fd640 1 --2- 172.21.15.45:0/369198324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b5810d730 0x7f9b5810db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.410+0000 7f9b5d3fd640 1 --2- 172.21.15.45:0/369198324 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b5810c5b0 0x7f9b5810c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.410+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/369198324 >> 172.21.15.45:0/369198324 conn(0x7f9b5806c260 msgr2=0x7f9b5806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:19.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.410+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/369198324 shutdown_connections 2024-09-15T22:16:19.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.410+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/369198324 wait complete. 2024-09-15T22:16:19.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.411+0000 7f9b5d3fd640 1 Processor -- start 2024-09-15T22:16:19.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.411+0000 7f9b5d3fd640 1 -- start start 2024-09-15T22:16:19.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.411+0000 7f9b5d3fd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b5810c5b0 0x7f9b581a28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.411+0000 7f9b5d3fd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b5810d730 0x7f9b581a2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.411+0000 7f9b5d3fd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b5810e0d0 0x7f9b581a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.411+0000 7f9b5d3fd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9b581182d0 con 0x7f9b5810c5b0 2024-09-15T22:16:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.411+0000 7f9b5d3fd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9b58118150 con 0x7f9b5810d730 2024-09-15T22:16:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.411+0000 7f9b5d3fd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9b58118450 con 0x7f9b5810e0d0 2024-09-15T22:16:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.411+0000 7f9b56ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b5810c5b0 0x7f9b581a28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.411+0000 7f9b56ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b5810c5b0 0x7f9b581a28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52028/0 (socket says 172.21.15.45:52028) 2024-09-15T22:16:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.411+0000 7f9b56ffd640 1 -- 172.21.15.45:0/2155715055 learned_addr learned my addr 172.21.15.45:0/2155715055 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.411+0000 7f9b4ffff640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b5810d730 0x7f9b581a2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.411+0000 7f9b577fe640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b5810e0d0 0x7f9b581a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.412+0000 7f9b56ffd640 1 -- 172.21.15.45:0/2155715055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b5810e0d0 msgr2=0x7f9b581a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.412+0000 7f9b56ffd640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b5810e0d0 0x7f9b581a9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.412+0000 7f9b56ffd640 1 -- 172.21.15.45:0/2155715055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b5810d730 msgr2=0x7f9b581a2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.412+0000 7f9b56ffd640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b5810d730 0x7f9b581a2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.412+0000 7f9b56ffd640 1 -- 172.21.15.45:0/2155715055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b581aa500 con 0x7f9b5810c5b0 2024-09-15T22:16:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.412+0000 7f9b4ffff640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b5810d730 0x7f9b581a2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.412+0000 7f9b56ffd640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b5810c5b0 0x7f9b581a28e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800e970 tx=0x7f9b4800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.412+0000 7f9b54ff9640 1 -- 172.21.15.45:0/2155715055 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4800ccc0 con 0x7f9b5810c5b0 2024-09-15T22:16:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.412+0000 7f9b54ff9640 1 -- 172.21.15.45:0/2155715055 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9b48010930 con 0x7f9b5810c5b0 2024-09-15T22:16:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.412+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/2155715055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b581aa7f0 con 0x7f9b5810c5b0 2024-09-15T22:16:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.412+0000 7f9b54ff9640 1 -- 172.21.15.45:0/2155715055 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b480189c0 con 0x7f9b5810c5b0 2024-09-15T22:16:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.412+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/2155715055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b581aad40 con 0x7f9b5810c5b0 2024-09-15T22:16:19.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.414+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/2155715055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b58113900 con 0x7f9b5810c5b0 2024-09-15T22:16:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.416+0000 7f9b54ff9640 1 -- 172.21.15.45:0/2155715055 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f9b48010ae0 con 0x7f9b5810c5b0 2024-09-15T22:16:19.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.416+0000 7f9b54ff9640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9b440a3090 0x7f9b440a5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:19.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.416+0000 7f9b54ff9640 1 -- 172.21.15.45:0/2155715055 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f9b480cfcf0 con 0x7f9b5810c5b0 2024-09-15T22:16:19.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.417+0000 7f9b4ffff640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9b440a3090 0x7f9b440a5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:19.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.417+0000 7f9b4ffff640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9b440a3090 0x7f9b440a5550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9b581a3df0 tx=0x7f9b40005f90 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:19.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.421+0000 7f9b54ff9640 1 -- 172.21.15.45:0/2155715055 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9b4809c220 con 0x7f9b5810c5b0 2024-09-15T22:16:19.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:19 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3391965081' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:16:19.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:19 smithi165 ceph-mon[35551]: mgrmap e21: x(active, since 1.02882s), standbys: z, y 2024-09-15T22:16:19.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:19 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3711233013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:16:19.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:19 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2552356695' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:16:19.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:19 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3391965081' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:16:19.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:19 smithi100 ceph-mon[35319]: mgrmap e21: x(active, since 1.02882s), standbys: z, y 2024-09-15T22:16:19.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:19 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3711233013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:16:19.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:19 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2552356695' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:16:19.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.659+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/2155715055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9b58062df0 con 0x7f9b5810c5b0 2024-09-15T22:16:19.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.660+0000 7f9b54ff9640 1 -- 172.21.15.45:0/2155715055 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7f9b480a0520 con 0x7f9b5810c5b0 2024-09-15T22:16:19.662 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-09-15T22:16:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.663+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/2155715055 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9b440a3090 msgr2=0x7f9b440a5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.663+0000 7f9b5d3fd640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9b440a3090 0x7f9b440a5550 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9b581a3df0 tx=0x7f9b40005f90 comp rx=0 tx=0).stop 2024-09-15T22:16:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.663+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/2155715055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b5810c5b0 msgr2=0x7f9b581a28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.663+0000 7f9b5d3fd640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b5810c5b0 0x7f9b581a28e0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9b4800e970 tx=0x7f9b4800ee30 comp rx=0 tx=0).stop 2024-09-15T22:16:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.663+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/2155715055 shutdown_connections 2024-09-15T22:16:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.663+0000 7f9b5d3fd640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9b440a3090 0x7f9b440a5550 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.663+0000 7f9b5d3fd640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9b5810e0d0 0x7f9b581a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.663+0000 7f9b5d3fd640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b5810d730 0x7f9b581a2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.663+0000 7f9b5d3fd640 1 --2- 172.21.15.45:0/2155715055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b5810c5b0 0x7f9b581a28e0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.663+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/2155715055 >> 172.21.15.45:0/2155715055 conn(0x7f9b5806c260 msgr2=0x7f9b58110ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.663+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/2155715055 shutdown_connections 2024-09-15T22:16:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:19.663+0000 7f9b5d3fd640 1 -- 172.21.15.45:0/2155715055 wait complete. 2024-09-15T22:16:19.678 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-15T22:16:19.678 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:16:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:20.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-mon[31180]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:16:20.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1961321293' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:16:20.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2155715055' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T22:16:20.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.301 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:20.028+0000 7fcffa40c640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:22:16:20] ENGINE Error in HTTPServer.serve 2024-09-15T22:16:20.301 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: Traceback (most recent call last): 2024-09-15T22:16:20.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:16:20.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: self._connections.run(self.expiration_interval) 2024-09-15T22:16:20.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:16:20.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: self._run(expiration_interval) 2024-09-15T22:16:20.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:16:20.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:16:20.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:16:20.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:16:20.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:16:20.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: s = self.context.wrap_socket( 2024-09-15T22:16:20.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:16:20.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: return self.sslsocket_class._create( 2024-09-15T22:16:20.302 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:16:20.303 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: self.do_handshake() 2024-09-15T22:16:20.303 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:16:20.303 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: self._sslobj.do_handshake() 2024-09-15T22:16:20.303 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:16:20.303 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:16:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:16:20.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:20 smithi165 ceph-mon[35551]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:16:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:20 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1961321293' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:16:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:20 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:20 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:20 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2155715055' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T22:16:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:20 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:20 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:20 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:20 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:20 smithi100 ceph-mon[35319]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:16:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:20 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1961321293' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:16:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:20 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:20 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:20 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2155715055' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T22:16:20.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:20 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:20 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:20 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:20 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.499+0000 7fa49bf62640 1 -- 172.21.15.45:0/2560528845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494102d30 msgr2=0x7fa494103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.499+0000 7fa49bf62640 1 --2- 172.21.15.45:0/2560528845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494102d30 0x7fa494103110 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa490009930 tx=0x7fa49002a420 comp rx=0 tx=0).stop 2024-09-15T22:16:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.499+0000 7fa49bf62640 1 -- 172.21.15.45:0/2560528845 shutdown_connections 2024-09-15T22:16:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.499+0000 7fa49bf62640 1 --2- 172.21.15.45:0/2560528845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa4941082a0 0x7fa49410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.499+0000 7fa49bf62640 1 --2- 172.21.15.45:0/2560528845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4941036e0 0x7fa494107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.499+0000 7fa49bf62640 1 --2- 172.21.15.45:0/2560528845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa494102d30 0x7fa494103110 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.499+0000 7fa49bf62640 1 -- 172.21.15.45:0/2560528845 >> 172.21.15.45:0/2560528845 conn(0x7fa4940fc7d0 msgr2=0x7fa4940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:20.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.499+0000 7fa49bf62640 1 -- 172.21.15.45:0/2560528845 shutdown_connections 2024-09-15T22:16:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.499+0000 7fa49bf62640 1 -- 172.21.15.45:0/2560528845 wait complete. 2024-09-15T22:16:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.499+0000 7fa49bf62640 1 Processor -- start 2024-09-15T22:16:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.499+0000 7fa49bf62640 1 -- start start 2024-09-15T22:16:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa49bf62640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa494102d30 0x7fa494100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa49bf62640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4941036e0 0x7fa494100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa49bf62640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4941082a0 0x7fa494101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa49bf62640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa4941121c0 con 0x7fa4941036e0 2024-09-15T22:16:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa49bf62640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa494112040 con 0x7fa4941082a0 2024-09-15T22:16:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa49bf62640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa494112340 con 0x7fa494102d30 2024-09-15T22:16:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa4994fd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4941036e0 0x7fa494100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa4994fd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4941036e0 0x7fa494100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52070/0 (socket says 172.21.15.45:52070) 2024-09-15T22:16:20.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa4994fd640 1 -- 172.21.15.45:0/3445085074 learned_addr learned my addr 172.21.15.45:0/3445085074 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa499cfe640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa494102d30 0x7fa494100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa49a4ff640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4941082a0 0x7fa494101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa4994fd640 1 -- 172.21.15.45:0/3445085074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa494102d30 msgr2=0x7fa494100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa4994fd640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa494102d30 0x7fa494100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa4994fd640 1 -- 172.21.15.45:0/3445085074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4941082a0 msgr2=0x7fa494101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa4994fd640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4941082a0 0x7fa494101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa4994fd640 1 -- 172.21.15.45:0/3445085074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4941a6b40 con 0x7fa4941036e0 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa499cfe640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa494102d30 0x7fa494100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.500+0000 7fa4994fd640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4941036e0 0x7fa494100ed0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa48400d740 tx=0x7fa48400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.501+0000 7fa48affd640 1 -- 172.21.15.45:0/3445085074 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484017070 con 0x7fa4941036e0 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.501+0000 7fa49bf62640 1 -- 172.21.15.45:0/3445085074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4941a6e30 con 0x7fa4941036e0 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.501+0000 7fa48affd640 1 -- 172.21.15.45:0/3445085074 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa48400de50 con 0x7fa4941036e0 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.501+0000 7fa48affd640 1 -- 172.21.15.45:0/3445085074 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48400f740 con 0x7fa4941036e0 2024-09-15T22:16:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.501+0000 7fa49bf62640 1 -- 172.21.15.45:0/3445085074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4941a72e0 con 0x7fa4941036e0 2024-09-15T22:16:20.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.502+0000 7fa49bf62640 1 -- 172.21.15.45:0/3445085074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa494103110 con 0x7fa4941036e0 2024-09-15T22:16:20.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.504+0000 7fa48affd640 1 -- 172.21.15.45:0/3445085074 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7fa48401a070 con 0x7fa4941036e0 2024-09-15T22:16:20.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.505+0000 7fa48affd640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa4800a3030 0x7fa4800a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:20.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.505+0000 7fa499cfe640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa4800a3030 0x7fa4800a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:20.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.505+0000 7fa48affd640 1 -- 172.21.15.45:0/3445085074 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fa4840cf2e0 con 0x7fa4941036e0 2024-09-15T22:16:20.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.505+0000 7fa499cfe640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa4800a3030 0x7fa4800a54f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa490009900 tx=0x7fa4900058d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:20.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.507+0000 7fa48affd640 1 -- 172.21.15.45:0/3445085074 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa48409b810 con 0x7fa4941036e0 2024-09-15T22:16:20.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.539+0000 7fa48affd640 1 -- 172.21.15.45:0/3445085074 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 22) ==== 138475+0+0 (secure 0 0 0) 0x7fa484097e80 con 0x7fa4941036e0 2024-09-15T22:16:20.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.733+0000 7fa49bf62640 1 -- 172.21.15.45:0/3445085074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa49410a2b0 con 0x7fa4941036e0 2024-09-15T22:16:20.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.734+0000 7fa48affd640 1 -- 172.21.15.45:0/3445085074 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fa484093ae0 con 0x7fa4941036e0 2024-09-15T22:16:20.737 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:20.737 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:16:20.737 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:16:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.737+0000 7fa49bf62640 1 -- 172.21.15.45:0/3445085074 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa4800a3030 msgr2=0x7fa4800a54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.737+0000 7fa49bf62640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa4800a3030 0x7fa4800a54f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa490009900 tx=0x7fa4900058d0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.737+0000 7fa49bf62640 1 -- 172.21.15.45:0/3445085074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4941036e0 msgr2=0x7fa494100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.737+0000 7fa49bf62640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4941036e0 0x7fa494100ed0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa48400d740 tx=0x7fa48400dc00 comp rx=0 tx=0).stop 2024-09-15T22:16:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.737+0000 7fa49bf62640 1 -- 172.21.15.45:0/3445085074 shutdown_connections 2024-09-15T22:16:20.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.737+0000 7fa49bf62640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa4800a3030 0x7fa4800a54f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.737+0000 7fa49bf62640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4941082a0 0x7fa494101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.737+0000 7fa49bf62640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4941036e0 0x7fa494100ed0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.737+0000 7fa49bf62640 1 --2- 172.21.15.45:0/3445085074 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa494102d30 0x7fa494100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:20.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.737+0000 7fa49bf62640 1 -- 172.21.15.45:0/3445085074 >> 172.21.15.45:0/3445085074 conn(0x7fa4940fc7d0 msgr2=0x7fa494105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:20.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.737+0000 7fa49bf62640 1 -- 172.21.15.45:0/3445085074 shutdown_connections 2024-09-15T22:16:20.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:20.737+0000 7fa49bf62640 1 -- 172.21.15.45:0/3445085074 wait complete. 2024-09-15T22:16:21.470 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: [15/Sep/2024:22:16:19] ENGINE Bus STARTING 2024-09-15T22:16:21.470 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: [15/Sep/2024:22:16:20] ENGINE Serving on https://172.21.15.45:7150 2024-09-15T22:16:21.470 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: [15/Sep/2024:22:16:20] ENGINE Error in HTTPServer.serve 2024-09-15T22:16:21.470 INFO:journalctl@ceph.mon.c.smithi165.stdout: Traceback (most recent call last): 2024-09-15T22:16:21.470 INFO:journalctl@ceph.mon.c.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:16:21.470 INFO:journalctl@ceph.mon.c.smithi165.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:16:21.470 INFO:journalctl@ceph.mon.c.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:16:21.470 INFO:journalctl@ceph.mon.c.smithi165.stdout: self._run(expiration_interval) 2024-09-15T22:16:21.470 INFO:journalctl@ceph.mon.c.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:16:21.470 INFO:journalctl@ceph.mon.c.smithi165.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout: s = self.context.wrap_socket( 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout: return self.sslsocket_class._create( 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout: self.do_handshake() 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout: self._sslobj.do_handshake() 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: [15/Sep/2024:22:16:20] ENGINE Serving on http://172.21.15.45:8765 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: [15/Sep/2024:22:16:20] ENGINE Bus STARTED 2024-09-15T22:16:21.471 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.472 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.472 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.472 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.472 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.472 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.472 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-15T22:16:21.472 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: Unable to set osd_memory_target on smithi100 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-15T22:16:21.472 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.472 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.472 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.472 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.472 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.472 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.473 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi165 to 176.0M 2024-09-15T22:16:21.473 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: Unable to set osd_memory_target on smithi165 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-15T22:16:21.473 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: mgrmap e22: x(active, since 3s), standbys: z, y 2024-09-15T22:16:21.473 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.473 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.473 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.473 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.473 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.473 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.473 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:21.473 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:21.473 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:21 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3445085074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:21.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: [15/Sep/2024:22:16:19] ENGINE Bus STARTING 2024-09-15T22:16:21.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: [15/Sep/2024:22:16:20] ENGINE Serving on https://172.21.15.45:7150 2024-09-15T22:16:21.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: [15/Sep/2024:22:16:20] ENGINE Error in HTTPServer.serve 2024-09-15T22:16:21.494 INFO:journalctl@ceph.mon.b.smithi100.stdout: Traceback (most recent call last): 2024-09-15T22:16:21.494 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:16:21.494 INFO:journalctl@ceph.mon.b.smithi100.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:16:21.495 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:16:21.495 INFO:journalctl@ceph.mon.b.smithi100.stdout: self._run(expiration_interval) 2024-09-15T22:16:21.495 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:16:21.495 INFO:journalctl@ceph.mon.b.smithi100.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:16:21.495 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:16:21.495 INFO:journalctl@ceph.mon.b.smithi100.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:16:21.495 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:16:21.495 INFO:journalctl@ceph.mon.b.smithi100.stdout: s = self.context.wrap_socket( 2024-09-15T22:16:21.495 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:16:21.495 INFO:journalctl@ceph.mon.b.smithi100.stdout: return self.sslsocket_class._create( 2024-09-15T22:16:21.495 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:16:21.495 INFO:journalctl@ceph.mon.b.smithi100.stdout: self.do_handshake() 2024-09-15T22:16:21.495 INFO:journalctl@ceph.mon.b.smithi100.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:16:21.496 INFO:journalctl@ceph.mon.b.smithi100.stdout: self._sslobj.do_handshake() 2024-09-15T22:16:21.496 INFO:journalctl@ceph.mon.b.smithi100.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:16:21.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: [15/Sep/2024:22:16:20] ENGINE Serving on http://172.21.15.45:8765 2024-09-15T22:16:21.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: [15/Sep/2024:22:16:20] ENGINE Bus STARTED 2024-09-15T22:16:21.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-15T22:16:21.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: Unable to set osd_memory_target on smithi100 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-15T22:16:21.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi165 to 176.0M 2024-09-15T22:16:21.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: Unable to set osd_memory_target on smithi165 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-15T22:16:21.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: mgrmap e22: x(active, since 3s), standbys: z, y 2024-09-15T22:16:21.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:21.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:21.498 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:21 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3445085074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:21.504 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: [15/Sep/2024:22:16:19] ENGINE Bus STARTING 2024-09-15T22:16:21.504 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: [15/Sep/2024:22:16:20] ENGINE Serving on https://172.21.15.45:7150 2024-09-15T22:16:21.504 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: [15/Sep/2024:22:16:20] ENGINE Error in HTTPServer.serve 2024-09-15T22:16:21.504 INFO:journalctl@ceph.mon.a.smithi045.stdout: Traceback (most recent call last): 2024-09-15T22:16:21.504 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T22:16:21.504 INFO:journalctl@ceph.mon.a.smithi045.stdout: self._connections.run(self.expiration_interval) 2024-09-15T22:16:21.504 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T22:16:21.504 INFO:journalctl@ceph.mon.a.smithi045.stdout: self._run(expiration_interval) 2024-09-15T22:16:21.505 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T22:16:21.505 INFO:journalctl@ceph.mon.a.smithi045.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T22:16:21.505 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T22:16:21.505 INFO:journalctl@ceph.mon.a.smithi045.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T22:16:21.505 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T22:16:21.505 INFO:journalctl@ceph.mon.a.smithi045.stdout: s = self.context.wrap_socket( 2024-09-15T22:16:21.505 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T22:16:21.505 INFO:journalctl@ceph.mon.a.smithi045.stdout: return self.sslsocket_class._create( 2024-09-15T22:16:21.505 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T22:16:21.505 INFO:journalctl@ceph.mon.a.smithi045.stdout: self.do_handshake() 2024-09-15T22:16:21.505 INFO:journalctl@ceph.mon.a.smithi045.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T22:16:21.505 INFO:journalctl@ceph.mon.a.smithi045.stdout: self._sslobj.do_handshake() 2024-09-15T22:16:21.505 INFO:journalctl@ceph.mon.a.smithi045.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T22:16:21.506 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: [15/Sep/2024:22:16:20] ENGINE Serving on http://172.21.15.45:8765 2024-09-15T22:16:21.506 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: [15/Sep/2024:22:16:20] ENGINE Bus STARTED 2024-09-15T22:16:21.506 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.506 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.506 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.506 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.506 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.506 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.506 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-15T22:16:21.506 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: Unable to set osd_memory_target on smithi100 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-15T22:16:21.506 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.506 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.506 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi165 to 176.0M 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: Unable to set osd_memory_target on smithi165 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: mgrmap e22: x(active, since 3s), standbys: z, y 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:21.507 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:21.508 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:21 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3445085074' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:21.537 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-15T22:16:21.537 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-15T22:16:21.537 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:16:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.663+0000 7f0a7be80640 1 -- 172.21.15.45:0/979649385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a74103fa0 msgr2=0x7f0a74104380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.663+0000 7f0a7be80640 1 --2- 172.21.15.45:0/979649385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a74103fa0 0x7f0a74104380 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009900 tx=0x7f0a7002a410 comp rx=0 tx=0).stop 2024-09-15T22:16:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.663+0000 7f0a7be80640 1 -- 172.21.15.45:0/979649385 shutdown_connections 2024-09-15T22:16:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.663+0000 7f0a7be80640 1 --2- 172.21.15.45:0/979649385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a741090f0 0x7f0a74110c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.663+0000 7f0a7be80640 1 --2- 172.21.15.45:0/979649385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a74104950 0x7f0a74108990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.663+0000 7f0a7be80640 1 --2- 172.21.15.45:0/979649385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a74103fa0 0x7f0a74104380 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.663+0000 7f0a7be80640 1 -- 172.21.15.45:0/979649385 >> 172.21.15.45:0/979649385 conn(0x7f0a740ffa50 msgr2=0x7f0a74101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.663+0000 7f0a7be80640 1 -- 172.21.15.45:0/979649385 shutdown_connections 2024-09-15T22:16:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.663+0000 7f0a7be80640 1 -- 172.21.15.45:0/979649385 wait complete. 2024-09-15T22:16:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.663+0000 7f0a7be80640 1 Processor -- start 2024-09-15T22:16:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.663+0000 7f0a7be80640 1 -- start start 2024-09-15T22:16:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a7be80640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a74103fa0 0x7f0a741a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a7be80640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a741090f0 0x7f0a741a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a7be80640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a7419a600 0x7f0a7419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a7be80640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74114270 con 0x7f0a74103fa0 2024-09-15T22:16:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a7be80640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0a741140f0 con 0x7f0a741090f0 2024-09-15T22:16:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a7be80640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0a741143f0 con 0x7f0a7419a600 2024-09-15T22:16:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a79c1c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a74103fa0 0x7f0a741a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a79c1c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a74103fa0 0x7f0a741a0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52100/0 (socket says 172.21.15.45:52100) 2024-09-15T22:16:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a79c1c640 1 -- 172.21.15.45:0/1315584222 learned_addr learned my addr 172.21.15.45:0/1315584222 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a7a41d640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a7419a600 0x7f0a7419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a7941b640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a741090f0 0x7f0a741a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a79c1c640 1 -- 172.21.15.45:0/1315584222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a7419a600 msgr2=0x7f0a7419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a79c1c640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a7419a600 0x7f0a7419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a79c1c640 1 -- 172.21.15.45:0/1315584222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a741090f0 msgr2=0x7f0a741a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a79c1c640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a741090f0 0x7f0a741a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a79c1c640 1 -- 172.21.15.45:0/1315584222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7419b120 con 0x7f0a74103fa0 2024-09-15T22:16:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a79c1c640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a74103fa0 0x7f0a741a0450 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0a70006010 tx=0x7f0a700040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.664+0000 7f0a6affd640 1 -- 172.21.15.45:0/1315584222 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7003f030 con 0x7f0a74103fa0 2024-09-15T22:16:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.665+0000 7f0a6affd640 1 -- 172.21.15.45:0/1315584222 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0a700044c0 con 0x7f0a74103fa0 2024-09-15T22:16:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.665+0000 7f0a7be80640 1 -- 172.21.15.45:0/1315584222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7419b3b0 con 0x7f0a74103fa0 2024-09-15T22:16:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.665+0000 7f0a6affd640 1 -- 172.21.15.45:0/1315584222 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70035070 con 0x7f0a74103fa0 2024-09-15T22:16:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.665+0000 7f0a7be80640 1 -- 172.21.15.45:0/1315584222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a741a7600 con 0x7f0a74103fa0 2024-09-15T22:16:21.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.666+0000 7f0a7be80640 1 -- 172.21.15.45:0/1315584222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a74104380 con 0x7f0a74103fa0 2024-09-15T22:16:21.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.667+0000 7f0a6affd640 1 -- 172.21.15.45:0/1315584222 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 22) ==== 138475+0+0 (secure 0 0 0) 0x7f0a70042030 con 0x7f0a74103fa0 2024-09-15T22:16:21.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.668+0000 7f0a6affd640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f0a600a3440 0x7f0a600a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:21.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.668+0000 7f0a7941b640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f0a600a3440 0x7f0a600a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:21.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.668+0000 7f0a6affd640 1 -- 172.21.15.45:0/1315584222 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f0a700f02a0 con 0x7f0a74103fa0 2024-09-15T22:16:21.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.668+0000 7f0a7941b640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f0a600a3440 0x7f0a600a5900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a740ffe90 tx=0x7f0a64005f90 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:21.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.672+0000 7f0a6affd640 1 -- 172.21.15.45:0/1315584222 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0a700bc2c0 con 0x7f0a74103fa0 2024-09-15T22:16:21.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.854+0000 7f0a7be80640 1 -- 172.21.15.45:0/1315584222 --> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a7410c310 con 0x7f0a600a3440 2024-09-15T22:16:21.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.864+0000 7f0a6affd640 1 -- 172.21.15.45:0/1315584222 <== mgr.15165 v2:172.21.15.45:6800/553298159 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339444 (secure 0 0 0) 0x7f0a6401b3f0 con 0x7f0a600a3440 2024-09-15T22:16:21.870 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:21.872 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-09-15T22:16:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.867+0000 7f0a7be80640 1 -- 172.21.15.45:0/1315584222 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f0a600a3440 msgr2=0x7f0a600a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.867+0000 7f0a7be80640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f0a600a3440 0x7f0a600a5900 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0a740ffe90 tx=0x7f0a64005f90 comp rx=0 tx=0).stop 2024-09-15T22:16:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.867+0000 7f0a7be80640 1 -- 172.21.15.45:0/1315584222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a74103fa0 msgr2=0x7f0a741a0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.867+0000 7f0a7be80640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a74103fa0 0x7f0a741a0450 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0a70006010 tx=0x7f0a700040c0 comp rx=0 tx=0).stop 2024-09-15T22:16:21.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.867+0000 7f0a7be80640 1 -- 172.21.15.45:0/1315584222 shutdown_connections 2024-09-15T22:16:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.867+0000 7f0a7be80640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f0a600a3440 0x7f0a600a5900 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.867+0000 7f0a7be80640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0a7419a600 0x7f0a7419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.867+0000 7f0a7be80640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a741090f0 0x7f0a741a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.867+0000 7f0a7be80640 1 --2- 172.21.15.45:0/1315584222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a74103fa0 0x7f0a741a0450 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.867+0000 7f0a7be80640 1 -- 172.21.15.45:0/1315584222 >> 172.21.15.45:0/1315584222 conn(0x7f0a740ffa50 msgr2=0x7f0a74100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.867+0000 7f0a7be80640 1 -- 172.21.15.45:0/1315584222 shutdown_connections 2024-09-15T22:16:21.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:21.868+0000 7f0a7be80640 1 -- 172.21.15.45:0/1315584222 wait complete. 2024-09-15T22:16:21.881 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-15T22:16:21.555256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188063,"num_objects":28,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":434,"num_read_kb":375,"num_write":389,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":792,"ondisk_log_size":792,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":415064,"kb_used_data":15620,"kb_used_omap":18,"kb_used_meta":398957,"kb_avail":1124526760,"statfs":{"total":1151940427776,"available":1151515402240,"internally_reserved":0,"allocated":15994880,"data_stored":9678965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":408532281},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.985700"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557493+0000","last_change":"2024-09-15T22:14:04.718966+0000","last_active":"2024-09-15T22:16:17.557493+0000","last_peered":"2024-09-15T22:16:17.557493+0000","last_clean":"2024-09-15T22:16:17.557493+0000","last_became_active":"2024-09-15T22:14:04.718743+0000","last_became_peered":"2024-09-15T22:14:04.718743+0000","last_unstale":"2024-09-15T22:16:17.557493+0000","last_undegraded":"2024-09-15T22:16:17.557493+0000","last_fullsized":"2024-09-15T22:16:17.557493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:24:01.767801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604829+0000","last_change":"2024-09-15T22:14:06.814802+0000","last_active":"2024-09-15T22:16:17.604829+0000","last_peered":"2024-09-15T22:16:17.604829+0000","last_clean":"2024-09-15T22:16:17.604829+0000","last_became_active":"2024-09-15T22:14:06.814495+0000","last_became_peered":"2024-09-15T22:14:06.814495+0000","last_unstale":"2024-09-15T22:16:17.604829+0000","last_undegraded":"2024-09-15T22:16:17.604829+0000","last_fullsized":"2024-09-15T22:16:17.604829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:45.384412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552197+0000","last_change":"2024-09-15T22:15:17.404082+0000","last_active":"2024-09-15T22:16:17.552197+0000","last_peered":"2024-09-15T22:16:17.552197+0000","last_clean":"2024-09-15T22:16:17.552197+0000","last_became_active":"2024-09-15T22:15:17.403590+0000","last_became_peered":"2024-09-15T22:15:17.403590+0000","last_unstale":"2024-09-15T22:16:17.552197+0000","last_undegraded":"2024-09-15T22:16:17.552197+0000","last_fullsized":"2024-09-15T22:16:17.552197+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:49.816560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.566735+0000","last_change":"2024-09-15T22:14:05.017101+0000","last_active":"2024-09-15T22:16:17.566735+0000","last_peered":"2024-09-15T22:16:17.566735+0000","last_clean":"2024-09-15T22:16:17.566735+0000","last_became_active":"2024-09-15T22:14:05.016748+0000","last_became_peered":"2024-09-15T22:14:05.016748+0000","last_unstale":"2024-09-15T22:16:17.566735+0000","last_undegraded":"2024-09-15T22:16:17.566735+0000","last_fullsized":"2024-09-15T22:16:17.566735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:11.211291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605811+0000","last_change":"2024-09-15T22:14:06.815112+0000","last_active":"2024-09-15T22:16:17.605811+0000","last_peered":"2024-09-15T22:16:17.605811+0000","last_clean":"2024-09-15T22:16:17.605811+0000","last_became_active":"2024-09-15T22:14:06.814556+0000","last_became_peered":"2024-09-15T22:14:06.814556+0000","last_unstale":"2024-09-15T22:16:17.605811+0000","last_undegraded":"2024-09-15T22:16:17.605811+0000","last_fullsized":"2024-09-15T22:16:17.605811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:24.733336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553827+0000","last_change":"2024-09-15T22:14:13.845829+0000","last_active":"2024-09-15T22:16:17.553827+0000","last_peered":"2024-09-15T22:16:17.553827+0000","last_clean":"2024-09-15T22:16:17.553827+0000","last_became_active":"2024-09-15T22:14:13.844958+0000","last_became_peered":"2024-09-15T22:14:13.844958+0000","last_unstale":"2024-09-15T22:16:17.553827+0000","last_undegraded":"2024-09-15T22:16:17.553827+0000","last_fullsized":"2024-09-15T22:16:17.553827+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:37.944143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555893+0000","last_change":"2024-09-15T22:14:04.720255+0000","last_active":"2024-09-15T22:16:17.555893+0000","last_peered":"2024-09-15T22:16:17.555893+0000","last_clean":"2024-09-15T22:16:17.555893+0000","last_became_active":"2024-09-15T22:14:04.719907+0000","last_became_peered":"2024-09-15T22:14:04.719907+0000","last_unstale":"2024-09-15T22:16:17.555893+0000","last_undegraded":"2024-09-15T22:16:17.555893+0000","last_fullsized":"2024-09-15T22:16:17.555893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:12.510139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.591919+0000","last_change":"2024-09-15T22:14:06.808322+0000","last_active":"2024-09-15T22:16:17.591919+0000","last_peered":"2024-09-15T22:16:17.591919+0000","last_clean":"2024-09-15T22:16:17.591919+0000","last_became_active":"2024-09-15T22:14:06.807398+0000","last_became_peered":"2024-09-15T22:14:06.807398+0000","last_unstale":"2024-09-15T22:16:17.591919+0000","last_undegraded":"2024-09-15T22:16:17.591919+0000","last_fullsized":"2024-09-15T22:16:17.591919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:11.677800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554758+0000","last_change":"2024-09-15T22:14:13.849713+0000","last_active":"2024-09-15T22:16:17.554758+0000","last_peered":"2024-09-15T22:16:17.554758+0000","last_clean":"2024-09-15T22:16:17.554758+0000","last_became_active":"2024-09-15T22:14:13.849311+0000","last_became_peered":"2024-09-15T22:14:13.849311+0000","last_unstale":"2024-09-15T22:16:17.554758+0000","last_undegraded":"2024-09-15T22:16:17.554758+0000","last_fullsized":"2024-09-15T22:16:17.554758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:17.782013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554654+0000","last_change":"2024-09-15T22:14:04.721694+0000","last_active":"2024-09-15T22:16:17.554654+0000","last_peered":"2024-09-15T22:16:17.554654+0000","last_clean":"2024-09-15T22:16:17.554654+0000","last_became_active":"2024-09-15T22:14:04.721321+0000","last_became_peered":"2024-09-15T22:14:04.721321+0000","last_unstale":"2024-09-15T22:16:17.554654+0000","last_undegraded":"2024-09-15T22:16:17.554654+0000","last_fullsized":"2024-09-15T22:16:17.554654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:47.817565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.586446+0000","last_change":"2024-09-15T22:14:06.809564+0000","last_active":"2024-09-15T22:16:17.586446+0000","last_peered":"2024-09-15T22:16:17.586446+0000","last_clean":"2024-09-15T22:16:17.586446+0000","last_became_active":"2024-09-15T22:14:06.809102+0000","last_became_peered":"2024-09-15T22:14:06.809102+0000","last_unstale":"2024-09-15T22:16:17.586446+0000","last_undegraded":"2024-09-15T22:16:17.586446+0000","last_fullsized":"2024-09-15T22:16:17.586446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:55.306791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554499+0000","last_change":"2024-09-15T22:14:13.849839+0000","last_active":"2024-09-15T22:16:17.554499+0000","last_peered":"2024-09-15T22:16:17.554499+0000","last_clean":"2024-09-15T22:16:17.554499+0000","last_became_active":"2024-09-15T22:14:13.849415+0000","last_became_peered":"2024-09-15T22:14:13.849415+0000","last_unstale":"2024-09-15T22:16:17.554499+0000","last_undegraded":"2024-09-15T22:16:17.554499+0000","last_fullsized":"2024-09-15T22:16:17.554499+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:20.336406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601259+0000","last_change":"2024-09-15T22:14:06.815506+0000","last_active":"2024-09-15T22:16:17.601259+0000","last_peered":"2024-09-15T22:16:17.601259+0000","last_clean":"2024-09-15T22:16:17.601259+0000","last_became_active":"2024-09-15T22:14:06.815066+0000","last_became_peered":"2024-09-15T22:14:06.815066+0000","last_unstale":"2024-09-15T22:16:17.601259+0000","last_undegraded":"2024-09-15T22:16:17.601259+0000","last_fullsized":"2024-09-15T22:16:17.601259+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:42.182268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555136+0000","last_change":"2024-09-15T22:14:04.721403+0000","last_active":"2024-09-15T22:16:17.555136+0000","last_peered":"2024-09-15T22:16:17.555136+0000","last_clean":"2024-09-15T22:16:17.555136+0000","last_became_active":"2024-09-15T22:14:04.721049+0000","last_became_peered":"2024-09-15T22:14:04.721049+0000","last_unstale":"2024-09-15T22:16:17.555136+0000","last_undegraded":"2024-09-15T22:16:17.555136+0000","last_fullsized":"2024-09-15T22:16:17.555136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:39.860926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.561252+0000","last_change":"2024-09-15T22:14:14.280656+0000","last_active":"2024-09-15T22:16:17.561252+0000","last_peered":"2024-09-15T22:16:17.561252+0000","last_clean":"2024-09-15T22:16:17.561252+0000","last_became_active":"2024-09-15T22:14:14.280230+0000","last_became_peered":"2024-09-15T22:14:14.280230+0000","last_unstale":"2024-09-15T22:16:17.561252+0000","last_undegraded":"2024-09-15T22:16:17.561252+0000","last_fullsized":"2024-09-15T22:16:17.561252+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:47.531799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603939+0000","last_change":"2024-09-15T22:14:06.805575+0000","last_active":"2024-09-15T22:16:17.603939+0000","last_peered":"2024-09-15T22:16:17.603939+0000","last_clean":"2024-09-15T22:16:17.603939+0000","last_became_active":"2024-09-15T22:14:06.804515+0000","last_became_peered":"2024-09-15T22:14:06.804515+0000","last_unstale":"2024-09-15T22:16:17.603939+0000","last_undegraded":"2024-09-15T22:16:17.603939+0000","last_fullsized":"2024-09-15T22:16:17.603939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.560964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552446+0000","last_change":"2024-09-15T22:14:04.717221+0000","last_active":"2024-09-15T22:16:17.552446+0000","last_peered":"2024-09-15T22:16:17.552446+0000","last_clean":"2024-09-15T22:16:17.552446+0000","last_became_active":"2024-09-15T22:14:04.716845+0000","last_became_peered":"2024-09-15T22:14:04.716845+0000","last_unstale":"2024-09-15T22:16:17.552446+0000","last_undegraded":"2024-09-15T22:16:17.552446+0000","last_fullsized":"2024-09-15T22:16:17.552446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.073229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555248+0000","last_change":"2024-09-15T22:14:13.847822+0000","last_active":"2024-09-15T22:16:17.555248+0000","last_peered":"2024-09-15T22:16:17.555248+0000","last_clean":"2024-09-15T22:16:17.555248+0000","last_became_active":"2024-09-15T22:14:13.847332+0000","last_became_peered":"2024-09-15T22:14:13.847332+0000","last_unstale":"2024-09-15T22:16:17.555248+0000","last_undegraded":"2024-09-15T22:16:17.555248+0000","last_fullsized":"2024-09-15T22:16:17.555248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:18.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603009+0000","last_change":"2024-09-15T22:14:06.814033+0000","last_active":"2024-09-15T22:16:17.603009+0000","last_peered":"2024-09-15T22:16:17.603009+0000","last_clean":"2024-09-15T22:16:17.603009+0000","last_became_active":"2024-09-15T22:14:06.813458+0000","last_became_peered":"2024-09-15T22:14:06.813458+0000","last_unstale":"2024-09-15T22:16:17.603009+0000","last_undegraded":"2024-09-15T22:16:17.603009+0000","last_fullsized":"2024-09-15T22:16:17.603009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:16.484113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554628+0000","last_change":"2024-09-15T22:14:04.715797+0000","last_active":"2024-09-15T22:16:17.554628+0000","last_peered":"2024-09-15T22:16:17.554628+0000","last_clean":"2024-09-15T22:16:17.554628+0000","last_became_active":"2024-09-15T22:14:04.715478+0000","last_became_peered":"2024-09-15T22:14:04.715478+0000","last_unstale":"2024-09-15T22:16:17.554628+0000","last_undegraded":"2024-09-15T22:16:17.554628+0000","last_fullsized":"2024-09-15T22:16:17.554628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:39.432873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557177+0000","last_change":"2024-09-15T22:14:13.853461+0000","last_active":"2024-09-15T22:16:17.557177+0000","last_peered":"2024-09-15T22:16:17.557177+0000","last_clean":"2024-09-15T22:16:17.557177+0000","last_became_active":"2024-09-15T22:14:13.852896+0000","last_became_peered":"2024-09-15T22:14:13.852896+0000","last_unstale":"2024-09-15T22:16:17.557177+0000","last_undegraded":"2024-09-15T22:16:17.557177+0000","last_fullsized":"2024-09-15T22:16:17.557177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:41.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579227+0000","last_change":"2024-09-15T22:14:06.814990+0000","last_active":"2024-09-15T22:16:17.579227+0000","last_peered":"2024-09-15T22:16:17.579227+0000","last_clean":"2024-09-15T22:16:17.579227+0000","last_became_active":"2024-09-15T22:14:06.814646+0000","last_became_peered":"2024-09-15T22:14:06.814646+0000","last_unstale":"2024-09-15T22:16:17.579227+0000","last_undegraded":"2024-09-15T22:16:17.579227+0000","last_fullsized":"2024-09-15T22:16:17.579227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:04.717207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.542012+0000","last_change":"2024-09-15T22:14:05.017599+0000","last_active":"2024-09-15T22:16:17.542012+0000","last_peered":"2024-09-15T22:16:17.542012+0000","last_clean":"2024-09-15T22:16:17.542012+0000","last_became_active":"2024-09-15T22:14:05.017296+0000","last_became_peered":"2024-09-15T22:14:05.017296+0000","last_unstale":"2024-09-15T22:16:17.542012+0000","last_undegraded":"2024-09-15T22:16:17.542012+0000","last_fullsized":"2024-09-15T22:16:17.542012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:11.427372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556380+0000","last_change":"2024-09-15T22:14:14.281453+0000","last_active":"2024-09-15T22:16:17.556380+0000","last_peered":"2024-09-15T22:16:17.556380+0000","last_clean":"2024-09-15T22:16:17.556380+0000","last_became_active":"2024-09-15T22:14:14.280814+0000","last_became_peered":"2024-09-15T22:14:14.280814+0000","last_unstale":"2024-09-15T22:16:17.556380+0000","last_undegraded":"2024-09-15T22:16:17.556380+0000","last_fullsized":"2024-09-15T22:16:17.556380+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:43:40.890979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604784+0000","last_change":"2024-09-15T22:14:06.816619+0000","last_active":"2024-09-15T22:16:17.604784+0000","last_peered":"2024-09-15T22:16:17.604784+0000","last_clean":"2024-09-15T22:16:17.604784+0000","last_became_active":"2024-09-15T22:14:06.814421+0000","last_became_peered":"2024-09-15T22:14:06.814421+0000","last_unstale":"2024-09-15T22:16:17.604784+0000","last_undegraded":"2024-09-15T22:16:17.604784+0000","last_fullsized":"2024-09-15T22:16:17.604784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:00.329802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556148+0000","last_change":"2024-09-15T22:14:05.197752+0000","last_active":"2024-09-15T22:16:17.556148+0000","last_peered":"2024-09-15T22:16:17.556148+0000","last_clean":"2024-09-15T22:16:17.556148+0000","last_became_active":"2024-09-15T22:14:05.197399+0000","last_became_peered":"2024-09-15T22:14:05.197399+0000","last_unstale":"2024-09-15T22:16:17.556148+0000","last_undegraded":"2024-09-15T22:16:17.556148+0000","last_fullsized":"2024-09-15T22:16:17.556148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:19.781842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552191+0000","last_change":"2024-09-15T22:14:13.847474+0000","last_active":"2024-09-15T22:16:17.552191+0000","last_peered":"2024-09-15T22:16:17.552191+0000","last_clean":"2024-09-15T22:16:17.552191+0000","last_became_active":"2024-09-15T22:14:13.847032+0000","last_became_peered":"2024-09-15T22:14:13.847032+0000","last_unstale":"2024-09-15T22:16:17.552191+0000","last_undegraded":"2024-09-15T22:16:17.552191+0000","last_fullsized":"2024-09-15T22:16:17.552191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:21.049024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598828+0000","last_change":"2024-09-15T22:14:06.809104+0000","last_active":"2024-09-15T22:16:17.598828+0000","last_peered":"2024-09-15T22:16:17.598828+0000","last_clean":"2024-09-15T22:16:17.598828+0000","last_became_active":"2024-09-15T22:14:06.808735+0000","last_became_peered":"2024-09-15T22:14:06.808735+0000","last_unstale":"2024-09-15T22:16:17.598828+0000","last_undegraded":"2024-09-15T22:16:17.598828+0000","last_fullsized":"2024-09-15T22:16:17.598828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:46.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'45","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.830286+0000","last_change":"2024-09-15T22:14:04.712546+0000","last_active":"2024-09-15T22:16:17.830286+0000","last_peered":"2024-09-15T22:16:17.830286+0000","last_clean":"2024-09-15T22:16:17.830286+0000","last_became_active":"2024-09-15T22:14:04.712222+0000","last_became_peered":"2024-09-15T22:14:04.712222+0000","last_unstale":"2024-09-15T22:16:17.830286+0000","last_undegraded":"2024-09-15T22:16:17.830286+0000","last_fullsized":"2024-09-15T22:16:17.830286+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:00.993810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.566187+0000","last_change":"2024-09-15T22:14:14.280905+0000","last_active":"2024-09-15T22:16:17.566187+0000","last_peered":"2024-09-15T22:16:17.566187+0000","last_clean":"2024-09-15T22:16:17.566187+0000","last_became_active":"2024-09-15T22:14:14.280368+0000","last_became_peered":"2024-09-15T22:14:14.280368+0000","last_unstale":"2024-09-15T22:16:17.566187+0000","last_undegraded":"2024-09-15T22:16:17.566187+0000","last_fullsized":"2024-09-15T22:16:17.566187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:52.812589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.599423+0000","last_change":"2024-09-15T22:14:06.816231+0000","last_active":"2024-09-15T22:16:17.599423+0000","last_peered":"2024-09-15T22:16:17.599423+0000","last_clean":"2024-09-15T22:16:17.599423+0000","last_became_active":"2024-09-15T22:14:06.815884+0000","last_became_peered":"2024-09-15T22:14:06.815884+0000","last_unstale":"2024-09-15T22:16:17.599423+0000","last_undegraded":"2024-09-15T22:16:17.599423+0000","last_fullsized":"2024-09-15T22:16:17.599423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:30.076077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556018+0000","last_change":"2024-09-15T22:14:05.017745+0000","last_active":"2024-09-15T22:16:17.556018+0000","last_peered":"2024-09-15T22:16:17.556018+0000","last_clean":"2024-09-15T22:16:17.556018+0000","last_became_active":"2024-09-15T22:14:05.017064+0000","last_became_peered":"2024-09-15T22:14:05.017064+0000","last_unstale":"2024-09-15T22:16:17.556018+0000","last_undegraded":"2024-09-15T22:16:17.556018+0000","last_fullsized":"2024-09-15T22:16:17.556018+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:44.038448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.560575+0000","last_change":"2024-09-15T22:14:13.853195+0000","last_active":"2024-09-15T22:16:17.560575+0000","last_peered":"2024-09-15T22:16:17.560575+0000","last_clean":"2024-09-15T22:16:17.560575+0000","last_became_active":"2024-09-15T22:14:13.852803+0000","last_became_peered":"2024-09-15T22:14:13.852803+0000","last_unstale":"2024-09-15T22:16:17.560575+0000","last_undegraded":"2024-09-15T22:16:17.560575+0000","last_fullsized":"2024-09-15T22:16:17.560575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:20.737509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601889+0000","last_change":"2024-09-15T22:14:06.805448+0000","last_active":"2024-09-15T22:16:17.601889+0000","last_peered":"2024-09-15T22:16:17.601889+0000","last_clean":"2024-09-15T22:16:17.601889+0000","last_became_active":"2024-09-15T22:14:06.804965+0000","last_became_peered":"2024-09-15T22:14:06.804965+0000","last_unstale":"2024-09-15T22:16:17.601889+0000","last_undegraded":"2024-09-15T22:16:17.601889+0000","last_fullsized":"2024-09-15T22:16:17.601889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:29.831888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556768+0000","last_change":"2024-09-15T22:14:05.017438+0000","last_active":"2024-09-15T22:16:17.556768+0000","last_peered":"2024-09-15T22:16:17.556768+0000","last_clean":"2024-09-15T22:16:17.556768+0000","last_became_active":"2024-09-15T22:14:05.017050+0000","last_became_peered":"2024-09-15T22:14:05.017050+0000","last_unstale":"2024-09-15T22:16:17.556768+0000","last_undegraded":"2024-09-15T22:16:17.556768+0000","last_fullsized":"2024-09-15T22:16:17.556768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:35.608774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554172+0000","last_change":"2024-09-15T22:14:14.281096+0000","last_active":"2024-09-15T22:16:17.554172+0000","last_peered":"2024-09-15T22:16:17.554172+0000","last_clean":"2024-09-15T22:16:17.554172+0000","last_became_active":"2024-09-15T22:14:14.280381+0000","last_became_peered":"2024-09-15T22:14:14.280381+0000","last_unstale":"2024-09-15T22:16:17.554172+0000","last_undegraded":"2024-09-15T22:16:17.554172+0000","last_fullsized":"2024-09-15T22:16:17.554172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:44.686080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.583155+0000","last_change":"2024-09-15T22:14:06.812046+0000","last_active":"2024-09-15T22:16:17.583155+0000","last_peered":"2024-09-15T22:16:17.583155+0000","last_clean":"2024-09-15T22:16:17.583155+0000","last_became_active":"2024-09-15T22:14:06.811721+0000","last_became_peered":"2024-09-15T22:14:06.811721+0000","last_unstale":"2024-09-15T22:16:17.583155+0000","last_undegraded":"2024-09-15T22:16:17.583155+0000","last_fullsized":"2024-09-15T22:16:17.583155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:13.244973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556145+0000","last_change":"2024-09-15T22:14:04.720940+0000","last_active":"2024-09-15T22:16:17.556145+0000","last_peered":"2024-09-15T22:16:17.556145+0000","last_clean":"2024-09-15T22:16:17.556145+0000","last_became_active":"2024-09-15T22:14:04.720624+0000","last_became_peered":"2024-09-15T22:14:04.720624+0000","last_unstale":"2024-09-15T22:16:17.556145+0000","last_undegraded":"2024-09-15T22:16:17.556145+0000","last_fullsized":"2024-09-15T22:16:17.556145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:29.823784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540604+0000","last_change":"2024-09-15T22:14:13.848882+0000","last_active":"2024-09-15T22:16:17.540604+0000","last_peered":"2024-09-15T22:16:17.540604+0000","last_clean":"2024-09-15T22:16:17.540604+0000","last_became_active":"2024-09-15T22:14:13.848512+0000","last_became_peered":"2024-09-15T22:14:13.848512+0000","last_unstale":"2024-09-15T22:16:17.540604+0000","last_undegraded":"2024-09-15T22:16:17.540604+0000","last_fullsized":"2024-09-15T22:16:17.540604+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:44.050344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582026+0000","last_change":"2024-09-15T22:14:06.813915+0000","last_active":"2024-09-15T22:16:17.582026+0000","last_peered":"2024-09-15T22:16:17.582026+0000","last_clean":"2024-09-15T22:16:17.582026+0000","last_became_active":"2024-09-15T22:14:06.811803+0000","last_became_peered":"2024-09-15T22:14:06.811803+0000","last_unstale":"2024-09-15T22:16:17.582026+0000","last_undegraded":"2024-09-15T22:16:17.582026+0000","last_fullsized":"2024-09-15T22:16:17.582026+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:42.117747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540432+0000","last_change":"2024-09-15T22:14:05.017360+0000","last_active":"2024-09-15T22:16:17.540432+0000","last_peered":"2024-09-15T22:16:17.540432+0000","last_clean":"2024-09-15T22:16:17.540432+0000","last_became_active":"2024-09-15T22:14:05.017004+0000","last_became_peered":"2024-09-15T22:14:05.017004+0000","last_unstale":"2024-09-15T22:16:17.540432+0000","last_undegraded":"2024-09-15T22:16:17.540432+0000","last_fullsized":"2024-09-15T22:16:17.540432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:01.366513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540715+0000","last_change":"2024-09-15T22:14:14.280215+0000","last_active":"2024-09-15T22:16:17.540715+0000","last_peered":"2024-09-15T22:16:17.540715+0000","last_clean":"2024-09-15T22:16:17.540715+0000","last_became_active":"2024-09-15T22:14:14.279750+0000","last_became_peered":"2024-09-15T22:14:14.279750+0000","last_unstale":"2024-09-15T22:16:17.540715+0000","last_undegraded":"2024-09-15T22:16:17.540715+0000","last_fullsized":"2024-09-15T22:16:17.540715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:58.827582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602972+0000","last_change":"2024-09-15T22:14:06.812410+0000","last_active":"2024-09-15T22:16:17.602972+0000","last_peered":"2024-09-15T22:16:17.602972+0000","last_clean":"2024-09-15T22:16:17.602972+0000","last_became_active":"2024-09-15T22:14:06.812032+0000","last_became_peered":"2024-09-15T22:14:06.812032+0000","last_unstale":"2024-09-15T22:16:17.602972+0000","last_undegraded":"2024-09-15T22:16:17.602972+0000","last_fullsized":"2024-09-15T22:16:17.602972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:48.100213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.558099+0000","last_change":"2024-09-15T22:14:04.719678+0000","last_active":"2024-09-15T22:16:17.558099+0000","last_peered":"2024-09-15T22:16:17.558099+0000","last_clean":"2024-09-15T22:16:17.558099+0000","last_became_active":"2024-09-15T22:14:04.719352+0000","last_became_peered":"2024-09-15T22:14:04.719352+0000","last_unstale":"2024-09-15T22:16:17.558099+0000","last_undegraded":"2024-09-15T22:16:17.558099+0000","last_fullsized":"2024-09-15T22:16:17.558099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.061957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545515+0000","last_change":"2024-09-15T22:14:14.281314+0000","last_active":"2024-09-15T22:16:17.545515+0000","last_peered":"2024-09-15T22:16:17.545515+0000","last_clean":"2024-09-15T22:16:17.545515+0000","last_became_active":"2024-09-15T22:14:14.280859+0000","last_became_peered":"2024-09-15T22:14:14.280859+0000","last_unstale":"2024-09-15T22:16:17.545515+0000","last_undegraded":"2024-09-15T22:16:17.545515+0000","last_fullsized":"2024-09-15T22:16:17.545515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:18.796767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.592298+0000","last_change":"2024-09-15T22:15:17.211828+0000","last_active":"2024-09-15T22:16:17.592298+0000","last_peered":"2024-09-15T22:16:17.592298+0000","last_clean":"2024-09-15T22:16:17.592298+0000","last_became_active":"2024-09-15T22:15:17.211560+0000","last_became_peered":"2024-09-15T22:15:17.211560+0000","last_unstale":"2024-09-15T22:16:17.592298+0000","last_undegraded":"2024-09-15T22:16:17.592298+0000","last_fullsized":"2024-09-15T22:16:17.592298+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:59.944869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555126+0000","last_change":"2024-09-15T22:14:04.718038+0000","last_active":"2024-09-15T22:16:17.555126+0000","last_peered":"2024-09-15T22:16:17.555126+0000","last_clean":"2024-09-15T22:16:17.555126+0000","last_became_active":"2024-09-15T22:14:04.717683+0000","last_became_peered":"2024-09-15T22:14:04.717683+0000","last_unstale":"2024-09-15T22:16:17.555126+0000","last_undegraded":"2024-09-15T22:16:17.555126+0000","last_fullsized":"2024-09-15T22:16:17.555126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:23.557077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":360,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.558271+0000","last_change":"2024-09-15T22:12:55.022635+0000","last_active":"2024-09-15T22:16:17.558271+0000","last_peered":"2024-09-15T22:16:17.558271+0000","last_clean":"2024-09-15T22:16:17.558271+0000","last_became_active":"2024-09-15T22:12:55.022132+0000","last_became_peered":"2024-09-15T22:12:55.022132+0000","last_unstale":"2024-09-15T22:16:17.558271+0000","last_undegraded":"2024-09-15T22:16:17.558271+0000","last_fullsized":"2024-09-15T22:16:17.558271+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_clean_scrub_stamp":"2024-09-15T22:09:30.115505+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:50.060169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.560360+0000","last_change":"2024-09-15T22:14:13.849547+0000","last_active":"2024-09-15T22:16:17.560360+0000","last_peered":"2024-09-15T22:16:17.560360+0000","last_clean":"2024-09-15T22:16:17.560360+0000","last_became_active":"2024-09-15T22:14:13.849091+0000","last_became_peered":"2024-09-15T22:14:13.849091+0000","last_unstale":"2024-09-15T22:16:17.560360+0000","last_undegraded":"2024-09-15T22:16:17.560360+0000","last_fullsized":"2024-09-15T22:16:17.560360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:49.450958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596676+0000","last_change":"2024-09-15T22:14:06.816340+0000","last_active":"2024-09-15T22:16:17.596676+0000","last_peered":"2024-09-15T22:16:17.596676+0000","last_clean":"2024-09-15T22:16:17.596676+0000","last_became_active":"2024-09-15T22:14:06.815712+0000","last_became_peered":"2024-09-15T22:14:06.815712+0000","last_unstale":"2024-09-15T22:16:17.596676+0000","last_undegraded":"2024-09-15T22:16:17.596676+0000","last_fullsized":"2024-09-15T22:16:17.596676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:43.598512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553284+0000","last_change":"2024-09-15T22:14:05.197487+0000","last_active":"2024-09-15T22:16:17.553284+0000","last_peered":"2024-09-15T22:16:17.553284+0000","last_clean":"2024-09-15T22:16:17.553284+0000","last_became_active":"2024-09-15T22:14:05.197098+0000","last_became_peered":"2024-09-15T22:14:05.197098+0000","last_unstale":"2024-09-15T22:16:17.553284+0000","last_undegraded":"2024-09-15T22:16:17.553284+0000","last_fullsized":"2024-09-15T22:16:17.553284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:31.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.541960+0000","last_change":"2024-09-15T22:14:13.849594+0000","last_active":"2024-09-15T22:16:17.541960+0000","last_peered":"2024-09-15T22:16:17.541960+0000","last_clean":"2024-09-15T22:16:17.541960+0000","last_became_active":"2024-09-15T22:14:13.849157+0000","last_became_peered":"2024-09-15T22:14:13.849157+0000","last_unstale":"2024-09-15T22:16:17.541960+0000","last_undegraded":"2024-09-15T22:16:17.541960+0000","last_fullsized":"2024-09-15T22:16:17.541960+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:49.994107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.594031+0000","last_change":"2024-09-15T22:14:06.814312+0000","last_active":"2024-09-15T22:16:17.594031+0000","last_peered":"2024-09-15T22:16:17.594031+0000","last_clean":"2024-09-15T22:16:17.594031+0000","last_became_active":"2024-09-15T22:14:06.813959+0000","last_became_peered":"2024-09-15T22:14:06.813959+0000","last_unstale":"2024-09-15T22:16:17.594031+0000","last_undegraded":"2024-09-15T22:16:17.594031+0000","last_fullsized":"2024-09-15T22:16:17.594031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:36.924162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'39","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.801579+0000","last_change":"2024-09-15T22:14:04.713307+0000","last_active":"2024-09-15T22:16:17.801579+0000","last_peered":"2024-09-15T22:16:17.801579+0000","last_clean":"2024-09-15T22:16:17.801579+0000","last_became_active":"2024-09-15T22:14:04.712996+0000","last_became_peered":"2024-09-15T22:14:04.712996+0000","last_unstale":"2024-09-15T22:16:17.801579+0000","last_undegraded":"2024-09-15T22:16:17.801579+0000","last_fullsized":"2024-09-15T22:16:17.801579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:37.298679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.563300+0000","last_change":"2024-09-15T22:14:13.846087+0000","last_active":"2024-09-15T22:16:17.563300+0000","last_peered":"2024-09-15T22:16:17.563300+0000","last_clean":"2024-09-15T22:16:17.563300+0000","last_became_active":"2024-09-15T22:14:13.845731+0000","last_became_peered":"2024-09-15T22:14:13.845731+0000","last_unstale":"2024-09-15T22:16:17.563300+0000","last_undegraded":"2024-09-15T22:16:17.563300+0000","last_fullsized":"2024-09-15T22:16:17.563300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:24.621330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.581187+0000","last_change":"2024-09-15T22:14:06.809456+0000","last_active":"2024-09-15T22:16:17.581187+0000","last_peered":"2024-09-15T22:16:17.581187+0000","last_clean":"2024-09-15T22:16:17.581187+0000","last_became_active":"2024-09-15T22:14:06.809141+0000","last_became_peered":"2024-09-15T22:14:06.809141+0000","last_unstale":"2024-09-15T22:16:17.581187+0000","last_undegraded":"2024-09-15T22:16:17.581187+0000","last_fullsized":"2024-09-15T22:16:17.581187+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:30.186800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540903+0000","last_change":"2024-09-15T22:14:04.715399+0000","last_active":"2024-09-15T22:16:17.540903+0000","last_peered":"2024-09-15T22:16:17.540903+0000","last_clean":"2024-09-15T22:16:17.540903+0000","last_became_active":"2024-09-15T22:14:04.715043+0000","last_became_peered":"2024-09-15T22:14:04.715043+0000","last_unstale":"2024-09-15T22:16:17.540903+0000","last_undegraded":"2024-09-15T22:16:17.540903+0000","last_fullsized":"2024-09-15T22:16:17.540903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:13.860413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.544985+0000","last_change":"2024-09-15T22:14:13.851594+0000","last_active":"2024-09-15T22:16:17.544985+0000","last_peered":"2024-09-15T22:16:17.544985+0000","last_clean":"2024-09-15T22:16:17.544985+0000","last_became_active":"2024-09-15T22:14:13.851154+0000","last_became_peered":"2024-09-15T22:14:13.851154+0000","last_unstale":"2024-09-15T22:16:17.544985+0000","last_undegraded":"2024-09-15T22:16:17.544985+0000","last_fullsized":"2024-09-15T22:16:17.544985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:43.343808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579012+0000","last_change":"2024-09-15T22:15:17.219587+0000","last_active":"2024-09-15T22:16:17.579012+0000","last_peered":"2024-09-15T22:16:17.579012+0000","last_clean":"2024-09-15T22:16:17.579012+0000","last_became_active":"2024-09-15T22:15:17.219207+0000","last_became_peered":"2024-09-15T22:15:17.219207+0000","last_unstale":"2024-09-15T22:16:17.579012+0000","last_undegraded":"2024-09-15T22:16:17.579012+0000","last_fullsized":"2024-09-15T22:16:17.579012+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:34.267857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553915+0000","last_change":"2024-09-15T22:14:04.719550+0000","last_active":"2024-09-15T22:16:17.553915+0000","last_peered":"2024-09-15T22:16:17.553915+0000","last_clean":"2024-09-15T22:16:17.553915+0000","last_became_active":"2024-09-15T22:14:04.719273+0000","last_became_peered":"2024-09-15T22:14:04.719273+0000","last_unstale":"2024-09-15T22:16:17.553915+0000","last_undegraded":"2024-09-15T22:16:17.553915+0000","last_fullsized":"2024-09-15T22:16:17.553915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:20.973615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545033+0000","last_change":"2024-09-15T22:14:13.851420+0000","last_active":"2024-09-15T22:16:17.545033+0000","last_peered":"2024-09-15T22:16:17.545033+0000","last_clean":"2024-09-15T22:16:17.545033+0000","last_became_active":"2024-09-15T22:14:13.851051+0000","last_became_peered":"2024-09-15T22:14:13.851051+0000","last_unstale":"2024-09-15T22:16:17.545033+0000","last_undegraded":"2024-09-15T22:16:17.545033+0000","last_fullsized":"2024-09-15T22:16:17.545033+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:11.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595467+0000","last_change":"2024-09-15T22:14:06.809609+0000","last_active":"2024-09-15T22:16:17.595467+0000","last_peered":"2024-09-15T22:16:17.595467+0000","last_clean":"2024-09-15T22:16:17.595467+0000","last_became_active":"2024-09-15T22:14:06.809213+0000","last_became_peered":"2024-09-15T22:14:06.809213+0000","last_unstale":"2024-09-15T22:16:17.595467+0000","last_undegraded":"2024-09-15T22:16:17.595467+0000","last_fullsized":"2024-09-15T22:16:17.595467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:11.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553706+0000","last_change":"2024-09-15T22:14:05.017559+0000","last_active":"2024-09-15T22:16:17.553706+0000","last_peered":"2024-09-15T22:16:17.553706+0000","last_clean":"2024-09-15T22:16:17.553706+0000","last_became_active":"2024-09-15T22:14:05.017121+0000","last_became_peered":"2024-09-15T22:14:05.017121+0000","last_unstale":"2024-09-15T22:16:17.553706+0000","last_undegraded":"2024-09-15T22:16:17.553706+0000","last_fullsized":"2024-09-15T22:16:17.553706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:29:06.442532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540809+0000","last_change":"2024-09-15T22:14:13.847835+0000","last_active":"2024-09-15T22:16:17.540809+0000","last_peered":"2024-09-15T22:16:17.540809+0000","last_clean":"2024-09-15T22:16:17.540809+0000","last_became_active":"2024-09-15T22:14:13.847437+0000","last_became_peered":"2024-09-15T22:14:13.847437+0000","last_unstale":"2024-09-15T22:16:17.540809+0000","last_undegraded":"2024-09-15T22:16:17.540809+0000","last_fullsized":"2024-09-15T22:16:17.540809+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:48.036495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.586312+0000","last_change":"2024-09-15T22:14:06.813191+0000","last_active":"2024-09-15T22:16:17.586312+0000","last_peered":"2024-09-15T22:16:17.586312+0000","last_clean":"2024-09-15T22:16:17.586312+0000","last_became_active":"2024-09-15T22:14:06.812861+0000","last_became_peered":"2024-09-15T22:14:06.812861+0000","last_unstale":"2024-09-15T22:16:17.586312+0000","last_undegraded":"2024-09-15T22:16:17.586312+0000","last_fullsized":"2024-09-15T22:16:17.586312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:51.487591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554382+0000","last_change":"2024-09-15T22:14:04.718431+0000","last_active":"2024-09-15T22:16:17.554382+0000","last_peered":"2024-09-15T22:16:17.554382+0000","last_clean":"2024-09-15T22:16:17.554382+0000","last_became_active":"2024-09-15T22:14:04.718109+0000","last_became_peered":"2024-09-15T22:14:04.718109+0000","last_unstale":"2024-09-15T22:16:17.554382+0000","last_undegraded":"2024-09-15T22:16:17.554382+0000","last_fullsized":"2024-09-15T22:16:17.554382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:10.408634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557287+0000","last_change":"2024-09-15T22:14:13.845179+0000","last_active":"2024-09-15T22:16:17.557287+0000","last_peered":"2024-09-15T22:16:17.557287+0000","last_clean":"2024-09-15T22:16:17.557287+0000","last_became_active":"2024-09-15T22:14:13.844795+0000","last_became_peered":"2024-09-15T22:14:13.844795+0000","last_unstale":"2024-09-15T22:16:17.557287+0000","last_undegraded":"2024-09-15T22:16:17.557287+0000","last_fullsized":"2024-09-15T22:16:17.557287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:24.113536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602323+0000","last_change":"2024-09-15T22:14:06.809687+0000","last_active":"2024-09-15T22:16:17.602323+0000","last_peered":"2024-09-15T22:16:17.602323+0000","last_clean":"2024-09-15T22:16:17.602323+0000","last_became_active":"2024-09-15T22:14:06.809383+0000","last_became_peered":"2024-09-15T22:14:06.809383+0000","last_unstale":"2024-09-15T22:16:17.602323+0000","last_undegraded":"2024-09-15T22:16:17.602323+0000","last_fullsized":"2024-09-15T22:16:17.602323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:19.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545298+0000","last_change":"2024-09-15T22:14:04.720577+0000","last_active":"2024-09-15T22:16:17.545298+0000","last_peered":"2024-09-15T22:16:17.545298+0000","last_clean":"2024-09-15T22:16:17.545298+0000","last_became_active":"2024-09-15T22:14:04.720235+0000","last_became_peered":"2024-09-15T22:14:04.720235+0000","last_unstale":"2024-09-15T22:16:17.545298+0000","last_undegraded":"2024-09-15T22:16:17.545298+0000","last_fullsized":"2024-09-15T22:16:17.545298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:17.501061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.559191+0000","last_change":"2024-09-15T22:14:13.854841+0000","last_active":"2024-09-15T22:16:17.559191+0000","last_peered":"2024-09-15T22:16:17.559191+0000","last_clean":"2024-09-15T22:16:17.559191+0000","last_became_active":"2024-09-15T22:14:13.854336+0000","last_became_peered":"2024-09-15T22:14:13.854336+0000","last_unstale":"2024-09-15T22:16:17.559191+0000","last_undegraded":"2024-09-15T22:16:17.559191+0000","last_fullsized":"2024-09-15T22:16:17.559191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:13.819532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.600352+0000","last_change":"2024-09-15T22:14:06.806829+0000","last_active":"2024-09-15T22:16:17.600352+0000","last_peered":"2024-09-15T22:16:17.600352+0000","last_clean":"2024-09-15T22:16:17.600352+0000","last_became_active":"2024-09-15T22:14:06.806521+0000","last_became_peered":"2024-09-15T22:14:06.806521+0000","last_unstale":"2024-09-15T22:16:17.600352+0000","last_undegraded":"2024-09-15T22:16:17.600352+0000","last_fullsized":"2024-09-15T22:16:17.600352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:50.983246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552219+0000","last_change":"2024-09-15T22:14:04.717722+0000","last_active":"2024-09-15T22:16:17.552219+0000","last_peered":"2024-09-15T22:16:17.552219+0000","last_clean":"2024-09-15T22:16:17.552219+0000","last_became_active":"2024-09-15T22:14:04.717201+0000","last_became_peered":"2024-09-15T22:14:04.717201+0000","last_unstale":"2024-09-15T22:16:17.552219+0000","last_undegraded":"2024-09-15T22:16:17.552219+0000","last_fullsized":"2024-09-15T22:16:17.552219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:50.545847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545450+0000","last_change":"2024-09-15T22:14:13.852874+0000","last_active":"2024-09-15T22:16:17.545450+0000","last_peered":"2024-09-15T22:16:17.545450+0000","last_clean":"2024-09-15T22:16:17.545450+0000","last_became_active":"2024-09-15T22:14:13.852426+0000","last_became_peered":"2024-09-15T22:14:13.852426+0000","last_unstale":"2024-09-15T22:16:17.545450+0000","last_undegraded":"2024-09-15T22:16:17.545450+0000","last_fullsized":"2024-09-15T22:16:17.545450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:02:19.215156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579371+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:16:17.579371+0000","last_peered":"2024-09-15T22:16:17.579371+0000","last_clean":"2024-09-15T22:16:17.579371+0000","last_became_active":"2024-09-15T22:14:06.809013+0000","last_became_peered":"2024-09-15T22:14:06.809013+0000","last_unstale":"2024-09-15T22:16:17.579371+0000","last_undegraded":"2024-09-15T22:16:17.579371+0000","last_fullsized":"2024-09-15T22:16:17.579371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:47.830385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:18.087848+0000","last_change":"2024-09-15T22:14:04.721020+0000","last_active":"2024-09-15T22:16:18.087848+0000","last_peered":"2024-09-15T22:16:18.087848+0000","last_clean":"2024-09-15T22:16:18.087848+0000","last_became_active":"2024-09-15T22:14:04.720613+0000","last_became_peered":"2024-09-15T22:14:04.720613+0000","last_unstale":"2024-09-15T22:16:18.087848+0000","last_undegraded":"2024-09-15T22:16:18.087848+0000","last_fullsized":"2024-09-15T22:16:18.087848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:42.719346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71847,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":200,"num_read_kb":171,"num_write":38,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555319+0000","last_change":"2024-09-15T22:14:13.854250+0000","last_active":"2024-09-15T22:16:17.555319+0000","last_peered":"2024-09-15T22:16:17.555319+0000","last_clean":"2024-09-15T22:16:17.555319+0000","last_became_active":"2024-09-15T22:14:13.852972+0000","last_became_peered":"2024-09-15T22:14:13.852972+0000","last_unstale":"2024-09-15T22:16:17.555319+0000","last_undegraded":"2024-09-15T22:16:17.555319+0000","last_fullsized":"2024-09-15T22:16:17.555319+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:50:45.301446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596123+0000","last_change":"2024-09-15T22:14:06.813789+0000","last_active":"2024-09-15T22:16:17.596123+0000","last_peered":"2024-09-15T22:16:17.596123+0000","last_clean":"2024-09-15T22:16:17.596123+0000","last_became_active":"2024-09-15T22:14:06.813501+0000","last_became_peered":"2024-09-15T22:14:06.813501+0000","last_unstale":"2024-09-15T22:16:17.596123+0000","last_undegraded":"2024-09-15T22:16:17.596123+0000","last_fullsized":"2024-09-15T22:16:17.596123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:40.032952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545586+0000","last_change":"2024-09-15T22:14:05.018957+0000","last_active":"2024-09-15T22:16:17.545586+0000","last_peered":"2024-09-15T22:16:17.545586+0000","last_clean":"2024-09-15T22:16:17.545586+0000","last_became_active":"2024-09-15T22:14:05.018602+0000","last_became_peered":"2024-09-15T22:14:05.018602+0000","last_unstale":"2024-09-15T22:16:17.545586+0000","last_undegraded":"2024-09-15T22:16:17.545586+0000","last_fullsized":"2024-09-15T22:16:17.545586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:48.839341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555029+0000","last_change":"2024-09-15T22:15:17.332417+0000","last_active":"2024-09-15T22:16:17.555029+0000","last_peered":"2024-09-15T22:16:17.555029+0000","last_clean":"2024-09-15T22:16:17.555029+0000","last_became_active":"2024-09-15T22:15:17.331771+0000","last_became_peered":"2024-09-15T22:15:17.331771+0000","last_unstale":"2024-09-15T22:16:17.555029+0000","last_undegraded":"2024-09-15T22:16:17.555029+0000","last_fullsized":"2024-09-15T22:16:17.555029+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:08.575035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603399+0000","last_change":"2024-09-15T22:14:06.814876+0000","last_active":"2024-09-15T22:16:17.603399+0000","last_peered":"2024-09-15T22:16:17.603399+0000","last_clean":"2024-09-15T22:16:17.603399+0000","last_became_active":"2024-09-15T22:14:06.814120+0000","last_became_peered":"2024-09-15T22:14:06.814120+0000","last_unstale":"2024-09-15T22:16:17.603399+0000","last_undegraded":"2024-09-15T22:16:17.603399+0000","last_fullsized":"2024-09-15T22:16:17.603399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:37.417618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555309+0000","last_change":"2024-09-15T22:14:04.719281+0000","last_active":"2024-09-15T22:16:17.555309+0000","last_peered":"2024-09-15T22:16:17.555309+0000","last_clean":"2024-09-15T22:16:17.555309+0000","last_became_active":"2024-09-15T22:14:04.718856+0000","last_became_peered":"2024-09-15T22:14:04.718856+0000","last_unstale":"2024-09-15T22:16:17.555309+0000","last_undegraded":"2024-09-15T22:16:17.555309+0000","last_fullsized":"2024-09-15T22:16:17.555309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:22.137825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554629+0000","last_change":"2024-09-15T22:14:13.847398+0000","last_active":"2024-09-15T22:16:17.554629+0000","last_peered":"2024-09-15T22:16:17.554629+0000","last_clean":"2024-09-15T22:16:17.554629+0000","last_became_active":"2024-09-15T22:14:13.846870+0000","last_became_peered":"2024-09-15T22:14:13.846870+0000","last_unstale":"2024-09-15T22:16:17.554629+0000","last_undegraded":"2024-09-15T22:16:17.554629+0000","last_fullsized":"2024-09-15T22:16:17.554629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:58.872716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595875+0000","last_change":"2024-09-15T22:14:06.810412+0000","last_active":"2024-09-15T22:16:17.595875+0000","last_peered":"2024-09-15T22:16:17.595875+0000","last_clean":"2024-09-15T22:16:17.595875+0000","last_became_active":"2024-09-15T22:14:06.809669+0000","last_became_peered":"2024-09-15T22:14:06.809669+0000","last_unstale":"2024-09-15T22:16:17.595875+0000","last_undegraded":"2024-09-15T22:16:17.595875+0000","last_fullsized":"2024-09-15T22:16:17.595875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:44.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.549857+0000","last_change":"2024-09-15T22:14:04.715509+0000","last_active":"2024-09-15T22:16:17.549857+0000","last_peered":"2024-09-15T22:16:17.549857+0000","last_clean":"2024-09-15T22:16:17.549857+0000","last_became_active":"2024-09-15T22:14:04.715169+0000","last_became_peered":"2024-09-15T22:14:04.715169+0000","last_unstale":"2024-09-15T22:16:17.549857+0000","last_undegraded":"2024-09-15T22:16:17.549857+0000","last_fullsized":"2024-09-15T22:16:17.549857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:21.884103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554221+0000","last_change":"2024-09-15T22:15:17.219519+0000","last_active":"2024-09-15T22:16:17.554221+0000","last_peered":"2024-09-15T22:16:17.554221+0000","last_clean":"2024-09-15T22:16:17.554221+0000","last_became_active":"2024-09-15T22:15:17.219106+0000","last_became_peered":"2024-09-15T22:15:17.219106+0000","last_unstale":"2024-09-15T22:16:17.554221+0000","last_undegraded":"2024-09-15T22:16:17.554221+0000","last_fullsized":"2024-09-15T22:16:17.554221+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:54:08.102329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.562557+0000","last_change":"2024-09-15T22:14:13.844375+0000","last_active":"2024-09-15T22:16:17.562557+0000","last_peered":"2024-09-15T22:16:17.562557+0000","last_clean":"2024-09-15T22:16:17.562557+0000","last_became_active":"2024-09-15T22:14:13.843918+0000","last_became_peered":"2024-09-15T22:14:13.843918+0000","last_unstale":"2024-09-15T22:16:17.562557+0000","last_undegraded":"2024-09-15T22:16:17.562557+0000","last_fullsized":"2024-09-15T22:16:17.562557+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:32.190119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606349+0000","last_change":"2024-09-15T22:14:06.809534+0000","last_active":"2024-09-15T22:16:17.606349+0000","last_peered":"2024-09-15T22:16:17.606349+0000","last_clean":"2024-09-15T22:16:17.606349+0000","last_became_active":"2024-09-15T22:14:06.809147+0000","last_became_peered":"2024-09-15T22:14:06.809147+0000","last_unstale":"2024-09-15T22:16:17.606349+0000","last_undegraded":"2024-09-15T22:16:17.606349+0000","last_fullsized":"2024-09-15T22:16:17.606349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:14.930542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545382+0000","last_change":"2024-09-15T22:14:04.715347+0000","last_active":"2024-09-15T22:16:17.545382+0000","last_peered":"2024-09-15T22:16:17.545382+0000","last_clean":"2024-09-15T22:16:17.545382+0000","last_became_active":"2024-09-15T22:14:04.715049+0000","last_became_peered":"2024-09-15T22:14:04.715049+0000","last_unstale":"2024-09-15T22:16:17.545382+0000","last_undegraded":"2024-09-15T22:16:17.545382+0000","last_fullsized":"2024-09-15T22:16:17.545382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:04.943344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.567570+0000","last_change":"2024-09-15T22:14:13.852397+0000","last_active":"2024-09-15T22:16:17.567570+0000","last_peered":"2024-09-15T22:16:17.567570+0000","last_clean":"2024-09-15T22:16:17.567570+0000","last_became_active":"2024-09-15T22:14:13.851863+0000","last_became_peered":"2024-09-15T22:14:13.851863+0000","last_unstale":"2024-09-15T22:16:17.567570+0000","last_undegraded":"2024-09-15T22:16:17.567570+0000","last_fullsized":"2024-09-15T22:16:17.567570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:38.242241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606188+0000","last_change":"2024-09-15T22:14:06.809084+0000","last_active":"2024-09-15T22:16:17.606188+0000","last_peered":"2024-09-15T22:16:17.606188+0000","last_clean":"2024-09-15T22:16:17.606188+0000","last_became_active":"2024-09-15T22:14:06.808725+0000","last_became_peered":"2024-09-15T22:14:06.808725+0000","last_unstale":"2024-09-15T22:16:17.606188+0000","last_undegraded":"2024-09-15T22:16:17.606188+0000","last_fullsized":"2024-09-15T22:16:17.606188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:37.451661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540329+0000","last_change":"2024-09-15T22:14:04.714279+0000","last_active":"2024-09-15T22:16:17.540329+0000","last_peered":"2024-09-15T22:16:17.540329+0000","last_clean":"2024-09-15T22:16:17.540329+0000","last_became_active":"2024-09-15T22:14:04.713751+0000","last_became_peered":"2024-09-15T22:14:04.713751+0000","last_unstale":"2024-09-15T22:16:17.540329+0000","last_undegraded":"2024-09-15T22:16:17.540329+0000","last_fullsized":"2024-09-15T22:16:17.540329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:34.268701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.549598+0000","last_change":"2024-09-15T22:14:04.716417+0000","last_active":"2024-09-15T22:16:17.549598+0000","last_peered":"2024-09-15T22:16:17.549598+0000","last_clean":"2024-09-15T22:16:17.549598+0000","last_became_active":"2024-09-15T22:14:04.716096+0000","last_became_peered":"2024-09-15T22:14:04.716096+0000","last_unstale":"2024-09-15T22:16:17.549598+0000","last_undegraded":"2024-09-15T22:16:17.549598+0000","last_fullsized":"2024-09-15T22:16:17.549598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:30.819060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601287+0000","last_change":"2024-09-15T22:15:17.403940+0000","last_active":"2024-09-15T22:16:17.601287+0000","last_peered":"2024-09-15T22:16:17.601287+0000","last_clean":"2024-09-15T22:16:17.601287+0000","last_became_active":"2024-09-15T22:15:17.403517+0000","last_became_peered":"2024-09-15T22:15:17.403517+0000","last_unstale":"2024-09-15T22:16:17.601287+0000","last_undegraded":"2024-09-15T22:16:17.601287+0000","last_fullsized":"2024-09-15T22:16:17.601287+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:49.602367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552004+0000","last_change":"2024-09-15T22:15:17.404136+0000","last_active":"2024-09-15T22:16:17.552004+0000","last_peered":"2024-09-15T22:16:17.552004+0000","last_clean":"2024-09-15T22:16:17.552004+0000","last_became_active":"2024-09-15T22:15:17.403652+0000","last_became_peered":"2024-09-15T22:15:17.403652+0000","last_unstale":"2024-09-15T22:16:17.552004+0000","last_undegraded":"2024-09-15T22:16:17.552004+0000","last_fullsized":"2024-09-15T22:16:17.552004+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:31.518956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545473+0000","last_change":"2024-09-15T22:14:04.718682+0000","last_active":"2024-09-15T22:16:17.545473+0000","last_peered":"2024-09-15T22:16:17.545473+0000","last_clean":"2024-09-15T22:16:17.545473+0000","last_became_active":"2024-09-15T22:14:04.718313+0000","last_became_peered":"2024-09-15T22:14:04.718313+0000","last_unstale":"2024-09-15T22:16:17.545473+0000","last_undegraded":"2024-09-15T22:16:17.545473+0000","last_fullsized":"2024-09-15T22:16:17.545473+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:47.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595742+0000","last_change":"2024-09-15T22:14:06.819632+0000","last_active":"2024-09-15T22:16:17.595742+0000","last_peered":"2024-09-15T22:16:17.595742+0000","last_clean":"2024-09-15T22:16:17.595742+0000","last_became_active":"2024-09-15T22:14:06.819135+0000","last_became_peered":"2024-09-15T22:14:06.819135+0000","last_unstale":"2024-09-15T22:16:17.595742+0000","last_undegraded":"2024-09-15T22:16:17.595742+0000","last_fullsized":"2024-09-15T22:16:17.595742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:35.708318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552345+0000","last_change":"2024-09-15T22:14:13.851367+0000","last_active":"2024-09-15T22:16:17.552345+0000","last_peered":"2024-09-15T22:16:17.552345+0000","last_clean":"2024-09-15T22:16:17.552345+0000","last_became_active":"2024-09-15T22:14:13.850999+0000","last_became_peered":"2024-09-15T22:14:13.850999+0000","last_unstale":"2024-09-15T22:16:17.552345+0000","last_undegraded":"2024-09-15T22:16:17.552345+0000","last_fullsized":"2024-09-15T22:16:17.552345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:40:03.957622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582014+0000","last_change":"2024-09-15T22:14:06.817213+0000","last_active":"2024-09-15T22:16:17.582014+0000","last_peered":"2024-09-15T22:16:17.582014+0000","last_clean":"2024-09-15T22:16:17.582014+0000","last_became_active":"2024-09-15T22:14:06.816828+0000","last_became_peered":"2024-09-15T22:14:06.816828+0000","last_unstale":"2024-09-15T22:16:17.582014+0000","last_undegraded":"2024-09-15T22:16:17.582014+0000","last_fullsized":"2024-09-15T22:16:17.582014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:55.042256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.590899+0000","last_change":"2024-09-15T22:14:06.814832+0000","last_active":"2024-09-15T22:16:17.590899+0000","last_peered":"2024-09-15T22:16:17.590899+0000","last_clean":"2024-09-15T22:16:17.590899+0000","last_became_active":"2024-09-15T22:14:06.814500+0000","last_became_peered":"2024-09-15T22:14:06.814500+0000","last_unstale":"2024-09-15T22:16:17.590899+0000","last_undegraded":"2024-09-15T22:16:17.590899+0000","last_fullsized":"2024-09-15T22:16:17.590899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:43.623629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603884+0000","last_change":"2024-09-15T22:14:06.809464+0000","last_active":"2024-09-15T22:16:17.603884+0000","last_peered":"2024-09-15T22:16:17.603884+0000","last_clean":"2024-09-15T22:16:17.603884+0000","last_became_active":"2024-09-15T22:14:06.809160+0000","last_became_peered":"2024-09-15T22:14:06.809160+0000","last_unstale":"2024-09-15T22:16:17.603884+0000","last_undegraded":"2024-09-15T22:16:17.603884+0000","last_fullsized":"2024-09-15T22:16:17.603884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:04.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606874+0000","last_change":"2024-09-15T22:14:06.814428+0000","last_active":"2024-09-15T22:16:17.606874+0000","last_peered":"2024-09-15T22:16:17.606874+0000","last_clean":"2024-09-15T22:16:17.606874+0000","last_became_active":"2024-09-15T22:14:06.814100+0000","last_became_peered":"2024-09-15T22:14:06.814100+0000","last_unstale":"2024-09-15T22:16:17.606874+0000","last_undegraded":"2024-09-15T22:16:17.606874+0000","last_fullsized":"2024-09-15T22:16:17.606874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:33.606766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606907+0000","last_change":"2024-09-15T22:14:06.815638+0000","last_active":"2024-09-15T22:16:17.606907+0000","last_peered":"2024-09-15T22:16:17.606907+0000","last_clean":"2024-09-15T22:16:17.606907+0000","last_became_active":"2024-09-15T22:14:06.815327+0000","last_became_peered":"2024-09-15T22:14:06.815327+0000","last_unstale":"2024-09-15T22:16:17.606907+0000","last_undegraded":"2024-09-15T22:16:17.606907+0000","last_fullsized":"2024-09-15T22:16:17.606907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:07.679547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.580925+0000","last_change":"2024-09-15T22:15:17.218238+0000","last_active":"2024-09-15T22:16:17.580925+0000","last_peered":"2024-09-15T22:16:17.580925+0000","last_clean":"2024-09-15T22:16:17.580925+0000","last_became_active":"2024-09-15T22:15:17.217852+0000","last_became_peered":"2024-09-15T22:15:17.217852+0000","last_unstale":"2024-09-15T22:16:17.580925+0000","last_undegraded":"2024-09-15T22:16:17.580925+0000","last_fullsized":"2024-09-15T22:16:17.580925+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:42.046956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.576752+0000","last_change":"2024-09-15T22:14:06.819667+0000","last_active":"2024-09-15T22:16:17.576752+0000","last_peered":"2024-09-15T22:16:17.576752+0000","last_clean":"2024-09-15T22:16:17.576752+0000","last_became_active":"2024-09-15T22:14:06.819389+0000","last_became_peered":"2024-09-15T22:14:06.819389+0000","last_unstale":"2024-09-15T22:16:17.576752+0000","last_undegraded":"2024-09-15T22:16:17.576752+0000","last_fullsized":"2024-09-15T22:16:17.576752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:16.571088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596695+0000","last_change":"2024-09-15T22:15:17.118133+0000","last_active":"2024-09-15T22:16:17.596695+0000","last_peered":"2024-09-15T22:16:17.596695+0000","last_clean":"2024-09-15T22:16:17.596695+0000","last_became_active":"2024-09-15T22:15:17.117802+0000","last_became_peered":"2024-09-15T22:15:17.117802+0000","last_unstale":"2024-09-15T22:16:17.596695+0000","last_undegraded":"2024-09-15T22:16:17.596695+0000","last_fullsized":"2024-09-15T22:16:17.596695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:21.523149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.600039+0000","last_change":"2024-09-15T22:14:06.801454+0000","last_active":"2024-09-15T22:16:17.600039+0000","last_peered":"2024-09-15T22:16:17.600039+0000","last_clean":"2024-09-15T22:16:17.600039+0000","last_became_active":"2024-09-15T22:14:06.801105+0000","last_became_peered":"2024-09-15T22:14:06.801105+0000","last_unstale":"2024-09-15T22:16:17.600039+0000","last_undegraded":"2024-09-15T22:16:17.600039+0000","last_fullsized":"2024-09-15T22:16:17.600039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:32.457428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596129+0000","last_change":"2024-09-15T22:14:06.812603+0000","last_active":"2024-09-15T22:16:17.596129+0000","last_peered":"2024-09-15T22:16:17.596129+0000","last_clean":"2024-09-15T22:16:17.596129+0000","last_became_active":"2024-09-15T22:14:06.812208+0000","last_became_peered":"2024-09-15T22:14:06.812208+0000","last_unstale":"2024-09-15T22:16:17.596129+0000","last_undegraded":"2024-09-15T22:16:17.596129+0000","last_fullsized":"2024-09-15T22:16:17.596129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:55.327481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595669+0000","last_change":"2024-09-15T22:14:06.811783+0000","last_active":"2024-09-15T22:16:17.595669+0000","last_peered":"2024-09-15T22:16:17.595669+0000","last_clean":"2024-09-15T22:16:17.595669+0000","last_became_active":"2024-09-15T22:14:06.811208+0000","last_became_peered":"2024-09-15T22:14:06.811208+0000","last_unstale":"2024-09-15T22:16:17.595669+0000","last_undegraded":"2024-09-15T22:16:17.595669+0000","last_fullsized":"2024-09-15T22:16:17.595669+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:15.576776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604634+0000","last_change":"2024-09-15T22:14:06.818608+0000","last_active":"2024-09-15T22:16:17.604634+0000","last_peered":"2024-09-15T22:16:17.604634+0000","last_clean":"2024-09-15T22:16:17.604634+0000","last_became_active":"2024-09-15T22:14:06.818283+0000","last_became_peered":"2024-09-15T22:14:06.818283+0000","last_unstale":"2024-09-15T22:16:17.604634+0000","last_undegraded":"2024-09-15T22:16:17.604634+0000","last_fullsized":"2024-09-15T22:16:17.604634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:02.477461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.593419+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:16:17.593419+0000","last_peered":"2024-09-15T22:16:17.593419+0000","last_clean":"2024-09-15T22:16:17.593419+0000","last_became_active":"2024-09-15T22:14:06.809043+0000","last_became_peered":"2024-09-15T22:14:06.809043+0000","last_unstale":"2024-09-15T22:16:17.593419+0000","last_undegraded":"2024-09-15T22:16:17.593419+0000","last_fullsized":"2024-09-15T22:16:17.593419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:58.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.590289+0000","last_change":"2024-09-15T22:14:06.814875+0000","last_active":"2024-09-15T22:16:17.590289+0000","last_peered":"2024-09-15T22:16:17.590289+0000","last_clean":"2024-09-15T22:16:17.590289+0000","last_became_active":"2024-09-15T22:14:06.814543+0000","last_became_peered":"2024-09-15T22:14:06.814543+0000","last_unstale":"2024-09-15T22:16:17.590289+0000","last_undegraded":"2024-09-15T22:16:17.590289+0000","last_fullsized":"2024-09-15T22:16:17.590289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:57.465965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.593270+0000","last_change":"2024-09-15T22:14:06.810655+0000","last_active":"2024-09-15T22:16:17.593270+0000","last_peered":"2024-09-15T22:16:17.593270+0000","last_clean":"2024-09-15T22:16:17.593270+0000","last_became_active":"2024-09-15T22:14:06.810159+0000","last_became_peered":"2024-09-15T22:14:06.810159+0000","last_unstale":"2024-09-15T22:16:17.593270+0000","last_undegraded":"2024-09-15T22:16:17.593270+0000","last_fullsized":"2024-09-15T22:16:17.593270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:17.368982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603230+0000","last_change":"2024-09-15T22:14:06.815048+0000","last_active":"2024-09-15T22:16:17.603230+0000","last_peered":"2024-09-15T22:16:17.603230+0000","last_clean":"2024-09-15T22:16:17.603230+0000","last_became_active":"2024-09-15T22:14:06.814744+0000","last_became_peered":"2024-09-15T22:14:06.814744+0000","last_unstale":"2024-09-15T22:16:17.603230+0000","last_undegraded":"2024-09-15T22:16:17.603230+0000","last_fullsized":"2024-09-15T22:16:17.603230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:26.927942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606870+0000","last_change":"2024-09-15T22:14:06.811672+0000","last_active":"2024-09-15T22:16:17.606870+0000","last_peered":"2024-09-15T22:16:17.606870+0000","last_clean":"2024-09-15T22:16:17.606870+0000","last_became_active":"2024-09-15T22:14:06.811300+0000","last_became_peered":"2024-09-15T22:14:06.811300+0000","last_unstale":"2024-09-15T22:16:17.606870+0000","last_undegraded":"2024-09-15T22:16:17.606870+0000","last_fullsized":"2024-09-15T22:16:17.606870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:46.223584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602861+0000","last_change":"2024-09-15T22:14:06.814495+0000","last_active":"2024-09-15T22:16:17.602861+0000","last_peered":"2024-09-15T22:16:17.602861+0000","last_clean":"2024-09-15T22:16:17.602861+0000","last_became_active":"2024-09-15T22:14:06.814142+0000","last_became_peered":"2024-09-15T22:14:06.814142+0000","last_unstale":"2024-09-15T22:16:17.602861+0000","last_undegraded":"2024-09-15T22:16:17.602861+0000","last_fullsized":"2024-09-15T22:16:17.602861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:20.374348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606219+0000","last_change":"2024-09-15T22:14:06.811063+0000","last_active":"2024-09-15T22:16:17.606219+0000","last_peered":"2024-09-15T22:16:17.606219+0000","last_clean":"2024-09-15T22:16:17.606219+0000","last_became_active":"2024-09-15T22:14:06.810700+0000","last_became_peered":"2024-09-15T22:14:06.810700+0000","last_unstale":"2024-09-15T22:16:17.606219+0000","last_undegraded":"2024-09-15T22:16:17.606219+0000","last_fullsized":"2024-09-15T22:16:17.606219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:11.250590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605660+0000","last_change":"2024-09-15T22:14:06.816896+0000","last_active":"2024-09-15T22:16:17.605660+0000","last_peered":"2024-09-15T22:16:17.605660+0000","last_clean":"2024-09-15T22:16:17.605660+0000","last_became_active":"2024-09-15T22:14:06.816559+0000","last_became_peered":"2024-09-15T22:14:06.816559+0000","last_unstale":"2024-09-15T22:16:17.605660+0000","last_undegraded":"2024-09-15T22:16:17.605660+0000","last_fullsized":"2024-09-15T22:16:17.605660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:17.965490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.591968+0000","last_change":"2024-09-15T22:14:06.813984+0000","last_active":"2024-09-15T22:16:17.591968+0000","last_peered":"2024-09-15T22:16:17.591968+0000","last_clean":"2024-09-15T22:16:17.591968+0000","last_became_active":"2024-09-15T22:14:06.813586+0000","last_became_peered":"2024-09-15T22:14:06.813586+0000","last_unstale":"2024-09-15T22:16:17.591968+0000","last_undegraded":"2024-09-15T22:16:17.591968+0000","last_fullsized":"2024-09-15T22:16:17.591968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:34.335741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596558+0000","last_change":"2024-09-15T22:14:06.816047+0000","last_active":"2024-09-15T22:16:17.596558+0000","last_peered":"2024-09-15T22:16:17.596558+0000","last_clean":"2024-09-15T22:16:17.596558+0000","last_became_active":"2024-09-15T22:14:06.815244+0000","last_became_peered":"2024-09-15T22:14:06.815244+0000","last_unstale":"2024-09-15T22:16:17.596558+0000","last_undegraded":"2024-09-15T22:16:17.596558+0000","last_fullsized":"2024-09-15T22:16:17.596558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:30.469382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.583325+0000","last_change":"2024-09-15T22:14:06.813254+0000","last_active":"2024-09-15T22:16:17.583325+0000","last_peered":"2024-09-15T22:16:17.583325+0000","last_clean":"2024-09-15T22:16:17.583325+0000","last_became_active":"2024-09-15T22:14:06.812921+0000","last_became_peered":"2024-09-15T22:14:06.812921+0000","last_unstale":"2024-09-15T22:16:17.583325+0000","last_undegraded":"2024-09-15T22:16:17.583325+0000","last_fullsized":"2024-09-15T22:16:17.583325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:40.674246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595905+0000","last_change":"2024-09-15T22:14:06.817016+0000","last_active":"2024-09-15T22:16:17.595905+0000","last_peered":"2024-09-15T22:16:17.595905+0000","last_clean":"2024-09-15T22:16:17.595905+0000","last_became_active":"2024-09-15T22:14:06.816256+0000","last_became_peered":"2024-09-15T22:14:06.816256+0000","last_unstale":"2024-09-15T22:16:17.595905+0000","last_undegraded":"2024-09-15T22:16:17.595905+0000","last_fullsized":"2024-09-15T22:16:17.595905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:37.092156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.585070+0000","last_change":"2024-09-15T22:15:17.331108+0000","last_active":"2024-09-15T22:16:17.585070+0000","last_peered":"2024-09-15T22:16:17.585070+0000","last_clean":"2024-09-15T22:16:17.585070+0000","last_became_active":"2024-09-15T22:15:17.330765+0000","last_became_peered":"2024-09-15T22:15:17.330765+0000","last_unstale":"2024-09-15T22:16:17.585070+0000","last_undegraded":"2024-09-15T22:16:17.585070+0000","last_fullsized":"2024-09-15T22:16:17.585070+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:37.975326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582652+0000","last_change":"2024-09-15T22:14:06.814902+0000","last_active":"2024-09-15T22:16:17.582652+0000","last_peered":"2024-09-15T22:16:17.582652+0000","last_clean":"2024-09-15T22:16:17.582652+0000","last_became_active":"2024-09-15T22:14:06.814563+0000","last_became_peered":"2024-09-15T22:14:06.814563+0000","last_unstale":"2024-09-15T22:16:17.582652+0000","last_undegraded":"2024-09-15T22:16:17.582652+0000","last_fullsized":"2024-09-15T22:16:17.582652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:02.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.580466+0000","last_change":"2024-09-15T22:14:06.807444+0000","last_active":"2024-09-15T22:16:17.580466+0000","last_peered":"2024-09-15T22:16:17.580466+0000","last_clean":"2024-09-15T22:16:17.580466+0000","last_became_active":"2024-09-15T22:14:06.807083+0000","last_became_peered":"2024-09-15T22:14:06.807083+0000","last_unstale":"2024-09-15T22:16:17.580466+0000","last_undegraded":"2024-09-15T22:16:17.580466+0000","last_fullsized":"2024-09-15T22:16:17.580466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:07.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598596+0000","last_change":"2024-09-15T22:14:06.811851+0000","last_active":"2024-09-15T22:16:17.598596+0000","last_peered":"2024-09-15T22:16:17.598596+0000","last_clean":"2024-09-15T22:16:17.598596+0000","last_became_active":"2024-09-15T22:14:06.811451+0000","last_became_peered":"2024-09-15T22:14:06.811451+0000","last_unstale":"2024-09-15T22:16:17.598596+0000","last_undegraded":"2024-09-15T22:16:17.598596+0000","last_fullsized":"2024-09-15T22:16:17.598596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:51.389555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.589842+0000","last_change":"2024-09-15T22:14:06.812520+0000","last_active":"2024-09-15T22:16:17.589842+0000","last_peered":"2024-09-15T22:16:17.589842+0000","last_clean":"2024-09-15T22:16:17.589842+0000","last_became_active":"2024-09-15T22:14:06.812222+0000","last_became_peered":"2024-09-15T22:14:06.812222+0000","last_unstale":"2024-09-15T22:16:17.589842+0000","last_undegraded":"2024-09-15T22:16:17.589842+0000","last_fullsized":"2024-09-15T22:16:17.589842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:01.589678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604461+0000","last_change":"2024-09-15T22:14:06.808649+0000","last_active":"2024-09-15T22:16:17.604461+0000","last_peered":"2024-09-15T22:16:17.604461+0000","last_clean":"2024-09-15T22:16:17.604461+0000","last_became_active":"2024-09-15T22:14:06.808278+0000","last_became_peered":"2024-09-15T22:14:06.808278+0000","last_unstale":"2024-09-15T22:16:17.604461+0000","last_undegraded":"2024-09-15T22:16:17.604461+0000","last_fullsized":"2024-09-15T22:16:17.604461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:32.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605104+0000","last_change":"2024-09-15T22:14:06.811593+0000","last_active":"2024-09-15T22:16:17.605104+0000","last_peered":"2024-09-15T22:16:17.605104+0000","last_clean":"2024-09-15T22:16:17.605104+0000","last_became_active":"2024-09-15T22:14:06.811285+0000","last_became_peered":"2024-09-15T22:14:06.811285+0000","last_unstale":"2024-09-15T22:16:17.605104+0000","last_undegraded":"2024-09-15T22:16:17.605104+0000","last_fullsized":"2024-09-15T22:16:17.605104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:36.482554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604430+0000","last_change":"2024-09-15T22:14:06.816084+0000","last_active":"2024-09-15T22:16:17.604430+0000","last_peered":"2024-09-15T22:16:17.604430+0000","last_clean":"2024-09-15T22:16:17.604430+0000","last_became_active":"2024-09-15T22:14:06.815461+0000","last_became_peered":"2024-09-15T22:14:06.815461+0000","last_unstale":"2024-09-15T22:16:17.604430+0000","last_undegraded":"2024-09-15T22:16:17.604430+0000","last_fullsized":"2024-09-15T22:16:17.604430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:57.455608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597461,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":256,"num_write":206,"num_write_kb":1413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1892352,"data_stored":1792383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547240,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1028096,"data_stored":511054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776172,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28888,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716264,"statfs":{"total":95995035648,"available":95965454336,"internally_reserved":0,"allocated":1847296,"data_stored":1300967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939697,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1429504,"data_stored":908948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168631,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1429504,"data_stored":904874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1630208,"data_stored":1106100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593793,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1024000,"data_stored":506958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822726,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37252,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707900,"statfs":{"total":95995035648,"available":95956889600,"internally_reserved":0,"allocated":1769472,"data_stored":1233204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1032192,"data_stored":511076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215184,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1560576,"data_stored":1031878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1110016,"data_stored":578053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1105920,"data_stored":578805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40512,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704640,"statfs":{"total":95995035648,"available":95953551360,"internally_reserved":0,"allocated":1028096,"data_stored":507048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":524920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":131782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":393820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":203641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:16:21.887 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:16:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.024+0000 7feab77c4640 1 -- 172.21.15.45:0/95214167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feab01009c0 msgr2=0x7feab0100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.024+0000 7feab77c4640 1 --2- 172.21.15.45:0/95214167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feab01009c0 0x7feab0100e20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009930 tx=0x7feaa002a420 comp rx=0 tx=0).stop 2024-09-15T22:16:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.024+0000 7feab77c4640 1 -- 172.21.15.45:0/95214167 shutdown_connections 2024-09-15T22:16:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.024+0000 7feab77c4640 1 --2- 172.21.15.45:0/95214167 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feab0101360 0x7feab010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.024+0000 7feab77c4640 1 --2- 172.21.15.45:0/95214167 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feab01009c0 0x7feab0100e20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.024+0000 7feab77c4640 1 --2- 172.21.15.45:0/95214167 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab01069d0 0x7feab0106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.024+0000 7feab77c4640 1 -- 172.21.15.45:0/95214167 >> 172.21.15.45:0/95214167 conn(0x7feab00fc6a0 msgr2=0x7feab00feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.024+0000 7feab77c4640 1 -- 172.21.15.45:0/95214167 shutdown_connections 2024-09-15T22:16:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.024+0000 7feab77c4640 1 -- 172.21.15.45:0/95214167 wait complete. 2024-09-15T22:16:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.025+0000 7feab77c4640 1 Processor -- start 2024-09-15T22:16:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.025+0000 7feab77c4640 1 -- start start 2024-09-15T22:16:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.025+0000 7feab77c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab01009c0 0x7feab00fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.025+0000 7feab77c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feab0101360 0x7feab00fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:22.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.025+0000 7feab77c4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feab01069d0 0x7feab00fd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.025+0000 7feab77c4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7feab0110f30 con 0x7feab0101360 2024-09-15T22:16:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.025+0000 7feab77c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feab0110db0 con 0x7feab01009c0 2024-09-15T22:16:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.025+0000 7feab77c4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feab01110b0 con 0x7feab01069d0 2024-09-15T22:16:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.025+0000 7feab4d5f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feab0101360 0x7feab00fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.025+0000 7feab4d5f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feab0101360 0x7feab00fd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52122/0 (socket says 172.21.15.45:52122) 2024-09-15T22:16:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.025+0000 7feab4d5f640 1 -- 172.21.15.45:0/1241162619 learned_addr learned my addr 172.21.15.45:0/1241162619 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.025+0000 7feab5560640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab01009c0 0x7feab00fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.025+0000 7feab5d61640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feab01069d0 0x7feab00fd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.026+0000 7feab4d5f640 1 -- 172.21.15.45:0/1241162619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feab01069d0 msgr2=0x7feab00fd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.026+0000 7feab4d5f640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feab01069d0 0x7feab00fd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.026+0000 7feab4d5f640 1 -- 172.21.15.45:0/1241162619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab01009c0 msgr2=0x7feab00fccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.026+0000 7feab4d5f640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab01009c0 0x7feab00fccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.026+0000 7feab4d5f640 1 -- 172.21.15.45:0/1241162619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab01a69f0 con 0x7feab0101360 2024-09-15T22:16:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.026+0000 7feab4d5f640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feab0101360 0x7feab00fd210 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009230 tx=0x7feaa0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.026+0000 7feaa67fc640 1 -- 172.21.15.45:0/1241162619 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa003f030 con 0x7feab0101360 2024-09-15T22:16:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.026+0000 7feaa67fc640 1 -- 172.21.15.45:0/1241162619 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feaa0004440 con 0x7feab0101360 2024-09-15T22:16:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.026+0000 7feab77c4640 1 -- 172.21.15.45:0/1241162619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab01a6c80 con 0x7feab0101360 2024-09-15T22:16:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.026+0000 7feaa67fc640 1 -- 172.21.15.45:0/1241162619 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa0035070 con 0x7feab0101360 2024-09-15T22:16:22.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.026+0000 7feab77c4640 1 -- 172.21.15.45:0/1241162619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab01a7170 con 0x7feab0101360 2024-09-15T22:16:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.027+0000 7feab77c4640 1 -- 172.21.15.45:0/1241162619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab0100e20 con 0x7feab0101360 2024-09-15T22:16:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.028+0000 7feaa67fc640 1 -- 172.21.15.45:0/1241162619 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 22) ==== 138475+0+0 (secure 0 0 0) 0x7feaa0042030 con 0x7feab0101360 2024-09-15T22:16:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.029+0000 7feaa67fc640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fea9c0a33c0 0x7fea9c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.029+0000 7feab5560640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fea9c0a33c0 0x7fea9c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:22.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.029+0000 7feaa67fc640 1 -- 172.21.15.45:0/1241162619 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7feaa00f0470 con 0x7feab0101360 2024-09-15T22:16:22.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.029+0000 7feab5560640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fea9c0a33c0 0x7fea9c0a5880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feaac005fd0 tx=0x7feaac009500 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:22.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.033+0000 7feaa67fc640 1 -- 172.21.15.45:0/1241162619 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feaa00bca80 con 0x7feab0101360 2024-09-15T22:16:22.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.195+0000 7feaa67fc640 1 -- 172.21.15.45:0/1241162619 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7feaa00b89f0 con 0x7feab0101360 2024-09-15T22:16:22.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.212+0000 7feab77c4640 1 -- 172.21.15.45:0/1241162619 --> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feab0062630 con 0x7fea9c0a33c0 2024-09-15T22:16:22.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.220+0000 7feaa67fc640 1 -- 172.21.15.45:0/1241162619 <== mgr.15165 v2:172.21.15.45:6800/553298159 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339444 (secure 0 0 0) 0x7feab0062630 con 0x7fea9c0a33c0 2024-09-15T22:16:22.226 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:22.227 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-09-15T22:16:22.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.224+0000 7feab77c4640 1 -- 172.21.15.45:0/1241162619 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fea9c0a33c0 msgr2=0x7fea9c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.224+0000 7feab77c4640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fea9c0a33c0 0x7fea9c0a5880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feaac005fd0 tx=0x7feaac009500 comp rx=0 tx=0).stop 2024-09-15T22:16:22.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.224+0000 7feab77c4640 1 -- 172.21.15.45:0/1241162619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feab0101360 msgr2=0x7feab00fd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.224+0000 7feab77c4640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feab0101360 0x7feab00fd210 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009230 tx=0x7feaa0004040 comp rx=0 tx=0).stop 2024-09-15T22:16:22.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.224+0000 7feab77c4640 1 -- 172.21.15.45:0/1241162619 shutdown_connections 2024-09-15T22:16:22.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.224+0000 7feab77c4640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fea9c0a33c0 0x7fea9c0a5880 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.224+0000 7feab77c4640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feab01069d0 0x7feab00fd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.224+0000 7feab77c4640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feab0101360 0x7feab00fd210 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.224+0000 7feab77c4640 1 --2- 172.21.15.45:0/1241162619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab01009c0 0x7feab00fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.224+0000 7feab77c4640 1 -- 172.21.15.45:0/1241162619 >> 172.21.15.45:0/1241162619 conn(0x7feab00fc6a0 msgr2=0x7feab006a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:22.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.224+0000 7feab77c4640 1 -- 172.21.15.45:0/1241162619 shutdown_connections 2024-09-15T22:16:22.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.224+0000 7feab77c4640 1 -- 172.21.15.45:0/1241162619 wait complete. 2024-09-15T22:16:22.237 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-15T22:16:21.555256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188063,"num_objects":28,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":434,"num_read_kb":375,"num_write":389,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":792,"ondisk_log_size":792,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":415064,"kb_used_data":15620,"kb_used_omap":18,"kb_used_meta":398957,"kb_avail":1124526760,"statfs":{"total":1151940427776,"available":1151515402240,"internally_reserved":0,"allocated":15994880,"data_stored":9678965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":408532281},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.985700"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557493+0000","last_change":"2024-09-15T22:14:04.718966+0000","last_active":"2024-09-15T22:16:17.557493+0000","last_peered":"2024-09-15T22:16:17.557493+0000","last_clean":"2024-09-15T22:16:17.557493+0000","last_became_active":"2024-09-15T22:14:04.718743+0000","last_became_peered":"2024-09-15T22:14:04.718743+0000","last_unstale":"2024-09-15T22:16:17.557493+0000","last_undegraded":"2024-09-15T22:16:17.557493+0000","last_fullsized":"2024-09-15T22:16:17.557493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:24:01.767801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604829+0000","last_change":"2024-09-15T22:14:06.814802+0000","last_active":"2024-09-15T22:16:17.604829+0000","last_peered":"2024-09-15T22:16:17.604829+0000","last_clean":"2024-09-15T22:16:17.604829+0000","last_became_active":"2024-09-15T22:14:06.814495+0000","last_became_peered":"2024-09-15T22:14:06.814495+0000","last_unstale":"2024-09-15T22:16:17.604829+0000","last_undegraded":"2024-09-15T22:16:17.604829+0000","last_fullsized":"2024-09-15T22:16:17.604829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:45.384412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552197+0000","last_change":"2024-09-15T22:15:17.404082+0000","last_active":"2024-09-15T22:16:17.552197+0000","last_peered":"2024-09-15T22:16:17.552197+0000","last_clean":"2024-09-15T22:16:17.552197+0000","last_became_active":"2024-09-15T22:15:17.403590+0000","last_became_peered":"2024-09-15T22:15:17.403590+0000","last_unstale":"2024-09-15T22:16:17.552197+0000","last_undegraded":"2024-09-15T22:16:17.552197+0000","last_fullsized":"2024-09-15T22:16:17.552197+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:49.816560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.566735+0000","last_change":"2024-09-15T22:14:05.017101+0000","last_active":"2024-09-15T22:16:17.566735+0000","last_peered":"2024-09-15T22:16:17.566735+0000","last_clean":"2024-09-15T22:16:17.566735+0000","last_became_active":"2024-09-15T22:14:05.016748+0000","last_became_peered":"2024-09-15T22:14:05.016748+0000","last_unstale":"2024-09-15T22:16:17.566735+0000","last_undegraded":"2024-09-15T22:16:17.566735+0000","last_fullsized":"2024-09-15T22:16:17.566735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:11.211291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605811+0000","last_change":"2024-09-15T22:14:06.815112+0000","last_active":"2024-09-15T22:16:17.605811+0000","last_peered":"2024-09-15T22:16:17.605811+0000","last_clean":"2024-09-15T22:16:17.605811+0000","last_became_active":"2024-09-15T22:14:06.814556+0000","last_became_peered":"2024-09-15T22:14:06.814556+0000","last_unstale":"2024-09-15T22:16:17.605811+0000","last_undegraded":"2024-09-15T22:16:17.605811+0000","last_fullsized":"2024-09-15T22:16:17.605811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:24.733336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553827+0000","last_change":"2024-09-15T22:14:13.845829+0000","last_active":"2024-09-15T22:16:17.553827+0000","last_peered":"2024-09-15T22:16:17.553827+0000","last_clean":"2024-09-15T22:16:17.553827+0000","last_became_active":"2024-09-15T22:14:13.844958+0000","last_became_peered":"2024-09-15T22:14:13.844958+0000","last_unstale":"2024-09-15T22:16:17.553827+0000","last_undegraded":"2024-09-15T22:16:17.553827+0000","last_fullsized":"2024-09-15T22:16:17.553827+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:37.944143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555893+0000","last_change":"2024-09-15T22:14:04.720255+0000","last_active":"2024-09-15T22:16:17.555893+0000","last_peered":"2024-09-15T22:16:17.555893+0000","last_clean":"2024-09-15T22:16:17.555893+0000","last_became_active":"2024-09-15T22:14:04.719907+0000","last_became_peered":"2024-09-15T22:14:04.719907+0000","last_unstale":"2024-09-15T22:16:17.555893+0000","last_undegraded":"2024-09-15T22:16:17.555893+0000","last_fullsized":"2024-09-15T22:16:17.555893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:12.510139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.591919+0000","last_change":"2024-09-15T22:14:06.808322+0000","last_active":"2024-09-15T22:16:17.591919+0000","last_peered":"2024-09-15T22:16:17.591919+0000","last_clean":"2024-09-15T22:16:17.591919+0000","last_became_active":"2024-09-15T22:14:06.807398+0000","last_became_peered":"2024-09-15T22:14:06.807398+0000","last_unstale":"2024-09-15T22:16:17.591919+0000","last_undegraded":"2024-09-15T22:16:17.591919+0000","last_fullsized":"2024-09-15T22:16:17.591919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:11.677800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554758+0000","last_change":"2024-09-15T22:14:13.849713+0000","last_active":"2024-09-15T22:16:17.554758+0000","last_peered":"2024-09-15T22:16:17.554758+0000","last_clean":"2024-09-15T22:16:17.554758+0000","last_became_active":"2024-09-15T22:14:13.849311+0000","last_became_peered":"2024-09-15T22:14:13.849311+0000","last_unstale":"2024-09-15T22:16:17.554758+0000","last_undegraded":"2024-09-15T22:16:17.554758+0000","last_fullsized":"2024-09-15T22:16:17.554758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:17.782013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554654+0000","last_change":"2024-09-15T22:14:04.721694+0000","last_active":"2024-09-15T22:16:17.554654+0000","last_peered":"2024-09-15T22:16:17.554654+0000","last_clean":"2024-09-15T22:16:17.554654+0000","last_became_active":"2024-09-15T22:14:04.721321+0000","last_became_peered":"2024-09-15T22:14:04.721321+0000","last_unstale":"2024-09-15T22:16:17.554654+0000","last_undegraded":"2024-09-15T22:16:17.554654+0000","last_fullsized":"2024-09-15T22:16:17.554654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:47.817565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.586446+0000","last_change":"2024-09-15T22:14:06.809564+0000","last_active":"2024-09-15T22:16:17.586446+0000","last_peered":"2024-09-15T22:16:17.586446+0000","last_clean":"2024-09-15T22:16:17.586446+0000","last_became_active":"2024-09-15T22:14:06.809102+0000","last_became_peered":"2024-09-15T22:14:06.809102+0000","last_unstale":"2024-09-15T22:16:17.586446+0000","last_undegraded":"2024-09-15T22:16:17.586446+0000","last_fullsized":"2024-09-15T22:16:17.586446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:55.306791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554499+0000","last_change":"2024-09-15T22:14:13.849839+0000","last_active":"2024-09-15T22:16:17.554499+0000","last_peered":"2024-09-15T22:16:17.554499+0000","last_clean":"2024-09-15T22:16:17.554499+0000","last_became_active":"2024-09-15T22:14:13.849415+0000","last_became_peered":"2024-09-15T22:14:13.849415+0000","last_unstale":"2024-09-15T22:16:17.554499+0000","last_undegraded":"2024-09-15T22:16:17.554499+0000","last_fullsized":"2024-09-15T22:16:17.554499+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:20.336406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601259+0000","last_change":"2024-09-15T22:14:06.815506+0000","last_active":"2024-09-15T22:16:17.601259+0000","last_peered":"2024-09-15T22:16:17.601259+0000","last_clean":"2024-09-15T22:16:17.601259+0000","last_became_active":"2024-09-15T22:14:06.815066+0000","last_became_peered":"2024-09-15T22:14:06.815066+0000","last_unstale":"2024-09-15T22:16:17.601259+0000","last_undegraded":"2024-09-15T22:16:17.601259+0000","last_fullsized":"2024-09-15T22:16:17.601259+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:42.182268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555136+0000","last_change":"2024-09-15T22:14:04.721403+0000","last_active":"2024-09-15T22:16:17.555136+0000","last_peered":"2024-09-15T22:16:17.555136+0000","last_clean":"2024-09-15T22:16:17.555136+0000","last_became_active":"2024-09-15T22:14:04.721049+0000","last_became_peered":"2024-09-15T22:14:04.721049+0000","last_unstale":"2024-09-15T22:16:17.555136+0000","last_undegraded":"2024-09-15T22:16:17.555136+0000","last_fullsized":"2024-09-15T22:16:17.555136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:39.860926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.561252+0000","last_change":"2024-09-15T22:14:14.280656+0000","last_active":"2024-09-15T22:16:17.561252+0000","last_peered":"2024-09-15T22:16:17.561252+0000","last_clean":"2024-09-15T22:16:17.561252+0000","last_became_active":"2024-09-15T22:14:14.280230+0000","last_became_peered":"2024-09-15T22:14:14.280230+0000","last_unstale":"2024-09-15T22:16:17.561252+0000","last_undegraded":"2024-09-15T22:16:17.561252+0000","last_fullsized":"2024-09-15T22:16:17.561252+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:47.531799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603939+0000","last_change":"2024-09-15T22:14:06.805575+0000","last_active":"2024-09-15T22:16:17.603939+0000","last_peered":"2024-09-15T22:16:17.603939+0000","last_clean":"2024-09-15T22:16:17.603939+0000","last_became_active":"2024-09-15T22:14:06.804515+0000","last_became_peered":"2024-09-15T22:14:06.804515+0000","last_unstale":"2024-09-15T22:16:17.603939+0000","last_undegraded":"2024-09-15T22:16:17.603939+0000","last_fullsized":"2024-09-15T22:16:17.603939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.560964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552446+0000","last_change":"2024-09-15T22:14:04.717221+0000","last_active":"2024-09-15T22:16:17.552446+0000","last_peered":"2024-09-15T22:16:17.552446+0000","last_clean":"2024-09-15T22:16:17.552446+0000","last_became_active":"2024-09-15T22:14:04.716845+0000","last_became_peered":"2024-09-15T22:14:04.716845+0000","last_unstale":"2024-09-15T22:16:17.552446+0000","last_undegraded":"2024-09-15T22:16:17.552446+0000","last_fullsized":"2024-09-15T22:16:17.552446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.073229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555248+0000","last_change":"2024-09-15T22:14:13.847822+0000","last_active":"2024-09-15T22:16:17.555248+0000","last_peered":"2024-09-15T22:16:17.555248+0000","last_clean":"2024-09-15T22:16:17.555248+0000","last_became_active":"2024-09-15T22:14:13.847332+0000","last_became_peered":"2024-09-15T22:14:13.847332+0000","last_unstale":"2024-09-15T22:16:17.555248+0000","last_undegraded":"2024-09-15T22:16:17.555248+0000","last_fullsized":"2024-09-15T22:16:17.555248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:18.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603009+0000","last_change":"2024-09-15T22:14:06.814033+0000","last_active":"2024-09-15T22:16:17.603009+0000","last_peered":"2024-09-15T22:16:17.603009+0000","last_clean":"2024-09-15T22:16:17.603009+0000","last_became_active":"2024-09-15T22:14:06.813458+0000","last_became_peered":"2024-09-15T22:14:06.813458+0000","last_unstale":"2024-09-15T22:16:17.603009+0000","last_undegraded":"2024-09-15T22:16:17.603009+0000","last_fullsized":"2024-09-15T22:16:17.603009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:16.484113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554628+0000","last_change":"2024-09-15T22:14:04.715797+0000","last_active":"2024-09-15T22:16:17.554628+0000","last_peered":"2024-09-15T22:16:17.554628+0000","last_clean":"2024-09-15T22:16:17.554628+0000","last_became_active":"2024-09-15T22:14:04.715478+0000","last_became_peered":"2024-09-15T22:14:04.715478+0000","last_unstale":"2024-09-15T22:16:17.554628+0000","last_undegraded":"2024-09-15T22:16:17.554628+0000","last_fullsized":"2024-09-15T22:16:17.554628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:39.432873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557177+0000","last_change":"2024-09-15T22:14:13.853461+0000","last_active":"2024-09-15T22:16:17.557177+0000","last_peered":"2024-09-15T22:16:17.557177+0000","last_clean":"2024-09-15T22:16:17.557177+0000","last_became_active":"2024-09-15T22:14:13.852896+0000","last_became_peered":"2024-09-15T22:14:13.852896+0000","last_unstale":"2024-09-15T22:16:17.557177+0000","last_undegraded":"2024-09-15T22:16:17.557177+0000","last_fullsized":"2024-09-15T22:16:17.557177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:41.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579227+0000","last_change":"2024-09-15T22:14:06.814990+0000","last_active":"2024-09-15T22:16:17.579227+0000","last_peered":"2024-09-15T22:16:17.579227+0000","last_clean":"2024-09-15T22:16:17.579227+0000","last_became_active":"2024-09-15T22:14:06.814646+0000","last_became_peered":"2024-09-15T22:14:06.814646+0000","last_unstale":"2024-09-15T22:16:17.579227+0000","last_undegraded":"2024-09-15T22:16:17.579227+0000","last_fullsized":"2024-09-15T22:16:17.579227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:04.717207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.542012+0000","last_change":"2024-09-15T22:14:05.017599+0000","last_active":"2024-09-15T22:16:17.542012+0000","last_peered":"2024-09-15T22:16:17.542012+0000","last_clean":"2024-09-15T22:16:17.542012+0000","last_became_active":"2024-09-15T22:14:05.017296+0000","last_became_peered":"2024-09-15T22:14:05.017296+0000","last_unstale":"2024-09-15T22:16:17.542012+0000","last_undegraded":"2024-09-15T22:16:17.542012+0000","last_fullsized":"2024-09-15T22:16:17.542012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:11.427372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556380+0000","last_change":"2024-09-15T22:14:14.281453+0000","last_active":"2024-09-15T22:16:17.556380+0000","last_peered":"2024-09-15T22:16:17.556380+0000","last_clean":"2024-09-15T22:16:17.556380+0000","last_became_active":"2024-09-15T22:14:14.280814+0000","last_became_peered":"2024-09-15T22:14:14.280814+0000","last_unstale":"2024-09-15T22:16:17.556380+0000","last_undegraded":"2024-09-15T22:16:17.556380+0000","last_fullsized":"2024-09-15T22:16:17.556380+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:43:40.890979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604784+0000","last_change":"2024-09-15T22:14:06.816619+0000","last_active":"2024-09-15T22:16:17.604784+0000","last_peered":"2024-09-15T22:16:17.604784+0000","last_clean":"2024-09-15T22:16:17.604784+0000","last_became_active":"2024-09-15T22:14:06.814421+0000","last_became_peered":"2024-09-15T22:14:06.814421+0000","last_unstale":"2024-09-15T22:16:17.604784+0000","last_undegraded":"2024-09-15T22:16:17.604784+0000","last_fullsized":"2024-09-15T22:16:17.604784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:00.329802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556148+0000","last_change":"2024-09-15T22:14:05.197752+0000","last_active":"2024-09-15T22:16:17.556148+0000","last_peered":"2024-09-15T22:16:17.556148+0000","last_clean":"2024-09-15T22:16:17.556148+0000","last_became_active":"2024-09-15T22:14:05.197399+0000","last_became_peered":"2024-09-15T22:14:05.197399+0000","last_unstale":"2024-09-15T22:16:17.556148+0000","last_undegraded":"2024-09-15T22:16:17.556148+0000","last_fullsized":"2024-09-15T22:16:17.556148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:19.781842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552191+0000","last_change":"2024-09-15T22:14:13.847474+0000","last_active":"2024-09-15T22:16:17.552191+0000","last_peered":"2024-09-15T22:16:17.552191+0000","last_clean":"2024-09-15T22:16:17.552191+0000","last_became_active":"2024-09-15T22:14:13.847032+0000","last_became_peered":"2024-09-15T22:14:13.847032+0000","last_unstale":"2024-09-15T22:16:17.552191+0000","last_undegraded":"2024-09-15T22:16:17.552191+0000","last_fullsized":"2024-09-15T22:16:17.552191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:21.049024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598828+0000","last_change":"2024-09-15T22:14:06.809104+0000","last_active":"2024-09-15T22:16:17.598828+0000","last_peered":"2024-09-15T22:16:17.598828+0000","last_clean":"2024-09-15T22:16:17.598828+0000","last_became_active":"2024-09-15T22:14:06.808735+0000","last_became_peered":"2024-09-15T22:14:06.808735+0000","last_unstale":"2024-09-15T22:16:17.598828+0000","last_undegraded":"2024-09-15T22:16:17.598828+0000","last_fullsized":"2024-09-15T22:16:17.598828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:46.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'45","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.830286+0000","last_change":"2024-09-15T22:14:04.712546+0000","last_active":"2024-09-15T22:16:17.830286+0000","last_peered":"2024-09-15T22:16:17.830286+0000","last_clean":"2024-09-15T22:16:17.830286+0000","last_became_active":"2024-09-15T22:14:04.712222+0000","last_became_peered":"2024-09-15T22:14:04.712222+0000","last_unstale":"2024-09-15T22:16:17.830286+0000","last_undegraded":"2024-09-15T22:16:17.830286+0000","last_fullsized":"2024-09-15T22:16:17.830286+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:00.993810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.566187+0000","last_change":"2024-09-15T22:14:14.280905+0000","last_active":"2024-09-15T22:16:17.566187+0000","last_peered":"2024-09-15T22:16:17.566187+0000","last_clean":"2024-09-15T22:16:17.566187+0000","last_became_active":"2024-09-15T22:14:14.280368+0000","last_became_peered":"2024-09-15T22:14:14.280368+0000","last_unstale":"2024-09-15T22:16:17.566187+0000","last_undegraded":"2024-09-15T22:16:17.566187+0000","last_fullsized":"2024-09-15T22:16:17.566187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:52.812589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.599423+0000","last_change":"2024-09-15T22:14:06.816231+0000","last_active":"2024-09-15T22:16:17.599423+0000","last_peered":"2024-09-15T22:16:17.599423+0000","last_clean":"2024-09-15T22:16:17.599423+0000","last_became_active":"2024-09-15T22:14:06.815884+0000","last_became_peered":"2024-09-15T22:14:06.815884+0000","last_unstale":"2024-09-15T22:16:17.599423+0000","last_undegraded":"2024-09-15T22:16:17.599423+0000","last_fullsized":"2024-09-15T22:16:17.599423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:30.076077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556018+0000","last_change":"2024-09-15T22:14:05.017745+0000","last_active":"2024-09-15T22:16:17.556018+0000","last_peered":"2024-09-15T22:16:17.556018+0000","last_clean":"2024-09-15T22:16:17.556018+0000","last_became_active":"2024-09-15T22:14:05.017064+0000","last_became_peered":"2024-09-15T22:14:05.017064+0000","last_unstale":"2024-09-15T22:16:17.556018+0000","last_undegraded":"2024-09-15T22:16:17.556018+0000","last_fullsized":"2024-09-15T22:16:17.556018+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:44.038448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.560575+0000","last_change":"2024-09-15T22:14:13.853195+0000","last_active":"2024-09-15T22:16:17.560575+0000","last_peered":"2024-09-15T22:16:17.560575+0000","last_clean":"2024-09-15T22:16:17.560575+0000","last_became_active":"2024-09-15T22:14:13.852803+0000","last_became_peered":"2024-09-15T22:14:13.852803+0000","last_unstale":"2024-09-15T22:16:17.560575+0000","last_undegraded":"2024-09-15T22:16:17.560575+0000","last_fullsized":"2024-09-15T22:16:17.560575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:20.737509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601889+0000","last_change":"2024-09-15T22:14:06.805448+0000","last_active":"2024-09-15T22:16:17.601889+0000","last_peered":"2024-09-15T22:16:17.601889+0000","last_clean":"2024-09-15T22:16:17.601889+0000","last_became_active":"2024-09-15T22:14:06.804965+0000","last_became_peered":"2024-09-15T22:14:06.804965+0000","last_unstale":"2024-09-15T22:16:17.601889+0000","last_undegraded":"2024-09-15T22:16:17.601889+0000","last_fullsized":"2024-09-15T22:16:17.601889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:29.831888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556768+0000","last_change":"2024-09-15T22:14:05.017438+0000","last_active":"2024-09-15T22:16:17.556768+0000","last_peered":"2024-09-15T22:16:17.556768+0000","last_clean":"2024-09-15T22:16:17.556768+0000","last_became_active":"2024-09-15T22:14:05.017050+0000","last_became_peered":"2024-09-15T22:14:05.017050+0000","last_unstale":"2024-09-15T22:16:17.556768+0000","last_undegraded":"2024-09-15T22:16:17.556768+0000","last_fullsized":"2024-09-15T22:16:17.556768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:35.608774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554172+0000","last_change":"2024-09-15T22:14:14.281096+0000","last_active":"2024-09-15T22:16:17.554172+0000","last_peered":"2024-09-15T22:16:17.554172+0000","last_clean":"2024-09-15T22:16:17.554172+0000","last_became_active":"2024-09-15T22:14:14.280381+0000","last_became_peered":"2024-09-15T22:14:14.280381+0000","last_unstale":"2024-09-15T22:16:17.554172+0000","last_undegraded":"2024-09-15T22:16:17.554172+0000","last_fullsized":"2024-09-15T22:16:17.554172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:44.686080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.583155+0000","last_change":"2024-09-15T22:14:06.812046+0000","last_active":"2024-09-15T22:16:17.583155+0000","last_peered":"2024-09-15T22:16:17.583155+0000","last_clean":"2024-09-15T22:16:17.583155+0000","last_became_active":"2024-09-15T22:14:06.811721+0000","last_became_peered":"2024-09-15T22:14:06.811721+0000","last_unstale":"2024-09-15T22:16:17.583155+0000","last_undegraded":"2024-09-15T22:16:17.583155+0000","last_fullsized":"2024-09-15T22:16:17.583155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:13.244973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556145+0000","last_change":"2024-09-15T22:14:04.720940+0000","last_active":"2024-09-15T22:16:17.556145+0000","last_peered":"2024-09-15T22:16:17.556145+0000","last_clean":"2024-09-15T22:16:17.556145+0000","last_became_active":"2024-09-15T22:14:04.720624+0000","last_became_peered":"2024-09-15T22:14:04.720624+0000","last_unstale":"2024-09-15T22:16:17.556145+0000","last_undegraded":"2024-09-15T22:16:17.556145+0000","last_fullsized":"2024-09-15T22:16:17.556145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:29.823784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540604+0000","last_change":"2024-09-15T22:14:13.848882+0000","last_active":"2024-09-15T22:16:17.540604+0000","last_peered":"2024-09-15T22:16:17.540604+0000","last_clean":"2024-09-15T22:16:17.540604+0000","last_became_active":"2024-09-15T22:14:13.848512+0000","last_became_peered":"2024-09-15T22:14:13.848512+0000","last_unstale":"2024-09-15T22:16:17.540604+0000","last_undegraded":"2024-09-15T22:16:17.540604+0000","last_fullsized":"2024-09-15T22:16:17.540604+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:44.050344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582026+0000","last_change":"2024-09-15T22:14:06.813915+0000","last_active":"2024-09-15T22:16:17.582026+0000","last_peered":"2024-09-15T22:16:17.582026+0000","last_clean":"2024-09-15T22:16:17.582026+0000","last_became_active":"2024-09-15T22:14:06.811803+0000","last_became_peered":"2024-09-15T22:14:06.811803+0000","last_unstale":"2024-09-15T22:16:17.582026+0000","last_undegraded":"2024-09-15T22:16:17.582026+0000","last_fullsized":"2024-09-15T22:16:17.582026+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:42.117747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540432+0000","last_change":"2024-09-15T22:14:05.017360+0000","last_active":"2024-09-15T22:16:17.540432+0000","last_peered":"2024-09-15T22:16:17.540432+0000","last_clean":"2024-09-15T22:16:17.540432+0000","last_became_active":"2024-09-15T22:14:05.017004+0000","last_became_peered":"2024-09-15T22:14:05.017004+0000","last_unstale":"2024-09-15T22:16:17.540432+0000","last_undegraded":"2024-09-15T22:16:17.540432+0000","last_fullsized":"2024-09-15T22:16:17.540432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:01.366513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540715+0000","last_change":"2024-09-15T22:14:14.280215+0000","last_active":"2024-09-15T22:16:17.540715+0000","last_peered":"2024-09-15T22:16:17.540715+0000","last_clean":"2024-09-15T22:16:17.540715+0000","last_became_active":"2024-09-15T22:14:14.279750+0000","last_became_peered":"2024-09-15T22:14:14.279750+0000","last_unstale":"2024-09-15T22:16:17.540715+0000","last_undegraded":"2024-09-15T22:16:17.540715+0000","last_fullsized":"2024-09-15T22:16:17.540715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:58.827582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602972+0000","last_change":"2024-09-15T22:14:06.812410+0000","last_active":"2024-09-15T22:16:17.602972+0000","last_peered":"2024-09-15T22:16:17.602972+0000","last_clean":"2024-09-15T22:16:17.602972+0000","last_became_active":"2024-09-15T22:14:06.812032+0000","last_became_peered":"2024-09-15T22:14:06.812032+0000","last_unstale":"2024-09-15T22:16:17.602972+0000","last_undegraded":"2024-09-15T22:16:17.602972+0000","last_fullsized":"2024-09-15T22:16:17.602972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:48.100213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.558099+0000","last_change":"2024-09-15T22:14:04.719678+0000","last_active":"2024-09-15T22:16:17.558099+0000","last_peered":"2024-09-15T22:16:17.558099+0000","last_clean":"2024-09-15T22:16:17.558099+0000","last_became_active":"2024-09-15T22:14:04.719352+0000","last_became_peered":"2024-09-15T22:14:04.719352+0000","last_unstale":"2024-09-15T22:16:17.558099+0000","last_undegraded":"2024-09-15T22:16:17.558099+0000","last_fullsized":"2024-09-15T22:16:17.558099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.061957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545515+0000","last_change":"2024-09-15T22:14:14.281314+0000","last_active":"2024-09-15T22:16:17.545515+0000","last_peered":"2024-09-15T22:16:17.545515+0000","last_clean":"2024-09-15T22:16:17.545515+0000","last_became_active":"2024-09-15T22:14:14.280859+0000","last_became_peered":"2024-09-15T22:14:14.280859+0000","last_unstale":"2024-09-15T22:16:17.545515+0000","last_undegraded":"2024-09-15T22:16:17.545515+0000","last_fullsized":"2024-09-15T22:16:17.545515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:18.796767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.592298+0000","last_change":"2024-09-15T22:15:17.211828+0000","last_active":"2024-09-15T22:16:17.592298+0000","last_peered":"2024-09-15T22:16:17.592298+0000","last_clean":"2024-09-15T22:16:17.592298+0000","last_became_active":"2024-09-15T22:15:17.211560+0000","last_became_peered":"2024-09-15T22:15:17.211560+0000","last_unstale":"2024-09-15T22:16:17.592298+0000","last_undegraded":"2024-09-15T22:16:17.592298+0000","last_fullsized":"2024-09-15T22:16:17.592298+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:59.944869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555126+0000","last_change":"2024-09-15T22:14:04.718038+0000","last_active":"2024-09-15T22:16:17.555126+0000","last_peered":"2024-09-15T22:16:17.555126+0000","last_clean":"2024-09-15T22:16:17.555126+0000","last_became_active":"2024-09-15T22:14:04.717683+0000","last_became_peered":"2024-09-15T22:14:04.717683+0000","last_unstale":"2024-09-15T22:16:17.555126+0000","last_undegraded":"2024-09-15T22:16:17.555126+0000","last_fullsized":"2024-09-15T22:16:17.555126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:23.557077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":360,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.558271+0000","last_change":"2024-09-15T22:12:55.022635+0000","last_active":"2024-09-15T22:16:17.558271+0000","last_peered":"2024-09-15T22:16:17.558271+0000","last_clean":"2024-09-15T22:16:17.558271+0000","last_became_active":"2024-09-15T22:12:55.022132+0000","last_became_peered":"2024-09-15T22:12:55.022132+0000","last_unstale":"2024-09-15T22:16:17.558271+0000","last_undegraded":"2024-09-15T22:16:17.558271+0000","last_fullsized":"2024-09-15T22:16:17.558271+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_clean_scrub_stamp":"2024-09-15T22:09:30.115505+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:50.060169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.560360+0000","last_change":"2024-09-15T22:14:13.849547+0000","last_active":"2024-09-15T22:16:17.560360+0000","last_peered":"2024-09-15T22:16:17.560360+0000","last_clean":"2024-09-15T22:16:17.560360+0000","last_became_active":"2024-09-15T22:14:13.849091+0000","last_became_peered":"2024-09-15T22:14:13.849091+0000","last_unstale":"2024-09-15T22:16:17.560360+0000","last_undegraded":"2024-09-15T22:16:17.560360+0000","last_fullsized":"2024-09-15T22:16:17.560360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:49.450958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596676+0000","last_change":"2024-09-15T22:14:06.816340+0000","last_active":"2024-09-15T22:16:17.596676+0000","last_peered":"2024-09-15T22:16:17.596676+0000","last_clean":"2024-09-15T22:16:17.596676+0000","last_became_active":"2024-09-15T22:14:06.815712+0000","last_became_peered":"2024-09-15T22:14:06.815712+0000","last_unstale":"2024-09-15T22:16:17.596676+0000","last_undegraded":"2024-09-15T22:16:17.596676+0000","last_fullsized":"2024-09-15T22:16:17.596676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:43.598512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553284+0000","last_change":"2024-09-15T22:14:05.197487+0000","last_active":"2024-09-15T22:16:17.553284+0000","last_peered":"2024-09-15T22:16:17.553284+0000","last_clean":"2024-09-15T22:16:17.553284+0000","last_became_active":"2024-09-15T22:14:05.197098+0000","last_became_peered":"2024-09-15T22:14:05.197098+0000","last_unstale":"2024-09-15T22:16:17.553284+0000","last_undegraded":"2024-09-15T22:16:17.553284+0000","last_fullsized":"2024-09-15T22:16:17.553284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:31.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.541960+0000","last_change":"2024-09-15T22:14:13.849594+0000","last_active":"2024-09-15T22:16:17.541960+0000","last_peered":"2024-09-15T22:16:17.541960+0000","last_clean":"2024-09-15T22:16:17.541960+0000","last_became_active":"2024-09-15T22:14:13.849157+0000","last_became_peered":"2024-09-15T22:14:13.849157+0000","last_unstale":"2024-09-15T22:16:17.541960+0000","last_undegraded":"2024-09-15T22:16:17.541960+0000","last_fullsized":"2024-09-15T22:16:17.541960+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:49.994107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.594031+0000","last_change":"2024-09-15T22:14:06.814312+0000","last_active":"2024-09-15T22:16:17.594031+0000","last_peered":"2024-09-15T22:16:17.594031+0000","last_clean":"2024-09-15T22:16:17.594031+0000","last_became_active":"2024-09-15T22:14:06.813959+0000","last_became_peered":"2024-09-15T22:14:06.813959+0000","last_unstale":"2024-09-15T22:16:17.594031+0000","last_undegraded":"2024-09-15T22:16:17.594031+0000","last_fullsized":"2024-09-15T22:16:17.594031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:36.924162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'39","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.801579+0000","last_change":"2024-09-15T22:14:04.713307+0000","last_active":"2024-09-15T22:16:17.801579+0000","last_peered":"2024-09-15T22:16:17.801579+0000","last_clean":"2024-09-15T22:16:17.801579+0000","last_became_active":"2024-09-15T22:14:04.712996+0000","last_became_peered":"2024-09-15T22:14:04.712996+0000","last_unstale":"2024-09-15T22:16:17.801579+0000","last_undegraded":"2024-09-15T22:16:17.801579+0000","last_fullsized":"2024-09-15T22:16:17.801579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:37.298679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.563300+0000","last_change":"2024-09-15T22:14:13.846087+0000","last_active":"2024-09-15T22:16:17.563300+0000","last_peered":"2024-09-15T22:16:17.563300+0000","last_clean":"2024-09-15T22:16:17.563300+0000","last_became_active":"2024-09-15T22:14:13.845731+0000","last_became_peered":"2024-09-15T22:14:13.845731+0000","last_unstale":"2024-09-15T22:16:17.563300+0000","last_undegraded":"2024-09-15T22:16:17.563300+0000","last_fullsized":"2024-09-15T22:16:17.563300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:24.621330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.581187+0000","last_change":"2024-09-15T22:14:06.809456+0000","last_active":"2024-09-15T22:16:17.581187+0000","last_peered":"2024-09-15T22:16:17.581187+0000","last_clean":"2024-09-15T22:16:17.581187+0000","last_became_active":"2024-09-15T22:14:06.809141+0000","last_became_peered":"2024-09-15T22:14:06.809141+0000","last_unstale":"2024-09-15T22:16:17.581187+0000","last_undegraded":"2024-09-15T22:16:17.581187+0000","last_fullsized":"2024-09-15T22:16:17.581187+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:30.186800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540903+0000","last_change":"2024-09-15T22:14:04.715399+0000","last_active":"2024-09-15T22:16:17.540903+0000","last_peered":"2024-09-15T22:16:17.540903+0000","last_clean":"2024-09-15T22:16:17.540903+0000","last_became_active":"2024-09-15T22:14:04.715043+0000","last_became_peered":"2024-09-15T22:14:04.715043+0000","last_unstale":"2024-09-15T22:16:17.540903+0000","last_undegraded":"2024-09-15T22:16:17.540903+0000","last_fullsized":"2024-09-15T22:16:17.540903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:13.860413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.544985+0000","last_change":"2024-09-15T22:14:13.851594+0000","last_active":"2024-09-15T22:16:17.544985+0000","last_peered":"2024-09-15T22:16:17.544985+0000","last_clean":"2024-09-15T22:16:17.544985+0000","last_became_active":"2024-09-15T22:14:13.851154+0000","last_became_peered":"2024-09-15T22:14:13.851154+0000","last_unstale":"2024-09-15T22:16:17.544985+0000","last_undegraded":"2024-09-15T22:16:17.544985+0000","last_fullsized":"2024-09-15T22:16:17.544985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:43.343808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579012+0000","last_change":"2024-09-15T22:15:17.219587+0000","last_active":"2024-09-15T22:16:17.579012+0000","last_peered":"2024-09-15T22:16:17.579012+0000","last_clean":"2024-09-15T22:16:17.579012+0000","last_became_active":"2024-09-15T22:15:17.219207+0000","last_became_peered":"2024-09-15T22:15:17.219207+0000","last_unstale":"2024-09-15T22:16:17.579012+0000","last_undegraded":"2024-09-15T22:16:17.579012+0000","last_fullsized":"2024-09-15T22:16:17.579012+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:34.267857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553915+0000","last_change":"2024-09-15T22:14:04.719550+0000","last_active":"2024-09-15T22:16:17.553915+0000","last_peered":"2024-09-15T22:16:17.553915+0000","last_clean":"2024-09-15T22:16:17.553915+0000","last_became_active":"2024-09-15T22:14:04.719273+0000","last_became_peered":"2024-09-15T22:14:04.719273+0000","last_unstale":"2024-09-15T22:16:17.553915+0000","last_undegraded":"2024-09-15T22:16:17.553915+0000","last_fullsized":"2024-09-15T22:16:17.553915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:20.973615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545033+0000","last_change":"2024-09-15T22:14:13.851420+0000","last_active":"2024-09-15T22:16:17.545033+0000","last_peered":"2024-09-15T22:16:17.545033+0000","last_clean":"2024-09-15T22:16:17.545033+0000","last_became_active":"2024-09-15T22:14:13.851051+0000","last_became_peered":"2024-09-15T22:14:13.851051+0000","last_unstale":"2024-09-15T22:16:17.545033+0000","last_undegraded":"2024-09-15T22:16:17.545033+0000","last_fullsized":"2024-09-15T22:16:17.545033+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:11.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595467+0000","last_change":"2024-09-15T22:14:06.809609+0000","last_active":"2024-09-15T22:16:17.595467+0000","last_peered":"2024-09-15T22:16:17.595467+0000","last_clean":"2024-09-15T22:16:17.595467+0000","last_became_active":"2024-09-15T22:14:06.809213+0000","last_became_peered":"2024-09-15T22:14:06.809213+0000","last_unstale":"2024-09-15T22:16:17.595467+0000","last_undegraded":"2024-09-15T22:16:17.595467+0000","last_fullsized":"2024-09-15T22:16:17.595467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:11.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553706+0000","last_change":"2024-09-15T22:14:05.017559+0000","last_active":"2024-09-15T22:16:17.553706+0000","last_peered":"2024-09-15T22:16:17.553706+0000","last_clean":"2024-09-15T22:16:17.553706+0000","last_became_active":"2024-09-15T22:14:05.017121+0000","last_became_peered":"2024-09-15T22:14:05.017121+0000","last_unstale":"2024-09-15T22:16:17.553706+0000","last_undegraded":"2024-09-15T22:16:17.553706+0000","last_fullsized":"2024-09-15T22:16:17.553706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:29:06.442532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540809+0000","last_change":"2024-09-15T22:14:13.847835+0000","last_active":"2024-09-15T22:16:17.540809+0000","last_peered":"2024-09-15T22:16:17.540809+0000","last_clean":"2024-09-15T22:16:17.540809+0000","last_became_active":"2024-09-15T22:14:13.847437+0000","last_became_peered":"2024-09-15T22:14:13.847437+0000","last_unstale":"2024-09-15T22:16:17.540809+0000","last_undegraded":"2024-09-15T22:16:17.540809+0000","last_fullsized":"2024-09-15T22:16:17.540809+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:48.036495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.586312+0000","last_change":"2024-09-15T22:14:06.813191+0000","last_active":"2024-09-15T22:16:17.586312+0000","last_peered":"2024-09-15T22:16:17.586312+0000","last_clean":"2024-09-15T22:16:17.586312+0000","last_became_active":"2024-09-15T22:14:06.812861+0000","last_became_peered":"2024-09-15T22:14:06.812861+0000","last_unstale":"2024-09-15T22:16:17.586312+0000","last_undegraded":"2024-09-15T22:16:17.586312+0000","last_fullsized":"2024-09-15T22:16:17.586312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:51.487591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554382+0000","last_change":"2024-09-15T22:14:04.718431+0000","last_active":"2024-09-15T22:16:17.554382+0000","last_peered":"2024-09-15T22:16:17.554382+0000","last_clean":"2024-09-15T22:16:17.554382+0000","last_became_active":"2024-09-15T22:14:04.718109+0000","last_became_peered":"2024-09-15T22:14:04.718109+0000","last_unstale":"2024-09-15T22:16:17.554382+0000","last_undegraded":"2024-09-15T22:16:17.554382+0000","last_fullsized":"2024-09-15T22:16:17.554382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:10.408634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557287+0000","last_change":"2024-09-15T22:14:13.845179+0000","last_active":"2024-09-15T22:16:17.557287+0000","last_peered":"2024-09-15T22:16:17.557287+0000","last_clean":"2024-09-15T22:16:17.557287+0000","last_became_active":"2024-09-15T22:14:13.844795+0000","last_became_peered":"2024-09-15T22:14:13.844795+0000","last_unstale":"2024-09-15T22:16:17.557287+0000","last_undegraded":"2024-09-15T22:16:17.557287+0000","last_fullsized":"2024-09-15T22:16:17.557287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:24.113536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602323+0000","last_change":"2024-09-15T22:14:06.809687+0000","last_active":"2024-09-15T22:16:17.602323+0000","last_peered":"2024-09-15T22:16:17.602323+0000","last_clean":"2024-09-15T22:16:17.602323+0000","last_became_active":"2024-09-15T22:14:06.809383+0000","last_became_peered":"2024-09-15T22:14:06.809383+0000","last_unstale":"2024-09-15T22:16:17.602323+0000","last_undegraded":"2024-09-15T22:16:17.602323+0000","last_fullsized":"2024-09-15T22:16:17.602323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:19.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545298+0000","last_change":"2024-09-15T22:14:04.720577+0000","last_active":"2024-09-15T22:16:17.545298+0000","last_peered":"2024-09-15T22:16:17.545298+0000","last_clean":"2024-09-15T22:16:17.545298+0000","last_became_active":"2024-09-15T22:14:04.720235+0000","last_became_peered":"2024-09-15T22:14:04.720235+0000","last_unstale":"2024-09-15T22:16:17.545298+0000","last_undegraded":"2024-09-15T22:16:17.545298+0000","last_fullsized":"2024-09-15T22:16:17.545298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:17.501061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.559191+0000","last_change":"2024-09-15T22:14:13.854841+0000","last_active":"2024-09-15T22:16:17.559191+0000","last_peered":"2024-09-15T22:16:17.559191+0000","last_clean":"2024-09-15T22:16:17.559191+0000","last_became_active":"2024-09-15T22:14:13.854336+0000","last_became_peered":"2024-09-15T22:14:13.854336+0000","last_unstale":"2024-09-15T22:16:17.559191+0000","last_undegraded":"2024-09-15T22:16:17.559191+0000","last_fullsized":"2024-09-15T22:16:17.559191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:13.819532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.600352+0000","last_change":"2024-09-15T22:14:06.806829+0000","last_active":"2024-09-15T22:16:17.600352+0000","last_peered":"2024-09-15T22:16:17.600352+0000","last_clean":"2024-09-15T22:16:17.600352+0000","last_became_active":"2024-09-15T22:14:06.806521+0000","last_became_peered":"2024-09-15T22:14:06.806521+0000","last_unstale":"2024-09-15T22:16:17.600352+0000","last_undegraded":"2024-09-15T22:16:17.600352+0000","last_fullsized":"2024-09-15T22:16:17.600352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:50.983246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552219+0000","last_change":"2024-09-15T22:14:04.717722+0000","last_active":"2024-09-15T22:16:17.552219+0000","last_peered":"2024-09-15T22:16:17.552219+0000","last_clean":"2024-09-15T22:16:17.552219+0000","last_became_active":"2024-09-15T22:14:04.717201+0000","last_became_peered":"2024-09-15T22:14:04.717201+0000","last_unstale":"2024-09-15T22:16:17.552219+0000","last_undegraded":"2024-09-15T22:16:17.552219+0000","last_fullsized":"2024-09-15T22:16:17.552219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:50.545847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545450+0000","last_change":"2024-09-15T22:14:13.852874+0000","last_active":"2024-09-15T22:16:17.545450+0000","last_peered":"2024-09-15T22:16:17.545450+0000","last_clean":"2024-09-15T22:16:17.545450+0000","last_became_active":"2024-09-15T22:14:13.852426+0000","last_became_peered":"2024-09-15T22:14:13.852426+0000","last_unstale":"2024-09-15T22:16:17.545450+0000","last_undegraded":"2024-09-15T22:16:17.545450+0000","last_fullsized":"2024-09-15T22:16:17.545450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:02:19.215156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579371+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:16:17.579371+0000","last_peered":"2024-09-15T22:16:17.579371+0000","last_clean":"2024-09-15T22:16:17.579371+0000","last_became_active":"2024-09-15T22:14:06.809013+0000","last_became_peered":"2024-09-15T22:14:06.809013+0000","last_unstale":"2024-09-15T22:16:17.579371+0000","last_undegraded":"2024-09-15T22:16:17.579371+0000","last_fullsized":"2024-09-15T22:16:17.579371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:47.830385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:18.087848+0000","last_change":"2024-09-15T22:14:04.721020+0000","last_active":"2024-09-15T22:16:18.087848+0000","last_peered":"2024-09-15T22:16:18.087848+0000","last_clean":"2024-09-15T22:16:18.087848+0000","last_became_active":"2024-09-15T22:14:04.720613+0000","last_became_peered":"2024-09-15T22:14:04.720613+0000","last_unstale":"2024-09-15T22:16:18.087848+0000","last_undegraded":"2024-09-15T22:16:18.087848+0000","last_fullsized":"2024-09-15T22:16:18.087848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:42.719346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71847,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":200,"num_read_kb":171,"num_write":38,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555319+0000","last_change":"2024-09-15T22:14:13.854250+0000","last_active":"2024-09-15T22:16:17.555319+0000","last_peered":"2024-09-15T22:16:17.555319+0000","last_clean":"2024-09-15T22:16:17.555319+0000","last_became_active":"2024-09-15T22:14:13.852972+0000","last_became_peered":"2024-09-15T22:14:13.852972+0000","last_unstale":"2024-09-15T22:16:17.555319+0000","last_undegraded":"2024-09-15T22:16:17.555319+0000","last_fullsized":"2024-09-15T22:16:17.555319+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:50:45.301446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596123+0000","last_change":"2024-09-15T22:14:06.813789+0000","last_active":"2024-09-15T22:16:17.596123+0000","last_peered":"2024-09-15T22:16:17.596123+0000","last_clean":"2024-09-15T22:16:17.596123+0000","last_became_active":"2024-09-15T22:14:06.813501+0000","last_became_peered":"2024-09-15T22:14:06.813501+0000","last_unstale":"2024-09-15T22:16:17.596123+0000","last_undegraded":"2024-09-15T22:16:17.596123+0000","last_fullsized":"2024-09-15T22:16:17.596123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:40.032952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545586+0000","last_change":"2024-09-15T22:14:05.018957+0000","last_active":"2024-09-15T22:16:17.545586+0000","last_peered":"2024-09-15T22:16:17.545586+0000","last_clean":"2024-09-15T22:16:17.545586+0000","last_became_active":"2024-09-15T22:14:05.018602+0000","last_became_peered":"2024-09-15T22:14:05.018602+0000","last_unstale":"2024-09-15T22:16:17.545586+0000","last_undegraded":"2024-09-15T22:16:17.545586+0000","last_fullsized":"2024-09-15T22:16:17.545586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:48.839341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555029+0000","last_change":"2024-09-15T22:15:17.332417+0000","last_active":"2024-09-15T22:16:17.555029+0000","last_peered":"2024-09-15T22:16:17.555029+0000","last_clean":"2024-09-15T22:16:17.555029+0000","last_became_active":"2024-09-15T22:15:17.331771+0000","last_became_peered":"2024-09-15T22:15:17.331771+0000","last_unstale":"2024-09-15T22:16:17.555029+0000","last_undegraded":"2024-09-15T22:16:17.555029+0000","last_fullsized":"2024-09-15T22:16:17.555029+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:08.575035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603399+0000","last_change":"2024-09-15T22:14:06.814876+0000","last_active":"2024-09-15T22:16:17.603399+0000","last_peered":"2024-09-15T22:16:17.603399+0000","last_clean":"2024-09-15T22:16:17.603399+0000","last_became_active":"2024-09-15T22:14:06.814120+0000","last_became_peered":"2024-09-15T22:14:06.814120+0000","last_unstale":"2024-09-15T22:16:17.603399+0000","last_undegraded":"2024-09-15T22:16:17.603399+0000","last_fullsized":"2024-09-15T22:16:17.603399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:37.417618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555309+0000","last_change":"2024-09-15T22:14:04.719281+0000","last_active":"2024-09-15T22:16:17.555309+0000","last_peered":"2024-09-15T22:16:17.555309+0000","last_clean":"2024-09-15T22:16:17.555309+0000","last_became_active":"2024-09-15T22:14:04.718856+0000","last_became_peered":"2024-09-15T22:14:04.718856+0000","last_unstale":"2024-09-15T22:16:17.555309+0000","last_undegraded":"2024-09-15T22:16:17.555309+0000","last_fullsized":"2024-09-15T22:16:17.555309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:22.137825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554629+0000","last_change":"2024-09-15T22:14:13.847398+0000","last_active":"2024-09-15T22:16:17.554629+0000","last_peered":"2024-09-15T22:16:17.554629+0000","last_clean":"2024-09-15T22:16:17.554629+0000","last_became_active":"2024-09-15T22:14:13.846870+0000","last_became_peered":"2024-09-15T22:14:13.846870+0000","last_unstale":"2024-09-15T22:16:17.554629+0000","last_undegraded":"2024-09-15T22:16:17.554629+0000","last_fullsized":"2024-09-15T22:16:17.554629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:58.872716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595875+0000","last_change":"2024-09-15T22:14:06.810412+0000","last_active":"2024-09-15T22:16:17.595875+0000","last_peered":"2024-09-15T22:16:17.595875+0000","last_clean":"2024-09-15T22:16:17.595875+0000","last_became_active":"2024-09-15T22:14:06.809669+0000","last_became_peered":"2024-09-15T22:14:06.809669+0000","last_unstale":"2024-09-15T22:16:17.595875+0000","last_undegraded":"2024-09-15T22:16:17.595875+0000","last_fullsized":"2024-09-15T22:16:17.595875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:44.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.549857+0000","last_change":"2024-09-15T22:14:04.715509+0000","last_active":"2024-09-15T22:16:17.549857+0000","last_peered":"2024-09-15T22:16:17.549857+0000","last_clean":"2024-09-15T22:16:17.549857+0000","last_became_active":"2024-09-15T22:14:04.715169+0000","last_became_peered":"2024-09-15T22:14:04.715169+0000","last_unstale":"2024-09-15T22:16:17.549857+0000","last_undegraded":"2024-09-15T22:16:17.549857+0000","last_fullsized":"2024-09-15T22:16:17.549857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:21.884103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554221+0000","last_change":"2024-09-15T22:15:17.219519+0000","last_active":"2024-09-15T22:16:17.554221+0000","last_peered":"2024-09-15T22:16:17.554221+0000","last_clean":"2024-09-15T22:16:17.554221+0000","last_became_active":"2024-09-15T22:15:17.219106+0000","last_became_peered":"2024-09-15T22:15:17.219106+0000","last_unstale":"2024-09-15T22:16:17.554221+0000","last_undegraded":"2024-09-15T22:16:17.554221+0000","last_fullsized":"2024-09-15T22:16:17.554221+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:54:08.102329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.562557+0000","last_change":"2024-09-15T22:14:13.844375+0000","last_active":"2024-09-15T22:16:17.562557+0000","last_peered":"2024-09-15T22:16:17.562557+0000","last_clean":"2024-09-15T22:16:17.562557+0000","last_became_active":"2024-09-15T22:14:13.843918+0000","last_became_peered":"2024-09-15T22:14:13.843918+0000","last_unstale":"2024-09-15T22:16:17.562557+0000","last_undegraded":"2024-09-15T22:16:17.562557+0000","last_fullsized":"2024-09-15T22:16:17.562557+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:32.190119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606349+0000","last_change":"2024-09-15T22:14:06.809534+0000","last_active":"2024-09-15T22:16:17.606349+0000","last_peered":"2024-09-15T22:16:17.606349+0000","last_clean":"2024-09-15T22:16:17.606349+0000","last_became_active":"2024-09-15T22:14:06.809147+0000","last_became_peered":"2024-09-15T22:14:06.809147+0000","last_unstale":"2024-09-15T22:16:17.606349+0000","last_undegraded":"2024-09-15T22:16:17.606349+0000","last_fullsized":"2024-09-15T22:16:17.606349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:14.930542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545382+0000","last_change":"2024-09-15T22:14:04.715347+0000","last_active":"2024-09-15T22:16:17.545382+0000","last_peered":"2024-09-15T22:16:17.545382+0000","last_clean":"2024-09-15T22:16:17.545382+0000","last_became_active":"2024-09-15T22:14:04.715049+0000","last_became_peered":"2024-09-15T22:14:04.715049+0000","last_unstale":"2024-09-15T22:16:17.545382+0000","last_undegraded":"2024-09-15T22:16:17.545382+0000","last_fullsized":"2024-09-15T22:16:17.545382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:04.943344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.567570+0000","last_change":"2024-09-15T22:14:13.852397+0000","last_active":"2024-09-15T22:16:17.567570+0000","last_peered":"2024-09-15T22:16:17.567570+0000","last_clean":"2024-09-15T22:16:17.567570+0000","last_became_active":"2024-09-15T22:14:13.851863+0000","last_became_peered":"2024-09-15T22:14:13.851863+0000","last_unstale":"2024-09-15T22:16:17.567570+0000","last_undegraded":"2024-09-15T22:16:17.567570+0000","last_fullsized":"2024-09-15T22:16:17.567570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:38.242241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606188+0000","last_change":"2024-09-15T22:14:06.809084+0000","last_active":"2024-09-15T22:16:17.606188+0000","last_peered":"2024-09-15T22:16:17.606188+0000","last_clean":"2024-09-15T22:16:17.606188+0000","last_became_active":"2024-09-15T22:14:06.808725+0000","last_became_peered":"2024-09-15T22:14:06.808725+0000","last_unstale":"2024-09-15T22:16:17.606188+0000","last_undegraded":"2024-09-15T22:16:17.606188+0000","last_fullsized":"2024-09-15T22:16:17.606188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:37.451661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540329+0000","last_change":"2024-09-15T22:14:04.714279+0000","last_active":"2024-09-15T22:16:17.540329+0000","last_peered":"2024-09-15T22:16:17.540329+0000","last_clean":"2024-09-15T22:16:17.540329+0000","last_became_active":"2024-09-15T22:14:04.713751+0000","last_became_peered":"2024-09-15T22:14:04.713751+0000","last_unstale":"2024-09-15T22:16:17.540329+0000","last_undegraded":"2024-09-15T22:16:17.540329+0000","last_fullsized":"2024-09-15T22:16:17.540329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:34.268701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.549598+0000","last_change":"2024-09-15T22:14:04.716417+0000","last_active":"2024-09-15T22:16:17.549598+0000","last_peered":"2024-09-15T22:16:17.549598+0000","last_clean":"2024-09-15T22:16:17.549598+0000","last_became_active":"2024-09-15T22:14:04.716096+0000","last_became_peered":"2024-09-15T22:14:04.716096+0000","last_unstale":"2024-09-15T22:16:17.549598+0000","last_undegraded":"2024-09-15T22:16:17.549598+0000","last_fullsized":"2024-09-15T22:16:17.549598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:30.819060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601287+0000","last_change":"2024-09-15T22:15:17.403940+0000","last_active":"2024-09-15T22:16:17.601287+0000","last_peered":"2024-09-15T22:16:17.601287+0000","last_clean":"2024-09-15T22:16:17.601287+0000","last_became_active":"2024-09-15T22:15:17.403517+0000","last_became_peered":"2024-09-15T22:15:17.403517+0000","last_unstale":"2024-09-15T22:16:17.601287+0000","last_undegraded":"2024-09-15T22:16:17.601287+0000","last_fullsized":"2024-09-15T22:16:17.601287+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:49.602367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552004+0000","last_change":"2024-09-15T22:15:17.404136+0000","last_active":"2024-09-15T22:16:17.552004+0000","last_peered":"2024-09-15T22:16:17.552004+0000","last_clean":"2024-09-15T22:16:17.552004+0000","last_became_active":"2024-09-15T22:15:17.403652+0000","last_became_peered":"2024-09-15T22:15:17.403652+0000","last_unstale":"2024-09-15T22:16:17.552004+0000","last_undegraded":"2024-09-15T22:16:17.552004+0000","last_fullsized":"2024-09-15T22:16:17.552004+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:31.518956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545473+0000","last_change":"2024-09-15T22:14:04.718682+0000","last_active":"2024-09-15T22:16:17.545473+0000","last_peered":"2024-09-15T22:16:17.545473+0000","last_clean":"2024-09-15T22:16:17.545473+0000","last_became_active":"2024-09-15T22:14:04.718313+0000","last_became_peered":"2024-09-15T22:14:04.718313+0000","last_unstale":"2024-09-15T22:16:17.545473+0000","last_undegraded":"2024-09-15T22:16:17.545473+0000","last_fullsized":"2024-09-15T22:16:17.545473+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:47.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595742+0000","last_change":"2024-09-15T22:14:06.819632+0000","last_active":"2024-09-15T22:16:17.595742+0000","last_peered":"2024-09-15T22:16:17.595742+0000","last_clean":"2024-09-15T22:16:17.595742+0000","last_became_active":"2024-09-15T22:14:06.819135+0000","last_became_peered":"2024-09-15T22:14:06.819135+0000","last_unstale":"2024-09-15T22:16:17.595742+0000","last_undegraded":"2024-09-15T22:16:17.595742+0000","last_fullsized":"2024-09-15T22:16:17.595742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:35.708318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552345+0000","last_change":"2024-09-15T22:14:13.851367+0000","last_active":"2024-09-15T22:16:17.552345+0000","last_peered":"2024-09-15T22:16:17.552345+0000","last_clean":"2024-09-15T22:16:17.552345+0000","last_became_active":"2024-09-15T22:14:13.850999+0000","last_became_peered":"2024-09-15T22:14:13.850999+0000","last_unstale":"2024-09-15T22:16:17.552345+0000","last_undegraded":"2024-09-15T22:16:17.552345+0000","last_fullsized":"2024-09-15T22:16:17.552345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:40:03.957622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582014+0000","last_change":"2024-09-15T22:14:06.817213+0000","last_active":"2024-09-15T22:16:17.582014+0000","last_peered":"2024-09-15T22:16:17.582014+0000","last_clean":"2024-09-15T22:16:17.582014+0000","last_became_active":"2024-09-15T22:14:06.816828+0000","last_became_peered":"2024-09-15T22:14:06.816828+0000","last_unstale":"2024-09-15T22:16:17.582014+0000","last_undegraded":"2024-09-15T22:16:17.582014+0000","last_fullsized":"2024-09-15T22:16:17.582014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:55.042256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.590899+0000","last_change":"2024-09-15T22:14:06.814832+0000","last_active":"2024-09-15T22:16:17.590899+0000","last_peered":"2024-09-15T22:16:17.590899+0000","last_clean":"2024-09-15T22:16:17.590899+0000","last_became_active":"2024-09-15T22:14:06.814500+0000","last_became_peered":"2024-09-15T22:14:06.814500+0000","last_unstale":"2024-09-15T22:16:17.590899+0000","last_undegraded":"2024-09-15T22:16:17.590899+0000","last_fullsized":"2024-09-15T22:16:17.590899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:43.623629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603884+0000","last_change":"2024-09-15T22:14:06.809464+0000","last_active":"2024-09-15T22:16:17.603884+0000","last_peered":"2024-09-15T22:16:17.603884+0000","last_clean":"2024-09-15T22:16:17.603884+0000","last_became_active":"2024-09-15T22:14:06.809160+0000","last_became_peered":"2024-09-15T22:14:06.809160+0000","last_unstale":"2024-09-15T22:16:17.603884+0000","last_undegraded":"2024-09-15T22:16:17.603884+0000","last_fullsized":"2024-09-15T22:16:17.603884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:04.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606874+0000","last_change":"2024-09-15T22:14:06.814428+0000","last_active":"2024-09-15T22:16:17.606874+0000","last_peered":"2024-09-15T22:16:17.606874+0000","last_clean":"2024-09-15T22:16:17.606874+0000","last_became_active":"2024-09-15T22:14:06.814100+0000","last_became_peered":"2024-09-15T22:14:06.814100+0000","last_unstale":"2024-09-15T22:16:17.606874+0000","last_undegraded":"2024-09-15T22:16:17.606874+0000","last_fullsized":"2024-09-15T22:16:17.606874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:33.606766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606907+0000","last_change":"2024-09-15T22:14:06.815638+0000","last_active":"2024-09-15T22:16:17.606907+0000","last_peered":"2024-09-15T22:16:17.606907+0000","last_clean":"2024-09-15T22:16:17.606907+0000","last_became_active":"2024-09-15T22:14:06.815327+0000","last_became_peered":"2024-09-15T22:14:06.815327+0000","last_unstale":"2024-09-15T22:16:17.606907+0000","last_undegraded":"2024-09-15T22:16:17.606907+0000","last_fullsized":"2024-09-15T22:16:17.606907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:07.679547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.580925+0000","last_change":"2024-09-15T22:15:17.218238+0000","last_active":"2024-09-15T22:16:17.580925+0000","last_peered":"2024-09-15T22:16:17.580925+0000","last_clean":"2024-09-15T22:16:17.580925+0000","last_became_active":"2024-09-15T22:15:17.217852+0000","last_became_peered":"2024-09-15T22:15:17.217852+0000","last_unstale":"2024-09-15T22:16:17.580925+0000","last_undegraded":"2024-09-15T22:16:17.580925+0000","last_fullsized":"2024-09-15T22:16:17.580925+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:42.046956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.576752+0000","last_change":"2024-09-15T22:14:06.819667+0000","last_active":"2024-09-15T22:16:17.576752+0000","last_peered":"2024-09-15T22:16:17.576752+0000","last_clean":"2024-09-15T22:16:17.576752+0000","last_became_active":"2024-09-15T22:14:06.819389+0000","last_became_peered":"2024-09-15T22:14:06.819389+0000","last_unstale":"2024-09-15T22:16:17.576752+0000","last_undegraded":"2024-09-15T22:16:17.576752+0000","last_fullsized":"2024-09-15T22:16:17.576752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:16.571088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596695+0000","last_change":"2024-09-15T22:15:17.118133+0000","last_active":"2024-09-15T22:16:17.596695+0000","last_peered":"2024-09-15T22:16:17.596695+0000","last_clean":"2024-09-15T22:16:17.596695+0000","last_became_active":"2024-09-15T22:15:17.117802+0000","last_became_peered":"2024-09-15T22:15:17.117802+0000","last_unstale":"2024-09-15T22:16:17.596695+0000","last_undegraded":"2024-09-15T22:16:17.596695+0000","last_fullsized":"2024-09-15T22:16:17.596695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:21.523149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.600039+0000","last_change":"2024-09-15T22:14:06.801454+0000","last_active":"2024-09-15T22:16:17.600039+0000","last_peered":"2024-09-15T22:16:17.600039+0000","last_clean":"2024-09-15T22:16:17.600039+0000","last_became_active":"2024-09-15T22:14:06.801105+0000","last_became_peered":"2024-09-15T22:14:06.801105+0000","last_unstale":"2024-09-15T22:16:17.600039+0000","last_undegraded":"2024-09-15T22:16:17.600039+0000","last_fullsized":"2024-09-15T22:16:17.600039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:32.457428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596129+0000","last_change":"2024-09-15T22:14:06.812603+0000","last_active":"2024-09-15T22:16:17.596129+0000","last_peered":"2024-09-15T22:16:17.596129+0000","last_clean":"2024-09-15T22:16:17.596129+0000","last_became_active":"2024-09-15T22:14:06.812208+0000","last_became_peered":"2024-09-15T22:14:06.812208+0000","last_unstale":"2024-09-15T22:16:17.596129+0000","last_undegraded":"2024-09-15T22:16:17.596129+0000","last_fullsized":"2024-09-15T22:16:17.596129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:55.327481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595669+0000","last_change":"2024-09-15T22:14:06.811783+0000","last_active":"2024-09-15T22:16:17.595669+0000","last_peered":"2024-09-15T22:16:17.595669+0000","last_clean":"2024-09-15T22:16:17.595669+0000","last_became_active":"2024-09-15T22:14:06.811208+0000","last_became_peered":"2024-09-15T22:14:06.811208+0000","last_unstale":"2024-09-15T22:16:17.595669+0000","last_undegraded":"2024-09-15T22:16:17.595669+0000","last_fullsized":"2024-09-15T22:16:17.595669+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:15.576776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604634+0000","last_change":"2024-09-15T22:14:06.818608+0000","last_active":"2024-09-15T22:16:17.604634+0000","last_peered":"2024-09-15T22:16:17.604634+0000","last_clean":"2024-09-15T22:16:17.604634+0000","last_became_active":"2024-09-15T22:14:06.818283+0000","last_became_peered":"2024-09-15T22:14:06.818283+0000","last_unstale":"2024-09-15T22:16:17.604634+0000","last_undegraded":"2024-09-15T22:16:17.604634+0000","last_fullsized":"2024-09-15T22:16:17.604634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:02.477461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.593419+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:16:17.593419+0000","last_peered":"2024-09-15T22:16:17.593419+0000","last_clean":"2024-09-15T22:16:17.593419+0000","last_became_active":"2024-09-15T22:14:06.809043+0000","last_became_peered":"2024-09-15T22:14:06.809043+0000","last_unstale":"2024-09-15T22:16:17.593419+0000","last_undegraded":"2024-09-15T22:16:17.593419+0000","last_fullsized":"2024-09-15T22:16:17.593419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:58.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.590289+0000","last_change":"2024-09-15T22:14:06.814875+0000","last_active":"2024-09-15T22:16:17.590289+0000","last_peered":"2024-09-15T22:16:17.590289+0000","last_clean":"2024-09-15T22:16:17.590289+0000","last_became_active":"2024-09-15T22:14:06.814543+0000","last_became_peered":"2024-09-15T22:14:06.814543+0000","last_unstale":"2024-09-15T22:16:17.590289+0000","last_undegraded":"2024-09-15T22:16:17.590289+0000","last_fullsized":"2024-09-15T22:16:17.590289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:57.465965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.593270+0000","last_change":"2024-09-15T22:14:06.810655+0000","last_active":"2024-09-15T22:16:17.593270+0000","last_peered":"2024-09-15T22:16:17.593270+0000","last_clean":"2024-09-15T22:16:17.593270+0000","last_became_active":"2024-09-15T22:14:06.810159+0000","last_became_peered":"2024-09-15T22:14:06.810159+0000","last_unstale":"2024-09-15T22:16:17.593270+0000","last_undegraded":"2024-09-15T22:16:17.593270+0000","last_fullsized":"2024-09-15T22:16:17.593270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:17.368982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603230+0000","last_change":"2024-09-15T22:14:06.815048+0000","last_active":"2024-09-15T22:16:17.603230+0000","last_peered":"2024-09-15T22:16:17.603230+0000","last_clean":"2024-09-15T22:16:17.603230+0000","last_became_active":"2024-09-15T22:14:06.814744+0000","last_became_peered":"2024-09-15T22:14:06.814744+0000","last_unstale":"2024-09-15T22:16:17.603230+0000","last_undegraded":"2024-09-15T22:16:17.603230+0000","last_fullsized":"2024-09-15T22:16:17.603230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:26.927942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606870+0000","last_change":"2024-09-15T22:14:06.811672+0000","last_active":"2024-09-15T22:16:17.606870+0000","last_peered":"2024-09-15T22:16:17.606870+0000","last_clean":"2024-09-15T22:16:17.606870+0000","last_became_active":"2024-09-15T22:14:06.811300+0000","last_became_peered":"2024-09-15T22:14:06.811300+0000","last_unstale":"2024-09-15T22:16:17.606870+0000","last_undegraded":"2024-09-15T22:16:17.606870+0000","last_fullsized":"2024-09-15T22:16:17.606870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:46.223584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602861+0000","last_change":"2024-09-15T22:14:06.814495+0000","last_active":"2024-09-15T22:16:17.602861+0000","last_peered":"2024-09-15T22:16:17.602861+0000","last_clean":"2024-09-15T22:16:17.602861+0000","last_became_active":"2024-09-15T22:14:06.814142+0000","last_became_peered":"2024-09-15T22:14:06.814142+0000","last_unstale":"2024-09-15T22:16:17.602861+0000","last_undegraded":"2024-09-15T22:16:17.602861+0000","last_fullsized":"2024-09-15T22:16:17.602861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:20.374348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606219+0000","last_change":"2024-09-15T22:14:06.811063+0000","last_active":"2024-09-15T22:16:17.606219+0000","last_peered":"2024-09-15T22:16:17.606219+0000","last_clean":"2024-09-15T22:16:17.606219+0000","last_became_active":"2024-09-15T22:14:06.810700+0000","last_became_peered":"2024-09-15T22:14:06.810700+0000","last_unstale":"2024-09-15T22:16:17.606219+0000","last_undegraded":"2024-09-15T22:16:17.606219+0000","last_fullsized":"2024-09-15T22:16:17.606219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:11.250590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605660+0000","last_change":"2024-09-15T22:14:06.816896+0000","last_active":"2024-09-15T22:16:17.605660+0000","last_peered":"2024-09-15T22:16:17.605660+0000","last_clean":"2024-09-15T22:16:17.605660+0000","last_became_active":"2024-09-15T22:14:06.816559+0000","last_became_peered":"2024-09-15T22:14:06.816559+0000","last_unstale":"2024-09-15T22:16:17.605660+0000","last_undegraded":"2024-09-15T22:16:17.605660+0000","last_fullsized":"2024-09-15T22:16:17.605660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:17.965490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.591968+0000","last_change":"2024-09-15T22:14:06.813984+0000","last_active":"2024-09-15T22:16:17.591968+0000","last_peered":"2024-09-15T22:16:17.591968+0000","last_clean":"2024-09-15T22:16:17.591968+0000","last_became_active":"2024-09-15T22:14:06.813586+0000","last_became_peered":"2024-09-15T22:14:06.813586+0000","last_unstale":"2024-09-15T22:16:17.591968+0000","last_undegraded":"2024-09-15T22:16:17.591968+0000","last_fullsized":"2024-09-15T22:16:17.591968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:34.335741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596558+0000","last_change":"2024-09-15T22:14:06.816047+0000","last_active":"2024-09-15T22:16:17.596558+0000","last_peered":"2024-09-15T22:16:17.596558+0000","last_clean":"2024-09-15T22:16:17.596558+0000","last_became_active":"2024-09-15T22:14:06.815244+0000","last_became_peered":"2024-09-15T22:14:06.815244+0000","last_unstale":"2024-09-15T22:16:17.596558+0000","last_undegraded":"2024-09-15T22:16:17.596558+0000","last_fullsized":"2024-09-15T22:16:17.596558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:30.469382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.583325+0000","last_change":"2024-09-15T22:14:06.813254+0000","last_active":"2024-09-15T22:16:17.583325+0000","last_peered":"2024-09-15T22:16:17.583325+0000","last_clean":"2024-09-15T22:16:17.583325+0000","last_became_active":"2024-09-15T22:14:06.812921+0000","last_became_peered":"2024-09-15T22:14:06.812921+0000","last_unstale":"2024-09-15T22:16:17.583325+0000","last_undegraded":"2024-09-15T22:16:17.583325+0000","last_fullsized":"2024-09-15T22:16:17.583325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:40.674246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595905+0000","last_change":"2024-09-15T22:14:06.817016+0000","last_active":"2024-09-15T22:16:17.595905+0000","last_peered":"2024-09-15T22:16:17.595905+0000","last_clean":"2024-09-15T22:16:17.595905+0000","last_became_active":"2024-09-15T22:14:06.816256+0000","last_became_peered":"2024-09-15T22:14:06.816256+0000","last_unstale":"2024-09-15T22:16:17.595905+0000","last_undegraded":"2024-09-15T22:16:17.595905+0000","last_fullsized":"2024-09-15T22:16:17.595905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:37.092156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.585070+0000","last_change":"2024-09-15T22:15:17.331108+0000","last_active":"2024-09-15T22:16:17.585070+0000","last_peered":"2024-09-15T22:16:17.585070+0000","last_clean":"2024-09-15T22:16:17.585070+0000","last_became_active":"2024-09-15T22:15:17.330765+0000","last_became_peered":"2024-09-15T22:15:17.330765+0000","last_unstale":"2024-09-15T22:16:17.585070+0000","last_undegraded":"2024-09-15T22:16:17.585070+0000","last_fullsized":"2024-09-15T22:16:17.585070+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:37.975326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582652+0000","last_change":"2024-09-15T22:14:06.814902+0000","last_active":"2024-09-15T22:16:17.582652+0000","last_peered":"2024-09-15T22:16:17.582652+0000","last_clean":"2024-09-15T22:16:17.582652+0000","last_became_active":"2024-09-15T22:14:06.814563+0000","last_became_peered":"2024-09-15T22:14:06.814563+0000","last_unstale":"2024-09-15T22:16:17.582652+0000","last_undegraded":"2024-09-15T22:16:17.582652+0000","last_fullsized":"2024-09-15T22:16:17.582652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:02.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.580466+0000","last_change":"2024-09-15T22:14:06.807444+0000","last_active":"2024-09-15T22:16:17.580466+0000","last_peered":"2024-09-15T22:16:17.580466+0000","last_clean":"2024-09-15T22:16:17.580466+0000","last_became_active":"2024-09-15T22:14:06.807083+0000","last_became_peered":"2024-09-15T22:14:06.807083+0000","last_unstale":"2024-09-15T22:16:17.580466+0000","last_undegraded":"2024-09-15T22:16:17.580466+0000","last_fullsized":"2024-09-15T22:16:17.580466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:07.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598596+0000","last_change":"2024-09-15T22:14:06.811851+0000","last_active":"2024-09-15T22:16:17.598596+0000","last_peered":"2024-09-15T22:16:17.598596+0000","last_clean":"2024-09-15T22:16:17.598596+0000","last_became_active":"2024-09-15T22:14:06.811451+0000","last_became_peered":"2024-09-15T22:14:06.811451+0000","last_unstale":"2024-09-15T22:16:17.598596+0000","last_undegraded":"2024-09-15T22:16:17.598596+0000","last_fullsized":"2024-09-15T22:16:17.598596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:51.389555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.589842+0000","last_change":"2024-09-15T22:14:06.812520+0000","last_active":"2024-09-15T22:16:17.589842+0000","last_peered":"2024-09-15T22:16:17.589842+0000","last_clean":"2024-09-15T22:16:17.589842+0000","last_became_active":"2024-09-15T22:14:06.812222+0000","last_became_peered":"2024-09-15T22:14:06.812222+0000","last_unstale":"2024-09-15T22:16:17.589842+0000","last_undegraded":"2024-09-15T22:16:17.589842+0000","last_fullsized":"2024-09-15T22:16:17.589842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:01.589678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604461+0000","last_change":"2024-09-15T22:14:06.808649+0000","last_active":"2024-09-15T22:16:17.604461+0000","last_peered":"2024-09-15T22:16:17.604461+0000","last_clean":"2024-09-15T22:16:17.604461+0000","last_became_active":"2024-09-15T22:14:06.808278+0000","last_became_peered":"2024-09-15T22:14:06.808278+0000","last_unstale":"2024-09-15T22:16:17.604461+0000","last_undegraded":"2024-09-15T22:16:17.604461+0000","last_fullsized":"2024-09-15T22:16:17.604461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:32.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605104+0000","last_change":"2024-09-15T22:14:06.811593+0000","last_active":"2024-09-15T22:16:17.605104+0000","last_peered":"2024-09-15T22:16:17.605104+0000","last_clean":"2024-09-15T22:16:17.605104+0000","last_became_active":"2024-09-15T22:14:06.811285+0000","last_became_peered":"2024-09-15T22:14:06.811285+0000","last_unstale":"2024-09-15T22:16:17.605104+0000","last_undegraded":"2024-09-15T22:16:17.605104+0000","last_fullsized":"2024-09-15T22:16:17.605104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:36.482554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604430+0000","last_change":"2024-09-15T22:14:06.816084+0000","last_active":"2024-09-15T22:16:17.604430+0000","last_peered":"2024-09-15T22:16:17.604430+0000","last_clean":"2024-09-15T22:16:17.604430+0000","last_became_active":"2024-09-15T22:14:06.815461+0000","last_became_peered":"2024-09-15T22:14:06.815461+0000","last_unstale":"2024-09-15T22:16:17.604430+0000","last_undegraded":"2024-09-15T22:16:17.604430+0000","last_fullsized":"2024-09-15T22:16:17.604430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:57.455608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597461,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":256,"num_write":206,"num_write_kb":1413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1892352,"data_stored":1792383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547240,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1028096,"data_stored":511054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776172,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28888,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716264,"statfs":{"total":95995035648,"available":95965454336,"internally_reserved":0,"allocated":1847296,"data_stored":1300967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939697,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1429504,"data_stored":908948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168631,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1429504,"data_stored":904874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1630208,"data_stored":1106100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593793,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1024000,"data_stored":506958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822726,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37252,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707900,"statfs":{"total":95995035648,"available":95956889600,"internally_reserved":0,"allocated":1769472,"data_stored":1233204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1032192,"data_stored":511076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215184,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1560576,"data_stored":1031878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1110016,"data_stored":578053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1105920,"data_stored":578805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40512,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704640,"statfs":{"total":95995035648,"available":95953551360,"internally_reserved":0,"allocated":1028096,"data_stored":507048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":524920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":131782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":393820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":203641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:16:22.242 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-15T22:16:22.242 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:16:22.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.380+0000 7fd67a265640 1 -- 172.21.15.45:0/1249170830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6741069d0 msgr2=0x7fd674106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.380+0000 7fd67a265640 1 --2- 172.21.15.45:0/1249170830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6741069d0 0x7fd674106db0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd664009930 tx=0x7fd66402a420 comp rx=0 tx=0).stop 2024-09-15T22:16:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.380+0000 7fd67a265640 1 -- 172.21.15.45:0/1249170830 shutdown_connections 2024-09-15T22:16:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.380+0000 7fd67a265640 1 --2- 172.21.15.45:0/1249170830 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd674101360 0x7fd67410d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.380+0000 7fd67a265640 1 --2- 172.21.15.45:0/1249170830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6741009c0 0x7fd674100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.380+0000 7fd67a265640 1 --2- 172.21.15.45:0/1249170830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6741069d0 0x7fd674106db0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.380+0000 7fd67a265640 1 -- 172.21.15.45:0/1249170830 >> 172.21.15.45:0/1249170830 conn(0x7fd6740fc6a0 msgr2=0x7fd6740feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.380+0000 7fd67a265640 1 -- 172.21.15.45:0/1249170830 shutdown_connections 2024-09-15T22:16:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.380+0000 7fd67a265640 1 -- 172.21.15.45:0/1249170830 wait complete. 2024-09-15T22:16:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.380+0000 7fd67a265640 1 Processor -- start 2024-09-15T22:16:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.380+0000 7fd67a265640 1 -- start start 2024-09-15T22:16:22.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.380+0000 7fd67a265640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6741009c0 0x7fd674198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.380+0000 7fd67a265640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd674101360 0x7fd6741989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd67a265640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6741069d0 0x7fd67419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd67a265640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd674112020 con 0x7fd6741069d0 2024-09-15T22:16:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd67a265640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd674111ea0 con 0x7fd674101360 2024-09-15T22:16:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd67a265640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd6741121a0 con 0x7fd6741009c0 2024-09-15T22:16:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd678802640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6741069d0 0x7fd67419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd678802640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6741069d0 0x7fd67419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52142/0 (socket says 172.21.15.45:52142) 2024-09-15T22:16:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd66bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd674101360 0x7fd6741989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:22.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd678802640 1 -- 172.21.15.45:0/1981555868 learned_addr learned my addr 172.21.15.45:0/1981555868 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd673fff640 1 --2- 172.21.15.45:0/1981555868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6741009c0 0x7fd674198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd678802640 1 -- 172.21.15.45:0/1981555868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6741009c0 msgr2=0x7fd674198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd678802640 1 --2- 172.21.15.45:0/1981555868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6741009c0 0x7fd674198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd678802640 1 -- 172.21.15.45:0/1981555868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd674101360 msgr2=0x7fd6741989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd678802640 1 --2- 172.21.15.45:0/1981555868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd674101360 0x7fd6741989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd678802640 1 -- 172.21.15.45:0/1981555868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67419d460 con 0x7fd6741069d0 2024-09-15T22:16:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd678802640 1 --2- 172.21.15.45:0/1981555868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6741069d0 0x7fd67419cd30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00cad0 tx=0x7fd66c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd671ffb640 1 -- 172.21.15.45:0/1981555868 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c00ad60 con 0x7fd6741069d0 2024-09-15T22:16:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd67a265640 1 -- 172.21.15.45:0/1981555868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67419d750 con 0x7fd6741069d0 2024-09-15T22:16:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd671ffb640 1 -- 172.21.15.45:0/1981555868 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd66c004b20 con 0x7fd6741069d0 2024-09-15T22:16:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd671ffb640 1 -- 172.21.15.45:0/1981555868 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c00f6b0 con 0x7fd6741069d0 2024-09-15T22:16:22.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.381+0000 7fd67a265640 1 -- 172.21.15.45:0/1981555868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6741a4fe0 con 0x7fd6741069d0 2024-09-15T22:16:22.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.382+0000 7fd67a265640 1 -- 172.21.15.45:0/1981555868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd674100e20 con 0x7fd6741069d0 2024-09-15T22:16:22.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.384+0000 7fd671ffb640 1 -- 172.21.15.45:0/1981555868 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fd66c004cd0 con 0x7fd6741069d0 2024-09-15T22:16:22.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.384+0000 7fd671ffb640 1 --2- 172.21.15.45:0/1981555868 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd6600a3450 0x7fd6600a5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:22.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.384+0000 7fd673fff640 1 --2- 172.21.15.45:0/1981555868 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd6600a3450 0x7fd6600a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:22.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.384+0000 7fd671ffb640 1 -- 172.21.15.45:0/1981555868 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fd66c0d0430 con 0x7fd6741069d0 2024-09-15T22:16:22.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.385+0000 7fd673fff640 1 --2- 172.21.15.45:0/1981555868 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd6600a3450 0x7fd6600a5910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd664006010 tx=0x7fd664000bc0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:22.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.387+0000 7fd671ffb640 1 -- 172.21.15.45:0/1981555868 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd66c014030 con 0x7fd6741069d0 2024-09-15T22:16:22.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi045 to 177.0M 2024-09-15T22:16:22.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: Unable to set osd_memory_target on smithi045 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-15T22:16:22.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-15T22:16:22.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-15T22:16:22.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-15T22:16:22.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: Updating smithi100:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:22.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:22.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: Updating smithi045:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:22.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:16:22.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:16:22.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:16:22.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:22.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:22.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:22.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:22 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi045 to 177.0M 2024-09-15T22:16:22.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: Unable to set osd_memory_target on smithi045 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-15T22:16:22.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-15T22:16:22.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-15T22:16:22.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-15T22:16:22.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: Updating smithi100:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:22.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: Updating smithi045:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:22.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:22.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:22 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi045 to 177.0M 2024-09-15T22:16:22.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: Unable to set osd_memory_target on smithi045 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-15T22:16:22.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: Updating smithi045:/etc/ceph/ceph.conf 2024-09-15T22:16:22.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: Updating smithi100:/etc/ceph/ceph.conf 2024-09-15T22:16:22.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: Updating smithi165:/etc/ceph/ceph.conf 2024-09-15T22:16:22.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: Updating smithi100:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:22.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:22.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: Updating smithi045:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T22:16:22.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:16:22.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: Updating smithi165:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:16:22.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: Updating smithi045:/etc/ceph/ceph.client.admin.keyring 2024-09-15T22:16:22.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.551 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.552 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.552 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:22.552 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:22.552 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:22.552 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:22 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:22.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.563+0000 7fd67a265640 1 -- 172.21.15.45:0/1981555868 --> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd6740fd450 con 0x7fd6600a3450 2024-09-15T22:16:22.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.571+0000 7fd671ffb640 1 -- 172.21.15.45:0/1981555868 <== mgr.15165 v2:172.21.15.45:6800/553298159 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339444 (secure 0 0 0) 0x7fd6740fd450 con 0x7fd6600a3450 2024-09-15T22:16:22.577 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:22.579 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-09-15T22:16:22.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.575+0000 7fd67a265640 1 -- 172.21.15.45:0/1981555868 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd6600a3450 msgr2=0x7fd6600a5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.575+0000 7fd67a265640 1 --2- 172.21.15.45:0/1981555868 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd6600a3450 0x7fd6600a5910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd664006010 tx=0x7fd664000bc0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.575+0000 7fd67a265640 1 -- 172.21.15.45:0/1981555868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6741069d0 msgr2=0x7fd67419cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.575+0000 7fd67a265640 1 --2- 172.21.15.45:0/1981555868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6741069d0 0x7fd67419cd30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00cad0 tx=0x7fd66c00ced0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.575+0000 7fd67a265640 1 -- 172.21.15.45:0/1981555868 shutdown_connections 2024-09-15T22:16:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.575+0000 7fd67a265640 1 --2- 172.21.15.45:0/1981555868 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd6600a3450 0x7fd6600a5910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.575+0000 7fd67a265640 1 --2- 172.21.15.45:0/1981555868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6741069d0 0x7fd67419cd30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.575+0000 7fd67a265640 1 --2- 172.21.15.45:0/1981555868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd674101360 0x7fd6741989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.575+0000 7fd67a265640 1 --2- 172.21.15.45:0/1981555868 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd6741009c0 0x7fd674198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.575+0000 7fd67a265640 1 -- 172.21.15.45:0/1981555868 >> 172.21.15.45:0/1981555868 conn(0x7fd6740fc6a0 msgr2=0x7fd6740fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.575+0000 7fd67a265640 1 -- 172.21.15.45:0/1981555868 shutdown_connections 2024-09-15T22:16:22.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:22.575+0000 7fd67a265640 1 -- 172.21.15.45:0/1981555868 wait complete. 2024-09-15T22:16:22.588 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-15T22:16:21.555256+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188063,"num_objects":28,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":434,"num_read_kb":375,"num_write":389,"num_write_kb":4353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":792,"ondisk_log_size":792,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":415064,"kb_used_data":15620,"kb_used_omap":18,"kb_used_meta":398957,"kb_avail":1124526760,"statfs":{"total":1151940427776,"available":1151515402240,"internally_reserved":0,"allocated":15994880,"data_stored":9678965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":408532281},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.985700"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557493+0000","last_change":"2024-09-15T22:14:04.718966+0000","last_active":"2024-09-15T22:16:17.557493+0000","last_peered":"2024-09-15T22:16:17.557493+0000","last_clean":"2024-09-15T22:16:17.557493+0000","last_became_active":"2024-09-15T22:14:04.718743+0000","last_became_peered":"2024-09-15T22:14:04.718743+0000","last_unstale":"2024-09-15T22:16:17.557493+0000","last_undegraded":"2024-09-15T22:16:17.557493+0000","last_fullsized":"2024-09-15T22:16:17.557493+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:24:01.767801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604829+0000","last_change":"2024-09-15T22:14:06.814802+0000","last_active":"2024-09-15T22:16:17.604829+0000","last_peered":"2024-09-15T22:16:17.604829+0000","last_clean":"2024-09-15T22:16:17.604829+0000","last_became_active":"2024-09-15T22:14:06.814495+0000","last_became_peered":"2024-09-15T22:14:06.814495+0000","last_unstale":"2024-09-15T22:16:17.604829+0000","last_undegraded":"2024-09-15T22:16:17.604829+0000","last_fullsized":"2024-09-15T22:16:17.604829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:45.384412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552197+0000","last_change":"2024-09-15T22:15:17.404082+0000","last_active":"2024-09-15T22:16:17.552197+0000","last_peered":"2024-09-15T22:16:17.552197+0000","last_clean":"2024-09-15T22:16:17.552197+0000","last_became_active":"2024-09-15T22:15:17.403590+0000","last_became_peered":"2024-09-15T22:15:17.403590+0000","last_unstale":"2024-09-15T22:16:17.552197+0000","last_undegraded":"2024-09-15T22:16:17.552197+0000","last_fullsized":"2024-09-15T22:16:17.552197+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:49.816560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.566735+0000","last_change":"2024-09-15T22:14:05.017101+0000","last_active":"2024-09-15T22:16:17.566735+0000","last_peered":"2024-09-15T22:16:17.566735+0000","last_clean":"2024-09-15T22:16:17.566735+0000","last_became_active":"2024-09-15T22:14:05.016748+0000","last_became_peered":"2024-09-15T22:14:05.016748+0000","last_unstale":"2024-09-15T22:16:17.566735+0000","last_undegraded":"2024-09-15T22:16:17.566735+0000","last_fullsized":"2024-09-15T22:16:17.566735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:11.211291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605811+0000","last_change":"2024-09-15T22:14:06.815112+0000","last_active":"2024-09-15T22:16:17.605811+0000","last_peered":"2024-09-15T22:16:17.605811+0000","last_clean":"2024-09-15T22:16:17.605811+0000","last_became_active":"2024-09-15T22:14:06.814556+0000","last_became_peered":"2024-09-15T22:14:06.814556+0000","last_unstale":"2024-09-15T22:16:17.605811+0000","last_undegraded":"2024-09-15T22:16:17.605811+0000","last_fullsized":"2024-09-15T22:16:17.605811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:24.733336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553827+0000","last_change":"2024-09-15T22:14:13.845829+0000","last_active":"2024-09-15T22:16:17.553827+0000","last_peered":"2024-09-15T22:16:17.553827+0000","last_clean":"2024-09-15T22:16:17.553827+0000","last_became_active":"2024-09-15T22:14:13.844958+0000","last_became_peered":"2024-09-15T22:14:13.844958+0000","last_unstale":"2024-09-15T22:16:17.553827+0000","last_undegraded":"2024-09-15T22:16:17.553827+0000","last_fullsized":"2024-09-15T22:16:17.553827+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:37.944143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555893+0000","last_change":"2024-09-15T22:14:04.720255+0000","last_active":"2024-09-15T22:16:17.555893+0000","last_peered":"2024-09-15T22:16:17.555893+0000","last_clean":"2024-09-15T22:16:17.555893+0000","last_became_active":"2024-09-15T22:14:04.719907+0000","last_became_peered":"2024-09-15T22:14:04.719907+0000","last_unstale":"2024-09-15T22:16:17.555893+0000","last_undegraded":"2024-09-15T22:16:17.555893+0000","last_fullsized":"2024-09-15T22:16:17.555893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:12.510139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.591919+0000","last_change":"2024-09-15T22:14:06.808322+0000","last_active":"2024-09-15T22:16:17.591919+0000","last_peered":"2024-09-15T22:16:17.591919+0000","last_clean":"2024-09-15T22:16:17.591919+0000","last_became_active":"2024-09-15T22:14:06.807398+0000","last_became_peered":"2024-09-15T22:14:06.807398+0000","last_unstale":"2024-09-15T22:16:17.591919+0000","last_undegraded":"2024-09-15T22:16:17.591919+0000","last_fullsized":"2024-09-15T22:16:17.591919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:11.677800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554758+0000","last_change":"2024-09-15T22:14:13.849713+0000","last_active":"2024-09-15T22:16:17.554758+0000","last_peered":"2024-09-15T22:16:17.554758+0000","last_clean":"2024-09-15T22:16:17.554758+0000","last_became_active":"2024-09-15T22:14:13.849311+0000","last_became_peered":"2024-09-15T22:14:13.849311+0000","last_unstale":"2024-09-15T22:16:17.554758+0000","last_undegraded":"2024-09-15T22:16:17.554758+0000","last_fullsized":"2024-09-15T22:16:17.554758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:17.782013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554654+0000","last_change":"2024-09-15T22:14:04.721694+0000","last_active":"2024-09-15T22:16:17.554654+0000","last_peered":"2024-09-15T22:16:17.554654+0000","last_clean":"2024-09-15T22:16:17.554654+0000","last_became_active":"2024-09-15T22:14:04.721321+0000","last_became_peered":"2024-09-15T22:14:04.721321+0000","last_unstale":"2024-09-15T22:16:17.554654+0000","last_undegraded":"2024-09-15T22:16:17.554654+0000","last_fullsized":"2024-09-15T22:16:17.554654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:47.817565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.586446+0000","last_change":"2024-09-15T22:14:06.809564+0000","last_active":"2024-09-15T22:16:17.586446+0000","last_peered":"2024-09-15T22:16:17.586446+0000","last_clean":"2024-09-15T22:16:17.586446+0000","last_became_active":"2024-09-15T22:14:06.809102+0000","last_became_peered":"2024-09-15T22:14:06.809102+0000","last_unstale":"2024-09-15T22:16:17.586446+0000","last_undegraded":"2024-09-15T22:16:17.586446+0000","last_fullsized":"2024-09-15T22:16:17.586446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:55.306791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554499+0000","last_change":"2024-09-15T22:14:13.849839+0000","last_active":"2024-09-15T22:16:17.554499+0000","last_peered":"2024-09-15T22:16:17.554499+0000","last_clean":"2024-09-15T22:16:17.554499+0000","last_became_active":"2024-09-15T22:14:13.849415+0000","last_became_peered":"2024-09-15T22:14:13.849415+0000","last_unstale":"2024-09-15T22:16:17.554499+0000","last_undegraded":"2024-09-15T22:16:17.554499+0000","last_fullsized":"2024-09-15T22:16:17.554499+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:20.336406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601259+0000","last_change":"2024-09-15T22:14:06.815506+0000","last_active":"2024-09-15T22:16:17.601259+0000","last_peered":"2024-09-15T22:16:17.601259+0000","last_clean":"2024-09-15T22:16:17.601259+0000","last_became_active":"2024-09-15T22:14:06.815066+0000","last_became_peered":"2024-09-15T22:14:06.815066+0000","last_unstale":"2024-09-15T22:16:17.601259+0000","last_undegraded":"2024-09-15T22:16:17.601259+0000","last_fullsized":"2024-09-15T22:16:17.601259+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:42.182268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555136+0000","last_change":"2024-09-15T22:14:04.721403+0000","last_active":"2024-09-15T22:16:17.555136+0000","last_peered":"2024-09-15T22:16:17.555136+0000","last_clean":"2024-09-15T22:16:17.555136+0000","last_became_active":"2024-09-15T22:14:04.721049+0000","last_became_peered":"2024-09-15T22:14:04.721049+0000","last_unstale":"2024-09-15T22:16:17.555136+0000","last_undegraded":"2024-09-15T22:16:17.555136+0000","last_fullsized":"2024-09-15T22:16:17.555136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:39.860926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.561252+0000","last_change":"2024-09-15T22:14:14.280656+0000","last_active":"2024-09-15T22:16:17.561252+0000","last_peered":"2024-09-15T22:16:17.561252+0000","last_clean":"2024-09-15T22:16:17.561252+0000","last_became_active":"2024-09-15T22:14:14.280230+0000","last_became_peered":"2024-09-15T22:14:14.280230+0000","last_unstale":"2024-09-15T22:16:17.561252+0000","last_undegraded":"2024-09-15T22:16:17.561252+0000","last_fullsized":"2024-09-15T22:16:17.561252+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:47.531799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603939+0000","last_change":"2024-09-15T22:14:06.805575+0000","last_active":"2024-09-15T22:16:17.603939+0000","last_peered":"2024-09-15T22:16:17.603939+0000","last_clean":"2024-09-15T22:16:17.603939+0000","last_became_active":"2024-09-15T22:14:06.804515+0000","last_became_peered":"2024-09-15T22:14:06.804515+0000","last_unstale":"2024-09-15T22:16:17.603939+0000","last_undegraded":"2024-09-15T22:16:17.603939+0000","last_fullsized":"2024-09-15T22:16:17.603939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.560964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552446+0000","last_change":"2024-09-15T22:14:04.717221+0000","last_active":"2024-09-15T22:16:17.552446+0000","last_peered":"2024-09-15T22:16:17.552446+0000","last_clean":"2024-09-15T22:16:17.552446+0000","last_became_active":"2024-09-15T22:14:04.716845+0000","last_became_peered":"2024-09-15T22:14:04.716845+0000","last_unstale":"2024-09-15T22:16:17.552446+0000","last_undegraded":"2024-09-15T22:16:17.552446+0000","last_fullsized":"2024-09-15T22:16:17.552446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.073229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555248+0000","last_change":"2024-09-15T22:14:13.847822+0000","last_active":"2024-09-15T22:16:17.555248+0000","last_peered":"2024-09-15T22:16:17.555248+0000","last_clean":"2024-09-15T22:16:17.555248+0000","last_became_active":"2024-09-15T22:14:13.847332+0000","last_became_peered":"2024-09-15T22:14:13.847332+0000","last_unstale":"2024-09-15T22:16:17.555248+0000","last_undegraded":"2024-09-15T22:16:17.555248+0000","last_fullsized":"2024-09-15T22:16:17.555248+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:18.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603009+0000","last_change":"2024-09-15T22:14:06.814033+0000","last_active":"2024-09-15T22:16:17.603009+0000","last_peered":"2024-09-15T22:16:17.603009+0000","last_clean":"2024-09-15T22:16:17.603009+0000","last_became_active":"2024-09-15T22:14:06.813458+0000","last_became_peered":"2024-09-15T22:14:06.813458+0000","last_unstale":"2024-09-15T22:16:17.603009+0000","last_undegraded":"2024-09-15T22:16:17.603009+0000","last_fullsized":"2024-09-15T22:16:17.603009+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:16.484113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554628+0000","last_change":"2024-09-15T22:14:04.715797+0000","last_active":"2024-09-15T22:16:17.554628+0000","last_peered":"2024-09-15T22:16:17.554628+0000","last_clean":"2024-09-15T22:16:17.554628+0000","last_became_active":"2024-09-15T22:14:04.715478+0000","last_became_peered":"2024-09-15T22:14:04.715478+0000","last_unstale":"2024-09-15T22:16:17.554628+0000","last_undegraded":"2024-09-15T22:16:17.554628+0000","last_fullsized":"2024-09-15T22:16:17.554628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:39.432873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557177+0000","last_change":"2024-09-15T22:14:13.853461+0000","last_active":"2024-09-15T22:16:17.557177+0000","last_peered":"2024-09-15T22:16:17.557177+0000","last_clean":"2024-09-15T22:16:17.557177+0000","last_became_active":"2024-09-15T22:14:13.852896+0000","last_became_peered":"2024-09-15T22:14:13.852896+0000","last_unstale":"2024-09-15T22:16:17.557177+0000","last_undegraded":"2024-09-15T22:16:17.557177+0000","last_fullsized":"2024-09-15T22:16:17.557177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:41.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579227+0000","last_change":"2024-09-15T22:14:06.814990+0000","last_active":"2024-09-15T22:16:17.579227+0000","last_peered":"2024-09-15T22:16:17.579227+0000","last_clean":"2024-09-15T22:16:17.579227+0000","last_became_active":"2024-09-15T22:14:06.814646+0000","last_became_peered":"2024-09-15T22:14:06.814646+0000","last_unstale":"2024-09-15T22:16:17.579227+0000","last_undegraded":"2024-09-15T22:16:17.579227+0000","last_fullsized":"2024-09-15T22:16:17.579227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:04.717207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.542012+0000","last_change":"2024-09-15T22:14:05.017599+0000","last_active":"2024-09-15T22:16:17.542012+0000","last_peered":"2024-09-15T22:16:17.542012+0000","last_clean":"2024-09-15T22:16:17.542012+0000","last_became_active":"2024-09-15T22:14:05.017296+0000","last_became_peered":"2024-09-15T22:14:05.017296+0000","last_unstale":"2024-09-15T22:16:17.542012+0000","last_undegraded":"2024-09-15T22:16:17.542012+0000","last_fullsized":"2024-09-15T22:16:17.542012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:11.427372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556380+0000","last_change":"2024-09-15T22:14:14.281453+0000","last_active":"2024-09-15T22:16:17.556380+0000","last_peered":"2024-09-15T22:16:17.556380+0000","last_clean":"2024-09-15T22:16:17.556380+0000","last_became_active":"2024-09-15T22:14:14.280814+0000","last_became_peered":"2024-09-15T22:14:14.280814+0000","last_unstale":"2024-09-15T22:16:17.556380+0000","last_undegraded":"2024-09-15T22:16:17.556380+0000","last_fullsized":"2024-09-15T22:16:17.556380+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:43:40.890979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604784+0000","last_change":"2024-09-15T22:14:06.816619+0000","last_active":"2024-09-15T22:16:17.604784+0000","last_peered":"2024-09-15T22:16:17.604784+0000","last_clean":"2024-09-15T22:16:17.604784+0000","last_became_active":"2024-09-15T22:14:06.814421+0000","last_became_peered":"2024-09-15T22:14:06.814421+0000","last_unstale":"2024-09-15T22:16:17.604784+0000","last_undegraded":"2024-09-15T22:16:17.604784+0000","last_fullsized":"2024-09-15T22:16:17.604784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:00.329802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556148+0000","last_change":"2024-09-15T22:14:05.197752+0000","last_active":"2024-09-15T22:16:17.556148+0000","last_peered":"2024-09-15T22:16:17.556148+0000","last_clean":"2024-09-15T22:16:17.556148+0000","last_became_active":"2024-09-15T22:14:05.197399+0000","last_became_peered":"2024-09-15T22:14:05.197399+0000","last_unstale":"2024-09-15T22:16:17.556148+0000","last_undegraded":"2024-09-15T22:16:17.556148+0000","last_fullsized":"2024-09-15T22:16:17.556148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:19.781842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552191+0000","last_change":"2024-09-15T22:14:13.847474+0000","last_active":"2024-09-15T22:16:17.552191+0000","last_peered":"2024-09-15T22:16:17.552191+0000","last_clean":"2024-09-15T22:16:17.552191+0000","last_became_active":"2024-09-15T22:14:13.847032+0000","last_became_peered":"2024-09-15T22:14:13.847032+0000","last_unstale":"2024-09-15T22:16:17.552191+0000","last_undegraded":"2024-09-15T22:16:17.552191+0000","last_fullsized":"2024-09-15T22:16:17.552191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:21.049024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598828+0000","last_change":"2024-09-15T22:14:06.809104+0000","last_active":"2024-09-15T22:16:17.598828+0000","last_peered":"2024-09-15T22:16:17.598828+0000","last_clean":"2024-09-15T22:16:17.598828+0000","last_became_active":"2024-09-15T22:14:06.808735+0000","last_became_peered":"2024-09-15T22:14:06.808735+0000","last_unstale":"2024-09-15T22:16:17.598828+0000","last_undegraded":"2024-09-15T22:16:17.598828+0000","last_fullsized":"2024-09-15T22:16:17.598828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:46.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'45","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.830286+0000","last_change":"2024-09-15T22:14:04.712546+0000","last_active":"2024-09-15T22:16:17.830286+0000","last_peered":"2024-09-15T22:16:17.830286+0000","last_clean":"2024-09-15T22:16:17.830286+0000","last_became_active":"2024-09-15T22:14:04.712222+0000","last_became_peered":"2024-09-15T22:14:04.712222+0000","last_unstale":"2024-09-15T22:16:17.830286+0000","last_undegraded":"2024-09-15T22:16:17.830286+0000","last_fullsized":"2024-09-15T22:16:17.830286+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:00.993810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.566187+0000","last_change":"2024-09-15T22:14:14.280905+0000","last_active":"2024-09-15T22:16:17.566187+0000","last_peered":"2024-09-15T22:16:17.566187+0000","last_clean":"2024-09-15T22:16:17.566187+0000","last_became_active":"2024-09-15T22:14:14.280368+0000","last_became_peered":"2024-09-15T22:14:14.280368+0000","last_unstale":"2024-09-15T22:16:17.566187+0000","last_undegraded":"2024-09-15T22:16:17.566187+0000","last_fullsized":"2024-09-15T22:16:17.566187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:52.812589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.599423+0000","last_change":"2024-09-15T22:14:06.816231+0000","last_active":"2024-09-15T22:16:17.599423+0000","last_peered":"2024-09-15T22:16:17.599423+0000","last_clean":"2024-09-15T22:16:17.599423+0000","last_became_active":"2024-09-15T22:14:06.815884+0000","last_became_peered":"2024-09-15T22:14:06.815884+0000","last_unstale":"2024-09-15T22:16:17.599423+0000","last_undegraded":"2024-09-15T22:16:17.599423+0000","last_fullsized":"2024-09-15T22:16:17.599423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:30.076077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556018+0000","last_change":"2024-09-15T22:14:05.017745+0000","last_active":"2024-09-15T22:16:17.556018+0000","last_peered":"2024-09-15T22:16:17.556018+0000","last_clean":"2024-09-15T22:16:17.556018+0000","last_became_active":"2024-09-15T22:14:05.017064+0000","last_became_peered":"2024-09-15T22:14:05.017064+0000","last_unstale":"2024-09-15T22:16:17.556018+0000","last_undegraded":"2024-09-15T22:16:17.556018+0000","last_fullsized":"2024-09-15T22:16:17.556018+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:44.038448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.560575+0000","last_change":"2024-09-15T22:14:13.853195+0000","last_active":"2024-09-15T22:16:17.560575+0000","last_peered":"2024-09-15T22:16:17.560575+0000","last_clean":"2024-09-15T22:16:17.560575+0000","last_became_active":"2024-09-15T22:14:13.852803+0000","last_became_peered":"2024-09-15T22:14:13.852803+0000","last_unstale":"2024-09-15T22:16:17.560575+0000","last_undegraded":"2024-09-15T22:16:17.560575+0000","last_fullsized":"2024-09-15T22:16:17.560575+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:20.737509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601889+0000","last_change":"2024-09-15T22:14:06.805448+0000","last_active":"2024-09-15T22:16:17.601889+0000","last_peered":"2024-09-15T22:16:17.601889+0000","last_clean":"2024-09-15T22:16:17.601889+0000","last_became_active":"2024-09-15T22:14:06.804965+0000","last_became_peered":"2024-09-15T22:14:06.804965+0000","last_unstale":"2024-09-15T22:16:17.601889+0000","last_undegraded":"2024-09-15T22:16:17.601889+0000","last_fullsized":"2024-09-15T22:16:17.601889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:29.831888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556768+0000","last_change":"2024-09-15T22:14:05.017438+0000","last_active":"2024-09-15T22:16:17.556768+0000","last_peered":"2024-09-15T22:16:17.556768+0000","last_clean":"2024-09-15T22:16:17.556768+0000","last_became_active":"2024-09-15T22:14:05.017050+0000","last_became_peered":"2024-09-15T22:14:05.017050+0000","last_unstale":"2024-09-15T22:16:17.556768+0000","last_undegraded":"2024-09-15T22:16:17.556768+0000","last_fullsized":"2024-09-15T22:16:17.556768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:35.608774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554172+0000","last_change":"2024-09-15T22:14:14.281096+0000","last_active":"2024-09-15T22:16:17.554172+0000","last_peered":"2024-09-15T22:16:17.554172+0000","last_clean":"2024-09-15T22:16:17.554172+0000","last_became_active":"2024-09-15T22:14:14.280381+0000","last_became_peered":"2024-09-15T22:14:14.280381+0000","last_unstale":"2024-09-15T22:16:17.554172+0000","last_undegraded":"2024-09-15T22:16:17.554172+0000","last_fullsized":"2024-09-15T22:16:17.554172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:44.686080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.583155+0000","last_change":"2024-09-15T22:14:06.812046+0000","last_active":"2024-09-15T22:16:17.583155+0000","last_peered":"2024-09-15T22:16:17.583155+0000","last_clean":"2024-09-15T22:16:17.583155+0000","last_became_active":"2024-09-15T22:14:06.811721+0000","last_became_peered":"2024-09-15T22:14:06.811721+0000","last_unstale":"2024-09-15T22:16:17.583155+0000","last_undegraded":"2024-09-15T22:16:17.583155+0000","last_fullsized":"2024-09-15T22:16:17.583155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:13.244973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556145+0000","last_change":"2024-09-15T22:14:04.720940+0000","last_active":"2024-09-15T22:16:17.556145+0000","last_peered":"2024-09-15T22:16:17.556145+0000","last_clean":"2024-09-15T22:16:17.556145+0000","last_became_active":"2024-09-15T22:14:04.720624+0000","last_became_peered":"2024-09-15T22:14:04.720624+0000","last_unstale":"2024-09-15T22:16:17.556145+0000","last_undegraded":"2024-09-15T22:16:17.556145+0000","last_fullsized":"2024-09-15T22:16:17.556145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:29.823784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540604+0000","last_change":"2024-09-15T22:14:13.848882+0000","last_active":"2024-09-15T22:16:17.540604+0000","last_peered":"2024-09-15T22:16:17.540604+0000","last_clean":"2024-09-15T22:16:17.540604+0000","last_became_active":"2024-09-15T22:14:13.848512+0000","last_became_peered":"2024-09-15T22:14:13.848512+0000","last_unstale":"2024-09-15T22:16:17.540604+0000","last_undegraded":"2024-09-15T22:16:17.540604+0000","last_fullsized":"2024-09-15T22:16:17.540604+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:44.050344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582026+0000","last_change":"2024-09-15T22:14:06.813915+0000","last_active":"2024-09-15T22:16:17.582026+0000","last_peered":"2024-09-15T22:16:17.582026+0000","last_clean":"2024-09-15T22:16:17.582026+0000","last_became_active":"2024-09-15T22:14:06.811803+0000","last_became_peered":"2024-09-15T22:14:06.811803+0000","last_unstale":"2024-09-15T22:16:17.582026+0000","last_undegraded":"2024-09-15T22:16:17.582026+0000","last_fullsized":"2024-09-15T22:16:17.582026+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:42.117747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540432+0000","last_change":"2024-09-15T22:14:05.017360+0000","last_active":"2024-09-15T22:16:17.540432+0000","last_peered":"2024-09-15T22:16:17.540432+0000","last_clean":"2024-09-15T22:16:17.540432+0000","last_became_active":"2024-09-15T22:14:05.017004+0000","last_became_peered":"2024-09-15T22:14:05.017004+0000","last_unstale":"2024-09-15T22:16:17.540432+0000","last_undegraded":"2024-09-15T22:16:17.540432+0000","last_fullsized":"2024-09-15T22:16:17.540432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:01.366513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540715+0000","last_change":"2024-09-15T22:14:14.280215+0000","last_active":"2024-09-15T22:16:17.540715+0000","last_peered":"2024-09-15T22:16:17.540715+0000","last_clean":"2024-09-15T22:16:17.540715+0000","last_became_active":"2024-09-15T22:14:14.279750+0000","last_became_peered":"2024-09-15T22:14:14.279750+0000","last_unstale":"2024-09-15T22:16:17.540715+0000","last_undegraded":"2024-09-15T22:16:17.540715+0000","last_fullsized":"2024-09-15T22:16:17.540715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:58.827582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602972+0000","last_change":"2024-09-15T22:14:06.812410+0000","last_active":"2024-09-15T22:16:17.602972+0000","last_peered":"2024-09-15T22:16:17.602972+0000","last_clean":"2024-09-15T22:16:17.602972+0000","last_became_active":"2024-09-15T22:14:06.812032+0000","last_became_peered":"2024-09-15T22:14:06.812032+0000","last_unstale":"2024-09-15T22:16:17.602972+0000","last_undegraded":"2024-09-15T22:16:17.602972+0000","last_fullsized":"2024-09-15T22:16:17.602972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:48.100213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.558099+0000","last_change":"2024-09-15T22:14:04.719678+0000","last_active":"2024-09-15T22:16:17.558099+0000","last_peered":"2024-09-15T22:16:17.558099+0000","last_clean":"2024-09-15T22:16:17.558099+0000","last_became_active":"2024-09-15T22:14:04.719352+0000","last_became_peered":"2024-09-15T22:14:04.719352+0000","last_unstale":"2024-09-15T22:16:17.558099+0000","last_undegraded":"2024-09-15T22:16:17.558099+0000","last_fullsized":"2024-09-15T22:16:17.558099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.061957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545515+0000","last_change":"2024-09-15T22:14:14.281314+0000","last_active":"2024-09-15T22:16:17.545515+0000","last_peered":"2024-09-15T22:16:17.545515+0000","last_clean":"2024-09-15T22:16:17.545515+0000","last_became_active":"2024-09-15T22:14:14.280859+0000","last_became_peered":"2024-09-15T22:14:14.280859+0000","last_unstale":"2024-09-15T22:16:17.545515+0000","last_undegraded":"2024-09-15T22:16:17.545515+0000","last_fullsized":"2024-09-15T22:16:17.545515+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:18.796767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.592298+0000","last_change":"2024-09-15T22:15:17.211828+0000","last_active":"2024-09-15T22:16:17.592298+0000","last_peered":"2024-09-15T22:16:17.592298+0000","last_clean":"2024-09-15T22:16:17.592298+0000","last_became_active":"2024-09-15T22:15:17.211560+0000","last_became_peered":"2024-09-15T22:15:17.211560+0000","last_unstale":"2024-09-15T22:16:17.592298+0000","last_undegraded":"2024-09-15T22:16:17.592298+0000","last_fullsized":"2024-09-15T22:16:17.592298+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:59.944869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555126+0000","last_change":"2024-09-15T22:14:04.718038+0000","last_active":"2024-09-15T22:16:17.555126+0000","last_peered":"2024-09-15T22:16:17.555126+0000","last_clean":"2024-09-15T22:16:17.555126+0000","last_became_active":"2024-09-15T22:14:04.717683+0000","last_became_peered":"2024-09-15T22:14:04.717683+0000","last_unstale":"2024-09-15T22:16:17.555126+0000","last_undegraded":"2024-09-15T22:16:17.555126+0000","last_fullsized":"2024-09-15T22:16:17.555126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:23.557077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":360,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.558271+0000","last_change":"2024-09-15T22:12:55.022635+0000","last_active":"2024-09-15T22:16:17.558271+0000","last_peered":"2024-09-15T22:16:17.558271+0000","last_clean":"2024-09-15T22:16:17.558271+0000","last_became_active":"2024-09-15T22:12:55.022132+0000","last_became_peered":"2024-09-15T22:12:55.022132+0000","last_unstale":"2024-09-15T22:16:17.558271+0000","last_undegraded":"2024-09-15T22:16:17.558271+0000","last_fullsized":"2024-09-15T22:16:17.558271+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_clean_scrub_stamp":"2024-09-15T22:09:30.115505+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:50.060169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.560360+0000","last_change":"2024-09-15T22:14:13.849547+0000","last_active":"2024-09-15T22:16:17.560360+0000","last_peered":"2024-09-15T22:16:17.560360+0000","last_clean":"2024-09-15T22:16:17.560360+0000","last_became_active":"2024-09-15T22:14:13.849091+0000","last_became_peered":"2024-09-15T22:14:13.849091+0000","last_unstale":"2024-09-15T22:16:17.560360+0000","last_undegraded":"2024-09-15T22:16:17.560360+0000","last_fullsized":"2024-09-15T22:16:17.560360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:49.450958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596676+0000","last_change":"2024-09-15T22:14:06.816340+0000","last_active":"2024-09-15T22:16:17.596676+0000","last_peered":"2024-09-15T22:16:17.596676+0000","last_clean":"2024-09-15T22:16:17.596676+0000","last_became_active":"2024-09-15T22:14:06.815712+0000","last_became_peered":"2024-09-15T22:14:06.815712+0000","last_unstale":"2024-09-15T22:16:17.596676+0000","last_undegraded":"2024-09-15T22:16:17.596676+0000","last_fullsized":"2024-09-15T22:16:17.596676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:43.598512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553284+0000","last_change":"2024-09-15T22:14:05.197487+0000","last_active":"2024-09-15T22:16:17.553284+0000","last_peered":"2024-09-15T22:16:17.553284+0000","last_clean":"2024-09-15T22:16:17.553284+0000","last_became_active":"2024-09-15T22:14:05.197098+0000","last_became_peered":"2024-09-15T22:14:05.197098+0000","last_unstale":"2024-09-15T22:16:17.553284+0000","last_undegraded":"2024-09-15T22:16:17.553284+0000","last_fullsized":"2024-09-15T22:16:17.553284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:31.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.541960+0000","last_change":"2024-09-15T22:14:13.849594+0000","last_active":"2024-09-15T22:16:17.541960+0000","last_peered":"2024-09-15T22:16:17.541960+0000","last_clean":"2024-09-15T22:16:17.541960+0000","last_became_active":"2024-09-15T22:14:13.849157+0000","last_became_peered":"2024-09-15T22:14:13.849157+0000","last_unstale":"2024-09-15T22:16:17.541960+0000","last_undegraded":"2024-09-15T22:16:17.541960+0000","last_fullsized":"2024-09-15T22:16:17.541960+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:49.994107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.594031+0000","last_change":"2024-09-15T22:14:06.814312+0000","last_active":"2024-09-15T22:16:17.594031+0000","last_peered":"2024-09-15T22:16:17.594031+0000","last_clean":"2024-09-15T22:16:17.594031+0000","last_became_active":"2024-09-15T22:14:06.813959+0000","last_became_peered":"2024-09-15T22:14:06.813959+0000","last_unstale":"2024-09-15T22:16:17.594031+0000","last_undegraded":"2024-09-15T22:16:17.594031+0000","last_fullsized":"2024-09-15T22:16:17.594031+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:36.924162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'39","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.801579+0000","last_change":"2024-09-15T22:14:04.713307+0000","last_active":"2024-09-15T22:16:17.801579+0000","last_peered":"2024-09-15T22:16:17.801579+0000","last_clean":"2024-09-15T22:16:17.801579+0000","last_became_active":"2024-09-15T22:14:04.712996+0000","last_became_peered":"2024-09-15T22:14:04.712996+0000","last_unstale":"2024-09-15T22:16:17.801579+0000","last_undegraded":"2024-09-15T22:16:17.801579+0000","last_fullsized":"2024-09-15T22:16:17.801579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:37.298679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.563300+0000","last_change":"2024-09-15T22:14:13.846087+0000","last_active":"2024-09-15T22:16:17.563300+0000","last_peered":"2024-09-15T22:16:17.563300+0000","last_clean":"2024-09-15T22:16:17.563300+0000","last_became_active":"2024-09-15T22:14:13.845731+0000","last_became_peered":"2024-09-15T22:14:13.845731+0000","last_unstale":"2024-09-15T22:16:17.563300+0000","last_undegraded":"2024-09-15T22:16:17.563300+0000","last_fullsized":"2024-09-15T22:16:17.563300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:24.621330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.581187+0000","last_change":"2024-09-15T22:14:06.809456+0000","last_active":"2024-09-15T22:16:17.581187+0000","last_peered":"2024-09-15T22:16:17.581187+0000","last_clean":"2024-09-15T22:16:17.581187+0000","last_became_active":"2024-09-15T22:14:06.809141+0000","last_became_peered":"2024-09-15T22:14:06.809141+0000","last_unstale":"2024-09-15T22:16:17.581187+0000","last_undegraded":"2024-09-15T22:16:17.581187+0000","last_fullsized":"2024-09-15T22:16:17.581187+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:30.186800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540903+0000","last_change":"2024-09-15T22:14:04.715399+0000","last_active":"2024-09-15T22:16:17.540903+0000","last_peered":"2024-09-15T22:16:17.540903+0000","last_clean":"2024-09-15T22:16:17.540903+0000","last_became_active":"2024-09-15T22:14:04.715043+0000","last_became_peered":"2024-09-15T22:14:04.715043+0000","last_unstale":"2024-09-15T22:16:17.540903+0000","last_undegraded":"2024-09-15T22:16:17.540903+0000","last_fullsized":"2024-09-15T22:16:17.540903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:13.860413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.544985+0000","last_change":"2024-09-15T22:14:13.851594+0000","last_active":"2024-09-15T22:16:17.544985+0000","last_peered":"2024-09-15T22:16:17.544985+0000","last_clean":"2024-09-15T22:16:17.544985+0000","last_became_active":"2024-09-15T22:14:13.851154+0000","last_became_peered":"2024-09-15T22:14:13.851154+0000","last_unstale":"2024-09-15T22:16:17.544985+0000","last_undegraded":"2024-09-15T22:16:17.544985+0000","last_fullsized":"2024-09-15T22:16:17.544985+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:43.343808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579012+0000","last_change":"2024-09-15T22:15:17.219587+0000","last_active":"2024-09-15T22:16:17.579012+0000","last_peered":"2024-09-15T22:16:17.579012+0000","last_clean":"2024-09-15T22:16:17.579012+0000","last_became_active":"2024-09-15T22:15:17.219207+0000","last_became_peered":"2024-09-15T22:15:17.219207+0000","last_unstale":"2024-09-15T22:16:17.579012+0000","last_undegraded":"2024-09-15T22:16:17.579012+0000","last_fullsized":"2024-09-15T22:16:17.579012+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:34.267857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553915+0000","last_change":"2024-09-15T22:14:04.719550+0000","last_active":"2024-09-15T22:16:17.553915+0000","last_peered":"2024-09-15T22:16:17.553915+0000","last_clean":"2024-09-15T22:16:17.553915+0000","last_became_active":"2024-09-15T22:14:04.719273+0000","last_became_peered":"2024-09-15T22:14:04.719273+0000","last_unstale":"2024-09-15T22:16:17.553915+0000","last_undegraded":"2024-09-15T22:16:17.553915+0000","last_fullsized":"2024-09-15T22:16:17.553915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:20.973615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545033+0000","last_change":"2024-09-15T22:14:13.851420+0000","last_active":"2024-09-15T22:16:17.545033+0000","last_peered":"2024-09-15T22:16:17.545033+0000","last_clean":"2024-09-15T22:16:17.545033+0000","last_became_active":"2024-09-15T22:14:13.851051+0000","last_became_peered":"2024-09-15T22:14:13.851051+0000","last_unstale":"2024-09-15T22:16:17.545033+0000","last_undegraded":"2024-09-15T22:16:17.545033+0000","last_fullsized":"2024-09-15T22:16:17.545033+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:11.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595467+0000","last_change":"2024-09-15T22:14:06.809609+0000","last_active":"2024-09-15T22:16:17.595467+0000","last_peered":"2024-09-15T22:16:17.595467+0000","last_clean":"2024-09-15T22:16:17.595467+0000","last_became_active":"2024-09-15T22:14:06.809213+0000","last_became_peered":"2024-09-15T22:14:06.809213+0000","last_unstale":"2024-09-15T22:16:17.595467+0000","last_undegraded":"2024-09-15T22:16:17.595467+0000","last_fullsized":"2024-09-15T22:16:17.595467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:11.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553706+0000","last_change":"2024-09-15T22:14:05.017559+0000","last_active":"2024-09-15T22:16:17.553706+0000","last_peered":"2024-09-15T22:16:17.553706+0000","last_clean":"2024-09-15T22:16:17.553706+0000","last_became_active":"2024-09-15T22:14:05.017121+0000","last_became_peered":"2024-09-15T22:14:05.017121+0000","last_unstale":"2024-09-15T22:16:17.553706+0000","last_undegraded":"2024-09-15T22:16:17.553706+0000","last_fullsized":"2024-09-15T22:16:17.553706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:29:06.442532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540809+0000","last_change":"2024-09-15T22:14:13.847835+0000","last_active":"2024-09-15T22:16:17.540809+0000","last_peered":"2024-09-15T22:16:17.540809+0000","last_clean":"2024-09-15T22:16:17.540809+0000","last_became_active":"2024-09-15T22:14:13.847437+0000","last_became_peered":"2024-09-15T22:14:13.847437+0000","last_unstale":"2024-09-15T22:16:17.540809+0000","last_undegraded":"2024-09-15T22:16:17.540809+0000","last_fullsized":"2024-09-15T22:16:17.540809+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:48.036495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.586312+0000","last_change":"2024-09-15T22:14:06.813191+0000","last_active":"2024-09-15T22:16:17.586312+0000","last_peered":"2024-09-15T22:16:17.586312+0000","last_clean":"2024-09-15T22:16:17.586312+0000","last_became_active":"2024-09-15T22:14:06.812861+0000","last_became_peered":"2024-09-15T22:14:06.812861+0000","last_unstale":"2024-09-15T22:16:17.586312+0000","last_undegraded":"2024-09-15T22:16:17.586312+0000","last_fullsized":"2024-09-15T22:16:17.586312+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:51.487591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554382+0000","last_change":"2024-09-15T22:14:04.718431+0000","last_active":"2024-09-15T22:16:17.554382+0000","last_peered":"2024-09-15T22:16:17.554382+0000","last_clean":"2024-09-15T22:16:17.554382+0000","last_became_active":"2024-09-15T22:14:04.718109+0000","last_became_peered":"2024-09-15T22:14:04.718109+0000","last_unstale":"2024-09-15T22:16:17.554382+0000","last_undegraded":"2024-09-15T22:16:17.554382+0000","last_fullsized":"2024-09-15T22:16:17.554382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:10.408634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557287+0000","last_change":"2024-09-15T22:14:13.845179+0000","last_active":"2024-09-15T22:16:17.557287+0000","last_peered":"2024-09-15T22:16:17.557287+0000","last_clean":"2024-09-15T22:16:17.557287+0000","last_became_active":"2024-09-15T22:14:13.844795+0000","last_became_peered":"2024-09-15T22:14:13.844795+0000","last_unstale":"2024-09-15T22:16:17.557287+0000","last_undegraded":"2024-09-15T22:16:17.557287+0000","last_fullsized":"2024-09-15T22:16:17.557287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:24.113536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602323+0000","last_change":"2024-09-15T22:14:06.809687+0000","last_active":"2024-09-15T22:16:17.602323+0000","last_peered":"2024-09-15T22:16:17.602323+0000","last_clean":"2024-09-15T22:16:17.602323+0000","last_became_active":"2024-09-15T22:14:06.809383+0000","last_became_peered":"2024-09-15T22:14:06.809383+0000","last_unstale":"2024-09-15T22:16:17.602323+0000","last_undegraded":"2024-09-15T22:16:17.602323+0000","last_fullsized":"2024-09-15T22:16:17.602323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:19.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545298+0000","last_change":"2024-09-15T22:14:04.720577+0000","last_active":"2024-09-15T22:16:17.545298+0000","last_peered":"2024-09-15T22:16:17.545298+0000","last_clean":"2024-09-15T22:16:17.545298+0000","last_became_active":"2024-09-15T22:14:04.720235+0000","last_became_peered":"2024-09-15T22:14:04.720235+0000","last_unstale":"2024-09-15T22:16:17.545298+0000","last_undegraded":"2024-09-15T22:16:17.545298+0000","last_fullsized":"2024-09-15T22:16:17.545298+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:17.501061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.559191+0000","last_change":"2024-09-15T22:14:13.854841+0000","last_active":"2024-09-15T22:16:17.559191+0000","last_peered":"2024-09-15T22:16:17.559191+0000","last_clean":"2024-09-15T22:16:17.559191+0000","last_became_active":"2024-09-15T22:14:13.854336+0000","last_became_peered":"2024-09-15T22:14:13.854336+0000","last_unstale":"2024-09-15T22:16:17.559191+0000","last_undegraded":"2024-09-15T22:16:17.559191+0000","last_fullsized":"2024-09-15T22:16:17.559191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:13.819532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.600352+0000","last_change":"2024-09-15T22:14:06.806829+0000","last_active":"2024-09-15T22:16:17.600352+0000","last_peered":"2024-09-15T22:16:17.600352+0000","last_clean":"2024-09-15T22:16:17.600352+0000","last_became_active":"2024-09-15T22:14:06.806521+0000","last_became_peered":"2024-09-15T22:14:06.806521+0000","last_unstale":"2024-09-15T22:16:17.600352+0000","last_undegraded":"2024-09-15T22:16:17.600352+0000","last_fullsized":"2024-09-15T22:16:17.600352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:50.983246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552219+0000","last_change":"2024-09-15T22:14:04.717722+0000","last_active":"2024-09-15T22:16:17.552219+0000","last_peered":"2024-09-15T22:16:17.552219+0000","last_clean":"2024-09-15T22:16:17.552219+0000","last_became_active":"2024-09-15T22:14:04.717201+0000","last_became_peered":"2024-09-15T22:14:04.717201+0000","last_unstale":"2024-09-15T22:16:17.552219+0000","last_undegraded":"2024-09-15T22:16:17.552219+0000","last_fullsized":"2024-09-15T22:16:17.552219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:50.545847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545450+0000","last_change":"2024-09-15T22:14:13.852874+0000","last_active":"2024-09-15T22:16:17.545450+0000","last_peered":"2024-09-15T22:16:17.545450+0000","last_clean":"2024-09-15T22:16:17.545450+0000","last_became_active":"2024-09-15T22:14:13.852426+0000","last_became_peered":"2024-09-15T22:14:13.852426+0000","last_unstale":"2024-09-15T22:16:17.545450+0000","last_undegraded":"2024-09-15T22:16:17.545450+0000","last_fullsized":"2024-09-15T22:16:17.545450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:02:19.215156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579371+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:16:17.579371+0000","last_peered":"2024-09-15T22:16:17.579371+0000","last_clean":"2024-09-15T22:16:17.579371+0000","last_became_active":"2024-09-15T22:14:06.809013+0000","last_became_peered":"2024-09-15T22:14:06.809013+0000","last_unstale":"2024-09-15T22:16:17.579371+0000","last_undegraded":"2024-09-15T22:16:17.579371+0000","last_fullsized":"2024-09-15T22:16:17.579371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:47.830385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":274,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:18.087848+0000","last_change":"2024-09-15T22:14:04.721020+0000","last_active":"2024-09-15T22:16:18.087848+0000","last_peered":"2024-09-15T22:16:18.087848+0000","last_clean":"2024-09-15T22:16:18.087848+0000","last_became_active":"2024-09-15T22:14:04.720613+0000","last_became_peered":"2024-09-15T22:14:04.720613+0000","last_unstale":"2024-09-15T22:16:18.087848+0000","last_undegraded":"2024-09-15T22:16:18.087848+0000","last_fullsized":"2024-09-15T22:16:18.087848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:42.719346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71847,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":200,"num_read_kb":171,"num_write":38,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555319+0000","last_change":"2024-09-15T22:14:13.854250+0000","last_active":"2024-09-15T22:16:17.555319+0000","last_peered":"2024-09-15T22:16:17.555319+0000","last_clean":"2024-09-15T22:16:17.555319+0000","last_became_active":"2024-09-15T22:14:13.852972+0000","last_became_peered":"2024-09-15T22:14:13.852972+0000","last_unstale":"2024-09-15T22:16:17.555319+0000","last_undegraded":"2024-09-15T22:16:17.555319+0000","last_fullsized":"2024-09-15T22:16:17.555319+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:50:45.301446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596123+0000","last_change":"2024-09-15T22:14:06.813789+0000","last_active":"2024-09-15T22:16:17.596123+0000","last_peered":"2024-09-15T22:16:17.596123+0000","last_clean":"2024-09-15T22:16:17.596123+0000","last_became_active":"2024-09-15T22:14:06.813501+0000","last_became_peered":"2024-09-15T22:14:06.813501+0000","last_unstale":"2024-09-15T22:16:17.596123+0000","last_undegraded":"2024-09-15T22:16:17.596123+0000","last_fullsized":"2024-09-15T22:16:17.596123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:40.032952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545586+0000","last_change":"2024-09-15T22:14:05.018957+0000","last_active":"2024-09-15T22:16:17.545586+0000","last_peered":"2024-09-15T22:16:17.545586+0000","last_clean":"2024-09-15T22:16:17.545586+0000","last_became_active":"2024-09-15T22:14:05.018602+0000","last_became_peered":"2024-09-15T22:14:05.018602+0000","last_unstale":"2024-09-15T22:16:17.545586+0000","last_undegraded":"2024-09-15T22:16:17.545586+0000","last_fullsized":"2024-09-15T22:16:17.545586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:48.839341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555029+0000","last_change":"2024-09-15T22:15:17.332417+0000","last_active":"2024-09-15T22:16:17.555029+0000","last_peered":"2024-09-15T22:16:17.555029+0000","last_clean":"2024-09-15T22:16:17.555029+0000","last_became_active":"2024-09-15T22:15:17.331771+0000","last_became_peered":"2024-09-15T22:15:17.331771+0000","last_unstale":"2024-09-15T22:16:17.555029+0000","last_undegraded":"2024-09-15T22:16:17.555029+0000","last_fullsized":"2024-09-15T22:16:17.555029+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:08.575035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603399+0000","last_change":"2024-09-15T22:14:06.814876+0000","last_active":"2024-09-15T22:16:17.603399+0000","last_peered":"2024-09-15T22:16:17.603399+0000","last_clean":"2024-09-15T22:16:17.603399+0000","last_became_active":"2024-09-15T22:14:06.814120+0000","last_became_peered":"2024-09-15T22:14:06.814120+0000","last_unstale":"2024-09-15T22:16:17.603399+0000","last_undegraded":"2024-09-15T22:16:17.603399+0000","last_fullsized":"2024-09-15T22:16:17.603399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:37.417618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555309+0000","last_change":"2024-09-15T22:14:04.719281+0000","last_active":"2024-09-15T22:16:17.555309+0000","last_peered":"2024-09-15T22:16:17.555309+0000","last_clean":"2024-09-15T22:16:17.555309+0000","last_became_active":"2024-09-15T22:14:04.718856+0000","last_became_peered":"2024-09-15T22:14:04.718856+0000","last_unstale":"2024-09-15T22:16:17.555309+0000","last_undegraded":"2024-09-15T22:16:17.555309+0000","last_fullsized":"2024-09-15T22:16:17.555309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:22.137825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554629+0000","last_change":"2024-09-15T22:14:13.847398+0000","last_active":"2024-09-15T22:16:17.554629+0000","last_peered":"2024-09-15T22:16:17.554629+0000","last_clean":"2024-09-15T22:16:17.554629+0000","last_became_active":"2024-09-15T22:14:13.846870+0000","last_became_peered":"2024-09-15T22:14:13.846870+0000","last_unstale":"2024-09-15T22:16:17.554629+0000","last_undegraded":"2024-09-15T22:16:17.554629+0000","last_fullsized":"2024-09-15T22:16:17.554629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:58.872716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595875+0000","last_change":"2024-09-15T22:14:06.810412+0000","last_active":"2024-09-15T22:16:17.595875+0000","last_peered":"2024-09-15T22:16:17.595875+0000","last_clean":"2024-09-15T22:16:17.595875+0000","last_became_active":"2024-09-15T22:14:06.809669+0000","last_became_peered":"2024-09-15T22:14:06.809669+0000","last_unstale":"2024-09-15T22:16:17.595875+0000","last_undegraded":"2024-09-15T22:16:17.595875+0000","last_fullsized":"2024-09-15T22:16:17.595875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:44.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.549857+0000","last_change":"2024-09-15T22:14:04.715509+0000","last_active":"2024-09-15T22:16:17.549857+0000","last_peered":"2024-09-15T22:16:17.549857+0000","last_clean":"2024-09-15T22:16:17.549857+0000","last_became_active":"2024-09-15T22:14:04.715169+0000","last_became_peered":"2024-09-15T22:14:04.715169+0000","last_unstale":"2024-09-15T22:16:17.549857+0000","last_undegraded":"2024-09-15T22:16:17.549857+0000","last_fullsized":"2024-09-15T22:16:17.549857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:21.884103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554221+0000","last_change":"2024-09-15T22:15:17.219519+0000","last_active":"2024-09-15T22:16:17.554221+0000","last_peered":"2024-09-15T22:16:17.554221+0000","last_clean":"2024-09-15T22:16:17.554221+0000","last_became_active":"2024-09-15T22:15:17.219106+0000","last_became_peered":"2024-09-15T22:15:17.219106+0000","last_unstale":"2024-09-15T22:16:17.554221+0000","last_undegraded":"2024-09-15T22:16:17.554221+0000","last_fullsized":"2024-09-15T22:16:17.554221+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:54:08.102329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.562557+0000","last_change":"2024-09-15T22:14:13.844375+0000","last_active":"2024-09-15T22:16:17.562557+0000","last_peered":"2024-09-15T22:16:17.562557+0000","last_clean":"2024-09-15T22:16:17.562557+0000","last_became_active":"2024-09-15T22:14:13.843918+0000","last_became_peered":"2024-09-15T22:14:13.843918+0000","last_unstale":"2024-09-15T22:16:17.562557+0000","last_undegraded":"2024-09-15T22:16:17.562557+0000","last_fullsized":"2024-09-15T22:16:17.562557+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:32.190119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606349+0000","last_change":"2024-09-15T22:14:06.809534+0000","last_active":"2024-09-15T22:16:17.606349+0000","last_peered":"2024-09-15T22:16:17.606349+0000","last_clean":"2024-09-15T22:16:17.606349+0000","last_became_active":"2024-09-15T22:14:06.809147+0000","last_became_peered":"2024-09-15T22:14:06.809147+0000","last_unstale":"2024-09-15T22:16:17.606349+0000","last_undegraded":"2024-09-15T22:16:17.606349+0000","last_fullsized":"2024-09-15T22:16:17.606349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:14.930542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545382+0000","last_change":"2024-09-15T22:14:04.715347+0000","last_active":"2024-09-15T22:16:17.545382+0000","last_peered":"2024-09-15T22:16:17.545382+0000","last_clean":"2024-09-15T22:16:17.545382+0000","last_became_active":"2024-09-15T22:14:04.715049+0000","last_became_peered":"2024-09-15T22:14:04.715049+0000","last_unstale":"2024-09-15T22:16:17.545382+0000","last_undegraded":"2024-09-15T22:16:17.545382+0000","last_fullsized":"2024-09-15T22:16:17.545382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:04.943344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.567570+0000","last_change":"2024-09-15T22:14:13.852397+0000","last_active":"2024-09-15T22:16:17.567570+0000","last_peered":"2024-09-15T22:16:17.567570+0000","last_clean":"2024-09-15T22:16:17.567570+0000","last_became_active":"2024-09-15T22:14:13.851863+0000","last_became_peered":"2024-09-15T22:14:13.851863+0000","last_unstale":"2024-09-15T22:16:17.567570+0000","last_undegraded":"2024-09-15T22:16:17.567570+0000","last_fullsized":"2024-09-15T22:16:17.567570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:38.242241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606188+0000","last_change":"2024-09-15T22:14:06.809084+0000","last_active":"2024-09-15T22:16:17.606188+0000","last_peered":"2024-09-15T22:16:17.606188+0000","last_clean":"2024-09-15T22:16:17.606188+0000","last_became_active":"2024-09-15T22:14:06.808725+0000","last_became_peered":"2024-09-15T22:14:06.808725+0000","last_unstale":"2024-09-15T22:16:17.606188+0000","last_undegraded":"2024-09-15T22:16:17.606188+0000","last_fullsized":"2024-09-15T22:16:17.606188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:37.451661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540329+0000","last_change":"2024-09-15T22:14:04.714279+0000","last_active":"2024-09-15T22:16:17.540329+0000","last_peered":"2024-09-15T22:16:17.540329+0000","last_clean":"2024-09-15T22:16:17.540329+0000","last_became_active":"2024-09-15T22:14:04.713751+0000","last_became_peered":"2024-09-15T22:14:04.713751+0000","last_unstale":"2024-09-15T22:16:17.540329+0000","last_undegraded":"2024-09-15T22:16:17.540329+0000","last_fullsized":"2024-09-15T22:16:17.540329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:34.268701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.549598+0000","last_change":"2024-09-15T22:14:04.716417+0000","last_active":"2024-09-15T22:16:17.549598+0000","last_peered":"2024-09-15T22:16:17.549598+0000","last_clean":"2024-09-15T22:16:17.549598+0000","last_became_active":"2024-09-15T22:14:04.716096+0000","last_became_peered":"2024-09-15T22:14:04.716096+0000","last_unstale":"2024-09-15T22:16:17.549598+0000","last_undegraded":"2024-09-15T22:16:17.549598+0000","last_fullsized":"2024-09-15T22:16:17.549598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:30.819060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601287+0000","last_change":"2024-09-15T22:15:17.403940+0000","last_active":"2024-09-15T22:16:17.601287+0000","last_peered":"2024-09-15T22:16:17.601287+0000","last_clean":"2024-09-15T22:16:17.601287+0000","last_became_active":"2024-09-15T22:15:17.403517+0000","last_became_peered":"2024-09-15T22:15:17.403517+0000","last_unstale":"2024-09-15T22:16:17.601287+0000","last_undegraded":"2024-09-15T22:16:17.601287+0000","last_fullsized":"2024-09-15T22:16:17.601287+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:49.602367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552004+0000","last_change":"2024-09-15T22:15:17.404136+0000","last_active":"2024-09-15T22:16:17.552004+0000","last_peered":"2024-09-15T22:16:17.552004+0000","last_clean":"2024-09-15T22:16:17.552004+0000","last_became_active":"2024-09-15T22:15:17.403652+0000","last_became_peered":"2024-09-15T22:15:17.403652+0000","last_unstale":"2024-09-15T22:16:17.552004+0000","last_undegraded":"2024-09-15T22:16:17.552004+0000","last_fullsized":"2024-09-15T22:16:17.552004+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:31.518956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545473+0000","last_change":"2024-09-15T22:14:04.718682+0000","last_active":"2024-09-15T22:16:17.545473+0000","last_peered":"2024-09-15T22:16:17.545473+0000","last_clean":"2024-09-15T22:16:17.545473+0000","last_became_active":"2024-09-15T22:14:04.718313+0000","last_became_peered":"2024-09-15T22:14:04.718313+0000","last_unstale":"2024-09-15T22:16:17.545473+0000","last_undegraded":"2024-09-15T22:16:17.545473+0000","last_fullsized":"2024-09-15T22:16:17.545473+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:47.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595742+0000","last_change":"2024-09-15T22:14:06.819632+0000","last_active":"2024-09-15T22:16:17.595742+0000","last_peered":"2024-09-15T22:16:17.595742+0000","last_clean":"2024-09-15T22:16:17.595742+0000","last_became_active":"2024-09-15T22:14:06.819135+0000","last_became_peered":"2024-09-15T22:14:06.819135+0000","last_unstale":"2024-09-15T22:16:17.595742+0000","last_undegraded":"2024-09-15T22:16:17.595742+0000","last_fullsized":"2024-09-15T22:16:17.595742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:35.708318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552345+0000","last_change":"2024-09-15T22:14:13.851367+0000","last_active":"2024-09-15T22:16:17.552345+0000","last_peered":"2024-09-15T22:16:17.552345+0000","last_clean":"2024-09-15T22:16:17.552345+0000","last_became_active":"2024-09-15T22:14:13.850999+0000","last_became_peered":"2024-09-15T22:14:13.850999+0000","last_unstale":"2024-09-15T22:16:17.552345+0000","last_undegraded":"2024-09-15T22:16:17.552345+0000","last_fullsized":"2024-09-15T22:16:17.552345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:40:03.957622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582014+0000","last_change":"2024-09-15T22:14:06.817213+0000","last_active":"2024-09-15T22:16:17.582014+0000","last_peered":"2024-09-15T22:16:17.582014+0000","last_clean":"2024-09-15T22:16:17.582014+0000","last_became_active":"2024-09-15T22:14:06.816828+0000","last_became_peered":"2024-09-15T22:14:06.816828+0000","last_unstale":"2024-09-15T22:16:17.582014+0000","last_undegraded":"2024-09-15T22:16:17.582014+0000","last_fullsized":"2024-09-15T22:16:17.582014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:55.042256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.590899+0000","last_change":"2024-09-15T22:14:06.814832+0000","last_active":"2024-09-15T22:16:17.590899+0000","last_peered":"2024-09-15T22:16:17.590899+0000","last_clean":"2024-09-15T22:16:17.590899+0000","last_became_active":"2024-09-15T22:14:06.814500+0000","last_became_peered":"2024-09-15T22:14:06.814500+0000","last_unstale":"2024-09-15T22:16:17.590899+0000","last_undegraded":"2024-09-15T22:16:17.590899+0000","last_fullsized":"2024-09-15T22:16:17.590899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:43.623629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603884+0000","last_change":"2024-09-15T22:14:06.809464+0000","last_active":"2024-09-15T22:16:17.603884+0000","last_peered":"2024-09-15T22:16:17.603884+0000","last_clean":"2024-09-15T22:16:17.603884+0000","last_became_active":"2024-09-15T22:14:06.809160+0000","last_became_peered":"2024-09-15T22:14:06.809160+0000","last_unstale":"2024-09-15T22:16:17.603884+0000","last_undegraded":"2024-09-15T22:16:17.603884+0000","last_fullsized":"2024-09-15T22:16:17.603884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:04.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606874+0000","last_change":"2024-09-15T22:14:06.814428+0000","last_active":"2024-09-15T22:16:17.606874+0000","last_peered":"2024-09-15T22:16:17.606874+0000","last_clean":"2024-09-15T22:16:17.606874+0000","last_became_active":"2024-09-15T22:14:06.814100+0000","last_became_peered":"2024-09-15T22:14:06.814100+0000","last_unstale":"2024-09-15T22:16:17.606874+0000","last_undegraded":"2024-09-15T22:16:17.606874+0000","last_fullsized":"2024-09-15T22:16:17.606874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:33.606766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606907+0000","last_change":"2024-09-15T22:14:06.815638+0000","last_active":"2024-09-15T22:16:17.606907+0000","last_peered":"2024-09-15T22:16:17.606907+0000","last_clean":"2024-09-15T22:16:17.606907+0000","last_became_active":"2024-09-15T22:14:06.815327+0000","last_became_peered":"2024-09-15T22:14:06.815327+0000","last_unstale":"2024-09-15T22:16:17.606907+0000","last_undegraded":"2024-09-15T22:16:17.606907+0000","last_fullsized":"2024-09-15T22:16:17.606907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:07.679547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.580925+0000","last_change":"2024-09-15T22:15:17.218238+0000","last_active":"2024-09-15T22:16:17.580925+0000","last_peered":"2024-09-15T22:16:17.580925+0000","last_clean":"2024-09-15T22:16:17.580925+0000","last_became_active":"2024-09-15T22:15:17.217852+0000","last_became_peered":"2024-09-15T22:15:17.217852+0000","last_unstale":"2024-09-15T22:16:17.580925+0000","last_undegraded":"2024-09-15T22:16:17.580925+0000","last_fullsized":"2024-09-15T22:16:17.580925+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:42.046956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.576752+0000","last_change":"2024-09-15T22:14:06.819667+0000","last_active":"2024-09-15T22:16:17.576752+0000","last_peered":"2024-09-15T22:16:17.576752+0000","last_clean":"2024-09-15T22:16:17.576752+0000","last_became_active":"2024-09-15T22:14:06.819389+0000","last_became_peered":"2024-09-15T22:14:06.819389+0000","last_unstale":"2024-09-15T22:16:17.576752+0000","last_undegraded":"2024-09-15T22:16:17.576752+0000","last_fullsized":"2024-09-15T22:16:17.576752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:16.571088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596695+0000","last_change":"2024-09-15T22:15:17.118133+0000","last_active":"2024-09-15T22:16:17.596695+0000","last_peered":"2024-09-15T22:16:17.596695+0000","last_clean":"2024-09-15T22:16:17.596695+0000","last_became_active":"2024-09-15T22:15:17.117802+0000","last_became_peered":"2024-09-15T22:15:17.117802+0000","last_unstale":"2024-09-15T22:16:17.596695+0000","last_undegraded":"2024-09-15T22:16:17.596695+0000","last_fullsized":"2024-09-15T22:16:17.596695+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:21.523149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.600039+0000","last_change":"2024-09-15T22:14:06.801454+0000","last_active":"2024-09-15T22:16:17.600039+0000","last_peered":"2024-09-15T22:16:17.600039+0000","last_clean":"2024-09-15T22:16:17.600039+0000","last_became_active":"2024-09-15T22:14:06.801105+0000","last_became_peered":"2024-09-15T22:14:06.801105+0000","last_unstale":"2024-09-15T22:16:17.600039+0000","last_undegraded":"2024-09-15T22:16:17.600039+0000","last_fullsized":"2024-09-15T22:16:17.600039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:32.457428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596129+0000","last_change":"2024-09-15T22:14:06.812603+0000","last_active":"2024-09-15T22:16:17.596129+0000","last_peered":"2024-09-15T22:16:17.596129+0000","last_clean":"2024-09-15T22:16:17.596129+0000","last_became_active":"2024-09-15T22:14:06.812208+0000","last_became_peered":"2024-09-15T22:14:06.812208+0000","last_unstale":"2024-09-15T22:16:17.596129+0000","last_undegraded":"2024-09-15T22:16:17.596129+0000","last_fullsized":"2024-09-15T22:16:17.596129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:55.327481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595669+0000","last_change":"2024-09-15T22:14:06.811783+0000","last_active":"2024-09-15T22:16:17.595669+0000","last_peered":"2024-09-15T22:16:17.595669+0000","last_clean":"2024-09-15T22:16:17.595669+0000","last_became_active":"2024-09-15T22:14:06.811208+0000","last_became_peered":"2024-09-15T22:14:06.811208+0000","last_unstale":"2024-09-15T22:16:17.595669+0000","last_undegraded":"2024-09-15T22:16:17.595669+0000","last_fullsized":"2024-09-15T22:16:17.595669+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:15.576776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604634+0000","last_change":"2024-09-15T22:14:06.818608+0000","last_active":"2024-09-15T22:16:17.604634+0000","last_peered":"2024-09-15T22:16:17.604634+0000","last_clean":"2024-09-15T22:16:17.604634+0000","last_became_active":"2024-09-15T22:14:06.818283+0000","last_became_peered":"2024-09-15T22:14:06.818283+0000","last_unstale":"2024-09-15T22:16:17.604634+0000","last_undegraded":"2024-09-15T22:16:17.604634+0000","last_fullsized":"2024-09-15T22:16:17.604634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:02.477461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.593419+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:16:17.593419+0000","last_peered":"2024-09-15T22:16:17.593419+0000","last_clean":"2024-09-15T22:16:17.593419+0000","last_became_active":"2024-09-15T22:14:06.809043+0000","last_became_peered":"2024-09-15T22:14:06.809043+0000","last_unstale":"2024-09-15T22:16:17.593419+0000","last_undegraded":"2024-09-15T22:16:17.593419+0000","last_fullsized":"2024-09-15T22:16:17.593419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:58.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.590289+0000","last_change":"2024-09-15T22:14:06.814875+0000","last_active":"2024-09-15T22:16:17.590289+0000","last_peered":"2024-09-15T22:16:17.590289+0000","last_clean":"2024-09-15T22:16:17.590289+0000","last_became_active":"2024-09-15T22:14:06.814543+0000","last_became_peered":"2024-09-15T22:14:06.814543+0000","last_unstale":"2024-09-15T22:16:17.590289+0000","last_undegraded":"2024-09-15T22:16:17.590289+0000","last_fullsized":"2024-09-15T22:16:17.590289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:57.465965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.593270+0000","last_change":"2024-09-15T22:14:06.810655+0000","last_active":"2024-09-15T22:16:17.593270+0000","last_peered":"2024-09-15T22:16:17.593270+0000","last_clean":"2024-09-15T22:16:17.593270+0000","last_became_active":"2024-09-15T22:14:06.810159+0000","last_became_peered":"2024-09-15T22:14:06.810159+0000","last_unstale":"2024-09-15T22:16:17.593270+0000","last_undegraded":"2024-09-15T22:16:17.593270+0000","last_fullsized":"2024-09-15T22:16:17.593270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:17.368982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603230+0000","last_change":"2024-09-15T22:14:06.815048+0000","last_active":"2024-09-15T22:16:17.603230+0000","last_peered":"2024-09-15T22:16:17.603230+0000","last_clean":"2024-09-15T22:16:17.603230+0000","last_became_active":"2024-09-15T22:14:06.814744+0000","last_became_peered":"2024-09-15T22:14:06.814744+0000","last_unstale":"2024-09-15T22:16:17.603230+0000","last_undegraded":"2024-09-15T22:16:17.603230+0000","last_fullsized":"2024-09-15T22:16:17.603230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:26.927942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606870+0000","last_change":"2024-09-15T22:14:06.811672+0000","last_active":"2024-09-15T22:16:17.606870+0000","last_peered":"2024-09-15T22:16:17.606870+0000","last_clean":"2024-09-15T22:16:17.606870+0000","last_became_active":"2024-09-15T22:14:06.811300+0000","last_became_peered":"2024-09-15T22:14:06.811300+0000","last_unstale":"2024-09-15T22:16:17.606870+0000","last_undegraded":"2024-09-15T22:16:17.606870+0000","last_fullsized":"2024-09-15T22:16:17.606870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:46.223584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602861+0000","last_change":"2024-09-15T22:14:06.814495+0000","last_active":"2024-09-15T22:16:17.602861+0000","last_peered":"2024-09-15T22:16:17.602861+0000","last_clean":"2024-09-15T22:16:17.602861+0000","last_became_active":"2024-09-15T22:14:06.814142+0000","last_became_peered":"2024-09-15T22:14:06.814142+0000","last_unstale":"2024-09-15T22:16:17.602861+0000","last_undegraded":"2024-09-15T22:16:17.602861+0000","last_fullsized":"2024-09-15T22:16:17.602861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:20.374348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606219+0000","last_change":"2024-09-15T22:14:06.811063+0000","last_active":"2024-09-15T22:16:17.606219+0000","last_peered":"2024-09-15T22:16:17.606219+0000","last_clean":"2024-09-15T22:16:17.606219+0000","last_became_active":"2024-09-15T22:14:06.810700+0000","last_became_peered":"2024-09-15T22:14:06.810700+0000","last_unstale":"2024-09-15T22:16:17.606219+0000","last_undegraded":"2024-09-15T22:16:17.606219+0000","last_fullsized":"2024-09-15T22:16:17.606219+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:11.250590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605660+0000","last_change":"2024-09-15T22:14:06.816896+0000","last_active":"2024-09-15T22:16:17.605660+0000","last_peered":"2024-09-15T22:16:17.605660+0000","last_clean":"2024-09-15T22:16:17.605660+0000","last_became_active":"2024-09-15T22:14:06.816559+0000","last_became_peered":"2024-09-15T22:14:06.816559+0000","last_unstale":"2024-09-15T22:16:17.605660+0000","last_undegraded":"2024-09-15T22:16:17.605660+0000","last_fullsized":"2024-09-15T22:16:17.605660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:17.965490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.591968+0000","last_change":"2024-09-15T22:14:06.813984+0000","last_active":"2024-09-15T22:16:17.591968+0000","last_peered":"2024-09-15T22:16:17.591968+0000","last_clean":"2024-09-15T22:16:17.591968+0000","last_became_active":"2024-09-15T22:14:06.813586+0000","last_became_peered":"2024-09-15T22:14:06.813586+0000","last_unstale":"2024-09-15T22:16:17.591968+0000","last_undegraded":"2024-09-15T22:16:17.591968+0000","last_fullsized":"2024-09-15T22:16:17.591968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:34.335741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596558+0000","last_change":"2024-09-15T22:14:06.816047+0000","last_active":"2024-09-15T22:16:17.596558+0000","last_peered":"2024-09-15T22:16:17.596558+0000","last_clean":"2024-09-15T22:16:17.596558+0000","last_became_active":"2024-09-15T22:14:06.815244+0000","last_became_peered":"2024-09-15T22:14:06.815244+0000","last_unstale":"2024-09-15T22:16:17.596558+0000","last_undegraded":"2024-09-15T22:16:17.596558+0000","last_fullsized":"2024-09-15T22:16:17.596558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:30.469382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.583325+0000","last_change":"2024-09-15T22:14:06.813254+0000","last_active":"2024-09-15T22:16:17.583325+0000","last_peered":"2024-09-15T22:16:17.583325+0000","last_clean":"2024-09-15T22:16:17.583325+0000","last_became_active":"2024-09-15T22:14:06.812921+0000","last_became_peered":"2024-09-15T22:14:06.812921+0000","last_unstale":"2024-09-15T22:16:17.583325+0000","last_undegraded":"2024-09-15T22:16:17.583325+0000","last_fullsized":"2024-09-15T22:16:17.583325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:40.674246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595905+0000","last_change":"2024-09-15T22:14:06.817016+0000","last_active":"2024-09-15T22:16:17.595905+0000","last_peered":"2024-09-15T22:16:17.595905+0000","last_clean":"2024-09-15T22:16:17.595905+0000","last_became_active":"2024-09-15T22:14:06.816256+0000","last_became_peered":"2024-09-15T22:14:06.816256+0000","last_unstale":"2024-09-15T22:16:17.595905+0000","last_undegraded":"2024-09-15T22:16:17.595905+0000","last_fullsized":"2024-09-15T22:16:17.595905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:37.092156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.585070+0000","last_change":"2024-09-15T22:15:17.331108+0000","last_active":"2024-09-15T22:16:17.585070+0000","last_peered":"2024-09-15T22:16:17.585070+0000","last_clean":"2024-09-15T22:16:17.585070+0000","last_became_active":"2024-09-15T22:15:17.330765+0000","last_became_peered":"2024-09-15T22:15:17.330765+0000","last_unstale":"2024-09-15T22:16:17.585070+0000","last_undegraded":"2024-09-15T22:16:17.585070+0000","last_fullsized":"2024-09-15T22:16:17.585070+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:37.975326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582652+0000","last_change":"2024-09-15T22:14:06.814902+0000","last_active":"2024-09-15T22:16:17.582652+0000","last_peered":"2024-09-15T22:16:17.582652+0000","last_clean":"2024-09-15T22:16:17.582652+0000","last_became_active":"2024-09-15T22:14:06.814563+0000","last_became_peered":"2024-09-15T22:14:06.814563+0000","last_unstale":"2024-09-15T22:16:17.582652+0000","last_undegraded":"2024-09-15T22:16:17.582652+0000","last_fullsized":"2024-09-15T22:16:17.582652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:02.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.580466+0000","last_change":"2024-09-15T22:14:06.807444+0000","last_active":"2024-09-15T22:16:17.580466+0000","last_peered":"2024-09-15T22:16:17.580466+0000","last_clean":"2024-09-15T22:16:17.580466+0000","last_became_active":"2024-09-15T22:14:06.807083+0000","last_became_peered":"2024-09-15T22:14:06.807083+0000","last_unstale":"2024-09-15T22:16:17.580466+0000","last_undegraded":"2024-09-15T22:16:17.580466+0000","last_fullsized":"2024-09-15T22:16:17.580466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:07.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598596+0000","last_change":"2024-09-15T22:14:06.811851+0000","last_active":"2024-09-15T22:16:17.598596+0000","last_peered":"2024-09-15T22:16:17.598596+0000","last_clean":"2024-09-15T22:16:17.598596+0000","last_became_active":"2024-09-15T22:14:06.811451+0000","last_became_peered":"2024-09-15T22:14:06.811451+0000","last_unstale":"2024-09-15T22:16:17.598596+0000","last_undegraded":"2024-09-15T22:16:17.598596+0000","last_fullsized":"2024-09-15T22:16:17.598596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:51.389555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.589842+0000","last_change":"2024-09-15T22:14:06.812520+0000","last_active":"2024-09-15T22:16:17.589842+0000","last_peered":"2024-09-15T22:16:17.589842+0000","last_clean":"2024-09-15T22:16:17.589842+0000","last_became_active":"2024-09-15T22:14:06.812222+0000","last_became_peered":"2024-09-15T22:14:06.812222+0000","last_unstale":"2024-09-15T22:16:17.589842+0000","last_undegraded":"2024-09-15T22:16:17.589842+0000","last_fullsized":"2024-09-15T22:16:17.589842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:01.589678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604461+0000","last_change":"2024-09-15T22:14:06.808649+0000","last_active":"2024-09-15T22:16:17.604461+0000","last_peered":"2024-09-15T22:16:17.604461+0000","last_clean":"2024-09-15T22:16:17.604461+0000","last_became_active":"2024-09-15T22:14:06.808278+0000","last_became_peered":"2024-09-15T22:14:06.808278+0000","last_unstale":"2024-09-15T22:16:17.604461+0000","last_undegraded":"2024-09-15T22:16:17.604461+0000","last_fullsized":"2024-09-15T22:16:17.604461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:32.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605104+0000","last_change":"2024-09-15T22:14:06.811593+0000","last_active":"2024-09-15T22:16:17.605104+0000","last_peered":"2024-09-15T22:16:17.605104+0000","last_clean":"2024-09-15T22:16:17.605104+0000","last_became_active":"2024-09-15T22:14:06.811285+0000","last_became_peered":"2024-09-15T22:14:06.811285+0000","last_unstale":"2024-09-15T22:16:17.605104+0000","last_undegraded":"2024-09-15T22:16:17.605104+0000","last_fullsized":"2024-09-15T22:16:17.605104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:36.482554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604430+0000","last_change":"2024-09-15T22:14:06.816084+0000","last_active":"2024-09-15T22:16:17.604430+0000","last_peered":"2024-09-15T22:16:17.604430+0000","last_clean":"2024-09-15T22:16:17.604430+0000","last_became_active":"2024-09-15T22:14:06.815461+0000","last_became_peered":"2024-09-15T22:14:06.815461+0000","last_unstale":"2024-09-15T22:16:17.604430+0000","last_undegraded":"2024-09-15T22:16:17.604430+0000","last_fullsized":"2024-09-15T22:16:17.604430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:57.455608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597461,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":298,"num_read_kb":256,"num_write":206,"num_write_kb":1413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1892352,"data_stored":1792383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547240,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1028096,"data_stored":511054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776172,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28888,"kb_used_data":1804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716264,"statfs":{"total":95995035648,"available":95965454336,"internally_reserved":0,"allocated":1847296,"data_stored":1300967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939697,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1429504,"data_stored":908948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168631,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36744,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708408,"statfs":{"total":95995035648,"available":95957409792,"internally_reserved":0,"allocated":1429504,"data_stored":904874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1630208,"data_stored":1106100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593793,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1024000,"data_stored":506958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822726,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37252,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707900,"statfs":{"total":95995035648,"available":95956889600,"internally_reserved":0,"allocated":1769472,"data_stored":1233204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1032192,"data_stored":511076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215184,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1560576,"data_stored":1031878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1110016,"data_stored":578053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1105920,"data_stored":578805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40512,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704640,"statfs":{"total":95995035648,"available":95953551360,"internally_reserved":0,"allocated":1028096,"data_stored":507048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":524920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":131782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":393820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":203641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:16:22.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:16:22.889 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:23.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:23 smithi045 ceph-mon[31180]: Updating smithi100:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:16:23.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:23 smithi045 ceph-mon[31180]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:16:23.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:23 smithi045 ceph-mon[31180]: Updating smithi045:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:16:23.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:23 smithi045 ceph-mon[31180]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:16:23.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:23 smithi045 ceph-mon[31180]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:23.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:23 smithi045 ceph-mon[31180]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-15T22:16:23.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:23 smithi045 ceph-mon[31180]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:23.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.430+0000 7f65194c4640 1 -- 172.21.15.45:0/1272639797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6514102790 msgr2=0x7f65141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:23.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.430+0000 7f65194c4640 1 --2- 172.21.15.45:0/1272639797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6514102790 0x7f65141067e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009900 tx=0x7f64fc02a410 comp rx=0 tx=0).stop 2024-09-15T22:16:23.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.430+0000 7f65194c4640 1 -- 172.21.15.45:0/1272639797 shutdown_connections 2024-09-15T22:16:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.430+0000 7f65194c4640 1 --2- 172.21.15.45:0/1272639797 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6514106f10 0x7f651410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.430+0000 7f65194c4640 1 --2- 172.21.15.45:0/1272639797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6514102790 0x7f65141067e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.430+0000 7f65194c4640 1 --2- 172.21.15.45:0/1272639797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6514101de0 0x7f65141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.430+0000 7f65194c4640 1 -- 172.21.15.45:0/1272639797 >> 172.21.15.45:0/1272639797 conn(0x7f65140fd8c0 msgr2=0x7f65140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.430+0000 7f65194c4640 1 -- 172.21.15.45:0/1272639797 shutdown_connections 2024-09-15T22:16:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.430+0000 7f65194c4640 1 -- 172.21.15.45:0/1272639797 wait complete. 2024-09-15T22:16:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.431+0000 7f65194c4640 1 Processor -- start 2024-09-15T22:16:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.431+0000 7f65194c4640 1 -- start start 2024-09-15T22:16:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.431+0000 7f65194c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6514101de0 0x7f6514198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.431+0000 7f65194c4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6514102790 0x7f6514198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.431+0000 7f65194c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6514106f10 0x7f651419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:23.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.431+0000 7f65194c4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6514112050 con 0x7f6514101de0 2024-09-15T22:16:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.431+0000 7f65194c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6514111ed0 con 0x7f6514106f10 2024-09-15T22:16:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.431+0000 7f65194c4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f65141121d0 con 0x7f6514102790 2024-09-15T22:16:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.431+0000 7f6512ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6514101de0 0x7f6514198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.431+0000 7f6512ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6514101de0 0x7f6514198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52152/0 (socket says 172.21.15.45:52152) 2024-09-15T22:16:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.431+0000 7f6512ffd640 1 -- 172.21.15.45:0/680268592 learned_addr learned my addr 172.21.15.45:0/680268592 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.431+0000 7f650bfff640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6514102790 0x7f6514198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.432+0000 7f65137fe640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6514106f10 0x7f651419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.432+0000 7f6512ffd640 1 -- 172.21.15.45:0/680268592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6514102790 msgr2=0x7f6514198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.432+0000 7f6512ffd640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6514102790 0x7f6514198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.432+0000 7f6512ffd640 1 -- 172.21.15.45:0/680268592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6514106f10 msgr2=0x7f651419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.432+0000 7f6512ffd640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6514106f10 0x7f651419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:23.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.432+0000 7f6512ffd640 1 -- 172.21.15.45:0/680268592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651419d500 con 0x7f6514101de0 2024-09-15T22:16:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.432+0000 7f65137fe640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6514106f10 0x7f651419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.432+0000 7f6512ffd640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6514101de0 0x7f6514198550 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f650400c890 tx=0x7f650400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.432+0000 7f6510ff9640 1 -- 172.21.15.45:0/680268592 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6504004220 con 0x7f6514101de0 2024-09-15T22:16:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.432+0000 7f6510ff9640 1 -- 172.21.15.45:0/680268592 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f65040043c0 con 0x7f6514101de0 2024-09-15T22:16:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.432+0000 7f65194c4640 1 -- 172.21.15.45:0/680268592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f651419d7f0 con 0x7f6514101de0 2024-09-15T22:16:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.432+0000 7f6510ff9640 1 -- 172.21.15.45:0/680268592 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6504004b10 con 0x7f6514101de0 2024-09-15T22:16:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.432+0000 7f65194c4640 1 -- 172.21.15.45:0/680268592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65141a50d0 con 0x7f6514101de0 2024-09-15T22:16:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.433+0000 7f65194c4640 1 -- 172.21.15.45:0/680268592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65141021c0 con 0x7f6514101de0 2024-09-15T22:16:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.434+0000 7f6510ff9640 1 -- 172.21.15.45:0/680268592 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f65040051b0 con 0x7f6514101de0 2024-09-15T22:16:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.435+0000 7f6510ff9640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f65000a3440 0x7f65000a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.435+0000 7f650bfff640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f65000a3440 0x7f65000a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:23.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.435+0000 7f6510ff9640 1 -- 172.21.15.45:0/680268592 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f65040d02b0 con 0x7f6514101de0 2024-09-15T22:16:23.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.435+0000 7f650bfff640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f65000a3440 0x7f65000a5900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009230 tx=0x7f64fc0058d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:23.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.439+0000 7f6510ff9640 1 -- 172.21.15.45:0/680268592 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6504014030 con 0x7f6514101de0 2024-09-15T22:16:23.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:23 smithi165 ceph-mon[35551]: Updating smithi100:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:16:23.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:23 smithi165 ceph-mon[35551]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:16:23.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:23 smithi165 ceph-mon[35551]: Updating smithi045:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:16:23.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:23 smithi165 ceph-mon[35551]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:16:23.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:23 smithi165 ceph-mon[35551]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:23.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:23 smithi165 ceph-mon[35551]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-15T22:16:23.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:23 smithi165 ceph-mon[35551]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:23 smithi100 ceph-mon[35319]: Updating smithi100:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:16:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:23 smithi100 ceph-mon[35319]: Updating smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:16:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:23 smithi100 ceph-mon[35319]: Updating smithi045:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T22:16:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:23 smithi100 ceph-mon[35319]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:16:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:23 smithi100 ceph-mon[35319]: from='client.15249 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:23.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:23 smithi100 ceph-mon[35319]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-09-15T22:16:23.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:23 smithi100 ceph-mon[35319]: from='client.15255 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:23.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.652+0000 7f65194c4640 1 -- 172.21.15.45:0/680268592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65141998b0 con 0x7f6514101de0 2024-09-15T22:16:23.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.653+0000 7f6510ff9640 1 -- 172.21.15.45:0/680268592 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f650409c7b0 con 0x7f6514101de0 2024-09-15T22:16:23.655 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:23.655 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:16:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:16:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.655+0000 7f65194c4640 1 -- 172.21.15.45:0/680268592 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f65000a3440 msgr2=0x7f65000a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.655+0000 7f65194c4640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f65000a3440 0x7f65000a5900 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009230 tx=0x7f64fc0058d0 comp rx=0 tx=0).stop 2024-09-15T22:16:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.655+0000 7f65194c4640 1 -- 172.21.15.45:0/680268592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6514101de0 msgr2=0x7f6514198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.655+0000 7f65194c4640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6514101de0 0x7f6514198550 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f650400c890 tx=0x7f650400cd50 comp rx=0 tx=0).stop 2024-09-15T22:16:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.655+0000 7f65194c4640 1 -- 172.21.15.45:0/680268592 shutdown_connections 2024-09-15T22:16:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.655+0000 7f65194c4640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f65000a3440 0x7f65000a5900 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.655+0000 7f65194c4640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6514106f10 0x7f651419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.655+0000 7f65194c4640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6514102790 0x7f6514198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.655+0000 7f65194c4640 1 --2- 172.21.15.45:0/680268592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6514101de0 0x7f6514198550 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.655+0000 7f65194c4640 1 -- 172.21.15.45:0/680268592 >> 172.21.15.45:0/680268592 conn(0x7f65140fd8c0 msgr2=0x7f65140fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.655+0000 7f65194c4640 1 -- 172.21.15.45:0/680268592 shutdown_connections 2024-09-15T22:16:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:23.655+0000 7f65194c4640 1 -- 172.21.15.45:0/680268592 wait complete. 2024-09-15T22:16:24.351 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:24 smithi045 ceph-mon[31180]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:24.351 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:24 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/680268592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:24.353 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:16:24.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:24 smithi165 ceph-mon[35551]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:24.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:24 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/680268592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:24.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:24 smithi100 ceph-mon[35319]: from='client.15261 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:24.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:24 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/680268592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:24.616 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:25.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.116+0000 7f977b431640 1 -- 172.21.15.45:0/3998430178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9774100e20 msgr2=0x7f9774101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:25.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.116+0000 7f977b431640 1 --2- 172.21.15.45:0/3998430178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9774100e20 0x7f9774101200 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9770009900 tx=0x7f977002a480 comp rx=0 tx=0).stop 2024-09-15T22:16:25.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.116+0000 7f977b431640 1 -- 172.21.15.45:0/3998430178 shutdown_connections 2024-09-15T22:16:25.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.116+0000 7f977b431640 1 --2- 172.21.15.45:0/3998430178 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9774102ef0 0x7f977410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:25.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.116+0000 7f977b431640 1 --2- 172.21.15.45:0/3998430178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9774102570 0x7f97741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.116+0000 7f977b431640 1 --2- 172.21.15.45:0/3998430178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9774100e20 0x7f9774101200 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.116+0000 7f977b431640 1 -- 172.21.15.45:0/3998430178 >> 172.21.15.45:0/3998430178 conn(0x7f97740fc7d0 msgr2=0x7f97740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.116+0000 7f977b431640 1 -- 172.21.15.45:0/3998430178 shutdown_connections 2024-09-15T22:16:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.116+0000 7f977b431640 1 -- 172.21.15.45:0/3998430178 wait complete. 2024-09-15T22:16:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f977b431640 1 Processor -- start 2024-09-15T22:16:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f977b431640 1 -- start start 2024-09-15T22:16:25.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f977b431640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9774100e20 0x7f97741986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:25.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f977b431640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9774102570 0x7f9774198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:25.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f977b431640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9774102ef0 0x7f977419cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:25.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f977b431640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9774111160 con 0x7f9774100e20 2024-09-15T22:16:25.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f977b431640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9774110fe0 con 0x7f9774102ef0 2024-09-15T22:16:25.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f977b431640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f97741112e0 con 0x7f9774102570 2024-09-15T22:16:25.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f97791cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9774100e20 0x7f97741986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:25.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f97791cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9774100e20 0x7f97741986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34534/0 (socket says 172.21.15.45:34534) 2024-09-15T22:16:25.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f97791cd640 1 -- 172.21.15.45:0/3416293584 learned_addr learned my addr 172.21.15.45:0/3416293584 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:25.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f97789cc640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9774102570 0x7f9774198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:25.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f97799ce640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9774102ef0 0x7f977419cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:25.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f97791cd640 1 -- 172.21.15.45:0/3416293584 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9774102570 msgr2=0x7f9774198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:25.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f97791cd640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9774102570 0x7f9774198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:25.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f97791cd640 1 -- 172.21.15.45:0/3416293584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9774102ef0 msgr2=0x7f977419cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:25.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f97791cd640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9774102ef0 0x7f977419cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:25.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.117+0000 7f97791cd640 1 -- 172.21.15.45:0/3416293584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977419d650 con 0x7f9774100e20 2024-09-15T22:16:25.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.118+0000 7f97791cd640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9774100e20 0x7f97741986a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9770006010 tx=0x7f9770004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:25.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.118+0000 7f97667fc640 1 -- 172.21.15.45:0/3416293584 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977003f030 con 0x7f9774100e20 2024-09-15T22:16:25.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.118+0000 7f977b431640 1 -- 172.21.15.45:0/3416293584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f977419d8e0 con 0x7f9774100e20 2024-09-15T22:16:25.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.118+0000 7f97667fc640 1 -- 172.21.15.45:0/3416293584 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9770005500 con 0x7f9774100e20 2024-09-15T22:16:25.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.118+0000 7f977b431640 1 -- 172.21.15.45:0/3416293584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97741a5220 con 0x7f9774100e20 2024-09-15T22:16:25.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.118+0000 7f97667fc640 1 -- 172.21.15.45:0/3416293584 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9770049060 con 0x7f9774100e20 2024-09-15T22:16:25.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.119+0000 7f977b431640 1 -- 172.21.15.45:0/3416293584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9774101200 con 0x7f9774100e20 2024-09-15T22:16:25.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.121+0000 7f97667fc640 1 -- 172.21.15.45:0/3416293584 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f9770042030 con 0x7f9774100e20 2024-09-15T22:16:25.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.121+0000 7f97667fc640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f97600a3440 0x7f97600a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:25.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.123+0000 7f97789cc640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f97600a3440 0x7f97600a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:25.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.123+0000 7f97667fc640 1 -- 172.21.15.45:0/3416293584 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f97700f0f10 con 0x7f9774100e20 2024-09-15T22:16:25.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.123+0000 7f97789cc640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f97600a3440 0x7f97600a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f97740fee00 tx=0x7f9768009110 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:25.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.126+0000 7f97667fc640 1 -- 172.21.15.45:0/3416293584 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f97700bd4d0 con 0x7f9774100e20 2024-09-15T22:16:25.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:25 smithi045 ceph-mon[31180]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:16:25.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.302+0000 7f977b431640 1 -- 172.21.15.45:0/3416293584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97741a5450 con 0x7f9774100e20 2024-09-15T22:16:25.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.304+0000 7f97667fc640 1 -- 172.21.15.45:0/3416293584 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25101 (secure 0 0 0) 0x7f97700bcdd0 con 0x7f9774100e20 2024-09-15T22:16:25.306 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:25.306 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":90,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:16:17.536229+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":7}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/1919238369":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/4107707607":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3286786467":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1080251242":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1461513797":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/1919238369":"2024-09-16T22:16:17.536196+0000","172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3846204427":"2024-09-16T22:16:17.536196+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:16:25.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.306+0000 7f977b431640 1 -- 172.21.15.45:0/3416293584 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f97600a3440 msgr2=0x7f97600a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:25.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.306+0000 7f977b431640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f97600a3440 0x7f97600a5900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f97740fee00 tx=0x7f9768009110 comp rx=0 tx=0).stop 2024-09-15T22:16:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.306+0000 7f977b431640 1 -- 172.21.15.45:0/3416293584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9774100e20 msgr2=0x7f97741986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.306+0000 7f977b431640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9774100e20 0x7f97741986a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9770006010 tx=0x7f9770004c00 comp rx=0 tx=0).stop 2024-09-15T22:16:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.306+0000 7f977b431640 1 -- 172.21.15.45:0/3416293584 shutdown_connections 2024-09-15T22:16:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.306+0000 7f977b431640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f97600a3440 0x7f97600a5900 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.306+0000 7f977b431640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9774102ef0 0x7f977419cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.306+0000 7f977b431640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9774102570 0x7f9774198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.306+0000 7f977b431640 1 --2- 172.21.15.45:0/3416293584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9774100e20 0x7f97741986a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.306+0000 7f977b431640 1 -- 172.21.15.45:0/3416293584 >> 172.21.15.45:0/3416293584 conn(0x7f97740fc7d0 msgr2=0x7f9774069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.306+0000 7f977b431640 1 -- 172.21.15.45:0/3416293584 shutdown_connections 2024-09-15T22:16:25.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:25.306+0000 7f977b431640 1 -- 172.21.15.45:0/3416293584 wait complete. 2024-09-15T22:16:25.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:25 smithi165 ceph-mon[35551]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:16:25.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:25 smithi100 ceph-mon[35319]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:16:26.041 DEBUG:tasks.fwd_scrub:Yielding 2024-09-15T22:16:26.042 INFO:teuthology.run_tasks:Running task exec... 2024-09-15T22:16:26.051 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T22:16:26.051 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-15T22:16:26.051 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-15T22:16:26.052 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-15T22:16:26.052 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:16:26.052 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:16:26.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.166+0000 7f4fe020e640 1 -- 172.21.15.45:0/2766869444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd8102c80 msgr2=0x7f4fd8103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.166+0000 7f4fe020e640 1 --2- 172.21.15.45:0/2766869444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd8102c80 0x7f4fd8103060 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009900 tx=0x7f4fd402a480 comp rx=0 tx=0).stop 2024-09-15T22:16:26.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.167+0000 7f4fe020e640 1 -- 172.21.15.45:0/2766869444 shutdown_connections 2024-09-15T22:16:26.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.167+0000 7f4fe020e640 1 --2- 172.21.15.45:0/2766869444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fd810c0d0 0x7f4fd810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.167+0000 7f4fe020e640 1 --2- 172.21.15.45:0/2766869444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fd81035a0 0x7f4fd810ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.167+0000 7f4fe020e640 1 --2- 172.21.15.45:0/2766869444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd8102c80 0x7f4fd8103060 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.167+0000 7f4fe020e640 1 -- 172.21.15.45:0/2766869444 >> 172.21.15.45:0/2766869444 conn(0x7f4fd8077990 msgr2=0x7f4fd80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:26.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.167+0000 7f4fe020e640 1 -- 172.21.15.45:0/2766869444 shutdown_connections 2024-09-15T22:16:26.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.167+0000 7f4fe020e640 1 -- 172.21.15.45:0/2766869444 wait complete. 2024-09-15T22:16:26.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.167+0000 7f4fe020e640 1 Processor -- start 2024-09-15T22:16:26.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.167+0000 7f4fe020e640 1 -- start start 2024-09-15T22:16:26.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fe020e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fd8102c80 0x7f4fd81008d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fe020e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd81035a0 0x7f4fd8100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fe020e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fd810c0d0 0x7f4fd8101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fe020e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd8111fd0 con 0x7f4fd81035a0 2024-09-15T22:16:26.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fe020e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd8111e50 con 0x7f4fd810c0d0 2024-09-15T22:16:26.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fe020e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd8112150 con 0x7f4fd8102c80 2024-09-15T22:16:26.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fdd7a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd81035a0 0x7f4fd8100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fdd7a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd81035a0 0x7f4fd8100e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34554/0 (socket says 172.21.15.45:34554) 2024-09-15T22:16:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fdd7a9640 1 -- 172.21.15.45:0/3088932921 learned_addr learned my addr 172.21.15.45:0/3088932921 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fddfaa640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fd8102c80 0x7f4fd81008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fde7ab640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fd810c0d0 0x7f4fd8101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fdd7a9640 1 -- 172.21.15.45:0/3088932921 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fd8102c80 msgr2=0x7f4fd81008d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fdd7a9640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fd8102c80 0x7f4fd81008d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fdd7a9640 1 -- 172.21.15.45:0/3088932921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fd810c0d0 msgr2=0x7f4fd8101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fdd7a9640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fd810c0d0 0x7f4fd8101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fdd7a9640 1 -- 172.21.15.45:0/3088932921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd81a69c0 con 0x7f4fd81035a0 2024-09-15T22:16:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fdd7a9640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd81035a0 0x7f4fd8100e10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800e9f0 tx=0x7f4fc800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.168+0000 7f4fceffd640 1 -- 172.21.15.45:0/3088932921 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc800ccc0 con 0x7f4fd81035a0 2024-09-15T22:16:26.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.169+0000 7f4fceffd640 1 -- 172.21.15.45:0/3088932921 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4fc800ce60 con 0x7f4fd81035a0 2024-09-15T22:16:26.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.169+0000 7f4fceffd640 1 -- 172.21.15.45:0/3088932921 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8010690 con 0x7f4fd81035a0 2024-09-15T22:16:26.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.169+0000 7f4fe020e640 1 -- 172.21.15.45:0/3088932921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd81a6cb0 con 0x7f4fd81035a0 2024-09-15T22:16:26.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.169+0000 7f4fe020e640 1 -- 172.21.15.45:0/3088932921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd81a71b0 con 0x7f4fd81035a0 2024-09-15T22:16:26.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.170+0000 7f4fe020e640 1 -- 172.21.15.45:0/3088932921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd8103060 con 0x7f4fd81035a0 2024-09-15T22:16:26.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.171+0000 7f4fceffd640 1 -- 172.21.15.45:0/3088932921 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f4fc80046c0 con 0x7f4fd81035a0 2024-09-15T22:16:26.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.172+0000 7f4fceffd640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4fc40a3500 0x7f4fc40a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.172+0000 7f4fddfaa640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4fc40a3500 0x7f4fc40a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.172+0000 7f4fceffd640 1 -- 172.21.15.45:0/3088932921 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f4fc80d0590 con 0x7f4fd81035a0 2024-09-15T22:16:26.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.172+0000 7f4fddfaa640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4fc40a3500 0x7f4fc40a59c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009230 tx=0x7f4fd40058d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.176+0000 7f4fceffd640 1 -- 172.21.15.45:0/3088932921 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4fc809ca90 con 0x7f4fd81035a0 2024-09-15T22:16:26.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:26 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3416293584' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:16:26.347 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:26.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.398+0000 7f4fe020e640 1 -- 172.21.15.45:0/3088932921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f4fd81a73e0 con 0x7f4fd81035a0 2024-09-15T22:16:26.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.402+0000 7f4fceffd640 1 -- 172.21.15.45:0/3088932921 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v32)=0 v32) ==== 129+0+0 (secure 0 0 0) 0x7f4fc809c390 con 0x7f4fd81035a0 2024-09-15T22:16:26.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.404+0000 7f4fe020e640 1 -- 172.21.15.45:0/3088932921 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4fc40a3500 msgr2=0x7f4fc40a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.404+0000 7f4fe020e640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4fc40a3500 0x7f4fc40a59c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009230 tx=0x7f4fd40058d0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.404+0000 7f4fe020e640 1 -- 172.21.15.45:0/3088932921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd81035a0 msgr2=0x7f4fd8100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.404+0000 7f4fe020e640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd81035a0 0x7f4fd8100e10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4fc800e9f0 tx=0x7f4fc800eeb0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.404+0000 7f4fe020e640 1 -- 172.21.15.45:0/3088932921 shutdown_connections 2024-09-15T22:16:26.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.404+0000 7f4fe020e640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4fc40a3500 0x7f4fc40a59c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.404+0000 7f4fe020e640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fd810c0d0 0x7f4fd8101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.404+0000 7f4fe020e640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fd81035a0 0x7f4fd8100e10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.404+0000 7f4fe020e640 1 --2- 172.21.15.45:0/3088932921 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4fd8102c80 0x7f4fd81008d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.404+0000 7f4fe020e640 1 -- 172.21.15.45:0/3088932921 >> 172.21.15.45:0/3088932921 conn(0x7f4fd8077990 msgr2=0x7f4fd80fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:26.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.404+0000 7f4fe020e640 1 -- 172.21.15.45:0/3088932921 shutdown_connections 2024-09-15T22:16:26.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.405+0000 7f4fe020e640 1 -- 172.21.15.45:0/3088932921 wait complete. 2024-09-15T22:16:26.417 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-15T22:16:26.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:26 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3416293584' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:16:26.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:26 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3416293584' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:16:26.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.523+0000 7f1e930ba640 1 -- 172.21.15.45:0/2745545826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e8c10c130 msgr2=0x7f1e8c10e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.523+0000 7f1e930ba640 1 --2- 172.21.15.45:0/2745545826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e8c10c130 0x7f1e8c10e5a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009ca0 tx=0x7f1e8402a950 comp rx=0 tx=0).stop 2024-09-15T22:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.523+0000 7f1e930ba640 1 -- 172.21.15.45:0/2745545826 shutdown_connections 2024-09-15T22:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.523+0000 7f1e930ba640 1 --2- 172.21.15.45:0/2745545826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e8c10c130 0x7f1e8c10e5a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.523+0000 7f1e930ba640 1 --2- 172.21.15.45:0/2745545826 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e8c103680 0x7f1e8c10bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.523+0000 7f1e930ba640 1 --2- 172.21.15.45:0/2745545826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c102d60 0x7f1e8c103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.523+0000 7f1e930ba640 1 -- 172.21.15.45:0/2745545826 >> 172.21.15.45:0/2745545826 conn(0x7f1e8c0fc6b0 msgr2=0x7f1e8c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.523+0000 7f1e930ba640 1 -- 172.21.15.45:0/2745545826 shutdown_connections 2024-09-15T22:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.523+0000 7f1e930ba640 1 -- 172.21.15.45:0/2745545826 wait complete. 2024-09-15T22:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.524+0000 7f1e930ba640 1 Processor -- start 2024-09-15T22:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.524+0000 7f1e930ba640 1 -- start start 2024-09-15T22:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.524+0000 7f1e930ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c102d60 0x7f1e8c1009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.524+0000 7f1e930ba640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e8c103680 0x7f1e8c100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.524+0000 7f1e930ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e8c10c130 0x7f1e8c101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.524+0000 7f1e930ba640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8c112020 con 0x7f1e8c10c130 2024-09-15T22:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.524+0000 7f1e930ba640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8c111ea0 con 0x7f1e8c102d60 2024-09-15T22:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.524+0000 7f1e930ba640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1e8c1121a0 con 0x7f1e8c103680 2024-09-15T22:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.524+0000 7f1e91657640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e8c10c130 0x7f1e8c101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.524+0000 7f1e90e56640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c102d60 0x7f1e8c1009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.524+0000 7f1e8bfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e8c103680 0x7f1e8c100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.524+0000 7f1e90e56640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c102d60 0x7f1e8c1009b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:56198/0 (socket says 172.21.15.45:56198) 2024-09-15T22:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.525+0000 7f1e90e56640 1 -- 172.21.15.45:0/2505515089 learned_addr learned my addr 172.21.15.45:0/2505515089 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.525+0000 7f1e90e56640 1 -- 172.21.15.45:0/2505515089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e8c103680 msgr2=0x7f1e8c100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.525+0000 7f1e90e56640 1 --2- 172.21.15.45:0/2505515089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e8c103680 0x7f1e8c100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.525+0000 7f1e90e56640 1 -- 172.21.15.45:0/2505515089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e8c10c130 msgr2=0x7f1e8c101430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.525+0000 7f1e90e56640 1 --2- 172.21.15.45:0/2505515089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e8c10c130 0x7f1e8c101430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.525+0000 7f1e90e56640 1 -- 172.21.15.45:0/2505515089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8c1a6930 con 0x7f1e8c102d60 2024-09-15T22:16:26.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.525+0000 7f1e90e56640 1 --2- 172.21.15.45:0/2505515089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c102d60 0x7f1e8c1009b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000e9f0 tx=0x7f1e8000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.525+0000 7f1e89ffb640 1 -- 172.21.15.45:0/2505515089 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000cd80 con 0x7f1e8c102d60 2024-09-15T22:16:26.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.525+0000 7f1e89ffb640 1 -- 172.21.15.45:0/2505515089 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1e80010930 con 0x7f1e8c102d60 2024-09-15T22:16:26.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.525+0000 7f1e930ba640 1 -- 172.21.15.45:0/2505515089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e8c1a6c20 con 0x7f1e8c102d60 2024-09-15T22:16:26.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.525+0000 7f1e89ffb640 1 -- 172.21.15.45:0/2505515089 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e80018b00 con 0x7f1e8c102d60 2024-09-15T22:16:26.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.525+0000 7f1e930ba640 1 -- 172.21.15.45:0/2505515089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e8c1a7170 con 0x7f1e8c102d60 2024-09-15T22:16:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.526+0000 7f1e930ba640 1 -- 172.21.15.45:0/2505515089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e8c103140 con 0x7f1e8c102d60 2024-09-15T22:16:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.528+0000 7f1e89ffb640 1 -- 172.21.15.45:0/2505515089 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f1e80018ca0 con 0x7f1e8c102d60 2024-09-15T22:16:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.528+0000 7f1e89ffb640 1 --2- 172.21.15.45:0/2505515089 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1e7c0a3500 0x7f1e7c0a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.528+0000 7f1e8bfff640 1 --2- 172.21.15.45:0/2505515089 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1e7c0a3500 0x7f1e7c0a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.528+0000 7f1e89ffb640 1 -- 172.21.15.45:0/2505515089 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f1e800d0730 con 0x7f1e8c102d60 2024-09-15T22:16:26.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.529+0000 7f1e8bfff640 1 --2- 172.21.15.45:0/2505515089 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1e7c0a3500 0x7f1e7c0a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c102440 tx=0x7f1e7800b410 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.531+0000 7f1e89ffb640 1 -- 172.21.15.45:0/2505515089 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e8009c640 con 0x7f1e8c102d60 2024-09-15T22:16:26.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.710+0000 7f1e930ba640 1 -- 172.21.15.45:0/2505515089 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f1e8c1a7370 con 0x7f1e8c102d60 2024-09-15T22:16:26.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.716+0000 7f1e89ffb640 1 -- 172.21.15.45:0/2505515089 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v33)=0 v33) ==== 138+0+0 (secure 0 0 0) 0x7f1e80098030 con 0x7f1e8c102d60 2024-09-15T22:16:26.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.718+0000 7f1e930ba640 1 -- 172.21.15.45:0/2505515089 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1e7c0a3500 msgr2=0x7f1e7c0a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.718+0000 7f1e930ba640 1 --2- 172.21.15.45:0/2505515089 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1e7c0a3500 0x7f1e7c0a59c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c102440 tx=0x7f1e7800b410 comp rx=0 tx=0).stop 2024-09-15T22:16:26.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.718+0000 7f1e930ba640 1 -- 172.21.15.45:0/2505515089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c102d60 msgr2=0x7f1e8c1009b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.718+0000 7f1e930ba640 1 --2- 172.21.15.45:0/2505515089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c102d60 0x7f1e8c1009b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000e9f0 tx=0x7f1e8000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.718+0000 7f1e930ba640 1 -- 172.21.15.45:0/2505515089 shutdown_connections 2024-09-15T22:16:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.718+0000 7f1e930ba640 1 --2- 172.21.15.45:0/2505515089 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1e7c0a3500 0x7f1e7c0a59c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.718+0000 7f1e930ba640 1 --2- 172.21.15.45:0/2505515089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e8c10c130 0x7f1e8c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.718+0000 7f1e930ba640 1 --2- 172.21.15.45:0/2505515089 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e8c103680 0x7f1e8c100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.718+0000 7f1e930ba640 1 --2- 172.21.15.45:0/2505515089 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e8c102d60 0x7f1e8c1009b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.718+0000 7f1e930ba640 1 -- 172.21.15.45:0/2505515089 >> 172.21.15.45:0/2505515089 conn(0x7f1e8c0fc6b0 msgr2=0x7f1e8c0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.718+0000 7f1e930ba640 1 -- 172.21.15.45:0/2505515089 shutdown_connections 2024-09-15T22:16:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.718+0000 7f1e930ba640 1 -- 172.21.15.45:0/2505515089 wait complete. 2024-09-15T22:16:26.732 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-15T22:16:26.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.840+0000 7f6404133640 1 -- 172.21.15.45:0/179289827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc102ce0 msgr2=0x7f63fc1030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.840+0000 7f6404133640 1 --2- 172.21.15.45:0/179289827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc102ce0 0x7f63fc1030c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009ca0 tx=0x7f63f802a950 comp rx=0 tx=0).stop 2024-09-15T22:16:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.840+0000 7f6404133640 1 -- 172.21.15.45:0/179289827 shutdown_connections 2024-09-15T22:16:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.840+0000 7f6404133640 1 --2- 172.21.15.45:0/179289827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63fc10c0b0 0x7f63fc10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.840+0000 7f6404133640 1 --2- 172.21.15.45:0/179289827 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63fc103600 0x7f63fc10bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.840+0000 7f6404133640 1 --2- 172.21.15.45:0/179289827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc102ce0 0x7f63fc1030c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.840+0000 7f6404133640 1 -- 172.21.15.45:0/179289827 >> 172.21.15.45:0/179289827 conn(0x7f63fc077990 msgr2=0x7f63fc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.840+0000 7f6404133640 1 -- 172.21.15.45:0/179289827 shutdown_connections 2024-09-15T22:16:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.840+0000 7f6404133640 1 -- 172.21.15.45:0/179289827 wait complete. 2024-09-15T22:16:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f6404133640 1 Processor -- start 2024-09-15T22:16:26.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f6404133640 1 -- start start 2024-09-15T22:16:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f6404133640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc102ce0 0x7f63fc19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f6404133640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63fc103600 0x7f63fc19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f6404133640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63fc10c0b0 0x7f63fc19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f6404133640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc111fd0 con 0x7f63fc102ce0 2024-09-15T22:16:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f6404133640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc111e50 con 0x7f63fc103600 2024-09-15T22:16:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f6404133640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc112150 con 0x7f63fc10c0b0 2024-09-15T22:16:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f6401ecf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc102ce0 0x7f63fc19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f64016ce640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63fc103600 0x7f63fc19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f6401ecf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc102ce0 0x7f63fc19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34600/0 (socket says 172.21.15.45:34600) 2024-09-15T22:16:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f6401ecf640 1 -- 172.21.15.45:0/4167349958 learned_addr learned my addr 172.21.15.45:0/4167349958 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f64026d0640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63fc10c0b0 0x7f63fc19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f64016ce640 1 -- 172.21.15.45:0/4167349958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63fc10c0b0 msgr2=0x7f63fc19eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f64016ce640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63fc10c0b0 0x7f63fc19eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f64016ce640 1 -- 172.21.15.45:0/4167349958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc102ce0 msgr2=0x7f63fc19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f64016ce640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc102ce0 0x7f63fc19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f64016ce640 1 -- 172.21.15.45:0/4167349958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc19f610 con 0x7f63fc103600 2024-09-15T22:16:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.841+0000 7f6401ecf640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc102ce0 0x7f63fc19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.842+0000 7f64016ce640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63fc103600 0x7f63fc19ab60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63f0005fd0 tx=0x7f63f000dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.842+0000 7f63eeffd640 1 -- 172.21.15.45:0/4167349958 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0009c30 con 0x7f63fc103600 2024-09-15T22:16:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.842+0000 7f63eeffd640 1 -- 172.21.15.45:0/4167349958 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63f0009dd0 con 0x7f63fc103600 2024-09-15T22:16:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.842+0000 7f6404133640 1 -- 172.21.15.45:0/4167349958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc19f900 con 0x7f63fc103600 2024-09-15T22:16:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.842+0000 7f63eeffd640 1 -- 172.21.15.45:0/4167349958 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0010460 con 0x7f63fc103600 2024-09-15T22:16:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.842+0000 7f6404133640 1 -- 172.21.15.45:0/4167349958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63fc1a7190 con 0x7f63fc103600 2024-09-15T22:16:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.843+0000 7f6404133640 1 -- 172.21.15.45:0/4167349958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63fc1030c0 con 0x7f63fc103600 2024-09-15T22:16:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.845+0000 7f63eeffd640 1 -- 172.21.15.45:0/4167349958 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f63f0004000 con 0x7f63fc103600 2024-09-15T22:16:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.846+0000 7f63eeffd640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f63e80a3580 0x7f63e80a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.846+0000 7f6401ecf640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f63e80a3580 0x7f63e80a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.847+0000 7f63eeffd640 1 -- 172.21.15.45:0/4167349958 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f63f00d0020 con 0x7f63fc103600 2024-09-15T22:16:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.847+0000 7f6401ecf640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f63e80a3580 0x7f63e80a5a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f63f802ae70 tx=0x7f63f8005c50 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.848+0000 7f63eeffd640 1 -- 172.21.15.45:0/4167349958 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f63f0017020 con 0x7f63fc103600 2024-09-15T22:16:26.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.930+0000 7fc0dafe9640 1 -- 172.21.15.45:0/2301743403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d4106a80 msgr2=0x7fc0d4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.930+0000 7fc0dafe9640 1 --2- 172.21.15.45:0/2301743403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d4106a80 0x7fc0d4106e60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009930 tx=0x7fc0bc02a420 comp rx=0 tx=0).stop 2024-09-15T22:16:26.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.930+0000 7fc0dafe9640 1 -- 172.21.15.45:0/2301743403 shutdown_connections 2024-09-15T22:16:26.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.930+0000 7fc0dafe9640 1 --2- 172.21.15.45:0/2301743403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d4101420 0x7fc0d410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.930+0000 7fc0dafe9640 1 --2- 172.21.15.45:0/2301743403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0d4100a80 0x7fc0d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.930+0000 7fc0dafe9640 1 --2- 172.21.15.45:0/2301743403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d4106a80 0x7fc0d4106e60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.930+0000 7fc0dafe9640 1 -- 172.21.15.45:0/2301743403 >> 172.21.15.45:0/2301743403 conn(0x7fc0d40fc7a0 msgr2=0x7fc0d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.930+0000 7fc0dafe9640 1 -- 172.21.15.45:0/2301743403 shutdown_connections 2024-09-15T22:16:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.930+0000 7fc0dafe9640 1 -- 172.21.15.45:0/2301743403 wait complete. 2024-09-15T22:16:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.930+0000 7fc0dafe9640 1 Processor -- start 2024-09-15T22:16:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.930+0000 7fc0dafe9640 1 -- start start 2024-09-15T22:16:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0dafe9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d4100a80 0x7fc0d41984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0dafe9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0d4101420 0x7fc0d4198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0dafe9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d4106a80 0x7fc0d419cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0dafe9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d4110f60 con 0x7fc0d4100a80 2024-09-15T22:16:26.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0dafe9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d4110de0 con 0x7fc0d4106a80 2024-09-15T22:16:26.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0dafe9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d41110e0 con 0x7fc0d4101420 2024-09-15T22:16:26.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0d8d85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d4100a80 0x7fc0d41984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0d8d85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d4100a80 0x7fc0d41984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34618/0 (socket says 172.21.15.45:34618) 2024-09-15T22:16:26.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0d8d85640 1 -- 172.21.15.45:0/2936235589 learned_addr learned my addr 172.21.15.45:0/2936235589 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:26.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0d9586640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d4106a80 0x7fc0d419cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0d3fff640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0d4101420 0x7fc0d4198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0d8d85640 1 -- 172.21.15.45:0/2936235589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0d4101420 msgr2=0x7fc0d4198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0d8d85640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0d4101420 0x7fc0d4198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0d8d85640 1 -- 172.21.15.45:0/2936235589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d4106a80 msgr2=0x7fc0d419cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0d8d85640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d4106a80 0x7fc0d419cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0d8d85640 1 -- 172.21.15.45:0/2936235589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d419d4a0 con 0x7fc0d4100a80 2024-09-15T22:16:26.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.931+0000 7fc0d9586640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d4106a80 0x7fc0d419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:26.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.932+0000 7fc0d8d85640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d4100a80 0x7fc0d41984f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009230 tx=0x7fc0bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.932+0000 7fc0d1ffb640 1 -- 172.21.15.45:0/2936235589 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc03f030 con 0x7fc0d4100a80 2024-09-15T22:16:26.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.932+0000 7fc0dafe9640 1 -- 172.21.15.45:0/2936235589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d419d730 con 0x7fc0d4100a80 2024-09-15T22:16:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.932+0000 7fc0d1ffb640 1 -- 172.21.15.45:0/2936235589 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc0bc003af0 con 0x7fc0d4100a80 2024-09-15T22:16:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.932+0000 7fc0d1ffb640 1 -- 172.21.15.45:0/2936235589 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc035070 con 0x7fc0d4100a80 2024-09-15T22:16:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.932+0000 7fc0dafe9640 1 -- 172.21.15.45:0/2936235589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d40fccf0 con 0x7fc0d4100a80 2024-09-15T22:16:26.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.935+0000 7fc0d1ffb640 1 -- 172.21.15.45:0/2936235589 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fc0bc042030 con 0x7fc0d4100a80 2024-09-15T22:16:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.935+0000 7fc0dd3c2740 1 Processor -- start 2024-09-15T22:16:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.935+0000 7fc0dd3c2740 1 -- start start 2024-09-15T22:16:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d1ffb640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc0c00a34c0 0x7fc0c00a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0dd3c2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8eb60 0x5560ebb8ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0dd3c2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb8f480 0x5560ebb99800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0dd3c2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb99d40 0x5560ebb9c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0dd3c2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5560ebaf4280 con 0x5560ebb8eb60 2024-09-15T22:16:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0dd3c2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5560eba9bb10 con 0x5560ebb99d40 2024-09-15T22:16:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0dd3c2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5560ebaf0240 con 0x5560ebb8f480 2024-09-15T22:16:26.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d9586640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc0c00a34c0 0x7fc0c00a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d8d85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8eb60 0x5560ebb8ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d8d85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8eb60 0x5560ebb8ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34624/0 (socket says 172.21.15.45:34624) 2024-09-15T22:16:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d8d85640 1 -- 172.21.15.45:0/2544828504 learned_addr learned my addr 172.21.15.45:0/2544828504 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d9586640 1 --2- 172.21.15.45:0/2544828504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb99d40 0x5560ebb9c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d3fff640 1 --2- 172.21.15.45:0/2544828504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb8f480 0x5560ebb99800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d1ffb640 1 -- 172.21.15.45:0/2936235589 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fc0bc0f0bf0 con 0x7fc0d4100a80 2024-09-15T22:16:26.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d8d85640 1 -- 172.21.15.45:0/2544828504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb8f480 msgr2=0x5560ebb99800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:26.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d8d85640 1 --2- 172.21.15.45:0/2544828504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb8f480 0x5560ebb99800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d8d85640 1 -- 172.21.15.45:0/2544828504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb99d40 msgr2=0x5560ebb9c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:26.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d8d85640 1 --2- 172.21.15.45:0/2544828504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb99d40 0x5560ebb9c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d8d85640 1 -- 172.21.15.45:0/2544828504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ebaa81f0 con 0x5560ebb8eb60 2024-09-15T22:16:26.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.936+0000 7fc0d9586640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc0c00a34c0 0x7fc0c00a5980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009fd0 tx=0x7fc0cc009dc0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.937+0000 7fc0d8d85640 1 --2- 172.21.15.45:0/2544828504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8eb60 0x5560ebb8ef40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009900 tx=0x7fc0bc02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ba5731427dfe59 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.937+0000 7fc0caffd640 1 -- 172.21.15.45:0/2544828504 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc049030 con 0x5560ebb8eb60 2024-09-15T22:16:26.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.937+0000 7fc0caffd640 1 -- 172.21.15.45:0/2544828504 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc0bc0c5660 con 0x5560ebb8eb60 2024-09-15T22:16:26.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.937+0000 7fc0caffd640 1 -- 172.21.15.45:0/2544828504 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0b92a0 con 0x5560ebb8eb60 2024-09-15T22:16:26.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.937+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/2544828504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8eb60 msgr2=0x5560ebb8ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.937+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/2544828504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8eb60 0x5560ebb8ef40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009900 tx=0x7fc0bc02a420 comp rx=0 tx=0).stop 2024-09-15T22:16:26.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.938+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/2544828504 shutdown_connections 2024-09-15T22:16:26.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.938+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/2544828504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb99d40 0x5560ebb9c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.938+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/2544828504 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb8f480 0x5560ebb99800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.938+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/2544828504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8eb60 0x5560ebb8ef40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.938+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/2544828504 >> 172.21.15.45:0/2544828504 conn(0x5560ebb8b0f0 msgr2=0x5560ebb8b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:26.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.938+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/2544828504 shutdown_connections 2024-09-15T22:16:26.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.938+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/2544828504 wait complete. 2024-09-15T22:16:26.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.938+0000 7fc0dd3c2740 1 -- start start 2024-09-15T22:16:26.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.938+0000 7fc0dd3c2740 1 Processor -- start 2024-09-15T22:16:26.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.938+0000 7fc0dd3c2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb8eb60 0x5560ebb96c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.938+0000 7fc0dd3c2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb97160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.938+0000 7fc0dd3c2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb99d40 0x5560ebb976a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0dd3c2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5560ebb9c6d0 con 0x5560ebb8f480 2024-09-15T22:16:26.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0dd3c2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5560ebaaef10 con 0x5560ebb99d40 2024-09-15T22:16:26.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0dd3c2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5560ebb9c850 con 0x5560ebb8eb60 2024-09-15T22:16:26.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0dd3c2740 10 client.0 _ll_register_callbacks cb 0x5560eba77a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:26.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb97160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0d9586640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb99d40 0x5560ebb976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0d9586640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb99d40 0x5560ebb976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:56250/0 (socket says 172.21.15.45:56250) 2024-09-15T22:16:26.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0d9586640 1 -- 172.21.15.45:0/252436478 learned_addr learned my addr 172.21.15.45:0/252436478 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:26.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0d8d85640 1 --2- 172.21.15.45:0/252436478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb8eb60 0x5560ebb96c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0d9586640 1 -- 172.21.15.45:0/252436478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb8eb60 msgr2=0x5560ebb96c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:26.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0d9586640 1 --2- 172.21.15.45:0/252436478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb8eb60 0x5560ebb96c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0d9586640 1 -- 172.21.15.45:0/252436478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 msgr2=0x5560ebb97160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:26.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0d9586640 1 --2- 172.21.15.45:0/252436478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb97160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0d9586640 1 -- 172.21.15.45:0/252436478 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560eb8656a0 con 0x5560ebb99d40 2024-09-15T22:16:26.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0d9586640 1 --2- 172.21.15.45:0/252436478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb99d40 0x5560ebb976a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc013370 tx=0x7fc0cc004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2182075eb95c227c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-15T22:16:26.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0b3fff640 1 -- 172.21.15.45:0/252436478 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc0044c0 con 0x5560ebb99d40 2024-09-15T22:16:26.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/252436478 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0bc0c5660 con 0x5560ebb99d40 2024-09-15T22:16:26.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.939+0000 7fc0b3fff640 1 -- 172.21.15.45:0/252436478 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fc0cc003d80 con 0x5560ebb99d40 2024-09-15T22:16:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.940+0000 7fc0b3fff640 1 -- 172.21.15.45:0/252436478 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc0cc02e580 con 0x5560ebb99d40 2024-09-15T22:16:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.940+0000 7fc0dd3c2740 10 client.25025 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.940+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/252436478 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5560ebba8210 con 0x5560ebb99d40 2024-09-15T22:16:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.940+0000 7fc0b3fff640 1 -- 172.21.15.45:0/252436478 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc0bc0c5660 con 0x5560ebb99d40 2024-09-15T22:16:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.940+0000 7fc0b3fff640 1 -- 172.21.15.45:0/252436478 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc0cc020050 con 0x5560ebb99d40 2024-09-15T22:16:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.940+0000 7fc0dd3c2740 10 client.25025 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.940+0000 7fc0dd3c2740 10 client.25025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.940+0000 7fc0dd3c2740 20 client.25025 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.940+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/252436478 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5560ebba9620 0x5560ebbaba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.940+0000 7fc0dd3c2740 4 client.25025 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.940+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/252436478 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560ebb017f0 con 0x5560ebba9620 2024-09-15T22:16:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.940+0000 7fc0d8d85640 1 --2- 172.21.15.45:0/252436478 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5560ebba9620 0x5560ebbaba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.941+0000 7fc0b3fff640 10 client.25025 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.941+0000 7fc0d8d85640 1 --2- 172.21.15.45:0/252436478 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5560ebba9620 0x5560ebbaba30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21a81988bfa8e0c7 server_cookie=a515fce7f8c88997 in_seq=0 out_seq=0 2024-09-15T22:16:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.941+0000 7fc0b3fff640 1 -- 172.21.15.45:0/252436478 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560ebb017f0 con 0x5560ebba9620 2024-09-15T22:16:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.941+0000 7fc0b3fff640 10 client.25025 handle_command_reply: tid=0 2024-09-15T22:16:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.941+0000 7fc0dd3c2740 1 client.25025 shutdown 2024-09-15T22:16:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.942+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/252436478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb99d40 msgr2=0x5560ebb976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.942+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/252436478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb99d40 0x5560ebb976a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc013370 tx=0x7fc0cc004730 comp rx=0 tx=0).stop 2024-09-15T22:16:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.942+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/252436478 shutdown_connections 2024-09-15T22:16:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.942+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/252436478 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5560ebba9620 0x5560ebbaba30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.942+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/252436478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb99d40 0x5560ebb976a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.942+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/252436478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb97160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.942+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/252436478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb8eb60 0x5560ebb96c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.942+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/252436478 >> 172.21.15.45:0/252436478 conn(0x5560ebb8b0f0 msgr2=0x5560ebb90e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:26.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.942+0000 7fc0b3fff640 0 client.25025 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:26.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.942+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/252436478 shutdown_connections 2024-09-15T22:16:26.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.942+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/252436478 wait complete. 2024-09-15T22:16:26.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.942+0000 7fc0dd3c2740 20 client.25025 trim_cache size 0 max 16384 2024-09-15T22:16:26.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.959+0000 7fc0dd3c2740 1 Processor -- start 2024-09-15T22:16:26.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.959+0000 7fc0dd3c2740 1 -- start start 2024-09-15T22:16:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0dd3c2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb8eb60 0x5560ebb915c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0dd3c2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb98a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0dd3c2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb99d40 0x5560ebbb1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0dd3c2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d41af1c0 con 0x5560ebb8f480 2024-09-15T22:16:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0dd3c2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d41b1a40 con 0x5560ebb8eb60 2024-09-15T22:16:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0dd3c2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d41af830 con 0x5560ebb99d40 2024-09-15T22:16:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb98a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb98a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34640/0 (socket says 172.21.15.45:34640) 2024-09-15T22:16:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0d3fff640 1 -- 172.21.15.45:0/3253314910 learned_addr learned my addr 172.21.15.45:0/3253314910 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0d8d85640 1 --2- 172.21.15.45:0/3253314910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb8eb60 0x5560ebb915c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0d9586640 1 --2- 172.21.15.45:0/3253314910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb99d40 0x5560ebbb1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0d3fff640 1 -- 172.21.15.45:0/3253314910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb99d40 msgr2=0x5560ebbb1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0d3fff640 1 --2- 172.21.15.45:0/3253314910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb99d40 0x5560ebbb1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0d3fff640 1 -- 172.21.15.45:0/3253314910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb8eb60 msgr2=0x5560ebb915c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0d3fff640 1 --2- 172.21.15.45:0/3253314910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb8eb60 0x5560ebb915c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0d3fff640 1 -- 172.21.15.45:0/3253314910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ebb994f0 con 0x5560ebb8f480 2024-09-15T22:16:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.960+0000 7fc0d9586640 1 --2- 172.21.15.45:0/3253314910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb99d40 0x5560ebbb1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.961+0000 7fc0d3fff640 1 --2- 172.21.15.45:0/3253314910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb98a80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4005fd0 tx=0x7fc0c4009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56b571c1e9ded7f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.961+0000 7fc0ca7fc640 1 -- 172.21.15.45:0/3253314910 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4020070 con 0x5560ebb8f480 2024-09-15T22:16:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.961+0000 7fc0ca7fc640 1 -- 172.21.15.45:0/3253314910 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc0c4011940 con 0x5560ebb8f480 2024-09-15T22:16:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.961+0000 7fc0ca7fc640 1 -- 172.21.15.45:0/3253314910 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c401bb40 con 0x5560ebb8f480 2024-09-15T22:16:26.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.961+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/3253314910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 msgr2=0x5560ebb98a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.962+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/3253314910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb98a80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4005fd0 tx=0x7fc0c4009760 comp rx=0 tx=0).stop 2024-09-15T22:16:26.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.962+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/3253314910 shutdown_connections 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.962+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/3253314910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb99d40 0x5560ebbb1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.962+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/3253314910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb98a80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.962+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/3253314910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb8eb60 0x5560ebb915c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.962+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/3253314910 >> 172.21.15.45:0/3253314910 conn(0x5560ebb8b0f0 msgr2=0x5560ebb98370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.962+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/3253314910 shutdown_connections 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.962+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/3253314910 wait complete. 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.962+0000 7fc0dd3c2740 1 -- start start 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.962+0000 7fc0dd3c2740 1 Processor -- start 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.962+0000 7fc0dd3c2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb8eb60 0x5560ebb93dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.962+0000 7fc0dd3c2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb94300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0dd3c2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb99d40 0x5560ebb94840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0dd3c2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d41aff00 con 0x5560ebb8f480 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0dd3c2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d41b1370 con 0x5560ebb8eb60 2024-09-15T22:16:26.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0dd3c2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d41b05d0 con 0x5560ebb99d40 2024-09-15T22:16:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0dd3c2740 10 client.0 _ll_register_callbacks cb 0x7fc0cc005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0d8d85640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb8eb60 0x5560ebb93dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0d3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb94300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0d8d85640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb8eb60 0x5560ebb93dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:56276/0 (socket says 172.21.15.45:56276) 2024-09-15T22:16:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0d8d85640 1 -- 172.21.15.45:0/3801866486 learned_addr learned my addr 172.21.15.45:0/3801866486 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0d9586640 1 --2- 172.21.15.45:0/3801866486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb99d40 0x5560ebb94840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0d8d85640 1 -- 172.21.15.45:0/3801866486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb99d40 msgr2=0x5560ebb94840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0d8d85640 1 --2- 172.21.15.45:0/3801866486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb99d40 0x5560ebb94840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0d8d85640 1 -- 172.21.15.45:0/3801866486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 msgr2=0x5560ebb94300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0d8d85640 1 --2- 172.21.15.45:0/3801866486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb94300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0d8d85640 1 -- 172.21.15.45:0/3801866486 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560ebc13380 con 0x5560ebb8eb60 2024-09-15T22:16:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0d8d85640 1 --2- 172.21.15.45:0/3801866486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb8eb60 0x5560ebb93dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc005ec0 tx=0x7fc0bc0de040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b321869fefbb760 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:26.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-15T22:16:26.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0b3fff640 1 -- 172.21.15.45:0/3801866486 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0d4070 con 0x5560ebb8eb60 2024-09-15T22:16:26.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0b3fff640 1 -- 172.21.15.45:0/3801866486 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fc0bc0b9110 con 0x5560ebb8eb60 2024-09-15T22:16:26.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.963+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/3801866486 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0c4011940 con 0x5560ebb8eb60 2024-09-15T22:16:26.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.964+0000 7fc0b3fff640 1 -- 172.21.15.45:0/3801866486 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc0bc049040 con 0x5560ebb8eb60 2024-09-15T22:16:26.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.964+0000 7fc0dd3c2740 10 client.25031 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:26.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.964+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/3801866486 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5560ebc146a0 con 0x5560ebb8eb60 2024-09-15T22:16:26.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.964+0000 7fc0b3fff640 1 -- 172.21.15.45:0/3801866486 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc0c4011940 con 0x5560ebb8eb60 2024-09-15T22:16:26.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.964+0000 7fc0b3fff640 1 -- 172.21.15.45:0/3801866486 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc0bc0a70b0 con 0x5560ebb8eb60 2024-09-15T22:16:26.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.964+0000 7fc0dd3c2740 10 client.25031 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:26.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.964+0000 7fc0dd3c2740 10 client.25031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:26.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.964+0000 7fc0dd3c2740 20 client.25031 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:26.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.964+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/3801866486 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5560ebc14c20 0x5560ebc17010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:26.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.964+0000 7fc0dd3c2740 4 client.25031 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:16:26.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.964+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/3801866486 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5560ebafbd00 con 0x5560ebc14c20 2024-09-15T22:16:26.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.964+0000 7fc0d3fff640 1 --2- 172.21.15.45:0/3801866486 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5560ebc14c20 0x5560ebc17010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:26.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.965+0000 7fc0b3fff640 10 client.25031 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:26.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.965+0000 7fc0d3fff640 1 --2- 172.21.15.45:0/3801866486 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5560ebc14c20 0x5560ebc17010 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9df79cf75ee8739f server_cookie=ff0356136c06b3da in_seq=0 out_seq=0 2024-09-15T22:16:26.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0b3fff640 1 -- 172.21.15.45:0/3801866486 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5560ebafbd00 con 0x5560ebc14c20 2024-09-15T22:16:26.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0b3fff640 10 client.25031 handle_command_reply: tid=0 2024-09-15T22:16:26.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0dd3c2740 1 client.25031 shutdown 2024-09-15T22:16:26.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/3801866486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb8eb60 msgr2=0x5560ebb93dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/3801866486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb8eb60 0x5560ebb93dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc005ec0 tx=0x7fc0bc0de040 comp rx=0 tx=0).stop 2024-09-15T22:16:26.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/3801866486 shutdown_connections 2024-09-15T22:16:26.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/3801866486 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5560ebc14c20 0x5560ebc17010 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/3801866486 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5560ebb99d40 0x5560ebb94840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/3801866486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560ebb8f480 0x5560ebb94300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0dd3c2740 1 --2- 172.21.15.45:0/3801866486 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5560ebb8eb60 0x5560ebb93dc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/3801866486 >> 172.21.15.45:0/3801866486 conn(0x5560ebb8b0f0 msgr2=0x5560ebba5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:26.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0b3fff640 0 client.25031 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:26.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/3801866486 shutdown_connections 2024-09-15T22:16:26.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0dd3c2740 1 -- 172.21.15.45:0/3801866486 wait complete. 2024-09-15T22:16:26.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.966+0000 7fc0dd3c2740 20 client.25031 trim_cache size 0 max 16384 2024-09-15T22:16:26.972 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:16:26.972 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:16:26.972 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "04efc6c2-fd93-437d-9919-18c95b96dedd", 2024-09-15T22:16:26.972 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:16:26.973 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:16:26.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.967+0000 7fc0dafe9640 1 -- 172.21.15.45:0/2936235589 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc0c00a34c0 msgr2=0x7fc0c00a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.967+0000 7fc0dafe9640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc0c00a34c0 0x7fc0c00a5980 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc009fd0 tx=0x7fc0cc009dc0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.967+0000 7fc0dafe9640 1 -- 172.21.15.45:0/2936235589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d4100a80 msgr2=0x7fc0d41984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:26.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.967+0000 7fc0dafe9640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d4100a80 0x7fc0d41984f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009230 tx=0x7fc0bc004270 comp rx=0 tx=0).stop 2024-09-15T22:16:26.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.967+0000 7fc0dafe9640 1 -- 172.21.15.45:0/2936235589 shutdown_connections 2024-09-15T22:16:26.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.967+0000 7fc0dafe9640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc0c00a34c0 0x7fc0c00a5980 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.967+0000 7fc0dafe9640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc0d4106a80 0x7fc0d419cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.967+0000 7fc0dafe9640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc0d4101420 0x7fc0d4198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.967+0000 7fc0dafe9640 1 --2- 172.21.15.45:0/2936235589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0d4100a80 0x7fc0d41984f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:26.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.967+0000 7fc0dafe9640 1 -- 172.21.15.45:0/2936235589 >> 172.21.15.45:0/2936235589 conn(0x7fc0d40fc7a0 msgr2=0x7fc0d406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:26.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.967+0000 7fc0dafe9640 1 -- 172.21.15.45:0/2936235589 shutdown_connections 2024-09-15T22:16:26.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:26.967+0000 7fc0dafe9640 1 -- 172.21.15.45:0/2936235589 wait complete. 2024-09-15T22:16:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.056+0000 7f6404133640 1 -- 172.21.15.45:0/4167349958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f63fc19b970 con 0x7f63fc103600 2024-09-15T22:16:27.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.063+0000 7f63eeffd640 1 -- 172.21.15.45:0/4167349958 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v34)=0 v34) ==== 133+0+0 (secure 0 0 0) 0x7f63fc19b970 con 0x7f63fc103600 2024-09-15T22:16:27.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.065+0000 7f6404133640 1 -- 172.21.15.45:0/4167349958 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f63e80a3580 msgr2=0x7f63e80a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:27.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.065+0000 7f6404133640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f63e80a3580 0x7f63e80a5a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f63f802ae70 tx=0x7f63f8005c50 comp rx=0 tx=0).stop 2024-09-15T22:16:27.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.065+0000 7f6404133640 1 -- 172.21.15.45:0/4167349958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63fc103600 msgr2=0x7f63fc19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:27.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.065+0000 7f6404133640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63fc103600 0x7f63fc19ab60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63f0005fd0 tx=0x7f63f000dde0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.066+0000 7f6404133640 1 -- 172.21.15.45:0/4167349958 shutdown_connections 2024-09-15T22:16:27.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.066+0000 7f6404133640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f63e80a3580 0x7f63e80a5a40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.066+0000 7f6404133640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f63fc10c0b0 0x7f63fc19eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.066+0000 7f6404133640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63fc103600 0x7f63fc19ab60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.066+0000 7f6404133640 1 --2- 172.21.15.45:0/4167349958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc102ce0 0x7f63fc19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.066+0000 7f6404133640 1 -- 172.21.15.45:0/4167349958 >> 172.21.15.45:0/4167349958 conn(0x7f63fc077990 msgr2=0x7f63fc100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:27.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.066+0000 7f6404133640 1 -- 172.21.15.45:0/4167349958 shutdown_connections 2024-09-15T22:16:27.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.066+0000 7f6404133640 1 -- 172.21.15.45:0/4167349958 wait complete. 2024-09-15T22:16:27.079 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-15T22:16:27.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.194+0000 7f1f1948b640 1 -- 172.21.15.45:0/3362409194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f141009f0 msgr2=0x7f1f14100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.194+0000 7f1f1948b640 1 --2- 172.21.15.45:0/3362409194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f141009f0 0x7f1f14100e50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009930 tx=0x7f1efc02a420 comp rx=0 tx=0).stop 2024-09-15T22:16:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.194+0000 7f1f1948b640 1 -- 172.21.15.45:0/3362409194 shutdown_connections 2024-09-15T22:16:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.194+0000 7f1f1948b640 1 --2- 172.21.15.45:0/3362409194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f14101390 0x7f1f1410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.194+0000 7f1f1948b640 1 --2- 172.21.15.45:0/3362409194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f141009f0 0x7f1f14100e50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.194+0000 7f1f1948b640 1 --2- 172.21.15.45:0/3362409194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f14106a00 0x7f1f14106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.194+0000 7f1f1948b640 1 -- 172.21.15.45:0/3362409194 >> 172.21.15.45:0/3362409194 conn(0x7f1f140fc6b0 msgr2=0x7f1f140fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.194+0000 7f1f1948b640 1 -- 172.21.15.45:0/3362409194 shutdown_connections 2024-09-15T22:16:27.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.195+0000 7f1f1948b640 1 -- 172.21.15.45:0/3362409194 wait complete. 2024-09-15T22:16:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.195+0000 7f1f1948b640 1 Processor -- start 2024-09-15T22:16:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.195+0000 7f1f1948b640 1 -- start start 2024-09-15T22:16:27.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.195+0000 7f1f1948b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f141009f0 0x7f1f1419a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.195+0000 7f1f1948b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f14101390 0x7f1f1419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.195+0000 7f1f1948b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f14106a00 0x7f1f1419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.195+0000 7f1f1948b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1f14110fb0 con 0x7f1f14106a00 2024-09-15T22:16:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.195+0000 7f1f1948b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1f14110e30 con 0x7f1f141009f0 2024-09-15T22:16:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.195+0000 7f1f1948b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1f14111130 con 0x7f1f14101390 2024-09-15T22:16:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.195+0000 7f1f137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f14106a00 0x7f1f1419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f12ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f141009f0 0x7f1f1419a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f14106a00 0x7f1f1419ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34670/0 (socket says 172.21.15.45:34670) 2024-09-15T22:16:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f137fe640 1 -- 172.21.15.45:0/2923779007 learned_addr learned my addr 172.21.15.45:0/2923779007 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f0bfff640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f14101390 0x7f1f1419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f137fe640 1 -- 172.21.15.45:0/2923779007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f14101390 msgr2=0x7f1f1419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:27.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f137fe640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f14101390 0x7f1f1419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f137fe640 1 -- 172.21.15.45:0/2923779007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f141009f0 msgr2=0x7f1f1419a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f137fe640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f141009f0 0x7f1f1419a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f137fe640 1 -- 172.21.15.45:0/2923779007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1419f6a0 con 0x7f1f14106a00 2024-09-15T22:16:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f0bfff640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f14101390 0x7f1f1419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f12ffd640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f141009f0 0x7f1f1419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f137fe640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f14106a00 0x7f1f1419ef70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00eb10 tx=0x7f1f0c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f10ff9640 1 -- 172.21.15.45:0/2923779007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c004b20 con 0x7f1f14106a00 2024-09-15T22:16:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f1948b640 1 -- 172.21.15.45:0/2923779007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1419f990 con 0x7f1f14106a00 2024-09-15T22:16:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f10ff9640 1 -- 172.21.15.45:0/2923779007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1f0c004cc0 con 0x7f1f14106a00 2024-09-15T22:16:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f10ff9640 1 -- 172.21.15.45:0/2923779007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c0107f0 con 0x7f1f14106a00 2024-09-15T22:16:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.196+0000 7f1f1948b640 1 -- 172.21.15.45:0/2923779007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f141a7220 con 0x7f1f14106a00 2024-09-15T22:16:27.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.197+0000 7f1f1948b640 1 -- 172.21.15.45:0/2923779007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f14100e50 con 0x7f1f14106a00 2024-09-15T22:16:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.199+0000 7f1f10ff9640 1 -- 172.21.15.45:0/2923779007 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f1f0c010990 con 0x7f1f14106a00 2024-09-15T22:16:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.199+0000 7f1f10ff9640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1f000a3500 0x7f1f000a59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.199+0000 7f1f12ffd640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1f000a3500 0x7f1f000a59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:27.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.200+0000 7f1f10ff9640 1 -- 172.21.15.45:0/2923779007 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f1f0c0d0a30 con 0x7f1f14106a00 2024-09-15T22:16:27.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.200+0000 7f1f12ffd640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1f000a3500 0x7f1f000a59c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1f04005fd0 tx=0x7f1f0400b390 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:27.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.202+0000 7f1f10ff9640 1 -- 172.21.15.45:0/2923779007 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1f0c0541b0 con 0x7f1f14106a00 2024-09-15T22:16:27.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.409+0000 7f1f1948b640 1 -- 172.21.15.45:0/2923779007 --> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f1f140fd360 con 0x7f1f000a3500 2024-09-15T22:16:27.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 146 B/s wr, 19 op/s 2024-09-15T22:16:27.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3088932921' entity='client.admin' 2024-09-15T22:16:27.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:27.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:27.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:27.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:27.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='client.? ' entity='client.admin' 2024-09-15T22:16:27.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:27.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:27.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:27.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:27.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='client.? ' entity='client.admin' 2024-09-15T22:16:27.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:27.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:27.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:27.466 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:27 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:27.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.473+0000 7f1f10ff9640 1 -- 172.21.15.45:0/2923779007 <== mgr.15165 v2:172.21.15.45:6800/553298159 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1f140fd360 con 0x7f1f000a3500 2024-09-15T22:16:27.474 INFO:teuthology.orchestra.run.smithi045.stdout:Schedule set for path / 2024-09-15T22:16:27.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.475+0000 7f1f1948b640 1 -- 172.21.15.45:0/2923779007 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1f000a3500 msgr2=0x7f1f000a59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.475+0000 7f1f1948b640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1f000a3500 0x7f1f000a59c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1f04005fd0 tx=0x7f1f0400b390 comp rx=0 tx=0).stop 2024-09-15T22:16:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.475+0000 7f1f1948b640 1 -- 172.21.15.45:0/2923779007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f14106a00 msgr2=0x7f1f1419ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.475+0000 7f1f1948b640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f14106a00 0x7f1f1419ef70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00eb10 tx=0x7f1f0c00c2d0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.475+0000 7f1f1948b640 1 -- 172.21.15.45:0/2923779007 shutdown_connections 2024-09-15T22:16:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.475+0000 7f1f1948b640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1f000a3500 0x7f1f000a59c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.475+0000 7f1f1948b640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f14106a00 0x7f1f1419ef70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.475+0000 7f1f1948b640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1f14101390 0x7f1f1419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.475+0000 7f1f1948b640 1 --2- 172.21.15.45:0/2923779007 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1f141009f0 0x7f1f1419a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.475+0000 7f1f1948b640 1 -- 172.21.15.45:0/2923779007 >> 172.21.15.45:0/2923779007 conn(0x7f1f140fc6b0 msgr2=0x7f1f140fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.475+0000 7f1f1948b640 1 -- 172.21.15.45:0/2923779007 shutdown_connections 2024-09-15T22:16:27.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.475+0000 7f1f1948b640 1 -- 172.21.15.45:0/2923779007 wait complete. 2024-09-15T22:16:27.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 146 B/s wr, 19 op/s 2024-09-15T22:16:27.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3088932921' entity='client.admin' 2024-09-15T22:16:27.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:27.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:27.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:27.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:27.486 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='client.? ' entity='client.admin' 2024-09-15T22:16:27.487 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:27.487 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:27.487 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:27.487 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:27.487 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='client.? ' entity='client.admin' 2024-09-15T22:16:27.487 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:27.487 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:27.487 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:27.487 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:27 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:27.488 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-15T22:16:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 146 B/s wr, 19 op/s 2024-09-15T22:16:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3088932921' entity='client.admin' 2024-09-15T22:16:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='client.? ' entity='client.admin' 2024-09-15T22:16:27.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:27.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:27.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:27.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:27.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='client.? ' entity='client.admin' 2024-09-15T22:16:27.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:16:27.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:16:27.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:16:27.495 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:27 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:16:27.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.595+0000 7f3ad4d11640 1 -- 172.21.15.45:0/4152605183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01009f0 msgr2=0x7f3ad0100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:27.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.595+0000 7f3ad4d11640 1 --2- 172.21.15.45:0/4152605183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01009f0 0x7f3ad0100e50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4009930 tx=0x7f3ac402a420 comp rx=0 tx=0).stop 2024-09-15T22:16:27.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.595+0000 7f3ad4d11640 1 -- 172.21.15.45:0/4152605183 shutdown_connections 2024-09-15T22:16:27.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.595+0000 7f3ad4d11640 1 --2- 172.21.15.45:0/4152605183 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ad0101390 0x7f3ad010d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.595+0000 7f3ad4d11640 1 --2- 172.21.15.45:0/4152605183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01009f0 0x7f3ad0100e50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.595+0000 7f3ad4d11640 1 --2- 172.21.15.45:0/4152605183 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ad0106a00 0x7f3ad0106de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.595+0000 7f3ad4d11640 1 -- 172.21.15.45:0/4152605183 >> 172.21.15.45:0/4152605183 conn(0x7f3ad00fc6b0 msgr2=0x7f3ad00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:27.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.595+0000 7f3ad4d11640 1 -- 172.21.15.45:0/4152605183 shutdown_connections 2024-09-15T22:16:27.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.595+0000 7f3ad4d11640 1 -- 172.21.15.45:0/4152605183 wait complete. 2024-09-15T22:16:27.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.596+0000 7f3ad4d11640 1 Processor -- start 2024-09-15T22:16:27.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.596+0000 7f3ad4d11640 1 -- start start 2024-09-15T22:16:27.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.596+0000 7f3ad4d11640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01009f0 0x7f3ad01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:27.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.596+0000 7f3ad4d11640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ad0101390 0x7f3ad01989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:27.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.596+0000 7f3ad4d11640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ad0106a00 0x7f3ad019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:27.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.596+0000 7f3ad4d11640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad0110f60 con 0x7f3ad01009f0 2024-09-15T22:16:27.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.596+0000 7f3ad4d11640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad0110de0 con 0x7f3ad0101390 2024-09-15T22:16:27.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.596+0000 7f3ad4d11640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad01110e0 con 0x7f3ad0106a00 2024-09-15T22:16:27.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.596+0000 7f3ace59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01009f0 0x7f3ad01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:27.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.596+0000 7f3ace59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01009f0 0x7f3ad01984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34688/0 (socket says 172.21.15.45:34688) 2024-09-15T22:16:27.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.596+0000 7f3ace59c640 1 -- 172.21.15.45:0/2110254777 learned_addr learned my addr 172.21.15.45:0/2110254777 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:27.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.596+0000 7f3acdd9b640 1 --2- 172.21.15.45:0/2110254777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ad0101390 0x7f3ad01989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:27.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.597+0000 7f3ace59c640 1 -- 172.21.15.45:0/2110254777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ad0106a00 msgr2=0x7f3ad019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:27.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.597+0000 7f3ace59c640 1 --2- 172.21.15.45:0/2110254777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ad0106a00 0x7f3ad019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.597+0000 7f3ace59c640 1 -- 172.21.15.45:0/2110254777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ad0101390 msgr2=0x7f3ad01989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:27.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.597+0000 7f3ace59c640 1 --2- 172.21.15.45:0/2110254777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ad0101390 0x7f3ad01989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.597+0000 7f3ace59c640 1 -- 172.21.15.45:0/2110254777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad019d490 con 0x7f3ad01009f0 2024-09-15T22:16:27.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.597+0000 7f3ace59c640 1 --2- 172.21.15.45:0/2110254777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01009f0 0x7f3ad01984a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000d770 tx=0x7f3ac000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:27.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.597+0000 7f3abf7fe640 1 -- 172.21.15.45:0/2110254777 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0017070 con 0x7f3ad01009f0 2024-09-15T22:16:27.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.597+0000 7f3abf7fe640 1 -- 172.21.15.45:0/2110254777 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3ac0005520 con 0x7f3ad01009f0 2024-09-15T22:16:27.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.597+0000 7f3ad4d11640 1 -- 172.21.15.45:0/2110254777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad019d780 con 0x7f3ad01009f0 2024-09-15T22:16:27.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.597+0000 7f3abf7fe640 1 -- 172.21.15.45:0/2110254777 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0010460 con 0x7f3ad01009f0 2024-09-15T22:16:27.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.597+0000 7f3ad4d11640 1 -- 172.21.15.45:0/2110254777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad01a5010 con 0x7f3ad01009f0 2024-09-15T22:16:27.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.598+0000 7f3ad4d11640 1 -- 172.21.15.45:0/2110254777 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad0100e50 con 0x7f3ad01009f0 2024-09-15T22:16:27.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.599+0000 7f3abf7fe640 1 -- 172.21.15.45:0/2110254777 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f3ac0004ea0 con 0x7f3ad01009f0 2024-09-15T22:16:27.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.600+0000 7f3abf7fe640 1 --2- 172.21.15.45:0/2110254777 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3ab80a3580 0x7f3ab80a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:27.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.600+0000 7f3abf7fe640 1 -- 172.21.15.45:0/2110254777 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f3ac00cfc60 con 0x7f3ad01009f0 2024-09-15T22:16:27.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.600+0000 7f3acdd9b640 1 --2- 172.21.15.45:0/2110254777 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3ab80a3580 0x7f3ab80a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:27.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.601+0000 7f3acdd9b640 1 --2- 172.21.15.45:0/2110254777 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3ab80a3580 0x7f3ab80a5a40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4009900 tx=0x7f3ac40058d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:27.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.604+0000 7f3abf7fe640 1 -- 172.21.15.45:0/2110254777 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ac009c100 con 0x7f3ad01009f0 2024-09-15T22:16:27.689 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:16:27.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.805+0000 7f3ad4d11640 1 -- 172.21.15.45:0/2110254777 --> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f3ad00626d0 con 0x7f3ab80a3580 2024-09-15T22:16:27.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.864+0000 7f3abf7fe640 1 -- 172.21.15.45:0/2110254777 <== mgr.15165 v2:172.21.15.45:6800/553298159 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f3ad00626d0 con 0x7f3ab80a3580 2024-09-15T22:16:27.865 INFO:teuthology.orchestra.run.smithi045.stdout:Retention added to path / 2024-09-15T22:16:27.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.866+0000 7f3ad4d11640 1 -- 172.21.15.45:0/2110254777 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3ab80a3580 msgr2=0x7f3ab80a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:27.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.866+0000 7f3ad4d11640 1 --2- 172.21.15.45:0/2110254777 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3ab80a3580 0x7f3ab80a5a40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4009900 tx=0x7f3ac40058d0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.866+0000 7f3ad4d11640 1 -- 172.21.15.45:0/2110254777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01009f0 msgr2=0x7f3ad01984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:27.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.866+0000 7f3ad4d11640 1 --2- 172.21.15.45:0/2110254777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01009f0 0x7f3ad01984a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000d770 tx=0x7f3ac000dc30 comp rx=0 tx=0).stop 2024-09-15T22:16:27.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.866+0000 7f3ad4d11640 1 -- 172.21.15.45:0/2110254777 shutdown_connections 2024-09-15T22:16:27.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.866+0000 7f3ad4d11640 1 --2- 172.21.15.45:0/2110254777 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3ab80a3580 0x7f3ab80a5a40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.866+0000 7f3ad4d11640 1 --2- 172.21.15.45:0/2110254777 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ad0106a00 0x7f3ad019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.866+0000 7f3ad4d11640 1 --2- 172.21.15.45:0/2110254777 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ad0101390 0x7f3ad01989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.866+0000 7f3ad4d11640 1 --2- 172.21.15.45:0/2110254777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ad01009f0 0x7f3ad01984a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:27.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.866+0000 7f3ad4d11640 1 -- 172.21.15.45:0/2110254777 >> 172.21.15.45:0/2110254777 conn(0x7f3ad00fc6b0 msgr2=0x7f3ad006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:27.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.866+0000 7f3ad4d11640 1 -- 172.21.15.45:0/2110254777 shutdown_connections 2024-09-15T22:16:27.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:27.866+0000 7f3ad4d11640 1 -- 172.21.15.45:0/2110254777 wait complete. 2024-09-15T22:16:27.878 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-15T22:16:27.970 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:28.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.003+0000 7fb2b4f66640 1 -- 172.21.15.45:0/3606650227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b010c0f0 msgr2=0x7fb2b010e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.003+0000 7fb2b4f66640 1 --2- 172.21.15.45:0/3606650227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b010c0f0 0x7fb2b010e560 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8009ca0 tx=0x7fb2a802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.003+0000 7fb2b4f66640 1 -- 172.21.15.45:0/3606650227 shutdown_connections 2024-09-15T22:16:28.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.003+0000 7fb2b4f66640 1 --2- 172.21.15.45:0/3606650227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b010c0f0 0x7fb2b010e560 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.003+0000 7fb2b4f66640 1 --2- 172.21.15.45:0/3606650227 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2b0103640 0x7fb2b010bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.003+0000 7fb2b4f66640 1 --2- 172.21.15.45:0/3606650227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b0102d20 0x7fb2b0103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.003+0000 7fb2b4f66640 1 -- 172.21.15.45:0/3606650227 >> 172.21.15.45:0/3606650227 conn(0x7fb2b00fc6b0 msgr2=0x7fb2b00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:28.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.003+0000 7fb2b4f66640 1 -- 172.21.15.45:0/3606650227 shutdown_connections 2024-09-15T22:16:28.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.003+0000 7fb2b4f66640 1 -- 172.21.15.45:0/3606650227 wait complete. 2024-09-15T22:16:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2b4f66640 1 Processor -- start 2024-09-15T22:16:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2b4f66640 1 -- start start 2024-09-15T22:16:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2b4f66640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2b0102d20 0x7fb2b0100970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2b4f66640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b0103640 0x7fb2b0100eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2b4f66640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b010c0f0 0x7fb2b01013f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2b4f66640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b0111fe0 con 0x7fb2b0103640 2024-09-15T22:16:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2b4f66640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b0111e60 con 0x7fb2b010c0f0 2024-09-15T22:16:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2b4f66640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b0112160 con 0x7fb2b0102d20 2024-09-15T22:16:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2add9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b0103640 0x7fb2b0100eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2add9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b0103640 0x7fb2b0100eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34710/0 (socket says 172.21.15.45:34710) 2024-09-15T22:16:28.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2add9b640 1 -- 172.21.15.45:0/1085480368 learned_addr learned my addr 172.21.15.45:0/1085480368 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2ae59c640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2b0102d20 0x7fb2b0100970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2aed9d640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b010c0f0 0x7fb2b01013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2add9b640 1 -- 172.21.15.45:0/1085480368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2b0102d20 msgr2=0x7fb2b0100970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2add9b640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2b0102d20 0x7fb2b0100970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2add9b640 1 -- 172.21.15.45:0/1085480368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b010c0f0 msgr2=0x7fb2b01013f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2add9b640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b010c0f0 0x7fb2b01013f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.004+0000 7fb2add9b640 1 -- 172.21.15.45:0/1085480368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b01a6870 con 0x7fb2b0103640 2024-09-15T22:16:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.005+0000 7fb2add9b640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b0103640 0x7fb2b0100eb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400d950 tx=0x7fb2a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.005+0000 7fb29f7fe640 1 -- 172.21.15.45:0/1085480368 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4017030 con 0x7fb2b0103640 2024-09-15T22:16:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.005+0000 7fb29f7fe640 1 -- 172.21.15.45:0/1085480368 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb2a4004020 con 0x7fb2b0103640 2024-09-15T22:16:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.005+0000 7fb2b4f66640 1 -- 172.21.15.45:0/1085480368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b01a6b60 con 0x7fb2b0103640 2024-09-15T22:16:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.005+0000 7fb29f7fe640 1 -- 172.21.15.45:0/1085480368 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4004a00 con 0x7fb2b0103640 2024-09-15T22:16:28.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.005+0000 7fb2b4f66640 1 -- 172.21.15.45:0/1085480368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b01a7100 con 0x7fb2b0103640 2024-09-15T22:16:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.006+0000 7fb2b4f66640 1 -- 172.21.15.45:0/1085480368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b0103100 con 0x7fb2b0103640 2024-09-15T22:16:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.007+0000 7fb29f7fe640 1 -- 172.21.15.45:0/1085480368 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fb2a40041d0 con 0x7fb2b0103640 2024-09-15T22:16:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.008+0000 7fb29f7fe640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb2980a3580 0x7fb2980a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.008+0000 7fb2ae59c640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb2980a3580 0x7fb2980a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.008+0000 7fb29f7fe640 1 -- 172.21.15.45:0/1085480368 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fb2a40cfb80 con 0x7fb2b0103640 2024-09-15T22:16:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.009+0000 7fb2ae59c640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb2980a3580 0x7fb2980a5a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000bbe0 tx=0x7fb2a000b390 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:28.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.013+0000 7fb29f7fe640 1 -- 172.21.15.45:0/1085480368 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb2a409c020 con 0x7fb2b0103640 2024-09-15T22:16:28.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.216+0000 7fb2b4f66640 1 -- 172.21.15.45:0/1085480368 --> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fb2b00fe9d0 con 0x7fb2980a3580 2024-09-15T22:16:28.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.223+0000 7fb29f7fe640 1 -- 172.21.15.45:0/1085480368 <== mgr.15165 v2:172.21.15.45:6800/553298159 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fb2b00fe9d0 con 0x7fb2980a3580 2024-09-15T22:16:28.224 INFO:teuthology.orchestra.run.smithi045.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-15T00:00:00", "created": "2024-09-15T22:16:27", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-15T22:16:28.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.225+0000 7fb2b4f66640 1 -- 172.21.15.45:0/1085480368 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb2980a3580 msgr2=0x7fb2980a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.225+0000 7fb2b4f66640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb2980a3580 0x7fb2980a5a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000bbe0 tx=0x7fb2a000b390 comp rx=0 tx=0).stop 2024-09-15T22:16:28.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.225+0000 7fb2b4f66640 1 -- 172.21.15.45:0/1085480368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b0103640 msgr2=0x7fb2b0100eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.225+0000 7fb2b4f66640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b0103640 0x7fb2b0100eb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400d950 tx=0x7fb2a400de10 comp rx=0 tx=0).stop 2024-09-15T22:16:28.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.225+0000 7fb2b4f66640 1 -- 172.21.15.45:0/1085480368 shutdown_connections 2024-09-15T22:16:28.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.225+0000 7fb2b4f66640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb2980a3580 0x7fb2980a5a40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.225+0000 7fb2b4f66640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2b010c0f0 0x7fb2b01013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.225+0000 7fb2b4f66640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2b0103640 0x7fb2b0100eb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.225+0000 7fb2b4f66640 1 --2- 172.21.15.45:0/1085480368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb2b0102d20 0x7fb2b0100970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.225+0000 7fb2b4f66640 1 -- 172.21.15.45:0/1085480368 >> 172.21.15.45:0/1085480368 conn(0x7fb2b00fc6b0 msgr2=0x7fb2b00fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:28.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.225+0000 7fb2b4f66640 1 -- 172.21.15.45:0/1085480368 shutdown_connections 2024-09-15T22:16:28.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.225+0000 7fb2b4f66640 1 -- 172.21.15.45:0/1085480368 wait complete. 2024-09-15T22:16:28.241 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-15T22:16:28.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.346+0000 7f5240ee4640 1 -- 172.21.15.45:0/2975536946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f523c10c0d0 msgr2=0x7f523c10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.346+0000 7f5240ee4640 1 --2- 172.21.15.45:0/2975536946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f523c10c0d0 0x7f523c10e550 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5234009ca0 tx=0x7f523402a950 comp rx=0 tx=0).stop 2024-09-15T22:16:28.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.346+0000 7f5240ee4640 1 -- 172.21.15.45:0/2975536946 shutdown_connections 2024-09-15T22:16:28.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.346+0000 7f5240ee4640 1 --2- 172.21.15.45:0/2975536946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f523c10c0d0 0x7f523c10e550 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.346+0000 7f5240ee4640 1 --2- 172.21.15.45:0/2975536946 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f523c1035a0 0x7f523c10ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.346+0000 7f5240ee4640 1 --2- 172.21.15.45:0/2975536946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f523c102c80 0x7f523c103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.346+0000 7f5240ee4640 1 -- 172.21.15.45:0/2975536946 >> 172.21.15.45:0/2975536946 conn(0x7f523c077990 msgr2=0x7f523c0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:28.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.346+0000 7f5240ee4640 1 -- 172.21.15.45:0/2975536946 shutdown_connections 2024-09-15T22:16:28.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.346+0000 7f5240ee4640 1 -- 172.21.15.45:0/2975536946 wait complete. 2024-09-15T22:16:28.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.347+0000 7f5240ee4640 1 Processor -- start 2024-09-15T22:16:28.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.347+0000 7f5240ee4640 1 -- start start 2024-09-15T22:16:28.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.347+0000 7f5240ee4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f523c102c80 0x7f523c1008d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.347+0000 7f5240ee4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f523c1035a0 0x7f523c100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.347+0000 7f5240ee4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f523c10c0d0 0x7f523c101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.347+0000 7f5240ee4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f523c111fb0 con 0x7f523c1035a0 2024-09-15T22:16:28.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.347+0000 7f5240ee4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f523c111e30 con 0x7f523c102c80 2024-09-15T22:16:28.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.347+0000 7f5240ee4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f523c112130 con 0x7f523c10c0d0 2024-09-15T22:16:28.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.347+0000 7f5233fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f523c1035a0 0x7f523c100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.347+0000 7f5233fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f523c1035a0 0x7f523c100e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34728/0 (socket says 172.21.15.45:34728) 2024-09-15T22:16:28.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.347+0000 7f5233fff640 1 -- 172.21.15.45:0/2177520833 learned_addr learned my addr 172.21.15.45:0/2177520833 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:28.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.347+0000 7f523a59c640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f523c102c80 0x7f523c1008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.347+0000 7f523ad9d640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f523c10c0d0 0x7f523c101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.348+0000 7f5233fff640 1 -- 172.21.15.45:0/2177520833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f523c10c0d0 msgr2=0x7f523c101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.348+0000 7f5233fff640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f523c10c0d0 0x7f523c101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.348+0000 7f5233fff640 1 -- 172.21.15.45:0/2177520833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f523c102c80 msgr2=0x7f523c1008d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.348+0000 7f5233fff640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f523c102c80 0x7f523c1008d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.348+0000 7f5233fff640 1 -- 172.21.15.45:0/2177520833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523c1a68e0 con 0x7f523c1035a0 2024-09-15T22:16:28.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.348+0000 7f523ad9d640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f523c10c0d0 0x7f523c101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:28.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.348+0000 7f5233fff640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f523c1035a0 0x7f523c100e10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f522400c940 tx=0x7f522400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:28.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.348+0000 7f52337fe640 1 -- 172.21.15.45:0/2177520833 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224004220 con 0x7f523c1035a0 2024-09-15T22:16:28.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.348+0000 7f52337fe640 1 -- 172.21.15.45:0/2177520833 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f52240043c0 con 0x7f523c1035a0 2024-09-15T22:16:28.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.348+0000 7f5240ee4640 1 -- 172.21.15.45:0/2177520833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f523c1a6bd0 con 0x7f523c1035a0 2024-09-15T22:16:28.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.348+0000 7f52337fe640 1 -- 172.21.15.45:0/2177520833 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224004a00 con 0x7f523c1035a0 2024-09-15T22:16:28.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.348+0000 7f5240ee4640 1 -- 172.21.15.45:0/2177520833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f523c1a7170 con 0x7f523c1035a0 2024-09-15T22:16:28.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.349+0000 7f5240ee4640 1 -- 172.21.15.45:0/2177520833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f523c103060 con 0x7f523c1035a0 2024-09-15T22:16:28.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.350+0000 7f52337fe640 1 -- 172.21.15.45:0/2177520833 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f5224005140 con 0x7f523c1035a0 2024-09-15T22:16:28.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.351+0000 7f52337fe640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f52280a3580 0x7f52280a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.351+0000 7f523a59c640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f52280a3580 0x7f52280a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.351+0000 7f52337fe640 1 -- 172.21.15.45:0/2177520833 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f52240d01c0 con 0x7f523c1035a0 2024-09-15T22:16:28.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.352+0000 7f523a59c640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f52280a3580 0x7f52280a5a40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f522c009bd0 tx=0x7f522c005f90 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:28.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.354+0000 7f52337fe640 1 -- 172.21.15.45:0/2177520833 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5224014030 con 0x7f523c1035a0 2024-09-15T22:16:28.461 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:28 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:16:28.461 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:28 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:28.461 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:28 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:16:28.461 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:28 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:28.461 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:28 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:16:28.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:28 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:16:28.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:28 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:28 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:16:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:28 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:28.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:28 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:16:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.451+0000 7f7dea21d640 1 -- 172.21.15.45:0/10239260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de41082a0 msgr2=0x7f7de410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.451+0000 7f7dea21d640 1 --2- 172.21.15.45:0/10239260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de41082a0 0x7f7de410ec40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc009930 tx=0x7f7ddc02a420 comp rx=0 tx=0).stop 2024-09-15T22:16:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.451+0000 7f7dea21d640 1 -- 172.21.15.45:0/10239260 shutdown_connections 2024-09-15T22:16:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.451+0000 7f7dea21d640 1 --2- 172.21.15.45:0/10239260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de41082a0 0x7f7de410ec40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.451+0000 7f7dea21d640 1 --2- 172.21.15.45:0/10239260 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7de41036e0 0x7f7de4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.451+0000 7f7dea21d640 1 --2- 172.21.15.45:0/10239260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de4102d30 0x7f7de4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.451+0000 7f7dea21d640 1 -- 172.21.15.45:0/10239260 >> 172.21.15.45:0/10239260 conn(0x7f7de40fc7d0 msgr2=0x7f7de40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.451+0000 7f7dea21d640 1 -- 172.21.15.45:0/10239260 shutdown_connections 2024-09-15T22:16:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.451+0000 7f7dea21d640 1 -- 172.21.15.45:0/10239260 wait complete. 2024-09-15T22:16:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.451+0000 7f7dea21d640 1 Processor -- start 2024-09-15T22:16:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.452+0000 7f7dea21d640 1 -- start start 2024-09-15T22:16:28.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.452+0000 7f7dea21d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de4102d30 0x7f7de4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.452+0000 7f7dea21d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7de41036e0 0x7f7de4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.452+0000 7f7dea21d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de41082a0 0x7f7de4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.452+0000 7f7dea21d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7de41121c0 con 0x7f7de4102d30 2024-09-15T22:16:28.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.452+0000 7f7dea21d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7de4112040 con 0x7f7de41082a0 2024-09-15T22:16:28.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.452+0000 7f7dea21d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7de4112340 con 0x7f7de41036e0 2024-09-15T22:16:28.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.452+0000 7f7de37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de4102d30 0x7f7de4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.452+0000 7f7de37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de4102d30 0x7f7de4100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34748/0 (socket says 172.21.15.45:34748) 2024-09-15T22:16:28.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.452+0000 7f7de37fe640 1 -- 172.21.15.45:0/3012401893 learned_addr learned my addr 172.21.15.45:0/3012401893 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:28.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.452+0000 7f7de2ffd640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7de41036e0 0x7f7de4100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.452+0000 7f7de3fff640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de41082a0 0x7f7de4101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.453+0000 7f7de37fe640 1 -- 172.21.15.45:0/3012401893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7de41036e0 msgr2=0x7f7de4100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.453+0000 7f7de37fe640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7de41036e0 0x7f7de4100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.453+0000 7f7de37fe640 1 -- 172.21.15.45:0/3012401893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de41082a0 msgr2=0x7f7de4101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.453+0000 7f7de37fe640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de41082a0 0x7f7de4101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.453+0000 7f7de37fe640 1 -- 172.21.15.45:0/3012401893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de41a6b00 con 0x7f7de4102d30 2024-09-15T22:16:28.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.453+0000 7f7de2ffd640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7de41036e0 0x7f7de4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.453+0000 7f7de3fff640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de41082a0 0x7f7de4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.453+0000 7f7de37fe640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de4102d30 0x7f7de4100990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400eab0 tx=0x7f7dd400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.453+0000 7f7de0ff9640 1 -- 172.21.15.45:0/3012401893 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400ce40 con 0x7f7de4102d30 2024-09-15T22:16:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.453+0000 7f7de0ff9640 1 -- 172.21.15.45:0/3012401893 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7dd4011970 con 0x7f7de4102d30 2024-09-15T22:16:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.453+0000 7f7dea21d640 1 -- 172.21.15.45:0/3012401893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de41a6df0 con 0x7f7de4102d30 2024-09-15T22:16:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.453+0000 7f7de0ff9640 1 -- 172.21.15.45:0/3012401893 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4010bb0 con 0x7f7de4102d30 2024-09-15T22:16:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.453+0000 7f7dea21d640 1 -- 172.21.15.45:0/3012401893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de41a72a0 con 0x7f7de4102d30 2024-09-15T22:16:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.456+0000 7f7dec5f6740 1 Processor -- start 2024-09-15T22:16:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.456+0000 7f7de0ff9640 1 -- 172.21.15.45:0/3012401893 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f7dd4010d50 con 0x7f7de4102d30 2024-09-15T22:16:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.456+0000 7f7dec5f6740 1 -- start start 2024-09-15T22:16:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.456+0000 7f7dec5f6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 0x55f8c34af880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.456+0000 7f7dec5f6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34ba140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7dec5f6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34ba680 0x55f8c34bca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7dec5f6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f8c34152e0 con 0x55f8c34af4a0 2024-09-15T22:16:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7dec5f6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f8c33bcce0 con 0x55f8c34ba680 2024-09-15T22:16:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7dec5f6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f8c34112a0 con 0x55f8c34afdc0 2024-09-15T22:16:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 0x55f8c34af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 0x55f8c34af880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34754/0 (socket says 172.21.15.45:34754) 2024-09-15T22:16:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de3fff640 1 -- 172.21.15.45:0/2467520866 learned_addr learned my addr 172.21.15.45:0/2467520866 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de2ffd640 1 --2- 172.21.15.45:0/2467520866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34ba680 0x55f8c34bca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de37fe640 1 --2- 172.21.15.45:0/2467520866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34ba140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de3fff640 1 -- 172.21.15.45:0/2467520866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 msgr2=0x55f8c34ba140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de3fff640 1 --2- 172.21.15.45:0/2467520866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34ba140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de0ff9640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7dcc0a3440 0x7f7dcc0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de3fff640 1 -- 172.21.15.45:0/2467520866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34ba680 msgr2=0x55f8c34bca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:28.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de3fff640 1 --2- 172.21.15.45:0/2467520866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34ba680 0x55f8c34bca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de3fff640 1 -- 172.21.15.45:0/2467520866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8c33a1440 con 0x55f8c34af4a0 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de37fe640 1 --2- 172.21.15.45:0/2467520866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34ba140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de0ff9640 1 -- 172.21.15.45:0/3012401893 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f7dd40d0930 con 0x7f7de4102d30 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de3fff640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7dcc0a3440 0x7f7dcc0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.457+0000 7f7de3fff640 1 --2- 172.21.15.45:0/2467520866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 0x55f8c34af880 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc009930 tx=0x7f7ddc032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f3f3d51a4ad0b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.458+0000 7f7dc9ffb640 1 -- 172.21.15.45:0/2467520866 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc03f070 con 0x55f8c34af4a0 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.458+0000 7f7dc9ffb640 1 -- 172.21.15.45:0/2467520866 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ddc005040 con 0x55f8c34af4a0 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.458+0000 7f7dc9ffb640 1 -- 172.21.15.45:0/2467520866 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc035070 con 0x55f8c34af4a0 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.458+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2467520866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 msgr2=0x55f8c34af880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.458+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2467520866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 0x55f8c34af880 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc009930 tx=0x7f7ddc032c80 comp rx=0 tx=0).stop 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.458+0000 7f7de3fff640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7dcc0a3440 0x7f7dcc0a5900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc032fd0 tx=0x7f7ddc004dc0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2467520866 shutdown_connections 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2467520866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34ba680 0x55f8c34bca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2467520866 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34ba140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2467520866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 0x55f8c34af880 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2467520866 >> 172.21.15.45:0/2467520866 conn(0x55f8c34aba30 msgr2=0x55f8c34abe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2467520866 shutdown_connections 2024-09-15T22:16:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2467520866 wait complete. 2024-09-15T22:16:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 -- start start 2024-09-15T22:16:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 Processor -- start 2024-09-15T22:16:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34af4a0 0x55f8c34b9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34afdc0 0x55f8c34b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34ba680 0x55f8c34b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f8c34bd250 con 0x55f8c34ba680 2024-09-15T22:16:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f8c33d0050 con 0x55f8c34afdc0 2024-09-15T22:16:28.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f8c34bd3d0 con 0x55f8c34af4a0 2024-09-15T22:16:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.459+0000 7f7dec5f6740 10 client.0 _ll_register_callbacks cb 0x55f8c3410160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7de3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34ba680 0x55f8c34b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7de2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34afdc0 0x55f8c34b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7de3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34ba680 0x55f8c34b76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34766/0 (socket says 172.21.15.45:34766) 2024-09-15T22:16:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7de2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34afdc0 0x55f8c34b71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:56392/0 (socket says 172.21.15.45:56392) 2024-09-15T22:16:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7de3fff640 1 -- 172.21.15.45:0/2242391334 learned_addr learned my addr 172.21.15.45:0/2242391334 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7de2ffd640 1 -- 172.21.15.45:0/2242391334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34af4a0 msgr2=0x55f8c34b9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7de2ffd640 1 --2- 172.21.15.45:0/2242391334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34af4a0 0x55f8c34b9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7de2ffd640 1 -- 172.21.15.45:0/2242391334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34ba680 msgr2=0x55f8c34b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7de2ffd640 1 --2- 172.21.15.45:0/2242391334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34ba680 0x55f8c34b76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7de2ffd640 1 -- 172.21.15.45:0/2242391334 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8c31863c0 con 0x55f8c34afdc0 2024-09-15T22:16:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7de2ffd640 1 --2- 172.21.15.45:0/2242391334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34afdc0 0x55f8c34b71a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7de4102420 tx=0x7f7dd80113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c4fdb024c295dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:28.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7dc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7dc2ffd640 1 -- 172.21.15.45:0/2242391334 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8011de0 con 0x55f8c34afdc0 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.460+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2242391334 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ddc005040 con 0x55f8c34afdc0 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.461+0000 7f7dc2ffd640 1 -- 172.21.15.45:0/2242391334 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f7dd8005020 con 0x55f8c34afdc0 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.461+0000 7f7dc2ffd640 1 -- 172.21.15.45:0/2242391334 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7dd8024050 con 0x55f8c34afdc0 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.461+0000 7f7dec5f6740 10 client.25067 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.461+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2242391334 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f8c34c8b60 con 0x55f8c34afdc0 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.461+0000 7f7dc2ffd640 1 -- 172.21.15.45:0/2242391334 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ddc005040 con 0x55f8c34afdc0 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.461+0000 7f7dc2ffd640 1 -- 172.21.15.45:0/2242391334 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7dd801b5a0 con 0x55f8c34afdc0 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.461+0000 7f7dec5f6740 10 client.25067 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.461+0000 7f7dec5f6740 10 client.25067 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.461+0000 7f7dec5f6740 20 client.25067 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.461+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2242391334 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f8c34c9f70 0x55f8c34cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.461+0000 7f7dec5f6740 4 client.25067 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:28.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.461+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2242391334 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8c3422850 con 0x55f8c34c9f70 2024-09-15T22:16:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.461+0000 7f7de37fe640 1 --2- 172.21.15.45:0/2242391334 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f8c34c9f70 0x55f8c34cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.462+0000 7f7de37fe640 1 --2- 172.21.15.45:0/2242391334 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f8c34c9f70 0x55f8c34cc410 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fd8586fe9cc4949 server_cookie=150ebdd82168bfb0 in_seq=0 out_seq=0 2024-09-15T22:16:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.462+0000 7f7dc2ffd640 10 client.25067 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.462+0000 7f7dc2ffd640 1 -- 172.21.15.45:0/2242391334 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f8c3422850 con 0x55f8c34c9f70 2024-09-15T22:16:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.462+0000 7f7dc2ffd640 10 client.25067 handle_command_reply: tid=0 2024-09-15T22:16:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.462+0000 7f7dec5f6740 1 client.25067 shutdown 2024-09-15T22:16:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.463+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2242391334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34afdc0 msgr2=0x55f8c34b71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.463+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2242391334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34afdc0 0x55f8c34b71a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7de4102420 tx=0x7f7dd80113e0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.463+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2242391334 shutdown_connections 2024-09-15T22:16:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.463+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2242391334 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f8c34c9f70 0x55f8c34cc410 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.463+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2242391334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34ba680 0x55f8c34b76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.463+0000 7f7dc2ffd640 0 client.25067 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.463+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2242391334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34afdc0 0x55f8c34b71a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.463+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2242391334 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34af4a0 0x55f8c34b9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.463+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2242391334 >> 172.21.15.45:0/2242391334 conn(0x55f8c34aba30 msgr2=0x55f8c34aab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:28.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.463+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2242391334 shutdown_connections 2024-09-15T22:16:28.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.463+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2242391334 wait complete. 2024-09-15T22:16:28.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.463+0000 7f7dec5f6740 20 client.25067 trim_cache size 0 max 16384 2024-09-15T22:16:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:28 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:16:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:28 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:28 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:16:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:28 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:28.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:28 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:16:28.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.496+0000 7f7dec5f6740 1 Processor -- start 2024-09-15T22:16:28.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.496+0000 7f7dec5f6740 1 -- start start 2024-09-15T22:16:28.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7dec5f6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 0x55f8c34d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7dec5f6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7dec5f6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34ba680 0x55f8c34b4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7dec5f6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7de41af290 con 0x55f8c34af4a0 2024-09-15T22:16:28.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7dec5f6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7de41b1b10 con 0x55f8c34ba680 2024-09-15T22:16:28.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7dec5f6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7de41af900 con 0x55f8c34afdc0 2024-09-15T22:16:28.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7de37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 0x55f8c34d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7de37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 0x55f8c34d1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34772/0 (socket says 172.21.15.45:34772) 2024-09-15T22:16:28.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7de37fe640 1 -- 172.21.15.45:0/33426495 learned_addr learned my addr 172.21.15.45:0/33426495 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:28.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7de3fff640 1 --2- 172.21.15.45:0/33426495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34ba680 0x55f8c34b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7de2ffd640 1 --2- 172.21.15.45:0/33426495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7de37fe640 1 -- 172.21.15.45:0/33426495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 msgr2=0x55f8c34d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:28.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7de37fe640 1 --2- 172.21.15.45:0/33426495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34d2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7de37fe640 1 -- 172.21.15.45:0/33426495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34ba680 msgr2=0x55f8c34b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:28.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7de37fe640 1 --2- 172.21.15.45:0/33426495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34ba680 0x55f8c34b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7de37fe640 1 -- 172.21.15.45:0/33426495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8c34ab4d0 con 0x55f8c34af4a0 2024-09-15T22:16:28.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7de2ffd640 1 --2- 172.21.15.45:0/33426495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:28.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.497+0000 7f7de37fe640 1 --2- 172.21.15.45:0/33426495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 0x55f8c34d1ce0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4098b90 tx=0x7f7dd40bc960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ece9f11a3209275 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:28.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.498+0000 7f7dc97fa640 1 -- 172.21.15.45:0/33426495 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd409c090 con 0x55f8c34af4a0 2024-09-15T22:16:28.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.498+0000 7f7dc97fa640 1 -- 172.21.15.45:0/33426495 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7dd409ce30 con 0x55f8c34af4a0 2024-09-15T22:16:28.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.498+0000 7f7dc97fa640 1 -- 172.21.15.45:0/33426495 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4011b20 con 0x55f8c34af4a0 2024-09-15T22:16:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.499+0000 7f7dec5f6740 1 -- 172.21.15.45:0/33426495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 msgr2=0x55f8c34d1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.499+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/33426495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 0x55f8c34d1ce0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4098b90 tx=0x7f7dd40bc960 comp rx=0 tx=0).stop 2024-09-15T22:16:28.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.499+0000 7f7dec5f6740 1 -- 172.21.15.45:0/33426495 shutdown_connections 2024-09-15T22:16:28.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.499+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/33426495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34ba680 0x55f8c34b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.499+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/33426495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.499+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/33426495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34af4a0 0x55f8c34d1ce0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.499+0000 7f7dec5f6740 1 -- 172.21.15.45:0/33426495 >> 172.21.15.45:0/33426495 conn(0x55f8c34aba30 msgr2=0x55f8c34b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:28.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.499+0000 7f7dec5f6740 1 -- 172.21.15.45:0/33426495 shutdown_connections 2024-09-15T22:16:28.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.499+0000 7f7dec5f6740 1 -- 172.21.15.45:0/33426495 wait complete. 2024-09-15T22:16:28.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.499+0000 7f7dec5f6740 1 -- start start 2024-09-15T22:16:28.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.499+0000 7f7dec5f6740 1 Processor -- start 2024-09-15T22:16:28.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7dec5f6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34af4a0 0x55f8c34c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7dec5f6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34be190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7dec5f6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34ba680 0x55f8c34be710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7dec5f6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7de41affd0 con 0x55f8c34ba680 2024-09-15T22:16:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7dec5f6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7de41b1440 con 0x55f8c34af4a0 2024-09-15T22:16:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7dec5f6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7de41b06a0 con 0x55f8c34afdc0 2024-09-15T22:16:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7dec5f6740 10 client.0 _ll_register_callbacks cb 0x7f7dd8004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7de3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34ba680 0x55f8c34be710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7de3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34ba680 0x55f8c34be710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34776/0 (socket says 172.21.15.45:34776) 2024-09-15T22:16:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7de37fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34af4a0 0x55f8c34c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7de3fff640 1 -- 172.21.15.45:0/2127498599 learned_addr learned my addr 172.21.15.45:0/2127498599 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7de2ffd640 1 --2- 172.21.15.45:0/2127498599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34be190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7de37fe640 1 -- 172.21.15.45:0/2127498599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 msgr2=0x55f8c34be190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:28.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7de37fe640 1 --2- 172.21.15.45:0/2127498599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34be190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7de37fe640 1 -- 172.21.15.45:0/2127498599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34ba680 msgr2=0x55f8c34be710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:28.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7de37fe640 1 --2- 172.21.15.45:0/2127498599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34ba680 0x55f8c34be710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7de37fe640 1 -- 172.21.15.45:0/2127498599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8c34bef40 con 0x55f8c34af4a0 2024-09-15T22:16:28.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.500+0000 7f7de3fff640 1 --2- 172.21.15.45:0/2127498599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34ba680 0x55f8c34be710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:28.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7de37fe640 1 --2- 172.21.15.45:0/2127498599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34af4a0 0x55f8c34c2e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40a0ca0 tx=0x7f7dd40cdc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cc7b43802f31f5c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:28.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dc2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-15T22:16:28.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dc2ffd640 1 -- 172.21.15.45:0/2127498599 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40b4030 con 0x55f8c34af4a0 2024-09-15T22:16:28.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dc2ffd640 1 -- 172.21.15.45:0/2127498599 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f7dd4098da0 con 0x55f8c34af4a0 2024-09-15T22:16:28.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2127498599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dd409ce30 con 0x55f8c34af4a0 2024-09-15T22:16:28.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dc2ffd640 1 -- 172.21.15.45:0/2127498599 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7dd40a53a0 con 0x55f8c34af4a0 2024-09-15T22:16:28.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dec5f6740 10 client.25073 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:28.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2127498599 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f8c3534cd0 con 0x55f8c34af4a0 2024-09-15T22:16:28.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dc2ffd640 1 -- 172.21.15.45:0/2127498599 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7dd409ce30 con 0x55f8c34af4a0 2024-09-15T22:16:28.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dc2ffd640 1 -- 172.21.15.45:0/2127498599 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7dd400f040 con 0x55f8c34af4a0 2024-09-15T22:16:28.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dec5f6740 10 client.25073 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:28.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dec5f6740 10 client.25073 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:28.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dec5f6740 20 client.25073 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:28.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2127498599 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f8c3535390 0x55f8c3537780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:28.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dec5f6740 4 client.25073 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:16:28.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.501+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2127498599 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f8c341cd60 con 0x55f8c3535390 2024-09-15T22:16:28.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7de2ffd640 1 --2- 172.21.15.45:0/2127498599 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f8c3535390 0x55f8c3537780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:28.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7dc2ffd640 10 client.25073 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:28.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7de2ffd640 1 --2- 172.21.15.45:0/2127498599 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f8c3535390 0x55f8c3537780 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93cb93ab656bd538 server_cookie=f6b928629133e32f in_seq=0 out_seq=0 2024-09-15T22:16:28.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7dc2ffd640 1 -- 172.21.15.45:0/2127498599 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f8c341cd60 con 0x55f8c3535390 2024-09-15T22:16:28.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7dc2ffd640 10 client.25073 handle_command_reply: tid=0 2024-09-15T22:16:28.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7dec5f6740 1 client.25073 shutdown 2024-09-15T22:16:28.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2127498599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34af4a0 msgr2=0x55f8c34c2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2127498599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34af4a0 0x55f8c34c2e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40a0ca0 tx=0x7f7dd40cdc80 comp rx=0 tx=0).stop 2024-09-15T22:16:28.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2127498599 shutdown_connections 2024-09-15T22:16:28.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2127498599 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f8c3535390 0x55f8c3537780 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2127498599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8c34ba680 0x55f8c34be710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2127498599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f8c34afdc0 0x55f8c34be190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7dc2ffd640 0 client.25073 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:28.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7dec5f6740 1 --2- 172.21.15.45:0/2127498599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f8c34af4a0 0x55f8c34c2e10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.502+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2127498599 >> 172.21.15.45:0/2127498599 conn(0x55f8c34aba30 msgr2=0x55f8c34b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:28.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.503+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2127498599 shutdown_connections 2024-09-15T22:16:28.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.503+0000 7f7dec5f6740 1 -- 172.21.15.45:0/2127498599 wait complete. 2024-09-15T22:16:28.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.503+0000 7f7dec5f6740 20 client.25073 trim_cache size 0 max 16384 2024-09-15T22:16:28.510 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:16:28.510 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:16:28.510 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:16:28.510 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:16:28.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.503+0000 7f7dea21d640 1 -- 172.21.15.45:0/3012401893 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7dcc0a3440 msgr2=0x7f7dcc0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.503+0000 7f7dea21d640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7dcc0a3440 0x7f7dcc0a5900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc032fd0 tx=0x7f7ddc004dc0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.503+0000 7f7dea21d640 1 -- 172.21.15.45:0/3012401893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de4102d30 msgr2=0x7f7de4100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.503+0000 7f7dea21d640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de4102d30 0x7f7de4100990 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400eab0 tx=0x7f7dd400ef70 comp rx=0 tx=0).stop 2024-09-15T22:16:28.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.504+0000 7f7dea21d640 1 -- 172.21.15.45:0/3012401893 shutdown_connections 2024-09-15T22:16:28.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.504+0000 7f7dea21d640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7dcc0a3440 0x7f7dcc0a5900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.504+0000 7f7dea21d640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de41082a0 0x7f7de4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.504+0000 7f7dea21d640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7de41036e0 0x7f7de4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.504+0000 7f7dea21d640 1 --2- 172.21.15.45:0/3012401893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7de4102d30 0x7f7de4100990 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.504+0000 7f7dea21d640 1 -- 172.21.15.45:0/3012401893 >> 172.21.15.45:0/3012401893 conn(0x7f7de40fc7d0 msgr2=0x7f7de40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:28.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.504+0000 7f7dea21d640 1 -- 172.21.15.45:0/3012401893 shutdown_connections 2024-09-15T22:16:28.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.504+0000 7f7dea21d640 1 -- 172.21.15.45:0/3012401893 wait complete. 2024-09-15T22:16:28.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.580+0000 7f5240ee4640 1 -- 172.21.15.45:0/2177520833 --> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f523c0fedd0 con 0x7f52280a3580 2024-09-15T22:16:28.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.587+0000 7f52337fe640 1 -- 172.21.15.45:0/2177520833 <== mgr.15165 v2:172.21.15.45:6800/553298159 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f523c0fedd0 con 0x7f52280a3580 2024-09-15T22:16:28.588 INFO:teuthology.orchestra.run.smithi045.stdout:/ 1m 6m3h 2024-09-15T22:16:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.589+0000 7f5240ee4640 1 -- 172.21.15.45:0/2177520833 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f52280a3580 msgr2=0x7f52280a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.589+0000 7f5240ee4640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f52280a3580 0x7f52280a5a40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f522c009bd0 tx=0x7f522c005f90 comp rx=0 tx=0).stop 2024-09-15T22:16:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.589+0000 7f5240ee4640 1 -- 172.21.15.45:0/2177520833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f523c1035a0 msgr2=0x7f523c100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.589+0000 7f5240ee4640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f523c1035a0 0x7f523c100e10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f522400c940 tx=0x7f522400ce00 comp rx=0 tx=0).stop 2024-09-15T22:16:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.589+0000 7f5240ee4640 1 -- 172.21.15.45:0/2177520833 shutdown_connections 2024-09-15T22:16:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.589+0000 7f5240ee4640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f52280a3580 0x7f52280a5a40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.589+0000 7f5240ee4640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f523c10c0d0 0x7f523c101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.589+0000 7f5240ee4640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f523c1035a0 0x7f523c100e10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.589+0000 7f5240ee4640 1 --2- 172.21.15.45:0/2177520833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f523c102c80 0x7f523c1008d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:28.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.589+0000 7f5240ee4640 1 -- 172.21.15.45:0/2177520833 >> 172.21.15.45:0/2177520833 conn(0x7f523c077990 msgr2=0x7f523c0fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:28.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.589+0000 7f5240ee4640 1 -- 172.21.15.45:0/2177520833 shutdown_connections 2024-09-15T22:16:28.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:28.589+0000 7f5240ee4640 1 -- 172.21.15.45:0/2177520833 wait complete. 2024-09-15T22:16:28.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-15T22:16:28.628 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-15T22:16:28.638 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-15T22:16:28.665 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T22:16:28.666 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:16:29.190 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:16:29.190 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:16:29.259 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:29.380 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:29 smithi045 ceph-mon[31180]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:29.380 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:29 smithi045 ceph-mon[31180]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 113 B/s wr, 14 op/s 2024-09-15T22:16:29.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:29 smithi045 ceph-mon[31180]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:29.381 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:29 smithi045 ceph-mon[31180]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:29.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:29 smithi165 ceph-mon[35551]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:29 smithi165 ceph-mon[35551]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 113 B/s wr, 14 op/s 2024-09-15T22:16:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:29 smithi165 ceph-mon[35551]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:29 smithi165 ceph-mon[35551]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:29 smithi100 ceph-mon[35319]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:29 smithi100 ceph-mon[35319]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 113 B/s wr, 14 op/s 2024-09-15T22:16:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:29 smithi100 ceph-mon[35319]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:29 smithi100 ceph-mon[35319]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.747+0000 7fc1d0501640 1 -- 172.21.15.45:0/356879447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1c8106a80 msgr2=0x7fc1c8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.747+0000 7fc1d0501640 1 --2- 172.21.15.45:0/356879447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1c8106a80 0x7fc1c8106e60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009930 tx=0x7fc1c402a420 comp rx=0 tx=0).stop 2024-09-15T22:16:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.747+0000 7fc1d0501640 1 -- 172.21.15.45:0/356879447 shutdown_connections 2024-09-15T22:16:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.747+0000 7fc1d0501640 1 --2- 172.21.15.45:0/356879447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1c8101420 0x7fc1c810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.747+0000 7fc1d0501640 1 --2- 172.21.15.45:0/356879447 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1c8100a80 0x7fc1c8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.747+0000 7fc1d0501640 1 --2- 172.21.15.45:0/356879447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1c8106a80 0x7fc1c8106e60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.747+0000 7fc1d0501640 1 -- 172.21.15.45:0/356879447 >> 172.21.15.45:0/356879447 conn(0x7fc1c80fc7a0 msgr2=0x7fc1c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.747+0000 7fc1d0501640 1 -- 172.21.15.45:0/356879447 shutdown_connections 2024-09-15T22:16:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.747+0000 7fc1d0501640 1 -- 172.21.15.45:0/356879447 wait complete. 2024-09-15T22:16:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.748+0000 7fc1d0501640 1 Processor -- start 2024-09-15T22:16:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.748+0000 7fc1d0501640 1 -- start start 2024-09-15T22:16:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.748+0000 7fc1d0501640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1c8100a80 0x7fc1c810e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.748+0000 7fc1d0501640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1c8101420 0x7fc1c810e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.748+0000 7fc1d0501640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1c8106a80 0x7fc1c810ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.748+0000 7fc1d0501640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c81120e0 con 0x7fc1c8101420 2024-09-15T22:16:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.748+0000 7fc1d0501640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c8111f60 con 0x7fc1c8100a80 2024-09-15T22:16:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.748+0000 7fc1d0501640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c8112260 con 0x7fc1c8106a80 2024-09-15T22:16:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.748+0000 7fc1cda9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1c8101420 0x7fc1c810e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.748+0000 7fc1cda9c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1c8101420 0x7fc1c810e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34802/0 (socket says 172.21.15.45:34802) 2024-09-15T22:16:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.748+0000 7fc1cda9c640 1 -- 172.21.15.45:0/51560322 learned_addr learned my addr 172.21.15.45:0/51560322 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1ce29d640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1c8100a80 0x7fc1c810e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1cea9e640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1c8106a80 0x7fc1c810ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1cda9c640 1 -- 172.21.15.45:0/51560322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1c8106a80 msgr2=0x7fc1c810ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1cda9c640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1c8106a80 0x7fc1c810ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1cda9c640 1 -- 172.21.15.45:0/51560322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1c8100a80 msgr2=0x7fc1c810e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1cda9c640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1c8100a80 0x7fc1c810e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1cda9c640 1 -- 172.21.15.45:0/51560322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c81a6aa0 con 0x7fc1c8101420 2024-09-15T22:16:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1cea9e640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1c8106a80 0x7fc1c810ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1cda9c640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1c8101420 0x7fc1c810e7a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800b4a0 tx=0x7fc1b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1bf7fe640 1 -- 172.21.15.45:0/51560322 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8014070 con 0x7fc1c8101420 2024-09-15T22:16:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1bf7fe640 1 -- 172.21.15.45:0/51560322 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc1b8010b10 con 0x7fc1c8101420 2024-09-15T22:16:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1d0501640 1 -- 172.21.15.45:0/51560322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c81a6d90 con 0x7fc1c8101420 2024-09-15T22:16:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1bf7fe640 1 -- 172.21.15.45:0/51560322 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8017d60 con 0x7fc1c8101420 2024-09-15T22:16:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.749+0000 7fc1d0501640 1 -- 172.21.15.45:0/51560322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c81a7270 con 0x7fc1c8101420 2024-09-15T22:16:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.750+0000 7fc1d0501640 1 -- 172.21.15.45:0/51560322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c8100ee0 con 0x7fc1c8101420 2024-09-15T22:16:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.751+0000 7fc1bf7fe640 1 -- 172.21.15.45:0/51560322 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fc1b8017070 con 0x7fc1c8101420 2024-09-15T22:16:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.752+0000 7fc1bf7fe640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc1b40a34c0 0x7fc1b40a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.752+0000 7fc1bf7fe640 1 -- 172.21.15.45:0/51560322 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fc1b80cf470 con 0x7fc1c8101420 2024-09-15T22:16:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.752+0000 7fc1ce29d640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc1b40a34c0 0x7fc1b40a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.753+0000 7fc1ce29d640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc1b40a34c0 0x7fc1b40a5980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4000c00 tx=0x7fc1c40095f0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.756+0000 7fc1bf7fe640 1 -- 172.21.15.45:0/51560322 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1b809bb20 con 0x7fc1c8101420 2024-09-15T22:16:29.803 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:29.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.943+0000 7fc1d0501640 1 -- 172.21.15.45:0/51560322 --> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1c8062630 con 0x7fc1b40a34c0 2024-09-15T22:16:29.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.952+0000 7fc1bf7fe640 1 -- 172.21.15.45:0/51560322 <== mgr.15165 v2:172.21.15.45:6800/553298159 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339316 (secure 0 0 0) 0x7fc1c8062630 con 0x7fc1b40a34c0 2024-09-15T22:16:29.956 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:29.958 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-09-15T22:16:29.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.955+0000 7fc1d0501640 1 -- 172.21.15.45:0/51560322 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc1b40a34c0 msgr2=0x7fc1b40a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:29.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.955+0000 7fc1d0501640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc1b40a34c0 0x7fc1b40a5980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4000c00 tx=0x7fc1c40095f0 comp rx=0 tx=0).stop 2024-09-15T22:16:29.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.955+0000 7fc1d0501640 1 -- 172.21.15.45:0/51560322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1c8101420 msgr2=0x7fc1c810e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:29.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.955+0000 7fc1d0501640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1c8101420 0x7fc1c810e7a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800b4a0 tx=0x7fc1b800b960 comp rx=0 tx=0).stop 2024-09-15T22:16:29.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.955+0000 7fc1d0501640 1 -- 172.21.15.45:0/51560322 shutdown_connections 2024-09-15T22:16:29.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.955+0000 7fc1d0501640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc1b40a34c0 0x7fc1b40a5980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:29.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.955+0000 7fc1d0501640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc1c8106a80 0x7fc1c810ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:29.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.955+0000 7fc1d0501640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1c8101420 0x7fc1c810e7a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:29.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.955+0000 7fc1d0501640 1 --2- 172.21.15.45:0/51560322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1c8100a80 0x7fc1c810e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:29.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.955+0000 7fc1d0501640 1 -- 172.21.15.45:0/51560322 >> 172.21.15.45:0/51560322 conn(0x7fc1c80fc7a0 msgr2=0x7fc1c80fd030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:29.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.955+0000 7fc1d0501640 1 -- 172.21.15.45:0/51560322 shutdown_connections 2024-09-15T22:16:29.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:29.955+0000 7fc1d0501640 1 -- 172.21.15.45:0/51560322 wait complete. 2024-09-15T22:16:30.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:30 smithi100 ceph-mon[35319]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:30.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:30 smithi045 ceph-mon[31180]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:30.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:30 smithi165 ceph-mon[35551]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:16:30.839 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-15T22:16:29.558467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1384695,"num_objects":28,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":799,"num_read_kb":818,"num_write":533,"num_write_kb":5268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":881,"ondisk_log_size":881,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":415752,"kb_used_data":16196,"kb_used_omap":18,"kb_used_meta":398957,"kb_avail":1124526072,"statfs":{"total":1151940427776,"available":1151514697728,"internally_reserved":0,"allocated":16584704,"data_stored":10269647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":408532281},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":443,"num_write":144,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.988911"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557539+0000","last_change":"2024-09-15T22:14:04.718966+0000","last_active":"2024-09-15T22:16:17.557539+0000","last_peered":"2024-09-15T22:16:17.557539+0000","last_clean":"2024-09-15T22:16:17.557539+0000","last_became_active":"2024-09-15T22:14:04.718743+0000","last_became_peered":"2024-09-15T22:14:04.718743+0000","last_unstale":"2024-09-15T22:16:17.557539+0000","last_undegraded":"2024-09-15T22:16:17.557539+0000","last_fullsized":"2024-09-15T22:16:17.557539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:24:01.767801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604829+0000","last_change":"2024-09-15T22:14:06.814802+0000","last_active":"2024-09-15T22:16:17.604829+0000","last_peered":"2024-09-15T22:16:17.604829+0000","last_clean":"2024-09-15T22:16:17.604829+0000","last_became_active":"2024-09-15T22:14:06.814495+0000","last_became_peered":"2024-09-15T22:14:06.814495+0000","last_unstale":"2024-09-15T22:16:17.604829+0000","last_undegraded":"2024-09-15T22:16:17.604829+0000","last_fullsized":"2024-09-15T22:16:17.604829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:45.384412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552197+0000","last_change":"2024-09-15T22:15:17.404082+0000","last_active":"2024-09-15T22:16:17.552197+0000","last_peered":"2024-09-15T22:16:17.552197+0000","last_clean":"2024-09-15T22:16:17.552197+0000","last_became_active":"2024-09-15T22:15:17.403590+0000","last_became_peered":"2024-09-15T22:15:17.403590+0000","last_unstale":"2024-09-15T22:16:17.552197+0000","last_undegraded":"2024-09-15T22:16:17.552197+0000","last_fullsized":"2024-09-15T22:16:17.552197+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:49.816560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.566735+0000","last_change":"2024-09-15T22:14:05.017101+0000","last_active":"2024-09-15T22:16:17.566735+0000","last_peered":"2024-09-15T22:16:17.566735+0000","last_clean":"2024-09-15T22:16:17.566735+0000","last_became_active":"2024-09-15T22:14:05.016748+0000","last_became_peered":"2024-09-15T22:14:05.016748+0000","last_unstale":"2024-09-15T22:16:17.566735+0000","last_undegraded":"2024-09-15T22:16:17.566735+0000","last_fullsized":"2024-09-15T22:16:17.566735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:11.211291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605811+0000","last_change":"2024-09-15T22:14:06.815112+0000","last_active":"2024-09-15T22:16:17.605811+0000","last_peered":"2024-09-15T22:16:17.605811+0000","last_clean":"2024-09-15T22:16:17.605811+0000","last_became_active":"2024-09-15T22:14:06.814556+0000","last_became_peered":"2024-09-15T22:14:06.814556+0000","last_unstale":"2024-09-15T22:16:17.605811+0000","last_undegraded":"2024-09-15T22:16:17.605811+0000","last_fullsized":"2024-09-15T22:16:17.605811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:24.733336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553827+0000","last_change":"2024-09-15T22:14:13.845829+0000","last_active":"2024-09-15T22:16:17.553827+0000","last_peered":"2024-09-15T22:16:17.553827+0000","last_clean":"2024-09-15T22:16:17.553827+0000","last_became_active":"2024-09-15T22:14:13.844958+0000","last_became_peered":"2024-09-15T22:14:13.844958+0000","last_unstale":"2024-09-15T22:16:17.553827+0000","last_undegraded":"2024-09-15T22:16:17.553827+0000","last_fullsized":"2024-09-15T22:16:17.553827+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:37.944143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555893+0000","last_change":"2024-09-15T22:14:04.720255+0000","last_active":"2024-09-15T22:16:17.555893+0000","last_peered":"2024-09-15T22:16:17.555893+0000","last_clean":"2024-09-15T22:16:17.555893+0000","last_became_active":"2024-09-15T22:14:04.719907+0000","last_became_peered":"2024-09-15T22:14:04.719907+0000","last_unstale":"2024-09-15T22:16:17.555893+0000","last_undegraded":"2024-09-15T22:16:17.555893+0000","last_fullsized":"2024-09-15T22:16:17.555893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:12.510139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.591919+0000","last_change":"2024-09-15T22:14:06.808322+0000","last_active":"2024-09-15T22:16:17.591919+0000","last_peered":"2024-09-15T22:16:17.591919+0000","last_clean":"2024-09-15T22:16:17.591919+0000","last_became_active":"2024-09-15T22:14:06.807398+0000","last_became_peered":"2024-09-15T22:14:06.807398+0000","last_unstale":"2024-09-15T22:16:17.591919+0000","last_undegraded":"2024-09-15T22:16:17.591919+0000","last_fullsized":"2024-09-15T22:16:17.591919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:11.677800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554758+0000","last_change":"2024-09-15T22:14:13.849713+0000","last_active":"2024-09-15T22:16:17.554758+0000","last_peered":"2024-09-15T22:16:17.554758+0000","last_clean":"2024-09-15T22:16:17.554758+0000","last_became_active":"2024-09-15T22:14:13.849311+0000","last_became_peered":"2024-09-15T22:14:13.849311+0000","last_unstale":"2024-09-15T22:16:17.554758+0000","last_undegraded":"2024-09-15T22:16:17.554758+0000","last_fullsized":"2024-09-15T22:16:17.554758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:17.782013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554654+0000","last_change":"2024-09-15T22:14:04.721694+0000","last_active":"2024-09-15T22:16:17.554654+0000","last_peered":"2024-09-15T22:16:17.554654+0000","last_clean":"2024-09-15T22:16:17.554654+0000","last_became_active":"2024-09-15T22:14:04.721321+0000","last_became_peered":"2024-09-15T22:14:04.721321+0000","last_unstale":"2024-09-15T22:16:17.554654+0000","last_undegraded":"2024-09-15T22:16:17.554654+0000","last_fullsized":"2024-09-15T22:16:17.554654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:47.817565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.586446+0000","last_change":"2024-09-15T22:14:06.809564+0000","last_active":"2024-09-15T22:16:17.586446+0000","last_peered":"2024-09-15T22:16:17.586446+0000","last_clean":"2024-09-15T22:16:17.586446+0000","last_became_active":"2024-09-15T22:14:06.809102+0000","last_became_peered":"2024-09-15T22:14:06.809102+0000","last_unstale":"2024-09-15T22:16:17.586446+0000","last_undegraded":"2024-09-15T22:16:17.586446+0000","last_fullsized":"2024-09-15T22:16:17.586446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:55.306791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554499+0000","last_change":"2024-09-15T22:14:13.849839+0000","last_active":"2024-09-15T22:16:17.554499+0000","last_peered":"2024-09-15T22:16:17.554499+0000","last_clean":"2024-09-15T22:16:17.554499+0000","last_became_active":"2024-09-15T22:14:13.849415+0000","last_became_peered":"2024-09-15T22:14:13.849415+0000","last_unstale":"2024-09-15T22:16:17.554499+0000","last_undegraded":"2024-09-15T22:16:17.554499+0000","last_fullsized":"2024-09-15T22:16:17.554499+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:20.336406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601353+0000","last_change":"2024-09-15T22:14:06.815506+0000","last_active":"2024-09-15T22:16:17.601353+0000","last_peered":"2024-09-15T22:16:17.601353+0000","last_clean":"2024-09-15T22:16:17.601353+0000","last_became_active":"2024-09-15T22:14:06.815066+0000","last_became_peered":"2024-09-15T22:14:06.815066+0000","last_unstale":"2024-09-15T22:16:17.601353+0000","last_undegraded":"2024-09-15T22:16:17.601353+0000","last_fullsized":"2024-09-15T22:16:17.601353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:42.182268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555136+0000","last_change":"2024-09-15T22:14:04.721403+0000","last_active":"2024-09-15T22:16:17.555136+0000","last_peered":"2024-09-15T22:16:17.555136+0000","last_clean":"2024-09-15T22:16:17.555136+0000","last_became_active":"2024-09-15T22:14:04.721049+0000","last_became_peered":"2024-09-15T22:14:04.721049+0000","last_unstale":"2024-09-15T22:16:17.555136+0000","last_undegraded":"2024-09-15T22:16:17.555136+0000","last_fullsized":"2024-09-15T22:16:17.555136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:39.860926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.561252+0000","last_change":"2024-09-15T22:14:14.280656+0000","last_active":"2024-09-15T22:16:17.561252+0000","last_peered":"2024-09-15T22:16:17.561252+0000","last_clean":"2024-09-15T22:16:17.561252+0000","last_became_active":"2024-09-15T22:14:14.280230+0000","last_became_peered":"2024-09-15T22:14:14.280230+0000","last_unstale":"2024-09-15T22:16:17.561252+0000","last_undegraded":"2024-09-15T22:16:17.561252+0000","last_fullsized":"2024-09-15T22:16:17.561252+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:47.531799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604047+0000","last_change":"2024-09-15T22:14:06.805575+0000","last_active":"2024-09-15T22:16:17.604047+0000","last_peered":"2024-09-15T22:16:17.604047+0000","last_clean":"2024-09-15T22:16:17.604047+0000","last_became_active":"2024-09-15T22:14:06.804515+0000","last_became_peered":"2024-09-15T22:14:06.804515+0000","last_unstale":"2024-09-15T22:16:17.604047+0000","last_undegraded":"2024-09-15T22:16:17.604047+0000","last_fullsized":"2024-09-15T22:16:17.604047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.560964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552446+0000","last_change":"2024-09-15T22:14:04.717221+0000","last_active":"2024-09-15T22:16:17.552446+0000","last_peered":"2024-09-15T22:16:17.552446+0000","last_clean":"2024-09-15T22:16:17.552446+0000","last_became_active":"2024-09-15T22:14:04.716845+0000","last_became_peered":"2024-09-15T22:14:04.716845+0000","last_unstale":"2024-09-15T22:16:17.552446+0000","last_undegraded":"2024-09-15T22:16:17.552446+0000","last_fullsized":"2024-09-15T22:16:17.552446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.073229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555298+0000","last_change":"2024-09-15T22:14:13.847822+0000","last_active":"2024-09-15T22:16:17.555298+0000","last_peered":"2024-09-15T22:16:17.555298+0000","last_clean":"2024-09-15T22:16:17.555298+0000","last_became_active":"2024-09-15T22:14:13.847332+0000","last_became_peered":"2024-09-15T22:14:13.847332+0000","last_unstale":"2024-09-15T22:16:17.555298+0000","last_undegraded":"2024-09-15T22:16:17.555298+0000","last_fullsized":"2024-09-15T22:16:17.555298+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:18.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603103+0000","last_change":"2024-09-15T22:14:06.814033+0000","last_active":"2024-09-15T22:16:17.603103+0000","last_peered":"2024-09-15T22:16:17.603103+0000","last_clean":"2024-09-15T22:16:17.603103+0000","last_became_active":"2024-09-15T22:14:06.813458+0000","last_became_peered":"2024-09-15T22:14:06.813458+0000","last_unstale":"2024-09-15T22:16:17.603103+0000","last_undegraded":"2024-09-15T22:16:17.603103+0000","last_fullsized":"2024-09-15T22:16:17.603103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:16.484113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554628+0000","last_change":"2024-09-15T22:14:04.715797+0000","last_active":"2024-09-15T22:16:17.554628+0000","last_peered":"2024-09-15T22:16:17.554628+0000","last_clean":"2024-09-15T22:16:17.554628+0000","last_became_active":"2024-09-15T22:14:04.715478+0000","last_became_peered":"2024-09-15T22:14:04.715478+0000","last_unstale":"2024-09-15T22:16:17.554628+0000","last_undegraded":"2024-09-15T22:16:17.554628+0000","last_fullsized":"2024-09-15T22:16:17.554628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:39.432873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557177+0000","last_change":"2024-09-15T22:14:13.853461+0000","last_active":"2024-09-15T22:16:17.557177+0000","last_peered":"2024-09-15T22:16:17.557177+0000","last_clean":"2024-09-15T22:16:17.557177+0000","last_became_active":"2024-09-15T22:14:13.852896+0000","last_became_peered":"2024-09-15T22:14:13.852896+0000","last_unstale":"2024-09-15T22:16:17.557177+0000","last_undegraded":"2024-09-15T22:16:17.557177+0000","last_fullsized":"2024-09-15T22:16:17.557177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:41.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579227+0000","last_change":"2024-09-15T22:14:06.814990+0000","last_active":"2024-09-15T22:16:17.579227+0000","last_peered":"2024-09-15T22:16:17.579227+0000","last_clean":"2024-09-15T22:16:17.579227+0000","last_became_active":"2024-09-15T22:14:06.814646+0000","last_became_peered":"2024-09-15T22:14:06.814646+0000","last_unstale":"2024-09-15T22:16:17.579227+0000","last_undegraded":"2024-09-15T22:16:17.579227+0000","last_fullsized":"2024-09-15T22:16:17.579227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:04.717207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.542012+0000","last_change":"2024-09-15T22:14:05.017599+0000","last_active":"2024-09-15T22:16:17.542012+0000","last_peered":"2024-09-15T22:16:17.542012+0000","last_clean":"2024-09-15T22:16:17.542012+0000","last_became_active":"2024-09-15T22:14:05.017296+0000","last_became_peered":"2024-09-15T22:14:05.017296+0000","last_unstale":"2024-09-15T22:16:17.542012+0000","last_undegraded":"2024-09-15T22:16:17.542012+0000","last_fullsized":"2024-09-15T22:16:17.542012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:11.427372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556380+0000","last_change":"2024-09-15T22:14:14.281453+0000","last_active":"2024-09-15T22:16:17.556380+0000","last_peered":"2024-09-15T22:16:17.556380+0000","last_clean":"2024-09-15T22:16:17.556380+0000","last_became_active":"2024-09-15T22:14:14.280814+0000","last_became_peered":"2024-09-15T22:14:14.280814+0000","last_unstale":"2024-09-15T22:16:17.556380+0000","last_undegraded":"2024-09-15T22:16:17.556380+0000","last_fullsized":"2024-09-15T22:16:17.556380+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:43:40.890979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604784+0000","last_change":"2024-09-15T22:14:06.816619+0000","last_active":"2024-09-15T22:16:17.604784+0000","last_peered":"2024-09-15T22:16:17.604784+0000","last_clean":"2024-09-15T22:16:17.604784+0000","last_became_active":"2024-09-15T22:14:06.814421+0000","last_became_peered":"2024-09-15T22:14:06.814421+0000","last_unstale":"2024-09-15T22:16:17.604784+0000","last_undegraded":"2024-09-15T22:16:17.604784+0000","last_fullsized":"2024-09-15T22:16:17.604784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:00.329802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556148+0000","last_change":"2024-09-15T22:14:05.197752+0000","last_active":"2024-09-15T22:16:17.556148+0000","last_peered":"2024-09-15T22:16:17.556148+0000","last_clean":"2024-09-15T22:16:17.556148+0000","last_became_active":"2024-09-15T22:14:05.197399+0000","last_became_peered":"2024-09-15T22:14:05.197399+0000","last_unstale":"2024-09-15T22:16:17.556148+0000","last_undegraded":"2024-09-15T22:16:17.556148+0000","last_fullsized":"2024-09-15T22:16:17.556148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:19.781842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552191+0000","last_change":"2024-09-15T22:14:13.847474+0000","last_active":"2024-09-15T22:16:17.552191+0000","last_peered":"2024-09-15T22:16:17.552191+0000","last_clean":"2024-09-15T22:16:17.552191+0000","last_became_active":"2024-09-15T22:14:13.847032+0000","last_became_peered":"2024-09-15T22:14:13.847032+0000","last_unstale":"2024-09-15T22:16:17.552191+0000","last_undegraded":"2024-09-15T22:16:17.552191+0000","last_fullsized":"2024-09-15T22:16:17.552191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:21.049024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598828+0000","last_change":"2024-09-15T22:14:06.809104+0000","last_active":"2024-09-15T22:16:17.598828+0000","last_peered":"2024-09-15T22:16:17.598828+0000","last_clean":"2024-09-15T22:16:17.598828+0000","last_became_active":"2024-09-15T22:14:06.808735+0000","last_became_peered":"2024-09-15T22:14:06.808735+0000","last_unstale":"2024-09-15T22:16:17.598828+0000","last_undegraded":"2024-09-15T22:16:17.598828+0000","last_fullsized":"2024-09-15T22:16:17.598828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:46.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'97","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:28.221507+0000","last_change":"2024-09-15T22:14:04.712546+0000","last_active":"2024-09-15T22:16:28.221507+0000","last_peered":"2024-09-15T22:16:28.221507+0000","last_clean":"2024-09-15T22:16:28.221507+0000","last_became_active":"2024-09-15T22:14:04.712222+0000","last_became_peered":"2024-09-15T22:14:04.712222+0000","last_unstale":"2024-09-15T22:16:28.221507+0000","last_undegraded":"2024-09-15T22:16:28.221507+0000","last_fullsized":"2024-09-15T22:16:28.221507+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:00.993810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":179,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.566187+0000","last_change":"2024-09-15T22:14:14.280905+0000","last_active":"2024-09-15T22:16:17.566187+0000","last_peered":"2024-09-15T22:16:17.566187+0000","last_clean":"2024-09-15T22:16:17.566187+0000","last_became_active":"2024-09-15T22:14:14.280368+0000","last_became_peered":"2024-09-15T22:14:14.280368+0000","last_unstale":"2024-09-15T22:16:17.566187+0000","last_undegraded":"2024-09-15T22:16:17.566187+0000","last_fullsized":"2024-09-15T22:16:17.566187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:52.812589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.599423+0000","last_change":"2024-09-15T22:14:06.816231+0000","last_active":"2024-09-15T22:16:17.599423+0000","last_peered":"2024-09-15T22:16:17.599423+0000","last_clean":"2024-09-15T22:16:17.599423+0000","last_became_active":"2024-09-15T22:14:06.815884+0000","last_became_peered":"2024-09-15T22:14:06.815884+0000","last_unstale":"2024-09-15T22:16:17.599423+0000","last_undegraded":"2024-09-15T22:16:17.599423+0000","last_fullsized":"2024-09-15T22:16:17.599423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:30.076077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556018+0000","last_change":"2024-09-15T22:14:05.017745+0000","last_active":"2024-09-15T22:16:17.556018+0000","last_peered":"2024-09-15T22:16:17.556018+0000","last_clean":"2024-09-15T22:16:17.556018+0000","last_became_active":"2024-09-15T22:14:05.017064+0000","last_became_peered":"2024-09-15T22:14:05.017064+0000","last_unstale":"2024-09-15T22:16:17.556018+0000","last_undegraded":"2024-09-15T22:16:17.556018+0000","last_fullsized":"2024-09-15T22:16:17.556018+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:44.038448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.560621+0000","last_change":"2024-09-15T22:14:13.853195+0000","last_active":"2024-09-15T22:16:17.560621+0000","last_peered":"2024-09-15T22:16:17.560621+0000","last_clean":"2024-09-15T22:16:17.560621+0000","last_became_active":"2024-09-15T22:14:13.852803+0000","last_became_peered":"2024-09-15T22:14:13.852803+0000","last_unstale":"2024-09-15T22:16:17.560621+0000","last_undegraded":"2024-09-15T22:16:17.560621+0000","last_fullsized":"2024-09-15T22:16:17.560621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:20.737509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601889+0000","last_change":"2024-09-15T22:14:06.805448+0000","last_active":"2024-09-15T22:16:17.601889+0000","last_peered":"2024-09-15T22:16:17.601889+0000","last_clean":"2024-09-15T22:16:17.601889+0000","last_became_active":"2024-09-15T22:14:06.804965+0000","last_became_peered":"2024-09-15T22:14:06.804965+0000","last_unstale":"2024-09-15T22:16:17.601889+0000","last_undegraded":"2024-09-15T22:16:17.601889+0000","last_fullsized":"2024-09-15T22:16:17.601889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:29.831888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556768+0000","last_change":"2024-09-15T22:14:05.017438+0000","last_active":"2024-09-15T22:16:17.556768+0000","last_peered":"2024-09-15T22:16:17.556768+0000","last_clean":"2024-09-15T22:16:17.556768+0000","last_became_active":"2024-09-15T22:14:05.017050+0000","last_became_peered":"2024-09-15T22:14:05.017050+0000","last_unstale":"2024-09-15T22:16:17.556768+0000","last_undegraded":"2024-09-15T22:16:17.556768+0000","last_fullsized":"2024-09-15T22:16:17.556768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:35.608774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554172+0000","last_change":"2024-09-15T22:14:14.281096+0000","last_active":"2024-09-15T22:16:17.554172+0000","last_peered":"2024-09-15T22:16:17.554172+0000","last_clean":"2024-09-15T22:16:17.554172+0000","last_became_active":"2024-09-15T22:14:14.280381+0000","last_became_peered":"2024-09-15T22:14:14.280381+0000","last_unstale":"2024-09-15T22:16:17.554172+0000","last_undegraded":"2024-09-15T22:16:17.554172+0000","last_fullsized":"2024-09-15T22:16:17.554172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:44.686080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.583155+0000","last_change":"2024-09-15T22:14:06.812046+0000","last_active":"2024-09-15T22:16:17.583155+0000","last_peered":"2024-09-15T22:16:17.583155+0000","last_clean":"2024-09-15T22:16:17.583155+0000","last_became_active":"2024-09-15T22:14:06.811721+0000","last_became_peered":"2024-09-15T22:14:06.811721+0000","last_unstale":"2024-09-15T22:16:17.583155+0000","last_undegraded":"2024-09-15T22:16:17.583155+0000","last_fullsized":"2024-09-15T22:16:17.583155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:13.244973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556145+0000","last_change":"2024-09-15T22:14:04.720940+0000","last_active":"2024-09-15T22:16:17.556145+0000","last_peered":"2024-09-15T22:16:17.556145+0000","last_clean":"2024-09-15T22:16:17.556145+0000","last_became_active":"2024-09-15T22:14:04.720624+0000","last_became_peered":"2024-09-15T22:14:04.720624+0000","last_unstale":"2024-09-15T22:16:17.556145+0000","last_undegraded":"2024-09-15T22:16:17.556145+0000","last_fullsized":"2024-09-15T22:16:17.556145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:29.823784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540655+0000","last_change":"2024-09-15T22:14:13.848882+0000","last_active":"2024-09-15T22:16:17.540655+0000","last_peered":"2024-09-15T22:16:17.540655+0000","last_clean":"2024-09-15T22:16:17.540655+0000","last_became_active":"2024-09-15T22:14:13.848512+0000","last_became_peered":"2024-09-15T22:14:13.848512+0000","last_unstale":"2024-09-15T22:16:17.540655+0000","last_undegraded":"2024-09-15T22:16:17.540655+0000","last_fullsized":"2024-09-15T22:16:17.540655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:44.050344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582026+0000","last_change":"2024-09-15T22:14:06.813915+0000","last_active":"2024-09-15T22:16:17.582026+0000","last_peered":"2024-09-15T22:16:17.582026+0000","last_clean":"2024-09-15T22:16:17.582026+0000","last_became_active":"2024-09-15T22:14:06.811803+0000","last_became_peered":"2024-09-15T22:14:06.811803+0000","last_unstale":"2024-09-15T22:16:17.582026+0000","last_undegraded":"2024-09-15T22:16:17.582026+0000","last_fullsized":"2024-09-15T22:16:17.582026+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:42.117747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540432+0000","last_change":"2024-09-15T22:14:05.017360+0000","last_active":"2024-09-15T22:16:17.540432+0000","last_peered":"2024-09-15T22:16:17.540432+0000","last_clean":"2024-09-15T22:16:17.540432+0000","last_became_active":"2024-09-15T22:14:05.017004+0000","last_became_peered":"2024-09-15T22:14:05.017004+0000","last_unstale":"2024-09-15T22:16:17.540432+0000","last_undegraded":"2024-09-15T22:16:17.540432+0000","last_fullsized":"2024-09-15T22:16:17.540432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:01.366513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540921+0000","last_change":"2024-09-15T22:14:14.280215+0000","last_active":"2024-09-15T22:16:17.540921+0000","last_peered":"2024-09-15T22:16:17.540921+0000","last_clean":"2024-09-15T22:16:17.540921+0000","last_became_active":"2024-09-15T22:14:14.279750+0000","last_became_peered":"2024-09-15T22:14:14.279750+0000","last_unstale":"2024-09-15T22:16:17.540921+0000","last_undegraded":"2024-09-15T22:16:17.540921+0000","last_fullsized":"2024-09-15T22:16:17.540921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:58.827582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602972+0000","last_change":"2024-09-15T22:14:06.812410+0000","last_active":"2024-09-15T22:16:17.602972+0000","last_peered":"2024-09-15T22:16:17.602972+0000","last_clean":"2024-09-15T22:16:17.602972+0000","last_became_active":"2024-09-15T22:14:06.812032+0000","last_became_peered":"2024-09-15T22:14:06.812032+0000","last_unstale":"2024-09-15T22:16:17.602972+0000","last_undegraded":"2024-09-15T22:16:17.602972+0000","last_fullsized":"2024-09-15T22:16:17.602972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:48.100213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.558099+0000","last_change":"2024-09-15T22:14:04.719678+0000","last_active":"2024-09-15T22:16:17.558099+0000","last_peered":"2024-09-15T22:16:17.558099+0000","last_clean":"2024-09-15T22:16:17.558099+0000","last_became_active":"2024-09-15T22:14:04.719352+0000","last_became_peered":"2024-09-15T22:14:04.719352+0000","last_unstale":"2024-09-15T22:16:17.558099+0000","last_undegraded":"2024-09-15T22:16:17.558099+0000","last_fullsized":"2024-09-15T22:16:17.558099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.061957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545734+0000","last_change":"2024-09-15T22:14:14.281314+0000","last_active":"2024-09-15T22:16:17.545734+0000","last_peered":"2024-09-15T22:16:17.545734+0000","last_clean":"2024-09-15T22:16:17.545734+0000","last_became_active":"2024-09-15T22:14:14.280859+0000","last_became_peered":"2024-09-15T22:14:14.280859+0000","last_unstale":"2024-09-15T22:16:17.545734+0000","last_undegraded":"2024-09-15T22:16:17.545734+0000","last_fullsized":"2024-09-15T22:16:17.545734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:18.796767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.592298+0000","last_change":"2024-09-15T22:15:17.211828+0000","last_active":"2024-09-15T22:16:17.592298+0000","last_peered":"2024-09-15T22:16:17.592298+0000","last_clean":"2024-09-15T22:16:17.592298+0000","last_became_active":"2024-09-15T22:15:17.211560+0000","last_became_peered":"2024-09-15T22:15:17.211560+0000","last_unstale":"2024-09-15T22:16:17.592298+0000","last_undegraded":"2024-09-15T22:16:17.592298+0000","last_fullsized":"2024-09-15T22:16:17.592298+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:59.944869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555126+0000","last_change":"2024-09-15T22:14:04.718038+0000","last_active":"2024-09-15T22:16:17.555126+0000","last_peered":"2024-09-15T22:16:17.555126+0000","last_clean":"2024-09-15T22:16:17.555126+0000","last_became_active":"2024-09-15T22:14:04.717683+0000","last_became_peered":"2024-09-15T22:14:04.717683+0000","last_unstale":"2024-09-15T22:16:17.555126+0000","last_undegraded":"2024-09-15T22:16:17.555126+0000","last_fullsized":"2024-09-15T22:16:17.555126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:23.557077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"90'148","reported_seq":404,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:19.690576+0000","last_change":"2024-09-15T22:12:55.022635+0000","last_active":"2024-09-15T22:16:19.690576+0000","last_peered":"2024-09-15T22:16:19.690576+0000","last_clean":"2024-09-15T22:16:19.690576+0000","last_became_active":"2024-09-15T22:12:55.022132+0000","last_became_peered":"2024-09-15T22:12:55.022132+0000","last_unstale":"2024-09-15T22:16:19.690576+0000","last_undegraded":"2024-09-15T22:16:19.690576+0000","last_fullsized":"2024-09-15T22:16:19.690576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_clean_scrub_stamp":"2024-09-15T22:09:30.115505+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:50.060169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.560414+0000","last_change":"2024-09-15T22:14:13.849547+0000","last_active":"2024-09-15T22:16:17.560414+0000","last_peered":"2024-09-15T22:16:17.560414+0000","last_clean":"2024-09-15T22:16:17.560414+0000","last_became_active":"2024-09-15T22:14:13.849091+0000","last_became_peered":"2024-09-15T22:14:13.849091+0000","last_unstale":"2024-09-15T22:16:17.560414+0000","last_undegraded":"2024-09-15T22:16:17.560414+0000","last_fullsized":"2024-09-15T22:16:17.560414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:49.450958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596732+0000","last_change":"2024-09-15T22:14:06.816340+0000","last_active":"2024-09-15T22:16:17.596732+0000","last_peered":"2024-09-15T22:16:17.596732+0000","last_clean":"2024-09-15T22:16:17.596732+0000","last_became_active":"2024-09-15T22:14:06.815712+0000","last_became_peered":"2024-09-15T22:14:06.815712+0000","last_unstale":"2024-09-15T22:16:17.596732+0000","last_undegraded":"2024-09-15T22:16:17.596732+0000","last_fullsized":"2024-09-15T22:16:17.596732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:43.598512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553284+0000","last_change":"2024-09-15T22:14:05.197487+0000","last_active":"2024-09-15T22:16:17.553284+0000","last_peered":"2024-09-15T22:16:17.553284+0000","last_clean":"2024-09-15T22:16:17.553284+0000","last_became_active":"2024-09-15T22:14:05.197098+0000","last_became_peered":"2024-09-15T22:14:05.197098+0000","last_unstale":"2024-09-15T22:16:17.553284+0000","last_undegraded":"2024-09-15T22:16:17.553284+0000","last_fullsized":"2024-09-15T22:16:17.553284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:31.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.542012+0000","last_change":"2024-09-15T22:14:13.849594+0000","last_active":"2024-09-15T22:16:17.542012+0000","last_peered":"2024-09-15T22:16:17.542012+0000","last_clean":"2024-09-15T22:16:17.542012+0000","last_became_active":"2024-09-15T22:14:13.849157+0000","last_became_peered":"2024-09-15T22:14:13.849157+0000","last_unstale":"2024-09-15T22:16:17.542012+0000","last_undegraded":"2024-09-15T22:16:17.542012+0000","last_fullsized":"2024-09-15T22:16:17.542012+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:49.994107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.594139+0000","last_change":"2024-09-15T22:14:06.814312+0000","last_active":"2024-09-15T22:16:17.594139+0000","last_peered":"2024-09-15T22:16:17.594139+0000","last_clean":"2024-09-15T22:16:17.594139+0000","last_became_active":"2024-09-15T22:14:06.813959+0000","last_became_peered":"2024-09-15T22:14:06.813959+0000","last_unstale":"2024-09-15T22:16:17.594139+0000","last_undegraded":"2024-09-15T22:16:17.594139+0000","last_fullsized":"2024-09-15T22:16:17.594139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:36.924162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'65","reported_seq":132,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:27.861728+0000","last_change":"2024-09-15T22:14:04.713307+0000","last_active":"2024-09-15T22:16:27.861728+0000","last_peered":"2024-09-15T22:16:27.861728+0000","last_clean":"2024-09-15T22:16:27.861728+0000","last_became_active":"2024-09-15T22:14:04.712996+0000","last_became_peered":"2024-09-15T22:14:04.712996+0000","last_unstale":"2024-09-15T22:16:27.861728+0000","last_undegraded":"2024-09-15T22:16:27.861728+0000","last_fullsized":"2024-09-15T22:16:27.861728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:37.298679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.563349+0000","last_change":"2024-09-15T22:14:13.846087+0000","last_active":"2024-09-15T22:16:17.563349+0000","last_peered":"2024-09-15T22:16:17.563349+0000","last_clean":"2024-09-15T22:16:17.563349+0000","last_became_active":"2024-09-15T22:14:13.845731+0000","last_became_peered":"2024-09-15T22:14:13.845731+0000","last_unstale":"2024-09-15T22:16:17.563349+0000","last_undegraded":"2024-09-15T22:16:17.563349+0000","last_fullsized":"2024-09-15T22:16:17.563349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:24.621330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.581459+0000","last_change":"2024-09-15T22:14:06.809456+0000","last_active":"2024-09-15T22:16:17.581459+0000","last_peered":"2024-09-15T22:16:17.581459+0000","last_clean":"2024-09-15T22:16:17.581459+0000","last_became_active":"2024-09-15T22:14:06.809141+0000","last_became_peered":"2024-09-15T22:14:06.809141+0000","last_unstale":"2024-09-15T22:16:17.581459+0000","last_undegraded":"2024-09-15T22:16:17.581459+0000","last_fullsized":"2024-09-15T22:16:17.581459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:30.186800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540944+0000","last_change":"2024-09-15T22:14:04.715399+0000","last_active":"2024-09-15T22:16:17.540944+0000","last_peered":"2024-09-15T22:16:17.540944+0000","last_clean":"2024-09-15T22:16:17.540944+0000","last_became_active":"2024-09-15T22:14:04.715043+0000","last_became_peered":"2024-09-15T22:14:04.715043+0000","last_unstale":"2024-09-15T22:16:17.540944+0000","last_undegraded":"2024-09-15T22:16:17.540944+0000","last_fullsized":"2024-09-15T22:16:17.540944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:13.860413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545046+0000","last_change":"2024-09-15T22:14:13.851594+0000","last_active":"2024-09-15T22:16:17.545046+0000","last_peered":"2024-09-15T22:16:17.545046+0000","last_clean":"2024-09-15T22:16:17.545046+0000","last_became_active":"2024-09-15T22:14:13.851154+0000","last_became_peered":"2024-09-15T22:14:13.851154+0000","last_unstale":"2024-09-15T22:16:17.545046+0000","last_undegraded":"2024-09-15T22:16:17.545046+0000","last_fullsized":"2024-09-15T22:16:17.545046+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:43.343808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579682+0000","last_change":"2024-09-15T22:15:17.219587+0000","last_active":"2024-09-15T22:16:17.579682+0000","last_peered":"2024-09-15T22:16:17.579682+0000","last_clean":"2024-09-15T22:16:17.579682+0000","last_became_active":"2024-09-15T22:15:17.219207+0000","last_became_peered":"2024-09-15T22:15:17.219207+0000","last_unstale":"2024-09-15T22:16:17.579682+0000","last_undegraded":"2024-09-15T22:16:17.579682+0000","last_fullsized":"2024-09-15T22:16:17.579682+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:34.267857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553979+0000","last_change":"2024-09-15T22:14:04.719550+0000","last_active":"2024-09-15T22:16:17.553979+0000","last_peered":"2024-09-15T22:16:17.553979+0000","last_clean":"2024-09-15T22:16:17.553979+0000","last_became_active":"2024-09-15T22:14:04.719273+0000","last_became_peered":"2024-09-15T22:14:04.719273+0000","last_unstale":"2024-09-15T22:16:17.553979+0000","last_undegraded":"2024-09-15T22:16:17.553979+0000","last_fullsized":"2024-09-15T22:16:17.553979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:20.973615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545214+0000","last_change":"2024-09-15T22:14:13.851420+0000","last_active":"2024-09-15T22:16:17.545214+0000","last_peered":"2024-09-15T22:16:17.545214+0000","last_clean":"2024-09-15T22:16:17.545214+0000","last_became_active":"2024-09-15T22:14:13.851051+0000","last_became_peered":"2024-09-15T22:14:13.851051+0000","last_unstale":"2024-09-15T22:16:17.545214+0000","last_undegraded":"2024-09-15T22:16:17.545214+0000","last_fullsized":"2024-09-15T22:16:17.545214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:11.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595588+0000","last_change":"2024-09-15T22:14:06.809609+0000","last_active":"2024-09-15T22:16:17.595588+0000","last_peered":"2024-09-15T22:16:17.595588+0000","last_clean":"2024-09-15T22:16:17.595588+0000","last_became_active":"2024-09-15T22:14:06.809213+0000","last_became_peered":"2024-09-15T22:14:06.809213+0000","last_unstale":"2024-09-15T22:16:17.595588+0000","last_undegraded":"2024-09-15T22:16:17.595588+0000","last_fullsized":"2024-09-15T22:16:17.595588+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:11.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553769+0000","last_change":"2024-09-15T22:14:05.017559+0000","last_active":"2024-09-15T22:16:17.553769+0000","last_peered":"2024-09-15T22:16:17.553769+0000","last_clean":"2024-09-15T22:16:17.553769+0000","last_became_active":"2024-09-15T22:14:05.017121+0000","last_became_peered":"2024-09-15T22:14:05.017121+0000","last_unstale":"2024-09-15T22:16:17.553769+0000","last_undegraded":"2024-09-15T22:16:17.553769+0000","last_fullsized":"2024-09-15T22:16:17.553769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:29:06.442532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540809+0000","last_change":"2024-09-15T22:14:13.847835+0000","last_active":"2024-09-15T22:16:17.540809+0000","last_peered":"2024-09-15T22:16:17.540809+0000","last_clean":"2024-09-15T22:16:17.540809+0000","last_became_active":"2024-09-15T22:14:13.847437+0000","last_became_peered":"2024-09-15T22:14:13.847437+0000","last_unstale":"2024-09-15T22:16:17.540809+0000","last_undegraded":"2024-09-15T22:16:17.540809+0000","last_fullsized":"2024-09-15T22:16:17.540809+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:48.036495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.586410+0000","last_change":"2024-09-15T22:14:06.813191+0000","last_active":"2024-09-15T22:16:17.586410+0000","last_peered":"2024-09-15T22:16:17.586410+0000","last_clean":"2024-09-15T22:16:17.586410+0000","last_became_active":"2024-09-15T22:14:06.812861+0000","last_became_peered":"2024-09-15T22:14:06.812861+0000","last_unstale":"2024-09-15T22:16:17.586410+0000","last_undegraded":"2024-09-15T22:16:17.586410+0000","last_fullsized":"2024-09-15T22:16:17.586410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:51.487591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554424+0000","last_change":"2024-09-15T22:14:04.718431+0000","last_active":"2024-09-15T22:16:17.554424+0000","last_peered":"2024-09-15T22:16:17.554424+0000","last_clean":"2024-09-15T22:16:17.554424+0000","last_became_active":"2024-09-15T22:14:04.718109+0000","last_became_peered":"2024-09-15T22:14:04.718109+0000","last_unstale":"2024-09-15T22:16:17.554424+0000","last_undegraded":"2024-09-15T22:16:17.554424+0000","last_fullsized":"2024-09-15T22:16:17.554424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:10.408634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557287+0000","last_change":"2024-09-15T22:14:13.845179+0000","last_active":"2024-09-15T22:16:17.557287+0000","last_peered":"2024-09-15T22:16:17.557287+0000","last_clean":"2024-09-15T22:16:17.557287+0000","last_became_active":"2024-09-15T22:14:13.844795+0000","last_became_peered":"2024-09-15T22:14:13.844795+0000","last_unstale":"2024-09-15T22:16:17.557287+0000","last_undegraded":"2024-09-15T22:16:17.557287+0000","last_fullsized":"2024-09-15T22:16:17.557287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:24.113536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602323+0000","last_change":"2024-09-15T22:14:06.809687+0000","last_active":"2024-09-15T22:16:17.602323+0000","last_peered":"2024-09-15T22:16:17.602323+0000","last_clean":"2024-09-15T22:16:17.602323+0000","last_became_active":"2024-09-15T22:14:06.809383+0000","last_became_peered":"2024-09-15T22:14:06.809383+0000","last_unstale":"2024-09-15T22:16:17.602323+0000","last_undegraded":"2024-09-15T22:16:17.602323+0000","last_fullsized":"2024-09-15T22:16:17.602323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:19.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545340+0000","last_change":"2024-09-15T22:14:04.720577+0000","last_active":"2024-09-15T22:16:17.545340+0000","last_peered":"2024-09-15T22:16:17.545340+0000","last_clean":"2024-09-15T22:16:17.545340+0000","last_became_active":"2024-09-15T22:14:04.720235+0000","last_became_peered":"2024-09-15T22:14:04.720235+0000","last_unstale":"2024-09-15T22:16:17.545340+0000","last_undegraded":"2024-09-15T22:16:17.545340+0000","last_fullsized":"2024-09-15T22:16:17.545340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:17.501061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.559191+0000","last_change":"2024-09-15T22:14:13.854841+0000","last_active":"2024-09-15T22:16:17.559191+0000","last_peered":"2024-09-15T22:16:17.559191+0000","last_clean":"2024-09-15T22:16:17.559191+0000","last_became_active":"2024-09-15T22:14:13.854336+0000","last_became_peered":"2024-09-15T22:14:13.854336+0000","last_unstale":"2024-09-15T22:16:17.559191+0000","last_undegraded":"2024-09-15T22:16:17.559191+0000","last_fullsized":"2024-09-15T22:16:17.559191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:13.819532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.600465+0000","last_change":"2024-09-15T22:14:06.806829+0000","last_active":"2024-09-15T22:16:17.600465+0000","last_peered":"2024-09-15T22:16:17.600465+0000","last_clean":"2024-09-15T22:16:17.600465+0000","last_became_active":"2024-09-15T22:14:06.806521+0000","last_became_peered":"2024-09-15T22:14:06.806521+0000","last_unstale":"2024-09-15T22:16:17.600465+0000","last_undegraded":"2024-09-15T22:16:17.600465+0000","last_fullsized":"2024-09-15T22:16:17.600465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:50.983246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552274+0000","last_change":"2024-09-15T22:14:04.717722+0000","last_active":"2024-09-15T22:16:17.552274+0000","last_peered":"2024-09-15T22:16:17.552274+0000","last_clean":"2024-09-15T22:16:17.552274+0000","last_became_active":"2024-09-15T22:14:04.717201+0000","last_became_peered":"2024-09-15T22:14:04.717201+0000","last_unstale":"2024-09-15T22:16:17.552274+0000","last_undegraded":"2024-09-15T22:16:17.552274+0000","last_fullsized":"2024-09-15T22:16:17.552274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:50.545847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545450+0000","last_change":"2024-09-15T22:14:13.852874+0000","last_active":"2024-09-15T22:16:17.545450+0000","last_peered":"2024-09-15T22:16:17.545450+0000","last_clean":"2024-09-15T22:16:17.545450+0000","last_became_active":"2024-09-15T22:14:13.852426+0000","last_became_peered":"2024-09-15T22:14:13.852426+0000","last_unstale":"2024-09-15T22:16:17.545450+0000","last_undegraded":"2024-09-15T22:16:17.545450+0000","last_fullsized":"2024-09-15T22:16:17.545450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:02:19.215156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579481+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:16:17.579481+0000","last_peered":"2024-09-15T22:16:17.579481+0000","last_clean":"2024-09-15T22:16:17.579481+0000","last_became_active":"2024-09-15T22:14:06.809013+0000","last_became_peered":"2024-09-15T22:14:06.809013+0000","last_unstale":"2024-09-15T22:16:17.579481+0000","last_undegraded":"2024-09-15T22:16:17.579481+0000","last_fullsized":"2024-09-15T22:16:17.579481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:47.830385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":296,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:28.101983+0000","last_change":"2024-09-15T22:14:04.721020+0000","last_active":"2024-09-15T22:16:28.101983+0000","last_peered":"2024-09-15T22:16:28.101983+0000","last_clean":"2024-09-15T22:16:28.101983+0000","last_became_active":"2024-09-15T22:14:04.720613+0000","last_became_peered":"2024-09-15T22:14:04.720613+0000","last_unstale":"2024-09-15T22:16:28.101983+0000","last_undegraded":"2024-09-15T22:16:28.101983+0000","last_fullsized":"2024-09-15T22:16:28.101983+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:42.719346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71847,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":221,"num_read_kb":182,"num_write":38,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555319+0000","last_change":"2024-09-15T22:14:13.854250+0000","last_active":"2024-09-15T22:16:17.555319+0000","last_peered":"2024-09-15T22:16:17.555319+0000","last_clean":"2024-09-15T22:16:17.555319+0000","last_became_active":"2024-09-15T22:14:13.852972+0000","last_became_peered":"2024-09-15T22:14:13.852972+0000","last_unstale":"2024-09-15T22:16:17.555319+0000","last_undegraded":"2024-09-15T22:16:17.555319+0000","last_fullsized":"2024-09-15T22:16:17.555319+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:50:45.301446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596123+0000","last_change":"2024-09-15T22:14:06.813789+0000","last_active":"2024-09-15T22:16:17.596123+0000","last_peered":"2024-09-15T22:16:17.596123+0000","last_clean":"2024-09-15T22:16:17.596123+0000","last_became_active":"2024-09-15T22:14:06.813501+0000","last_became_peered":"2024-09-15T22:14:06.813501+0000","last_unstale":"2024-09-15T22:16:17.596123+0000","last_undegraded":"2024-09-15T22:16:17.596123+0000","last_fullsized":"2024-09-15T22:16:17.596123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:40.032952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545628+0000","last_change":"2024-09-15T22:14:05.018957+0000","last_active":"2024-09-15T22:16:17.545628+0000","last_peered":"2024-09-15T22:16:17.545628+0000","last_clean":"2024-09-15T22:16:17.545628+0000","last_became_active":"2024-09-15T22:14:05.018602+0000","last_became_peered":"2024-09-15T22:14:05.018602+0000","last_unstale":"2024-09-15T22:16:17.545628+0000","last_undegraded":"2024-09-15T22:16:17.545628+0000","last_fullsized":"2024-09-15T22:16:17.545628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:48.839341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555029+0000","last_change":"2024-09-15T22:15:17.332417+0000","last_active":"2024-09-15T22:16:17.555029+0000","last_peered":"2024-09-15T22:16:17.555029+0000","last_clean":"2024-09-15T22:16:17.555029+0000","last_became_active":"2024-09-15T22:15:17.331771+0000","last_became_peered":"2024-09-15T22:15:17.331771+0000","last_unstale":"2024-09-15T22:16:17.555029+0000","last_undegraded":"2024-09-15T22:16:17.555029+0000","last_fullsized":"2024-09-15T22:16:17.555029+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:08.575035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603399+0000","last_change":"2024-09-15T22:14:06.814876+0000","last_active":"2024-09-15T22:16:17.603399+0000","last_peered":"2024-09-15T22:16:17.603399+0000","last_clean":"2024-09-15T22:16:17.603399+0000","last_became_active":"2024-09-15T22:14:06.814120+0000","last_became_peered":"2024-09-15T22:14:06.814120+0000","last_unstale":"2024-09-15T22:16:17.603399+0000","last_undegraded":"2024-09-15T22:16:17.603399+0000","last_fullsized":"2024-09-15T22:16:17.603399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:37.417618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555352+0000","last_change":"2024-09-15T22:14:04.719281+0000","last_active":"2024-09-15T22:16:17.555352+0000","last_peered":"2024-09-15T22:16:17.555352+0000","last_clean":"2024-09-15T22:16:17.555352+0000","last_became_active":"2024-09-15T22:14:04.718856+0000","last_became_peered":"2024-09-15T22:14:04.718856+0000","last_unstale":"2024-09-15T22:16:17.555352+0000","last_undegraded":"2024-09-15T22:16:17.555352+0000","last_fullsized":"2024-09-15T22:16:17.555352+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:22.137825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554629+0000","last_change":"2024-09-15T22:14:13.847398+0000","last_active":"2024-09-15T22:16:17.554629+0000","last_peered":"2024-09-15T22:16:17.554629+0000","last_clean":"2024-09-15T22:16:17.554629+0000","last_became_active":"2024-09-15T22:14:13.846870+0000","last_became_peered":"2024-09-15T22:14:13.846870+0000","last_unstale":"2024-09-15T22:16:17.554629+0000","last_undegraded":"2024-09-15T22:16:17.554629+0000","last_fullsized":"2024-09-15T22:16:17.554629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:58.872716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595875+0000","last_change":"2024-09-15T22:14:06.810412+0000","last_active":"2024-09-15T22:16:17.595875+0000","last_peered":"2024-09-15T22:16:17.595875+0000","last_clean":"2024-09-15T22:16:17.595875+0000","last_became_active":"2024-09-15T22:14:06.809669+0000","last_became_peered":"2024-09-15T22:14:06.809669+0000","last_unstale":"2024-09-15T22:16:17.595875+0000","last_undegraded":"2024-09-15T22:16:17.595875+0000","last_fullsized":"2024-09-15T22:16:17.595875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:44.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.549857+0000","last_change":"2024-09-15T22:14:04.715509+0000","last_active":"2024-09-15T22:16:17.549857+0000","last_peered":"2024-09-15T22:16:17.549857+0000","last_clean":"2024-09-15T22:16:17.549857+0000","last_became_active":"2024-09-15T22:14:04.715169+0000","last_became_peered":"2024-09-15T22:14:04.715169+0000","last_unstale":"2024-09-15T22:16:17.549857+0000","last_undegraded":"2024-09-15T22:16:17.549857+0000","last_fullsized":"2024-09-15T22:16:17.549857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:21.884103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554221+0000","last_change":"2024-09-15T22:15:17.219519+0000","last_active":"2024-09-15T22:16:17.554221+0000","last_peered":"2024-09-15T22:16:17.554221+0000","last_clean":"2024-09-15T22:16:17.554221+0000","last_became_active":"2024-09-15T22:15:17.219106+0000","last_became_peered":"2024-09-15T22:15:17.219106+0000","last_unstale":"2024-09-15T22:16:17.554221+0000","last_undegraded":"2024-09-15T22:16:17.554221+0000","last_fullsized":"2024-09-15T22:16:17.554221+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:54:08.102329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.562557+0000","last_change":"2024-09-15T22:14:13.844375+0000","last_active":"2024-09-15T22:16:17.562557+0000","last_peered":"2024-09-15T22:16:17.562557+0000","last_clean":"2024-09-15T22:16:17.562557+0000","last_became_active":"2024-09-15T22:14:13.843918+0000","last_became_peered":"2024-09-15T22:14:13.843918+0000","last_unstale":"2024-09-15T22:16:17.562557+0000","last_undegraded":"2024-09-15T22:16:17.562557+0000","last_fullsized":"2024-09-15T22:16:17.562557+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:32.190119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606349+0000","last_change":"2024-09-15T22:14:06.809534+0000","last_active":"2024-09-15T22:16:17.606349+0000","last_peered":"2024-09-15T22:16:17.606349+0000","last_clean":"2024-09-15T22:16:17.606349+0000","last_became_active":"2024-09-15T22:14:06.809147+0000","last_became_peered":"2024-09-15T22:14:06.809147+0000","last_unstale":"2024-09-15T22:16:17.606349+0000","last_undegraded":"2024-09-15T22:16:17.606349+0000","last_fullsized":"2024-09-15T22:16:17.606349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:14.930542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545382+0000","last_change":"2024-09-15T22:14:04.715347+0000","last_active":"2024-09-15T22:16:17.545382+0000","last_peered":"2024-09-15T22:16:17.545382+0000","last_clean":"2024-09-15T22:16:17.545382+0000","last_became_active":"2024-09-15T22:14:04.715049+0000","last_became_peered":"2024-09-15T22:14:04.715049+0000","last_unstale":"2024-09-15T22:16:17.545382+0000","last_undegraded":"2024-09-15T22:16:17.545382+0000","last_fullsized":"2024-09-15T22:16:17.545382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:04.943344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.567570+0000","last_change":"2024-09-15T22:14:13.852397+0000","last_active":"2024-09-15T22:16:17.567570+0000","last_peered":"2024-09-15T22:16:17.567570+0000","last_clean":"2024-09-15T22:16:17.567570+0000","last_became_active":"2024-09-15T22:14:13.851863+0000","last_became_peered":"2024-09-15T22:14:13.851863+0000","last_unstale":"2024-09-15T22:16:17.567570+0000","last_undegraded":"2024-09-15T22:16:17.567570+0000","last_fullsized":"2024-09-15T22:16:17.567570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:38.242241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606188+0000","last_change":"2024-09-15T22:14:06.809084+0000","last_active":"2024-09-15T22:16:17.606188+0000","last_peered":"2024-09-15T22:16:17.606188+0000","last_clean":"2024-09-15T22:16:17.606188+0000","last_became_active":"2024-09-15T22:14:06.808725+0000","last_became_peered":"2024-09-15T22:14:06.808725+0000","last_unstale":"2024-09-15T22:16:17.606188+0000","last_undegraded":"2024-09-15T22:16:17.606188+0000","last_fullsized":"2024-09-15T22:16:17.606188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:37.451661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540329+0000","last_change":"2024-09-15T22:14:04.714279+0000","last_active":"2024-09-15T22:16:17.540329+0000","last_peered":"2024-09-15T22:16:17.540329+0000","last_clean":"2024-09-15T22:16:17.540329+0000","last_became_active":"2024-09-15T22:14:04.713751+0000","last_became_peered":"2024-09-15T22:14:04.713751+0000","last_unstale":"2024-09-15T22:16:17.540329+0000","last_undegraded":"2024-09-15T22:16:17.540329+0000","last_fullsized":"2024-09-15T22:16:17.540329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:34.268701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.549598+0000","last_change":"2024-09-15T22:14:04.716417+0000","last_active":"2024-09-15T22:16:17.549598+0000","last_peered":"2024-09-15T22:16:17.549598+0000","last_clean":"2024-09-15T22:16:17.549598+0000","last_became_active":"2024-09-15T22:14:04.716096+0000","last_became_peered":"2024-09-15T22:14:04.716096+0000","last_unstale":"2024-09-15T22:16:17.549598+0000","last_undegraded":"2024-09-15T22:16:17.549598+0000","last_fullsized":"2024-09-15T22:16:17.549598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:30.819060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601287+0000","last_change":"2024-09-15T22:15:17.403940+0000","last_active":"2024-09-15T22:16:17.601287+0000","last_peered":"2024-09-15T22:16:17.601287+0000","last_clean":"2024-09-15T22:16:17.601287+0000","last_became_active":"2024-09-15T22:15:17.403517+0000","last_became_peered":"2024-09-15T22:15:17.403517+0000","last_unstale":"2024-09-15T22:16:17.601287+0000","last_undegraded":"2024-09-15T22:16:17.601287+0000","last_fullsized":"2024-09-15T22:16:17.601287+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:49.602367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552004+0000","last_change":"2024-09-15T22:15:17.404136+0000","last_active":"2024-09-15T22:16:17.552004+0000","last_peered":"2024-09-15T22:16:17.552004+0000","last_clean":"2024-09-15T22:16:17.552004+0000","last_became_active":"2024-09-15T22:15:17.403652+0000","last_became_peered":"2024-09-15T22:15:17.403652+0000","last_unstale":"2024-09-15T22:16:17.552004+0000","last_undegraded":"2024-09-15T22:16:17.552004+0000","last_fullsized":"2024-09-15T22:16:17.552004+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:31.518956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545473+0000","last_change":"2024-09-15T22:14:04.718682+0000","last_active":"2024-09-15T22:16:17.545473+0000","last_peered":"2024-09-15T22:16:17.545473+0000","last_clean":"2024-09-15T22:16:17.545473+0000","last_became_active":"2024-09-15T22:14:04.718313+0000","last_became_peered":"2024-09-15T22:14:04.718313+0000","last_unstale":"2024-09-15T22:16:17.545473+0000","last_undegraded":"2024-09-15T22:16:17.545473+0000","last_fullsized":"2024-09-15T22:16:17.545473+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:47.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595742+0000","last_change":"2024-09-15T22:14:06.819632+0000","last_active":"2024-09-15T22:16:17.595742+0000","last_peered":"2024-09-15T22:16:17.595742+0000","last_clean":"2024-09-15T22:16:17.595742+0000","last_became_active":"2024-09-15T22:14:06.819135+0000","last_became_peered":"2024-09-15T22:14:06.819135+0000","last_unstale":"2024-09-15T22:16:17.595742+0000","last_undegraded":"2024-09-15T22:16:17.595742+0000","last_fullsized":"2024-09-15T22:16:17.595742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:35.708318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552345+0000","last_change":"2024-09-15T22:14:13.851367+0000","last_active":"2024-09-15T22:16:17.552345+0000","last_peered":"2024-09-15T22:16:17.552345+0000","last_clean":"2024-09-15T22:16:17.552345+0000","last_became_active":"2024-09-15T22:14:13.850999+0000","last_became_peered":"2024-09-15T22:14:13.850999+0000","last_unstale":"2024-09-15T22:16:17.552345+0000","last_undegraded":"2024-09-15T22:16:17.552345+0000","last_fullsized":"2024-09-15T22:16:17.552345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:40:03.957622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582014+0000","last_change":"2024-09-15T22:14:06.817213+0000","last_active":"2024-09-15T22:16:17.582014+0000","last_peered":"2024-09-15T22:16:17.582014+0000","last_clean":"2024-09-15T22:16:17.582014+0000","last_became_active":"2024-09-15T22:14:06.816828+0000","last_became_peered":"2024-09-15T22:14:06.816828+0000","last_unstale":"2024-09-15T22:16:17.582014+0000","last_undegraded":"2024-09-15T22:16:17.582014+0000","last_fullsized":"2024-09-15T22:16:17.582014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:55.042256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.590899+0000","last_change":"2024-09-15T22:14:06.814832+0000","last_active":"2024-09-15T22:16:17.590899+0000","last_peered":"2024-09-15T22:16:17.590899+0000","last_clean":"2024-09-15T22:16:17.590899+0000","last_became_active":"2024-09-15T22:14:06.814500+0000","last_became_peered":"2024-09-15T22:14:06.814500+0000","last_unstale":"2024-09-15T22:16:17.590899+0000","last_undegraded":"2024-09-15T22:16:17.590899+0000","last_fullsized":"2024-09-15T22:16:17.590899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:43.623629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603884+0000","last_change":"2024-09-15T22:14:06.809464+0000","last_active":"2024-09-15T22:16:17.603884+0000","last_peered":"2024-09-15T22:16:17.603884+0000","last_clean":"2024-09-15T22:16:17.603884+0000","last_became_active":"2024-09-15T22:14:06.809160+0000","last_became_peered":"2024-09-15T22:14:06.809160+0000","last_unstale":"2024-09-15T22:16:17.603884+0000","last_undegraded":"2024-09-15T22:16:17.603884+0000","last_fullsized":"2024-09-15T22:16:17.603884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:04.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606874+0000","last_change":"2024-09-15T22:14:06.814428+0000","last_active":"2024-09-15T22:16:17.606874+0000","last_peered":"2024-09-15T22:16:17.606874+0000","last_clean":"2024-09-15T22:16:17.606874+0000","last_became_active":"2024-09-15T22:14:06.814100+0000","last_became_peered":"2024-09-15T22:14:06.814100+0000","last_unstale":"2024-09-15T22:16:17.606874+0000","last_undegraded":"2024-09-15T22:16:17.606874+0000","last_fullsized":"2024-09-15T22:16:17.606874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:33.606766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606907+0000","last_change":"2024-09-15T22:14:06.815638+0000","last_active":"2024-09-15T22:16:17.606907+0000","last_peered":"2024-09-15T22:16:17.606907+0000","last_clean":"2024-09-15T22:16:17.606907+0000","last_became_active":"2024-09-15T22:14:06.815327+0000","last_became_peered":"2024-09-15T22:14:06.815327+0000","last_unstale":"2024-09-15T22:16:17.606907+0000","last_undegraded":"2024-09-15T22:16:17.606907+0000","last_fullsized":"2024-09-15T22:16:17.606907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:07.679547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.580925+0000","last_change":"2024-09-15T22:15:17.218238+0000","last_active":"2024-09-15T22:16:17.580925+0000","last_peered":"2024-09-15T22:16:17.580925+0000","last_clean":"2024-09-15T22:16:17.580925+0000","last_became_active":"2024-09-15T22:15:17.217852+0000","last_became_peered":"2024-09-15T22:15:17.217852+0000","last_unstale":"2024-09-15T22:16:17.580925+0000","last_undegraded":"2024-09-15T22:16:17.580925+0000","last_fullsized":"2024-09-15T22:16:17.580925+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:42.046956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.576752+0000","last_change":"2024-09-15T22:14:06.819667+0000","last_active":"2024-09-15T22:16:17.576752+0000","last_peered":"2024-09-15T22:16:17.576752+0000","last_clean":"2024-09-15T22:16:17.576752+0000","last_became_active":"2024-09-15T22:14:06.819389+0000","last_became_peered":"2024-09-15T22:14:06.819389+0000","last_unstale":"2024-09-15T22:16:17.576752+0000","last_undegraded":"2024-09-15T22:16:17.576752+0000","last_fullsized":"2024-09-15T22:16:17.576752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:16.571088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.597582+0000","last_change":"2024-09-15T22:15:17.118133+0000","last_active":"2024-09-15T22:16:17.597582+0000","last_peered":"2024-09-15T22:16:17.597582+0000","last_clean":"2024-09-15T22:16:17.597582+0000","last_became_active":"2024-09-15T22:15:17.117802+0000","last_became_peered":"2024-09-15T22:15:17.117802+0000","last_unstale":"2024-09-15T22:16:17.597582+0000","last_undegraded":"2024-09-15T22:16:17.597582+0000","last_fullsized":"2024-09-15T22:16:17.597582+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:21.523149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.600039+0000","last_change":"2024-09-15T22:14:06.801454+0000","last_active":"2024-09-15T22:16:17.600039+0000","last_peered":"2024-09-15T22:16:17.600039+0000","last_clean":"2024-09-15T22:16:17.600039+0000","last_became_active":"2024-09-15T22:14:06.801105+0000","last_became_peered":"2024-09-15T22:14:06.801105+0000","last_unstale":"2024-09-15T22:16:17.600039+0000","last_undegraded":"2024-09-15T22:16:17.600039+0000","last_fullsized":"2024-09-15T22:16:17.600039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:32.457428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596301+0000","last_change":"2024-09-15T22:14:06.812603+0000","last_active":"2024-09-15T22:16:17.596301+0000","last_peered":"2024-09-15T22:16:17.596301+0000","last_clean":"2024-09-15T22:16:17.596301+0000","last_became_active":"2024-09-15T22:14:06.812208+0000","last_became_peered":"2024-09-15T22:14:06.812208+0000","last_unstale":"2024-09-15T22:16:17.596301+0000","last_undegraded":"2024-09-15T22:16:17.596301+0000","last_fullsized":"2024-09-15T22:16:17.596301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:55.327481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595802+0000","last_change":"2024-09-15T22:14:06.811783+0000","last_active":"2024-09-15T22:16:17.595802+0000","last_peered":"2024-09-15T22:16:17.595802+0000","last_clean":"2024-09-15T22:16:17.595802+0000","last_became_active":"2024-09-15T22:14:06.811208+0000","last_became_peered":"2024-09-15T22:14:06.811208+0000","last_unstale":"2024-09-15T22:16:17.595802+0000","last_undegraded":"2024-09-15T22:16:17.595802+0000","last_fullsized":"2024-09-15T22:16:17.595802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:15.576776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.607074+0000","last_change":"2024-09-15T22:14:06.818608+0000","last_active":"2024-09-15T22:16:17.607074+0000","last_peered":"2024-09-15T22:16:17.607074+0000","last_clean":"2024-09-15T22:16:17.607074+0000","last_became_active":"2024-09-15T22:14:06.818283+0000","last_became_peered":"2024-09-15T22:14:06.818283+0000","last_unstale":"2024-09-15T22:16:17.607074+0000","last_undegraded":"2024-09-15T22:16:17.607074+0000","last_fullsized":"2024-09-15T22:16:17.607074+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:02.477461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.593536+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:16:17.593536+0000","last_peered":"2024-09-15T22:16:17.593536+0000","last_clean":"2024-09-15T22:16:17.593536+0000","last_became_active":"2024-09-15T22:14:06.809043+0000","last_became_peered":"2024-09-15T22:14:06.809043+0000","last_unstale":"2024-09-15T22:16:17.593536+0000","last_undegraded":"2024-09-15T22:16:17.593536+0000","last_fullsized":"2024-09-15T22:16:17.593536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:58.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598619+0000","last_change":"2024-09-15T22:14:06.814875+0000","last_active":"2024-09-15T22:16:17.598619+0000","last_peered":"2024-09-15T22:16:17.598619+0000","last_clean":"2024-09-15T22:16:17.598619+0000","last_became_active":"2024-09-15T22:14:06.814543+0000","last_became_peered":"2024-09-15T22:14:06.814543+0000","last_unstale":"2024-09-15T22:16:17.598619+0000","last_undegraded":"2024-09-15T22:16:17.598619+0000","last_fullsized":"2024-09-15T22:16:17.598619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:57.465965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595163+0000","last_change":"2024-09-15T22:14:06.810655+0000","last_active":"2024-09-15T22:16:17.595163+0000","last_peered":"2024-09-15T22:16:17.595163+0000","last_clean":"2024-09-15T22:16:17.595163+0000","last_became_active":"2024-09-15T22:14:06.810159+0000","last_became_peered":"2024-09-15T22:14:06.810159+0000","last_unstale":"2024-09-15T22:16:17.595163+0000","last_undegraded":"2024-09-15T22:16:17.595163+0000","last_fullsized":"2024-09-15T22:16:17.595163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:17.368982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604239+0000","last_change":"2024-09-15T22:14:06.815048+0000","last_active":"2024-09-15T22:16:17.604239+0000","last_peered":"2024-09-15T22:16:17.604239+0000","last_clean":"2024-09-15T22:16:17.604239+0000","last_became_active":"2024-09-15T22:14:06.814744+0000","last_became_peered":"2024-09-15T22:14:06.814744+0000","last_unstale":"2024-09-15T22:16:17.604239+0000","last_undegraded":"2024-09-15T22:16:17.604239+0000","last_fullsized":"2024-09-15T22:16:17.604239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:26.927942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606940+0000","last_change":"2024-09-15T22:14:06.811672+0000","last_active":"2024-09-15T22:16:17.606940+0000","last_peered":"2024-09-15T22:16:17.606940+0000","last_clean":"2024-09-15T22:16:17.606940+0000","last_became_active":"2024-09-15T22:14:06.811300+0000","last_became_peered":"2024-09-15T22:14:06.811300+0000","last_unstale":"2024-09-15T22:16:17.606940+0000","last_undegraded":"2024-09-15T22:16:17.606940+0000","last_fullsized":"2024-09-15T22:16:17.606940+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:46.223584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603117+0000","last_change":"2024-09-15T22:14:06.814495+0000","last_active":"2024-09-15T22:16:17.603117+0000","last_peered":"2024-09-15T22:16:17.603117+0000","last_clean":"2024-09-15T22:16:17.603117+0000","last_became_active":"2024-09-15T22:14:06.814142+0000","last_became_peered":"2024-09-15T22:14:06.814142+0000","last_unstale":"2024-09-15T22:16:17.603117+0000","last_undegraded":"2024-09-15T22:16:17.603117+0000","last_fullsized":"2024-09-15T22:16:17.603117+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:20.374348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606333+0000","last_change":"2024-09-15T22:14:06.811063+0000","last_active":"2024-09-15T22:16:17.606333+0000","last_peered":"2024-09-15T22:16:17.606333+0000","last_clean":"2024-09-15T22:16:17.606333+0000","last_became_active":"2024-09-15T22:14:06.810700+0000","last_became_peered":"2024-09-15T22:14:06.810700+0000","last_unstale":"2024-09-15T22:16:17.606333+0000","last_undegraded":"2024-09-15T22:16:17.606333+0000","last_fullsized":"2024-09-15T22:16:17.606333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:11.250590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605660+0000","last_change":"2024-09-15T22:14:06.816896+0000","last_active":"2024-09-15T22:16:17.605660+0000","last_peered":"2024-09-15T22:16:17.605660+0000","last_clean":"2024-09-15T22:16:17.605660+0000","last_became_active":"2024-09-15T22:14:06.816559+0000","last_became_peered":"2024-09-15T22:14:06.816559+0000","last_unstale":"2024-09-15T22:16:17.605660+0000","last_undegraded":"2024-09-15T22:16:17.605660+0000","last_fullsized":"2024-09-15T22:16:17.605660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:17.965490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.592573+0000","last_change":"2024-09-15T22:14:06.813984+0000","last_active":"2024-09-15T22:16:17.592573+0000","last_peered":"2024-09-15T22:16:17.592573+0000","last_clean":"2024-09-15T22:16:17.592573+0000","last_became_active":"2024-09-15T22:14:06.813586+0000","last_became_peered":"2024-09-15T22:14:06.813586+0000","last_unstale":"2024-09-15T22:16:17.592573+0000","last_undegraded":"2024-09-15T22:16:17.592573+0000","last_fullsized":"2024-09-15T22:16:17.592573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:34.335741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596558+0000","last_change":"2024-09-15T22:14:06.816047+0000","last_active":"2024-09-15T22:16:17.596558+0000","last_peered":"2024-09-15T22:16:17.596558+0000","last_clean":"2024-09-15T22:16:17.596558+0000","last_became_active":"2024-09-15T22:14:06.815244+0000","last_became_peered":"2024-09-15T22:14:06.815244+0000","last_unstale":"2024-09-15T22:16:17.596558+0000","last_undegraded":"2024-09-15T22:16:17.596558+0000","last_fullsized":"2024-09-15T22:16:17.596558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:30.469382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.583325+0000","last_change":"2024-09-15T22:14:06.813254+0000","last_active":"2024-09-15T22:16:17.583325+0000","last_peered":"2024-09-15T22:16:17.583325+0000","last_clean":"2024-09-15T22:16:17.583325+0000","last_became_active":"2024-09-15T22:14:06.812921+0000","last_became_peered":"2024-09-15T22:14:06.812921+0000","last_unstale":"2024-09-15T22:16:17.583325+0000","last_undegraded":"2024-09-15T22:16:17.583325+0000","last_fullsized":"2024-09-15T22:16:17.583325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:40.674246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595905+0000","last_change":"2024-09-15T22:14:06.817016+0000","last_active":"2024-09-15T22:16:17.595905+0000","last_peered":"2024-09-15T22:16:17.595905+0000","last_clean":"2024-09-15T22:16:17.595905+0000","last_became_active":"2024-09-15T22:14:06.816256+0000","last_became_peered":"2024-09-15T22:14:06.816256+0000","last_unstale":"2024-09-15T22:16:17.595905+0000","last_undegraded":"2024-09-15T22:16:17.595905+0000","last_fullsized":"2024-09-15T22:16:17.595905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:37.092156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.585070+0000","last_change":"2024-09-15T22:15:17.331108+0000","last_active":"2024-09-15T22:16:17.585070+0000","last_peered":"2024-09-15T22:16:17.585070+0000","last_clean":"2024-09-15T22:16:17.585070+0000","last_became_active":"2024-09-15T22:15:17.330765+0000","last_became_peered":"2024-09-15T22:15:17.330765+0000","last_unstale":"2024-09-15T22:16:17.585070+0000","last_undegraded":"2024-09-15T22:16:17.585070+0000","last_fullsized":"2024-09-15T22:16:17.585070+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:37.975326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582652+0000","last_change":"2024-09-15T22:14:06.814902+0000","last_active":"2024-09-15T22:16:17.582652+0000","last_peered":"2024-09-15T22:16:17.582652+0000","last_clean":"2024-09-15T22:16:17.582652+0000","last_became_active":"2024-09-15T22:14:06.814563+0000","last_became_peered":"2024-09-15T22:14:06.814563+0000","last_unstale":"2024-09-15T22:16:17.582652+0000","last_undegraded":"2024-09-15T22:16:17.582652+0000","last_fullsized":"2024-09-15T22:16:17.582652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:02.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.580466+0000","last_change":"2024-09-15T22:14:06.807444+0000","last_active":"2024-09-15T22:16:17.580466+0000","last_peered":"2024-09-15T22:16:17.580466+0000","last_clean":"2024-09-15T22:16:17.580466+0000","last_became_active":"2024-09-15T22:14:06.807083+0000","last_became_peered":"2024-09-15T22:14:06.807083+0000","last_unstale":"2024-09-15T22:16:17.580466+0000","last_undegraded":"2024-09-15T22:16:17.580466+0000","last_fullsized":"2024-09-15T22:16:17.580466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:07.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598596+0000","last_change":"2024-09-15T22:14:06.811851+0000","last_active":"2024-09-15T22:16:17.598596+0000","last_peered":"2024-09-15T22:16:17.598596+0000","last_clean":"2024-09-15T22:16:17.598596+0000","last_became_active":"2024-09-15T22:14:06.811451+0000","last_became_peered":"2024-09-15T22:14:06.811451+0000","last_unstale":"2024-09-15T22:16:17.598596+0000","last_undegraded":"2024-09-15T22:16:17.598596+0000","last_fullsized":"2024-09-15T22:16:17.598596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:51.389555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.589842+0000","last_change":"2024-09-15T22:14:06.812520+0000","last_active":"2024-09-15T22:16:17.589842+0000","last_peered":"2024-09-15T22:16:17.589842+0000","last_clean":"2024-09-15T22:16:17.589842+0000","last_became_active":"2024-09-15T22:14:06.812222+0000","last_became_peered":"2024-09-15T22:14:06.812222+0000","last_unstale":"2024-09-15T22:16:17.589842+0000","last_undegraded":"2024-09-15T22:16:17.589842+0000","last_fullsized":"2024-09-15T22:16:17.589842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:01.589678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604461+0000","last_change":"2024-09-15T22:14:06.808649+0000","last_active":"2024-09-15T22:16:17.604461+0000","last_peered":"2024-09-15T22:16:17.604461+0000","last_clean":"2024-09-15T22:16:17.604461+0000","last_became_active":"2024-09-15T22:14:06.808278+0000","last_became_peered":"2024-09-15T22:14:06.808278+0000","last_unstale":"2024-09-15T22:16:17.604461+0000","last_undegraded":"2024-09-15T22:16:17.604461+0000","last_fullsized":"2024-09-15T22:16:17.604461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:32.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605104+0000","last_change":"2024-09-15T22:14:06.811593+0000","last_active":"2024-09-15T22:16:17.605104+0000","last_peered":"2024-09-15T22:16:17.605104+0000","last_clean":"2024-09-15T22:16:17.605104+0000","last_became_active":"2024-09-15T22:14:06.811285+0000","last_became_peered":"2024-09-15T22:14:06.811285+0000","last_unstale":"2024-09-15T22:16:17.605104+0000","last_undegraded":"2024-09-15T22:16:17.605104+0000","last_fullsized":"2024-09-15T22:16:17.605104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:36.482554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604430+0000","last_change":"2024-09-15T22:14:06.816084+0000","last_active":"2024-09-15T22:16:17.604430+0000","last_peered":"2024-09-15T22:16:17.604430+0000","last_clean":"2024-09-15T22:16:17.604430+0000","last_became_active":"2024-09-15T22:14:06.815461+0000","last_became_peered":"2024-09-15T22:14:06.815461+0000","last_unstale":"2024-09-15T22:16:17.604430+0000","last_undegraded":"2024-09-15T22:16:17.604430+0000","last_fullsized":"2024-09-15T22:16:17.604430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:57.455608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":794093,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":562,"num_read_kb":488,"num_write":330,"num_write_kb":2328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2482176,"data_stored":2382279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547242,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1028096,"data_stored":511054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776174,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29140,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716012,"statfs":{"total":95995035648,"available":95965196288,"internally_reserved":0,"allocated":2043904,"data_stored":1497599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939699,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36740,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708412,"statfs":{"total":95995035648,"available":95957413888,"internally_reserved":0,"allocated":1429504,"data_stored":908948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168633,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36740,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708412,"statfs":{"total":95995035648,"available":95957413888,"internally_reserved":0,"allocated":1429504,"data_stored":904874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430269,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1630208,"data_stored":1106100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593795,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1024000,"data_stored":506958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822728,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37384,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707768,"statfs":{"total":95995035648,"available":95956754432,"internally_reserved":0,"allocated":1966080,"data_stored":1429836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986252,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1032192,"data_stored":511076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215186,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28860,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716292,"statfs":{"total":95995035648,"available":95965483008,"internally_reserved":0,"allocated":1757184,"data_stored":1228510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1110016,"data_stored":578839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1105920,"data_stored":578805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40512,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704640,"statfs":{"total":95995035648,"available":95953551360,"internally_reserved":0,"allocated":1028096,"data_stored":507048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":733184,"data_stored":721552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":328414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":393820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":400273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:16:30.845 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:16:31.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.066+0000 7f1e28c5b640 1 -- 172.21.15.45:0/396909749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e24102570 msgr2=0x7f1e241029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:31.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.066+0000 7f1e28c5b640 1 --2- 172.21.15.45:0/396909749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e24102570 0x7f1e241029b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1e18009900 tx=0x7f1e1802a480 comp rx=0 tx=0).stop 2024-09-15T22:16:31.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.067+0000 7f1e28c5b640 1 -- 172.21.15.45:0/396909749 shutdown_connections 2024-09-15T22:16:31.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.067+0000 7f1e28c5b640 1 --2- 172.21.15.45:0/396909749 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e24102ef0 0x7f1e2410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:31.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.067+0000 7f1e28c5b640 1 --2- 172.21.15.45:0/396909749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e24102570 0x7f1e241029b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:31.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.067+0000 7f1e28c5b640 1 --2- 172.21.15.45:0/396909749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e24100e20 0x7f1e24101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:31.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.067+0000 7f1e28c5b640 1 -- 172.21.15.45:0/396909749 >> 172.21.15.45:0/396909749 conn(0x7f1e240fc7d0 msgr2=0x7f1e240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:31.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.067+0000 7f1e28c5b640 1 -- 172.21.15.45:0/396909749 shutdown_connections 2024-09-15T22:16:31.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.067+0000 7f1e28c5b640 1 -- 172.21.15.45:0/396909749 wait complete. 2024-09-15T22:16:31.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.068+0000 7f1e28c5b640 1 Processor -- start 2024-09-15T22:16:31.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.068+0000 7f1e28c5b640 1 -- start start 2024-09-15T22:16:31.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.068+0000 7f1e28c5b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e24100e20 0x7f1e241994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:31.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.068+0000 7f1e28c5b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e24102570 0x7f1e24199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:31.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.068+0000 7f1e28c5b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e24102ef0 0x7f1e241a4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:31.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.068+0000 7f1e28c5b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1e241110a0 con 0x7f1e24102570 2024-09-15T22:16:31.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.068+0000 7f1e28c5b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e24110f20 con 0x7f1e24102ef0 2024-09-15T22:16:31.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.068+0000 7f1e28c5b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1e24111220 con 0x7f1e24100e20 2024-09-15T22:16:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.068+0000 7f1e21d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e24102570 0x7f1e24199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.068+0000 7f1e21d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e24102570 0x7f1e24199a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34826/0 (socket says 172.21.15.45:34826) 2024-09-15T22:16:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.068+0000 7f1e21d9b640 1 -- 172.21.15.45:0/2666880132 learned_addr learned my addr 172.21.15.45:0/2666880132 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.068+0000 7f1e22d9d640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e24102ef0 0x7f1e241a4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.068+0000 7f1e2259c640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e24100e20 0x7f1e241994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.069+0000 7f1e21d9b640 1 -- 172.21.15.45:0/2666880132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e24100e20 msgr2=0x7f1e241994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.069+0000 7f1e21d9b640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e24100e20 0x7f1e241994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.069+0000 7f1e21d9b640 1 -- 172.21.15.45:0/2666880132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e24102ef0 msgr2=0x7f1e241a4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.069+0000 7f1e21d9b640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e24102ef0 0x7f1e241a4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.069+0000 7f1e21d9b640 1 -- 172.21.15.45:0/2666880132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e241a4a90 con 0x7f1e24102570 2024-09-15T22:16:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.069+0000 7f1e2259c640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e24100e20 0x7f1e241994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.069+0000 7f1e21d9b640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e24102570 0x7f1e24199a10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1e18006010 tx=0x7f1e18004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:31.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.069+0000 7f1e137fe640 1 -- 172.21.15.45:0/2666880132 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1803f030 con 0x7f1e24102570 2024-09-15T22:16:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.069+0000 7f1e28c5b640 1 -- 172.21.15.45:0/2666880132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e241a4c60 con 0x7f1e24102570 2024-09-15T22:16:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.069+0000 7f1e137fe640 1 -- 172.21.15.45:0/2666880132 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1e18005500 con 0x7f1e24102570 2024-09-15T22:16:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.069+0000 7f1e137fe640 1 -- 172.21.15.45:0/2666880132 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18035070 con 0x7f1e24102570 2024-09-15T22:16:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.069+0000 7f1e28c5b640 1 -- 172.21.15.45:0/2666880132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e241a5110 con 0x7f1e24102570 2024-09-15T22:16:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.070+0000 7f1e28c5b640 1 -- 172.21.15.45:0/2666880132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e24101200 con 0x7f1e24102570 2024-09-15T22:16:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.071+0000 7f1e137fe640 1 -- 172.21.15.45:0/2666880132 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f1e18042030 con 0x7f1e24102570 2024-09-15T22:16:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.072+0000 7f1e137fe640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1e0c0a34c0 0x7f1e0c0a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.072+0000 7f1e2259c640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1e0c0a34c0 0x7f1e0c0a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.072+0000 7f1e137fe640 1 -- 172.21.15.45:0/2666880132 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f1e180f06a0 con 0x7f1e24102570 2024-09-15T22:16:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.073+0000 7f1e2259c640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1e0c0a34c0 0x7f1e0c0a5980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1e14005fd0 tx=0x7f1e14009520 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.077+0000 7f1e137fe640 1 -- 172.21.15.45:0/2666880132 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1e180bcba0 con 0x7f1e24102570 2024-09-15T22:16:31.140 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:31.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.295+0000 7f1e28c5b640 1 -- 172.21.15.45:0/2666880132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e24109090 con 0x7f1e24102570 2024-09-15T22:16:31.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.296+0000 7f1e137fe640 1 -- 172.21.15.45:0/2666880132 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f1e180bc4a0 con 0x7f1e24102570 2024-09-15T22:16:31.298 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:31.298 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:16:31.298 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:16:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.298+0000 7f1e28c5b640 1 -- 172.21.15.45:0/2666880132 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1e0c0a34c0 msgr2=0x7f1e0c0a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.299+0000 7f1e28c5b640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1e0c0a34c0 0x7f1e0c0a5980 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1e14005fd0 tx=0x7f1e14009520 comp rx=0 tx=0).stop 2024-09-15T22:16:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.299+0000 7f1e28c5b640 1 -- 172.21.15.45:0/2666880132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e24102570 msgr2=0x7f1e24199a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.299+0000 7f1e28c5b640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e24102570 0x7f1e24199a10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1e18006010 tx=0x7f1e18004c00 comp rx=0 tx=0).stop 2024-09-15T22:16:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.299+0000 7f1e28c5b640 1 -- 172.21.15.45:0/2666880132 shutdown_connections 2024-09-15T22:16:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.299+0000 7f1e28c5b640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f1e0c0a34c0 0x7f1e0c0a5980 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.299+0000 7f1e28c5b640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e24102ef0 0x7f1e241a4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.299+0000 7f1e28c5b640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e24102570 0x7f1e24199a10 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.299+0000 7f1e28c5b640 1 --2- 172.21.15.45:0/2666880132 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1e24100e20 0x7f1e241994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.299+0000 7f1e28c5b640 1 -- 172.21.15.45:0/2666880132 >> 172.21.15.45:0/2666880132 conn(0x7f1e240fc7d0 msgr2=0x7f1e24105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:31.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.299+0000 7f1e28c5b640 1 -- 172.21.15.45:0/2666880132 shutdown_connections 2024-09-15T22:16:31.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:31.299+0000 7f1e28c5b640 1 -- 172.21.15.45:0/2666880132 wait complete. 2024-09-15T22:16:31.414 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:31 smithi045 ceph-mon[31180]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 83 KiB/s wr, 46 op/s 2024-09-15T22:16:31.414 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:31 smithi045 ceph-mon[31180]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:31.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:31 smithi100 ceph-mon[35319]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 83 KiB/s wr, 46 op/s 2024-09-15T22:16:31.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:31 smithi100 ceph-mon[35319]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:31.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:31 smithi165 ceph-mon[35551]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 83 KiB/s wr, 46 op/s 2024-09-15T22:16:31.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:31 smithi165 ceph-mon[35551]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:32.120 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:16:32.393 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:32 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2666880132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:32.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.392+0000 7fc2b1d99640 1 -- 172.21.15.45:0/45935312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2ac106f10 msgr2=0x7fc2ac10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:32.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.392+0000 7fc2b1d99640 1 --2- 172.21.15.45:0/45935312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2ac106f10 0x7fc2ac10ea90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4009ca0 tx=0x7fc2a402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:16:32.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.392+0000 7fc2b1d99640 1 -- 172.21.15.45:0/45935312 shutdown_connections 2024-09-15T22:16:32.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.392+0000 7fc2b1d99640 1 --2- 172.21.15.45:0/45935312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2ac106f10 0x7fc2ac10ea90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:32.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.392+0000 7fc2b1d99640 1 --2- 172.21.15.45:0/45935312 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2ac102790 0x7fc2ac1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:32.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.392+0000 7fc2b1d99640 1 --2- 172.21.15.45:0/45935312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2ac101de0 0x7fc2ac1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:32.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.392+0000 7fc2b1d99640 1 -- 172.21.15.45:0/45935312 >> 172.21.15.45:0/45935312 conn(0x7fc2ac0fd8c0 msgr2=0x7fc2ac0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:32.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.392+0000 7fc2b1d99640 1 -- 172.21.15.45:0/45935312 shutdown_connections 2024-09-15T22:16:32.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.392+0000 7fc2b1d99640 1 -- 172.21.15.45:0/45935312 wait complete. 2024-09-15T22:16:32.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.393+0000 7fc2b1d99640 1 Processor -- start 2024-09-15T22:16:32.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.393+0000 7fc2b1d99640 1 -- start start 2024-09-15T22:16:32.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2b1d99640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2ac101de0 0x7fc2ac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:32.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2b1d99640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2ac102790 0x7fc2ac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:32.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2b1d99640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2ac106f10 0x7fc2ac074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:32.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2b1d99640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ac112090 con 0x7fc2ac101de0 2024-09-15T22:16:32.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2b1d99640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ac111f10 con 0x7fc2ac106f10 2024-09-15T22:16:32.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2b1d99640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ac112210 con 0x7fc2ac102790 2024-09-15T22:16:32.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2ab7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2ac101de0 0x7fc2ac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:32.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2ab7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2ac101de0 0x7fc2ac0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34848/0 (socket says 172.21.15.45:34848) 2024-09-15T22:16:32.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2ab7fe640 1 -- 172.21.15.45:0/3581650875 learned_addr learned my addr 172.21.15.45:0/3581650875 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:32.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2abfff640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2ac106f10 0x7fc2ac074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:32.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2aaffd640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2ac102790 0x7fc2ac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2ab7fe640 1 -- 172.21.15.45:0/3581650875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2ac102790 msgr2=0x7fc2ac074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2ab7fe640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2ac102790 0x7fc2ac074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2ab7fe640 1 -- 172.21.15.45:0/3581650875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2ac106f10 msgr2=0x7fc2ac074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2ab7fe640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2ac106f10 0x7fc2ac074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.394+0000 7fc2ab7fe640 1 -- 172.21.15.45:0/3581650875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ac1a6920 con 0x7fc2ac101de0 2024-09-15T22:16:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.395+0000 7fc2ab7fe640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2ac101de0 0x7fc2ac0744f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00d950 tx=0x7fc29c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.395+0000 7fc2a8ff9640 1 -- 172.21.15.45:0/3581650875 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c017030 con 0x7fc2ac101de0 2024-09-15T22:16:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.395+0000 7fc2a8ff9640 1 -- 172.21.15.45:0/3581650875 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc29c004020 con 0x7fc2ac101de0 2024-09-15T22:16:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.395+0000 7fc2b1d99640 1 -- 172.21.15.45:0/3581650875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ac1a6c10 con 0x7fc2ac101de0 2024-09-15T22:16:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.395+0000 7fc2a8ff9640 1 -- 172.21.15.45:0/3581650875 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29c004a00 con 0x7fc2ac101de0 2024-09-15T22:16:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.395+0000 7fc2b1d99640 1 -- 172.21.15.45:0/3581650875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ac1a7150 con 0x7fc2ac101de0 2024-09-15T22:16:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.396+0000 7fc2b1d99640 1 -- 172.21.15.45:0/3581650875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ac1021c0 con 0x7fc2ac101de0 2024-09-15T22:16:32.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.397+0000 7fc2a8ff9640 1 -- 172.21.15.45:0/3581650875 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fc29c0041d0 con 0x7fc2ac101de0 2024-09-15T22:16:32.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.397+0000 7fc2a8ff9640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2940a3440 0x7fc2940a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:32.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.398+0000 7fc2a8ff9640 1 -- 172.21.15.45:0/3581650875 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fc29c0d01d0 con 0x7fc2ac101de0 2024-09-15T22:16:32.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.398+0000 7fc2aaffd640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2940a3440 0x7fc2940a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:32.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.398+0000 7fc2aaffd640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2940a3440 0x7fc2940a5900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac075ee0 tx=0x7fc2a000a2d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:32.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.401+0000 7fc2a8ff9640 1 -- 172.21.15.45:0/3581650875 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc29c09c6d0 con 0x7fc2ac101de0 2024-09-15T22:16:32.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:32 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2666880132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:32.494 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:32.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.582+0000 7fc2b1d99640 1 -- 172.21.15.45:0/3581650875 --> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2ac062630 con 0x7fc2940a3440 2024-09-15T22:16:32.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.590+0000 7fc2a8ff9640 1 -- 172.21.15.45:0/3581650875 <== mgr.15165 v2:172.21.15.45:6800/553298159 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339317 (secure 0 0 0) 0x7fc2ac062630 con 0x7fc2940a3440 2024-09-15T22:16:32.595 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:32.596 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-09-15T22:16:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.593+0000 7fc2b1d99640 1 -- 172.21.15.45:0/3581650875 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2940a3440 msgr2=0x7fc2940a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.594+0000 7fc2b1d99640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2940a3440 0x7fc2940a5900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac075ee0 tx=0x7fc2a000a2d0 comp rx=0 tx=0).stop 2024-09-15T22:16:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.594+0000 7fc2b1d99640 1 -- 172.21.15.45:0/3581650875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2ac101de0 msgr2=0x7fc2ac0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.594+0000 7fc2b1d99640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2ac101de0 0x7fc2ac0744f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc29c00d950 tx=0x7fc29c00de10 comp rx=0 tx=0).stop 2024-09-15T22:16:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.594+0000 7fc2b1d99640 1 -- 172.21.15.45:0/3581650875 shutdown_connections 2024-09-15T22:16:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.594+0000 7fc2b1d99640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2940a3440 0x7fc2940a5900 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:32.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.594+0000 7fc2b1d99640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2ac106f10 0x7fc2ac074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:32.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.594+0000 7fc2b1d99640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2ac102790 0x7fc2ac074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:32.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.594+0000 7fc2b1d99640 1 --2- 172.21.15.45:0/3581650875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2ac101de0 0x7fc2ac0744f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:32.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.594+0000 7fc2b1d99640 1 -- 172.21.15.45:0/3581650875 >> 172.21.15.45:0/3581650875 conn(0x7fc2ac0fd8c0 msgr2=0x7fc2ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:32.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.594+0000 7fc2b1d99640 1 -- 172.21.15.45:0/3581650875 shutdown_connections 2024-09-15T22:16:32.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:32.594+0000 7fc2b1d99640 1 -- 172.21.15.45:0/3581650875 wait complete. 2024-09-15T22:16:32.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:32 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2666880132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:33.452 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:33 smithi045 ceph-mon[31180]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 76 KiB/s wr, 42 op/s 2024-09-15T22:16:33.481 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-09-15T22:16:31.559086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1384695,"num_objects":28,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":799,"num_read_kb":818,"num_write":533,"num_write_kb":5268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":881,"ondisk_log_size":881,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":415752,"kb_used_data":16196,"kb_used_omap":18,"kb_used_meta":398957,"kb_avail":1124526072,"statfs":{"total":1151940427776,"available":1151514697728,"internally_reserved":0,"allocated":16584704,"data_stored":10269647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":408532281},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":443,"num_write":144,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004152"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557539+0000","last_change":"2024-09-15T22:14:04.718966+0000","last_active":"2024-09-15T22:16:17.557539+0000","last_peered":"2024-09-15T22:16:17.557539+0000","last_clean":"2024-09-15T22:16:17.557539+0000","last_became_active":"2024-09-15T22:14:04.718743+0000","last_became_peered":"2024-09-15T22:14:04.718743+0000","last_unstale":"2024-09-15T22:16:17.557539+0000","last_undegraded":"2024-09-15T22:16:17.557539+0000","last_fullsized":"2024-09-15T22:16:17.557539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:24:01.767801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604829+0000","last_change":"2024-09-15T22:14:06.814802+0000","last_active":"2024-09-15T22:16:17.604829+0000","last_peered":"2024-09-15T22:16:17.604829+0000","last_clean":"2024-09-15T22:16:17.604829+0000","last_became_active":"2024-09-15T22:14:06.814495+0000","last_became_peered":"2024-09-15T22:14:06.814495+0000","last_unstale":"2024-09-15T22:16:17.604829+0000","last_undegraded":"2024-09-15T22:16:17.604829+0000","last_fullsized":"2024-09-15T22:16:17.604829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:45.384412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552197+0000","last_change":"2024-09-15T22:15:17.404082+0000","last_active":"2024-09-15T22:16:17.552197+0000","last_peered":"2024-09-15T22:16:17.552197+0000","last_clean":"2024-09-15T22:16:17.552197+0000","last_became_active":"2024-09-15T22:15:17.403590+0000","last_became_peered":"2024-09-15T22:15:17.403590+0000","last_unstale":"2024-09-15T22:16:17.552197+0000","last_undegraded":"2024-09-15T22:16:17.552197+0000","last_fullsized":"2024-09-15T22:16:17.552197+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:49.816560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.566735+0000","last_change":"2024-09-15T22:14:05.017101+0000","last_active":"2024-09-15T22:16:17.566735+0000","last_peered":"2024-09-15T22:16:17.566735+0000","last_clean":"2024-09-15T22:16:17.566735+0000","last_became_active":"2024-09-15T22:14:05.016748+0000","last_became_peered":"2024-09-15T22:14:05.016748+0000","last_unstale":"2024-09-15T22:16:17.566735+0000","last_undegraded":"2024-09-15T22:16:17.566735+0000","last_fullsized":"2024-09-15T22:16:17.566735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:11.211291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605811+0000","last_change":"2024-09-15T22:14:06.815112+0000","last_active":"2024-09-15T22:16:17.605811+0000","last_peered":"2024-09-15T22:16:17.605811+0000","last_clean":"2024-09-15T22:16:17.605811+0000","last_became_active":"2024-09-15T22:14:06.814556+0000","last_became_peered":"2024-09-15T22:14:06.814556+0000","last_unstale":"2024-09-15T22:16:17.605811+0000","last_undegraded":"2024-09-15T22:16:17.605811+0000","last_fullsized":"2024-09-15T22:16:17.605811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:24.733336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553827+0000","last_change":"2024-09-15T22:14:13.845829+0000","last_active":"2024-09-15T22:16:17.553827+0000","last_peered":"2024-09-15T22:16:17.553827+0000","last_clean":"2024-09-15T22:16:17.553827+0000","last_became_active":"2024-09-15T22:14:13.844958+0000","last_became_peered":"2024-09-15T22:14:13.844958+0000","last_unstale":"2024-09-15T22:16:17.553827+0000","last_undegraded":"2024-09-15T22:16:17.553827+0000","last_fullsized":"2024-09-15T22:16:17.553827+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:37.944143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555893+0000","last_change":"2024-09-15T22:14:04.720255+0000","last_active":"2024-09-15T22:16:17.555893+0000","last_peered":"2024-09-15T22:16:17.555893+0000","last_clean":"2024-09-15T22:16:17.555893+0000","last_became_active":"2024-09-15T22:14:04.719907+0000","last_became_peered":"2024-09-15T22:14:04.719907+0000","last_unstale":"2024-09-15T22:16:17.555893+0000","last_undegraded":"2024-09-15T22:16:17.555893+0000","last_fullsized":"2024-09-15T22:16:17.555893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:12.510139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.591919+0000","last_change":"2024-09-15T22:14:06.808322+0000","last_active":"2024-09-15T22:16:17.591919+0000","last_peered":"2024-09-15T22:16:17.591919+0000","last_clean":"2024-09-15T22:16:17.591919+0000","last_became_active":"2024-09-15T22:14:06.807398+0000","last_became_peered":"2024-09-15T22:14:06.807398+0000","last_unstale":"2024-09-15T22:16:17.591919+0000","last_undegraded":"2024-09-15T22:16:17.591919+0000","last_fullsized":"2024-09-15T22:16:17.591919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:11.677800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554758+0000","last_change":"2024-09-15T22:14:13.849713+0000","last_active":"2024-09-15T22:16:17.554758+0000","last_peered":"2024-09-15T22:16:17.554758+0000","last_clean":"2024-09-15T22:16:17.554758+0000","last_became_active":"2024-09-15T22:14:13.849311+0000","last_became_peered":"2024-09-15T22:14:13.849311+0000","last_unstale":"2024-09-15T22:16:17.554758+0000","last_undegraded":"2024-09-15T22:16:17.554758+0000","last_fullsized":"2024-09-15T22:16:17.554758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:17.782013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554654+0000","last_change":"2024-09-15T22:14:04.721694+0000","last_active":"2024-09-15T22:16:17.554654+0000","last_peered":"2024-09-15T22:16:17.554654+0000","last_clean":"2024-09-15T22:16:17.554654+0000","last_became_active":"2024-09-15T22:14:04.721321+0000","last_became_peered":"2024-09-15T22:14:04.721321+0000","last_unstale":"2024-09-15T22:16:17.554654+0000","last_undegraded":"2024-09-15T22:16:17.554654+0000","last_fullsized":"2024-09-15T22:16:17.554654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:47.817565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.586446+0000","last_change":"2024-09-15T22:14:06.809564+0000","last_active":"2024-09-15T22:16:17.586446+0000","last_peered":"2024-09-15T22:16:17.586446+0000","last_clean":"2024-09-15T22:16:17.586446+0000","last_became_active":"2024-09-15T22:14:06.809102+0000","last_became_peered":"2024-09-15T22:14:06.809102+0000","last_unstale":"2024-09-15T22:16:17.586446+0000","last_undegraded":"2024-09-15T22:16:17.586446+0000","last_fullsized":"2024-09-15T22:16:17.586446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:55.306791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554499+0000","last_change":"2024-09-15T22:14:13.849839+0000","last_active":"2024-09-15T22:16:17.554499+0000","last_peered":"2024-09-15T22:16:17.554499+0000","last_clean":"2024-09-15T22:16:17.554499+0000","last_became_active":"2024-09-15T22:14:13.849415+0000","last_became_peered":"2024-09-15T22:14:13.849415+0000","last_unstale":"2024-09-15T22:16:17.554499+0000","last_undegraded":"2024-09-15T22:16:17.554499+0000","last_fullsized":"2024-09-15T22:16:17.554499+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:20.336406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601353+0000","last_change":"2024-09-15T22:14:06.815506+0000","last_active":"2024-09-15T22:16:17.601353+0000","last_peered":"2024-09-15T22:16:17.601353+0000","last_clean":"2024-09-15T22:16:17.601353+0000","last_became_active":"2024-09-15T22:14:06.815066+0000","last_became_peered":"2024-09-15T22:14:06.815066+0000","last_unstale":"2024-09-15T22:16:17.601353+0000","last_undegraded":"2024-09-15T22:16:17.601353+0000","last_fullsized":"2024-09-15T22:16:17.601353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:42.182268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555136+0000","last_change":"2024-09-15T22:14:04.721403+0000","last_active":"2024-09-15T22:16:17.555136+0000","last_peered":"2024-09-15T22:16:17.555136+0000","last_clean":"2024-09-15T22:16:17.555136+0000","last_became_active":"2024-09-15T22:14:04.721049+0000","last_became_peered":"2024-09-15T22:14:04.721049+0000","last_unstale":"2024-09-15T22:16:17.555136+0000","last_undegraded":"2024-09-15T22:16:17.555136+0000","last_fullsized":"2024-09-15T22:16:17.555136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:39.860926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.561252+0000","last_change":"2024-09-15T22:14:14.280656+0000","last_active":"2024-09-15T22:16:17.561252+0000","last_peered":"2024-09-15T22:16:17.561252+0000","last_clean":"2024-09-15T22:16:17.561252+0000","last_became_active":"2024-09-15T22:14:14.280230+0000","last_became_peered":"2024-09-15T22:14:14.280230+0000","last_unstale":"2024-09-15T22:16:17.561252+0000","last_undegraded":"2024-09-15T22:16:17.561252+0000","last_fullsized":"2024-09-15T22:16:17.561252+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:47.531799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604047+0000","last_change":"2024-09-15T22:14:06.805575+0000","last_active":"2024-09-15T22:16:17.604047+0000","last_peered":"2024-09-15T22:16:17.604047+0000","last_clean":"2024-09-15T22:16:17.604047+0000","last_became_active":"2024-09-15T22:14:06.804515+0000","last_became_peered":"2024-09-15T22:14:06.804515+0000","last_unstale":"2024-09-15T22:16:17.604047+0000","last_undegraded":"2024-09-15T22:16:17.604047+0000","last_fullsized":"2024-09-15T22:16:17.604047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.560964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552446+0000","last_change":"2024-09-15T22:14:04.717221+0000","last_active":"2024-09-15T22:16:17.552446+0000","last_peered":"2024-09-15T22:16:17.552446+0000","last_clean":"2024-09-15T22:16:17.552446+0000","last_became_active":"2024-09-15T22:14:04.716845+0000","last_became_peered":"2024-09-15T22:14:04.716845+0000","last_unstale":"2024-09-15T22:16:17.552446+0000","last_undegraded":"2024-09-15T22:16:17.552446+0000","last_fullsized":"2024-09-15T22:16:17.552446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.073229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555298+0000","last_change":"2024-09-15T22:14:13.847822+0000","last_active":"2024-09-15T22:16:17.555298+0000","last_peered":"2024-09-15T22:16:17.555298+0000","last_clean":"2024-09-15T22:16:17.555298+0000","last_became_active":"2024-09-15T22:14:13.847332+0000","last_became_peered":"2024-09-15T22:14:13.847332+0000","last_unstale":"2024-09-15T22:16:17.555298+0000","last_undegraded":"2024-09-15T22:16:17.555298+0000","last_fullsized":"2024-09-15T22:16:17.555298+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:18.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603103+0000","last_change":"2024-09-15T22:14:06.814033+0000","last_active":"2024-09-15T22:16:17.603103+0000","last_peered":"2024-09-15T22:16:17.603103+0000","last_clean":"2024-09-15T22:16:17.603103+0000","last_became_active":"2024-09-15T22:14:06.813458+0000","last_became_peered":"2024-09-15T22:14:06.813458+0000","last_unstale":"2024-09-15T22:16:17.603103+0000","last_undegraded":"2024-09-15T22:16:17.603103+0000","last_fullsized":"2024-09-15T22:16:17.603103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:16.484113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554628+0000","last_change":"2024-09-15T22:14:04.715797+0000","last_active":"2024-09-15T22:16:17.554628+0000","last_peered":"2024-09-15T22:16:17.554628+0000","last_clean":"2024-09-15T22:16:17.554628+0000","last_became_active":"2024-09-15T22:14:04.715478+0000","last_became_peered":"2024-09-15T22:14:04.715478+0000","last_unstale":"2024-09-15T22:16:17.554628+0000","last_undegraded":"2024-09-15T22:16:17.554628+0000","last_fullsized":"2024-09-15T22:16:17.554628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:39.432873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557177+0000","last_change":"2024-09-15T22:14:13.853461+0000","last_active":"2024-09-15T22:16:17.557177+0000","last_peered":"2024-09-15T22:16:17.557177+0000","last_clean":"2024-09-15T22:16:17.557177+0000","last_became_active":"2024-09-15T22:14:13.852896+0000","last_became_peered":"2024-09-15T22:14:13.852896+0000","last_unstale":"2024-09-15T22:16:17.557177+0000","last_undegraded":"2024-09-15T22:16:17.557177+0000","last_fullsized":"2024-09-15T22:16:17.557177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:41.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579227+0000","last_change":"2024-09-15T22:14:06.814990+0000","last_active":"2024-09-15T22:16:17.579227+0000","last_peered":"2024-09-15T22:16:17.579227+0000","last_clean":"2024-09-15T22:16:17.579227+0000","last_became_active":"2024-09-15T22:14:06.814646+0000","last_became_peered":"2024-09-15T22:14:06.814646+0000","last_unstale":"2024-09-15T22:16:17.579227+0000","last_undegraded":"2024-09-15T22:16:17.579227+0000","last_fullsized":"2024-09-15T22:16:17.579227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:04.717207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.542012+0000","last_change":"2024-09-15T22:14:05.017599+0000","last_active":"2024-09-15T22:16:17.542012+0000","last_peered":"2024-09-15T22:16:17.542012+0000","last_clean":"2024-09-15T22:16:17.542012+0000","last_became_active":"2024-09-15T22:14:05.017296+0000","last_became_peered":"2024-09-15T22:14:05.017296+0000","last_unstale":"2024-09-15T22:16:17.542012+0000","last_undegraded":"2024-09-15T22:16:17.542012+0000","last_fullsized":"2024-09-15T22:16:17.542012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:11.427372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556380+0000","last_change":"2024-09-15T22:14:14.281453+0000","last_active":"2024-09-15T22:16:17.556380+0000","last_peered":"2024-09-15T22:16:17.556380+0000","last_clean":"2024-09-15T22:16:17.556380+0000","last_became_active":"2024-09-15T22:14:14.280814+0000","last_became_peered":"2024-09-15T22:14:14.280814+0000","last_unstale":"2024-09-15T22:16:17.556380+0000","last_undegraded":"2024-09-15T22:16:17.556380+0000","last_fullsized":"2024-09-15T22:16:17.556380+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:43:40.890979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604784+0000","last_change":"2024-09-15T22:14:06.816619+0000","last_active":"2024-09-15T22:16:17.604784+0000","last_peered":"2024-09-15T22:16:17.604784+0000","last_clean":"2024-09-15T22:16:17.604784+0000","last_became_active":"2024-09-15T22:14:06.814421+0000","last_became_peered":"2024-09-15T22:14:06.814421+0000","last_unstale":"2024-09-15T22:16:17.604784+0000","last_undegraded":"2024-09-15T22:16:17.604784+0000","last_fullsized":"2024-09-15T22:16:17.604784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:00.329802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556148+0000","last_change":"2024-09-15T22:14:05.197752+0000","last_active":"2024-09-15T22:16:17.556148+0000","last_peered":"2024-09-15T22:16:17.556148+0000","last_clean":"2024-09-15T22:16:17.556148+0000","last_became_active":"2024-09-15T22:14:05.197399+0000","last_became_peered":"2024-09-15T22:14:05.197399+0000","last_unstale":"2024-09-15T22:16:17.556148+0000","last_undegraded":"2024-09-15T22:16:17.556148+0000","last_fullsized":"2024-09-15T22:16:17.556148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:19.781842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552191+0000","last_change":"2024-09-15T22:14:13.847474+0000","last_active":"2024-09-15T22:16:17.552191+0000","last_peered":"2024-09-15T22:16:17.552191+0000","last_clean":"2024-09-15T22:16:17.552191+0000","last_became_active":"2024-09-15T22:14:13.847032+0000","last_became_peered":"2024-09-15T22:14:13.847032+0000","last_unstale":"2024-09-15T22:16:17.552191+0000","last_undegraded":"2024-09-15T22:16:17.552191+0000","last_fullsized":"2024-09-15T22:16:17.552191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:21.049024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598828+0000","last_change":"2024-09-15T22:14:06.809104+0000","last_active":"2024-09-15T22:16:17.598828+0000","last_peered":"2024-09-15T22:16:17.598828+0000","last_clean":"2024-09-15T22:16:17.598828+0000","last_became_active":"2024-09-15T22:14:06.808735+0000","last_became_peered":"2024-09-15T22:14:06.808735+0000","last_unstale":"2024-09-15T22:16:17.598828+0000","last_undegraded":"2024-09-15T22:16:17.598828+0000","last_fullsized":"2024-09-15T22:16:17.598828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:46.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'97","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:28.221507+0000","last_change":"2024-09-15T22:14:04.712546+0000","last_active":"2024-09-15T22:16:28.221507+0000","last_peered":"2024-09-15T22:16:28.221507+0000","last_clean":"2024-09-15T22:16:28.221507+0000","last_became_active":"2024-09-15T22:14:04.712222+0000","last_became_peered":"2024-09-15T22:14:04.712222+0000","last_unstale":"2024-09-15T22:16:28.221507+0000","last_undegraded":"2024-09-15T22:16:28.221507+0000","last_fullsized":"2024-09-15T22:16:28.221507+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:00.993810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":179,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.566187+0000","last_change":"2024-09-15T22:14:14.280905+0000","last_active":"2024-09-15T22:16:17.566187+0000","last_peered":"2024-09-15T22:16:17.566187+0000","last_clean":"2024-09-15T22:16:17.566187+0000","last_became_active":"2024-09-15T22:14:14.280368+0000","last_became_peered":"2024-09-15T22:14:14.280368+0000","last_unstale":"2024-09-15T22:16:17.566187+0000","last_undegraded":"2024-09-15T22:16:17.566187+0000","last_fullsized":"2024-09-15T22:16:17.566187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:52.812589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.599423+0000","last_change":"2024-09-15T22:14:06.816231+0000","last_active":"2024-09-15T22:16:17.599423+0000","last_peered":"2024-09-15T22:16:17.599423+0000","last_clean":"2024-09-15T22:16:17.599423+0000","last_became_active":"2024-09-15T22:14:06.815884+0000","last_became_peered":"2024-09-15T22:14:06.815884+0000","last_unstale":"2024-09-15T22:16:17.599423+0000","last_undegraded":"2024-09-15T22:16:17.599423+0000","last_fullsized":"2024-09-15T22:16:17.599423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:30.076077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556018+0000","last_change":"2024-09-15T22:14:05.017745+0000","last_active":"2024-09-15T22:16:17.556018+0000","last_peered":"2024-09-15T22:16:17.556018+0000","last_clean":"2024-09-15T22:16:17.556018+0000","last_became_active":"2024-09-15T22:14:05.017064+0000","last_became_peered":"2024-09-15T22:14:05.017064+0000","last_unstale":"2024-09-15T22:16:17.556018+0000","last_undegraded":"2024-09-15T22:16:17.556018+0000","last_fullsized":"2024-09-15T22:16:17.556018+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:44.038448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.560621+0000","last_change":"2024-09-15T22:14:13.853195+0000","last_active":"2024-09-15T22:16:17.560621+0000","last_peered":"2024-09-15T22:16:17.560621+0000","last_clean":"2024-09-15T22:16:17.560621+0000","last_became_active":"2024-09-15T22:14:13.852803+0000","last_became_peered":"2024-09-15T22:14:13.852803+0000","last_unstale":"2024-09-15T22:16:17.560621+0000","last_undegraded":"2024-09-15T22:16:17.560621+0000","last_fullsized":"2024-09-15T22:16:17.560621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:20.737509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601889+0000","last_change":"2024-09-15T22:14:06.805448+0000","last_active":"2024-09-15T22:16:17.601889+0000","last_peered":"2024-09-15T22:16:17.601889+0000","last_clean":"2024-09-15T22:16:17.601889+0000","last_became_active":"2024-09-15T22:14:06.804965+0000","last_became_peered":"2024-09-15T22:14:06.804965+0000","last_unstale":"2024-09-15T22:16:17.601889+0000","last_undegraded":"2024-09-15T22:16:17.601889+0000","last_fullsized":"2024-09-15T22:16:17.601889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:29.831888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556768+0000","last_change":"2024-09-15T22:14:05.017438+0000","last_active":"2024-09-15T22:16:17.556768+0000","last_peered":"2024-09-15T22:16:17.556768+0000","last_clean":"2024-09-15T22:16:17.556768+0000","last_became_active":"2024-09-15T22:14:05.017050+0000","last_became_peered":"2024-09-15T22:14:05.017050+0000","last_unstale":"2024-09-15T22:16:17.556768+0000","last_undegraded":"2024-09-15T22:16:17.556768+0000","last_fullsized":"2024-09-15T22:16:17.556768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:35.608774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554172+0000","last_change":"2024-09-15T22:14:14.281096+0000","last_active":"2024-09-15T22:16:17.554172+0000","last_peered":"2024-09-15T22:16:17.554172+0000","last_clean":"2024-09-15T22:16:17.554172+0000","last_became_active":"2024-09-15T22:14:14.280381+0000","last_became_peered":"2024-09-15T22:14:14.280381+0000","last_unstale":"2024-09-15T22:16:17.554172+0000","last_undegraded":"2024-09-15T22:16:17.554172+0000","last_fullsized":"2024-09-15T22:16:17.554172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:44.686080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.583155+0000","last_change":"2024-09-15T22:14:06.812046+0000","last_active":"2024-09-15T22:16:17.583155+0000","last_peered":"2024-09-15T22:16:17.583155+0000","last_clean":"2024-09-15T22:16:17.583155+0000","last_became_active":"2024-09-15T22:14:06.811721+0000","last_became_peered":"2024-09-15T22:14:06.811721+0000","last_unstale":"2024-09-15T22:16:17.583155+0000","last_undegraded":"2024-09-15T22:16:17.583155+0000","last_fullsized":"2024-09-15T22:16:17.583155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:13.244973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556145+0000","last_change":"2024-09-15T22:14:04.720940+0000","last_active":"2024-09-15T22:16:17.556145+0000","last_peered":"2024-09-15T22:16:17.556145+0000","last_clean":"2024-09-15T22:16:17.556145+0000","last_became_active":"2024-09-15T22:14:04.720624+0000","last_became_peered":"2024-09-15T22:14:04.720624+0000","last_unstale":"2024-09-15T22:16:17.556145+0000","last_undegraded":"2024-09-15T22:16:17.556145+0000","last_fullsized":"2024-09-15T22:16:17.556145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:29.823784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540655+0000","last_change":"2024-09-15T22:14:13.848882+0000","last_active":"2024-09-15T22:16:17.540655+0000","last_peered":"2024-09-15T22:16:17.540655+0000","last_clean":"2024-09-15T22:16:17.540655+0000","last_became_active":"2024-09-15T22:14:13.848512+0000","last_became_peered":"2024-09-15T22:14:13.848512+0000","last_unstale":"2024-09-15T22:16:17.540655+0000","last_undegraded":"2024-09-15T22:16:17.540655+0000","last_fullsized":"2024-09-15T22:16:17.540655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:44.050344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582026+0000","last_change":"2024-09-15T22:14:06.813915+0000","last_active":"2024-09-15T22:16:17.582026+0000","last_peered":"2024-09-15T22:16:17.582026+0000","last_clean":"2024-09-15T22:16:17.582026+0000","last_became_active":"2024-09-15T22:14:06.811803+0000","last_became_peered":"2024-09-15T22:14:06.811803+0000","last_unstale":"2024-09-15T22:16:17.582026+0000","last_undegraded":"2024-09-15T22:16:17.582026+0000","last_fullsized":"2024-09-15T22:16:17.582026+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:42.117747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540432+0000","last_change":"2024-09-15T22:14:05.017360+0000","last_active":"2024-09-15T22:16:17.540432+0000","last_peered":"2024-09-15T22:16:17.540432+0000","last_clean":"2024-09-15T22:16:17.540432+0000","last_became_active":"2024-09-15T22:14:05.017004+0000","last_became_peered":"2024-09-15T22:14:05.017004+0000","last_unstale":"2024-09-15T22:16:17.540432+0000","last_undegraded":"2024-09-15T22:16:17.540432+0000","last_fullsized":"2024-09-15T22:16:17.540432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:01.366513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540921+0000","last_change":"2024-09-15T22:14:14.280215+0000","last_active":"2024-09-15T22:16:17.540921+0000","last_peered":"2024-09-15T22:16:17.540921+0000","last_clean":"2024-09-15T22:16:17.540921+0000","last_became_active":"2024-09-15T22:14:14.279750+0000","last_became_peered":"2024-09-15T22:14:14.279750+0000","last_unstale":"2024-09-15T22:16:17.540921+0000","last_undegraded":"2024-09-15T22:16:17.540921+0000","last_fullsized":"2024-09-15T22:16:17.540921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:58.827582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602972+0000","last_change":"2024-09-15T22:14:06.812410+0000","last_active":"2024-09-15T22:16:17.602972+0000","last_peered":"2024-09-15T22:16:17.602972+0000","last_clean":"2024-09-15T22:16:17.602972+0000","last_became_active":"2024-09-15T22:14:06.812032+0000","last_became_peered":"2024-09-15T22:14:06.812032+0000","last_unstale":"2024-09-15T22:16:17.602972+0000","last_undegraded":"2024-09-15T22:16:17.602972+0000","last_fullsized":"2024-09-15T22:16:17.602972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:48.100213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.558099+0000","last_change":"2024-09-15T22:14:04.719678+0000","last_active":"2024-09-15T22:16:17.558099+0000","last_peered":"2024-09-15T22:16:17.558099+0000","last_clean":"2024-09-15T22:16:17.558099+0000","last_became_active":"2024-09-15T22:14:04.719352+0000","last_became_peered":"2024-09-15T22:14:04.719352+0000","last_unstale":"2024-09-15T22:16:17.558099+0000","last_undegraded":"2024-09-15T22:16:17.558099+0000","last_fullsized":"2024-09-15T22:16:17.558099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.061957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545734+0000","last_change":"2024-09-15T22:14:14.281314+0000","last_active":"2024-09-15T22:16:17.545734+0000","last_peered":"2024-09-15T22:16:17.545734+0000","last_clean":"2024-09-15T22:16:17.545734+0000","last_became_active":"2024-09-15T22:14:14.280859+0000","last_became_peered":"2024-09-15T22:14:14.280859+0000","last_unstale":"2024-09-15T22:16:17.545734+0000","last_undegraded":"2024-09-15T22:16:17.545734+0000","last_fullsized":"2024-09-15T22:16:17.545734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:18.796767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.592298+0000","last_change":"2024-09-15T22:15:17.211828+0000","last_active":"2024-09-15T22:16:17.592298+0000","last_peered":"2024-09-15T22:16:17.592298+0000","last_clean":"2024-09-15T22:16:17.592298+0000","last_became_active":"2024-09-15T22:15:17.211560+0000","last_became_peered":"2024-09-15T22:15:17.211560+0000","last_unstale":"2024-09-15T22:16:17.592298+0000","last_undegraded":"2024-09-15T22:16:17.592298+0000","last_fullsized":"2024-09-15T22:16:17.592298+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:59.944869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555126+0000","last_change":"2024-09-15T22:14:04.718038+0000","last_active":"2024-09-15T22:16:17.555126+0000","last_peered":"2024-09-15T22:16:17.555126+0000","last_clean":"2024-09-15T22:16:17.555126+0000","last_became_active":"2024-09-15T22:14:04.717683+0000","last_became_peered":"2024-09-15T22:14:04.717683+0000","last_unstale":"2024-09-15T22:16:17.555126+0000","last_undegraded":"2024-09-15T22:16:17.555126+0000","last_fullsized":"2024-09-15T22:16:17.555126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:23.557077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"90'148","reported_seq":404,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:19.690576+0000","last_change":"2024-09-15T22:12:55.022635+0000","last_active":"2024-09-15T22:16:19.690576+0000","last_peered":"2024-09-15T22:16:19.690576+0000","last_clean":"2024-09-15T22:16:19.690576+0000","last_became_active":"2024-09-15T22:12:55.022132+0000","last_became_peered":"2024-09-15T22:12:55.022132+0000","last_unstale":"2024-09-15T22:16:19.690576+0000","last_undegraded":"2024-09-15T22:16:19.690576+0000","last_fullsized":"2024-09-15T22:16:19.690576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_clean_scrub_stamp":"2024-09-15T22:09:30.115505+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:50.060169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.560414+0000","last_change":"2024-09-15T22:14:13.849547+0000","last_active":"2024-09-15T22:16:17.560414+0000","last_peered":"2024-09-15T22:16:17.560414+0000","last_clean":"2024-09-15T22:16:17.560414+0000","last_became_active":"2024-09-15T22:14:13.849091+0000","last_became_peered":"2024-09-15T22:14:13.849091+0000","last_unstale":"2024-09-15T22:16:17.560414+0000","last_undegraded":"2024-09-15T22:16:17.560414+0000","last_fullsized":"2024-09-15T22:16:17.560414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:49.450958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596732+0000","last_change":"2024-09-15T22:14:06.816340+0000","last_active":"2024-09-15T22:16:17.596732+0000","last_peered":"2024-09-15T22:16:17.596732+0000","last_clean":"2024-09-15T22:16:17.596732+0000","last_became_active":"2024-09-15T22:14:06.815712+0000","last_became_peered":"2024-09-15T22:14:06.815712+0000","last_unstale":"2024-09-15T22:16:17.596732+0000","last_undegraded":"2024-09-15T22:16:17.596732+0000","last_fullsized":"2024-09-15T22:16:17.596732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:43.598512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553284+0000","last_change":"2024-09-15T22:14:05.197487+0000","last_active":"2024-09-15T22:16:17.553284+0000","last_peered":"2024-09-15T22:16:17.553284+0000","last_clean":"2024-09-15T22:16:17.553284+0000","last_became_active":"2024-09-15T22:14:05.197098+0000","last_became_peered":"2024-09-15T22:14:05.197098+0000","last_unstale":"2024-09-15T22:16:17.553284+0000","last_undegraded":"2024-09-15T22:16:17.553284+0000","last_fullsized":"2024-09-15T22:16:17.553284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:31.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.542012+0000","last_change":"2024-09-15T22:14:13.849594+0000","last_active":"2024-09-15T22:16:17.542012+0000","last_peered":"2024-09-15T22:16:17.542012+0000","last_clean":"2024-09-15T22:16:17.542012+0000","last_became_active":"2024-09-15T22:14:13.849157+0000","last_became_peered":"2024-09-15T22:14:13.849157+0000","last_unstale":"2024-09-15T22:16:17.542012+0000","last_undegraded":"2024-09-15T22:16:17.542012+0000","last_fullsized":"2024-09-15T22:16:17.542012+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:49.994107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.594139+0000","last_change":"2024-09-15T22:14:06.814312+0000","last_active":"2024-09-15T22:16:17.594139+0000","last_peered":"2024-09-15T22:16:17.594139+0000","last_clean":"2024-09-15T22:16:17.594139+0000","last_became_active":"2024-09-15T22:14:06.813959+0000","last_became_peered":"2024-09-15T22:14:06.813959+0000","last_unstale":"2024-09-15T22:16:17.594139+0000","last_undegraded":"2024-09-15T22:16:17.594139+0000","last_fullsized":"2024-09-15T22:16:17.594139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:36.924162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'65","reported_seq":132,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:27.861728+0000","last_change":"2024-09-15T22:14:04.713307+0000","last_active":"2024-09-15T22:16:27.861728+0000","last_peered":"2024-09-15T22:16:27.861728+0000","last_clean":"2024-09-15T22:16:27.861728+0000","last_became_active":"2024-09-15T22:14:04.712996+0000","last_became_peered":"2024-09-15T22:14:04.712996+0000","last_unstale":"2024-09-15T22:16:27.861728+0000","last_undegraded":"2024-09-15T22:16:27.861728+0000","last_fullsized":"2024-09-15T22:16:27.861728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:37.298679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.563349+0000","last_change":"2024-09-15T22:14:13.846087+0000","last_active":"2024-09-15T22:16:17.563349+0000","last_peered":"2024-09-15T22:16:17.563349+0000","last_clean":"2024-09-15T22:16:17.563349+0000","last_became_active":"2024-09-15T22:14:13.845731+0000","last_became_peered":"2024-09-15T22:14:13.845731+0000","last_unstale":"2024-09-15T22:16:17.563349+0000","last_undegraded":"2024-09-15T22:16:17.563349+0000","last_fullsized":"2024-09-15T22:16:17.563349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:24.621330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.581459+0000","last_change":"2024-09-15T22:14:06.809456+0000","last_active":"2024-09-15T22:16:17.581459+0000","last_peered":"2024-09-15T22:16:17.581459+0000","last_clean":"2024-09-15T22:16:17.581459+0000","last_became_active":"2024-09-15T22:14:06.809141+0000","last_became_peered":"2024-09-15T22:14:06.809141+0000","last_unstale":"2024-09-15T22:16:17.581459+0000","last_undegraded":"2024-09-15T22:16:17.581459+0000","last_fullsized":"2024-09-15T22:16:17.581459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:30.186800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540944+0000","last_change":"2024-09-15T22:14:04.715399+0000","last_active":"2024-09-15T22:16:17.540944+0000","last_peered":"2024-09-15T22:16:17.540944+0000","last_clean":"2024-09-15T22:16:17.540944+0000","last_became_active":"2024-09-15T22:14:04.715043+0000","last_became_peered":"2024-09-15T22:14:04.715043+0000","last_unstale":"2024-09-15T22:16:17.540944+0000","last_undegraded":"2024-09-15T22:16:17.540944+0000","last_fullsized":"2024-09-15T22:16:17.540944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:13.860413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545046+0000","last_change":"2024-09-15T22:14:13.851594+0000","last_active":"2024-09-15T22:16:17.545046+0000","last_peered":"2024-09-15T22:16:17.545046+0000","last_clean":"2024-09-15T22:16:17.545046+0000","last_became_active":"2024-09-15T22:14:13.851154+0000","last_became_peered":"2024-09-15T22:14:13.851154+0000","last_unstale":"2024-09-15T22:16:17.545046+0000","last_undegraded":"2024-09-15T22:16:17.545046+0000","last_fullsized":"2024-09-15T22:16:17.545046+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:43.343808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579682+0000","last_change":"2024-09-15T22:15:17.219587+0000","last_active":"2024-09-15T22:16:17.579682+0000","last_peered":"2024-09-15T22:16:17.579682+0000","last_clean":"2024-09-15T22:16:17.579682+0000","last_became_active":"2024-09-15T22:15:17.219207+0000","last_became_peered":"2024-09-15T22:15:17.219207+0000","last_unstale":"2024-09-15T22:16:17.579682+0000","last_undegraded":"2024-09-15T22:16:17.579682+0000","last_fullsized":"2024-09-15T22:16:17.579682+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:34.267857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553979+0000","last_change":"2024-09-15T22:14:04.719550+0000","last_active":"2024-09-15T22:16:17.553979+0000","last_peered":"2024-09-15T22:16:17.553979+0000","last_clean":"2024-09-15T22:16:17.553979+0000","last_became_active":"2024-09-15T22:14:04.719273+0000","last_became_peered":"2024-09-15T22:14:04.719273+0000","last_unstale":"2024-09-15T22:16:17.553979+0000","last_undegraded":"2024-09-15T22:16:17.553979+0000","last_fullsized":"2024-09-15T22:16:17.553979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:20.973615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545214+0000","last_change":"2024-09-15T22:14:13.851420+0000","last_active":"2024-09-15T22:16:17.545214+0000","last_peered":"2024-09-15T22:16:17.545214+0000","last_clean":"2024-09-15T22:16:17.545214+0000","last_became_active":"2024-09-15T22:14:13.851051+0000","last_became_peered":"2024-09-15T22:14:13.851051+0000","last_unstale":"2024-09-15T22:16:17.545214+0000","last_undegraded":"2024-09-15T22:16:17.545214+0000","last_fullsized":"2024-09-15T22:16:17.545214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:11.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595588+0000","last_change":"2024-09-15T22:14:06.809609+0000","last_active":"2024-09-15T22:16:17.595588+0000","last_peered":"2024-09-15T22:16:17.595588+0000","last_clean":"2024-09-15T22:16:17.595588+0000","last_became_active":"2024-09-15T22:14:06.809213+0000","last_became_peered":"2024-09-15T22:14:06.809213+0000","last_unstale":"2024-09-15T22:16:17.595588+0000","last_undegraded":"2024-09-15T22:16:17.595588+0000","last_fullsized":"2024-09-15T22:16:17.595588+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:11.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553769+0000","last_change":"2024-09-15T22:14:05.017559+0000","last_active":"2024-09-15T22:16:17.553769+0000","last_peered":"2024-09-15T22:16:17.553769+0000","last_clean":"2024-09-15T22:16:17.553769+0000","last_became_active":"2024-09-15T22:14:05.017121+0000","last_became_peered":"2024-09-15T22:14:05.017121+0000","last_unstale":"2024-09-15T22:16:17.553769+0000","last_undegraded":"2024-09-15T22:16:17.553769+0000","last_fullsized":"2024-09-15T22:16:17.553769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:29:06.442532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540809+0000","last_change":"2024-09-15T22:14:13.847835+0000","last_active":"2024-09-15T22:16:17.540809+0000","last_peered":"2024-09-15T22:16:17.540809+0000","last_clean":"2024-09-15T22:16:17.540809+0000","last_became_active":"2024-09-15T22:14:13.847437+0000","last_became_peered":"2024-09-15T22:14:13.847437+0000","last_unstale":"2024-09-15T22:16:17.540809+0000","last_undegraded":"2024-09-15T22:16:17.540809+0000","last_fullsized":"2024-09-15T22:16:17.540809+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:48.036495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.586410+0000","last_change":"2024-09-15T22:14:06.813191+0000","last_active":"2024-09-15T22:16:17.586410+0000","last_peered":"2024-09-15T22:16:17.586410+0000","last_clean":"2024-09-15T22:16:17.586410+0000","last_became_active":"2024-09-15T22:14:06.812861+0000","last_became_peered":"2024-09-15T22:14:06.812861+0000","last_unstale":"2024-09-15T22:16:17.586410+0000","last_undegraded":"2024-09-15T22:16:17.586410+0000","last_fullsized":"2024-09-15T22:16:17.586410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:51.487591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554424+0000","last_change":"2024-09-15T22:14:04.718431+0000","last_active":"2024-09-15T22:16:17.554424+0000","last_peered":"2024-09-15T22:16:17.554424+0000","last_clean":"2024-09-15T22:16:17.554424+0000","last_became_active":"2024-09-15T22:14:04.718109+0000","last_became_peered":"2024-09-15T22:14:04.718109+0000","last_unstale":"2024-09-15T22:16:17.554424+0000","last_undegraded":"2024-09-15T22:16:17.554424+0000","last_fullsized":"2024-09-15T22:16:17.554424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:10.408634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557287+0000","last_change":"2024-09-15T22:14:13.845179+0000","last_active":"2024-09-15T22:16:17.557287+0000","last_peered":"2024-09-15T22:16:17.557287+0000","last_clean":"2024-09-15T22:16:17.557287+0000","last_became_active":"2024-09-15T22:14:13.844795+0000","last_became_peered":"2024-09-15T22:14:13.844795+0000","last_unstale":"2024-09-15T22:16:17.557287+0000","last_undegraded":"2024-09-15T22:16:17.557287+0000","last_fullsized":"2024-09-15T22:16:17.557287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:24.113536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602323+0000","last_change":"2024-09-15T22:14:06.809687+0000","last_active":"2024-09-15T22:16:17.602323+0000","last_peered":"2024-09-15T22:16:17.602323+0000","last_clean":"2024-09-15T22:16:17.602323+0000","last_became_active":"2024-09-15T22:14:06.809383+0000","last_became_peered":"2024-09-15T22:14:06.809383+0000","last_unstale":"2024-09-15T22:16:17.602323+0000","last_undegraded":"2024-09-15T22:16:17.602323+0000","last_fullsized":"2024-09-15T22:16:17.602323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:19.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545340+0000","last_change":"2024-09-15T22:14:04.720577+0000","last_active":"2024-09-15T22:16:17.545340+0000","last_peered":"2024-09-15T22:16:17.545340+0000","last_clean":"2024-09-15T22:16:17.545340+0000","last_became_active":"2024-09-15T22:14:04.720235+0000","last_became_peered":"2024-09-15T22:14:04.720235+0000","last_unstale":"2024-09-15T22:16:17.545340+0000","last_undegraded":"2024-09-15T22:16:17.545340+0000","last_fullsized":"2024-09-15T22:16:17.545340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:17.501061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.559191+0000","last_change":"2024-09-15T22:14:13.854841+0000","last_active":"2024-09-15T22:16:17.559191+0000","last_peered":"2024-09-15T22:16:17.559191+0000","last_clean":"2024-09-15T22:16:17.559191+0000","last_became_active":"2024-09-15T22:14:13.854336+0000","last_became_peered":"2024-09-15T22:14:13.854336+0000","last_unstale":"2024-09-15T22:16:17.559191+0000","last_undegraded":"2024-09-15T22:16:17.559191+0000","last_fullsized":"2024-09-15T22:16:17.559191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:13.819532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.600465+0000","last_change":"2024-09-15T22:14:06.806829+0000","last_active":"2024-09-15T22:16:17.600465+0000","last_peered":"2024-09-15T22:16:17.600465+0000","last_clean":"2024-09-15T22:16:17.600465+0000","last_became_active":"2024-09-15T22:14:06.806521+0000","last_became_peered":"2024-09-15T22:14:06.806521+0000","last_unstale":"2024-09-15T22:16:17.600465+0000","last_undegraded":"2024-09-15T22:16:17.600465+0000","last_fullsized":"2024-09-15T22:16:17.600465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:50.983246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552274+0000","last_change":"2024-09-15T22:14:04.717722+0000","last_active":"2024-09-15T22:16:17.552274+0000","last_peered":"2024-09-15T22:16:17.552274+0000","last_clean":"2024-09-15T22:16:17.552274+0000","last_became_active":"2024-09-15T22:14:04.717201+0000","last_became_peered":"2024-09-15T22:14:04.717201+0000","last_unstale":"2024-09-15T22:16:17.552274+0000","last_undegraded":"2024-09-15T22:16:17.552274+0000","last_fullsized":"2024-09-15T22:16:17.552274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:50.545847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545450+0000","last_change":"2024-09-15T22:14:13.852874+0000","last_active":"2024-09-15T22:16:17.545450+0000","last_peered":"2024-09-15T22:16:17.545450+0000","last_clean":"2024-09-15T22:16:17.545450+0000","last_became_active":"2024-09-15T22:14:13.852426+0000","last_became_peered":"2024-09-15T22:14:13.852426+0000","last_unstale":"2024-09-15T22:16:17.545450+0000","last_undegraded":"2024-09-15T22:16:17.545450+0000","last_fullsized":"2024-09-15T22:16:17.545450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:02:19.215156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579481+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:16:17.579481+0000","last_peered":"2024-09-15T22:16:17.579481+0000","last_clean":"2024-09-15T22:16:17.579481+0000","last_became_active":"2024-09-15T22:14:06.809013+0000","last_became_peered":"2024-09-15T22:14:06.809013+0000","last_unstale":"2024-09-15T22:16:17.579481+0000","last_undegraded":"2024-09-15T22:16:17.579481+0000","last_fullsized":"2024-09-15T22:16:17.579481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:47.830385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":296,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:28.101983+0000","last_change":"2024-09-15T22:14:04.721020+0000","last_active":"2024-09-15T22:16:28.101983+0000","last_peered":"2024-09-15T22:16:28.101983+0000","last_clean":"2024-09-15T22:16:28.101983+0000","last_became_active":"2024-09-15T22:14:04.720613+0000","last_became_peered":"2024-09-15T22:14:04.720613+0000","last_unstale":"2024-09-15T22:16:28.101983+0000","last_undegraded":"2024-09-15T22:16:28.101983+0000","last_fullsized":"2024-09-15T22:16:28.101983+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:42.719346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71847,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":221,"num_read_kb":182,"num_write":38,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555319+0000","last_change":"2024-09-15T22:14:13.854250+0000","last_active":"2024-09-15T22:16:17.555319+0000","last_peered":"2024-09-15T22:16:17.555319+0000","last_clean":"2024-09-15T22:16:17.555319+0000","last_became_active":"2024-09-15T22:14:13.852972+0000","last_became_peered":"2024-09-15T22:14:13.852972+0000","last_unstale":"2024-09-15T22:16:17.555319+0000","last_undegraded":"2024-09-15T22:16:17.555319+0000","last_fullsized":"2024-09-15T22:16:17.555319+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:50:45.301446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596123+0000","last_change":"2024-09-15T22:14:06.813789+0000","last_active":"2024-09-15T22:16:17.596123+0000","last_peered":"2024-09-15T22:16:17.596123+0000","last_clean":"2024-09-15T22:16:17.596123+0000","last_became_active":"2024-09-15T22:14:06.813501+0000","last_became_peered":"2024-09-15T22:14:06.813501+0000","last_unstale":"2024-09-15T22:16:17.596123+0000","last_undegraded":"2024-09-15T22:16:17.596123+0000","last_fullsized":"2024-09-15T22:16:17.596123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:40.032952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545628+0000","last_change":"2024-09-15T22:14:05.018957+0000","last_active":"2024-09-15T22:16:17.545628+0000","last_peered":"2024-09-15T22:16:17.545628+0000","last_clean":"2024-09-15T22:16:17.545628+0000","last_became_active":"2024-09-15T22:14:05.018602+0000","last_became_peered":"2024-09-15T22:14:05.018602+0000","last_unstale":"2024-09-15T22:16:17.545628+0000","last_undegraded":"2024-09-15T22:16:17.545628+0000","last_fullsized":"2024-09-15T22:16:17.545628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:48.839341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555029+0000","last_change":"2024-09-15T22:15:17.332417+0000","last_active":"2024-09-15T22:16:17.555029+0000","last_peered":"2024-09-15T22:16:17.555029+0000","last_clean":"2024-09-15T22:16:17.555029+0000","last_became_active":"2024-09-15T22:15:17.331771+0000","last_became_peered":"2024-09-15T22:15:17.331771+0000","last_unstale":"2024-09-15T22:16:17.555029+0000","last_undegraded":"2024-09-15T22:16:17.555029+0000","last_fullsized":"2024-09-15T22:16:17.555029+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:08.575035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603399+0000","last_change":"2024-09-15T22:14:06.814876+0000","last_active":"2024-09-15T22:16:17.603399+0000","last_peered":"2024-09-15T22:16:17.603399+0000","last_clean":"2024-09-15T22:16:17.603399+0000","last_became_active":"2024-09-15T22:14:06.814120+0000","last_became_peered":"2024-09-15T22:14:06.814120+0000","last_unstale":"2024-09-15T22:16:17.603399+0000","last_undegraded":"2024-09-15T22:16:17.603399+0000","last_fullsized":"2024-09-15T22:16:17.603399+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:37.417618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555352+0000","last_change":"2024-09-15T22:14:04.719281+0000","last_active":"2024-09-15T22:16:17.555352+0000","last_peered":"2024-09-15T22:16:17.555352+0000","last_clean":"2024-09-15T22:16:17.555352+0000","last_became_active":"2024-09-15T22:14:04.718856+0000","last_became_peered":"2024-09-15T22:14:04.718856+0000","last_unstale":"2024-09-15T22:16:17.555352+0000","last_undegraded":"2024-09-15T22:16:17.555352+0000","last_fullsized":"2024-09-15T22:16:17.555352+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:22.137825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554629+0000","last_change":"2024-09-15T22:14:13.847398+0000","last_active":"2024-09-15T22:16:17.554629+0000","last_peered":"2024-09-15T22:16:17.554629+0000","last_clean":"2024-09-15T22:16:17.554629+0000","last_became_active":"2024-09-15T22:14:13.846870+0000","last_became_peered":"2024-09-15T22:14:13.846870+0000","last_unstale":"2024-09-15T22:16:17.554629+0000","last_undegraded":"2024-09-15T22:16:17.554629+0000","last_fullsized":"2024-09-15T22:16:17.554629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:58.872716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595875+0000","last_change":"2024-09-15T22:14:06.810412+0000","last_active":"2024-09-15T22:16:17.595875+0000","last_peered":"2024-09-15T22:16:17.595875+0000","last_clean":"2024-09-15T22:16:17.595875+0000","last_became_active":"2024-09-15T22:14:06.809669+0000","last_became_peered":"2024-09-15T22:14:06.809669+0000","last_unstale":"2024-09-15T22:16:17.595875+0000","last_undegraded":"2024-09-15T22:16:17.595875+0000","last_fullsized":"2024-09-15T22:16:17.595875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:44.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.549857+0000","last_change":"2024-09-15T22:14:04.715509+0000","last_active":"2024-09-15T22:16:17.549857+0000","last_peered":"2024-09-15T22:16:17.549857+0000","last_clean":"2024-09-15T22:16:17.549857+0000","last_became_active":"2024-09-15T22:14:04.715169+0000","last_became_peered":"2024-09-15T22:14:04.715169+0000","last_unstale":"2024-09-15T22:16:17.549857+0000","last_undegraded":"2024-09-15T22:16:17.549857+0000","last_fullsized":"2024-09-15T22:16:17.549857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:21.884103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554221+0000","last_change":"2024-09-15T22:15:17.219519+0000","last_active":"2024-09-15T22:16:17.554221+0000","last_peered":"2024-09-15T22:16:17.554221+0000","last_clean":"2024-09-15T22:16:17.554221+0000","last_became_active":"2024-09-15T22:15:17.219106+0000","last_became_peered":"2024-09-15T22:15:17.219106+0000","last_unstale":"2024-09-15T22:16:17.554221+0000","last_undegraded":"2024-09-15T22:16:17.554221+0000","last_fullsized":"2024-09-15T22:16:17.554221+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:54:08.102329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.562557+0000","last_change":"2024-09-15T22:14:13.844375+0000","last_active":"2024-09-15T22:16:17.562557+0000","last_peered":"2024-09-15T22:16:17.562557+0000","last_clean":"2024-09-15T22:16:17.562557+0000","last_became_active":"2024-09-15T22:14:13.843918+0000","last_became_peered":"2024-09-15T22:14:13.843918+0000","last_unstale":"2024-09-15T22:16:17.562557+0000","last_undegraded":"2024-09-15T22:16:17.562557+0000","last_fullsized":"2024-09-15T22:16:17.562557+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:32.190119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606349+0000","last_change":"2024-09-15T22:14:06.809534+0000","last_active":"2024-09-15T22:16:17.606349+0000","last_peered":"2024-09-15T22:16:17.606349+0000","last_clean":"2024-09-15T22:16:17.606349+0000","last_became_active":"2024-09-15T22:14:06.809147+0000","last_became_peered":"2024-09-15T22:14:06.809147+0000","last_unstale":"2024-09-15T22:16:17.606349+0000","last_undegraded":"2024-09-15T22:16:17.606349+0000","last_fullsized":"2024-09-15T22:16:17.606349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:14.930542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545382+0000","last_change":"2024-09-15T22:14:04.715347+0000","last_active":"2024-09-15T22:16:17.545382+0000","last_peered":"2024-09-15T22:16:17.545382+0000","last_clean":"2024-09-15T22:16:17.545382+0000","last_became_active":"2024-09-15T22:14:04.715049+0000","last_became_peered":"2024-09-15T22:14:04.715049+0000","last_unstale":"2024-09-15T22:16:17.545382+0000","last_undegraded":"2024-09-15T22:16:17.545382+0000","last_fullsized":"2024-09-15T22:16:17.545382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:04.943344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.567570+0000","last_change":"2024-09-15T22:14:13.852397+0000","last_active":"2024-09-15T22:16:17.567570+0000","last_peered":"2024-09-15T22:16:17.567570+0000","last_clean":"2024-09-15T22:16:17.567570+0000","last_became_active":"2024-09-15T22:14:13.851863+0000","last_became_peered":"2024-09-15T22:14:13.851863+0000","last_unstale":"2024-09-15T22:16:17.567570+0000","last_undegraded":"2024-09-15T22:16:17.567570+0000","last_fullsized":"2024-09-15T22:16:17.567570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:38.242241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606188+0000","last_change":"2024-09-15T22:14:06.809084+0000","last_active":"2024-09-15T22:16:17.606188+0000","last_peered":"2024-09-15T22:16:17.606188+0000","last_clean":"2024-09-15T22:16:17.606188+0000","last_became_active":"2024-09-15T22:14:06.808725+0000","last_became_peered":"2024-09-15T22:14:06.808725+0000","last_unstale":"2024-09-15T22:16:17.606188+0000","last_undegraded":"2024-09-15T22:16:17.606188+0000","last_fullsized":"2024-09-15T22:16:17.606188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:37.451661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540329+0000","last_change":"2024-09-15T22:14:04.714279+0000","last_active":"2024-09-15T22:16:17.540329+0000","last_peered":"2024-09-15T22:16:17.540329+0000","last_clean":"2024-09-15T22:16:17.540329+0000","last_became_active":"2024-09-15T22:14:04.713751+0000","last_became_peered":"2024-09-15T22:14:04.713751+0000","last_unstale":"2024-09-15T22:16:17.540329+0000","last_undegraded":"2024-09-15T22:16:17.540329+0000","last_fullsized":"2024-09-15T22:16:17.540329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:34.268701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.549598+0000","last_change":"2024-09-15T22:14:04.716417+0000","last_active":"2024-09-15T22:16:17.549598+0000","last_peered":"2024-09-15T22:16:17.549598+0000","last_clean":"2024-09-15T22:16:17.549598+0000","last_became_active":"2024-09-15T22:14:04.716096+0000","last_became_peered":"2024-09-15T22:14:04.716096+0000","last_unstale":"2024-09-15T22:16:17.549598+0000","last_undegraded":"2024-09-15T22:16:17.549598+0000","last_fullsized":"2024-09-15T22:16:17.549598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:30.819060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601287+0000","last_change":"2024-09-15T22:15:17.403940+0000","last_active":"2024-09-15T22:16:17.601287+0000","last_peered":"2024-09-15T22:16:17.601287+0000","last_clean":"2024-09-15T22:16:17.601287+0000","last_became_active":"2024-09-15T22:15:17.403517+0000","last_became_peered":"2024-09-15T22:15:17.403517+0000","last_unstale":"2024-09-15T22:16:17.601287+0000","last_undegraded":"2024-09-15T22:16:17.601287+0000","last_fullsized":"2024-09-15T22:16:17.601287+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:49.602367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552004+0000","last_change":"2024-09-15T22:15:17.404136+0000","last_active":"2024-09-15T22:16:17.552004+0000","last_peered":"2024-09-15T22:16:17.552004+0000","last_clean":"2024-09-15T22:16:17.552004+0000","last_became_active":"2024-09-15T22:15:17.403652+0000","last_became_peered":"2024-09-15T22:15:17.403652+0000","last_unstale":"2024-09-15T22:16:17.552004+0000","last_undegraded":"2024-09-15T22:16:17.552004+0000","last_fullsized":"2024-09-15T22:16:17.552004+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:31.518956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545473+0000","last_change":"2024-09-15T22:14:04.718682+0000","last_active":"2024-09-15T22:16:17.545473+0000","last_peered":"2024-09-15T22:16:17.545473+0000","last_clean":"2024-09-15T22:16:17.545473+0000","last_became_active":"2024-09-15T22:14:04.718313+0000","last_became_peered":"2024-09-15T22:14:04.718313+0000","last_unstale":"2024-09-15T22:16:17.545473+0000","last_undegraded":"2024-09-15T22:16:17.545473+0000","last_fullsized":"2024-09-15T22:16:17.545473+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:47.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595742+0000","last_change":"2024-09-15T22:14:06.819632+0000","last_active":"2024-09-15T22:16:17.595742+0000","last_peered":"2024-09-15T22:16:17.595742+0000","last_clean":"2024-09-15T22:16:17.595742+0000","last_became_active":"2024-09-15T22:14:06.819135+0000","last_became_peered":"2024-09-15T22:14:06.819135+0000","last_unstale":"2024-09-15T22:16:17.595742+0000","last_undegraded":"2024-09-15T22:16:17.595742+0000","last_fullsized":"2024-09-15T22:16:17.595742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:35.708318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552345+0000","last_change":"2024-09-15T22:14:13.851367+0000","last_active":"2024-09-15T22:16:17.552345+0000","last_peered":"2024-09-15T22:16:17.552345+0000","last_clean":"2024-09-15T22:16:17.552345+0000","last_became_active":"2024-09-15T22:14:13.850999+0000","last_became_peered":"2024-09-15T22:14:13.850999+0000","last_unstale":"2024-09-15T22:16:17.552345+0000","last_undegraded":"2024-09-15T22:16:17.552345+0000","last_fullsized":"2024-09-15T22:16:17.552345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:40:03.957622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582014+0000","last_change":"2024-09-15T22:14:06.817213+0000","last_active":"2024-09-15T22:16:17.582014+0000","last_peered":"2024-09-15T22:16:17.582014+0000","last_clean":"2024-09-15T22:16:17.582014+0000","last_became_active":"2024-09-15T22:14:06.816828+0000","last_became_peered":"2024-09-15T22:14:06.816828+0000","last_unstale":"2024-09-15T22:16:17.582014+0000","last_undegraded":"2024-09-15T22:16:17.582014+0000","last_fullsized":"2024-09-15T22:16:17.582014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:55.042256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.590899+0000","last_change":"2024-09-15T22:14:06.814832+0000","last_active":"2024-09-15T22:16:17.590899+0000","last_peered":"2024-09-15T22:16:17.590899+0000","last_clean":"2024-09-15T22:16:17.590899+0000","last_became_active":"2024-09-15T22:14:06.814500+0000","last_became_peered":"2024-09-15T22:14:06.814500+0000","last_unstale":"2024-09-15T22:16:17.590899+0000","last_undegraded":"2024-09-15T22:16:17.590899+0000","last_fullsized":"2024-09-15T22:16:17.590899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:43.623629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603884+0000","last_change":"2024-09-15T22:14:06.809464+0000","last_active":"2024-09-15T22:16:17.603884+0000","last_peered":"2024-09-15T22:16:17.603884+0000","last_clean":"2024-09-15T22:16:17.603884+0000","last_became_active":"2024-09-15T22:14:06.809160+0000","last_became_peered":"2024-09-15T22:14:06.809160+0000","last_unstale":"2024-09-15T22:16:17.603884+0000","last_undegraded":"2024-09-15T22:16:17.603884+0000","last_fullsized":"2024-09-15T22:16:17.603884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:04.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606874+0000","last_change":"2024-09-15T22:14:06.814428+0000","last_active":"2024-09-15T22:16:17.606874+0000","last_peered":"2024-09-15T22:16:17.606874+0000","last_clean":"2024-09-15T22:16:17.606874+0000","last_became_active":"2024-09-15T22:14:06.814100+0000","last_became_peered":"2024-09-15T22:14:06.814100+0000","last_unstale":"2024-09-15T22:16:17.606874+0000","last_undegraded":"2024-09-15T22:16:17.606874+0000","last_fullsized":"2024-09-15T22:16:17.606874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:33.606766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606907+0000","last_change":"2024-09-15T22:14:06.815638+0000","last_active":"2024-09-15T22:16:17.606907+0000","last_peered":"2024-09-15T22:16:17.606907+0000","last_clean":"2024-09-15T22:16:17.606907+0000","last_became_active":"2024-09-15T22:14:06.815327+0000","last_became_peered":"2024-09-15T22:14:06.815327+0000","last_unstale":"2024-09-15T22:16:17.606907+0000","last_undegraded":"2024-09-15T22:16:17.606907+0000","last_fullsized":"2024-09-15T22:16:17.606907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:07.679547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.580925+0000","last_change":"2024-09-15T22:15:17.218238+0000","last_active":"2024-09-15T22:16:17.580925+0000","last_peered":"2024-09-15T22:16:17.580925+0000","last_clean":"2024-09-15T22:16:17.580925+0000","last_became_active":"2024-09-15T22:15:17.217852+0000","last_became_peered":"2024-09-15T22:15:17.217852+0000","last_unstale":"2024-09-15T22:16:17.580925+0000","last_undegraded":"2024-09-15T22:16:17.580925+0000","last_fullsized":"2024-09-15T22:16:17.580925+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:42.046956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.576752+0000","last_change":"2024-09-15T22:14:06.819667+0000","last_active":"2024-09-15T22:16:17.576752+0000","last_peered":"2024-09-15T22:16:17.576752+0000","last_clean":"2024-09-15T22:16:17.576752+0000","last_became_active":"2024-09-15T22:14:06.819389+0000","last_became_peered":"2024-09-15T22:14:06.819389+0000","last_unstale":"2024-09-15T22:16:17.576752+0000","last_undegraded":"2024-09-15T22:16:17.576752+0000","last_fullsized":"2024-09-15T22:16:17.576752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:16.571088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.597582+0000","last_change":"2024-09-15T22:15:17.118133+0000","last_active":"2024-09-15T22:16:17.597582+0000","last_peered":"2024-09-15T22:16:17.597582+0000","last_clean":"2024-09-15T22:16:17.597582+0000","last_became_active":"2024-09-15T22:15:17.117802+0000","last_became_peered":"2024-09-15T22:15:17.117802+0000","last_unstale":"2024-09-15T22:16:17.597582+0000","last_undegraded":"2024-09-15T22:16:17.597582+0000","last_fullsized":"2024-09-15T22:16:17.597582+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:21.523149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.600039+0000","last_change":"2024-09-15T22:14:06.801454+0000","last_active":"2024-09-15T22:16:17.600039+0000","last_peered":"2024-09-15T22:16:17.600039+0000","last_clean":"2024-09-15T22:16:17.600039+0000","last_became_active":"2024-09-15T22:14:06.801105+0000","last_became_peered":"2024-09-15T22:14:06.801105+0000","last_unstale":"2024-09-15T22:16:17.600039+0000","last_undegraded":"2024-09-15T22:16:17.600039+0000","last_fullsized":"2024-09-15T22:16:17.600039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:32.457428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596301+0000","last_change":"2024-09-15T22:14:06.812603+0000","last_active":"2024-09-15T22:16:17.596301+0000","last_peered":"2024-09-15T22:16:17.596301+0000","last_clean":"2024-09-15T22:16:17.596301+0000","last_became_active":"2024-09-15T22:14:06.812208+0000","last_became_peered":"2024-09-15T22:14:06.812208+0000","last_unstale":"2024-09-15T22:16:17.596301+0000","last_undegraded":"2024-09-15T22:16:17.596301+0000","last_fullsized":"2024-09-15T22:16:17.596301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:55.327481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595802+0000","last_change":"2024-09-15T22:14:06.811783+0000","last_active":"2024-09-15T22:16:17.595802+0000","last_peered":"2024-09-15T22:16:17.595802+0000","last_clean":"2024-09-15T22:16:17.595802+0000","last_became_active":"2024-09-15T22:14:06.811208+0000","last_became_peered":"2024-09-15T22:14:06.811208+0000","last_unstale":"2024-09-15T22:16:17.595802+0000","last_undegraded":"2024-09-15T22:16:17.595802+0000","last_fullsized":"2024-09-15T22:16:17.595802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:15.576776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.607074+0000","last_change":"2024-09-15T22:14:06.818608+0000","last_active":"2024-09-15T22:16:17.607074+0000","last_peered":"2024-09-15T22:16:17.607074+0000","last_clean":"2024-09-15T22:16:17.607074+0000","last_became_active":"2024-09-15T22:14:06.818283+0000","last_became_peered":"2024-09-15T22:14:06.818283+0000","last_unstale":"2024-09-15T22:16:17.607074+0000","last_undegraded":"2024-09-15T22:16:17.607074+0000","last_fullsized":"2024-09-15T22:16:17.607074+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:02.477461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.593536+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:16:17.593536+0000","last_peered":"2024-09-15T22:16:17.593536+0000","last_clean":"2024-09-15T22:16:17.593536+0000","last_became_active":"2024-09-15T22:14:06.809043+0000","last_became_peered":"2024-09-15T22:14:06.809043+0000","last_unstale":"2024-09-15T22:16:17.593536+0000","last_undegraded":"2024-09-15T22:16:17.593536+0000","last_fullsized":"2024-09-15T22:16:17.593536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:58.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598619+0000","last_change":"2024-09-15T22:14:06.814875+0000","last_active":"2024-09-15T22:16:17.598619+0000","last_peered":"2024-09-15T22:16:17.598619+0000","last_clean":"2024-09-15T22:16:17.598619+0000","last_became_active":"2024-09-15T22:14:06.814543+0000","last_became_peered":"2024-09-15T22:14:06.814543+0000","last_unstale":"2024-09-15T22:16:17.598619+0000","last_undegraded":"2024-09-15T22:16:17.598619+0000","last_fullsized":"2024-09-15T22:16:17.598619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:57.465965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595163+0000","last_change":"2024-09-15T22:14:06.810655+0000","last_active":"2024-09-15T22:16:17.595163+0000","last_peered":"2024-09-15T22:16:17.595163+0000","last_clean":"2024-09-15T22:16:17.595163+0000","last_became_active":"2024-09-15T22:14:06.810159+0000","last_became_peered":"2024-09-15T22:14:06.810159+0000","last_unstale":"2024-09-15T22:16:17.595163+0000","last_undegraded":"2024-09-15T22:16:17.595163+0000","last_fullsized":"2024-09-15T22:16:17.595163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:17.368982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604239+0000","last_change":"2024-09-15T22:14:06.815048+0000","last_active":"2024-09-15T22:16:17.604239+0000","last_peered":"2024-09-15T22:16:17.604239+0000","last_clean":"2024-09-15T22:16:17.604239+0000","last_became_active":"2024-09-15T22:14:06.814744+0000","last_became_peered":"2024-09-15T22:14:06.814744+0000","last_unstale":"2024-09-15T22:16:17.604239+0000","last_undegraded":"2024-09-15T22:16:17.604239+0000","last_fullsized":"2024-09-15T22:16:17.604239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:26.927942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606940+0000","last_change":"2024-09-15T22:14:06.811672+0000","last_active":"2024-09-15T22:16:17.606940+0000","last_peered":"2024-09-15T22:16:17.606940+0000","last_clean":"2024-09-15T22:16:17.606940+0000","last_became_active":"2024-09-15T22:14:06.811300+0000","last_became_peered":"2024-09-15T22:14:06.811300+0000","last_unstale":"2024-09-15T22:16:17.606940+0000","last_undegraded":"2024-09-15T22:16:17.606940+0000","last_fullsized":"2024-09-15T22:16:17.606940+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:46.223584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603117+0000","last_change":"2024-09-15T22:14:06.814495+0000","last_active":"2024-09-15T22:16:17.603117+0000","last_peered":"2024-09-15T22:16:17.603117+0000","last_clean":"2024-09-15T22:16:17.603117+0000","last_became_active":"2024-09-15T22:14:06.814142+0000","last_became_peered":"2024-09-15T22:14:06.814142+0000","last_unstale":"2024-09-15T22:16:17.603117+0000","last_undegraded":"2024-09-15T22:16:17.603117+0000","last_fullsized":"2024-09-15T22:16:17.603117+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:20.374348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606333+0000","last_change":"2024-09-15T22:14:06.811063+0000","last_active":"2024-09-15T22:16:17.606333+0000","last_peered":"2024-09-15T22:16:17.606333+0000","last_clean":"2024-09-15T22:16:17.606333+0000","last_became_active":"2024-09-15T22:14:06.810700+0000","last_became_peered":"2024-09-15T22:14:06.810700+0000","last_unstale":"2024-09-15T22:16:17.606333+0000","last_undegraded":"2024-09-15T22:16:17.606333+0000","last_fullsized":"2024-09-15T22:16:17.606333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:11.250590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605660+0000","last_change":"2024-09-15T22:14:06.816896+0000","last_active":"2024-09-15T22:16:17.605660+0000","last_peered":"2024-09-15T22:16:17.605660+0000","last_clean":"2024-09-15T22:16:17.605660+0000","last_became_active":"2024-09-15T22:14:06.816559+0000","last_became_peered":"2024-09-15T22:14:06.816559+0000","last_unstale":"2024-09-15T22:16:17.605660+0000","last_undegraded":"2024-09-15T22:16:17.605660+0000","last_fullsized":"2024-09-15T22:16:17.605660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:17.965490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.592573+0000","last_change":"2024-09-15T22:14:06.813984+0000","last_active":"2024-09-15T22:16:17.592573+0000","last_peered":"2024-09-15T22:16:17.592573+0000","last_clean":"2024-09-15T22:16:17.592573+0000","last_became_active":"2024-09-15T22:14:06.813586+0000","last_became_peered":"2024-09-15T22:14:06.813586+0000","last_unstale":"2024-09-15T22:16:17.592573+0000","last_undegraded":"2024-09-15T22:16:17.592573+0000","last_fullsized":"2024-09-15T22:16:17.592573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:34.335741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596558+0000","last_change":"2024-09-15T22:14:06.816047+0000","last_active":"2024-09-15T22:16:17.596558+0000","last_peered":"2024-09-15T22:16:17.596558+0000","last_clean":"2024-09-15T22:16:17.596558+0000","last_became_active":"2024-09-15T22:14:06.815244+0000","last_became_peered":"2024-09-15T22:14:06.815244+0000","last_unstale":"2024-09-15T22:16:17.596558+0000","last_undegraded":"2024-09-15T22:16:17.596558+0000","last_fullsized":"2024-09-15T22:16:17.596558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:30.469382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.583325+0000","last_change":"2024-09-15T22:14:06.813254+0000","last_active":"2024-09-15T22:16:17.583325+0000","last_peered":"2024-09-15T22:16:17.583325+0000","last_clean":"2024-09-15T22:16:17.583325+0000","last_became_active":"2024-09-15T22:14:06.812921+0000","last_became_peered":"2024-09-15T22:14:06.812921+0000","last_unstale":"2024-09-15T22:16:17.583325+0000","last_undegraded":"2024-09-15T22:16:17.583325+0000","last_fullsized":"2024-09-15T22:16:17.583325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:40.674246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595905+0000","last_change":"2024-09-15T22:14:06.817016+0000","last_active":"2024-09-15T22:16:17.595905+0000","last_peered":"2024-09-15T22:16:17.595905+0000","last_clean":"2024-09-15T22:16:17.595905+0000","last_became_active":"2024-09-15T22:14:06.816256+0000","last_became_peered":"2024-09-15T22:14:06.816256+0000","last_unstale":"2024-09-15T22:16:17.595905+0000","last_undegraded":"2024-09-15T22:16:17.595905+0000","last_fullsized":"2024-09-15T22:16:17.595905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:37.092156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.585070+0000","last_change":"2024-09-15T22:15:17.331108+0000","last_active":"2024-09-15T22:16:17.585070+0000","last_peered":"2024-09-15T22:16:17.585070+0000","last_clean":"2024-09-15T22:16:17.585070+0000","last_became_active":"2024-09-15T22:15:17.330765+0000","last_became_peered":"2024-09-15T22:15:17.330765+0000","last_unstale":"2024-09-15T22:16:17.585070+0000","last_undegraded":"2024-09-15T22:16:17.585070+0000","last_fullsized":"2024-09-15T22:16:17.585070+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:37.975326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582652+0000","last_change":"2024-09-15T22:14:06.814902+0000","last_active":"2024-09-15T22:16:17.582652+0000","last_peered":"2024-09-15T22:16:17.582652+0000","last_clean":"2024-09-15T22:16:17.582652+0000","last_became_active":"2024-09-15T22:14:06.814563+0000","last_became_peered":"2024-09-15T22:14:06.814563+0000","last_unstale":"2024-09-15T22:16:17.582652+0000","last_undegraded":"2024-09-15T22:16:17.582652+0000","last_fullsized":"2024-09-15T22:16:17.582652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:02.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.580466+0000","last_change":"2024-09-15T22:14:06.807444+0000","last_active":"2024-09-15T22:16:17.580466+0000","last_peered":"2024-09-15T22:16:17.580466+0000","last_clean":"2024-09-15T22:16:17.580466+0000","last_became_active":"2024-09-15T22:14:06.807083+0000","last_became_peered":"2024-09-15T22:14:06.807083+0000","last_unstale":"2024-09-15T22:16:17.580466+0000","last_undegraded":"2024-09-15T22:16:17.580466+0000","last_fullsized":"2024-09-15T22:16:17.580466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:07.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598596+0000","last_change":"2024-09-15T22:14:06.811851+0000","last_active":"2024-09-15T22:16:17.598596+0000","last_peered":"2024-09-15T22:16:17.598596+0000","last_clean":"2024-09-15T22:16:17.598596+0000","last_became_active":"2024-09-15T22:14:06.811451+0000","last_became_peered":"2024-09-15T22:14:06.811451+0000","last_unstale":"2024-09-15T22:16:17.598596+0000","last_undegraded":"2024-09-15T22:16:17.598596+0000","last_fullsized":"2024-09-15T22:16:17.598596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:51.389555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.589842+0000","last_change":"2024-09-15T22:14:06.812520+0000","last_active":"2024-09-15T22:16:17.589842+0000","last_peered":"2024-09-15T22:16:17.589842+0000","last_clean":"2024-09-15T22:16:17.589842+0000","last_became_active":"2024-09-15T22:14:06.812222+0000","last_became_peered":"2024-09-15T22:14:06.812222+0000","last_unstale":"2024-09-15T22:16:17.589842+0000","last_undegraded":"2024-09-15T22:16:17.589842+0000","last_fullsized":"2024-09-15T22:16:17.589842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:01.589678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604461+0000","last_change":"2024-09-15T22:14:06.808649+0000","last_active":"2024-09-15T22:16:17.604461+0000","last_peered":"2024-09-15T22:16:17.604461+0000","last_clean":"2024-09-15T22:16:17.604461+0000","last_became_active":"2024-09-15T22:14:06.808278+0000","last_became_peered":"2024-09-15T22:14:06.808278+0000","last_unstale":"2024-09-15T22:16:17.604461+0000","last_undegraded":"2024-09-15T22:16:17.604461+0000","last_fullsized":"2024-09-15T22:16:17.604461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:32.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605104+0000","last_change":"2024-09-15T22:14:06.811593+0000","last_active":"2024-09-15T22:16:17.605104+0000","last_peered":"2024-09-15T22:16:17.605104+0000","last_clean":"2024-09-15T22:16:17.605104+0000","last_became_active":"2024-09-15T22:14:06.811285+0000","last_became_peered":"2024-09-15T22:14:06.811285+0000","last_unstale":"2024-09-15T22:16:17.605104+0000","last_undegraded":"2024-09-15T22:16:17.605104+0000","last_fullsized":"2024-09-15T22:16:17.605104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:36.482554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604430+0000","last_change":"2024-09-15T22:14:06.816084+0000","last_active":"2024-09-15T22:16:17.604430+0000","last_peered":"2024-09-15T22:16:17.604430+0000","last_clean":"2024-09-15T22:16:17.604430+0000","last_became_active":"2024-09-15T22:14:06.815461+0000","last_became_peered":"2024-09-15T22:14:06.815461+0000","last_unstale":"2024-09-15T22:16:17.604430+0000","last_undegraded":"2024-09-15T22:16:17.604430+0000","last_fullsized":"2024-09-15T22:16:17.604430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:57.455608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":794093,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":562,"num_read_kb":488,"num_write":330,"num_write_kb":2328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2482176,"data_stored":2382279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547242,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1028096,"data_stored":511054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776174,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29140,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716012,"statfs":{"total":95995035648,"available":95965196288,"internally_reserved":0,"allocated":2043904,"data_stored":1497599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939699,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36740,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708412,"statfs":{"total":95995035648,"available":95957413888,"internally_reserved":0,"allocated":1429504,"data_stored":908948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168633,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36740,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708412,"statfs":{"total":95995035648,"available":95957413888,"internally_reserved":0,"allocated":1429504,"data_stored":904874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430269,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1630208,"data_stored":1106100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593795,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1024000,"data_stored":506958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822728,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37384,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707768,"statfs":{"total":95995035648,"available":95956754432,"internally_reserved":0,"allocated":1966080,"data_stored":1429836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986252,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1032192,"data_stored":511076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215186,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28860,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716292,"statfs":{"total":95995035648,"available":95965483008,"internally_reserved":0,"allocated":1757184,"data_stored":1228510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1110016,"data_stored":578839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1105920,"data_stored":578805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40512,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704640,"statfs":{"total":95995035648,"available":95953551360,"internally_reserved":0,"allocated":1028096,"data_stored":507048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":733184,"data_stored":721552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":328414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":393820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":400273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:16:33.486 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T22:16:33.486 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T22:16:33.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:33 smithi100 ceph-mon[35319]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 76 KiB/s wr, 42 op/s 2024-09-15T22:16:33.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:33 smithi165 ceph-mon[35551]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 76 KiB/s wr, 42 op/s 2024-09-15T22:16:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.765+0000 7f5437ec6640 1 -- 172.21.15.45:0/204835845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430102ef0 msgr2=0x7f543010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.765+0000 7f5437ec6640 1 --2- 172.21.15.45:0/204835845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430102ef0 0x7f543010da40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5428009ca0 tx=0x7f542802a950 comp rx=0 tx=0).stop 2024-09-15T22:16:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.765+0000 7f5437ec6640 1 -- 172.21.15.45:0/204835845 shutdown_connections 2024-09-15T22:16:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.765+0000 7f5437ec6640 1 --2- 172.21.15.45:0/204835845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430102ef0 0x7f543010da40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.765+0000 7f5437ec6640 1 --2- 172.21.15.45:0/204835845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5430102570 0x7f54301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.765+0000 7f5437ec6640 1 --2- 172.21.15.45:0/204835845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5430100e20 0x7f5430101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.765+0000 7f5437ec6640 1 -- 172.21.15.45:0/204835845 >> 172.21.15.45:0/204835845 conn(0x7f54300fc7d0 msgr2=0x7f54300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.765+0000 7f5437ec6640 1 -- 172.21.15.45:0/204835845 shutdown_connections 2024-09-15T22:16:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.765+0000 7f5437ec6640 1 -- 172.21.15.45:0/204835845 wait complete. 2024-09-15T22:16:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5437ec6640 1 Processor -- start 2024-09-15T22:16:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5437ec6640 1 -- start start 2024-09-15T22:16:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5437ec6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430100e20 0x7f54301984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5437ec6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5430102570 0x7f5430198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5437ec6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5430102ef0 0x7f543019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5437ec6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f54301121f0 con 0x7f5430100e20 2024-09-15T22:16:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5437ec6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5430112070 con 0x7f5430102ef0 2024-09-15T22:16:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5437ec6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5430112370 con 0x7f5430102570 2024-09-15T22:16:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5435c62640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430100e20 0x7f54301984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5435c62640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430100e20 0x7f54301984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34854/0 (socket says 172.21.15.45:34854) 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5435c62640 1 -- 172.21.15.45:0/171460209 learned_addr learned my addr 172.21.15.45:0/171460209 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5435461640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5430102570 0x7f5430198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5436463640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5430102ef0 0x7f543019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5435c62640 1 -- 172.21.15.45:0/171460209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5430102570 msgr2=0x7f5430198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5435c62640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5430102570 0x7f5430198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5435c62640 1 -- 172.21.15.45:0/171460209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5430102ef0 msgr2=0x7f543019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5435c62640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5430102ef0 0x7f543019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5435c62640 1 -- 172.21.15.45:0/171460209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543019d480 con 0x7f5430100e20 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.766+0000 7f5436463640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5430102ef0 0x7f543019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.767+0000 7f5435c62640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430100e20 0x7f54301984d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f542c00d770 tx=0x7f542c00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.767+0000 7f5426ffd640 1 -- 172.21.15.45:0/171460209 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c017070 con 0x7f5430100e20 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.767+0000 7f5426ffd640 1 -- 172.21.15.45:0/171460209 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f542c009820 con 0x7f5430100e20 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.767+0000 7f5437ec6640 1 -- 172.21.15.45:0/171460209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f543019d770 con 0x7f5430100e20 2024-09-15T22:16:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.767+0000 7f5426ffd640 1 -- 172.21.15.45:0/171460209 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c004dd0 con 0x7f5430100e20 2024-09-15T22:16:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.767+0000 7f5437ec6640 1 -- 172.21.15.45:0/171460209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54301a5050 con 0x7f5430100e20 2024-09-15T22:16:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.769+0000 7f5426ffd640 1 -- 172.21.15.45:0/171460209 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f542c0099d0 con 0x7f5430100e20 2024-09-15T22:16:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.770+0000 7f543a29f740 1 Processor -- start 2024-09-15T22:16:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.770+0000 7f543a29f740 1 -- start start 2024-09-15T22:16:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.770+0000 7f543a29f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 0x55636f83e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.770+0000 7f543a29f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f83ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.770+0000 7f543a29f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f849370 0x55636f84b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.770+0000 7f543a29f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55636f7a42f0 con 0x55636f83fb40 2024-09-15T22:16:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.770+0000 7f543a29f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55636f74bcf0 con 0x55636f83e5d0 2024-09-15T22:16:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.770+0000 7f543a29f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55636f7a02b0 con 0x55636f849370 2024-09-15T22:16:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.770+0000 7f5436463640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 0x55636f83e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.770+0000 7f5436463640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 0x55636f83e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34870/0 (socket says 172.21.15.45:34870) 2024-09-15T22:16:33.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.770+0000 7f5436463640 1 -- 172.21.15.45:0/639050920 learned_addr learned my addr 172.21.15.45:0/639050920 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:33.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.770+0000 7f5435c62640 1 --2- 172.21.15.45:0/639050920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f83ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.770+0000 7f5435461640 1 --2- 172.21.15.45:0/639050920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f849370 0x55636f84b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.771+0000 7f5426ffd640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f541c0a3440 0x7f541c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.771+0000 7f5436463640 1 -- 172.21.15.45:0/639050920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f849370 msgr2=0x55636f84b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:33.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.771+0000 7f5436463640 1 --2- 172.21.15.45:0/639050920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f849370 0x55636f84b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.771+0000 7f5436463640 1 -- 172.21.15.45:0/639050920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 msgr2=0x55636f83ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:33.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.771+0000 7f5436463640 1 --2- 172.21.15.45:0/639050920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f83ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.771+0000 7f5436463640 1 -- 172.21.15.45:0/639050920 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55636f7303a0 con 0x55636f83fb40 2024-09-15T22:16:33.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.771+0000 7f5435c62640 1 --2- 172.21.15.45:0/639050920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f83ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:33.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.771+0000 7f5426ffd640 1 -- 172.21.15.45:0/171460209 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f542c0cfca0 con 0x7f5430100e20 2024-09-15T22:16:33.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.771+0000 7f5436463640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f541c0a3440 0x7f541c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.771+0000 7f5436463640 1 --2- 172.21.15.45:0/639050920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 0x55636f83e090 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f542802f6f0 tx=0x7f542802f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ba9b09ad4ac130 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.771+0000 7f541bfff640 1 -- 172.21.15.45:0/639050920 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5428034040 con 0x55636f83fb40 2024-09-15T22:16:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.771+0000 7f541bfff640 1 -- 172.21.15.45:0/639050920 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f542802fe10 con 0x55636f83fb40 2024-09-15T22:16:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.771+0000 7f541bfff640 1 -- 172.21.15.45:0/639050920 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54280307c0 con 0x55636f83fb40 2024-09-15T22:16:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.772+0000 7f543a29f740 1 -- 172.21.15.45:0/639050920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 msgr2=0x55636f83e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.772+0000 7f5436463640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f541c0a3440 0x7f541c0a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5428049000 tx=0x7f542804a000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.772+0000 7f543a29f740 1 --2- 172.21.15.45:0/639050920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 0x55636f83e090 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f542802f6f0 tx=0x7f542802f720 comp rx=0 tx=0).stop 2024-09-15T22:16:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.772+0000 7f543a29f740 1 -- 172.21.15.45:0/639050920 shutdown_connections 2024-09-15T22:16:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.772+0000 7f543a29f740 1 --2- 172.21.15.45:0/639050920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f849370 0x55636f84b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.772+0000 7f543a29f740 1 --2- 172.21.15.45:0/639050920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f83ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.772+0000 7f543a29f740 1 --2- 172.21.15.45:0/639050920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 0x55636f83e090 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.772+0000 7f543a29f740 1 -- 172.21.15.45:0/639050920 >> 172.21.15.45:0/639050920 conn(0x55636f807310 msgr2=0x55636f83ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.772+0000 7f543a29f740 1 -- 172.21.15.45:0/639050920 shutdown_connections 2024-09-15T22:16:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.772+0000 7f543a29f740 1 -- 172.21.15.45:0/639050920 wait complete. 2024-09-15T22:16:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.773+0000 7f543a29f740 1 -- start start 2024-09-15T22:16:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.773+0000 7f543a29f740 1 Processor -- start 2024-09-15T22:16:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.773+0000 7f543a29f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f848ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.773+0000 7f543a29f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f83fb40 0x55636f845f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.773+0000 7f543a29f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f849370 0x55636f8464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.773+0000 7f543a29f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55636f84c070 con 0x55636f849370 2024-09-15T22:16:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.773+0000 7f543a29f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55636f75f060 con 0x55636f83e5d0 2024-09-15T22:16:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.773+0000 7f543a29f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55636f84c1f0 con 0x55636f83fb40 2024-09-15T22:16:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.773+0000 7f543a29f740 10 client.0 _ll_register_callbacks cb 0x55636f4b28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.773+0000 7f5436463640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f849370 0x55636f8464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.773+0000 7f5436463640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f849370 0x55636f8464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34878/0 (socket says 172.21.15.45:34878) 2024-09-15T22:16:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.773+0000 7f5436463640 1 -- 172.21.15.45:0/3853491398 learned_addr learned my addr 172.21.15.45:0/3853491398 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.773+0000 7f5435461640 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f83fb40 0x55636f845f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f5435c62640 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f848ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f5436463640 1 -- 172.21.15.45:0/3853491398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f83fb40 msgr2=0x55636f845f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f5436463640 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f83fb40 0x55636f845f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f5436463640 1 -- 172.21.15.45:0/3853491398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 msgr2=0x55636f848ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f5436463640 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f848ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f5436463640 1 -- 172.21.15.45:0/3853491398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55636f5153c0 con 0x55636f849370 2024-09-15T22:16:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f5435c62640 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f848ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f5436463640 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f849370 0x55636f8464f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5428009ca0 tx=0x7f5428030ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf889e9b86e82c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f54197fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f54197fa640 1 -- 172.21.15.45:0/3853491398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5428034050 con 0x55636f849370 2024-09-15T22:16:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f543a29f740 1 -- 172.21.15.45:0/3853491398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f542802fe10 con 0x55636f849370 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f54197fa640 1 -- 172.21.15.45:0/3853491398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f5428003f00 con 0x55636f849370 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f54197fa640 1 -- 172.21.15.45:0/3853491398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5428004100 con 0x55636f849370 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f543a29f740 10 client.15381 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f543a29f740 1 -- 172.21.15.45:0/3853491398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55636f84c070 con 0x55636f849370 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.774+0000 7f54197fa640 1 -- 172.21.15.45:0/3853491398 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f542802fe10 con 0x55636f849370 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.775+0000 7f54197fa640 1 -- 172.21.15.45:0/3853491398 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5428051960 con 0x55636f849370 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.775+0000 7f543a29f740 10 client.15381 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.775+0000 7f543a29f740 10 client.15381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.775+0000 7f543a29f740 20 client.15381 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.775+0000 7f543a29f740 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55636f858c00 0x55636f85aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.775+0000 7f543a29f740 4 client.15381 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.775+0000 7f543a29f740 1 -- 172.21.15.45:0/3853491398 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55636f7b1860 con 0x55636f858c00 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.775+0000 7f5435c62640 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55636f858c00 0x55636f85aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.775+0000 7f54197fa640 10 client.15381 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.775+0000 7f5435c62640 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55636f858c00 0x55636f85aff0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34cf211741cf50c3 server_cookie=a6de08555a749fec in_seq=0 out_seq=0 2024-09-15T22:16:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f54197fa640 1 -- 172.21.15.45:0/3853491398 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55636f7b1860 con 0x55636f858c00 2024-09-15T22:16:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f54197fa640 10 client.15381 handle_command_reply: tid=0 2024-09-15T22:16:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f543a29f740 1 client.15381 shutdown 2024-09-15T22:16:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f543a29f740 1 -- 172.21.15.45:0/3853491398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f849370 msgr2=0x55636f8464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f543a29f740 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f849370 0x55636f8464f0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5428009ca0 tx=0x7f5428030ca0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f543a29f740 1 -- 172.21.15.45:0/3853491398 shutdown_connections 2024-09-15T22:16:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f543a29f740 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55636f858c00 0x55636f85aff0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f543a29f740 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f849370 0x55636f8464f0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f543a29f740 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f83fb40 0x55636f845f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f543a29f740 1 --2- 172.21.15.45:0/3853491398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f848ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f54197fa640 0 client.15381 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f543a29f740 1 -- 172.21.15.45:0/3853491398 >> 172.21.15.45:0/3853491398 conn(0x55636f807310 msgr2=0x55636f840960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f543a29f740 1 -- 172.21.15.45:0/3853491398 shutdown_connections 2024-09-15T22:16:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.776+0000 7f543a29f740 1 -- 172.21.15.45:0/3853491398 wait complete. 2024-09-15T22:16:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.777+0000 7f543a29f740 20 client.15381 trim_cache size 0 max 16384 2024-09-15T22:16:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f543a29f740 1 Processor -- start 2024-09-15T22:16:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f543a29f740 1 -- start start 2024-09-15T22:16:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f543a29f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f855310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f543a29f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 0x55636f841120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f543a29f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f849370 0x55636f841660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f543a29f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f54301ace90 con 0x55636f83fb40 2024-09-15T22:16:33.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f543a29f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f54301af710 con 0x55636f83e5d0 2024-09-15T22:16:33.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f543a29f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f54301ad500 con 0x55636f849370 2024-09-15T22:16:33.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f5435461640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 0x55636f841120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f5435461640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 0x55636f841120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34880/0 (socket says 172.21.15.45:34880) 2024-09-15T22:16:33.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f5435461640 1 -- 172.21.15.45:0/2206537715 learned_addr learned my addr 172.21.15.45:0/2206537715 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:33.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f5436463640 1 --2- 172.21.15.45:0/2206537715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f849370 0x55636f841660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f5435461640 1 -- 172.21.15.45:0/2206537715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f849370 msgr2=0x55636f841660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:33.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f5435c62640 1 --2- 172.21.15.45:0/2206537715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f855310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f5435461640 1 --2- 172.21.15.45:0/2206537715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f849370 0x55636f841660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f5435461640 1 -- 172.21.15.45:0/2206537715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 msgr2=0x55636f855310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:33.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f5435461640 1 --2- 172.21.15.45:0/2206537715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f855310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f5435461640 1 -- 172.21.15.45:0/2206537715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55636f839310 con 0x55636f83fb40 2024-09-15T22:16:33.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f5435c62640 1 --2- 172.21.15.45:0/2206537715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f855310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:33.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.790+0000 7f5435461640 1 --2- 172.21.15.45:0/2206537715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 0x55636f841120 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f542000abd0 tx=0x7f5420010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06b6b4cf6f93401 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.791+0000 7f541b7fe640 1 -- 172.21.15.45:0/2206537715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5420005220 con 0x55636f83fb40 2024-09-15T22:16:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.791+0000 7f541b7fe640 1 -- 172.21.15.45:0/2206537715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5420004ca0 con 0x55636f83fb40 2024-09-15T22:16:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.791+0000 7f541b7fe640 1 -- 172.21.15.45:0/2206537715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542001ba60 con 0x55636f83fb40 2024-09-15T22:16:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.791+0000 7f543a29f740 1 -- 172.21.15.45:0/2206537715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 msgr2=0x55636f841120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.791+0000 7f543a29f740 1 --2- 172.21.15.45:0/2206537715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 0x55636f841120 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f542000abd0 tx=0x7f5420010800 comp rx=0 tx=0).stop 2024-09-15T22:16:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.791+0000 7f543a29f740 1 -- 172.21.15.45:0/2206537715 shutdown_connections 2024-09-15T22:16:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.791+0000 7f543a29f740 1 --2- 172.21.15.45:0/2206537715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f849370 0x55636f841660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.791+0000 7f543a29f740 1 --2- 172.21.15.45:0/2206537715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83fb40 0x55636f841120 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.791+0000 7f543a29f740 1 --2- 172.21.15.45:0/2206537715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f83e5d0 0x55636f855310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.791+0000 7f543a29f740 1 -- 172.21.15.45:0/2206537715 >> 172.21.15.45:0/2206537715 conn(0x55636f807310 msgr2=0x55636f845080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.791+0000 7f543a29f740 1 -- 172.21.15.45:0/2206537715 shutdown_connections 2024-09-15T22:16:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.791+0000 7f543a29f740 1 -- 172.21.15.45:0/2206537715 wait complete. 2024-09-15T22:16:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.792+0000 7f543a29f740 1 -- start start 2024-09-15T22:16:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.792+0000 7f543a29f740 1 Processor -- start 2024-09-15T22:16:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.792+0000 7f543a29f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83e5d0 0x55636f851b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.792+0000 7f543a29f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f83fb40 0x55636f842bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.792+0000 7f543a29f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f849370 0x55636f843130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.792+0000 7f543a29f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f54301adbd0 con 0x55636f83e5d0 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.792+0000 7f543a29f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f54301af040 con 0x55636f849370 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.792+0000 7f543a29f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f54301ae2a0 con 0x55636f83fb40 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.792+0000 7f543a29f740 10 client.0 _ll_register_callbacks cb 0x7f5428048020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.792+0000 7f5435c62640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83e5d0 0x55636f851b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.792+0000 7f5435c62640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83e5d0 0x55636f851b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34890/0 (socket says 172.21.15.45:34890) 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.792+0000 7f5435c62640 1 -- 172.21.15.45:0/3745184788 learned_addr learned my addr 172.21.15.45:0/3745184788 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.792+0000 7f5436463640 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f849370 0x55636f843130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f5435461640 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f83fb40 0x55636f842bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f5435c62640 1 -- 172.21.15.45:0/3745184788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f83fb40 msgr2=0x55636f842bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f5435c62640 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f83fb40 0x55636f842bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f5435c62640 1 -- 172.21.15.45:0/3745184788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f849370 msgr2=0x55636f843130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f5435c62640 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f849370 0x55636f843130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f5435c62640 1 -- 172.21.15.45:0/3745184788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55636f843910 con 0x55636f83e5d0 2024-09-15T22:16:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f5436463640 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f849370 0x55636f843130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f5435c62640 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83e5d0 0x55636f851b70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f542c004ff0 tx=0x7f542c0048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6423db574b9c9b1c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f54197fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f54197fa640 1 -- 172.21.15.45:0/3745184788 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c020040 con 0x55636f83e5d0 2024-09-15T22:16:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f54197fa640 1 -- 172.21.15.45:0/3745184788 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f542c098110 con 0x55636f83e5d0 2024-09-15T22:16:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f543a29f740 1 -- 172.21.15.45:0/3745184788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5420004ca0 con 0x55636f83e5d0 2024-09-15T22:16:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f54197fa640 1 -- 172.21.15.45:0/3745184788 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f542c0b8050 con 0x55636f83e5d0 2024-09-15T22:16:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f543a29f740 10 client.15387 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:33.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f543a29f740 1 -- 172.21.15.45:0/3745184788 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55636f8c3650 con 0x55636f83e5d0 2024-09-15T22:16:33.820 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:16:33.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f54197fa640 1 -- 172.21.15.45:0/3745184788 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5420004ca0 con 0x55636f83e5d0 2024-09-15T22:16:33.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f54197fa640 1 -- 172.21.15.45:0/3745184788 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f542c0d4040 con 0x55636f83e5d0 2024-09-15T22:16:33.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f543a29f740 10 client.15387 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:33.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f543a29f740 10 client.15387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:33.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f543a29f740 20 client.15387 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:33.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.793+0000 7f543a29f740 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55636f8c3d70 0x55636f8c6190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:33.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.794+0000 7f543a29f740 4 client.15387 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:16:33.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.794+0000 7f543a29f740 1 -- 172.21.15.45:0/3745184788 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55636f7abd70 con 0x55636f8c3d70 2024-09-15T22:16:33.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.794+0000 7f5435461640 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55636f8c3d70 0x55636f8c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:33.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.794+0000 7f5435461640 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55636f8c3d70 0x55636f8c6190 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4cc75a2a34f933d server_cookie=3585d8787676f688 in_seq=0 out_seq=0 2024-09-15T22:16:33.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.794+0000 7f54197fa640 10 client.15387 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.794+0000 7f54197fa640 1 -- 172.21.15.45:0/3745184788 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55636f7abd70 con 0x55636f8c3d70 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.794+0000 7f54197fa640 10 client.15387 handle_command_reply: tid=0 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.794+0000 7f543a29f740 1 client.15387 shutdown 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f543a29f740 1 -- 172.21.15.45:0/3745184788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83e5d0 msgr2=0x55636f851b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f543a29f740 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83e5d0 0x55636f851b70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f542c004ff0 tx=0x7f542c0048a0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f543a29f740 1 -- 172.21.15.45:0/3745184788 shutdown_connections 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f543a29f740 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55636f8c3d70 0x55636f8c6190 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f543a29f740 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55636f849370 0x55636f843130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f543a29f740 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55636f83fb40 0x55636f842bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f54197fa640 0 client.15387 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f543a29f740 1 --2- 172.21.15.45:0/3745184788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55636f83e5d0 0x55636f851b70 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f543a29f740 1 -- 172.21.15.45:0/3745184788 >> 172.21.15.45:0/3745184788 conn(0x55636f807310 msgr2=0x55636f8477f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f543a29f740 1 -- 172.21.15.45:0/3745184788 shutdown_connections 2024-09-15T22:16:33.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f543a29f740 1 -- 172.21.15.45:0/3745184788 wait complete. 2024-09-15T22:16:33.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f543a29f740 20 client.15387 trim_cache size 0 max 16384 2024-09-15T22:16:33.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f5437ec6640 1 -- 172.21.15.45:0/171460209 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f541c0a3440 msgr2=0x7f541c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:33.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f5437ec6640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f541c0a3440 0x7f541c0a5900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5428049000 tx=0x7f542804a000 comp rx=0 tx=0).stop 2024-09-15T22:16:33.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f5437ec6640 1 -- 172.21.15.45:0/171460209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430100e20 msgr2=0x7f54301984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:33.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f5437ec6640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430100e20 0x7f54301984d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f542c00d770 tx=0x7f542c00db70 comp rx=0 tx=0).stop 2024-09-15T22:16:33.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f5437ec6640 1 -- 172.21.15.45:0/171460209 shutdown_connections 2024-09-15T22:16:33.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f5437ec6640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f541c0a3440 0x7f541c0a5900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f5437ec6640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5430102ef0 0x7f543019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f5437ec6640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5430102570 0x7f5430198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f5437ec6640 1 --2- 172.21.15.45:0/171460209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5430100e20 0x7f54301984d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:33.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.795+0000 7f5437ec6640 1 -- 172.21.15.45:0/171460209 >> 172.21.15.45:0/171460209 conn(0x7f54300fc7d0 msgr2=0x7f54301056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:33.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.796+0000 7f5437ec6640 1 -- 172.21.15.45:0/171460209 shutdown_connections 2024-09-15T22:16:33.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:33.796+0000 7f5437ec6640 1 -- 172.21.15.45:0/171460209 wait complete. 2024-09-15T22:16:34.450 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:34 smithi045 ceph-mon[31180]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:34.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:34 smithi165 ceph-mon[35551]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:34.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:34 smithi100 ceph-mon[35319]: from='client.15369 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:34.580 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:35.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.100+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/760091804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd8106f50 msgr2=0x7f6fd810eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:35.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.100+0000 7f6fdf5f0640 1 --2- 172.21.15.45:0/760091804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd8106f50 0x7f6fd810eaf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009930 tx=0x7f6fd002a420 comp rx=0 tx=0).stop 2024-09-15T22:16:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.100+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/760091804 shutdown_connections 2024-09-15T22:16:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.100+0000 7f6fdf5f0640 1 --2- 172.21.15.45:0/760091804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd8106f50 0x7f6fd810eaf0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.100+0000 7f6fdf5f0640 1 --2- 172.21.15.45:0/760091804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fd8100ca0 0x7f6fd8106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.100+0000 7f6fdf5f0640 1 --2- 172.21.15.45:0/760091804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fd81002f0 0x7f6fd81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.100+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/760091804 >> 172.21.15.45:0/760091804 conn(0x7f6fd8077210 msgr2=0x7f6fd80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.100+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/760091804 shutdown_connections 2024-09-15T22:16:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.100+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/760091804 wait complete. 2024-09-15T22:16:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.101+0000 7f6fdf5f0640 1 Processor -- start 2024-09-15T22:16:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.101+0000 7f6fdf5f0640 1 -- start start 2024-09-15T22:16:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.101+0000 7f6fdf5f0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd81002f0 0x7f6fd81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.101+0000 7f6fdf5f0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fd8100ca0 0x7f6fd8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:35.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.101+0000 7f6fdf5f0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fd8106f50 0x7f6fd819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.101+0000 7f6fdf5f0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd8112110 con 0x7f6fd81002f0 2024-09-15T22:16:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.101+0000 7f6fdf5f0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd8111f90 con 0x7f6fd8106f50 2024-09-15T22:16:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.101+0000 7f6fdf5f0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd8112290 con 0x7f6fd8100ca0 2024-09-15T22:16:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.101+0000 7f6fdd38c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd81002f0 0x7f6fd81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.101+0000 7f6fdd38c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd81002f0 0x7f6fd81984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51564/0 (socket says 172.21.15.45:51564) 2024-09-15T22:16:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.101+0000 7f6fdd38c640 1 -- 172.21.15.45:0/3658493361 learned_addr learned my addr 172.21.15.45:0/3658493361 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.101+0000 7f6fdcb8b640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fd8100ca0 0x7f6fd8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.101+0000 7f6fddb8d640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fd8106f50 0x7f6fd819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.102+0000 7f6fdd38c640 1 -- 172.21.15.45:0/3658493361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fd8100ca0 msgr2=0x7f6fd8198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.102+0000 7f6fdd38c640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fd8100ca0 0x7f6fd8198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:35.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.102+0000 7f6fdd38c640 1 -- 172.21.15.45:0/3658493361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fd8106f50 msgr2=0x7f6fd819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.102+0000 7f6fdd38c640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fd8106f50 0x7f6fd819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.102+0000 7f6fdd38c640 1 -- 172.21.15.45:0/3658493361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd819d480 con 0x7f6fd81002f0 2024-09-15T22:16:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.102+0000 7f6fdd38c640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd81002f0 0x7f6fd81984d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400eab0 tx=0x7f6fd400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.102+0000 7f6fca7fc640 1 -- 172.21.15.45:0/3658493361 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd400cd80 con 0x7f6fd81002f0 2024-09-15T22:16:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.102+0000 7f6fca7fc640 1 -- 172.21.15.45:0/3658493361 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6fd4011970 con 0x7f6fd81002f0 2024-09-15T22:16:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.102+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/3658493361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd819d770 con 0x7f6fd81002f0 2024-09-15T22:16:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.102+0000 7f6fca7fc640 1 -- 172.21.15.45:0/3658493361 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4010ab0 con 0x7f6fd81002f0 2024-09-15T22:16:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.102+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/3658493361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd81a5050 con 0x7f6fd81002f0 2024-09-15T22:16:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.103+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/3658493361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fd81006d0 con 0x7f6fd81002f0 2024-09-15T22:16:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.104+0000 7f6fca7fc640 1 -- 172.21.15.45:0/3658493361 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f6fd4011b20 con 0x7f6fd81002f0 2024-09-15T22:16:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.105+0000 7f6fca7fc640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6fc40a3440 0x7f6fc40a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.105+0000 7f6fdcb8b640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6fc40a3440 0x7f6fc40a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:35.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.105+0000 7f6fca7fc640 1 -- 172.21.15.45:0/3658493361 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f6fd40d07c0 con 0x7f6fd81002f0 2024-09-15T22:16:35.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.105+0000 7f6fdcb8b640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6fc40a3440 0x7f6fc40a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8108960 tx=0x7f6fcc00a2d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:35.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.109+0000 7f6fca7fc640 1 -- 172.21.15.45:0/3658493361 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6fd4016030 con 0x7f6fd81002f0 2024-09-15T22:16:35.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.284+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/3658493361 --> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6fd8062630 con 0x7f6fc40a3440 2024-09-15T22:16:35.285 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:35 smithi045 ceph-mon[31180]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 76 KiB/s wr, 42 op/s 2024-09-15T22:16:35.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.292+0000 7f6fca7fc640 1 -- 172.21.15.45:0/3658493361 <== mgr.15165 v2:172.21.15.45:6800/553298159 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339317 (secure 0 0 0) 0x7f6fd8062630 con 0x7f6fc40a3440 2024-09-15T22:16:35.297 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:35.299 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-09-15T22:16:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.295+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/3658493361 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6fc40a3440 msgr2=0x7f6fc40a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.295+0000 7f6fdf5f0640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6fc40a3440 0x7f6fc40a5900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8108960 tx=0x7f6fcc00a2d0 comp rx=0 tx=0).stop 2024-09-15T22:16:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.295+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/3658493361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd81002f0 msgr2=0x7f6fd81984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:35.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.295+0000 7f6fdf5f0640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd81002f0 0x7f6fd81984d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400eab0 tx=0x7f6fd400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.296+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/3658493361 shutdown_connections 2024-09-15T22:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.296+0000 7f6fdf5f0640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6fc40a3440 0x7f6fc40a5900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.296+0000 7f6fdf5f0640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fd8106f50 0x7f6fd819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.296+0000 7f6fdf5f0640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6fd8100ca0 0x7f6fd8198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.296+0000 7f6fdf5f0640 1 --2- 172.21.15.45:0/3658493361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6fd81002f0 0x7f6fd81984d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.296+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/3658493361 >> 172.21.15.45:0/3658493361 conn(0x7f6fd8077210 msgr2=0x7f6fd8105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.296+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/3658493361 shutdown_connections 2024-09-15T22:16:35.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:35.296+0000 7f6fdf5f0640 1 -- 172.21.15.45:0/3658493361 wait complete. 2024-09-15T22:16:35.478 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:16:35.479 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:16:35.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:35 smithi100 ceph-mon[35319]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 76 KiB/s wr, 42 op/s 2024-09-15T22:16:35.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:35 smithi165 ceph-mon[35551]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 76 KiB/s wr, 42 op/s 2024-09-15T22:16:35.979 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-15T22:16:33.559562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1384695,"num_objects":28,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":799,"num_read_kb":818,"num_write":533,"num_write_kb":5268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":881,"ondisk_log_size":881,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":415752,"kb_used_data":16196,"kb_used_omap":18,"kb_used_meta":398957,"kb_avail":1124526072,"statfs":{"total":1151940427776,"available":1151514697728,"internally_reserved":0,"allocated":16584704,"data_stored":10269647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":408532281},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":443,"num_write":144,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004306"},"pg_stats":[{"pgid":"2.1f","version":"81'4","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557539+0000","last_change":"2024-09-15T22:14:04.718966+0000","last_active":"2024-09-15T22:16:17.557539+0000","last_peered":"2024-09-15T22:16:17.557539+0000","last_clean":"2024-09-15T22:16:17.557539+0000","last_became_active":"2024-09-15T22:14:04.718743+0000","last_became_peered":"2024-09-15T22:14:04.718743+0000","last_unstale":"2024-09-15T22:16:17.557539+0000","last_undegraded":"2024-09-15T22:16:17.557539+0000","last_fullsized":"2024-09-15T22:16:17.557539+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:24:01.767801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604829+0000","last_change":"2024-09-15T22:14:06.814802+0000","last_active":"2024-09-15T22:16:17.604829+0000","last_peered":"2024-09-15T22:16:17.604829+0000","last_clean":"2024-09-15T22:16:17.604829+0000","last_became_active":"2024-09-15T22:14:06.814495+0000","last_became_peered":"2024-09-15T22:14:06.814495+0000","last_unstale":"2024-09-15T22:16:17.604829+0000","last_undegraded":"2024-09-15T22:16:17.604829+0000","last_fullsized":"2024-09-15T22:16:17.604829+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:45.384412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552197+0000","last_change":"2024-09-15T22:15:17.404082+0000","last_active":"2024-09-15T22:16:17.552197+0000","last_peered":"2024-09-15T22:16:17.552197+0000","last_clean":"2024-09-15T22:16:17.552197+0000","last_became_active":"2024-09-15T22:15:17.403590+0000","last_became_peered":"2024-09-15T22:15:17.403590+0000","last_unstale":"2024-09-15T22:16:17.552197+0000","last_undegraded":"2024-09-15T22:16:17.552197+0000","last_fullsized":"2024-09-15T22:16:17.552197+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:14:49.816560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8,0],"acting":[2,3,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"81'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.566735+0000","last_change":"2024-09-15T22:14:05.017101+0000","last_active":"2024-09-15T22:16:17.566735+0000","last_peered":"2024-09-15T22:16:17.566735+0000","last_clean":"2024-09-15T22:16:17.566735+0000","last_became_active":"2024-09-15T22:14:05.016748+0000","last_became_peered":"2024-09-15T22:14:05.016748+0000","last_unstale":"2024-09-15T22:16:17.566735+0000","last_undegraded":"2024-09-15T22:16:17.566735+0000","last_fullsized":"2024-09-15T22:16:17.566735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:11.211291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605811+0000","last_change":"2024-09-15T22:14:06.815112+0000","last_active":"2024-09-15T22:16:17.605811+0000","last_peered":"2024-09-15T22:16:17.605811+0000","last_clean":"2024-09-15T22:16:17.605811+0000","last_became_active":"2024-09-15T22:14:06.814556+0000","last_became_peered":"2024-09-15T22:14:06.814556+0000","last_unstale":"2024-09-15T22:16:17.605811+0000","last_undegraded":"2024-09-15T22:16:17.605811+0000","last_fullsized":"2024-09-15T22:16:17.605811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:24.733336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553827+0000","last_change":"2024-09-15T22:14:13.845829+0000","last_active":"2024-09-15T22:16:17.553827+0000","last_peered":"2024-09-15T22:16:17.553827+0000","last_clean":"2024-09-15T22:16:17.553827+0000","last_became_active":"2024-09-15T22:14:13.844958+0000","last_became_peered":"2024-09-15T22:14:13.844958+0000","last_unstale":"2024-09-15T22:16:17.553827+0000","last_undegraded":"2024-09-15T22:16:17.553827+0000","last_fullsized":"2024-09-15T22:16:17.553827+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:37.944143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555893+0000","last_change":"2024-09-15T22:14:04.720255+0000","last_active":"2024-09-15T22:16:17.555893+0000","last_peered":"2024-09-15T22:16:17.555893+0000","last_clean":"2024-09-15T22:16:17.555893+0000","last_became_active":"2024-09-15T22:14:04.719907+0000","last_became_peered":"2024-09-15T22:14:04.719907+0000","last_unstale":"2024-09-15T22:16:17.555893+0000","last_undegraded":"2024-09-15T22:16:17.555893+0000","last_fullsized":"2024-09-15T22:16:17.555893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:12.510139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.591919+0000","last_change":"2024-09-15T22:14:06.808322+0000","last_active":"2024-09-15T22:16:17.591919+0000","last_peered":"2024-09-15T22:16:17.591919+0000","last_clean":"2024-09-15T22:16:17.591919+0000","last_became_active":"2024-09-15T22:14:06.807398+0000","last_became_peered":"2024-09-15T22:14:06.807398+0000","last_unstale":"2024-09-15T22:16:17.591919+0000","last_undegraded":"2024-09-15T22:16:17.591919+0000","last_fullsized":"2024-09-15T22:16:17.591919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:11.677800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554758+0000","last_change":"2024-09-15T22:14:13.849713+0000","last_active":"2024-09-15T22:16:17.554758+0000","last_peered":"2024-09-15T22:16:17.554758+0000","last_clean":"2024-09-15T22:16:17.554758+0000","last_became_active":"2024-09-15T22:14:13.849311+0000","last_became_peered":"2024-09-15T22:14:13.849311+0000","last_unstale":"2024-09-15T22:16:17.554758+0000","last_undegraded":"2024-09-15T22:16:17.554758+0000","last_fullsized":"2024-09-15T22:16:17.554758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:17.782013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554654+0000","last_change":"2024-09-15T22:14:04.721694+0000","last_active":"2024-09-15T22:16:17.554654+0000","last_peered":"2024-09-15T22:16:17.554654+0000","last_clean":"2024-09-15T22:16:17.554654+0000","last_became_active":"2024-09-15T22:14:04.721321+0000","last_became_peered":"2024-09-15T22:14:04.721321+0000","last_unstale":"2024-09-15T22:16:17.554654+0000","last_undegraded":"2024-09-15T22:16:17.554654+0000","last_fullsized":"2024-09-15T22:16:17.554654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:47.817565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.586446+0000","last_change":"2024-09-15T22:14:06.809564+0000","last_active":"2024-09-15T22:16:17.586446+0000","last_peered":"2024-09-15T22:16:17.586446+0000","last_clean":"2024-09-15T22:16:17.586446+0000","last_became_active":"2024-09-15T22:14:06.809102+0000","last_became_peered":"2024-09-15T22:14:06.809102+0000","last_unstale":"2024-09-15T22:16:17.586446+0000","last_undegraded":"2024-09-15T22:16:17.586446+0000","last_fullsized":"2024-09-15T22:16:17.586446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:55.306791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554499+0000","last_change":"2024-09-15T22:14:13.849839+0000","last_active":"2024-09-15T22:16:17.554499+0000","last_peered":"2024-09-15T22:16:17.554499+0000","last_clean":"2024-09-15T22:16:17.554499+0000","last_became_active":"2024-09-15T22:14:13.849415+0000","last_became_peered":"2024-09-15T22:14:13.849415+0000","last_unstale":"2024-09-15T22:16:17.554499+0000","last_undegraded":"2024-09-15T22:16:17.554499+0000","last_fullsized":"2024-09-15T22:16:17.554499+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:20.336406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601353+0000","last_change":"2024-09-15T22:14:06.815506+0000","last_active":"2024-09-15T22:16:17.601353+0000","last_peered":"2024-09-15T22:16:17.601353+0000","last_clean":"2024-09-15T22:16:17.601353+0000","last_became_active":"2024-09-15T22:14:06.815066+0000","last_became_peered":"2024-09-15T22:14:06.815066+0000","last_unstale":"2024-09-15T22:16:17.601353+0000","last_undegraded":"2024-09-15T22:16:17.601353+0000","last_fullsized":"2024-09-15T22:16:17.601353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:42.182268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"81'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555136+0000","last_change":"2024-09-15T22:14:04.721403+0000","last_active":"2024-09-15T22:16:17.555136+0000","last_peered":"2024-09-15T22:16:17.555136+0000","last_clean":"2024-09-15T22:16:17.555136+0000","last_became_active":"2024-09-15T22:14:04.721049+0000","last_became_peered":"2024-09-15T22:14:04.721049+0000","last_unstale":"2024-09-15T22:16:17.555136+0000","last_undegraded":"2024-09-15T22:16:17.555136+0000","last_fullsized":"2024-09-15T22:16:17.555136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:39.860926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.561252+0000","last_change":"2024-09-15T22:14:14.280656+0000","last_active":"2024-09-15T22:16:17.561252+0000","last_peered":"2024-09-15T22:16:17.561252+0000","last_clean":"2024-09-15T22:16:17.561252+0000","last_became_active":"2024-09-15T22:14:14.280230+0000","last_became_peered":"2024-09-15T22:14:14.280230+0000","last_unstale":"2024-09-15T22:16:17.561252+0000","last_undegraded":"2024-09-15T22:16:17.561252+0000","last_fullsized":"2024-09-15T22:16:17.561252+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:04:47.531799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604047+0000","last_change":"2024-09-15T22:14:06.805575+0000","last_active":"2024-09-15T22:16:17.604047+0000","last_peered":"2024-09-15T22:16:17.604047+0000","last_clean":"2024-09-15T22:16:17.604047+0000","last_became_active":"2024-09-15T22:14:06.804515+0000","last_became_peered":"2024-09-15T22:14:06.804515+0000","last_unstale":"2024-09-15T22:16:17.604047+0000","last_undegraded":"2024-09-15T22:16:17.604047+0000","last_fullsized":"2024-09-15T22:16:17.604047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:06.560964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552446+0000","last_change":"2024-09-15T22:14:04.717221+0000","last_active":"2024-09-15T22:16:17.552446+0000","last_peered":"2024-09-15T22:16:17.552446+0000","last_clean":"2024-09-15T22:16:17.552446+0000","last_became_active":"2024-09-15T22:14:04.716845+0000","last_became_peered":"2024-09-15T22:14:04.716845+0000","last_unstale":"2024-09-15T22:16:17.552446+0000","last_undegraded":"2024-09-15T22:16:17.552446+0000","last_fullsized":"2024-09-15T22:16:17.552446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:09.073229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555298+0000","last_change":"2024-09-15T22:14:13.847822+0000","last_active":"2024-09-15T22:16:17.555298+0000","last_peered":"2024-09-15T22:16:17.555298+0000","last_clean":"2024-09-15T22:16:17.555298+0000","last_became_active":"2024-09-15T22:14:13.847332+0000","last_became_peered":"2024-09-15T22:14:13.847332+0000","last_unstale":"2024-09-15T22:16:17.555298+0000","last_undegraded":"2024-09-15T22:16:17.555298+0000","last_fullsized":"2024-09-15T22:16:17.555298+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:18.241885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603103+0000","last_change":"2024-09-15T22:14:06.814033+0000","last_active":"2024-09-15T22:16:17.603103+0000","last_peered":"2024-09-15T22:16:17.603103+0000","last_clean":"2024-09-15T22:16:17.603103+0000","last_became_active":"2024-09-15T22:14:06.813458+0000","last_became_peered":"2024-09-15T22:14:06.813458+0000","last_unstale":"2024-09-15T22:16:17.603103+0000","last_undegraded":"2024-09-15T22:16:17.603103+0000","last_fullsized":"2024-09-15T22:16:17.603103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:09:16.484113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554628+0000","last_change":"2024-09-15T22:14:04.715797+0000","last_active":"2024-09-15T22:16:17.554628+0000","last_peered":"2024-09-15T22:16:17.554628+0000","last_clean":"2024-09-15T22:16:17.554628+0000","last_became_active":"2024-09-15T22:14:04.715478+0000","last_became_peered":"2024-09-15T22:14:04.715478+0000","last_unstale":"2024-09-15T22:16:17.554628+0000","last_undegraded":"2024-09-15T22:16:17.554628+0000","last_fullsized":"2024-09-15T22:16:17.554628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:39.432873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557177+0000","last_change":"2024-09-15T22:14:13.853461+0000","last_active":"2024-09-15T22:16:17.557177+0000","last_peered":"2024-09-15T22:16:17.557177+0000","last_clean":"2024-09-15T22:16:17.557177+0000","last_became_active":"2024-09-15T22:14:13.852896+0000","last_became_peered":"2024-09-15T22:14:13.852896+0000","last_unstale":"2024-09-15T22:16:17.557177+0000","last_undegraded":"2024-09-15T22:16:17.557177+0000","last_fullsized":"2024-09-15T22:16:17.557177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:41.597321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579227+0000","last_change":"2024-09-15T22:14:06.814990+0000","last_active":"2024-09-15T22:16:17.579227+0000","last_peered":"2024-09-15T22:16:17.579227+0000","last_clean":"2024-09-15T22:16:17.579227+0000","last_became_active":"2024-09-15T22:14:06.814646+0000","last_became_peered":"2024-09-15T22:14:06.814646+0000","last_unstale":"2024-09-15T22:16:17.579227+0000","last_undegraded":"2024-09-15T22:16:17.579227+0000","last_fullsized":"2024-09-15T22:16:17.579227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:04.717207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.542012+0000","last_change":"2024-09-15T22:14:05.017599+0000","last_active":"2024-09-15T22:16:17.542012+0000","last_peered":"2024-09-15T22:16:17.542012+0000","last_clean":"2024-09-15T22:16:17.542012+0000","last_became_active":"2024-09-15T22:14:05.017296+0000","last_became_peered":"2024-09-15T22:14:05.017296+0000","last_unstale":"2024-09-15T22:16:17.542012+0000","last_undegraded":"2024-09-15T22:16:17.542012+0000","last_fullsized":"2024-09-15T22:16:17.542012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:11.427372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556380+0000","last_change":"2024-09-15T22:14:14.281453+0000","last_active":"2024-09-15T22:16:17.556380+0000","last_peered":"2024-09-15T22:16:17.556380+0000","last_clean":"2024-09-15T22:16:17.556380+0000","last_became_active":"2024-09-15T22:14:14.280814+0000","last_became_peered":"2024-09-15T22:14:14.280814+0000","last_unstale":"2024-09-15T22:16:17.556380+0000","last_undegraded":"2024-09-15T22:16:17.556380+0000","last_fullsized":"2024-09-15T22:16:17.556380+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:43:40.890979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604784+0000","last_change":"2024-09-15T22:14:06.816619+0000","last_active":"2024-09-15T22:16:17.604784+0000","last_peered":"2024-09-15T22:16:17.604784+0000","last_clean":"2024-09-15T22:16:17.604784+0000","last_became_active":"2024-09-15T22:14:06.814421+0000","last_became_peered":"2024-09-15T22:14:06.814421+0000","last_unstale":"2024-09-15T22:16:17.604784+0000","last_undegraded":"2024-09-15T22:16:17.604784+0000","last_fullsized":"2024-09-15T22:16:17.604784+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:00.329802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"81'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556148+0000","last_change":"2024-09-15T22:14:05.197752+0000","last_active":"2024-09-15T22:16:17.556148+0000","last_peered":"2024-09-15T22:16:17.556148+0000","last_clean":"2024-09-15T22:16:17.556148+0000","last_became_active":"2024-09-15T22:14:05.197399+0000","last_became_peered":"2024-09-15T22:14:05.197399+0000","last_unstale":"2024-09-15T22:16:17.556148+0000","last_undegraded":"2024-09-15T22:16:17.556148+0000","last_fullsized":"2024-09-15T22:16:17.556148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:53:19.781842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552191+0000","last_change":"2024-09-15T22:14:13.847474+0000","last_active":"2024-09-15T22:16:17.552191+0000","last_peered":"2024-09-15T22:16:17.552191+0000","last_clean":"2024-09-15T22:16:17.552191+0000","last_became_active":"2024-09-15T22:14:13.847032+0000","last_became_peered":"2024-09-15T22:14:13.847032+0000","last_unstale":"2024-09-15T22:16:17.552191+0000","last_undegraded":"2024-09-15T22:16:17.552191+0000","last_fullsized":"2024-09-15T22:16:17.552191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:21.049024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598828+0000","last_change":"2024-09-15T22:14:06.809104+0000","last_active":"2024-09-15T22:16:17.598828+0000","last_peered":"2024-09-15T22:16:17.598828+0000","last_clean":"2024-09-15T22:16:17.598828+0000","last_became_active":"2024-09-15T22:14:06.808735+0000","last_became_peered":"2024-09-15T22:14:06.808735+0000","last_unstale":"2024-09-15T22:16:17.598828+0000","last_undegraded":"2024-09-15T22:16:17.598828+0000","last_fullsized":"2024-09-15T22:16:17.598828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:46.388619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'97","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:28.221507+0000","last_change":"2024-09-15T22:14:04.712546+0000","last_active":"2024-09-15T22:16:28.221507+0000","last_peered":"2024-09-15T22:16:28.221507+0000","last_clean":"2024-09-15T22:16:28.221507+0000","last_became_active":"2024-09-15T22:14:04.712222+0000","last_became_peered":"2024-09-15T22:14:04.712222+0000","last_unstale":"2024-09-15T22:16:28.221507+0000","last_undegraded":"2024-09-15T22:16:28.221507+0000","last_fullsized":"2024-09-15T22:16:28.221507+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:37:00.993810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":302,"num_read_kb":268,"num_write":179,"num_write_kb":1287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.566187+0000","last_change":"2024-09-15T22:14:14.280905+0000","last_active":"2024-09-15T22:16:17.566187+0000","last_peered":"2024-09-15T22:16:17.566187+0000","last_clean":"2024-09-15T22:16:17.566187+0000","last_became_active":"2024-09-15T22:14:14.280368+0000","last_became_peered":"2024-09-15T22:14:14.280368+0000","last_unstale":"2024-09-15T22:16:17.566187+0000","last_undegraded":"2024-09-15T22:16:17.566187+0000","last_fullsized":"2024-09-15T22:16:17.566187+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:52.812589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.599423+0000","last_change":"2024-09-15T22:14:06.816231+0000","last_active":"2024-09-15T22:16:17.599423+0000","last_peered":"2024-09-15T22:16:17.599423+0000","last_clean":"2024-09-15T22:16:17.599423+0000","last_became_active":"2024-09-15T22:14:06.815884+0000","last_became_peered":"2024-09-15T22:14:06.815884+0000","last_unstale":"2024-09-15T22:16:17.599423+0000","last_undegraded":"2024-09-15T22:16:17.599423+0000","last_fullsized":"2024-09-15T22:16:17.599423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:33:30.076077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556018+0000","last_change":"2024-09-15T22:14:05.017745+0000","last_active":"2024-09-15T22:16:17.556018+0000","last_peered":"2024-09-15T22:16:17.556018+0000","last_clean":"2024-09-15T22:16:17.556018+0000","last_became_active":"2024-09-15T22:14:05.017064+0000","last_became_peered":"2024-09-15T22:14:05.017064+0000","last_unstale":"2024-09-15T22:16:17.556018+0000","last_undegraded":"2024-09-15T22:16:17.556018+0000","last_fullsized":"2024-09-15T22:16:17.556018+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:44.038448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.560621+0000","last_change":"2024-09-15T22:14:13.853195+0000","last_active":"2024-09-15T22:16:17.560621+0000","last_peered":"2024-09-15T22:16:17.560621+0000","last_clean":"2024-09-15T22:16:17.560621+0000","last_became_active":"2024-09-15T22:14:13.852803+0000","last_became_peered":"2024-09-15T22:14:13.852803+0000","last_unstale":"2024-09-15T22:16:17.560621+0000","last_undegraded":"2024-09-15T22:16:17.560621+0000","last_fullsized":"2024-09-15T22:16:17.560621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:20.737509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601889+0000","last_change":"2024-09-15T22:14:06.805448+0000","last_active":"2024-09-15T22:16:17.601889+0000","last_peered":"2024-09-15T22:16:17.601889+0000","last_clean":"2024-09-15T22:16:17.601889+0000","last_became_active":"2024-09-15T22:14:06.804965+0000","last_became_peered":"2024-09-15T22:14:06.804965+0000","last_unstale":"2024-09-15T22:16:17.601889+0000","last_undegraded":"2024-09-15T22:16:17.601889+0000","last_fullsized":"2024-09-15T22:16:17.601889+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:29.831888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556768+0000","last_change":"2024-09-15T22:14:05.017438+0000","last_active":"2024-09-15T22:16:17.556768+0000","last_peered":"2024-09-15T22:16:17.556768+0000","last_clean":"2024-09-15T22:16:17.556768+0000","last_became_active":"2024-09-15T22:14:05.017050+0000","last_became_peered":"2024-09-15T22:14:05.017050+0000","last_unstale":"2024-09-15T22:16:17.556768+0000","last_undegraded":"2024-09-15T22:16:17.556768+0000","last_fullsized":"2024-09-15T22:16:17.556768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:35.608774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554172+0000","last_change":"2024-09-15T22:14:14.281096+0000","last_active":"2024-09-15T22:16:17.554172+0000","last_peered":"2024-09-15T22:16:17.554172+0000","last_clean":"2024-09-15T22:16:17.554172+0000","last_became_active":"2024-09-15T22:14:14.280381+0000","last_became_peered":"2024-09-15T22:14:14.280381+0000","last_unstale":"2024-09-15T22:16:17.554172+0000","last_undegraded":"2024-09-15T22:16:17.554172+0000","last_fullsized":"2024-09-15T22:16:17.554172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:11:44.686080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.583155+0000","last_change":"2024-09-15T22:14:06.812046+0000","last_active":"2024-09-15T22:16:17.583155+0000","last_peered":"2024-09-15T22:16:17.583155+0000","last_clean":"2024-09-15T22:16:17.583155+0000","last_became_active":"2024-09-15T22:14:06.811721+0000","last_became_peered":"2024-09-15T22:14:06.811721+0000","last_unstale":"2024-09-15T22:16:17.583155+0000","last_undegraded":"2024-09-15T22:16:17.583155+0000","last_fullsized":"2024-09-15T22:16:17.583155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:13.244973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.556145+0000","last_change":"2024-09-15T22:14:04.720940+0000","last_active":"2024-09-15T22:16:17.556145+0000","last_peered":"2024-09-15T22:16:17.556145+0000","last_clean":"2024-09-15T22:16:17.556145+0000","last_became_active":"2024-09-15T22:14:04.720624+0000","last_became_peered":"2024-09-15T22:14:04.720624+0000","last_unstale":"2024-09-15T22:16:17.556145+0000","last_undegraded":"2024-09-15T22:16:17.556145+0000","last_fullsized":"2024-09-15T22:16:17.556145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:29.823784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540655+0000","last_change":"2024-09-15T22:14:13.848882+0000","last_active":"2024-09-15T22:16:17.540655+0000","last_peered":"2024-09-15T22:16:17.540655+0000","last_clean":"2024-09-15T22:16:17.540655+0000","last_became_active":"2024-09-15T22:14:13.848512+0000","last_became_peered":"2024-09-15T22:14:13.848512+0000","last_unstale":"2024-09-15T22:16:17.540655+0000","last_undegraded":"2024-09-15T22:16:17.540655+0000","last_fullsized":"2024-09-15T22:16:17.540655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:44.050344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582026+0000","last_change":"2024-09-15T22:14:06.813915+0000","last_active":"2024-09-15T22:16:17.582026+0000","last_peered":"2024-09-15T22:16:17.582026+0000","last_clean":"2024-09-15T22:16:17.582026+0000","last_became_active":"2024-09-15T22:14:06.811803+0000","last_became_peered":"2024-09-15T22:14:06.811803+0000","last_unstale":"2024-09-15T22:16:17.582026+0000","last_undegraded":"2024-09-15T22:16:17.582026+0000","last_fullsized":"2024-09-15T22:16:17.582026+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:42.117747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540432+0000","last_change":"2024-09-15T22:14:05.017360+0000","last_active":"2024-09-15T22:16:17.540432+0000","last_peered":"2024-09-15T22:16:17.540432+0000","last_clean":"2024-09-15T22:16:17.540432+0000","last_became_active":"2024-09-15T22:14:05.017004+0000","last_became_peered":"2024-09-15T22:14:05.017004+0000","last_unstale":"2024-09-15T22:16:17.540432+0000","last_undegraded":"2024-09-15T22:16:17.540432+0000","last_fullsized":"2024-09-15T22:16:17.540432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:31:01.366513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540921+0000","last_change":"2024-09-15T22:14:14.280215+0000","last_active":"2024-09-15T22:16:17.540921+0000","last_peered":"2024-09-15T22:16:17.540921+0000","last_clean":"2024-09-15T22:16:17.540921+0000","last_became_active":"2024-09-15T22:14:14.279750+0000","last_became_peered":"2024-09-15T22:14:14.279750+0000","last_unstale":"2024-09-15T22:16:17.540921+0000","last_undegraded":"2024-09-15T22:16:17.540921+0000","last_fullsized":"2024-09-15T22:16:17.540921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:58.827582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602972+0000","last_change":"2024-09-15T22:14:06.812410+0000","last_active":"2024-09-15T22:16:17.602972+0000","last_peered":"2024-09-15T22:16:17.602972+0000","last_clean":"2024-09-15T22:16:17.602972+0000","last_became_active":"2024-09-15T22:14:06.812032+0000","last_became_peered":"2024-09-15T22:14:06.812032+0000","last_unstale":"2024-09-15T22:16:17.602972+0000","last_undegraded":"2024-09-15T22:16:17.602972+0000","last_fullsized":"2024-09-15T22:16:17.602972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:48.100213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.558099+0000","last_change":"2024-09-15T22:14:04.719678+0000","last_active":"2024-09-15T22:16:17.558099+0000","last_peered":"2024-09-15T22:16:17.558099+0000","last_clean":"2024-09-15T22:16:17.558099+0000","last_became_active":"2024-09-15T22:14:04.719352+0000","last_became_peered":"2024-09-15T22:14:04.719352+0000","last_unstale":"2024-09-15T22:16:17.558099+0000","last_undegraded":"2024-09-15T22:16:17.558099+0000","last_fullsized":"2024-09-15T22:16:17.558099+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:23.061957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545734+0000","last_change":"2024-09-15T22:14:14.281314+0000","last_active":"2024-09-15T22:16:17.545734+0000","last_peered":"2024-09-15T22:16:17.545734+0000","last_clean":"2024-09-15T22:16:17.545734+0000","last_became_active":"2024-09-15T22:14:14.280859+0000","last_became_peered":"2024-09-15T22:14:14.280859+0000","last_unstale":"2024-09-15T22:16:17.545734+0000","last_undegraded":"2024-09-15T22:16:17.545734+0000","last_fullsized":"2024-09-15T22:16:17.545734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:18.796767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.592298+0000","last_change":"2024-09-15T22:15:17.211828+0000","last_active":"2024-09-15T22:16:17.592298+0000","last_peered":"2024-09-15T22:16:17.592298+0000","last_clean":"2024-09-15T22:16:17.592298+0000","last_became_active":"2024-09-15T22:15:17.211560+0000","last_became_peered":"2024-09-15T22:15:17.211560+0000","last_unstale":"2024-09-15T22:16:17.592298+0000","last_undegraded":"2024-09-15T22:16:17.592298+0000","last_fullsized":"2024-09-15T22:16:17.592298+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:27:59.944869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555126+0000","last_change":"2024-09-15T22:14:04.718038+0000","last_active":"2024-09-15T22:16:17.555126+0000","last_peered":"2024-09-15T22:16:17.555126+0000","last_clean":"2024-09-15T22:16:17.555126+0000","last_became_active":"2024-09-15T22:14:04.717683+0000","last_became_peered":"2024-09-15T22:14:04.717683+0000","last_unstale":"2024-09-15T22:16:17.555126+0000","last_undegraded":"2024-09-15T22:16:17.555126+0000","last_fullsized":"2024-09-15T22:16:17.555126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:23.557077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"90'148","reported_seq":404,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:19.690576+0000","last_change":"2024-09-15T22:12:55.022635+0000","last_active":"2024-09-15T22:16:19.690576+0000","last_peered":"2024-09-15T22:16:19.690576+0000","last_clean":"2024-09-15T22:16:19.690576+0000","last_became_active":"2024-09-15T22:12:55.022132+0000","last_became_peered":"2024-09-15T22:12:55.022132+0000","last_unstale":"2024-09-15T22:16:19.690576+0000","last_undegraded":"2024-09-15T22:16:19.690576+0000","last_fullsized":"2024-09-15T22:16:19.690576+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:09:30.115505+0000","last_clean_scrub_stamp":"2024-09-15T22:09:30.115505+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:50.060169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.560414+0000","last_change":"2024-09-15T22:14:13.849547+0000","last_active":"2024-09-15T22:16:17.560414+0000","last_peered":"2024-09-15T22:16:17.560414+0000","last_clean":"2024-09-15T22:16:17.560414+0000","last_became_active":"2024-09-15T22:14:13.849091+0000","last_became_peered":"2024-09-15T22:14:13.849091+0000","last_unstale":"2024-09-15T22:16:17.560414+0000","last_undegraded":"2024-09-15T22:16:17.560414+0000","last_fullsized":"2024-09-15T22:16:17.560414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:49.450958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596732+0000","last_change":"2024-09-15T22:14:06.816340+0000","last_active":"2024-09-15T22:16:17.596732+0000","last_peered":"2024-09-15T22:16:17.596732+0000","last_clean":"2024-09-15T22:16:17.596732+0000","last_became_active":"2024-09-15T22:14:06.815712+0000","last_became_peered":"2024-09-15T22:14:06.815712+0000","last_unstale":"2024-09-15T22:16:17.596732+0000","last_undegraded":"2024-09-15T22:16:17.596732+0000","last_fullsized":"2024-09-15T22:16:17.596732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:43.598512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553284+0000","last_change":"2024-09-15T22:14:05.197487+0000","last_active":"2024-09-15T22:16:17.553284+0000","last_peered":"2024-09-15T22:16:17.553284+0000","last_clean":"2024-09-15T22:16:17.553284+0000","last_became_active":"2024-09-15T22:14:05.197098+0000","last_became_peered":"2024-09-15T22:14:05.197098+0000","last_unstale":"2024-09-15T22:16:17.553284+0000","last_undegraded":"2024-09-15T22:16:17.553284+0000","last_fullsized":"2024-09-15T22:16:17.553284+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:31.365645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.542012+0000","last_change":"2024-09-15T22:14:13.849594+0000","last_active":"2024-09-15T22:16:17.542012+0000","last_peered":"2024-09-15T22:16:17.542012+0000","last_clean":"2024-09-15T22:16:17.542012+0000","last_became_active":"2024-09-15T22:14:13.849157+0000","last_became_peered":"2024-09-15T22:14:13.849157+0000","last_unstale":"2024-09-15T22:16:17.542012+0000","last_undegraded":"2024-09-15T22:16:17.542012+0000","last_fullsized":"2024-09-15T22:16:17.542012+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:49.994107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.594139+0000","last_change":"2024-09-15T22:14:06.814312+0000","last_active":"2024-09-15T22:16:17.594139+0000","last_peered":"2024-09-15T22:16:17.594139+0000","last_clean":"2024-09-15T22:16:17.594139+0000","last_became_active":"2024-09-15T22:14:06.813959+0000","last_became_peered":"2024-09-15T22:14:06.813959+0000","last_unstale":"2024-09-15T22:16:17.594139+0000","last_undegraded":"2024-09-15T22:16:17.594139+0000","last_fullsized":"2024-09-15T22:16:17.594139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:36.924162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'65","reported_seq":132,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:27.861728+0000","last_change":"2024-09-15T22:14:04.713307+0000","last_active":"2024-09-15T22:16:27.861728+0000","last_peered":"2024-09-15T22:16:27.861728+0000","last_clean":"2024-09-15T22:16:27.861728+0000","last_became_active":"2024-09-15T22:14:04.712996+0000","last_became_peered":"2024-09-15T22:14:04.712996+0000","last_unstale":"2024-09-15T22:16:27.861728+0000","last_undegraded":"2024-09-15T22:16:27.861728+0000","last_fullsized":"2024-09-15T22:16:27.861728+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:37.298679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":32,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.563349+0000","last_change":"2024-09-15T22:14:13.846087+0000","last_active":"2024-09-15T22:16:17.563349+0000","last_peered":"2024-09-15T22:16:17.563349+0000","last_clean":"2024-09-15T22:16:17.563349+0000","last_became_active":"2024-09-15T22:14:13.845731+0000","last_became_peered":"2024-09-15T22:14:13.845731+0000","last_unstale":"2024-09-15T22:16:17.563349+0000","last_undegraded":"2024-09-15T22:16:17.563349+0000","last_fullsized":"2024-09-15T22:16:17.563349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:24.621330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.581459+0000","last_change":"2024-09-15T22:14:06.809456+0000","last_active":"2024-09-15T22:16:17.581459+0000","last_peered":"2024-09-15T22:16:17.581459+0000","last_clean":"2024-09-15T22:16:17.581459+0000","last_became_active":"2024-09-15T22:14:06.809141+0000","last_became_peered":"2024-09-15T22:14:06.809141+0000","last_unstale":"2024-09-15T22:16:17.581459+0000","last_undegraded":"2024-09-15T22:16:17.581459+0000","last_fullsized":"2024-09-15T22:16:17.581459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:30.186800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540944+0000","last_change":"2024-09-15T22:14:04.715399+0000","last_active":"2024-09-15T22:16:17.540944+0000","last_peered":"2024-09-15T22:16:17.540944+0000","last_clean":"2024-09-15T22:16:17.540944+0000","last_became_active":"2024-09-15T22:14:04.715043+0000","last_became_peered":"2024-09-15T22:14:04.715043+0000","last_unstale":"2024-09-15T22:16:17.540944+0000","last_undegraded":"2024-09-15T22:16:17.540944+0000","last_fullsized":"2024-09-15T22:16:17.540944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:13.860413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545046+0000","last_change":"2024-09-15T22:14:13.851594+0000","last_active":"2024-09-15T22:16:17.545046+0000","last_peered":"2024-09-15T22:16:17.545046+0000","last_clean":"2024-09-15T22:16:17.545046+0000","last_became_active":"2024-09-15T22:14:13.851154+0000","last_became_peered":"2024-09-15T22:14:13.851154+0000","last_unstale":"2024-09-15T22:16:17.545046+0000","last_undegraded":"2024-09-15T22:16:17.545046+0000","last_fullsized":"2024-09-15T22:16:17.545046+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:56:43.343808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579682+0000","last_change":"2024-09-15T22:15:17.219587+0000","last_active":"2024-09-15T22:16:17.579682+0000","last_peered":"2024-09-15T22:16:17.579682+0000","last_clean":"2024-09-15T22:16:17.579682+0000","last_became_active":"2024-09-15T22:15:17.219207+0000","last_became_peered":"2024-09-15T22:15:17.219207+0000","last_unstale":"2024-09-15T22:16:17.579682+0000","last_undegraded":"2024-09-15T22:16:17.579682+0000","last_fullsized":"2024-09-15T22:16:17.579682+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:15:34.267857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553979+0000","last_change":"2024-09-15T22:14:04.719550+0000","last_active":"2024-09-15T22:16:17.553979+0000","last_peered":"2024-09-15T22:16:17.553979+0000","last_clean":"2024-09-15T22:16:17.553979+0000","last_became_active":"2024-09-15T22:14:04.719273+0000","last_became_peered":"2024-09-15T22:14:04.719273+0000","last_unstale":"2024-09-15T22:16:17.553979+0000","last_undegraded":"2024-09-15T22:16:17.553979+0000","last_fullsized":"2024-09-15T22:16:17.553979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:20.973615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545214+0000","last_change":"2024-09-15T22:14:13.851420+0000","last_active":"2024-09-15T22:16:17.545214+0000","last_peered":"2024-09-15T22:16:17.545214+0000","last_clean":"2024-09-15T22:16:17.545214+0000","last_became_active":"2024-09-15T22:14:13.851051+0000","last_became_peered":"2024-09-15T22:14:13.851051+0000","last_unstale":"2024-09-15T22:16:17.545214+0000","last_undegraded":"2024-09-15T22:16:17.545214+0000","last_fullsized":"2024-09-15T22:16:17.545214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:11.979180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595588+0000","last_change":"2024-09-15T22:14:06.809609+0000","last_active":"2024-09-15T22:16:17.595588+0000","last_peered":"2024-09-15T22:16:17.595588+0000","last_clean":"2024-09-15T22:16:17.595588+0000","last_became_active":"2024-09-15T22:14:06.809213+0000","last_became_peered":"2024-09-15T22:14:06.809213+0000","last_unstale":"2024-09-15T22:16:17.595588+0000","last_undegraded":"2024-09-15T22:16:17.595588+0000","last_fullsized":"2024-09-15T22:16:17.595588+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:11.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"81'8","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.553769+0000","last_change":"2024-09-15T22:14:05.017559+0000","last_active":"2024-09-15T22:16:17.553769+0000","last_peered":"2024-09-15T22:16:17.553769+0000","last_clean":"2024-09-15T22:16:17.553769+0000","last_became_active":"2024-09-15T22:14:05.017121+0000","last_became_peered":"2024-09-15T22:14:05.017121+0000","last_unstale":"2024-09-15T22:16:17.553769+0000","last_undegraded":"2024-09-15T22:16:17.553769+0000","last_fullsized":"2024-09-15T22:16:17.553769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:29:06.442532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540809+0000","last_change":"2024-09-15T22:14:13.847835+0000","last_active":"2024-09-15T22:16:17.540809+0000","last_peered":"2024-09-15T22:16:17.540809+0000","last_clean":"2024-09-15T22:16:17.540809+0000","last_became_active":"2024-09-15T22:14:13.847437+0000","last_became_peered":"2024-09-15T22:14:13.847437+0000","last_unstale":"2024-09-15T22:16:17.540809+0000","last_undegraded":"2024-09-15T22:16:17.540809+0000","last_fullsized":"2024-09-15T22:16:17.540809+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:48.036495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.586410+0000","last_change":"2024-09-15T22:14:06.813191+0000","last_active":"2024-09-15T22:16:17.586410+0000","last_peered":"2024-09-15T22:16:17.586410+0000","last_clean":"2024-09-15T22:16:17.586410+0000","last_became_active":"2024-09-15T22:14:06.812861+0000","last_became_peered":"2024-09-15T22:14:06.812861+0000","last_unstale":"2024-09-15T22:16:17.586410+0000","last_undegraded":"2024-09-15T22:16:17.586410+0000","last_fullsized":"2024-09-15T22:16:17.586410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:44:51.487591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554424+0000","last_change":"2024-09-15T22:14:04.718431+0000","last_active":"2024-09-15T22:16:17.554424+0000","last_peered":"2024-09-15T22:16:17.554424+0000","last_clean":"2024-09-15T22:16:17.554424+0000","last_became_active":"2024-09-15T22:14:04.718109+0000","last_became_peered":"2024-09-15T22:14:04.718109+0000","last_unstale":"2024-09-15T22:16:17.554424+0000","last_undegraded":"2024-09-15T22:16:17.554424+0000","last_fullsized":"2024-09-15T22:16:17.554424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:10.408634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.557287+0000","last_change":"2024-09-15T22:14:13.845179+0000","last_active":"2024-09-15T22:16:17.557287+0000","last_peered":"2024-09-15T22:16:17.557287+0000","last_clean":"2024-09-15T22:16:17.557287+0000","last_became_active":"2024-09-15T22:14:13.844795+0000","last_became_peered":"2024-09-15T22:14:13.844795+0000","last_unstale":"2024-09-15T22:16:17.557287+0000","last_undegraded":"2024-09-15T22:16:17.557287+0000","last_fullsized":"2024-09-15T22:16:17.557287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:24.113536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.602323+0000","last_change":"2024-09-15T22:14:06.809687+0000","last_active":"2024-09-15T22:16:17.602323+0000","last_peered":"2024-09-15T22:16:17.602323+0000","last_clean":"2024-09-15T22:16:17.602323+0000","last_became_active":"2024-09-15T22:14:06.809383+0000","last_became_peered":"2024-09-15T22:14:06.809383+0000","last_unstale":"2024-09-15T22:16:17.602323+0000","last_undegraded":"2024-09-15T22:16:17.602323+0000","last_fullsized":"2024-09-15T22:16:17.602323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:19.439118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545340+0000","last_change":"2024-09-15T22:14:04.720577+0000","last_active":"2024-09-15T22:16:17.545340+0000","last_peered":"2024-09-15T22:16:17.545340+0000","last_clean":"2024-09-15T22:16:17.545340+0000","last_became_active":"2024-09-15T22:14:04.720235+0000","last_became_peered":"2024-09-15T22:14:04.720235+0000","last_unstale":"2024-09-15T22:16:17.545340+0000","last_undegraded":"2024-09-15T22:16:17.545340+0000","last_fullsized":"2024-09-15T22:16:17.545340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:17.501061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.559191+0000","last_change":"2024-09-15T22:14:13.854841+0000","last_active":"2024-09-15T22:16:17.559191+0000","last_peered":"2024-09-15T22:16:17.559191+0000","last_clean":"2024-09-15T22:16:17.559191+0000","last_became_active":"2024-09-15T22:14:13.854336+0000","last_became_peered":"2024-09-15T22:14:13.854336+0000","last_unstale":"2024-09-15T22:16:17.559191+0000","last_undegraded":"2024-09-15T22:16:17.559191+0000","last_fullsized":"2024-09-15T22:16:17.559191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:13.819532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.600465+0000","last_change":"2024-09-15T22:14:06.806829+0000","last_active":"2024-09-15T22:16:17.600465+0000","last_peered":"2024-09-15T22:16:17.600465+0000","last_clean":"2024-09-15T22:16:17.600465+0000","last_became_active":"2024-09-15T22:14:06.806521+0000","last_became_peered":"2024-09-15T22:14:06.806521+0000","last_unstale":"2024-09-15T22:16:17.600465+0000","last_undegraded":"2024-09-15T22:16:17.600465+0000","last_fullsized":"2024-09-15T22:16:17.600465+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:50.983246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"81'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552274+0000","last_change":"2024-09-15T22:14:04.717722+0000","last_active":"2024-09-15T22:16:17.552274+0000","last_peered":"2024-09-15T22:16:17.552274+0000","last_clean":"2024-09-15T22:16:17.552274+0000","last_became_active":"2024-09-15T22:14:04.717201+0000","last_became_peered":"2024-09-15T22:14:04.717201+0000","last_unstale":"2024-09-15T22:16:17.552274+0000","last_undegraded":"2024-09-15T22:16:17.552274+0000","last_fullsized":"2024-09-15T22:16:17.552274+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:50.545847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545450+0000","last_change":"2024-09-15T22:14:13.852874+0000","last_active":"2024-09-15T22:16:17.545450+0000","last_peered":"2024-09-15T22:16:17.545450+0000","last_clean":"2024-09-15T22:16:17.545450+0000","last_became_active":"2024-09-15T22:14:13.852426+0000","last_became_peered":"2024-09-15T22:14:13.852426+0000","last_unstale":"2024-09-15T22:16:17.545450+0000","last_undegraded":"2024-09-15T22:16:17.545450+0000","last_fullsized":"2024-09-15T22:16:17.545450+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:02:19.215156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.579481+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:16:17.579481+0000","last_peered":"2024-09-15T22:16:17.579481+0000","last_clean":"2024-09-15T22:16:17.579481+0000","last_became_active":"2024-09-15T22:14:06.809013+0000","last_became_peered":"2024-09-15T22:14:06.809013+0000","last_unstale":"2024-09-15T22:16:17.579481+0000","last_undegraded":"2024-09-15T22:16:17.579481+0000","last_fullsized":"2024-09-15T22:16:17.579481+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:47.830385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'38","reported_seq":296,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:28.101983+0000","last_change":"2024-09-15T22:14:04.721020+0000","last_active":"2024-09-15T22:16:28.101983+0000","last_peered":"2024-09-15T22:16:28.101983+0000","last_clean":"2024-09-15T22:16:28.101983+0000","last_became_active":"2024-09-15T22:14:04.720613+0000","last_became_peered":"2024-09-15T22:14:04.720613+0000","last_unstale":"2024-09-15T22:16:28.101983+0000","last_undegraded":"2024-09-15T22:16:28.101983+0000","last_fullsized":"2024-09-15T22:16:28.101983+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:42.719346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71847,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":221,"num_read_kb":182,"num_write":38,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555319+0000","last_change":"2024-09-15T22:14:13.854250+0000","last_active":"2024-09-15T22:16:17.555319+0000","last_peered":"2024-09-15T22:16:17.555319+0000","last_clean":"2024-09-15T22:16:17.555319+0000","last_became_active":"2024-09-15T22:14:13.852972+0000","last_became_peered":"2024-09-15T22:14:13.852972+0000","last_unstale":"2024-09-15T22:16:17.555319+0000","last_undegraded":"2024-09-15T22:16:17.555319+0000","last_fullsized":"2024-09-15T22:16:17.555319+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:50:45.301446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596123+0000","last_change":"2024-09-15T22:14:06.813789+0000","last_active":"2024-09-15T22:16:17.596123+0000","last_peered":"2024-09-15T22:16:17.596123+0000","last_clean":"2024-09-15T22:16:17.596123+0000","last_became_active":"2024-09-15T22:14:06.813501+0000","last_became_peered":"2024-09-15T22:14:06.813501+0000","last_unstale":"2024-09-15T22:16:17.596123+0000","last_undegraded":"2024-09-15T22:16:17.596123+0000","last_fullsized":"2024-09-15T22:16:17.596123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:21:40.032952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"81'3","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545628+0000","last_change":"2024-09-15T22:14:05.018957+0000","last_active":"2024-09-15T22:16:17.545628+0000","last_peered":"2024-09-15T22:16:17.545628+0000","last_clean":"2024-09-15T22:16:17.545628+0000","last_became_active":"2024-09-15T22:14:05.018602+0000","last_became_peered":"2024-09-15T22:14:05.018602+0000","last_unstale":"2024-09-15T22:16:17.545628+0000","last_undegraded":"2024-09-15T22:16:17.545628+0000","last_fullsized":"2024-09-15T22:16:17.545628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:48.839341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555029+0000","last_change":"2024-09-15T22:15:17.332417+0000","last_active":"2024-09-15T22:16:17.555029+0000","last_peered":"2024-09-15T22:16:17.555029+0000","last_clean":"2024-09-15T22:16:17.555029+0000","last_became_active":"2024-09-15T22:15:17.331771+0000","last_became_peered":"2024-09-15T22:15:17.331771+0000","last_unstale":"2024-09-15T22:16:17.555029+0000","last_undegraded":"2024-09-15T22:16:17.555029+0000","last_fullsized":"2024-09-15T22:16:17.555029+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:13:08.575035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,10],"acting":[4,1,2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605187+0000","last_change":"2024-09-15T22:14:06.814876+0000","last_active":"2024-09-15T22:16:17.605187+0000","last_peered":"2024-09-15T22:16:17.605187+0000","last_clean":"2024-09-15T22:16:17.605187+0000","last_became_active":"2024-09-15T22:14:06.814120+0000","last_became_peered":"2024-09-15T22:14:06.814120+0000","last_unstale":"2024-09-15T22:16:17.605187+0000","last_undegraded":"2024-09-15T22:16:17.605187+0000","last_fullsized":"2024-09-15T22:16:17.605187+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:37.417618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.555352+0000","last_change":"2024-09-15T22:14:04.719281+0000","last_active":"2024-09-15T22:16:17.555352+0000","last_peered":"2024-09-15T22:16:17.555352+0000","last_clean":"2024-09-15T22:16:17.555352+0000","last_became_active":"2024-09-15T22:14:04.718856+0000","last_became_peered":"2024-09-15T22:14:04.718856+0000","last_unstale":"2024-09-15T22:16:17.555352+0000","last_undegraded":"2024-09-15T22:16:17.555352+0000","last_fullsized":"2024-09-15T22:16:17.555352+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:28:22.137825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554629+0000","last_change":"2024-09-15T22:14:13.847398+0000","last_active":"2024-09-15T22:16:17.554629+0000","last_peered":"2024-09-15T22:16:17.554629+0000","last_clean":"2024-09-15T22:16:17.554629+0000","last_became_active":"2024-09-15T22:14:13.846870+0000","last_became_peered":"2024-09-15T22:14:13.846870+0000","last_unstale":"2024-09-15T22:16:17.554629+0000","last_undegraded":"2024-09-15T22:16:17.554629+0000","last_fullsized":"2024-09-15T22:16:17.554629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:51:58.872716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595875+0000","last_change":"2024-09-15T22:14:06.810412+0000","last_active":"2024-09-15T22:16:17.595875+0000","last_peered":"2024-09-15T22:16:17.595875+0000","last_clean":"2024-09-15T22:16:17.595875+0000","last_became_active":"2024-09-15T22:14:06.809669+0000","last_became_peered":"2024-09-15T22:14:06.809669+0000","last_unstale":"2024-09-15T22:16:17.595875+0000","last_undegraded":"2024-09-15T22:16:17.595875+0000","last_fullsized":"2024-09-15T22:16:17.595875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:44.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.549857+0000","last_change":"2024-09-15T22:14:04.715509+0000","last_active":"2024-09-15T22:16:17.549857+0000","last_peered":"2024-09-15T22:16:17.549857+0000","last_clean":"2024-09-15T22:16:17.549857+0000","last_became_active":"2024-09-15T22:14:04.715169+0000","last_became_peered":"2024-09-15T22:14:04.715169+0000","last_unstale":"2024-09-15T22:16:17.549857+0000","last_undegraded":"2024-09-15T22:16:17.549857+0000","last_fullsized":"2024-09-15T22:16:17.549857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:21.884103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.554221+0000","last_change":"2024-09-15T22:15:17.219519+0000","last_active":"2024-09-15T22:16:17.554221+0000","last_peered":"2024-09-15T22:16:17.554221+0000","last_clean":"2024-09-15T22:16:17.554221+0000","last_became_active":"2024-09-15T22:15:17.219106+0000","last_became_peered":"2024-09-15T22:15:17.219106+0000","last_unstale":"2024-09-15T22:16:17.554221+0000","last_undegraded":"2024-09-15T22:16:17.554221+0000","last_fullsized":"2024-09-15T22:16:17.554221+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:54:08.102329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,8],"acting":[3,7,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.562557+0000","last_change":"2024-09-15T22:14:13.844375+0000","last_active":"2024-09-15T22:16:17.562557+0000","last_peered":"2024-09-15T22:16:17.562557+0000","last_clean":"2024-09-15T22:16:17.562557+0000","last_became_active":"2024-09-15T22:14:13.843918+0000","last_became_peered":"2024-09-15T22:14:13.843918+0000","last_unstale":"2024-09-15T22:16:17.562557+0000","last_undegraded":"2024-09-15T22:16:17.562557+0000","last_fullsized":"2024-09-15T22:16:17.562557+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:32.190119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606349+0000","last_change":"2024-09-15T22:14:06.809534+0000","last_active":"2024-09-15T22:16:17.606349+0000","last_peered":"2024-09-15T22:16:17.606349+0000","last_clean":"2024-09-15T22:16:17.606349+0000","last_became_active":"2024-09-15T22:14:06.809147+0000","last_became_peered":"2024-09-15T22:14:06.809147+0000","last_unstale":"2024-09-15T22:16:17.606349+0000","last_undegraded":"2024-09-15T22:16:17.606349+0000","last_fullsized":"2024-09-15T22:16:17.606349+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:14.930542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545382+0000","last_change":"2024-09-15T22:14:04.715347+0000","last_active":"2024-09-15T22:16:17.545382+0000","last_peered":"2024-09-15T22:16:17.545382+0000","last_clean":"2024-09-15T22:16:17.545382+0000","last_became_active":"2024-09-15T22:14:04.715049+0000","last_became_peered":"2024-09-15T22:14:04.715049+0000","last_unstale":"2024-09-15T22:16:17.545382+0000","last_undegraded":"2024-09-15T22:16:17.545382+0000","last_fullsized":"2024-09-15T22:16:17.545382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:04.943344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.567570+0000","last_change":"2024-09-15T22:14:13.852397+0000","last_active":"2024-09-15T22:16:17.567570+0000","last_peered":"2024-09-15T22:16:17.567570+0000","last_clean":"2024-09-15T22:16:17.567570+0000","last_became_active":"2024-09-15T22:14:13.851863+0000","last_became_peered":"2024-09-15T22:14:13.851863+0000","last_unstale":"2024-09-15T22:16:17.567570+0000","last_undegraded":"2024-09-15T22:16:17.567570+0000","last_fullsized":"2024-09-15T22:16:17.567570+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:38.242241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606188+0000","last_change":"2024-09-15T22:14:06.809084+0000","last_active":"2024-09-15T22:16:17.606188+0000","last_peered":"2024-09-15T22:16:17.606188+0000","last_clean":"2024-09-15T22:16:17.606188+0000","last_became_active":"2024-09-15T22:14:06.808725+0000","last_became_peered":"2024-09-15T22:14:06.808725+0000","last_unstale":"2024-09-15T22:16:17.606188+0000","last_undegraded":"2024-09-15T22:16:17.606188+0000","last_fullsized":"2024-09-15T22:16:17.606188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:37.451661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.540329+0000","last_change":"2024-09-15T22:14:04.714279+0000","last_active":"2024-09-15T22:16:17.540329+0000","last_peered":"2024-09-15T22:16:17.540329+0000","last_clean":"2024-09-15T22:16:17.540329+0000","last_became_active":"2024-09-15T22:14:04.713751+0000","last_became_peered":"2024-09-15T22:14:04.713751+0000","last_unstale":"2024-09-15T22:16:17.540329+0000","last_undegraded":"2024-09-15T22:16:17.540329+0000","last_fullsized":"2024-09-15T22:16:17.540329+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:34.268701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"81'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.549598+0000","last_change":"2024-09-15T22:14:04.716417+0000","last_active":"2024-09-15T22:16:17.549598+0000","last_peered":"2024-09-15T22:16:17.549598+0000","last_clean":"2024-09-15T22:16:17.549598+0000","last_became_active":"2024-09-15T22:14:04.716096+0000","last_became_peered":"2024-09-15T22:14:04.716096+0000","last_unstale":"2024-09-15T22:16:17.549598+0000","last_undegraded":"2024-09-15T22:16:17.549598+0000","last_fullsized":"2024-09-15T22:16:17.549598+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:30.819060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.601287+0000","last_change":"2024-09-15T22:15:17.403940+0000","last_active":"2024-09-15T22:16:17.601287+0000","last_peered":"2024-09-15T22:16:17.601287+0000","last_clean":"2024-09-15T22:16:17.601287+0000","last_became_active":"2024-09-15T22:15:17.403517+0000","last_became_peered":"2024-09-15T22:15:17.403517+0000","last_unstale":"2024-09-15T22:16:17.601287+0000","last_undegraded":"2024-09-15T22:16:17.601287+0000","last_fullsized":"2024-09-15T22:16:17.601287+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:49.602367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552004+0000","last_change":"2024-09-15T22:15:17.404136+0000","last_active":"2024-09-15T22:16:17.552004+0000","last_peered":"2024-09-15T22:16:17.552004+0000","last_clean":"2024-09-15T22:16:17.552004+0000","last_became_active":"2024-09-15T22:15:17.403652+0000","last_became_peered":"2024-09-15T22:15:17.403652+0000","last_unstale":"2024-09-15T22:16:17.552004+0000","last_undegraded":"2024-09-15T22:16:17.552004+0000","last_fullsized":"2024-09-15T22:16:17.552004+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:02:31.518956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"81'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.545473+0000","last_change":"2024-09-15T22:14:04.718682+0000","last_active":"2024-09-15T22:16:17.545473+0000","last_peered":"2024-09-15T22:16:17.545473+0000","last_clean":"2024-09-15T22:16:17.545473+0000","last_became_active":"2024-09-15T22:14:04.718313+0000","last_became_peered":"2024-09-15T22:14:04.718313+0000","last_unstale":"2024-09-15T22:16:17.545473+0000","last_undegraded":"2024-09-15T22:16:17.545473+0000","last_fullsized":"2024-09-15T22:16:17.545473+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:03.695849+0000","last_clean_scrub_stamp":"2024-09-15T22:14:03.695849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:47.797513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595742+0000","last_change":"2024-09-15T22:14:06.819632+0000","last_active":"2024-09-15T22:16:17.595742+0000","last_peered":"2024-09-15T22:16:17.595742+0000","last_clean":"2024-09-15T22:16:17.595742+0000","last_became_active":"2024-09-15T22:14:06.819135+0000","last_became_peered":"2024-09-15T22:14:06.819135+0000","last_unstale":"2024-09-15T22:16:17.595742+0000","last_undegraded":"2024-09-15T22:16:17.595742+0000","last_fullsized":"2024-09-15T22:16:17.595742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:12:35.708318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.552345+0000","last_change":"2024-09-15T22:14:13.851367+0000","last_active":"2024-09-15T22:16:17.552345+0000","last_peered":"2024-09-15T22:16:17.552345+0000","last_clean":"2024-09-15T22:16:17.552345+0000","last_became_active":"2024-09-15T22:14:13.850999+0000","last_became_peered":"2024-09-15T22:14:13.850999+0000","last_unstale":"2024-09-15T22:16:17.552345+0000","last_undegraded":"2024-09-15T22:16:17.552345+0000","last_fullsized":"2024-09-15T22:16:17.552345+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:12.819987+0000","last_clean_scrub_stamp":"2024-09-15T22:14:12.819987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:40:03.957622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582014+0000","last_change":"2024-09-15T22:14:06.817213+0000","last_active":"2024-09-15T22:16:17.582014+0000","last_peered":"2024-09-15T22:16:17.582014+0000","last_clean":"2024-09-15T22:16:17.582014+0000","last_became_active":"2024-09-15T22:14:06.816828+0000","last_became_peered":"2024-09-15T22:14:06.816828+0000","last_unstale":"2024-09-15T22:16:17.582014+0000","last_undegraded":"2024-09-15T22:16:17.582014+0000","last_fullsized":"2024-09-15T22:16:17.582014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:55.042256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.590899+0000","last_change":"2024-09-15T22:14:06.814832+0000","last_active":"2024-09-15T22:16:17.590899+0000","last_peered":"2024-09-15T22:16:17.590899+0000","last_clean":"2024-09-15T22:16:17.590899+0000","last_became_active":"2024-09-15T22:14:06.814500+0000","last_became_peered":"2024-09-15T22:14:06.814500+0000","last_unstale":"2024-09-15T22:16:17.590899+0000","last_undegraded":"2024-09-15T22:16:17.590899+0000","last_fullsized":"2024-09-15T22:16:17.590899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:43.623629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603884+0000","last_change":"2024-09-15T22:14:06.809464+0000","last_active":"2024-09-15T22:16:17.603884+0000","last_peered":"2024-09-15T22:16:17.603884+0000","last_clean":"2024-09-15T22:16:17.603884+0000","last_became_active":"2024-09-15T22:14:06.809160+0000","last_became_peered":"2024-09-15T22:14:06.809160+0000","last_unstale":"2024-09-15T22:16:17.603884+0000","last_undegraded":"2024-09-15T22:16:17.603884+0000","last_fullsized":"2024-09-15T22:16:17.603884+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:04.428259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606874+0000","last_change":"2024-09-15T22:14:06.814428+0000","last_active":"2024-09-15T22:16:17.606874+0000","last_peered":"2024-09-15T22:16:17.606874+0000","last_clean":"2024-09-15T22:16:17.606874+0000","last_became_active":"2024-09-15T22:14:06.814100+0000","last_became_peered":"2024-09-15T22:14:06.814100+0000","last_unstale":"2024-09-15T22:16:17.606874+0000","last_undegraded":"2024-09-15T22:16:17.606874+0000","last_fullsized":"2024-09-15T22:16:17.606874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:33.606766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606907+0000","last_change":"2024-09-15T22:14:06.815638+0000","last_active":"2024-09-15T22:16:17.606907+0000","last_peered":"2024-09-15T22:16:17.606907+0000","last_clean":"2024-09-15T22:16:17.606907+0000","last_became_active":"2024-09-15T22:14:06.815327+0000","last_became_peered":"2024-09-15T22:14:06.815327+0000","last_unstale":"2024-09-15T22:16:17.606907+0000","last_undegraded":"2024-09-15T22:16:17.606907+0000","last_fullsized":"2024-09-15T22:16:17.606907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:07.679547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.580925+0000","last_change":"2024-09-15T22:15:17.218238+0000","last_active":"2024-09-15T22:16:17.580925+0000","last_peered":"2024-09-15T22:16:17.580925+0000","last_clean":"2024-09-15T22:16:17.580925+0000","last_became_active":"2024-09-15T22:15:17.217852+0000","last_became_peered":"2024-09-15T22:15:17.217852+0000","last_unstale":"2024-09-15T22:16:17.580925+0000","last_undegraded":"2024-09-15T22:16:17.580925+0000","last_fullsized":"2024-09-15T22:16:17.580925+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:13:42.046956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.576752+0000","last_change":"2024-09-15T22:14:06.819667+0000","last_active":"2024-09-15T22:16:17.576752+0000","last_peered":"2024-09-15T22:16:17.576752+0000","last_clean":"2024-09-15T22:16:17.576752+0000","last_became_active":"2024-09-15T22:14:06.819389+0000","last_became_peered":"2024-09-15T22:14:06.819389+0000","last_unstale":"2024-09-15T22:16:17.576752+0000","last_undegraded":"2024-09-15T22:16:17.576752+0000","last_fullsized":"2024-09-15T22:16:17.576752+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:06:16.571088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.597582+0000","last_change":"2024-09-15T22:15:17.118133+0000","last_active":"2024-09-15T22:16:17.597582+0000","last_peered":"2024-09-15T22:16:17.597582+0000","last_clean":"2024-09-15T22:16:17.597582+0000","last_became_active":"2024-09-15T22:15:17.117802+0000","last_became_peered":"2024-09-15T22:15:17.117802+0000","last_unstale":"2024-09-15T22:16:17.597582+0000","last_undegraded":"2024-09-15T22:16:17.597582+0000","last_fullsized":"2024-09-15T22:16:17.597582+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:17:21.523149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.600039+0000","last_change":"2024-09-15T22:14:06.801454+0000","last_active":"2024-09-15T22:16:17.600039+0000","last_peered":"2024-09-15T22:16:17.600039+0000","last_clean":"2024-09-15T22:16:17.600039+0000","last_became_active":"2024-09-15T22:14:06.801105+0000","last_became_peered":"2024-09-15T22:14:06.801105+0000","last_unstale":"2024-09-15T22:16:17.600039+0000","last_undegraded":"2024-09-15T22:16:17.600039+0000","last_fullsized":"2024-09-15T22:16:17.600039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:32.457428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596301+0000","last_change":"2024-09-15T22:14:06.812603+0000","last_active":"2024-09-15T22:16:17.596301+0000","last_peered":"2024-09-15T22:16:17.596301+0000","last_clean":"2024-09-15T22:16:17.596301+0000","last_became_active":"2024-09-15T22:14:06.812208+0000","last_became_peered":"2024-09-15T22:14:06.812208+0000","last_unstale":"2024-09-15T22:16:17.596301+0000","last_undegraded":"2024-09-15T22:16:17.596301+0000","last_fullsized":"2024-09-15T22:16:17.596301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:55.327481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595802+0000","last_change":"2024-09-15T22:14:06.811783+0000","last_active":"2024-09-15T22:16:17.595802+0000","last_peered":"2024-09-15T22:16:17.595802+0000","last_clean":"2024-09-15T22:16:17.595802+0000","last_became_active":"2024-09-15T22:14:06.811208+0000","last_became_peered":"2024-09-15T22:14:06.811208+0000","last_unstale":"2024-09-15T22:16:17.595802+0000","last_undegraded":"2024-09-15T22:16:17.595802+0000","last_fullsized":"2024-09-15T22:16:17.595802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:08:15.576776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.607074+0000","last_change":"2024-09-15T22:14:06.818608+0000","last_active":"2024-09-15T22:16:17.607074+0000","last_peered":"2024-09-15T22:16:17.607074+0000","last_clean":"2024-09-15T22:16:17.607074+0000","last_became_active":"2024-09-15T22:14:06.818283+0000","last_became_peered":"2024-09-15T22:14:06.818283+0000","last_unstale":"2024-09-15T22:16:17.607074+0000","last_undegraded":"2024-09-15T22:16:17.607074+0000","last_fullsized":"2024-09-15T22:16:17.607074+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:02.477461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.593536+0000","last_change":"2024-09-15T22:14:06.809383+0000","last_active":"2024-09-15T22:16:17.593536+0000","last_peered":"2024-09-15T22:16:17.593536+0000","last_clean":"2024-09-15T22:16:17.593536+0000","last_became_active":"2024-09-15T22:14:06.809043+0000","last_became_peered":"2024-09-15T22:14:06.809043+0000","last_unstale":"2024-09-15T22:16:17.593536+0000","last_undegraded":"2024-09-15T22:16:17.593536+0000","last_fullsized":"2024-09-15T22:16:17.593536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:58.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598619+0000","last_change":"2024-09-15T22:14:06.814875+0000","last_active":"2024-09-15T22:16:17.598619+0000","last_peered":"2024-09-15T22:16:17.598619+0000","last_clean":"2024-09-15T22:16:17.598619+0000","last_became_active":"2024-09-15T22:14:06.814543+0000","last_became_peered":"2024-09-15T22:14:06.814543+0000","last_unstale":"2024-09-15T22:16:17.598619+0000","last_undegraded":"2024-09-15T22:16:17.598619+0000","last_fullsized":"2024-09-15T22:16:17.598619+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:55:57.465965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595163+0000","last_change":"2024-09-15T22:14:06.810655+0000","last_active":"2024-09-15T22:16:17.595163+0000","last_peered":"2024-09-15T22:16:17.595163+0000","last_clean":"2024-09-15T22:16:17.595163+0000","last_became_active":"2024-09-15T22:14:06.810159+0000","last_became_peered":"2024-09-15T22:14:06.810159+0000","last_unstale":"2024-09-15T22:16:17.595163+0000","last_undegraded":"2024-09-15T22:16:17.595163+0000","last_fullsized":"2024-09-15T22:16:17.595163+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:17.368982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604239+0000","last_change":"2024-09-15T22:14:06.815048+0000","last_active":"2024-09-15T22:16:17.604239+0000","last_peered":"2024-09-15T22:16:17.604239+0000","last_clean":"2024-09-15T22:16:17.604239+0000","last_became_active":"2024-09-15T22:14:06.814744+0000","last_became_peered":"2024-09-15T22:14:06.814744+0000","last_unstale":"2024-09-15T22:16:17.604239+0000","last_undegraded":"2024-09-15T22:16:17.604239+0000","last_fullsized":"2024-09-15T22:16:17.604239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:26.927942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606940+0000","last_change":"2024-09-15T22:14:06.811672+0000","last_active":"2024-09-15T22:16:17.606940+0000","last_peered":"2024-09-15T22:16:17.606940+0000","last_clean":"2024-09-15T22:16:17.606940+0000","last_became_active":"2024-09-15T22:14:06.811300+0000","last_became_peered":"2024-09-15T22:14:06.811300+0000","last_unstale":"2024-09-15T22:16:17.606940+0000","last_undegraded":"2024-09-15T22:16:17.606940+0000","last_fullsized":"2024-09-15T22:16:17.606940+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:46.223584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.603117+0000","last_change":"2024-09-15T22:14:06.814495+0000","last_active":"2024-09-15T22:16:17.603117+0000","last_peered":"2024-09-15T22:16:17.603117+0000","last_clean":"2024-09-15T22:16:17.603117+0000","last_became_active":"2024-09-15T22:14:06.814142+0000","last_became_peered":"2024-09-15T22:14:06.814142+0000","last_unstale":"2024-09-15T22:16:17.603117+0000","last_undegraded":"2024-09-15T22:16:17.603117+0000","last_fullsized":"2024-09-15T22:16:17.603117+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:20.374348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.606333+0000","last_change":"2024-09-15T22:14:06.811063+0000","last_active":"2024-09-15T22:16:17.606333+0000","last_peered":"2024-09-15T22:16:17.606333+0000","last_clean":"2024-09-15T22:16:17.606333+0000","last_became_active":"2024-09-15T22:14:06.810700+0000","last_became_peered":"2024-09-15T22:14:06.810700+0000","last_unstale":"2024-09-15T22:16:17.606333+0000","last_undegraded":"2024-09-15T22:16:17.606333+0000","last_fullsized":"2024-09-15T22:16:17.606333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:11.250590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605660+0000","last_change":"2024-09-15T22:14:06.816896+0000","last_active":"2024-09-15T22:16:17.605660+0000","last_peered":"2024-09-15T22:16:17.605660+0000","last_clean":"2024-09-15T22:16:17.605660+0000","last_became_active":"2024-09-15T22:14:06.816559+0000","last_became_peered":"2024-09-15T22:14:06.816559+0000","last_unstale":"2024-09-15T22:16:17.605660+0000","last_undegraded":"2024-09-15T22:16:17.605660+0000","last_fullsized":"2024-09-15T22:16:17.605660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:46:17.965490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.592573+0000","last_change":"2024-09-15T22:14:06.813984+0000","last_active":"2024-09-15T22:16:17.592573+0000","last_peered":"2024-09-15T22:16:17.592573+0000","last_clean":"2024-09-15T22:16:17.592573+0000","last_became_active":"2024-09-15T22:14:06.813586+0000","last_became_peered":"2024-09-15T22:14:06.813586+0000","last_unstale":"2024-09-15T22:16:17.592573+0000","last_undegraded":"2024-09-15T22:16:17.592573+0000","last_fullsized":"2024-09-15T22:16:17.592573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:34.335741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.596558+0000","last_change":"2024-09-15T22:14:06.816047+0000","last_active":"2024-09-15T22:16:17.596558+0000","last_peered":"2024-09-15T22:16:17.596558+0000","last_clean":"2024-09-15T22:16:17.596558+0000","last_became_active":"2024-09-15T22:14:06.815244+0000","last_became_peered":"2024-09-15T22:14:06.815244+0000","last_unstale":"2024-09-15T22:16:17.596558+0000","last_undegraded":"2024-09-15T22:16:17.596558+0000","last_fullsized":"2024-09-15T22:16:17.596558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:30.469382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.583325+0000","last_change":"2024-09-15T22:14:06.813254+0000","last_active":"2024-09-15T22:16:17.583325+0000","last_peered":"2024-09-15T22:16:17.583325+0000","last_clean":"2024-09-15T22:16:17.583325+0000","last_became_active":"2024-09-15T22:14:06.812921+0000","last_became_peered":"2024-09-15T22:14:06.812921+0000","last_unstale":"2024-09-15T22:16:17.583325+0000","last_undegraded":"2024-09-15T22:16:17.583325+0000","last_fullsized":"2024-09-15T22:16:17.583325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:40.674246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.595905+0000","last_change":"2024-09-15T22:14:06.817016+0000","last_active":"2024-09-15T22:16:17.595905+0000","last_peered":"2024-09-15T22:16:17.595905+0000","last_clean":"2024-09-15T22:16:17.595905+0000","last_became_active":"2024-09-15T22:14:06.816256+0000","last_became_peered":"2024-09-15T22:14:06.816256+0000","last_unstale":"2024-09-15T22:16:17.595905+0000","last_undegraded":"2024-09-15T22:16:17.595905+0000","last_fullsized":"2024-09-15T22:16:17.595905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:37.092156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.585070+0000","last_change":"2024-09-15T22:15:17.331108+0000","last_active":"2024-09-15T22:16:17.585070+0000","last_peered":"2024-09-15T22:16:17.585070+0000","last_clean":"2024-09-15T22:16:17.585070+0000","last_became_active":"2024-09-15T22:15:17.330765+0000","last_became_peered":"2024-09-15T22:15:17.330765+0000","last_unstale":"2024-09-15T22:16:17.585070+0000","last_undegraded":"2024-09-15T22:16:17.585070+0000","last_fullsized":"2024-09-15T22:16:17.585070+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:37.975326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,10],"acting":[9,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.582652+0000","last_change":"2024-09-15T22:14:06.814902+0000","last_active":"2024-09-15T22:16:17.582652+0000","last_peered":"2024-09-15T22:16:17.582652+0000","last_clean":"2024-09-15T22:16:17.582652+0000","last_became_active":"2024-09-15T22:14:06.814563+0000","last_became_peered":"2024-09-15T22:14:06.814563+0000","last_unstale":"2024-09-15T22:16:17.582652+0000","last_undegraded":"2024-09-15T22:16:17.582652+0000","last_fullsized":"2024-09-15T22:16:17.582652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:02.185641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.580466+0000","last_change":"2024-09-15T22:14:06.807444+0000","last_active":"2024-09-15T22:16:17.580466+0000","last_peered":"2024-09-15T22:16:17.580466+0000","last_clean":"2024-09-15T22:16:17.580466+0000","last_became_active":"2024-09-15T22:14:06.807083+0000","last_became_peered":"2024-09-15T22:14:06.807083+0000","last_unstale":"2024-09-15T22:16:17.580466+0000","last_undegraded":"2024-09-15T22:16:17.580466+0000","last_fullsized":"2024-09-15T22:16:17.580466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:07.704125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.598596+0000","last_change":"2024-09-15T22:14:06.811851+0000","last_active":"2024-09-15T22:16:17.598596+0000","last_peered":"2024-09-15T22:16:17.598596+0000","last_clean":"2024-09-15T22:16:17.598596+0000","last_became_active":"2024-09-15T22:14:06.811451+0000","last_became_peered":"2024-09-15T22:14:06.811451+0000","last_unstale":"2024-09-15T22:16:17.598596+0000","last_undegraded":"2024-09-15T22:16:17.598596+0000","last_fullsized":"2024-09-15T22:16:17.598596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:51.389555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.589842+0000","last_change":"2024-09-15T22:14:06.812520+0000","last_active":"2024-09-15T22:16:17.589842+0000","last_peered":"2024-09-15T22:16:17.589842+0000","last_clean":"2024-09-15T22:16:17.589842+0000","last_became_active":"2024-09-15T22:14:06.812222+0000","last_became_peered":"2024-09-15T22:14:06.812222+0000","last_unstale":"2024-09-15T22:16:17.589842+0000","last_undegraded":"2024-09-15T22:16:17.589842+0000","last_fullsized":"2024-09-15T22:16:17.589842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:01.589678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604461+0000","last_change":"2024-09-15T22:14:06.808649+0000","last_active":"2024-09-15T22:16:17.604461+0000","last_peered":"2024-09-15T22:16:17.604461+0000","last_clean":"2024-09-15T22:16:17.604461+0000","last_became_active":"2024-09-15T22:14:06.808278+0000","last_became_peered":"2024-09-15T22:14:06.808278+0000","last_unstale":"2024-09-15T22:16:17.604461+0000","last_undegraded":"2024-09-15T22:16:17.604461+0000","last_fullsized":"2024-09-15T22:16:17.604461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:32.810549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.605104+0000","last_change":"2024-09-15T22:14:06.811593+0000","last_active":"2024-09-15T22:16:17.605104+0000","last_peered":"2024-09-15T22:16:17.605104+0000","last_clean":"2024-09-15T22:16:17.605104+0000","last_became_active":"2024-09-15T22:14:06.811285+0000","last_became_peered":"2024-09-15T22:14:06.811285+0000","last_unstale":"2024-09-15T22:16:17.605104+0000","last_undegraded":"2024-09-15T22:16:17.605104+0000","last_fullsized":"2024-09-15T22:16:17.605104+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:36.482554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"90'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-15T22:16:17.604430+0000","last_change":"2024-09-15T22:14:06.816084+0000","last_active":"2024-09-15T22:16:17.604430+0000","last_peered":"2024-09-15T22:16:17.604430+0000","last_clean":"2024-09-15T22:16:17.604430+0000","last_became_active":"2024-09-15T22:14:06.815461+0000","last_became_peered":"2024-09-15T22:14:06.815461+0000","last_unstale":"2024-09-15T22:16:17.604430+0000","last_undegraded":"2024-09-15T22:16:17.604430+0000","last_fullsized":"2024-09-15T22:16:17.604430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:14:05.780402+0000","last_clean_scrub_stamp":"2024-09-15T22:14:05.780402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:57.455608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":794093,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":562,"num_read_kb":488,"num_write":330,"num_write_kb":2328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2482176,"data_stored":2382279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547242,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1028096,"data_stored":511054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776174,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29140,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716012,"statfs":{"total":95995035648,"available":95965196288,"internally_reserved":0,"allocated":2043904,"data_stored":1497599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939699,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36740,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708412,"statfs":{"total":95995035648,"available":95957413888,"internally_reserved":0,"allocated":1429504,"data_stored":908948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168633,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36740,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708412,"statfs":{"total":95995035648,"available":95957413888,"internally_reserved":0,"allocated":1429504,"data_stored":904874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430269,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1630208,"data_stored":1106100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593795,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1024000,"data_stored":506958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822728,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37384,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707768,"statfs":{"total":95995035648,"available":95956754432,"internally_reserved":0,"allocated":1966080,"data_stored":1429836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986252,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1032192,"data_stored":511076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215186,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28860,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716292,"statfs":{"total":95995035648,"available":95965483008,"internally_reserved":0,"allocated":1757184,"data_stored":1228510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1110016,"data_stored":578839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1105920,"data_stored":578805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40512,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704640,"statfs":{"total":95995035648,"available":95953551360,"internally_reserved":0,"allocated":1028096,"data_stored":507048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":71881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":733184,"data_stored":721552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":328414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":393820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":393798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":400273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:16:35.989 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:16:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:36.480 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:36 smithi045 ceph-mon[31180]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:36.669 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:36 smithi100 ceph-mon[35319]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:36.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.566+0000 7f4dcaced640 1 -- 172.21.15.45:0/3078426357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc4102d90 msgr2=0x7f4dc4103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:36.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.566+0000 7f4dcaced640 1 --2- 172.21.15.45:0/3078426357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc4102d90 0x7f4dc4103170 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009930 tx=0x7f4db802a420 comp rx=0 tx=0).stop 2024-09-15T22:16:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.566+0000 7f4dcaced640 1 -- 172.21.15.45:0/3078426357 shutdown_connections 2024-09-15T22:16:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.566+0000 7f4dcaced640 1 --2- 172.21.15.45:0/3078426357 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dc4108290 0x7f4dc410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.566+0000 7f4dcaced640 1 --2- 172.21.15.45:0/3078426357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc4103740 0x7f4dc4107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.566+0000 7f4dcaced640 1 --2- 172.21.15.45:0/3078426357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc4102d90 0x7f4dc4103170 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.566+0000 7f4dcaced640 1 -- 172.21.15.45:0/3078426357 >> 172.21.15.45:0/3078426357 conn(0x7f4dc40fc7d0 msgr2=0x7f4dc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.566+0000 7f4dcaced640 1 -- 172.21.15.45:0/3078426357 shutdown_connections 2024-09-15T22:16:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.566+0000 7f4dcaced640 1 -- 172.21.15.45:0/3078426357 wait complete. 2024-09-15T22:16:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.566+0000 7f4dcaced640 1 Processor -- start 2024-09-15T22:16:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dcaced640 1 -- start start 2024-09-15T22:16:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dcaced640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc4102d90 0x7f4dc41985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dcaced640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dc4103740 0x7f4dc4198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dcaced640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc4108290 0x7f4dc419cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dcaced640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc41121b0 con 0x7f4dc4102d90 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dcaced640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc4112030 con 0x7f4dc4108290 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dcaced640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc4112330 con 0x7f4dc4103740 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dc8a89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc4102d90 0x7f4dc41985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dc8a89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc4102d90 0x7f4dc41985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51596/0 (socket says 172.21.15.45:51596) 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dc8a89640 1 -- 172.21.15.45:0/3915843530 learned_addr learned my addr 172.21.15.45:0/3915843530 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dc928a640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc4108290 0x7f4dc419cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dc3fff640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dc4103740 0x7f4dc4198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dc8a89640 1 -- 172.21.15.45:0/3915843530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dc4103740 msgr2=0x7f4dc4198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dc4103740 0x7f4dc4198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dc8a89640 1 -- 172.21.15.45:0/3915843530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc4108290 msgr2=0x7f4dc419cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc4108290 0x7f4dc419cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dc8a89640 1 -- 172.21.15.45:0/3915843530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc419d5a0 con 0x7f4dc4102d90 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.567+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc4102d90 0x7f4dc41985f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009230 tx=0x7f4db8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.568+0000 7f4dc1ffb640 1 -- 172.21.15.45:0/3915843530 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db803f030 con 0x7f4dc4102d90 2024-09-15T22:16:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.568+0000 7f4dc1ffb640 1 -- 172.21.15.45:0/3915843530 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4db8003af0 con 0x7f4dc4102d90 2024-09-15T22:16:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.568+0000 7f4dc1ffb640 1 -- 172.21.15.45:0/3915843530 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8035070 con 0x7f4dc4102d90 2024-09-15T22:16:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.568+0000 7f4dcaced640 1 -- 172.21.15.45:0/3915843530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc419d830 con 0x7f4dc4102d90 2024-09-15T22:16:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.568+0000 7f4dcaced640 1 -- 172.21.15.45:0/3915843530 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc419dcc0 con 0x7f4dc4102d90 2024-09-15T22:16:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.570+0000 7f4dc1ffb640 1 -- 172.21.15.45:0/3915843530 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f4db8042030 con 0x7f4dc4102d90 2024-09-15T22:16:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.570+0000 7f4dcd0c6740 1 Processor -- start 2024-09-15T22:16:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.570+0000 7f4dcd0c6740 1 -- start start 2024-09-15T22:16:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dcd0c6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755a3b60 0x5604755a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dcd0c6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a4480 0x5604755ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dcd0c6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755aed40 0x5604755b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dcd0c6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560475509280 con 0x5604755aed40 2024-09-15T22:16:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dcd0c6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5604754b0b10 con 0x5604755a4480 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dcd0c6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560475505240 con 0x5604755a3b60 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dc1ffb640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4db40a34c0 0x7f4db40a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755aed40 0x5604755b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755aed40 0x5604755b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51608/0 (socket says 172.21.15.45:51608) 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dc3fff640 1 -- 172.21.15.45:0/361825570 learned_addr learned my addr 172.21.15.45:0/361825570 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dc928a640 1 --2- 172.21.15.45:0/361825570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755a3b60 0x5604755a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/361825570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a4480 0x5604755ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dc928a640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4db40a34c0 0x7f4db40a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dc1ffb640 1 -- 172.21.15.45:0/3915843530 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f4db80f0a30 con 0x7f4dc4102d90 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dc3fff640 1 -- 172.21.15.45:0/361825570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755a3b60 msgr2=0x5604755a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dc3fff640 1 --2- 172.21.15.45:0/361825570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755a3b60 0x5604755a3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dc3fff640 1 -- 172.21.15.45:0/361825570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a4480 msgr2=0x5604755ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dc3fff640 1 --2- 172.21.15.45:0/361825570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a4480 0x5604755ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.571+0000 7f4dc3fff640 1 -- 172.21.15.45:0/361825570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604754bd1f0 con 0x5604755aed40 2024-09-15T22:16:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.572+0000 7f4dc3fff640 1 --2- 172.21.15.45:0/361825570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755aed40 0x5604755b1130 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009b10 tx=0x7f4db000e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0a01440f8dece2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.572+0000 7f4daeffd640 1 -- 172.21.15.45:0/361825570 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0016070 con 0x5604755aed40 2024-09-15T22:16:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.572+0000 7f4dc928a640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4db40a34c0 0x7f4db40a5980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00bfd0 tx=0x7f4dbc004a40 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.572+0000 7f4daeffd640 1 -- 172.21.15.45:0/361825570 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4db0005520 con 0x5604755aed40 2024-09-15T22:16:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.572+0000 7f4daeffd640 1 -- 172.21.15.45:0/361825570 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0011670 con 0x5604755aed40 2024-09-15T22:16:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.572+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/361825570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755aed40 msgr2=0x5604755b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.572+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/361825570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755aed40 0x5604755b1130 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009b10 tx=0x7f4db000e2f0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.572+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/361825570 shutdown_connections 2024-09-15T22:16:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.572+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/361825570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755aed40 0x5604755b1130 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.572+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/361825570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a4480 0x5604755ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.572+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/361825570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755a3b60 0x5604755a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.572+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/361825570 >> 172.21.15.45:0/361825570 conn(0x5604755a00f0 msgr2=0x5604755a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:36.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.572+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/361825570 shutdown_connections 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.573+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/361825570 wait complete. 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.573+0000 7f4dcd0c6740 1 -- start start 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.573+0000 7f4dcd0c6740 1 Processor -- start 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.573+0000 7f4dcd0c6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755a3b60 0x5604755abb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.573+0000 7f4dcd0c6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a4480 0x5604755ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.573+0000 7f4dcd0c6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755aed40 0x5604755ac610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.573+0000 7f4dcd0c6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5604755b1910 con 0x5604755a4480 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.573+0000 7f4dcd0c6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5604754c3f10 con 0x5604755aed40 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.573+0000 7f4dcd0c6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5604755b1a90 con 0x5604755a3b60 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.573+0000 7f4dcd0c6740 10 client.0 _ll_register_callbacks cb 0x56047548ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.573+0000 7f4dc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a4480 0x5604755ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4dc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a4480 0x5604755ac0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51620/0 (socket says 172.21.15.45:51620) 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4dc3fff640 1 -- 172.21.15.45:0/1760457786 learned_addr learned my addr 172.21.15.45:0/1760457786 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:36.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/1760457786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755a3b60 0x5604755abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4dc928a640 1 --2- 172.21.15.45:0/1760457786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755aed40 0x5604755ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4dc3fff640 1 -- 172.21.15.45:0/1760457786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755a3b60 msgr2=0x5604755abb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4dc3fff640 1 --2- 172.21.15.45:0/1760457786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755a3b60 0x5604755abb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4dc3fff640 1 -- 172.21.15.45:0/1760457786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755aed40 msgr2=0x5604755ac610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4dc3fff640 1 --2- 172.21.15.45:0/1760457786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755aed40 0x5604755ac610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4dc3fff640 1 -- 172.21.15.45:0/1760457786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56047527a6a0 con 0x5604755a4480 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4dc3fff640 1 --2- 172.21.15.45:0/1760457786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a4480 0x5604755ac0d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4db0000c00 tx=0x7f4db000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a195ee7a6e693e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4da3fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4da3fff640 1 -- 172.21.15.45:0/1760457786 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0028060 con 0x5604755a4480 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4da3fff640 1 -- 172.21.15.45:0/1760457786 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f4db0005020 con 0x5604755a4480 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1760457786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4db0005520 con 0x5604755a4480 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4da3fff640 1 -- 172.21.15.45:0/1760457786 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4db002f050 con 0x5604755a4480 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4dcd0c6740 10 client.15405 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:36.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.574+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1760457786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5604755bd4a0 con 0x5604755a4480 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.575+0000 7f4da3fff640 1 -- 172.21.15.45:0/1760457786 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4db0005520 con 0x5604755a4480 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.575+0000 7f4da3fff640 1 -- 172.21.15.45:0/1760457786 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4db000f040 con 0x5604755a4480 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.575+0000 7f4dcd0c6740 10 client.15405 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.575+0000 7f4dcd0c6740 10 client.15405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.575+0000 7f4dcd0c6740 20 client.15405 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.575+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/1760457786 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5604755be8b0 0x5604755c0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.575+0000 7f4dcd0c6740 4 client.15405 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.575+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1760457786 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604755167f0 con 0x5604755be8b0 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.575+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/1760457786 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5604755be8b0 0x5604755c0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.575+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/1760457786 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5604755be8b0 0x5604755c0ca0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45ce3605b341bc4a server_cookie=331d0faea56dcd6 in_seq=0 out_seq=0 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.575+0000 7f4da3fff640 10 client.15405 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.576+0000 7f4da3fff640 1 -- 172.21.15.45:0/1760457786 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604755167f0 con 0x5604755be8b0 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.576+0000 7f4da3fff640 10 client.15405 handle_command_reply: tid=0 2024-09-15T22:16:36.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.576+0000 7f4dcd0c6740 1 client.15405 shutdown 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.576+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1760457786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a4480 msgr2=0x5604755ac0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.576+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/1760457786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a4480 0x5604755ac0d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4db0000c00 tx=0x7f4db000ed20 comp rx=0 tx=0).stop 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.576+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1760457786 shutdown_connections 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.576+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/1760457786 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5604755be8b0 0x5604755c0ca0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.576+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/1760457786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755aed40 0x5604755ac610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.576+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/1760457786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a4480 0x5604755ac0d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.576+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/1760457786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755a3b60 0x5604755abb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.576+0000 7f4da3fff640 0 client.15405 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.576+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1760457786 >> 172.21.15.45:0/1760457786 conn(0x5604755a00f0 msgr2=0x5604755a5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.577+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1760457786 shutdown_connections 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.577+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1760457786 wait complete. 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.577+0000 7f4dcd0c6740 20 client.15405 trim_cache size 0 max 16384 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.598+0000 7f4dcd0c6740 1 Processor -- start 2024-09-15T22:16:36.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.598+0000 7f4dcd0c6740 1 -- start start 2024-09-15T22:16:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.598+0000 7f4dcd0c6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a3b60 0x5604755ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.598+0000 7f4dcd0c6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a4480 0x5604755c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.598+0000 7f4dcd0c6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755aed40 0x5604755c6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.598+0000 7f4dcd0c6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc41acf40 con 0x5604755a4480 2024-09-15T22:16:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.598+0000 7f4dcd0c6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc41af7c0 con 0x5604755a3b60 2024-09-15T22:16:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.598+0000 7f4dcd0c6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc41ad5b0 con 0x5604755aed40 2024-09-15T22:16:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.598+0000 7f4dc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a4480 0x5604755c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.598+0000 7f4dc3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a4480 0x5604755c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51626/0 (socket says 172.21.15.45:51626) 2024-09-15T22:16:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.598+0000 7f4dc3fff640 1 -- 172.21.15.45:0/718266475 learned_addr learned my addr 172.21.15.45:0/718266475 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.598+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/718266475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a3b60 0x5604755ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.598+0000 7f4dc928a640 1 --2- 172.21.15.45:0/718266475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755aed40 0x5604755c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.599+0000 7f4dc8a89640 1 -- 172.21.15.45:0/718266475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755aed40 msgr2=0x5604755c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:36.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.599+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/718266475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755aed40 0x5604755c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.599+0000 7f4dc8a89640 1 -- 172.21.15.45:0/718266475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a4480 msgr2=0x5604755c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.599+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/718266475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a4480 0x5604755c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.599+0000 7f4dc8a89640 1 -- 172.21.15.45:0/718266475 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604755a4270 con 0x5604755a3b60 2024-09-15T22:16:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.599+0000 7f4dc928a640 1 --2- 172.21.15.45:0/718266475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755aed40 0x5604755c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.599+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/718266475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a3b60 0x5604755ad9f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4db80edd20 tx=0x7f4db80872f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=489271a5ea7e1d06 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.599+0000 7f4dae7fc640 1 -- 172.21.15.45:0/718266475 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8049040 con 0x5604755a3b60 2024-09-15T22:16:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.599+0000 7f4dae7fc640 1 -- 172.21.15.45:0/718266475 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4db80bc8f0 con 0x5604755a3b60 2024-09-15T22:16:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.599+0000 7f4dae7fc640 1 -- 172.21.15.45:0/718266475 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db803b460 con 0x5604755a3b60 2024-09-15T22:16:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.600+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/718266475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a3b60 msgr2=0x5604755ad9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.600+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/718266475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a3b60 0x5604755ad9f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4db80edd20 tx=0x7f4db80872f0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.600+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/718266475 shutdown_connections 2024-09-15T22:16:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.600+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/718266475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755aed40 0x5604755c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.600+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/718266475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a4480 0x5604755c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.600+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/718266475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a3b60 0x5604755ad9f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.600+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/718266475 >> 172.21.15.45:0/718266475 conn(0x5604755a00f0 msgr2=0x5604755ad2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.600+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/718266475 shutdown_connections 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.600+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/718266475 wait complete. 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.600+0000 7f4dcd0c6740 1 -- start start 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dcd0c6740 1 Processor -- start 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dcd0c6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a3b60 0x5604755b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dcd0c6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a4480 0x5604755b7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dcd0c6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755aed40 0x5604755b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dcd0c6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc41adc80 con 0x5604755a3b60 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dcd0c6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc41af0f0 con 0x5604755a4480 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dcd0c6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc41ae350 con 0x5604755aed40 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dcd0c6740 10 client.0 _ll_register_callbacks cb 0x7f4db80edbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:36.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dc8a89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a3b60 0x5604755b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dc8a89640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a3b60 0x5604755b6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51632/0 (socket says 172.21.15.45:51632) 2024-09-15T22:16:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dc8a89640 1 -- 172.21.15.45:0/1569024248 learned_addr learned my addr 172.21.15.45:0/1569024248 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dc3fff640 1 --2- 172.21.15.45:0/1569024248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a4480 0x5604755b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dc928a640 1 --2- 172.21.15.45:0/1569024248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755aed40 0x5604755b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dc8a89640 1 -- 172.21.15.45:0/1569024248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755aed40 msgr2=0x5604755b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/1569024248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755aed40 0x5604755b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dc8a89640 1 -- 172.21.15.45:0/1569024248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a4480 msgr2=0x5604755b7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/1569024248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a4480 0x5604755b7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.601+0000 7f4dc8a89640 1 -- 172.21.15.45:0/1569024248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604755b7760 con 0x5604755a3b60 2024-09-15T22:16:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.602+0000 7f4dc8a89640 1 --2- 172.21.15.45:0/1569024248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a3b60 0x5604755b6ce0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4db80c5030 tx=0x7f4db80edd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4105c702c0831784 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.602+0000 7f4da3fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.602+0000 7f4da3fff640 1 -- 172.21.15.45:0/1569024248 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db80da060 con 0x5604755a3b60 2024-09-15T22:16:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.602+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1569024248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4db80bc8f0 con 0x5604755a3b60 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.602+0000 7f4da3fff640 1 -- 172.21.15.45:0/1569024248 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f4db80b8f60 con 0x5604755a3b60 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.602+0000 7f4da3fff640 1 -- 172.21.15.45:0/1569024248 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4db8049070 con 0x5604755a3b60 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.602+0000 7f4dcd0c6740 10 client.15411 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.602+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1569024248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560475632240 con 0x5604755a3b60 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.602+0000 7f4da3fff640 1 -- 172.21.15.45:0/1569024248 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4db80bc8f0 con 0x5604755a3b60 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.602+0000 7f4da3fff640 1 -- 172.21.15.45:0/1569024248 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4db80ee000 con 0x5604755a3b60 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.602+0000 7f4dcd0c6740 10 client.15411 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.603+0000 7f4dcd0c6740 10 client.15411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.603+0000 7f4dcd0c6740 20 client.15411 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.603+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/1569024248 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5604756328b0 0x560475634cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.603+0000 7f4dcd0c6740 4 client.15411 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.603+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1569024248 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560475510d00 con 0x5604756328b0 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.603+0000 7f4dc3fff640 1 --2- 172.21.15.45:0/1569024248 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5604756328b0 0x560475634cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:36.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.603+0000 7f4dc3fff640 1 --2- 172.21.15.45:0/1569024248 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5604756328b0 0x560475634cd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b5b0dd1c06534e3 server_cookie=f379bb012be55d2b in_seq=0 out_seq=0 2024-09-15T22:16:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.603+0000 7f4da3fff640 10 client.15411 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.604+0000 7f4da3fff640 1 -- 172.21.15.45:0/1569024248 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560475510d00 con 0x5604756328b0 2024-09-15T22:16:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.604+0000 7f4da3fff640 10 client.15411 handle_command_reply: tid=0 2024-09-15T22:16:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.604+0000 7f4dcd0c6740 1 client.15411 shutdown 2024-09-15T22:16:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.604+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1569024248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a3b60 msgr2=0x5604755b6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.604+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/1569024248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a3b60 0x5604755b6ce0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4db80c5030 tx=0x7f4db80edd80 comp rx=0 tx=0).stop 2024-09-15T22:16:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.604+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1569024248 shutdown_connections 2024-09-15T22:16:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.604+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/1569024248 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5604756328b0 0x560475634cd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.605+0000 7f4da3fff640 0 client.15411 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.605+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/1569024248 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5604755aed40 0x5604755b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.605+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/1569024248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5604755a4480 0x5604755b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.605+0000 7f4dcd0c6740 1 --2- 172.21.15.45:0/1569024248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5604755a3b60 0x5604755b6ce0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.605+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1569024248 >> 172.21.15.45:0/1569024248 conn(0x5604755a00f0 msgr2=0x5604755a5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.605+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1569024248 shutdown_connections 2024-09-15T22:16:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.605+0000 7f4dcd0c6740 1 -- 172.21.15.45:0/1569024248 wait complete. 2024-09-15T22:16:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.605+0000 7f4dcd0c6740 20 client.15411 trim_cache size 0 max 16384 2024-09-15T22:16:36.689 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:16:36.689 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:16:36.689 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "80212734-e7ea-4109-81cd-cde8e1d81518", 2024-09-15T22:16:36.690 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:16:36.690 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:16:36.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.606+0000 7f4dcaced640 1 -- 172.21.15.45:0/3915843530 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4db40a34c0 msgr2=0x7f4db40a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:36.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.606+0000 7f4dcaced640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4db40a34c0 0x7f4db40a5980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00bfd0 tx=0x7f4dbc004a40 comp rx=0 tx=0).stop 2024-09-15T22:16:36.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.606+0000 7f4dcaced640 1 -- 172.21.15.45:0/3915843530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc4102d90 msgr2=0x7f4dc41985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:36.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.606+0000 7f4dcaced640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc4102d90 0x7f4dc41985f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009230 tx=0x7f4db8004270 comp rx=0 tx=0).stop 2024-09-15T22:16:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.606+0000 7f4dcaced640 1 -- 172.21.15.45:0/3915843530 shutdown_connections 2024-09-15T22:16:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.606+0000 7f4dcaced640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4db40a34c0 0x7f4db40a5980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.606+0000 7f4dcaced640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4dc4108290 0x7f4dc419cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.606+0000 7f4dcaced640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4dc4103740 0x7f4dc4198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.606+0000 7f4dcaced640 1 --2- 172.21.15.45:0/3915843530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4dc4102d90 0x7f4dc41985f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.606+0000 7f4dcaced640 1 -- 172.21.15.45:0/3915843530 >> 172.21.15.45:0/3915843530 conn(0x7f4dc40fc7d0 msgr2=0x7f4dc4106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.606+0000 7f4dcaced640 1 -- 172.21.15.45:0/3915843530 shutdown_connections 2024-09-15T22:16:36.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:36.606+0000 7f4dcaced640 1 -- 172.21.15.45:0/3915843530 wait complete. 2024-09-15T22:16:36.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:36 smithi165 ceph-mon[35551]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T22:16:36.951 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:37.393 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:37 smithi045 ceph-mon[31180]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-15T22:16:37.424 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:16:37.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:37 smithi100 ceph-mon[35319]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-15T22:16:37.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:37 smithi165 ceph-mon[35551]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 76 KiB/s wr, 44 op/s 2024-09-15T22:16:37.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.879+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1104582984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c38100e20 msgr2=0x7f7c38101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:37.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.879+0000 7f7c3f4a9640 1 --2- 172.21.15.45:0/1104582984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c38100e20 0x7f7c38101200 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009900 tx=0x7f7c3402a480 comp rx=0 tx=0).stop 2024-09-15T22:16:37.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.879+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1104582984 shutdown_connections 2024-09-15T22:16:37.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.879+0000 7f7c3f4a9640 1 --2- 172.21.15.45:0/1104582984 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c38102ef0 0x7f7c3810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:37.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.879+0000 7f7c3f4a9640 1 --2- 172.21.15.45:0/1104582984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c38102570 0x7f7c381029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:37.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.879+0000 7f7c3f4a9640 1 --2- 172.21.15.45:0/1104582984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c38100e20 0x7f7c38101200 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:37.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.879+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1104582984 >> 172.21.15.45:0/1104582984 conn(0x7f7c380fc7d0 msgr2=0x7f7c380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:37.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.879+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1104582984 shutdown_connections 2024-09-15T22:16:37.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.879+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1104582984 wait complete. 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3f4a9640 1 Processor -- start 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3f4a9640 1 -- start start 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3f4a9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c38100e20 0x7f7c38196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3f4a9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c38102570 0x7f7c38196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3f4a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c38102ef0 0x7f7c3819acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3f4a9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3810ffa0 con 0x7f7c38102ef0 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3f4a9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3810fe20 con 0x7f7c38100e20 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3f4a9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7c38110120 con 0x7f7c38102570 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3da46640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c38102ef0 0x7f7c3819acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3da46640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c38102ef0 0x7f7c3819acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51658/0 (socket says 172.21.15.45:51658) 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3da46640 1 -- 172.21.15.45:0/1633947109 learned_addr learned my addr 172.21.15.45:0/1633947109 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3d245640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c38100e20 0x7f7c38196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3ca44640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c38102570 0x7f7c38196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:37.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3da46640 1 -- 172.21.15.45:0/1633947109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c38102570 msgr2=0x7f7c38196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3da46640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c38102570 0x7f7c38196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3da46640 1 -- 172.21.15.45:0/1633947109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c38100e20 msgr2=0x7f7c38196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3da46640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c38100e20 0x7f7c38196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.880+0000 7f7c3da46640 1 -- 172.21.15.45:0/1633947109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3819b3d0 con 0x7f7c38102ef0 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.881+0000 7f7c3da46640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c38102ef0 0x7f7c3819acf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009fd0 tx=0x7f7c3000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.881+0000 7f7c2e7fc640 1 -- 172.21.15.45:0/1633947109 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30017070 con 0x7f7c38102ef0 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.881+0000 7f7c2e7fc640 1 -- 172.21.15.45:0/1633947109 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c30004020 con 0x7f7c38102ef0 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.881+0000 7f7c2e7fc640 1 -- 172.21.15.45:0/1633947109 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c300106c0 con 0x7f7c38102ef0 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.881+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1633947109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3819b6c0 con 0x7f7c38102ef0 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.881+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1633947109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c381a2fa0 con 0x7f7c38102ef0 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.882+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1633947109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c38101200 con 0x7f7c38102ef0 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.883+0000 7f7c2e7fc640 1 -- 172.21.15.45:0/1633947109 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f7c300041d0 con 0x7f7c38102ef0 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.884+0000 7f7c2e7fc640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7c240a5650 0x7f7c240a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:37.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.884+0000 7f7c3d245640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7c240a5650 0x7f7c240a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.884+0000 7f7c2e7fc640 1 -- 172.21.15.45:0/1633947109 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f7c300cfe20 con 0x7f7c38102ef0 2024-09-15T22:16:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.884+0000 7f7c3d245640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7c240a5650 0x7f7c240a7b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009230 tx=0x7f7c340058d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:37.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:37.888+0000 7f7c2e7fc640 1 -- 172.21.15.45:0/1633947109 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7c3009bcd0 con 0x7f7c38102ef0 2024-09-15T22:16:37.933 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:38.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.104+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1633947109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c381a3170 con 0x7f7c38102ef0 2024-09-15T22:16:38.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.104+0000 7f7c2e7fc640 1 -- 172.21.15.45:0/1633947109 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f7c3009ffd0 con 0x7f7c38102ef0 2024-09-15T22:16:38.106 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:38.106 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:16:38.106 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:16:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.107+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1633947109 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7c240a5650 msgr2=0x7f7c240a7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.107+0000 7f7c3f4a9640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7c240a5650 0x7f7c240a7b10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009230 tx=0x7f7c340058d0 comp rx=0 tx=0).stop 2024-09-15T22:16:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.107+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1633947109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c38102ef0 msgr2=0x7f7c3819acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.107+0000 7f7c3f4a9640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c38102ef0 0x7f7c3819acf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7c30009fd0 tx=0x7f7c3000b260 comp rx=0 tx=0).stop 2024-09-15T22:16:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.107+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1633947109 shutdown_connections 2024-09-15T22:16:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.107+0000 7f7c3f4a9640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7c240a5650 0x7f7c240a7b10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:38.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.107+0000 7f7c3f4a9640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c38102ef0 0x7f7c3819acf0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:38.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.107+0000 7f7c3f4a9640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c38102570 0x7f7c38196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:38.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.107+0000 7f7c3f4a9640 1 --2- 172.21.15.45:0/1633947109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c38100e20 0x7f7c38196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:38.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.107+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1633947109 >> 172.21.15.45:0/1633947109 conn(0x7f7c380fc7d0 msgr2=0x7f7c380fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:38.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.107+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1633947109 shutdown_connections 2024-09-15T22:16:38.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:38.107+0000 7f7c3f4a9640 1 -- 172.21.15.45:0/1633947109 wait complete. 2024-09-15T22:16:38.528 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:38 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:16:38.528 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:38 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:38.528 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:38 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:16:38.528 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:38 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:38.528 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:38 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:16:38.529 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:38 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1633947109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:38.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:38 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:16:38.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:38 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:38.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:38 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:16:38.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:38 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:38.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:38 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:16:38.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:38 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1633947109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:38 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:16:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:38 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:38 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:16:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:38 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:38 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:16:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:38 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1633947109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:38.884 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:16:39.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.072+0000 7f6be7e47640 1 -- 172.21.15.45:0/3097734819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be0102d50 msgr2=0x7f6be0103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:39.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.072+0000 7f6be7e47640 1 --2- 172.21.15.45:0/3097734819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be0102d50 0x7f6be0103130 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009900 tx=0x7f6bdc02a480 comp rx=0 tx=0).stop 2024-09-15T22:16:39.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.072+0000 7f6be7e47640 1 -- 172.21.15.45:0/3097734819 shutdown_connections 2024-09-15T22:16:39.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.072+0000 7f6be7e47640 1 --2- 172.21.15.45:0/3097734819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be010c180 0x7f6be010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.072+0000 7f6be7e47640 1 --2- 172.21.15.45:0/3097734819 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6be0103670 0x7f6be010bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.072+0000 7f6be7e47640 1 --2- 172.21.15.45:0/3097734819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be0102d50 0x7f6be0103130 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.072+0000 7f6be7e47640 1 -- 172.21.15.45:0/3097734819 >> 172.21.15.45:0/3097734819 conn(0x7f6be00fc7d0 msgr2=0x7f6be00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:39.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.072+0000 7f6be7e47640 1 -- 172.21.15.45:0/3097734819 shutdown_connections 2024-09-15T22:16:39.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.072+0000 7f6be7e47640 1 -- 172.21.15.45:0/3097734819 wait complete. 2024-09-15T22:16:39.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.073+0000 7f6be7e47640 1 Processor -- start 2024-09-15T22:16:39.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.073+0000 7f6be7e47640 1 -- start start 2024-09-15T22:16:39.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.073+0000 7f6be7e47640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6be0102d50 0x7f6be019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.073+0000 7f6be7e47640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be0103670 0x7f6be019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.073+0000 7f6be7e47640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be010c180 0x7f6be019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.073+0000 7f6be7e47640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0112100 con 0x7f6be0103670 2024-09-15T22:16:39.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.073+0000 7f6be7e47640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0111f80 con 0x7f6be010c180 2024-09-15T22:16:39.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.073+0000 7f6be7e47640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0112280 con 0x7f6be0102d50 2024-09-15T22:16:39.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.073+0000 7f6be53e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be0103670 0x7f6be019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.073+0000 7f6be53e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be0103670 0x7f6be019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51670/0 (socket says 172.21.15.45:51670) 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.073+0000 7f6be53e2640 1 -- 172.21.15.45:0/3690347516 learned_addr learned my addr 172.21.15.45:0/3690347516 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.074+0000 7f6be5be3640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6be0102d50 0x7f6be019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.074+0000 7f6be63e4640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be010c180 0x7f6be019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.074+0000 7f6be53e2640 1 -- 172.21.15.45:0/3690347516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6be0102d50 msgr2=0x7f6be019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.074+0000 7f6be53e2640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6be0102d50 0x7f6be019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.074+0000 7f6be53e2640 1 -- 172.21.15.45:0/3690347516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be010c180 msgr2=0x7f6be019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.074+0000 7f6be53e2640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be010c180 0x7f6be019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.074+0000 7f6be53e2640 1 -- 172.21.15.45:0/3690347516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be019f6a0 con 0x7f6be0103670 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.074+0000 7f6be53e2640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be0103670 0x7f6be019ac30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000c970 tx=0x7f6bd000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.074+0000 7f6bd6ffd640 1 -- 172.21.15.45:0/3690347516 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0007bb0 con 0x7f6be0103670 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.074+0000 7f6be7e47640 1 -- 172.21.15.45:0/3690347516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be019f990 con 0x7f6be0103670 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.074+0000 7f6bd6ffd640 1 -- 172.21.15.45:0/3690347516 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bd0007d50 con 0x7f6be0103670 2024-09-15T22:16:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.074+0000 7f6be7e47640 1 -- 172.21.15.45:0/3690347516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be01a7270 con 0x7f6be0103670 2024-09-15T22:16:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.074+0000 7f6bd6ffd640 1 -- 172.21.15.45:0/3690347516 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0018880 con 0x7f6be0103670 2024-09-15T22:16:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.077+0000 7f6bd6ffd640 1 -- 172.21.15.45:0/3690347516 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f6bd0018b20 con 0x7f6be0103670 2024-09-15T22:16:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.077+0000 7f6bea220740 1 Processor -- start 2024-09-15T22:16:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.078+0000 7f6bea220740 1 -- start start 2024-09-15T22:16:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.078+0000 7f6bea220740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c499324a0 0x557c49932880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.078+0000 7f6bea220740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c49932dc0 0x557c4993d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.078+0000 7f6bea220740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4993fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.078+0000 7f6bea220740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557c498982e0 con 0x557c499324a0 2024-09-15T22:16:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.078+0000 7f6bea220740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557c4983fce0 con 0x557c49932dc0 2024-09-15T22:16:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.078+0000 7f6bea220740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557c498942a0 con 0x557c4993d680 2024-09-15T22:16:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.078+0000 7f6bd6ffd640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6bcc0a34c0 0x7f6bcc0a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.078+0000 7f6be63e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c499324a0 0x557c49932880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.078+0000 7f6be63e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c499324a0 0x557c49932880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51686/0 (socket says 172.21.15.45:51686) 2024-09-15T22:16:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.078+0000 7f6be63e4640 1 -- 172.21.15.45:0/2627072028 learned_addr learned my addr 172.21.15.45:0/2627072028 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.078+0000 7f6be5be3640 1 --2- 172.21.15.45:0/2627072028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c49932dc0 0x557c4993d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.079+0000 7f6be53e2640 1 --2- 172.21.15.45:0/2627072028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4993fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.079+0000 7f6be63e4640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6bcc0a34c0 0x7f6bcc0a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.079+0000 7f6be5be3640 1 -- 172.21.15.45:0/2627072028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 msgr2=0x557c4993fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.079+0000 7f6be5be3640 1 --2- 172.21.15.45:0/2627072028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4993fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.079+0000 7f6be5be3640 1 -- 172.21.15.45:0/2627072028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c499324a0 msgr2=0x557c49932880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.079+0000 7f6be5be3640 1 --2- 172.21.15.45:0/2627072028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c499324a0 0x557c49932880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.079+0000 7f6bd6ffd640 1 -- 172.21.15.45:0/3690347516 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f6bd00d0140 con 0x7f6be0103670 2024-09-15T22:16:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.079+0000 7f6be5be3640 1 -- 172.21.15.45:0/2627072028 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c49824440 con 0x557c49932dc0 2024-09-15T22:16:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.079+0000 7f6be63e4640 1 --2- 172.21.15.45:0/2627072028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c499324a0 0x557c49932880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:39.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.079+0000 7f6be5be3640 1 --2- 172.21.15.45:0/2627072028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c49932dc0 0x557c4993d140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009230 tx=0x7f6bdc031640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f15462e3f112b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.079+0000 7f6be63e4640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6bcc0a34c0 0x7f6bcc0a5980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009fd0 tx=0x7f6bd8004a40 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.079+0000 7f6bcbfff640 1 -- 172.21.15.45:0/2627072028 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc03f070 con 0x557c49932dc0 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.079+0000 7f6bcbfff640 1 -- 172.21.15.45:0/2627072028 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bdc031a30 con 0x557c49932dc0 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.080+0000 7f6bcbfff640 1 -- 172.21.15.45:0/2627072028 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc035070 con 0x557c49932dc0 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.080+0000 7f6bea220740 1 -- 172.21.15.45:0/2627072028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c49932dc0 msgr2=0x557c4993d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.080+0000 7f6bea220740 1 --2- 172.21.15.45:0/2627072028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c49932dc0 0x557c4993d140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009230 tx=0x7f6bdc031640 comp rx=0 tx=0).stop 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.080+0000 7f6bea220740 1 -- 172.21.15.45:0/2627072028 shutdown_connections 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.080+0000 7f6bea220740 1 --2- 172.21.15.45:0/2627072028 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4993fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.080+0000 7f6bea220740 1 --2- 172.21.15.45:0/2627072028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c49932dc0 0x557c4993d140 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.080+0000 7f6bea220740 1 --2- 172.21.15.45:0/2627072028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c499324a0 0x557c49932880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.080+0000 7f6bea220740 1 -- 172.21.15.45:0/2627072028 >> 172.21.15.45:0/2627072028 conn(0x557c4992ea30 msgr2=0x557c4992ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.080+0000 7f6bea220740 1 -- 172.21.15.45:0/2627072028 shutdown_connections 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.080+0000 7f6bea220740 1 -- 172.21.15.45:0/2627072028 wait complete. 2024-09-15T22:16:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.081+0000 7f6bea220740 1 -- start start 2024-09-15T22:16:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.081+0000 7f6bea220740 1 Processor -- start 2024-09-15T22:16:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.081+0000 7f6bea220740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c499324a0 0x557c4993cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.081+0000 7f6bea220740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c49932dc0 0x557c4993a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.081+0000 7f6bea220740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4993a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.081+0000 7f6bea220740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557c49940250 con 0x557c49932dc0 2024-09-15T22:16:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.081+0000 7f6be53e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c49932dc0 0x557c4993a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.081+0000 7f6be5be3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c499324a0 0x557c4993cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6be5be3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c499324a0 0x557c4993cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:58210/0 (socket says 172.21.15.45:58210) 2024-09-15T22:16:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6be5be3640 1 -- 172.21.15.45:0/3367307716 learned_addr learned my addr 172.21.15.45:0/3367307716 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6be53e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c49932dc0 0x557c4993a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51700/0 (socket says 172.21.15.45:51700) 2024-09-15T22:16:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6bea220740 1 -- 172.21.15.45:0/3367307716 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557c49853050 con 0x557c499324a0 2024-09-15T22:16:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6be63e4640 1 --2- 172.21.15.45:0/3367307716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4993a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6bea220740 1 -- 172.21.15.45:0/3367307716 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557c499403d0 con 0x557c4993d680 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6bea220740 10 client.0 _ll_register_callbacks cb 0x557c49893160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6be63e4640 1 -- 172.21.15.45:0/3367307716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c499324a0 msgr2=0x557c4993cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6be63e4640 1 --2- 172.21.15.45:0/3367307716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c499324a0 0x557c4993cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6be63e4640 1 -- 172.21.15.45:0/3367307716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c49932dc0 msgr2=0x557c4993a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6be63e4640 1 --2- 172.21.15.45:0/3367307716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c49932dc0 0x557c4993a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6be63e4640 1 -- 172.21.15.45:0/3367307716 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c496093c0 con 0x557c4993d680 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6be53e2640 1 --2- 172.21.15.45:0/3367307716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c49932dc0 0x557c4993a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6be63e4640 1 --2- 172.21.15.45:0/3367307716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4993a690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8007b10 tx=0x7f6bd8004b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=189e42c399e9b1ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6bc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6bc97fa640 1 -- 172.21.15.45:0/3367307716 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8015070 con 0x557c4993d680 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6bea220740 1 -- 172.21.15.45:0/3367307716 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bdc031a30 con 0x557c4993d680 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.082+0000 7f6bc97fa640 1 -- 172.21.15.45:0/3367307716 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f6bd800ad50 con 0x557c4993d680 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.083+0000 7f6bc97fa640 1 -- 172.21.15.45:0/3367307716 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6bd8030050 con 0x557c4993d680 2024-09-15T22:16:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.083+0000 7f6bea220740 10 client.25045 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.083+0000 7f6bea220740 1 -- 172.21.15.45:0/3367307716 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557c499543d0 con 0x557c4993d680 2024-09-15T22:16:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.083+0000 7f6bc97fa640 1 -- 172.21.15.45:0/3367307716 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bdc031a30 con 0x557c4993d680 2024-09-15T22:16:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.083+0000 7f6bc97fa640 1 -- 172.21.15.45:0/3367307716 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6bd8027410 con 0x557c4993d680 2024-09-15T22:16:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.083+0000 7f6bea220740 10 client.25045 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.083+0000 7f6bea220740 10 client.25045 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.083+0000 7f6bea220740 20 client.25045 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.083+0000 7f6bea220740 1 --2- 172.21.15.45:0/3367307716 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557c49955830 0x557c49957cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.083+0000 7f6bea220740 4 client.25045 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.083+0000 7f6bea220740 1 -- 172.21.15.45:0/3367307716 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c498a5850 con 0x557c49955830 2024-09-15T22:16:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.083+0000 7f6be5be3640 1 --2- 172.21.15.45:0/3367307716 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557c49955830 0x557c49957cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.084+0000 7f6be5be3640 1 --2- 172.21.15.45:0/3367307716 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557c49955830 0x557c49957cd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15332103caacee8e server_cookie=c57613940029bfd1 in_seq=0 out_seq=0 2024-09-15T22:16:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.084+0000 7f6bc97fa640 10 client.25045 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.084+0000 7f6bc97fa640 1 -- 172.21.15.45:0/3367307716 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c498a5850 con 0x557c49955830 2024-09-15T22:16:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.084+0000 7f6bc97fa640 10 client.25045 handle_command_reply: tid=0 2024-09-15T22:16:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.084+0000 7f6bea220740 1 client.25045 shutdown 2024-09-15T22:16:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.085+0000 7f6bea220740 1 -- 172.21.15.45:0/3367307716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 msgr2=0x557c4993a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.085+0000 7f6bea220740 1 --2- 172.21.15.45:0/3367307716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4993a690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8007b10 tx=0x7f6bd8004b50 comp rx=0 tx=0).stop 2024-09-15T22:16:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.085+0000 7f6bea220740 1 -- 172.21.15.45:0/3367307716 shutdown_connections 2024-09-15T22:16:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.085+0000 7f6bea220740 1 --2- 172.21.15.45:0/3367307716 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557c49955830 0x557c49957cd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.085+0000 7f6bea220740 1 --2- 172.21.15.45:0/3367307716 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4993a690 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.085+0000 7f6bea220740 1 --2- 172.21.15.45:0/3367307716 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c49932dc0 0x557c4993a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.085+0000 7f6bc97fa640 0 client.25045 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.085+0000 7f6bea220740 1 --2- 172.21.15.45:0/3367307716 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c499324a0 0x557c4993cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.085+0000 7f6bea220740 1 -- 172.21.15.45:0/3367307716 >> 172.21.15.45:0/3367307716 conn(0x557c4992ea30 msgr2=0x557c49934760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.085+0000 7f6bea220740 1 -- 172.21.15.45:0/3367307716 shutdown_connections 2024-09-15T22:16:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.085+0000 7f6bea220740 1 -- 172.21.15.45:0/3367307716 wait complete. 2024-09-15T22:16:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.085+0000 7f6bea220740 20 client.25045 trim_cache size 0 max 16384 2024-09-15T22:16:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.103+0000 7f6bea220740 1 Processor -- start 2024-09-15T22:16:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.103+0000 7f6bea220740 1 -- start start 2024-09-15T22:16:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.103+0000 7f6bea220740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c499324a0 0x557c4995d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.103+0000 7f6bea220740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c49932dc0 0x557c4995dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.103+0000 7f6bea220740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c4993d680 0x557c4994ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.103+0000 7f6bea220740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc400dd50 con 0x557c4993d680 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.103+0000 7f6bea220740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc40105d0 con 0x557c49932dc0 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.103+0000 7f6bea220740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc400e3c0 con 0x557c499324a0 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.103+0000 7f6be63e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c4993d680 0x557c4994ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.103+0000 7f6be63e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c4993d680 0x557c4994ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51706/0 (socket says 172.21.15.45:51706) 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.103+0000 7f6be63e4640 1 -- 172.21.15.45:0/3459032611 learned_addr learned my addr 172.21.15.45:0/3459032611 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.103+0000 7f6be53e2640 1 --2- 172.21.15.45:0/3459032611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c49932dc0 0x557c4995dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.103+0000 7f6be5be3640 1 --2- 172.21.15.45:0/3459032611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c499324a0 0x557c4995d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.104+0000 7f6be63e4640 1 -- 172.21.15.45:0/3459032611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c499324a0 msgr2=0x557c4995d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.104+0000 7f6be63e4640 1 --2- 172.21.15.45:0/3459032611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c499324a0 0x557c4995d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.104+0000 7f6be63e4640 1 -- 172.21.15.45:0/3459032611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c49932dc0 msgr2=0x557c4995dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.104+0000 7f6be63e4640 1 --2- 172.21.15.45:0/3459032611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c49932dc0 0x557c4995dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.104+0000 7f6be63e4640 1 -- 172.21.15.45:0/3459032611 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c4992e860 con 0x557c4993d680 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.104+0000 7f6be53e2640 1 --2- 172.21.15.45:0/3459032611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c49932dc0 0x557c4995dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.104+0000 7f6be63e4640 1 --2- 172.21.15.45:0/3459032611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c4993d680 0x557c4994ded0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80277e0 tx=0x7f6bd800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b0139d12f0f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.104+0000 7f6bcb7fe640 1 -- 172.21.15.45:0/3459032611 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8015040 con 0x557c4993d680 2024-09-15T22:16:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.104+0000 7f6bcb7fe640 1 -- 172.21.15.45:0/3459032611 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bd8039070 con 0x557c4993d680 2024-09-15T22:16:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.104+0000 7f6bcb7fe640 1 -- 172.21.15.45:0/3459032611 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd801d440 con 0x557c4993d680 2024-09-15T22:16:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.105+0000 7f6bea220740 1 -- 172.21.15.45:0/3459032611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c4993d680 msgr2=0x557c4994ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.105+0000 7f6bea220740 1 --2- 172.21.15.45:0/3459032611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c4993d680 0x557c4994ded0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80277e0 tx=0x7f6bd800cf00 comp rx=0 tx=0).stop 2024-09-15T22:16:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.105+0000 7f6bea220740 1 -- 172.21.15.45:0/3459032611 shutdown_connections 2024-09-15T22:16:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.105+0000 7f6bea220740 1 --2- 172.21.15.45:0/3459032611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c4993d680 0x557c4994ded0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.105+0000 7f6bea220740 1 --2- 172.21.15.45:0/3459032611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c49932dc0 0x557c4995dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.105+0000 7f6bea220740 1 --2- 172.21.15.45:0/3459032611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c499324a0 0x557c4995d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.105+0000 7f6bea220740 1 -- 172.21.15.45:0/3459032611 >> 172.21.15.45:0/3459032611 conn(0x557c4992ea30 msgr2=0x557c49938a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.106+0000 7f6bea220740 1 -- 172.21.15.45:0/3459032611 shutdown_connections 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.106+0000 7f6bea220740 1 -- 172.21.15.45:0/3459032611 wait complete. 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.106+0000 7f6bea220740 1 -- start start 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.106+0000 7f6bea220740 1 Processor -- start 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.107+0000 7f6bea220740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c499324a0 0x557c49949db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.107+0000 7f6bea220740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c49932dc0 0x557c4994a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.107+0000 7f6be53e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c49932dc0 0x557c4994a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.107+0000 7f6be53e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c49932dc0 0x557c4994a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51708/0 (socket says 172.21.15.45:51708) 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.107+0000 7f6be53e2640 1 -- 172.21.15.45:0/2113446257 learned_addr learned my addr 172.21.15.45:0/2113446257 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.107+0000 7f6bea220740 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4994a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.107+0000 7f6be5be3640 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c499324a0 0x557c49949db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.107+0000 7f6bea220740 1 -- 172.21.15.45:0/2113446257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc400ea90 con 0x557c49932dc0 2024-09-15T22:16:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.107+0000 7f6bea220740 1 -- 172.21.15.45:0/2113446257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc400ff00 con 0x557c499324a0 2024-09-15T22:16:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.107+0000 7f6bea220740 1 -- 172.21.15.45:0/2113446257 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc400f160 con 0x557c4993d680 2024-09-15T22:16:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.107+0000 7f6bea220740 10 client.0 _ll_register_callbacks cb 0x7f6bd8009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:39.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.108+0000 7f6be63e4640 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4994a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.108+0000 7f6be5be3640 1 -- 172.21.15.45:0/2113446257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 msgr2=0x557c4994a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.108+0000 7f6be5be3640 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4994a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.108+0000 7f6be5be3640 1 -- 172.21.15.45:0/2113446257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c49932dc0 msgr2=0x557c4994a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.108+0000 7f6be5be3640 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c49932dc0 0x557c4994a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.108+0000 7f6be5be3640 1 -- 172.21.15.45:0/2113446257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c499bf710 con 0x557c499324a0 2024-09-15T22:16:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.108+0000 7f6be63e4640 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4994a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.108+0000 7f6be5be3640 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c499324a0 0x557c49949db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc02a9a0 tx=0x7f6bdc005680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2cef25975d88e90 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.108+0000 7f6bc97fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-15T22:16:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.108+0000 7f6bc97fa640 1 -- 172.21.15.45:0/2113446257 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc035040 con 0x557c499324a0 2024-09-15T22:16:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.109+0000 7f6bc97fa640 1 -- 172.21.15.45:0/2113446257 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f6bdc0319c0 con 0x557c499324a0 2024-09-15T22:16:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.109+0000 7f6bea220740 1 -- 172.21.15.45:0/2113446257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd8039070 con 0x557c499324a0 2024-09-15T22:16:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.109+0000 7f6bc97fa640 1 -- 172.21.15.45:0/2113446257 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6bdc060050 con 0x557c499324a0 2024-09-15T22:16:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.109+0000 7f6bea220740 10 client.25139 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.109+0000 7f6bea220740 1 -- 172.21.15.45:0/2113446257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557c499c09c0 con 0x557c499324a0 2024-09-15T22:16:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.109+0000 7f6bc97fa640 1 -- 172.21.15.45:0/2113446257 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bdc0044a0 con 0x557c499324a0 2024-09-15T22:16:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.110+0000 7f6bc97fa640 1 -- 172.21.15.45:0/2113446257 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6bdc04c040 con 0x557c499324a0 2024-09-15T22:16:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.110+0000 7f6bea220740 10 client.25139 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.110+0000 7f6bea220740 10 client.25139 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.110+0000 7f6bea220740 20 client.25139 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.110+0000 7f6bea220740 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557c49955830 0x557c499c2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.110+0000 7f6bea220740 4 client.25139 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:16:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.110+0000 7f6bea220740 1 -- 172.21.15.45:0/2113446257 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f6bd8039070 con 0x557c49955830 2024-09-15T22:16:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.110+0000 7f6be53e2640 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557c49955830 0x557c499c2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6bc97fa640 10 client.25139 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6be53e2640 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557c49955830 0x557c499c2d10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c462a4753eb904b server_cookie=edd450d2e4bf1c15 in_seq=0 out_seq=0 2024-09-15T22:16:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6bc97fa640 1 -- 172.21.15.45:0/2113446257 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f6bd8039070 con 0x557c49955830 2024-09-15T22:16:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6bc97fa640 10 client.25139 handle_command_reply: tid=0 2024-09-15T22:16:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6bea220740 1 client.25139 shutdown 2024-09-15T22:16:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6bea220740 1 -- 172.21.15.45:0/2113446257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c499324a0 msgr2=0x557c49949db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6bea220740 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c499324a0 0x557c49949db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc02a9a0 tx=0x7f6bdc005680 comp rx=0 tx=0).stop 2024-09-15T22:16:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6bea220740 1 -- 172.21.15.45:0/2113446257 shutdown_connections 2024-09-15T22:16:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6bea220740 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557c49955830 0x557c499c2d10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6bea220740 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557c4993d680 0x557c4994a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6bea220740 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557c49932dc0 0x557c4994a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6bea220740 1 --2- 172.21.15.45:0/2113446257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557c499324a0 0x557c49949db0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6bea220740 1 -- 172.21.15.45:0/2113446257 >> 172.21.15.45:0/2113446257 conn(0x557c4992ea30 msgr2=0x557c4993b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.111+0000 7f6bc97fa640 0 client.25139 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.112+0000 7f6bea220740 1 -- 172.21.15.45:0/2113446257 shutdown_connections 2024-09-15T22:16:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.112+0000 7f6bea220740 1 -- 172.21.15.45:0/2113446257 wait complete. 2024-09-15T22:16:39.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.112+0000 7f6bea220740 20 client.25139 trim_cache size 0 max 16384 2024-09-15T22:16:39.117 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:16:39.117 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:16:39.117 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:16:39.118 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:16:39.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.113+0000 7f6be7e47640 1 -- 172.21.15.45:0/3690347516 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6bcc0a34c0 msgr2=0x7f6bcc0a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:39.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.113+0000 7f6be7e47640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6bcc0a34c0 0x7f6bcc0a5980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009fd0 tx=0x7f6bd8004a40 comp rx=0 tx=0).stop 2024-09-15T22:16:39.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.113+0000 7f6be7e47640 1 -- 172.21.15.45:0/3690347516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be0103670 msgr2=0x7f6be019ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.113+0000 7f6be7e47640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be0103670 0x7f6be019ac30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6bd000c970 tx=0x7f6bd000ce30 comp rx=0 tx=0).stop 2024-09-15T22:16:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.113+0000 7f6be7e47640 1 -- 172.21.15.45:0/3690347516 shutdown_connections 2024-09-15T22:16:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.113+0000 7f6be7e47640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6bcc0a34c0 0x7f6bcc0a5980 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.113+0000 7f6be7e47640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6be010c180 0x7f6be019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.113+0000 7f6be7e47640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6be0103670 0x7f6be019ac30 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.113+0000 7f6be7e47640 1 --2- 172.21.15.45:0/3690347516 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6be0102d50 0x7f6be019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.113+0000 7f6be7e47640 1 -- 172.21.15.45:0/3690347516 >> 172.21.15.45:0/3690347516 conn(0x7f6be00fc7d0 msgr2=0x7f6be00fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.113+0000 7f6be7e47640 1 -- 172.21.15.45:0/3690347516 shutdown_connections 2024-09-15T22:16:39.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:39.113+0000 7f6be7e47640 1 -- 172.21.15.45:0/3690347516 wait complete. 2024-09-15T22:16:39.487 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:39 smithi045 ceph-mon[31180]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-15T22:16:39.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:39 smithi165 ceph-mon[35551]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-15T22:16:39.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:39 smithi100 ceph-mon[35319]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 76 KiB/s wr, 33 op/s 2024-09-15T22:16:39.796 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:39.826 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:16:39.826 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:16:40.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.305+0000 7f98f528c640 1 -- 172.21.15.45:0/679104450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98f0102ef0 msgr2=0x7f98f010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:40.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.305+0000 7f98f528c640 1 --2- 172.21.15.45:0/679104450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98f0102ef0 0x7f98f010da40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009ca0 tx=0x7f98e802a950 comp rx=0 tx=0).stop 2024-09-15T22:16:40.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.305+0000 7f98f528c640 1 -- 172.21.15.45:0/679104450 shutdown_connections 2024-09-15T22:16:40.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.305+0000 7f98f528c640 1 --2- 172.21.15.45:0/679104450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98f0102ef0 0x7f98f010da40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.305+0000 7f98f528c640 1 --2- 172.21.15.45:0/679104450 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98f0102570 0x7f98f01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.305+0000 7f98f528c640 1 --2- 172.21.15.45:0/679104450 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98f0100e20 0x7f98f0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.305+0000 7f98f528c640 1 -- 172.21.15.45:0/679104450 >> 172.21.15.45:0/679104450 conn(0x7f98f00fc7d0 msgr2=0x7f98f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.305+0000 7f98f528c640 1 -- 172.21.15.45:0/679104450 shutdown_connections 2024-09-15T22:16:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.305+0000 7f98f528c640 1 -- 172.21.15.45:0/679104450 wait complete. 2024-09-15T22:16:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.305+0000 7f98f528c640 1 Processor -- start 2024-09-15T22:16:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98f528c640 1 -- start start 2024-09-15T22:16:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98f528c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98f0100e20 0x7f98f0199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98f528c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98f0102570 0x7f98f01999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98f528c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98f0102ef0 0x7f98f01a44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98f528c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f98f01110a0 con 0x7f98f0102570 2024-09-15T22:16:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98f528c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f98f0110f20 con 0x7f98f0100e20 2024-09-15T22:16:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98f528c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f98f0111220 con 0x7f98f0102ef0 2024-09-15T22:16:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98e67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98f0102570 0x7f98f01999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98e67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98f0102570 0x7f98f01999b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51728/0 (socket says 172.21.15.45:51728) 2024-09-15T22:16:40.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98e67fc640 1 -- 172.21.15.45:0/165301311 learned_addr learned my addr 172.21.15.45:0/165301311 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:40.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98eeffd640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98f0100e20 0x7f98f0199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:40.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98ef7fe640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98f0102ef0 0x7f98f01a44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:40.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98e67fc640 1 -- 172.21.15.45:0/165301311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98f0102ef0 msgr2=0x7f98f01a44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:40.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98e67fc640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98f0102ef0 0x7f98f01a44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98e67fc640 1 -- 172.21.15.45:0/165301311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98f0100e20 msgr2=0x7f98f0199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:40.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98e67fc640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98f0100e20 0x7f98f0199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.306+0000 7f98e67fc640 1 -- 172.21.15.45:0/165301311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f01a4a30 con 0x7f98f0102570 2024-09-15T22:16:40.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.307+0000 7f98e67fc640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98f0102570 0x7f98f01999b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f98d800c890 tx=0x7f98d800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:40.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.307+0000 7f98ecff9640 1 -- 172.21.15.45:0/165301311 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d8004220 con 0x7f98f0102570 2024-09-15T22:16:40.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.307+0000 7f98ecff9640 1 -- 172.21.15.45:0/165301311 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f98d80043c0 con 0x7f98f0102570 2024-09-15T22:16:40.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.307+0000 7f98f528c640 1 -- 172.21.15.45:0/165301311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f01a4c00 con 0x7f98f0102570 2024-09-15T22:16:40.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.307+0000 7f98ecff9640 1 -- 172.21.15.45:0/165301311 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d8004b10 con 0x7f98f0102570 2024-09-15T22:16:40.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.307+0000 7f98f528c640 1 -- 172.21.15.45:0/165301311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f01a5110 con 0x7f98f0102570 2024-09-15T22:16:40.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.308+0000 7f98f528c640 1 -- 172.21.15.45:0/165301311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f0101200 con 0x7f98f0102570 2024-09-15T22:16:40.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.310+0000 7f98ecff9640 1 -- 172.21.15.45:0/165301311 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f98d80051b0 con 0x7f98f0102570 2024-09-15T22:16:40.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.311+0000 7f98ecff9640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f98dc0a3440 0x7f98dc0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:40.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.311+0000 7f98eeffd640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f98dc0a3440 0x7f98dc0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:40.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.311+0000 7f98ecff9640 1 -- 172.21.15.45:0/165301311 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f98d80d02e0 con 0x7f98f0102570 2024-09-15T22:16:40.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.311+0000 7f98eeffd640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f98dc0a3440 0x7f98dc0a5900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f98e0005fd0 tx=0x7f98e000b590 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:40.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.314+0000 7f98ecff9640 1 -- 172.21.15.45:0/165301311 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98d8014030 con 0x7f98f0102570 2024-09-15T22:16:40.371 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.530+0000 7f98f528c640 1 -- 172.21.15.45:0/165301311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98f006a560 con 0x7f98f0102570 2024-09-15T22:16:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.531+0000 7f98ecff9640 1 -- 172.21.15.45:0/165301311 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f98f006a560 con 0x7f98f0102570 2024-09-15T22:16:40.533 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:40.533 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:16:40.533 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:16:40.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.533+0000 7f98f528c640 1 -- 172.21.15.45:0/165301311 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f98dc0a3440 msgr2=0x7f98dc0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:40.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.533+0000 7f98f528c640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f98dc0a3440 0x7f98dc0a5900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f98e0005fd0 tx=0x7f98e000b590 comp rx=0 tx=0).stop 2024-09-15T22:16:40.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.533+0000 7f98f528c640 1 -- 172.21.15.45:0/165301311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98f0102570 msgr2=0x7f98f01999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.533+0000 7f98f528c640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98f0102570 0x7f98f01999b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f98d800c890 tx=0x7f98d800cd50 comp rx=0 tx=0).stop 2024-09-15T22:16:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.533+0000 7f98f528c640 1 -- 172.21.15.45:0/165301311 shutdown_connections 2024-09-15T22:16:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.533+0000 7f98f528c640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f98dc0a3440 0x7f98dc0a5900 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.533+0000 7f98f528c640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f98f0102ef0 0x7f98f01a44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.533+0000 7f98f528c640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98f0102570 0x7f98f01999b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.533+0000 7f98f528c640 1 --2- 172.21.15.45:0/165301311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98f0100e20 0x7f98f0199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.533+0000 7f98f528c640 1 -- 172.21.15.45:0/165301311 >> 172.21.15.45:0/165301311 conn(0x7f98f00fc7d0 msgr2=0x7f98f0106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.533+0000 7f98f528c640 1 -- 172.21.15.45:0/165301311 shutdown_connections 2024-09-15T22:16:40.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:40.533+0000 7f98f528c640 1 -- 172.21.15.45:0/165301311 wait complete. 2024-09-15T22:16:41.239 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:16:41.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:41 smithi045 ceph-mon[31180]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 76 KiB/s wr, 34 op/s 2024-09-15T22:16:41.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:41 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/165301311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:41.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.639+0000 7fe65fe8f640 1 -- 172.21.15.45:0/275904234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658102ef0 msgr2=0x7fe65810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:41.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.639+0000 7fe65fe8f640 1 --2- 172.21.15.45:0/275904234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658102ef0 0x7fe65810da40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe650009900 tx=0x7fe65002a480 comp rx=0 tx=0).stop 2024-09-15T22:16:41.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.640+0000 7fe65fe8f640 1 -- 172.21.15.45:0/275904234 shutdown_connections 2024-09-15T22:16:41.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.640+0000 7fe65fe8f640 1 --2- 172.21.15.45:0/275904234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658102ef0 0x7fe65810da40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:41.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.640+0000 7fe65fe8f640 1 --2- 172.21.15.45:0/275904234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe658102570 0x7fe6581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:41.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.640+0000 7fe65fe8f640 1 --2- 172.21.15.45:0/275904234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe658100e20 0x7fe658101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:41.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.640+0000 7fe65fe8f640 1 -- 172.21.15.45:0/275904234 >> 172.21.15.45:0/275904234 conn(0x7fe6580fc7d0 msgr2=0x7fe6580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:41.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.640+0000 7fe65fe8f640 1 -- 172.21.15.45:0/275904234 shutdown_connections 2024-09-15T22:16:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.640+0000 7fe65fe8f640 1 -- 172.21.15.45:0/275904234 wait complete. 2024-09-15T22:16:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.640+0000 7fe65fe8f640 1 Processor -- start 2024-09-15T22:16:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.640+0000 7fe65fe8f640 1 -- start start 2024-09-15T22:16:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.640+0000 7fe65fe8f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe658100e20 0x7fe658198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.640+0000 7fe65fe8f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe658102570 0x7fe658198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65fe8f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658102ef0 0x7fe65819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65fe8f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe6581121c0 con 0x7fe658102ef0 2024-09-15T22:16:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65fe8f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe658112040 con 0x7fe658100e20 2024-09-15T22:16:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65fe8f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe658112340 con 0x7fe658102570 2024-09-15T22:16:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65e42c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658102ef0 0x7fe65819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65e42c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658102ef0 0x7fe65819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51740/0 (socket says 172.21.15.45:51740) 2024-09-15T22:16:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65e42c640 1 -- 172.21.15.45:0/1596859307 learned_addr learned my addr 172.21.15.45:0/1596859307 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65d42a640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe658102570 0x7fe658198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65dc2b640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe658100e20 0x7fe658198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65e42c640 1 -- 172.21.15.45:0/1596859307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe658102570 msgr2=0x7fe658198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65e42c640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe658102570 0x7fe658198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65e42c640 1 -- 172.21.15.45:0/1596859307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe658100e20 msgr2=0x7fe658198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65e42c640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe658100e20 0x7fe658198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65e42c640 1 -- 172.21.15.45:0/1596859307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65819d3f0 con 0x7fe658102ef0 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65e42c640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658102ef0 0x7fe65819cd10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe650032fd0 tx=0x7fe650004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe656ffd640 1 -- 172.21.15.45:0/1596859307 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65003f030 con 0x7fe658102ef0 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe656ffd640 1 -- 172.21.15.45:0/1596859307 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe650005000 con 0x7fe658102ef0 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe65fe8f640 1 -- 172.21.15.45:0/1596859307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65819d680 con 0x7fe658102ef0 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.641+0000 7fe656ffd640 1 -- 172.21.15.45:0/1596859307 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe650035070 con 0x7fe658102ef0 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.642+0000 7fe65fe8f640 1 -- 172.21.15.45:0/1596859307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6581a4fc0 con 0x7fe658102ef0 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.643+0000 7fe65fe8f640 1 -- 172.21.15.45:0/1596859307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe658101200 con 0x7fe658102ef0 2024-09-15T22:16:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.644+0000 7fe656ffd640 1 -- 172.21.15.45:0/1596859307 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fe650042030 con 0x7fe658102ef0 2024-09-15T22:16:41.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.644+0000 7fe656ffd640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe6400a34c0 0x7fe6400a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:41.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.645+0000 7fe65dc2b640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe6400a34c0 0x7fe6400a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:41.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.645+0000 7fe656ffd640 1 -- 172.21.15.45:0/1596859307 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fe6500f09f0 con 0x7fe658102ef0 2024-09-15T22:16:41.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.645+0000 7fe65dc2b640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe6400a34c0 0x7fe6400a5980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe648007ec0 tx=0x7fe6480075b0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:41.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.648+0000 7fe656ffd640 1 -- 172.21.15.45:0/1596859307 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe6500bcef0 con 0x7fe658102ef0 2024-09-15T22:16:41.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:41 smithi165 ceph-mon[35551]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 76 KiB/s wr, 34 op/s 2024-09-15T22:16:41.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:41 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/165301311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:41.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:41 smithi100 ceph-mon[35319]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 76 KiB/s wr, 34 op/s 2024-09-15T22:16:41.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:41 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/165301311' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:41.745 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.873+0000 7fe65fe8f640 1 -- 172.21.15.45:0/1596859307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6581a5190 con 0x7fe658102ef0 2024-09-15T22:16:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.873+0000 7fe656ffd640 1 -- 172.21.15.45:0/1596859307 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fe6500bc7f0 con 0x7fe658102ef0 2024-09-15T22:16:41.876 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:41.876 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:16:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:16:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.875+0000 7fe65fe8f640 1 -- 172.21.15.45:0/1596859307 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe6400a34c0 msgr2=0x7fe6400a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.875+0000 7fe65fe8f640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe6400a34c0 0x7fe6400a5980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe648007ec0 tx=0x7fe6480075b0 comp rx=0 tx=0).stop 2024-09-15T22:16:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.875+0000 7fe65fe8f640 1 -- 172.21.15.45:0/1596859307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658102ef0 msgr2=0x7fe65819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.875+0000 7fe65fe8f640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658102ef0 0x7fe65819cd10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe650032fd0 tx=0x7fe650004b80 comp rx=0 tx=0).stop 2024-09-15T22:16:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.876+0000 7fe65fe8f640 1 -- 172.21.15.45:0/1596859307 shutdown_connections 2024-09-15T22:16:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.876+0000 7fe65fe8f640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe6400a34c0 0x7fe6400a5980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.876+0000 7fe65fe8f640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe658102ef0 0x7fe65819cd10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.876+0000 7fe65fe8f640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe658102570 0x7fe658198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:41.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.876+0000 7fe65fe8f640 1 --2- 172.21.15.45:0/1596859307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe658100e20 0x7fe658198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.876+0000 7fe65fe8f640 1 -- 172.21.15.45:0/1596859307 >> 172.21.15.45:0/1596859307 conn(0x7fe6580fc7d0 msgr2=0x7fe6581056c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.876+0000 7fe65fe8f640 1 -- 172.21.15.45:0/1596859307 shutdown_connections 2024-09-15T22:16:41.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:41.876+0000 7fe65fe8f640 1 -- 172.21.15.45:0/1596859307 wait complete. 2024-09-15T22:16:42.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:42 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1596859307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:42.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:42 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1596859307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:42.730 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:16:42.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:42 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1596859307' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:42.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.910+0000 7f74bc263640 1 -- 172.21.15.45:0/3684593770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74b4103740 msgr2=0x7f74b4107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:42.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.910+0000 7f74bc263640 1 --2- 172.21.15.45:0/3684593770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74b4103740 0x7f74b4107b80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009930 tx=0x7f74a402a420 comp rx=0 tx=0).stop 2024-09-15T22:16:42.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.910+0000 7f74bc263640 1 -- 172.21.15.45:0/3684593770 shutdown_connections 2024-09-15T22:16:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.910+0000 7f74bc263640 1 --2- 172.21.15.45:0/3684593770 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b4108290 0x7f74b410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.910+0000 7f74bc263640 1 --2- 172.21.15.45:0/3684593770 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74b4103740 0x7f74b4107b80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.910+0000 7f74bc263640 1 --2- 172.21.15.45:0/3684593770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b4102d90 0x7f74b4103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.910+0000 7f74bc263640 1 -- 172.21.15.45:0/3684593770 >> 172.21.15.45:0/3684593770 conn(0x7f74b40fc7d0 msgr2=0x7f74b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.910+0000 7f74bc263640 1 -- 172.21.15.45:0/3684593770 shutdown_connections 2024-09-15T22:16:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.910+0000 7f74bc263640 1 -- 172.21.15.45:0/3684593770 wait complete. 2024-09-15T22:16:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.911+0000 7f74bc263640 1 Processor -- start 2024-09-15T22:16:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.911+0000 7f74bc263640 1 -- start start 2024-09-15T22:16:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.911+0000 7f74bc263640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b4102d90 0x7f74b41009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.911+0000 7f74bc263640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b4103740 0x7f74b4100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.911+0000 7f74bc263640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74b4108290 0x7f74b4101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.911+0000 7f74bc263640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41121b0 con 0x7f74b4108290 2024-09-15T22:16:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.911+0000 7f74bc263640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4112030 con 0x7f74b4103740 2024-09-15T22:16:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.911+0000 7f74bc263640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4112330 con 0x7f74b4102d90 2024-09-15T22:16:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.911+0000 7f74ba800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74b4108290 0x7f74b4101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.911+0000 7f74ba800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74b4108290 0x7f74b4101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51758/0 (socket says 172.21.15.45:51758) 2024-09-15T22:16:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.911+0000 7f74ba800640 1 -- 172.21.15.45:0/965132631 learned_addr learned my addr 172.21.15.45:0/965132631 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.912+0000 7f74b97fe640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b4103740 0x7f74b4100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.912+0000 7f74b9fff640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b4102d90 0x7f74b41009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.912+0000 7f74ba800640 1 -- 172.21.15.45:0/965132631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b4102d90 msgr2=0x7f74b41009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.912+0000 7f74ba800640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b4102d90 0x7f74b41009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.912+0000 7f74ba800640 1 -- 172.21.15.45:0/965132631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b4103740 msgr2=0x7f74b4100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.912+0000 7f74ba800640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b4103740 0x7f74b4100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.912+0000 7f74ba800640 1 -- 172.21.15.45:0/965132631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b41a6b60 con 0x7f74b4108290 2024-09-15T22:16:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.912+0000 7f74ba800640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74b4108290 0x7f74b4101470 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00eb10 tx=0x7f74ac00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.912+0000 7f74aaffd640 1 -- 172.21.15.45:0/965132631 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac004b20 con 0x7f74b4108290 2024-09-15T22:16:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.912+0000 7f74aaffd640 1 -- 172.21.15.45:0/965132631 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74ac004cc0 con 0x7f74b4108290 2024-09-15T22:16:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.912+0000 7f74bc263640 1 -- 172.21.15.45:0/965132631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b41a6e50 con 0x7f74b4108290 2024-09-15T22:16:42.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.912+0000 7f74aaffd640 1 -- 172.21.15.45:0/965132631 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0107f0 con 0x7f74b4108290 2024-09-15T22:16:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.912+0000 7f74bc263640 1 -- 172.21.15.45:0/965132631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b41a7310 con 0x7f74b4108290 2024-09-15T22:16:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.914+0000 7f74bc263640 1 -- 172.21.15.45:0/965132631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b406a7f0 con 0x7f74b4108290 2024-09-15T22:16:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.915+0000 7f74aaffd640 1 -- 172.21.15.45:0/965132631 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f74ac005020 con 0x7f74b4108290 2024-09-15T22:16:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.915+0000 7f74aaffd640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f74a00a3440 0x7f74a00a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.916+0000 7f74aaffd640 1 -- 172.21.15.45:0/965132631 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f74ac0d0720 con 0x7f74b4108290 2024-09-15T22:16:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.916+0000 7f74b9fff640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f74a00a3440 0x7f74a00a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.916+0000 7f74b9fff640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f74a00a3440 0x7f74a00a5900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74b0005d00 tx=0x7f74b000b410 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:42.920+0000 7f74aaffd640 1 -- 172.21.15.45:0/965132631 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f74ac09cc20 con 0x7f74b4108290 2024-09-15T22:16:42.994 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:43.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.103+0000 7f74bc263640 1 -- 172.21.15.45:0/965132631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74b410a2a0 con 0x7f74b4108290 2024-09-15T22:16:43.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.105+0000 7f74aaffd640 1 -- 172.21.15.45:0/965132631 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25101 (secure 0 0 0) 0x7f74ac09c520 con 0x7f74b4108290 2024-09-15T22:16:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:43.107 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":90,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:16:17.536229+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":7}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/1919238369":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/4107707607":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3286786467":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1080251242":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1461513797":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/1919238369":"2024-09-16T22:16:17.536196+0000","172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3846204427":"2024-09-16T22:16:17.536196+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:16:43.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.107+0000 7f74bc263640 1 -- 172.21.15.45:0/965132631 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f74a00a3440 msgr2=0x7f74a00a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:43.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.107+0000 7f74bc263640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f74a00a3440 0x7f74a00a5900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74b0005d00 tx=0x7f74b000b410 comp rx=0 tx=0).stop 2024-09-15T22:16:43.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.107+0000 7f74bc263640 1 -- 172.21.15.45:0/965132631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74b4108290 msgr2=0x7f74b4101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:43.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.107+0000 7f74bc263640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74b4108290 0x7f74b4101470 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00eb10 tx=0x7f74ac00c2d0 comp rx=0 tx=0).stop 2024-09-15T22:16:43.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.107+0000 7f74bc263640 1 -- 172.21.15.45:0/965132631 shutdown_connections 2024-09-15T22:16:43.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.107+0000 7f74bc263640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f74a00a3440 0x7f74a00a5900 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:43.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.107+0000 7f74bc263640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74b4108290 0x7f74b4101470 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:43.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.107+0000 7f74bc263640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b4103740 0x7f74b4100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:43.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.107+0000 7f74bc263640 1 --2- 172.21.15.45:0/965132631 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f74b4102d90 0x7f74b41009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:43.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.107+0000 7f74bc263640 1 -- 172.21.15.45:0/965132631 >> 172.21.15.45:0/965132631 conn(0x7f74b40fc7d0 msgr2=0x7f74b4106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:43.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.107+0000 7f74bc263640 1 -- 172.21.15.45:0/965132631 shutdown_connections 2024-09-15T22:16:43.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:43.107+0000 7f74bc263640 1 -- 172.21.15.45:0/965132631 wait complete. 2024-09-15T22:16:43.405 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:43 smithi045 ceph-mon[31180]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-15T22:16:43.405 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:43 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/965132631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:16:43.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:43 smithi165 ceph-mon[35551]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-15T22:16:43.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:43 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/965132631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:16:43.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:43 smithi100 ceph-mon[35319]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-15T22:16:43.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:43 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/965132631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:16:43.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-15T22:16:44.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.130+0000 7fce50f42640 1 -- 172.21.15.45:0/2409011325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce4c10e3d0 msgr2=0x7fce4c110820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:44.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.130+0000 7fce50f42640 1 --2- 172.21.15.45:0/2409011325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce4c10e3d0 0x7fce4c110820 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fce44009ca0 tx=0x7fce4402a950 comp rx=0 tx=0).stop 2024-09-15T22:16:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.130+0000 7fce50f42640 1 -- 172.21.15.45:0/2409011325 shutdown_connections 2024-09-15T22:16:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.130+0000 7fce50f42640 1 --2- 172.21.15.45:0/2409011325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce4c10e3d0 0x7fce4c110820 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.130+0000 7fce50f42640 1 --2- 172.21.15.45:0/2409011325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c074f40 0x7fce4c10de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.130+0000 7fce50f42640 1 --2- 172.21.15.45:0/2409011325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce4c074620 0x7fce4c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.130+0000 7fce50f42640 1 -- 172.21.15.45:0/2409011325 >> 172.21.15.45:0/2409011325 conn(0x7fce4c0fd8f0 msgr2=0x7fce4c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.130+0000 7fce50f42640 1 -- 172.21.15.45:0/2409011325 shutdown_connections 2024-09-15T22:16:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.130+0000 7fce50f42640 1 -- 172.21.15.45:0/2409011325 wait complete. 2024-09-15T22:16:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.131+0000 7fce50f42640 1 Processor -- start 2024-09-15T22:16:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.131+0000 7fce50f42640 1 -- start start 2024-09-15T22:16:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.131+0000 7fce50f42640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c074620 0x7fce4c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.131+0000 7fce50f42640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce4c074f40 0x7fce4c19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.131+0000 7fce50f42640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce4c10e3d0 0x7fce4c19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.131+0000 7fce50f42640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1142d0 con 0x7fce4c074f40 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.131+0000 7fce50f42640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c114150 con 0x7fce4c074620 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce50f42640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c114450 con 0x7fce4c10e3d0 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce49d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce4c074f40 0x7fce4c19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce49d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce4c074f40 0x7fce4c19ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51774/0 (socket says 172.21.15.45:51774) 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce49d9b640 1 -- 172.21.15.45:0/137501391 learned_addr learned my addr 172.21.15.45:0/137501391 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce4a59c640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c074620 0x7fce4c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce4ad9d640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce4c10e3d0 0x7fce4c19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce49d9b640 1 -- 172.21.15.45:0/137501391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce4c10e3d0 msgr2=0x7fce4c19efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce49d9b640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce4c10e3d0 0x7fce4c19efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce49d9b640 1 -- 172.21.15.45:0/137501391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c074620 msgr2=0x7fce4c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:44.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce49d9b640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c074620 0x7fce4c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce49d9b640 1 -- 172.21.15.45:0/137501391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4c19f6c0 con 0x7fce4c074f40 2024-09-15T22:16:44.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce49d9b640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce4c074f40 0x7fce4c19ac50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fce4000d950 tx=0x7fce4000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:44.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce3b7fe640 1 -- 172.21.15.45:0/137501391 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40017070 con 0x7fce4c074f40 2024-09-15T22:16:44.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce3b7fe640 1 -- 172.21.15.45:0/137501391 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce40009c30 con 0x7fce4c074f40 2024-09-15T22:16:44.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce3b7fe640 1 -- 172.21.15.45:0/137501391 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4000f740 con 0x7fce4c074f40 2024-09-15T22:16:44.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce50f42640 1 -- 172.21.15.45:0/137501391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce4c19f9b0 con 0x7fce4c074f40 2024-09-15T22:16:44.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.132+0000 7fce50f42640 1 -- 172.21.15.45:0/137501391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce4c1a7290 con 0x7fce4c074f40 2024-09-15T22:16:44.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.135+0000 7fce3b7fe640 1 -- 172.21.15.45:0/137501391 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fce40010a80 con 0x7fce4c074f40 2024-09-15T22:16:44.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.135+0000 7fce5331b740 1 Processor -- start 2024-09-15T22:16:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce5331b740 1 -- start start 2024-09-15T22:16:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce5331b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9d3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce5331b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9d35d0 0x56108a9d3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce5331b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9de370 0x56108a9e0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce5331b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56108a9392f0 con 0x56108a9d4b40 2024-09-15T22:16:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce5331b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56108a8e0cf0 con 0x56108a9de370 2024-09-15T22:16:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce5331b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56108a9352b0 con 0x56108a9d35d0 2024-09-15T22:16:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce3b7fe640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fce340a3440 0x7fce340a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce4ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce4ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9d3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51778/0 (socket says 172.21.15.45:51778) 2024-09-15T22:16:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce4ad9d640 1 -- 172.21.15.45:0/3095403555 learned_addr learned my addr 172.21.15.45:0/3095403555 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce3b7fe640 1 -- 172.21.15.45:0/137501391 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fce400cfe10 con 0x7fce4c074f40 2024-09-15T22:16:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce4a59c640 1 --2- 172.21.15.45:0/3095403555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9d35d0 0x56108a9d3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.136+0000 7fce49d9b640 1 --2- 172.21.15.45:0/3095403555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9de370 0x56108a9e0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.137+0000 7fce4ad9d640 1 -- 172.21.15.45:0/3095403555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9d35d0 msgr2=0x56108a9d3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.137+0000 7fce4ad9d640 1 --2- 172.21.15.45:0/3095403555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9d35d0 0x56108a9d3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.137+0000 7fce4ad9d640 1 -- 172.21.15.45:0/3095403555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9de370 msgr2=0x56108a9e0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.137+0000 7fce4ad9d640 1 --2- 172.21.15.45:0/3095403555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9de370 0x56108a9e0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.137+0000 7fce4ad9d640 1 -- 172.21.15.45:0/3095403555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56108a8c53a0 con 0x56108a9d4b40 2024-09-15T22:16:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.137+0000 7fce4ad9d640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fce340a3440 0x7fce340a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.138+0000 7fce4ad9d640 1 --2- 172.21.15.45:0/3095403555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9d3090 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fce44035000 tx=0x7fce4402f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf47062de2eebd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.138+0000 7fce38ff9640 1 -- 172.21.15.45:0/3095403555 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44041040 con 0x56108a9d4b40 2024-09-15T22:16:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.138+0000 7fce4ad9d640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fce340a3440 0x7fce340a5900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce44043000 tx=0x7fce44045000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.138+0000 7fce38ff9640 1 -- 172.21.15.45:0/3095403555 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce44003c30 con 0x56108a9d4b40 2024-09-15T22:16:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.138+0000 7fce38ff9640 1 -- 172.21.15.45:0/3095403555 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44034040 con 0x56108a9d4b40 2024-09-15T22:16:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.139+0000 7fce5331b740 1 -- 172.21.15.45:0/3095403555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 msgr2=0x56108a9d3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.139+0000 7fce5331b740 1 --2- 172.21.15.45:0/3095403555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9d3090 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fce44035000 tx=0x7fce4402f450 comp rx=0 tx=0).stop 2024-09-15T22:16:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.139+0000 7fce5331b740 1 -- 172.21.15.45:0/3095403555 shutdown_connections 2024-09-15T22:16:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.139+0000 7fce5331b740 1 --2- 172.21.15.45:0/3095403555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9de370 0x56108a9e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.139+0000 7fce5331b740 1 --2- 172.21.15.45:0/3095403555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9d35d0 0x56108a9d3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.139+0000 7fce5331b740 1 --2- 172.21.15.45:0/3095403555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9d3090 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.139+0000 7fce5331b740 1 -- 172.21.15.45:0/3095403555 >> 172.21.15.45:0/3095403555 conn(0x56108a99c310 msgr2=0x56108a9cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.139+0000 7fce5331b740 1 -- 172.21.15.45:0/3095403555 shutdown_connections 2024-09-15T22:16:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.139+0000 7fce5331b740 1 -- 172.21.15.45:0/3095403555 wait complete. 2024-09-15T22:16:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.139+0000 7fce5331b740 1 -- start start 2024-09-15T22:16:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce5331b740 1 Processor -- start 2024-09-15T22:16:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce5331b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d35d0 0x56108a9ddde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce5331b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9db090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce5331b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9de370 0x56108a9db7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce5331b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56108a9e1010 con 0x56108a9d4b40 2024-09-15T22:16:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce5331b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56108a8f4060 con 0x56108a9d35d0 2024-09-15T22:16:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce5331b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56108a9e1190 con 0x56108a9de370 2024-09-15T22:16:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce5331b740 10 client.0 _ll_register_callbacks cb 0x56108a6478c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce49d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9db090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce49d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9db090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51792/0 (socket says 172.21.15.45:51792) 2024-09-15T22:16:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce49d9b640 1 -- 172.21.15.45:0/2502562394 learned_addr learned my addr 172.21.15.45:0/2502562394 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce4a59c640 1 --2- 172.21.15.45:0/2502562394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d35d0 0x56108a9ddde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce49d9b640 1 -- 172.21.15.45:0/2502562394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9de370 msgr2=0x56108a9db7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce49d9b640 1 --2- 172.21.15.45:0/2502562394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9de370 0x56108a9db7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce49d9b640 1 -- 172.21.15.45:0/2502562394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d35d0 msgr2=0x56108a9ddde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce49d9b640 1 --2- 172.21.15.45:0/2502562394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d35d0 0x56108a9ddde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.140+0000 7fce49d9b640 1 -- 172.21.15.45:0/2502562394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56108a6aa3c0 con 0x56108a9d4b40 2024-09-15T22:16:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.141+0000 7fce49d9b640 1 --2- 172.21.15.45:0/2502562394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9db090 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fce400cd7f0 tx=0x7fce4009b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d075dca2949234 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.141+0000 7fce31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.141+0000 7fce31ffb640 1 -- 172.21.15.45:0/2502562394 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40020040 con 0x56108a9d4b40 2024-09-15T22:16:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.141+0000 7fce31ffb640 1 -- 172.21.15.45:0/2502562394 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fce400860c0 con 0x56108a9d4b40 2024-09-15T22:16:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.141+0000 7fce5331b740 1 -- 172.21.15.45:0/2502562394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce44003c30 con 0x56108a9d4b40 2024-09-15T22:16:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.141+0000 7fce31ffb640 1 -- 172.21.15.45:0/2502562394 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fce400cd5e0 con 0x56108a9d4b40 2024-09-15T22:16:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.141+0000 7fce5331b740 10 client.15465 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.141+0000 7fce5331b740 1 -- 172.21.15.45:0/2502562394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56108a9ecb90 con 0x56108a9d4b40 2024-09-15T22:16:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.141+0000 7fce31ffb640 1 -- 172.21.15.45:0/2502562394 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce44003c30 con 0x56108a9d4b40 2024-09-15T22:16:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.142+0000 7fce31ffb640 1 -- 172.21.15.45:0/2502562394 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fce4009b060 con 0x56108a9d4b40 2024-09-15T22:16:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.142+0000 7fce5331b740 10 client.15465 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.142+0000 7fce5331b740 10 client.15465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.142+0000 7fce5331b740 20 client.15465 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.142+0000 7fce5331b740 1 --2- 172.21.15.45:0/2502562394 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56108a9ee0a0 0x56108a9f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.142+0000 7fce5331b740 4 client.15465 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.142+0000 7fce5331b740 1 -- 172.21.15.45:0/2502562394 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56108a946860 con 0x56108a9ee0a0 2024-09-15T22:16:44.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.142+0000 7fce4a59c640 1 --2- 172.21.15.45:0/2502562394 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56108a9ee0a0 0x56108a9f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.142+0000 7fce4a59c640 1 --2- 172.21.15.45:0/2502562394 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56108a9ee0a0 0x56108a9f04b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=637512d028798e63 server_cookie=85c17c9eacb5760f in_seq=0 out_seq=0 2024-09-15T22:16:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.142+0000 7fce31ffb640 10 client.15465 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.143+0000 7fce31ffb640 1 -- 172.21.15.45:0/2502562394 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56108a946860 con 0x56108a9ee0a0 2024-09-15T22:16:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.143+0000 7fce31ffb640 10 client.15465 handle_command_reply: tid=0 2024-09-15T22:16:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.143+0000 7fce5331b740 1 client.15465 shutdown 2024-09-15T22:16:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.143+0000 7fce5331b740 1 -- 172.21.15.45:0/2502562394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 msgr2=0x56108a9db090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.143+0000 7fce5331b740 1 --2- 172.21.15.45:0/2502562394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9db090 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fce400cd7f0 tx=0x7fce4009b660 comp rx=0 tx=0).stop 2024-09-15T22:16:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.143+0000 7fce5331b740 1 -- 172.21.15.45:0/2502562394 shutdown_connections 2024-09-15T22:16:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.143+0000 7fce5331b740 1 --2- 172.21.15.45:0/2502562394 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56108a9ee0a0 0x56108a9f04b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.143+0000 7fce31ffb640 0 client.15465 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.143+0000 7fce5331b740 1 --2- 172.21.15.45:0/2502562394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9de370 0x56108a9db7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.143+0000 7fce5331b740 1 --2- 172.21.15.45:0/2502562394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9db090 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.143+0000 7fce5331b740 1 --2- 172.21.15.45:0/2502562394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d35d0 0x56108a9ddde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.143+0000 7fce5331b740 1 -- 172.21.15.45:0/2502562394 >> 172.21.15.45:0/2502562394 conn(0x56108a99c310 msgr2=0x56108a9d5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.144+0000 7fce5331b740 1 -- 172.21.15.45:0/2502562394 shutdown_connections 2024-09-15T22:16:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.144+0000 7fce5331b740 1 -- 172.21.15.45:0/2502562394 wait complete. 2024-09-15T22:16:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.144+0000 7fce5331b740 20 client.15465 trim_cache size 0 max 16384 2024-09-15T22:16:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.157+0000 7fce5331b740 1 Processor -- start 2024-09-15T22:16:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.157+0000 7fce5331b740 1 -- start start 2024-09-15T22:16:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.157+0000 7fce5331b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9d35d0 0x56108a9ea2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.157+0000 7fce5331b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d4b40 0x56108a9d6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.157+0000 7fce5331b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9de370 0x56108a9d6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.157+0000 7fce5331b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1af1d0 con 0x56108a9de370 2024-09-15T22:16:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.157+0000 7fce5331b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1b1a50 con 0x56108a9d4b40 2024-09-15T22:16:44.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.157+0000 7fce5331b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1af840 con 0x56108a9d35d0 2024-09-15T22:16:44.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.157+0000 7fce4ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9de370 0x56108a9d6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.157+0000 7fce4ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9de370 0x56108a9d6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51796/0 (socket says 172.21.15.45:51796) 2024-09-15T22:16:44.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.157+0000 7fce4ad9d640 1 -- 172.21.15.45:0/3168591651 learned_addr learned my addr 172.21.15.45:0/3168591651 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:44.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.158+0000 7fce49d9b640 1 --2- 172.21.15.45:0/3168591651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d4b40 0x56108a9d6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.158+0000 7fce4ad9d640 1 -- 172.21.15.45:0/3168591651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9d35d0 msgr2=0x56108a9ea2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:44.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.158+0000 7fce4ad9d640 1 --2- 172.21.15.45:0/3168591651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9d35d0 0x56108a9ea2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.158+0000 7fce4ad9d640 1 -- 172.21.15.45:0/3168591651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d4b40 msgr2=0x56108a9d6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:44.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.158+0000 7fce4ad9d640 1 --2- 172.21.15.45:0/3168591651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d4b40 0x56108a9d6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.158+0000 7fce4ad9d640 1 -- 172.21.15.45:0/3168591651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56108a9dbb40 con 0x56108a9de370 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.158+0000 7fce4ad9d640 1 --2- 172.21.15.45:0/3168591651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9de370 0x56108a9d6660 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fce44009ca0 tx=0x7fce44009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533e0565ccb21d78 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.158+0000 7fce33fff640 1 -- 172.21.15.45:0/3168591651 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44052070 con 0x56108a9de370 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.158+0000 7fce33fff640 1 -- 172.21.15.45:0/3168591651 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce44003c30 con 0x56108a9de370 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.158+0000 7fce33fff640 1 -- 172.21.15.45:0/3168591651 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44041040 con 0x56108a9de370 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.159+0000 7fce5331b740 1 -- 172.21.15.45:0/3168591651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9de370 msgr2=0x56108a9d6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.159+0000 7fce5331b740 1 --2- 172.21.15.45:0/3168591651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9de370 0x56108a9d6660 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fce44009ca0 tx=0x7fce44009b20 comp rx=0 tx=0).stop 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.159+0000 7fce5331b740 1 -- 172.21.15.45:0/3168591651 shutdown_connections 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.159+0000 7fce5331b740 1 --2- 172.21.15.45:0/3168591651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9de370 0x56108a9d6660 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.159+0000 7fce5331b740 1 --2- 172.21.15.45:0/3168591651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d4b40 0x56108a9d6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.159+0000 7fce5331b740 1 --2- 172.21.15.45:0/3168591651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9d35d0 0x56108a9ea2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.159+0000 7fce5331b740 1 -- 172.21.15.45:0/3168591651 >> 172.21.15.45:0/3168591651 conn(0x56108a99c310 msgr2=0x56108a9da1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.159+0000 7fce5331b740 1 -- 172.21.15.45:0/3168591651 shutdown_connections 2024-09-15T22:16:44.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.159+0000 7fce5331b740 1 -- 172.21.15.45:0/3168591651 wait complete. 2024-09-15T22:16:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.160+0000 7fce5331b740 1 -- start start 2024-09-15T22:16:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.160+0000 7fce5331b740 1 Processor -- start 2024-09-15T22:16:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.160+0000 7fce5331b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d35d0 0x56108a9e6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.160+0000 7fce5331b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9d7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.160+0000 7fce5331b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9de370 0x56108a9d81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.160+0000 7fce5331b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1aff10 con 0x56108a9d4b40 2024-09-15T22:16:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.160+0000 7fce5331b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1b1380 con 0x56108a9d35d0 2024-09-15T22:16:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce5331b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce4c1b05e0 con 0x56108a9de370 2024-09-15T22:16:44.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce5331b740 10 client.0 _ll_register_callbacks cb 0x7fce40097ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce49d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9d7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce49d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9d7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51798/0 (socket says 172.21.15.45:51798) 2024-09-15T22:16:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce49d9b640 1 -- 172.21.15.45:0/721395570 learned_addr learned my addr 172.21.15.45:0/721395570 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce4a59c640 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d35d0 0x56108a9e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce4ad9d640 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9de370 0x56108a9d81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce4ad9d640 1 -- 172.21.15.45:0/721395570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d35d0 msgr2=0x56108a9e6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce4ad9d640 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d35d0 0x56108a9e6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce4ad9d640 1 -- 172.21.15.45:0/721395570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 msgr2=0x56108a9d7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce4ad9d640 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9d7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce4ad9d640 1 -- 172.21.15.45:0/721395570 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56108a9d87e0 con 0x56108a9de370 2024-09-15T22:16:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce49d9b640 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9d7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce4ad9d640 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9de370 0x56108a9d81a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x56108a9e1260 tx=0x7fce44005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c444a4415be81799 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.161+0000 7fce31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce31ffb640 1 -- 172.21.15.45:0/721395570 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce44052070 con 0x56108a9de370 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce5331b740 1 -- 172.21.15.45:0/721395570 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce44003c30 con 0x56108a9de370 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce31ffb640 1 -- 172.21.15.45:0/721395570 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fce44057460 con 0x56108a9de370 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce31ffb640 1 -- 172.21.15.45:0/721395570 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fce44041040 con 0x56108a9de370 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce5331b740 10 client.25072 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce5331b740 1 -- 172.21.15.45:0/721395570 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56108aa58ba0 con 0x56108a9de370 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce31ffb640 1 -- 172.21.15.45:0/721395570 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce44003c30 con 0x56108a9de370 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce31ffb640 1 -- 172.21.15.45:0/721395570 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fce44030600 con 0x56108a9de370 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce5331b740 10 client.25072 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce5331b740 10 client.25072 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce5331b740 20 client.25072 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce5331b740 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56108aa58dd0 0x56108aa5b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce5331b740 4 client.25072 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:16:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.162+0000 7fce5331b740 1 -- 172.21.15.45:0/721395570 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56108a940d70 con 0x56108aa58dd0 2024-09-15T22:16:44.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.163+0000 7fce4a59c640 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56108aa58dd0 0x56108aa5b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:44.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.163+0000 7fce31ffb640 10 client.25072 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:44.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.163+0000 7fce4a59c640 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56108aa58dd0 0x56108aa5b1c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f233e506913651f4 server_cookie=9d9e8a063077a69a in_seq=0 out_seq=0 2024-09-15T22:16:44.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce31ffb640 1 -- 172.21.15.45:0/721395570 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56108a940d70 con 0x56108aa58dd0 2024-09-15T22:16:44.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce31ffb640 10 client.25072 handle_command_reply: tid=0 2024-09-15T22:16:44.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce5331b740 1 client.25072 shutdown 2024-09-15T22:16:44.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce5331b740 1 -- 172.21.15.45:0/721395570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9de370 msgr2=0x56108a9d81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:44.170 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:16:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce5331b740 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9de370 0x56108a9d81a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x56108a9e1260 tx=0x7fce44005ef0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce5331b740 1 -- 172.21.15.45:0/721395570 shutdown_connections 2024-09-15T22:16:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce5331b740 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56108aa58dd0 0x56108aa5b1c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce5331b740 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56108a9de370 0x56108a9d81a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce5331b740 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56108a9d4b40 0x56108a9d7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce31ffb640 0 client.25072 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce5331b740 1 --2- 172.21.15.45:0/721395570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56108a9d35d0 0x56108a9e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce5331b740 1 -- 172.21.15.45:0/721395570 >> 172.21.15.45:0/721395570 conn(0x56108a99c310 msgr2=0x56108a9dc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce5331b740 1 -- 172.21.15.45:0/721395570 shutdown_connections 2024-09-15T22:16:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce5331b740 1 -- 172.21.15.45:0/721395570 wait complete. 2024-09-15T22:16:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.164+0000 7fce5331b740 20 client.25072 trim_cache size 0 max 16384 2024-09-15T22:16:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.165+0000 7fce50f42640 1 -- 172.21.15.45:0/137501391 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fce340a3440 msgr2=0x7fce340a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.165+0000 7fce50f42640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fce340a3440 0x7fce340a5900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce44043000 tx=0x7fce44045000 comp rx=0 tx=0).stop 2024-09-15T22:16:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.165+0000 7fce50f42640 1 -- 172.21.15.45:0/137501391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce4c074f40 msgr2=0x7fce4c19ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.165+0000 7fce50f42640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce4c074f40 0x7fce4c19ac50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fce4000d950 tx=0x7fce4000de10 comp rx=0 tx=0).stop 2024-09-15T22:16:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.165+0000 7fce50f42640 1 -- 172.21.15.45:0/137501391 shutdown_connections 2024-09-15T22:16:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.165+0000 7fce50f42640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fce340a3440 0x7fce340a5900 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.165+0000 7fce50f42640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce4c10e3d0 0x7fce4c19efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.165+0000 7fce50f42640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce4c074f40 0x7fce4c19ac50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.165+0000 7fce50f42640 1 --2- 172.21.15.45:0/137501391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce4c074620 0x7fce4c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.165+0000 7fce50f42640 1 -- 172.21.15.45:0/137501391 >> 172.21.15.45:0/137501391 conn(0x7fce4c0fd8f0 msgr2=0x7fce4c0fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.166+0000 7fce50f42640 1 -- 172.21.15.45:0/137501391 shutdown_connections 2024-09-15T22:16:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:44.166+0000 7fce50f42640 1 -- 172.21.15.45:0/137501391 wait complete. 2024-09-15T22:16:45.006 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:45.530 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:45 smithi045 ceph-mon[31180]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-15T22:16:45.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:45 smithi165 ceph-mon[35551]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-15T22:16:45.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:45 smithi100 ceph-mon[35319]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-15T22:16:46.019 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:16:46.020 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:16:46.236 INFO:teuthology.orchestra.run.smithi045.stdout:{"run_dir":"/var/run/ceph"} 2024-09-15T22:16:46.236 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-15T22:16:46.236 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 3393 2024-09-15T22:16:46.237 DEBUG:tasks.quiescer:Yielding 2024-09-15T22:16:46.237 INFO:teuthology.run_tasks:Running task workunit... 2024-09-15T22:16:46.254 INFO:tasks.workunit:Pulling workunits from ref ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T22:16:46.255 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-15T22:16:46.255 INFO:tasks.workunit:timeout=3h 2024-09-15T22:16:46.255 INFO:tasks.workunit:cleanup=True 2024-09-15T22:16:46.255 DEBUG:teuthology.orchestra.run.smithi045:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-15T22:16:46.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:16:46.274 INFO:teuthology.orchestra.run.smithi045.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-15T22:16:46.274 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-15T22:16:46.274 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-15T22:16:46.274 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:16:46.274 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-15T22:16:46.274 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-09-15 22:14:52.876379610 +0000 2024-09-15T22:16:46.275 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-09-15 22:14:52.876379610 +0000 2024-09-15T22:16:46.275 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-09-15 22:16:17.557320164 +0000 2024-09-15T22:16:46.275 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-09-15 22:14:52.876379610 +0000 2024-09-15T22:16:46.275 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-15T22:16:46.275 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-15T22:16:46.291 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:46.325 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T22:16:46.381 INFO:tasks.workunit.client.0.smithi045.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-15T22:16:46.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.880+0000 7fe0f7512640 1 -- 172.21.15.45:0/2437863070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f01027a0 msgr2=0x7fe0f01067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:46.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.880+0000 7fe0f7512640 1 --2- 172.21.15.45:0/2437863070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f01027a0 0x7fe0f01067f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009900 tx=0x7fe0e402a410 comp rx=0 tx=0).stop 2024-09-15T22:16:46.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.880+0000 7fe0f7512640 1 -- 172.21.15.45:0/2437863070 shutdown_connections 2024-09-15T22:16:46.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.880+0000 7fe0f7512640 1 --2- 172.21.15.45:0/2437863070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f0106f20 0x7fe0f010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.880+0000 7fe0f7512640 1 --2- 172.21.15.45:0/2437863070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f01027a0 0x7fe0f01067f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.880+0000 7fe0f7512640 1 --2- 172.21.15.45:0/2437863070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0f0101df0 0x7fe0f01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.880+0000 7fe0f7512640 1 -- 172.21.15.45:0/2437863070 >> 172.21.15.45:0/2437863070 conn(0x7fe0f00fd8f0 msgr2=0x7fe0f00ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:46.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.880+0000 7fe0f7512640 1 -- 172.21.15.45:0/2437863070 shutdown_connections 2024-09-15T22:16:46.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.880+0000 7fe0f7512640 1 -- 172.21.15.45:0/2437863070 wait complete. 2024-09-15T22:16:46.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.881+0000 7fe0f7512640 1 Processor -- start 2024-09-15T22:16:46.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.881+0000 7fe0f7512640 1 -- start start 2024-09-15T22:16:46.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.881+0000 7fe0f7512640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f0101df0 0x7fe0f0198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.881+0000 7fe0f7512640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0f01027a0 0x7fe0f0198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.881+0000 7fe0f7512640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f0106f20 0x7fe0f019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.881+0000 7fe0f7512640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01120a0 con 0x7fe0f0101df0 2024-09-15T22:16:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.881+0000 7fe0f7512640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f0111f20 con 0x7fe0f0106f20 2024-09-15T22:16:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.881+0000 7fe0f7512640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f0112220 con 0x7fe0f01027a0 2024-09-15T22:16:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.881+0000 7fe0f52ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f0101df0 0x7fe0f0198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.881+0000 7fe0f52ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f0101df0 0x7fe0f0198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48536/0 (socket says 172.21.15.45:48536) 2024-09-15T22:16:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.881+0000 7fe0f52ae640 1 -- 172.21.15.45:0/2449512220 learned_addr learned my addr 172.21.15.45:0/2449512220 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.881+0000 7fe0f5aaf640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f0106f20 0x7fe0f019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.881+0000 7fe0f4aad640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0f01027a0 0x7fe0f0198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.882+0000 7fe0f52ae640 1 -- 172.21.15.45:0/2449512220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0f01027a0 msgr2=0x7fe0f0198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.882+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0f01027a0 0x7fe0f0198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.882+0000 7fe0f52ae640 1 -- 172.21.15.45:0/2449512220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f0106f20 msgr2=0x7fe0f019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.882+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f0106f20 0x7fe0f019ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.882+0000 7fe0f52ae640 1 -- 172.21.15.45:0/2449512220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f019d510 con 0x7fe0f0101df0 2024-09-15T22:16:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.882+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f0101df0 0x7fe0f0198560 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000d770 tx=0x7fe0e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.882+0000 7fe0ee7fc640 1 -- 172.21.15.45:0/2449512220 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0017070 con 0x7fe0f0101df0 2024-09-15T22:16:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.882+0000 7fe0ee7fc640 1 -- 172.21.15.45:0/2449512220 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0e0005520 con 0x7fe0f0101df0 2024-09-15T22:16:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.882+0000 7fe0f7512640 1 -- 172.21.15.45:0/2449512220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f019d800 con 0x7fe0f0101df0 2024-09-15T22:16:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.882+0000 7fe0ee7fc640 1 -- 172.21.15.45:0/2449512220 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0010460 con 0x7fe0f0101df0 2024-09-15T22:16:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.882+0000 7fe0f7512640 1 -- 172.21.15.45:0/2449512220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f01a50e0 con 0x7fe0f0101df0 2024-09-15T22:16:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.884+0000 7fe0ee7fc640 1 -- 172.21.15.45:0/2449512220 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fe0e0004ea0 con 0x7fe0f0101df0 2024-09-15T22:16:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.885+0000 7fe0f98eb740 1 Processor -- start 2024-09-15T22:16:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.885+0000 7fe0f98eb740 1 -- start start 2024-09-15T22:16:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.885+0000 7fe0f98eb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1dfff70 0x55dfa1e00350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.885+0000 7fe0f98eb740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e00890 0x55dfa1e0ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.885+0000 7fe0f98eb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1e0b150 0x55dfa1e0d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.885+0000 7fe0f98eb740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55dfa1d61280 con 0x55dfa1e00890 2024-09-15T22:16:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.885+0000 7fe0f98eb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55dfa1d08b10 con 0x55dfa1dfff70 2024-09-15T22:16:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.885+0000 7fe0f98eb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55dfa1d5d240 con 0x55dfa1e0b150 2024-09-15T22:16:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.885+0000 7fe0ee7fc640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe0d80a34c0 0x7fe0d80a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.885+0000 7fe0f52ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e00890 0x55dfa1e0ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f5aaf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1dfff70 0x55dfa1e00350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f52ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e00890 0x55dfa1e0ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48540/0 (socket says 172.21.15.45:48540) 2024-09-15T22:16:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f52ae640 1 -- 172.21.15.45:0/3458455950 learned_addr learned my addr 172.21.15.45:0/3458455950 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f5aaf640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe0d80a34c0 0x7fe0d80a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f4aad640 1 --2- 172.21.15.45:0/3458455950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1e0b150 0x55dfa1e0d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0ee7fc640 1 -- 172.21.15.45:0/2449512220 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fe0e00cfca0 con 0x7fe0f0101df0 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f52ae640 1 -- 172.21.15.45:0/3458455950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1e0b150 msgr2=0x55dfa1e0d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/3458455950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1e0b150 0x55dfa1e0d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f52ae640 1 -- 172.21.15.45:0/3458455950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1dfff70 msgr2=0x55dfa1e00350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/3458455950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1dfff70 0x55dfa1e00350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f52ae640 1 -- 172.21.15.45:0/3458455950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfa1d151f0 con 0x55dfa1e00890 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f5aaf640 1 --2- 172.21.15.45:0/3458455950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1dfff70 0x55dfa1e00350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f4aad640 1 --2- 172.21.15.45:0/3458455950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1e0b150 0x55dfa1e0d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f5aaf640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe0d80a34c0 0x7fe0d80a5980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009fd0 tx=0x7fe0e8009240 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/3458455950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e00890 0x55dfa1e0ac10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe0e006e8a0 tx=0x7fe0e00c6870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff54a88020f3da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0d77fe640 1 -- 172.21.15.45:0/3458455950 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0020070 con 0x55dfa1e00890 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0d77fe640 1 -- 172.21.15.45:0/3458455950 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0e009baa0 con 0x55dfa1e00890 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.886+0000 7fe0d77fe640 1 -- 172.21.15.45:0/3458455950 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0098110 con 0x55dfa1e00890 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.887+0000 7fe0f98eb740 1 -- 172.21.15.45:0/3458455950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e00890 msgr2=0x55dfa1e0ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:46.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.887+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/3458455950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e00890 0x55dfa1e0ac10 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe0e006e8a0 tx=0x7fe0e00c6870 comp rx=0 tx=0).stop 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.887+0000 7fe0f98eb740 1 -- 172.21.15.45:0/3458455950 shutdown_connections 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.887+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/3458455950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1e0b150 0x55dfa1e0d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.887+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/3458455950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e00890 0x55dfa1e0ac10 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.887+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/3458455950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1dfff70 0x55dfa1e00350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.887+0000 7fe0f98eb740 1 -- 172.21.15.45:0/3458455950 >> 172.21.15.45:0/3458455950 conn(0x55dfa1dfc500 msgr2=0x55dfa1dfc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.887+0000 7fe0f98eb740 1 -- 172.21.15.45:0/3458455950 shutdown_connections 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.887+0000 7fe0f98eb740 1 -- 172.21.15.45:0/3458455950 wait complete. 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.888+0000 7fe0f98eb740 1 -- start start 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.888+0000 7fe0f98eb740 1 Processor -- start 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.888+0000 7fe0f98eb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1dfff70 0x55dfa1e08060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.888+0000 7fe0f98eb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1e00890 0x55dfa1e085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.888+0000 7fe0f98eb740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e08ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.888+0000 7fe0f98eb740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55dfa1e0dcc0 con 0x55dfa1e0b150 2024-09-15T22:16:46.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.888+0000 7fe0f98eb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55dfa1d1bf10 con 0x55dfa1dfff70 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.888+0000 7fe0f98eb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55dfa1e0de40 con 0x55dfa1e00890 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.888+0000 7fe0f98eb740 10 client.0 _ll_register_callbacks cb 0x55dfa1ce4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.889+0000 7fe0f5aaf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e08ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.889+0000 7fe0f5aaf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e08ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48544/0 (socket says 172.21.15.45:48544) 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.889+0000 7fe0f5aaf640 1 -- 172.21.15.45:0/2330924242 learned_addr learned my addr 172.21.15.45:0/2330924242 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.889+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1dfff70 0x55dfa1e08060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.889+0000 7fe0f4aad640 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1e00890 0x55dfa1e085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.889+0000 7fe0f5aaf640 1 -- 172.21.15.45:0/2330924242 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1e00890 msgr2=0x55dfa1e085a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.889+0000 7fe0f5aaf640 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1e00890 0x55dfa1e085a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.889+0000 7fe0f5aaf640 1 -- 172.21.15.45:0/2330924242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1dfff70 msgr2=0x55dfa1e08060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.889+0000 7fe0f5aaf640 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1dfff70 0x55dfa1e08060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.889+0000 7fe0f5aaf640 1 -- 172.21.15.45:0/2330924242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfa1ad26a0 con 0x55dfa1e0b150 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.889+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1dfff70 0x55dfa1e08060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:46.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.889+0000 7fe0f5aaf640 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e08ae0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800fe10 tx=0x7fe0e8012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c09f39cf2bd081 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:46.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.889+0000 7fe0d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:46.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0d4ff9640 1 -- 172.21.15.45:0/2330924242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8004b20 con 0x55dfa1e0b150 2024-09-15T22:16:46.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0f98eb740 1 -- 172.21.15.45:0/2330924242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0e009baa0 con 0x55dfa1e0b150 2024-09-15T22:16:46.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0d4ff9640 1 -- 172.21.15.45:0/2330924242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fe0e8004cc0 con 0x55dfa1e0b150 2024-09-15T22:16:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0d4ff9640 1 -- 172.21.15.45:0/2330924242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe0e8032050 con 0x55dfa1e0b150 2024-09-15T22:16:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0f98eb740 10 client.15483 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0f98eb740 1 -- 172.21.15.45:0/2330924242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dfa1e19940 con 0x55dfa1e0b150 2024-09-15T22:16:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0d4ff9640 1 -- 172.21.15.45:0/2330924242 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0e009baa0 con 0x55dfa1e0b150 2024-09-15T22:16:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0d4ff9640 1 -- 172.21.15.45:0/2330924242 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe0e801f050 con 0x55dfa1e0b150 2024-09-15T22:16:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0f98eb740 10 client.15483 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0f98eb740 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0f98eb740 20 client.15483 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dfa1e1ad50 0x55dfa1e1d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0f98eb740 4 client.15483 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.890+0000 7fe0f98eb740 1 -- 172.21.15.45:0/2330924242 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfa1d6e7f0 con 0x55dfa1e1ad50 2024-09-15T22:16:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.891+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dfa1e1ad50 0x55dfa1e1d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.891+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dfa1e1ad50 0x55dfa1e1d190 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=587e8839d44a7023 server_cookie=c460cf7dce2c8cb3 in_seq=0 out_seq=0 2024-09-15T22:16:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.891+0000 7fe0d4ff9640 10 client.15483 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0d4ff9640 1 -- 172.21.15.45:0/2330924242 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfa1d6e7f0 con 0x55dfa1e1ad50 2024-09-15T22:16:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0d4ff9640 10 client.15483 handle_command_reply: tid=0 2024-09-15T22:16:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0f98eb740 1 client.15483 shutdown 2024-09-15T22:16:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0f98eb740 1 -- 172.21.15.45:0/2330924242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 msgr2=0x55dfa1e08ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e08ae0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800fe10 tx=0x7fe0e8012f90 comp rx=0 tx=0).stop 2024-09-15T22:16:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0f98eb740 1 -- 172.21.15.45:0/2330924242 shutdown_connections 2024-09-15T22:16:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dfa1e1ad50 0x55dfa1e1d190 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e08ae0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1e00890 0x55dfa1e085a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/2330924242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1dfff70 0x55dfa1e08060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0f98eb740 1 -- 172.21.15.45:0/2330924242 >> 172.21.15.45:0/2330924242 conn(0x55dfa1dfc500 msgr2=0x55dfa1df7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:46.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0d4ff9640 0 client.15483 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:46.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0f98eb740 1 -- 172.21.15.45:0/2330924242 shutdown_connections 2024-09-15T22:16:46.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.892+0000 7fe0f98eb740 1 -- 172.21.15.45:0/2330924242 wait complete. 2024-09-15T22:16:46.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.893+0000 7fe0f98eb740 20 client.15483 trim_cache size 0 max 16384 2024-09-15T22:16:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.913+0000 7fe0f98eb740 1 Processor -- start 2024-09-15T22:16:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.913+0000 7fe0f98eb740 1 -- start start 2024-09-15T22:16:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.913+0000 7fe0f98eb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 0x55dfa1e09ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.913+0000 7fe0f98eb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1e00890 0x55dfa1e22ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.913+0000 7fe0f98eb740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e22ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.913+0000 7fe0f98eb740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01aae10 con 0x55dfa1e0b150 2024-09-15T22:16:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.913+0000 7fe0f98eb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01ad690 con 0x55dfa1e00890 2024-09-15T22:16:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.913+0000 7fe0f98eb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01ab480 con 0x55dfa1dfff70 2024-09-15T22:16:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.914+0000 7fe0f52ae640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 0x55dfa1e09ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.914+0000 7fe0f4aad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1e00890 0x55dfa1e22ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.914+0000 7fe0f52ae640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 0x55dfa1e09ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:50320/0 (socket says 172.21.15.45:50320) 2024-09-15T22:16:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.914+0000 7fe0f52ae640 1 -- 172.21.15.45:0/762338808 learned_addr learned my addr 172.21.15.45:0/762338808 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.914+0000 7fe0f5aaf640 1 --2- 172.21.15.45:0/762338808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e22ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.914+0000 7fe0f52ae640 1 -- 172.21.15.45:0/762338808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1e00890 msgr2=0x55dfa1e22ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.914+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/762338808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1e00890 0x55dfa1e22ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.914+0000 7fe0f52ae640 1 -- 172.21.15.45:0/762338808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 msgr2=0x55dfa1e22ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.914+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/762338808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e22ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.914+0000 7fe0f52ae640 1 -- 172.21.15.45:0/762338808 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfa1e006c0 con 0x55dfa1dfff70 2024-09-15T22:16:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.914+0000 7fe0f4aad640 1 --2- 172.21.15.45:0/762338808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1e00890 0x55dfa1e22ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.914+0000 7fe0f5aaf640 1 --2- 172.21.15.45:0/762338808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e22ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.914+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/762338808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 0x55dfa1e09ec0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0098470 tx=0x7fe0e0097d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77a5f1da00bc39fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.915+0000 7fe0d6ffd640 1 -- 172.21.15.45:0/762338808 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0020040 con 0x55dfa1dfff70 2024-09-15T22:16:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.915+0000 7fe0d6ffd640 1 -- 172.21.15.45:0/762338808 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0e00a4710 con 0x55dfa1dfff70 2024-09-15T22:16:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.915+0000 7fe0d6ffd640 1 -- 172.21.15.45:0/762338808 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00cd270 con 0x55dfa1dfff70 2024-09-15T22:16:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.915+0000 7fe0f98eb740 1 -- 172.21.15.45:0/762338808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 msgr2=0x55dfa1e09ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.915+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/762338808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 0x55dfa1e09ec0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0098470 tx=0x7fe0e0097d40 comp rx=0 tx=0).stop 2024-09-15T22:16:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.916+0000 7fe0f98eb740 1 -- 172.21.15.45:0/762338808 shutdown_connections 2024-09-15T22:16:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.916+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/762338808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e22ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.916+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/762338808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1e00890 0x55dfa1e22ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.916+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/762338808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 0x55dfa1e09ec0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.916+0000 7fe0f98eb740 1 -- 172.21.15.45:0/762338808 >> 172.21.15.45:0/762338808 conn(0x55dfa1dfc500 msgr2=0x55dfa1e097b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.916+0000 7fe0f98eb740 1 -- 172.21.15.45:0/762338808 shutdown_connections 2024-09-15T22:16:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.916+0000 7fe0f98eb740 1 -- 172.21.15.45:0/762338808 wait complete. 2024-09-15T22:16:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.917+0000 7fe0f98eb740 1 -- start start 2024-09-15T22:16:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.917+0000 7fe0f98eb740 1 Processor -- start 2024-09-15T22:16:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.917+0000 7fe0f98eb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 0x55dfa1dfb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.917+0000 7fe0f98eb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1e00890 0x55dfa1dfb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.918+0000 7fe0f98eb740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e132e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.918+0000 7fe0f98eb740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01abb50 con 0x55dfa1e0b150 2024-09-15T22:16:46.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.918+0000 7fe0f98eb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01acfc0 con 0x55dfa1e00890 2024-09-15T22:16:46.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.918+0000 7fe0f98eb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f01ac220 con 0x55dfa1dfff70 2024-09-15T22:16:46.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.918+0000 7fe0f52ae640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 0x55dfa1dfb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.918+0000 7fe0f52ae640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 0x55dfa1dfb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:50332/0 (socket says 172.21.15.45:50332) 2024-09-15T22:16:46.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.918+0000 7fe0f52ae640 1 -- 172.21.15.45:0/229749920 learned_addr learned my addr 172.21.15.45:0/229749920 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:46.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.918+0000 7fe0f98eb740 10 client.0 _ll_register_callbacks cb 0x7fe0e800fab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.918+0000 7fe0f5aaf640 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.918+0000 7fe0f4aad640 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1e00890 0x55dfa1dfb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.918+0000 7fe0f52ae640 1 -- 172.21.15.45:0/229749920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1e00890 msgr2=0x55dfa1dfb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1e00890 0x55dfa1dfb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0f52ae640 1 -- 172.21.15.45:0/229749920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 msgr2=0x55dfa1e132e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e132e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0f52ae640 1 -- 172.21.15.45:0/229749920 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfa1e13b10 con 0x55dfa1dfff70 2024-09-15T22:16:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0f4aad640 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1e00890 0x55dfa1dfb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0f5aaf640 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0f52ae640 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 0x55dfa1dfb450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0099d50 tx=0x7fe0e009c260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca9ecffad658efe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-15T22:16:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0d4ff9640 1 -- 172.21.15.45:0/229749920 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00b8060 con 0x55dfa1dfff70 2024-09-15T22:16:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0d4ff9640 1 -- 172.21.15.45:0/229749920 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fe0e0005190 con 0x55dfa1dfff70 2024-09-15T22:16:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0f98eb740 1 -- 172.21.15.45:0/229749920 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0e00a4710 con 0x55dfa1dfff70 2024-09-15T22:16:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0d4ff9640 1 -- 172.21.15.45:0/229749920 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe0e0014070 con 0x55dfa1dfff70 2024-09-15T22:16:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0f98eb740 10 client.25090 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.919+0000 7fe0f98eb740 1 -- 172.21.15.45:0/229749920 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dfa1df9600 con 0x55dfa1dfff70 2024-09-15T22:16:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.920+0000 7fe0d4ff9640 1 -- 172.21.15.45:0/229749920 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0e00a4710 con 0x55dfa1dfff70 2024-09-15T22:16:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.920+0000 7fe0d4ff9640 1 -- 172.21.15.45:0/229749920 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe0e009aef0 con 0x55dfa1dfff70 2024-09-15T22:16:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.920+0000 7fe0f98eb740 10 client.25090 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.920+0000 7fe0f98eb740 10 client.25090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.920+0000 7fe0f98eb740 20 client.25090 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.920+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dfa1e8a2d0 0x55dfa1e8c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.920+0000 7fe0f98eb740 4 client.25090 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:16:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.920+0000 7fe0f98eb740 1 -- 172.21.15.45:0/229749920 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dfa1d68d00 con 0x55dfa1e8a2d0 2024-09-15T22:16:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.920+0000 7fe0f4aad640 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dfa1e8a2d0 0x55dfa1e8c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.921+0000 7fe0f4aad640 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dfa1e8a2d0 0x55dfa1e8c6c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec9591356c8e1ec7 server_cookie=1c277ad85746aa9d in_seq=0 out_seq=0 2024-09-15T22:16:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.921+0000 7fe0d4ff9640 10 client.25090 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.922+0000 7fe0d4ff9640 1 -- 172.21.15.45:0/229749920 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dfa1d68d00 con 0x55dfa1e8a2d0 2024-09-15T22:16:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.922+0000 7fe0d4ff9640 10 client.25090 handle_command_reply: tid=0 2024-09-15T22:16:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.922+0000 7fe0f98eb740 1 client.25090 shutdown 2024-09-15T22:16:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.922+0000 7fe0f98eb740 1 -- 172.21.15.45:0/229749920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 msgr2=0x55dfa1dfb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.922+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 0x55dfa1dfb450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0099d50 tx=0x7fe0e009c260 comp rx=0 tx=0).stop 2024-09-15T22:16:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.922+0000 7fe0f98eb740 1 -- 172.21.15.45:0/229749920 shutdown_connections 2024-09-15T22:16:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.922+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dfa1e8a2d0 0x55dfa1e8c6c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.922+0000 7fe0d4ff9640 0 client.25090 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:46.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.922+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dfa1e0b150 0x55dfa1e132e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.922+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dfa1e00890 0x55dfa1dfb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.922+0000 7fe0f98eb740 1 --2- 172.21.15.45:0/229749920 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dfa1dfff70 0x55dfa1dfb450 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0099d50 tx=0x7fe0e009c260 comp rx=0 tx=0).stop 2024-09-15T22:16:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.922+0000 7fe0f98eb740 1 -- 172.21.15.45:0/229749920 >> 172.21.15.45:0/229749920 conn(0x55dfa1dfc500 msgr2=0x55dfa1df7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.923+0000 7fe0f98eb740 1 -- 172.21.15.45:0/229749920 shutdown_connections 2024-09-15T22:16:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.923+0000 7fe0f98eb740 1 -- 172.21.15.45:0/229749920 wait complete. 2024-09-15T22:16:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.924+0000 7fe0f98eb740 20 client.25090 trim_cache size 0 max 16384 2024-09-15T22:16:46.927 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:16:46.927 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:16:46.927 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "9b3174ff-ee89-4fd2-8fac-095c8eb2ae29", 2024-09-15T22:16:46.927 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:16:46.928 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:16:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.924+0000 7fe0f7512640 1 -- 172.21.15.45:0/2449512220 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe0d80a34c0 msgr2=0x7fe0d80a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.924+0000 7fe0f7512640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe0d80a34c0 0x7fe0d80a5980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009fd0 tx=0x7fe0e8009240 comp rx=0 tx=0).stop 2024-09-15T22:16:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.924+0000 7fe0f7512640 1 -- 172.21.15.45:0/2449512220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f0101df0 msgr2=0x7fe0f0198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.924+0000 7fe0f7512640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f0101df0 0x7fe0f0198560 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000d770 tx=0x7fe0e000dc30 comp rx=0 tx=0).stop 2024-09-15T22:16:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.924+0000 7fe0f7512640 1 -- 172.21.15.45:0/2449512220 shutdown_connections 2024-09-15T22:16:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.924+0000 7fe0f7512640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe0d80a34c0 0x7fe0d80a5980 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.924+0000 7fe0f7512640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0f0106f20 0x7fe0f019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.924+0000 7fe0f7512640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0f01027a0 0x7fe0f0198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.924+0000 7fe0f7512640 1 --2- 172.21.15.45:0/2449512220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0f0101df0 0x7fe0f0198560 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:46.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.925+0000 7fe0f7512640 1 -- 172.21.15.45:0/2449512220 >> 172.21.15.45:0/2449512220 conn(0x7fe0f00fd8f0 msgr2=0x7fe0f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:46.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.925+0000 7fe0f7512640 1 -- 172.21.15.45:0/2449512220 shutdown_connections 2024-09-15T22:16:46.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:46.925+0000 7fe0f7512640 1 -- 172.21.15.45:0/2449512220 wait complete. 2024-09-15T22:16:46.934 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:47.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:47 smithi045 ceph-mon[31180]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-15T22:16:47.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:47 smithi165 ceph-mon[35551]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-15T22:16:47.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:47 smithi100 ceph-mon[35319]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-09-15T22:16:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.735+0000 7f3d528aa640 1 -- 172.21.15.45:0/4001946022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d4c103670 msgr2=0x7f3d4c10bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.735+0000 7f3d528aa640 1 --2- 172.21.15.45:0/4001946022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d4c103670 0x7f3d4c10bb60 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009900 tx=0x7f3d4002a480 comp rx=0 tx=0).stop 2024-09-15T22:16:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.735+0000 7f3d528aa640 1 -- 172.21.15.45:0/4001946022 shutdown_connections 2024-09-15T22:16:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.735+0000 7f3d528aa640 1 --2- 172.21.15.45:0/4001946022 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d4c10c180 0x7f3d4c10e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.735+0000 7f3d528aa640 1 --2- 172.21.15.45:0/4001946022 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d4c103670 0x7f3d4c10bb60 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.735+0000 7f3d528aa640 1 --2- 172.21.15.45:0/4001946022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c102d50 0x7f3d4c103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.735+0000 7f3d528aa640 1 -- 172.21.15.45:0/4001946022 >> 172.21.15.45:0/4001946022 conn(0x7f3d4c0fc7d0 msgr2=0x7f3d4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.735+0000 7f3d528aa640 1 -- 172.21.15.45:0/4001946022 shutdown_connections 2024-09-15T22:16:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.735+0000 7f3d528aa640 1 -- 172.21.15.45:0/4001946022 wait complete. 2024-09-15T22:16:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.736+0000 7f3d528aa640 1 Processor -- start 2024-09-15T22:16:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.736+0000 7f3d528aa640 1 -- start start 2024-09-15T22:16:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.736+0000 7f3d528aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d4c102d50 0x7f3d4c1a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.736+0000 7f3d528aa640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d4c103670 0x7f3d4c1a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.736+0000 7f3d528aa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c10c180 0x7f3d4c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.736+0000 7f3d528aa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c112100 con 0x7f3d4c102d50 2024-09-15T22:16:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.736+0000 7f3d528aa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c111f80 con 0x7f3d4c10c180 2024-09-15T22:16:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.736+0000 7f3d528aa640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c112280 con 0x7f3d4c103670 2024-09-15T22:16:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.736+0000 7f3d4bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d4c102d50 0x7f3d4c1a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.736+0000 7f3d4bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d4c102d50 0x7f3d4c1a0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48586/0 (socket says 172.21.15.45:48586) 2024-09-15T22:16:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.736+0000 7f3d4bfff640 1 -- 172.21.15.45:0/3335301049 learned_addr learned my addr 172.21.15.45:0/3335301049 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d50e47640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c10c180 0x7f3d4c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d4b7fe640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d4c103670 0x7f3d4c1a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d4bfff640 1 -- 172.21.15.45:0/3335301049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d4c103670 msgr2=0x7f3d4c1a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d4bfff640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d4c103670 0x7f3d4c1a0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d4bfff640 1 -- 172.21.15.45:0/3335301049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c10c180 msgr2=0x7f3d4c19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d4bfff640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c10c180 0x7f3d4c19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d4bfff640 1 -- 172.21.15.45:0/3335301049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4c19ae90 con 0x7f3d4c102d50 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d50e47640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c10c180 0x7f3d4c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d4bfff640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d4c102d50 0x7f3d4c1a0500 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00c890 tx=0x7f3d3c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d497fa640 1 -- 172.21.15.45:0/3335301049 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c004220 con 0x7f3d4c102d50 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d497fa640 1 -- 172.21.15.45:0/3335301049 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3d3c0043c0 con 0x7f3d4c102d50 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d528aa640 1 -- 172.21.15.45:0/3335301049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d4c19b180 con 0x7f3d4c102d50 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d497fa640 1 -- 172.21.15.45:0/3335301049 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c004b10 con 0x7f3d4c102d50 2024-09-15T22:16:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.737+0000 7f3d528aa640 1 -- 172.21.15.45:0/3335301049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d4c1a74f0 con 0x7f3d4c102d50 2024-09-15T22:16:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.738+0000 7f3d528aa640 1 -- 172.21.15.45:0/3335301049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d4c06b070 con 0x7f3d4c102d50 2024-09-15T22:16:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.740+0000 7f3d497fa640 1 -- 172.21.15.45:0/3335301049 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f3d3c0051b0 con 0x7f3d4c102d50 2024-09-15T22:16:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.740+0000 7f3d497fa640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3d340a3440 0x7f3d340a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.740+0000 7f3d4b7fe640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3d340a3440 0x7f3d340a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.740+0000 7f3d497fa640 1 -- 172.21.15.45:0/3335301049 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f3d3c0d03f0 con 0x7f3d4c102d50 2024-09-15T22:16:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.741+0000 7f3d4b7fe640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3d340a3440 0x7f3d340a5900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d40006010 tx=0x7f3d40000bc0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:47.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.743+0000 7f3d497fa640 1 -- 172.21.15.45:0/3335301049 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d3c014030 con 0x7f3d4c102d50 2024-09-15T22:16:47.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.957+0000 7f3d528aa640 1 -- 172.21.15.45:0/3335301049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d4c103130 con 0x7f3d4c102d50 2024-09-15T22:16:47.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.958+0000 7f3d497fa640 1 -- 172.21.15.45:0/3335301049 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f3d3c09c890 con 0x7f3d4c102d50 2024-09-15T22:16:47.960 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:47.961 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:16:47.961 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:16:47.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.960+0000 7f3d528aa640 1 -- 172.21.15.45:0/3335301049 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3d340a3440 msgr2=0x7f3d340a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:47.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.960+0000 7f3d528aa640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3d340a3440 0x7f3d340a5900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d40006010 tx=0x7f3d40000bc0 comp rx=0 tx=0).stop 2024-09-15T22:16:47.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.960+0000 7f3d528aa640 1 -- 172.21.15.45:0/3335301049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d4c102d50 msgr2=0x7f3d4c1a0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:47.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.960+0000 7f3d528aa640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d4c102d50 0x7f3d4c1a0500 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00c890 tx=0x7f3d3c00cd50 comp rx=0 tx=0).stop 2024-09-15T22:16:47.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.960+0000 7f3d528aa640 1 -- 172.21.15.45:0/3335301049 shutdown_connections 2024-09-15T22:16:47.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.960+0000 7f3d528aa640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3d340a3440 0x7f3d340a5900 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:47.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.960+0000 7f3d528aa640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d4c10c180 0x7f3d4c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:47.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.960+0000 7f3d528aa640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d4c103670 0x7f3d4c1a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:47.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.960+0000 7f3d528aa640 1 --2- 172.21.15.45:0/3335301049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d4c102d50 0x7f3d4c1a0500 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:47.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.960+0000 7f3d528aa640 1 -- 172.21.15.45:0/3335301049 >> 172.21.15.45:0/3335301049 conn(0x7f3d4c0fc7d0 msgr2=0x7f3d4c10d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:47.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.960+0000 7f3d528aa640 1 -- 172.21.15.45:0/3335301049 shutdown_connections 2024-09-15T22:16:47.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:47.960+0000 7f3d528aa640 1 -- 172.21.15.45:0/3335301049 wait complete. 2024-09-15T22:16:48.136 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:16:48.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:48 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:16:48.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:48 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:48.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:48 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:16:48.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:48 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:48.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:48 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:16:48.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:48 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3335301049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:48.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:48 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:16:48.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:48 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:48.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:48 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:16:48.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:48 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:48.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:48 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:16:48.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:48 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3335301049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:48.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:48 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:16:48.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:48 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:48.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:48 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:16:48.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:48 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:48.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:48 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:16:48.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:48 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3335301049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:48.775 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T22:14:07.480609+0000', 'modified': '2024-09-15T22:14:45.759794+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.165:6839/2278031843', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.165:6838', 'nonce': 2278031843}, {'type': 'v1', 'addr': '172.21.15.165:6839', 'nonce': 2278031843}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24476': {'gid': 24476, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6839/1428203088', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 1428203088}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 1428203088}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24476, 'qdb_cluster': [24476]} 2024-09-15T22:16:48.775 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:16:48.775 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-15T22:16:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:49.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:49 smithi045 ceph-mon[31180]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:16:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.400+0000 7fe1bebcc640 1 -- 172.21.15.45:0/2364811832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b81027a0 msgr2=0x7fe1b81067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.400+0000 7fe1bebcc640 1 --2- 172.21.15.45:0/2364811832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b81027a0 0x7fe1b81067f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009ca0 tx=0x7fe1a802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.400+0000 7fe1bebcc640 1 -- 172.21.15.45:0/2364811832 shutdown_connections 2024-09-15T22:16:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.400+0000 7fe1bebcc640 1 --2- 172.21.15.45:0/2364811832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b8106f20 0x7fe1b810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.400+0000 7fe1bebcc640 1 --2- 172.21.15.45:0/2364811832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b81027a0 0x7fe1b81067f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.400+0000 7fe1bebcc640 1 --2- 172.21.15.45:0/2364811832 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1b8101df0 0x7fe1b81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.400+0000 7fe1bebcc640 1 -- 172.21.15.45:0/2364811832 >> 172.21.15.45:0/2364811832 conn(0x7fe1b80fd8f0 msgr2=0x7fe1b80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.400+0000 7fe1bebcc640 1 -- 172.21.15.45:0/2364811832 shutdown_connections 2024-09-15T22:16:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.400+0000 7fe1bebcc640 1 -- 172.21.15.45:0/2364811832 wait complete. 2024-09-15T22:16:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.400+0000 7fe1bebcc640 1 Processor -- start 2024-09-15T22:16:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1bebcc640 1 -- start start 2024-09-15T22:16:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1bebcc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b8101df0 0x7fe1b81a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1bebcc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b81027a0 0x7fe1b81a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1bebcc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1b8106f20 0x7fe1b819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1bebcc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b81120a0 con 0x7fe1b81027a0 2024-09-15T22:16:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1bebcc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b8111f20 con 0x7fe1b8101df0 2024-09-15T22:16:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b81027a0 0x7fe1b81a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1bebcc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b8112220 con 0x7fe1b8106f20 2024-09-15T22:16:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b81027a0 0x7fe1b81a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48608/0 (socket says 172.21.15.45:48608) 2024-09-15T22:16:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1b7fff640 1 -- 172.21.15.45:0/2061046431 learned_addr learned my addr 172.21.15.45:0/2061046431 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1bd169640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1b8106f20 0x7fe1b819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1bc968640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b8101df0 0x7fe1b81a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1b7fff640 1 -- 172.21.15.45:0/2061046431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1b8106f20 msgr2=0x7fe1b819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.401+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1b8106f20 0x7fe1b819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.402+0000 7fe1b7fff640 1 -- 172.21.15.45:0/2061046431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b8101df0 msgr2=0x7fe1b81a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.402+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b8101df0 0x7fe1b81a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.402+0000 7fe1b7fff640 1 -- 172.21.15.45:0/2061046431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b819acd0 con 0x7fe1b81027a0 2024-09-15T22:16:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.402+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b81027a0 0x7fe1b81a0920 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe1a802ade0 tx=0x7fe1a80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.402+0000 7fe1b5ffb640 1 -- 172.21.15.45:0/2061046431 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8003b70 con 0x7fe1b81027a0 2024-09-15T22:16:49.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.402+0000 7fe1b5ffb640 1 -- 172.21.15.45:0/2061046431 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe1a8003d10 con 0x7fe1b81027a0 2024-09-15T22:16:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.402+0000 7fe1bebcc640 1 -- 172.21.15.45:0/2061046431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1b819af60 con 0x7fe1b81027a0 2024-09-15T22:16:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.402+0000 7fe1b5ffb640 1 -- 172.21.15.45:0/2061046431 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a802fd10 con 0x7fe1b81027a0 2024-09-15T22:16:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.402+0000 7fe1bebcc640 1 -- 172.21.15.45:0/2061046431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1b81a72b0 con 0x7fe1b81027a0 2024-09-15T22:16:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.405+0000 7fe1b5ffb640 1 -- 172.21.15.45:0/2061046431 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fe1a8004050 con 0x7fe1b81027a0 2024-09-15T22:16:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.405+0000 7fe1c0fa5740 1 Processor -- start 2024-09-15T22:16:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.405+0000 7fe1c0fa5740 1 -- start start 2024-09-15T22:16:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.405+0000 7fe1c0fa5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed764a0 0x55620ed76880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1c0fa5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed76dc0 0x55620ed81140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1c0fa5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed81680 0x55620ed83a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1c0fa5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55620ecdc2e0 con 0x55620ed81680 2024-09-15T22:16:49.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1c0fa5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55620ec83ce0 con 0x55620ed764a0 2024-09-15T22:16:49.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1c0fa5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55620ecd82a0 con 0x55620ed76dc0 2024-09-15T22:16:49.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed81680 0x55620ed83a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1bd169640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed764a0 0x55620ed76880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed81680 0x55620ed83a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48614/0 (socket says 172.21.15.45:48614) 2024-09-15T22:16:49.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1b7fff640 1 -- 172.21.15.45:0/564691408 learned_addr learned my addr 172.21.15.45:0/564691408 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:49.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1b5ffb640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe1a40a3440 0x7fe1a40a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1bc968640 1 --2- 172.21.15.45:0/564691408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed76dc0 0x55620ed81140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1bd169640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe1a40a3440 0x7fe1a40a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1b5ffb640 1 -- 172.21.15.45:0/2061046431 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fe1a80f1430 con 0x7fe1b81027a0 2024-09-15T22:16:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1b7fff640 1 -- 172.21.15.45:0/564691408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed76dc0 msgr2=0x55620ed81140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/564691408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed76dc0 0x55620ed81140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1b7fff640 1 -- 172.21.15.45:0/564691408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed764a0 msgr2=0x55620ed76880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/564691408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed764a0 0x55620ed76880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1b7fff640 1 -- 172.21.15.45:0/564691408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55620ec68440 con 0x55620ed81680 2024-09-15T22:16:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1bd169640 1 --2- 172.21.15.45:0/564691408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed764a0 0x55620ed76880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.406+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/564691408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed81680 0x55620ed83a70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80bd070 tx=0x7fe1a80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0e5a44a85aeb9f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.407+0000 7fe1aeffd640 1 -- 172.21.15.45:0/564691408 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a80bd140 con 0x55620ed81680 2024-09-15T22:16:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.407+0000 7fe1aeffd640 1 -- 172.21.15.45:0/564691408 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe1a8036070 con 0x55620ed81680 2024-09-15T22:16:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.407+0000 7fe1bd169640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe1a40a3440 0x7fe1a40a5900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b610 tx=0x7fe1b0004730 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.407+0000 7fe1aeffd640 1 -- 172.21.15.45:0/564691408 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a80bccd0 con 0x55620ed81680 2024-09-15T22:16:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.407+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/564691408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed81680 msgr2=0x55620ed83a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.407+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/564691408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed81680 0x55620ed83a70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80bd070 tx=0x7fe1a80095c0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.407+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/564691408 shutdown_connections 2024-09-15T22:16:49.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.407+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/564691408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed81680 0x55620ed83a70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.407+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/564691408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed76dc0 0x55620ed81140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.407+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/564691408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed764a0 0x55620ed76880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.407+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/564691408 >> 172.21.15.45:0/564691408 conn(0x55620ed72a30 msgr2=0x55620ed72e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.407+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/564691408 shutdown_connections 2024-09-15T22:16:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.407+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/564691408 wait complete. 2024-09-15T22:16:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.408+0000 7fe1c0fa5740 1 -- start start 2024-09-15T22:16:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.408+0000 7fe1c0fa5740 1 Processor -- start 2024-09-15T22:16:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.408+0000 7fe1c0fa5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed764a0 0x55620ed80fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.408+0000 7fe1c0fa5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed76dc0 0x55620ed7e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.408+0000 7fe1c0fa5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed81680 0x55620ed7e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.408+0000 7fe1c0fa5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55620ecdc2e0 con 0x55620ed764a0 2024-09-15T22:16:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.408+0000 7fe1c0fa5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55620ec97050 con 0x55620ed76dc0 2024-09-15T22:16:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.408+0000 7fe1c0fa5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55620ed84010 con 0x55620ed81680 2024-09-15T22:16:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.408+0000 7fe1c0fa5740 10 client.0 _ll_register_callbacks cb 0x55620ecd7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed76dc0 0x55620ed7e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe1bd169640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed81680 0x55620ed7e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe1bc968640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed764a0 0x55620ed80fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed76dc0 0x55620ed7e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:57554/0 (socket says 172.21.15.45:57554) 2024-09-15T22:16:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe1b7fff640 1 -- 172.21.15.45:0/220923970 learned_addr learned my addr 172.21.15.45:0/220923970 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe1b7fff640 1 -- 172.21.15.45:0/220923970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed81680 msgr2=0x55620ed7e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/220923970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed81680 0x55620ed7e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe1b7fff640 1 -- 172.21.15.45:0/220923970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed764a0 msgr2=0x55620ed80fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/220923970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed764a0 0x55620ed80fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe1b7fff640 1 -- 172.21.15.45:0/220923970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55620ea4d3c0 con 0x55620ed76dc0 2024-09-15T22:16:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/220923970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed76dc0 0x55620ed7e290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80c5a20 tx=0x7fe1a80c1720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5df5711e41d6b54b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe197fff640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-15T22:16:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe197fff640 1 -- 172.21.15.45:0/220923970 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a80bceb0 con 0x55620ed76dc0 2024-09-15T22:16:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/220923970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1a8036070 con 0x55620ed76dc0 2024-09-15T22:16:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.409+0000 7fe197fff640 1 -- 172.21.15.45:0/220923970 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fe1a8004550 con 0x55620ed76dc0 2024-09-15T22:16:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.410+0000 7fe197fff640 1 -- 172.21.15.45:0/220923970 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe1a80bccd0 con 0x55620ed76dc0 2024-09-15T22:16:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.410+0000 7fe1c0fa5740 10 client.25202 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.410+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/220923970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55620ed8f7d0 con 0x55620ed76dc0 2024-09-15T22:16:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.410+0000 7fe197fff640 1 -- 172.21.15.45:0/220923970 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe1a8036070 con 0x55620ed76dc0 2024-09-15T22:16:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.410+0000 7fe197fff640 1 -- 172.21.15.45:0/220923970 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe1a80dd0c0 con 0x55620ed76dc0 2024-09-15T22:16:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.410+0000 7fe1c0fa5740 10 client.25202 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.410+0000 7fe1c0fa5740 10 client.25202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.410+0000 7fe1c0fa5740 20 client.25202 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.410+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/220923970 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55620ed90a60 0x55620ed92e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.410+0000 7fe1c0fa5740 4 client.25202 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:49.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.410+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/220923970 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55620ece9850 con 0x55620ed90a60 2024-09-15T22:16:49.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.411+0000 7fe1bc968640 1 --2- 172.21.15.45:0/220923970 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55620ed90a60 0x55620ed92e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.411+0000 7fe1bc968640 1 --2- 172.21.15.45:0/220923970 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55620ed90a60 0x55620ed92e50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c347c3c42bfa00b server_cookie=3b6669ed93d02907 in_seq=0 out_seq=0 2024-09-15T22:16:49.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.411+0000 7fe197fff640 10 client.25202 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe197fff640 1 -- 172.21.15.45:0/220923970 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55620ece9850 con 0x55620ed90a60 2024-09-15T22:16:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe197fff640 10 client.25202 handle_command_reply: tid=0 2024-09-15T22:16:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe1c0fa5740 1 client.25202 shutdown 2024-09-15T22:16:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/220923970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed76dc0 msgr2=0x55620ed7e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/220923970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed76dc0 0x55620ed7e290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80c5a20 tx=0x7fe1a80c1720 comp rx=0 tx=0).stop 2024-09-15T22:16:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/220923970 shutdown_connections 2024-09-15T22:16:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/220923970 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55620ed90a60 0x55620ed92e50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/220923970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed81680 0x55620ed7e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/220923970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed76dc0 0x55620ed7e290 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/220923970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed764a0 0x55620ed80fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/220923970 >> 172.21.15.45:0/220923970 conn(0x55620ed72a30 msgr2=0x55620ed78710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:49.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe197fff640 0 client.25202 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:49.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/220923970 shutdown_connections 2024-09-15T22:16:49.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/220923970 wait complete. 2024-09-15T22:16:49.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.412+0000 7fe1c0fa5740 20 client.25202 trim_cache size 0 max 16384 2024-09-15T22:16:49.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.430+0000 7fe1c0fa5740 1 Processor -- start 2024-09-15T22:16:49.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.430+0000 7fe1c0fa5740 1 -- start start 2024-09-15T22:16:49.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1c0fa5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed764a0 0x55620ed8d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1c0fa5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed76dc0 0x55620ed98760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1c0fa5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed81680 0x55620ed98ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1c0fa5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b81af100 con 0x55620ed764a0 2024-09-15T22:16:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1c0fa5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b81b1980 con 0x55620ed81680 2024-09-15T22:16:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1c0fa5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b81af770 con 0x55620ed76dc0 2024-09-15T22:16:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1bc968640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed764a0 0x55620ed8d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1bc968640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed764a0 0x55620ed8d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48622/0 (socket says 172.21.15.45:48622) 2024-09-15T22:16:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1bc968640 1 -- 172.21.15.45:0/45623748 learned_addr learned my addr 172.21.15.45:0/45623748 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/45623748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed76dc0 0x55620ed98760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1bc968640 1 -- 172.21.15.45:0/45623748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed76dc0 msgr2=0x55620ed98760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1bc968640 1 --2- 172.21.15.45:0/45623748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed76dc0 0x55620ed98760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1bc968640 1 -- 172.21.15.45:0/45623748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed81680 msgr2=0x55620ed98ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1bc968640 1 --2- 172.21.15.45:0/45623748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed81680 0x55620ed98ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.431+0000 7fe1bc968640 1 -- 172.21.15.45:0/45623748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55620ed76bf0 con 0x55620ed764a0 2024-09-15T22:16:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.432+0000 7fe1bc968640 1 --2- 172.21.15.45:0/45623748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed764a0 0x55620ed8d060 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000a690 tx=0x7fe1a000a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6d239366c27993 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:49.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.432+0000 7fe1ae7fc640 1 -- 172.21.15.45:0/45623748 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0004220 con 0x55620ed764a0 2024-09-15T22:16:49.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.432+0000 7fe1ae7fc640 1 -- 172.21.15.45:0/45623748 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe1a00043c0 con 0x55620ed764a0 2024-09-15T22:16:49.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.432+0000 7fe1ae7fc640 1 -- 172.21.15.45:0/45623748 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a001eaa0 con 0x55620ed764a0 2024-09-15T22:16:49.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.433+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/45623748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed764a0 msgr2=0x55620ed8d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:49.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.433+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/45623748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed764a0 0x55620ed8d060 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000a690 tx=0x7fe1a000a250 comp rx=0 tx=0).stop 2024-09-15T22:16:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.433+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/45623748 shutdown_connections 2024-09-15T22:16:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.433+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/45623748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed81680 0x55620ed98ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.433+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/45623748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed76dc0 0x55620ed98760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.433+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/45623748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed764a0 0x55620ed8d060 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.433+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/45623748 >> 172.21.15.45:0/45623748 conn(0x55620ed72a30 msgr2=0x55620ed7cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.433+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/45623748 shutdown_connections 2024-09-15T22:16:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.433+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/45623748 wait complete. 2024-09-15T22:16:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.433+0000 7fe1c0fa5740 1 -- start start 2024-09-15T22:16:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.433+0000 7fe1c0fa5740 1 Processor -- start 2024-09-15T22:16:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.434+0000 7fe1c0fa5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed764a0 0x55620ed894e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.434+0000 7fe1c0fa5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed76dc0 0x55620ed89a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.434+0000 7fe1c0fa5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed81680 0x55620ed848f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.434+0000 7fe1c0fa5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b81afe40 con 0x55620ed76dc0 2024-09-15T22:16:49.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.434+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed76dc0 0x55620ed89a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.434+0000 7fe1b7fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed76dc0 0x55620ed89a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48632/0 (socket says 172.21.15.45:48632) 2024-09-15T22:16:49.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.434+0000 7fe1b7fff640 1 -- 172.21.15.45:0/2735149141 learned_addr learned my addr 172.21.15.45:0/2735149141 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:49.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.434+0000 7fe1bc968640 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed764a0 0x55620ed894e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.434+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/2735149141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b81b12b0 con 0x55620ed81680 2024-09-15T22:16:49.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.434+0000 7fe1bd169640 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed81680 0x55620ed848f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.434+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/2735149141 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe1b81b0510 con 0x55620ed764a0 2024-09-15T22:16:49.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe1c0fa5740 10 client.0 _ll_register_callbacks cb 0x7fe1b0004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:49.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe1b7fff640 1 -- 172.21.15.45:0/2735149141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed764a0 msgr2=0x55620ed894e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:49.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed764a0 0x55620ed894e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe1b7fff640 1 -- 172.21.15.45:0/2735149141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed81680 msgr2=0x55620ed848f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:49.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed81680 0x55620ed848f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe1b7fff640 1 -- 172.21.15.45:0/2735149141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55620ed85120 con 0x55620ed76dc0 2024-09-15T22:16:49.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe1bd169640 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed81680 0x55620ed848f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:49.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe1b7fff640 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed76dc0 0x55620ed89a20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80b97d0 tx=0x7fe1a8031ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75beb2c09ed4e95 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:49.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe197fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:49.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe197fff640 1 -- 172.21.15.45:0/2735149141 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a80bd140 con 0x55620ed76dc0 2024-09-15T22:16:49.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe197fff640 1 -- 172.21.15.45:0/2735149141 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fe1a8004d40 con 0x55620ed76dc0 2024-09-15T22:16:49.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/2735149141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1a00043c0 con 0x55620ed76dc0 2024-09-15T22:16:49.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe197fff640 1 -- 172.21.15.45:0/2735149141 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe1a80bceb0 con 0x55620ed76dc0 2024-09-15T22:16:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe1c0fa5740 10 client.15513 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.435+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/2735149141 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55620ed85120 con 0x55620ed76dc0 2024-09-15T22:16:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.436+0000 7fe197fff640 1 -- 172.21.15.45:0/2735149141 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe1a00043c0 con 0x55620ed76dc0 2024-09-15T22:16:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.436+0000 7fe197fff640 1 -- 172.21.15.45:0/2735149141 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe1a80bc7c0 con 0x55620ed76dc0 2024-09-15T22:16:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.436+0000 7fe1c0fa5740 10 client.15513 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.436+0000 7fe1c0fa5740 10 client.15513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.436+0000 7fe1c0fa5740 20 client.15513 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.436+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55620edfb5c0 0x55620edfd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.436+0000 7fe1c0fa5740 4 client.15513 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:16:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.436+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/2735149141 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55620ece3d60 con 0x55620edfb5c0 2024-09-15T22:16:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.436+0000 7fe1bc968640 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55620edfb5c0 0x55620edfd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:49.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe1bc968640 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55620edfb5c0 0x55620edfd9b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f29b29ad07315dff server_cookie=afb76ba7271e54b4 in_seq=0 out_seq=0 2024-09-15T22:16:49.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe197fff640 10 client.15513 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:49.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe197fff640 1 -- 172.21.15.45:0/2735149141 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55620ece3d60 con 0x55620edfb5c0 2024-09-15T22:16:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe197fff640 10 client.15513 handle_command_reply: tid=0 2024-09-15T22:16:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe1c0fa5740 1 client.15513 shutdown 2024-09-15T22:16:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/2735149141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed76dc0 msgr2=0x55620ed89a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed76dc0 0x55620ed89a20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80b97d0 tx=0x7fe1a8031ae0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/2735149141 shutdown_connections 2024-09-15T22:16:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55620edfb5c0 0x55620edfd9b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55620ed81680 0x55620ed848f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55620ed76dc0 0x55620ed89a20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe197fff640 0 client.15513 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe1c0fa5740 1 --2- 172.21.15.45:0/2735149141 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55620ed764a0 0x55620ed894e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/2735149141 >> 172.21.15.45:0/2735149141 conn(0x55620ed72a30 msgr2=0x55620ed80310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/2735149141 shutdown_connections 2024-09-15T22:16:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe1c0fa5740 1 -- 172.21.15.45:0/2735149141 wait complete. 2024-09-15T22:16:49.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.437+0000 7fe1c0fa5740 20 client.15513 trim_cache size 0 max 16384 2024-09-15T22:16:49.445 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:16:49.445 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:16:49.445 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:16:49.445 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:16:49.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.438+0000 7fe1bebcc640 1 -- 172.21.15.45:0/2061046431 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe1a40a3440 msgr2=0x7fe1a40a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:49.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.438+0000 7fe1bebcc640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe1a40a3440 0x7fe1a40a5900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000b610 tx=0x7fe1b0004730 comp rx=0 tx=0).stop 2024-09-15T22:16:49.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.438+0000 7fe1bebcc640 1 -- 172.21.15.45:0/2061046431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b81027a0 msgr2=0x7fe1b81a0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:49.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.438+0000 7fe1bebcc640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b81027a0 0x7fe1b81a0920 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fe1a802ade0 tx=0x7fe1a80319f0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.438+0000 7fe1bebcc640 1 -- 172.21.15.45:0/2061046431 shutdown_connections 2024-09-15T22:16:49.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.438+0000 7fe1bebcc640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe1a40a3440 0x7fe1a40a5900 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.438+0000 7fe1bebcc640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe1b8106f20 0x7fe1b819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.438+0000 7fe1bebcc640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1b81027a0 0x7fe1b81a0920 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.438+0000 7fe1bebcc640 1 --2- 172.21.15.45:0/2061046431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1b8101df0 0x7fe1b81a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:49.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.438+0000 7fe1bebcc640 1 -- 172.21.15.45:0/2061046431 >> 172.21.15.45:0/2061046431 conn(0x7fe1b80fd8f0 msgr2=0x7fe1b80fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:49.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.438+0000 7fe1bebcc640 1 -- 172.21.15.45:0/2061046431 shutdown_connections 2024-09-15T22:16:49.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:49.438+0000 7fe1bebcc640 1 -- 172.21.15.45:0/2061046431 wait complete. 2024-09-15T22:16:49.451 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:49.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:49 smithi165 ceph-mon[35551]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:16:49.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:49 smithi100 ceph-mon[35319]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:16:50.262 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:16:50.263 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:16:50.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.717+0000 7f7189227640 1 -- 172.21.15.45:0/3676592006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7184106a80 msgr2=0x7f7184106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:50.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.717+0000 7f7189227640 1 --2- 172.21.15.45:0/3676592006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7184106a80 0x7f7184106e60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7174009930 tx=0x7f717402a420 comp rx=0 tx=0).stop 2024-09-15T22:16:50.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.717+0000 7f7189227640 1 -- 172.21.15.45:0/3676592006 shutdown_connections 2024-09-15T22:16:50.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.717+0000 7f7189227640 1 --2- 172.21.15.45:0/3676592006 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7184101420 0x7f718410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.717+0000 7f7189227640 1 --2- 172.21.15.45:0/3676592006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7184100a80 0x7f7184100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.717+0000 7f7189227640 1 --2- 172.21.15.45:0/3676592006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7184106a80 0x7f7184106e60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.717+0000 7f7189227640 1 -- 172.21.15.45:0/3676592006 >> 172.21.15.45:0/3676592006 conn(0x7f71840fc7a0 msgr2=0x7f71840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:50.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.717+0000 7f7189227640 1 -- 172.21.15.45:0/3676592006 shutdown_connections 2024-09-15T22:16:50.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.717+0000 7f7189227640 1 -- 172.21.15.45:0/3676592006 wait complete. 2024-09-15T22:16:50.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.718+0000 7f7189227640 1 Processor -- start 2024-09-15T22:16:50.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.718+0000 7f7189227640 1 -- start start 2024-09-15T22:16:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.718+0000 7f7189227640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7184100a80 0x7f7184199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.718+0000 7f7189227640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7184101420 0x7f7184199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.718+0000 7f7189227640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7184106a80 0x7f71841a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.718+0000 7f7189227640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7184110fa0 con 0x7f7184100a80 2024-09-15T22:16:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.718+0000 7f7189227640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7184110e20 con 0x7f7184101420 2024-09-15T22:16:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.718+0000 7f7189227640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7184111120 con 0x7f7184106a80 2024-09-15T22:16:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.718+0000 7f7182d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7184100a80 0x7f7184199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.718+0000 7f7182d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7184100a80 0x7f7184199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48646/0 (socket says 172.21.15.45:48646) 2024-09-15T22:16:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.718+0000 7f7182d9d640 1 -- 172.21.15.45:0/2722678280 learned_addr learned my addr 172.21.15.45:0/2722678280 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.718+0000 7f718359e640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7184106a80 0x7f71841a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.719+0000 7f718259c640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7184101420 0x7f7184199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.719+0000 7f7182d9d640 1 -- 172.21.15.45:0/2722678280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7184106a80 msgr2=0x7f71841a43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:50.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.719+0000 7f7182d9d640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7184106a80 0x7f71841a43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.719+0000 7f7182d9d640 1 -- 172.21.15.45:0/2722678280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7184101420 msgr2=0x7f7184199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.719+0000 7f7182d9d640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7184101420 0x7f7184199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.719+0000 7f7182d9d640 1 -- 172.21.15.45:0/2722678280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71841a48f0 con 0x7f7184100a80 2024-09-15T22:16:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.719+0000 7f7182d9d640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7184100a80 0x7f7184199330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7174009230 tx=0x7f7174004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.719+0000 7f716bfff640 1 -- 172.21.15.45:0/2722678280 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717403f030 con 0x7f7184100a80 2024-09-15T22:16:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.719+0000 7f7189227640 1 -- 172.21.15.45:0/2722678280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71841a4ac0 con 0x7f7184100a80 2024-09-15T22:16:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.719+0000 7f716bfff640 1 -- 172.21.15.45:0/2722678280 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7174003af0 con 0x7f7184100a80 2024-09-15T22:16:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.719+0000 7f716bfff640 1 -- 172.21.15.45:0/2722678280 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7174035070 con 0x7f7184100a80 2024-09-15T22:16:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.719+0000 7f7189227640 1 -- 172.21.15.45:0/2722678280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71841a4f50 con 0x7f7184100a80 2024-09-15T22:16:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.722+0000 7f716bfff640 1 -- 172.21.15.45:0/2722678280 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f7174042030 con 0x7f7184100a80 2024-09-15T22:16:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.722+0000 7f718b600740 1 Processor -- start 2024-09-15T22:16:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.722+0000 7f718b600740 1 -- start start 2024-09-15T22:16:50.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.722+0000 7f718b600740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbccb9d0 0x55a8bbccbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.722+0000 7f718b600740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccc2f0 0x55a8bbcd6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.722+0000 7f718b600740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.722+0000 7f718b600740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a8bbc32090 con 0x55a8bbccb9d0 2024-09-15T22:16:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.722+0000 7f718b600740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a8bbbd9a70 con 0x55a8bbccc2f0 2024-09-15T22:16:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.722+0000 7f718b600740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a8bbc2e050 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f718359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbccb9d0 0x55a8bbccbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f718359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbccb9d0 0x55a8bbccbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48648/0 (socket says 172.21.15.45:48648) 2024-09-15T22:16:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f718359e640 1 -- 172.21.15.45:0/908591872 learned_addr learned my addr 172.21.15.45:0/908591872 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f7182d9d640 1 --2- 172.21.15.45:0/908591872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccc2f0 0x55a8bbcd6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f716bfff640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f716c0a3440 0x7f716c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f718259c640 1 --2- 172.21.15.45:0/908591872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f718359e640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f716c0a3440 0x7f716c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f716bfff640 1 -- 172.21.15.45:0/2722678280 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f71740f0940 con 0x7f7184100a80 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f7182d9d640 1 -- 172.21.15.45:0/908591872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbcd6bb0 msgr2=0x55a8bbcd8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f7182d9d640 1 --2- 172.21.15.45:0/908591872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f7182d9d640 1 -- 172.21.15.45:0/908591872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbccb9d0 msgr2=0x55a8bbccbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f7182d9d640 1 --2- 172.21.15.45:0/908591872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbccb9d0 0x55a8bbccbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f7182d9d640 1 -- 172.21.15.45:0/908591872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8bbbe6130 con 0x55a8bbccc2f0 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f7182d9d640 1 --2- 172.21.15.45:0/908591872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccc2f0 0x55a8bbcd6670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71740edc00 tx=0x7f7174009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=154a190a123bb261 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f718359e640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f716c0a3440 0x7f716c0a5900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f717c005f40 tx=0x7f717c004ab0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.723+0000 7f71697fa640 1 -- 172.21.15.45:0/908591872 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7174049030 con 0x55a8bbccc2f0 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.724+0000 7f71697fa640 1 -- 172.21.15.45:0/908591872 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f71740c5410 con 0x55a8bbccc2f0 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.724+0000 7f71697fa640 1 -- 172.21.15.45:0/908591872 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7174003ca0 con 0x55a8bbccc2f0 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.724+0000 7f718b600740 1 -- 172.21.15.45:0/908591872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccc2f0 msgr2=0x55a8bbcd6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.724+0000 7f718b600740 1 --2- 172.21.15.45:0/908591872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccc2f0 0x55a8bbcd6670 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71740edc00 tx=0x7f7174009260 comp rx=0 tx=0).stop 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.724+0000 7f718b600740 1 -- 172.21.15.45:0/908591872 shutdown_connections 2024-09-15T22:16:50.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.724+0000 7f718b600740 1 --2- 172.21.15.45:0/908591872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.724+0000 7f718b600740 1 --2- 172.21.15.45:0/908591872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccc2f0 0x55a8bbcd6670 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.724+0000 7f718b600740 1 --2- 172.21.15.45:0/908591872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbccb9d0 0x55a8bbccbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.724+0000 7f718b600740 1 -- 172.21.15.45:0/908591872 >> 172.21.15.45:0/908591872 conn(0x55a8bbcc7f60 msgr2=0x55a8bbcc8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.724+0000 7f718b600740 1 -- 172.21.15.45:0/908591872 shutdown_connections 2024-09-15T22:16:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.724+0000 7f718b600740 1 -- 172.21.15.45:0/908591872 wait complete. 2024-09-15T22:16:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718b600740 1 -- start start 2024-09-15T22:16:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718b600740 1 Processor -- start 2024-09-15T22:16:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718b600740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccb9d0 0x55a8bbcd63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718b600740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccc2f0 0x55a8bbcd3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718b600740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718b600740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a8bbcd9540 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718b600740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a8bbbecf20 con 0x55a8bbccc2f0 2024-09-15T22:16:50.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718b600740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a8bbcd96c0 con 0x55a8bbccb9d0 2024-09-15T22:16:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718b600740 10 client.0 _ll_register_callbacks cb 0x55a8bbbb6030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48658/0 (socket says 172.21.15.45:48658) 2024-09-15T22:16:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718359e640 1 -- 172.21.15.45:0/3549181573 learned_addr learned my addr 172.21.15.45:0/3549181573 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718259c640 1 --2- 172.21.15.45:0/3549181573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccc2f0 0x55a8bbcd3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f7182d9d640 1 --2- 172.21.15.45:0/3549181573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccb9d0 0x55a8bbcd63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718359e640 1 -- 172.21.15.45:0/3549181573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccb9d0 msgr2=0x55a8bbcd63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718359e640 1 --2- 172.21.15.45:0/3549181573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccb9d0 0x55a8bbcd63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718359e640 1 -- 172.21.15.45:0/3549181573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccc2f0 msgr2=0x55a8bbcd3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718359e640 1 --2- 172.21.15.45:0/3549181573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccc2f0 0x55a8bbcd3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.725+0000 7f718359e640 1 -- 172.21.15.45:0/3549181573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8bb9a32b0 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f718359e640 1 --2- 172.21.15.45:0/3549181573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd3c70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f717c014380 tx=0x7f717c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb603c7ae8c7fef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:50.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f7166ff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f7166ff5640 1 -- 172.21.15.45:0/3549181573 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c01a040 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f7166ff5640 1 -- 172.21.15.45:0/3549181573 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f717c013980 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f718b600740 1 -- 172.21.15.45:0/3549181573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71740c5410 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f7166ff5640 1 -- 172.21.15.45:0/3549181573 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f717c02f050 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f718b600740 10 client.15525 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f718b600740 1 -- 172.21.15.45:0/3549181573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a8bbce4dc0 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f7166ff5640 1 -- 172.21.15.45:0/3549181573 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f71740c5410 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f7166ff5640 1 -- 172.21.15.45:0/3549181573 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f717c020040 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f718b600740 10 client.15525 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f718b600740 10 client.15525 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:16:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f718b600740 20 client.15525 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f718b600740 1 --2- 172.21.15.45:0/3549181573 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a8bbce74b0 0x55a8bbce8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f718b600740 4 client.15525 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.726+0000 7f718b600740 1 -- 172.21.15.45:0/3549181573 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8bbc3f600 con 0x55a8bbce74b0 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.727+0000 7f7182d9d640 1 --2- 172.21.15.45:0/3549181573 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a8bbce74b0 0x55a8bbce8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.727+0000 7f7182d9d640 1 --2- 172.21.15.45:0/3549181573 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a8bbce74b0 0x55a8bbce8920 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb39e7564021f656 server_cookie=ad3de380bf530f2 in_seq=0 out_seq=0 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.727+0000 7f7166ff5640 10 client.15525 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f7166ff5640 1 -- 172.21.15.45:0/3549181573 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a8bbc3f600 con 0x55a8bbce74b0 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f7166ff5640 10 client.15525 handle_command_reply: tid=0 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f718b600740 1 client.15525 shutdown 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f718b600740 1 -- 172.21.15.45:0/3549181573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 msgr2=0x55a8bbcd3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f718b600740 1 --2- 172.21.15.45:0/3549181573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd3c70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f717c014380 tx=0x7f717c004a40 comp rx=0 tx=0).stop 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f718b600740 1 -- 172.21.15.45:0/3549181573 shutdown_connections 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f718b600740 1 --2- 172.21.15.45:0/3549181573 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a8bbce74b0 0x55a8bbce8920 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f7166ff5640 0 client.15525 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f718b600740 1 --2- 172.21.15.45:0/3549181573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd3c70 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f718b600740 1 --2- 172.21.15.45:0/3549181573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccc2f0 0x55a8bbcd3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f718b600740 1 --2- 172.21.15.45:0/3549181573 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccb9d0 0x55a8bbcd63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f718b600740 1 -- 172.21.15.45:0/3549181573 >> 172.21.15.45:0/3549181573 conn(0x55a8bbcc7f60 msgr2=0x55a8bbccdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:50.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f718b600740 1 -- 172.21.15.45:0/3549181573 shutdown_connections 2024-09-15T22:16:50.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f718b600740 1 -- 172.21.15.45:0/3549181573 wait complete. 2024-09-15T22:16:50.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.728+0000 7f718b600740 20 client.15525 trim_cache size 0 max 16384 2024-09-15T22:16:50.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.748+0000 7f718b600740 1 Processor -- start 2024-09-15T22:16:50.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.748+0000 7f718b600740 1 -- start start 2024-09-15T22:16:50.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718b600740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccb9d0 0x55a8bbce8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718b600740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccc2f0 0x55a8bbce2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718b600740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718b600740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a8bbce6c60 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718b600740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a8bbce7330 con 0x55a8bbccb9d0 2024-09-15T22:16:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718b600740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a8bbce7a00 con 0x55a8bbccc2f0 2024-09-15T22:16:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48666/0 (socket says 172.21.15.45:48666) 2024-09-15T22:16:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718359e640 1 -- 172.21.15.45:0/3615678065 learned_addr learned my addr 172.21.15.45:0/3615678065 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f7182d9d640 1 --2- 172.21.15.45:0/3615678065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccb9d0 0x55a8bbce8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718259c640 1 --2- 172.21.15.45:0/3615678065 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccc2f0 0x55a8bbce2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718359e640 1 -- 172.21.15.45:0/3615678065 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccc2f0 msgr2=0x55a8bbce2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718359e640 1 --2- 172.21.15.45:0/3615678065 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccc2f0 0x55a8bbce2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718359e640 1 -- 172.21.15.45:0/3615678065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccb9d0 msgr2=0x55a8bbce8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718359e640 1 --2- 172.21.15.45:0/3615678065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccb9d0 0x55a8bbce8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718359e640 1 -- 172.21.15.45:0/3615678065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8bbccc120 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.749+0000 7f718359e640 1 --2- 172.21.15.45:0/3615678065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd36f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f717c0044b0 tx=0x7f717c009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449d9c657c9872d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:50.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.750+0000 7f7168ff9640 1 -- 172.21.15.45:0/3615678065 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c01a070 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.750+0000 7f7168ff9640 1 -- 172.21.15.45:0/3615678065 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f717c037020 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.750+0000 7f7168ff9640 1 -- 172.21.15.45:0/3615678065 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c003d60 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.750+0000 7f718b600740 1 -- 172.21.15.45:0/3615678065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 msgr2=0x55a8bbcd36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:50.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.750+0000 7f718b600740 1 --2- 172.21.15.45:0/3615678065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd36f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f717c0044b0 tx=0x7f717c009f30 comp rx=0 tx=0).stop 2024-09-15T22:16:50.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.750+0000 7f718b600740 1 -- 172.21.15.45:0/3615678065 shutdown_connections 2024-09-15T22:16:50.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.750+0000 7f718b600740 1 --2- 172.21.15.45:0/3615678065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcd36f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.750+0000 7f718b600740 1 --2- 172.21.15.45:0/3615678065 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccc2f0 0x55a8bbce2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.750+0000 7f718b600740 1 --2- 172.21.15.45:0/3615678065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccb9d0 0x55a8bbce8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.751+0000 7f718b600740 1 -- 172.21.15.45:0/3615678065 >> 172.21.15.45:0/3615678065 conn(0x55a8bbcc7f60 msgr2=0x55a8bbcc2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:50.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.751+0000 7f718b600740 1 -- 172.21.15.45:0/3615678065 shutdown_connections 2024-09-15T22:16:50.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.751+0000 7f718b600740 1 -- 172.21.15.45:0/3615678065 wait complete. 2024-09-15T22:16:50.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.751+0000 7f718b600740 1 -- start start 2024-09-15T22:16:50.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.751+0000 7f718b600740 1 Processor -- start 2024-09-15T22:16:50.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.751+0000 7f718b600740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccb9d0 0x55a8bbcf0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.751+0000 7f718b600740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccc2f0 0x55a8bbcf12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.751+0000 7f718b600740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcea150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.751+0000 7f718b600740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a8bbce87a0 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.751+0000 7f718b600740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a8bbce80d0 con 0x55a8bbccb9d0 2024-09-15T22:16:50.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.751+0000 7f718b600740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a8bbce8e70 con 0x55a8bbccc2f0 2024-09-15T22:16:50.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.751+0000 7f718b600740 10 client.0 _ll_register_callbacks cb 0x7f717c014030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:50.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.751+0000 7f718359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f718359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcea150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48678/0 (socket says 172.21.15.45:48678) 2024-09-15T22:16:50.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f718359e640 1 -- 172.21.15.45:0/2031907688 learned_addr learned my addr 172.21.15.45:0/2031907688 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:50.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f718259c640 1 --2- 172.21.15.45:0/2031907688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccc2f0 0x55a8bbcf12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f7182d9d640 1 --2- 172.21.15.45:0/2031907688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccb9d0 0x55a8bbcf0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f718359e640 1 -- 172.21.15.45:0/2031907688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccc2f0 msgr2=0x55a8bbcf12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f718359e640 1 --2- 172.21.15.45:0/2031907688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccc2f0 0x55a8bbcf12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f718359e640 1 -- 172.21.15.45:0/2031907688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccb9d0 msgr2=0x55a8bbcf0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f718359e640 1 --2- 172.21.15.45:0/2031907688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccb9d0 0x55a8bbcf0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f718359e640 1 -- 172.21.15.45:0/2031907688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8bbcea980 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f718359e640 1 --2- 172.21.15.45:0/2031907688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcea150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f717c006010 tx=0x7f717c0048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc57abaa8e491d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f7166ff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f7166ff5640 1 -- 172.21.15.45:0/2031907688 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c01a030 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f7166ff5640 1 -- 172.21.15.45:0/2031907688 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f717c003970 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f718b600740 1 -- 172.21.15.45:0/2031907688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f717c037020 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f7166ff5640 1 -- 172.21.15.45:0/2031907688 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f717c04a050 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f718b600740 10 client.15531 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.752+0000 7f718b600740 1 -- 172.21.15.45:0/2031907688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a8bbcef2d0 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.753+0000 7f7166ff5640 1 -- 172.21.15.45:0/2031907688 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f717c037020 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.753+0000 7f7166ff5640 1 -- 172.21.15.45:0/2031907688 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f717c020040 con 0x55a8bbcd6bb0 2024-09-15T22:16:50.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.753+0000 7f718b600740 10 client.15531 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:50.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.753+0000 7f718b600740 10 client.15531 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T22:16:50.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.753+0000 7f718b600740 20 client.15531 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:50.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.753+0000 7f718b600740 1 --2- 172.21.15.45:0/2031907688 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a8bbce74b0 0x55a8bbd54aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:50.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.753+0000 7f718b600740 4 client.15531 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:16:50.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.753+0000 7f718b600740 1 -- 172.21.15.45:0/2031907688 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "status"}) -- 0x55a8bbc39b10 con 0x55a8bbce74b0 2024-09-15T22:16:50.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.753+0000 7f7182d9d640 1 --2- 172.21.15.45:0/2031907688 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a8bbce74b0 0x55a8bbd54aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:50.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f7182d9d640 1 --2- 172.21.15.45:0/2031907688 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a8bbce74b0 0x55a8bbd54aa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=546e39eccf8262b6 server_cookie=84067edb7ccd50eb in_seq=0 out_seq=0 2024-09-15T22:16:50.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f7166ff5640 10 client.15531 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:50.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f7166ff5640 1 -- 172.21.15.45:0/2031907688 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a8bbc39b10 con 0x55a8bbce74b0 2024-09-15T22:16:50.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f7166ff5640 10 client.15531 handle_command_reply: tid=0 2024-09-15T22:16:50.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f718b600740 1 client.15531 shutdown 2024-09-15T22:16:50.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f718b600740 1 -- 172.21.15.45:0/2031907688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 msgr2=0x55a8bbcea150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:50.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f718b600740 1 --2- 172.21.15.45:0/2031907688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcea150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f717c006010 tx=0x7f717c0048d0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f718b600740 1 -- 172.21.15.45:0/2031907688 shutdown_connections 2024-09-15T22:16:50.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f718b600740 1 --2- 172.21.15.45:0/2031907688 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a8bbce74b0 0x55a8bbd54aa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f718b600740 1 --2- 172.21.15.45:0/2031907688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a8bbcd6bb0 0x55a8bbcea150 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f718b600740 1 --2- 172.21.15.45:0/2031907688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a8bbccc2f0 0x55a8bbcf12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f718b600740 1 --2- 172.21.15.45:0/2031907688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a8bbccb9d0 0x55a8bbcf0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f718b600740 1 -- 172.21.15.45:0/2031907688 >> 172.21.15.45:0/2031907688 conn(0x55a8bbcc7f60 msgr2=0x55a8bbcd36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:50.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f7166ff5640 0 client.15531 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:50.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f718b600740 1 -- 172.21.15.45:0/2031907688 shutdown_connections 2024-09-15T22:16:50.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f718b600740 1 -- 172.21.15.45:0/2031907688 wait complete. 2024-09-15T22:16:50.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.754+0000 7f718b600740 20 client.15531 trim_cache size 0 max 16384 2024-09-15T22:16:50.762 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:16:50.762 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "a1911414-73ae-11ef-bceb-c7b262605968", 2024-09-15T22:16:50.762 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2024-09-15T22:16:50.762 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 24476, 2024-09-15T22:16:50.762 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-09-15T22:16:50.762 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-09-15T22:16:50.762 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-09-15T22:16:50.762 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 162.94861963299999, 2024-09-15T22:16:50.762 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 21, 2024-09-15T22:16:50.762 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 90, 2024-09-15T22:16:50.762 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 90, 2024-09-15T22:16:50.763 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 173.51467870299999 2024-09-15T22:16:50.763 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:16:50.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.755+0000 7f7189227640 1 -- 172.21.15.45:0/2722678280 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f716c0a3440 msgr2=0x7f716c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:50.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.755+0000 7f7189227640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f716c0a3440 0x7f716c0a5900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f717c005f40 tx=0x7f717c004ab0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.755+0000 7f7189227640 1 -- 172.21.15.45:0/2722678280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7184100a80 msgr2=0x7f7184199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:50.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.755+0000 7f7189227640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7184100a80 0x7f7184199330 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7174009230 tx=0x7f7174004270 comp rx=0 tx=0).stop 2024-09-15T22:16:50.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.755+0000 7f7189227640 1 -- 172.21.15.45:0/2722678280 shutdown_connections 2024-09-15T22:16:50.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.755+0000 7f7189227640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f716c0a3440 0x7f716c0a5900 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.755+0000 7f7189227640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7184106a80 0x7f71841a43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.755+0000 7f7189227640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7184101420 0x7f7184199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.755+0000 7f7189227640 1 --2- 172.21.15.45:0/2722678280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7184100a80 0x7f7184199330 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:50.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.755+0000 7f7189227640 1 -- 172.21.15.45:0/2722678280 >> 172.21.15.45:0/2722678280 conn(0x7f71840fc7a0 msgr2=0x7f71840fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:50.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.755+0000 7f7189227640 1 -- 172.21.15.45:0/2722678280 shutdown_connections 2024-09-15T22:16:50.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:50.755+0000 7f7189227640 1 -- 172.21.15.45:0/2722678280 wait complete. 2024-09-15T22:16:51.007 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:51.501 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:51 smithi045 ceph-mon[31180]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-15T22:16:51.529 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-15T22:16:51.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:51 smithi165 ceph-mon[35551]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-15T22:16:51.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:51 smithi100 ceph-mon[35319]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-15T22:16:52.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.044+0000 7f6ba76f8640 1 -- 172.21.15.45:0/3127375356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba01036c0 msgr2=0x7f6ba010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:52.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.044+0000 7f6ba76f8640 1 --2- 172.21.15.45:0/3127375356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba01036c0 0x7f6ba010bbb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009900 tx=0x7f6b9002a480 comp rx=0 tx=0).stop 2024-09-15T22:16:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.044+0000 7f6ba76f8640 1 -- 172.21.15.45:0/3127375356 shutdown_connections 2024-09-15T22:16:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.044+0000 7f6ba76f8640 1 --2- 172.21.15.45:0/3127375356 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ba010c180 0x7f6ba010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.044+0000 7f6ba76f8640 1 --2- 172.21.15.45:0/3127375356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba01036c0 0x7f6ba010bbb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.044+0000 7f6ba76f8640 1 --2- 172.21.15.45:0/3127375356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba0102da0 0x7f6ba0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.044+0000 7f6ba76f8640 1 -- 172.21.15.45:0/3127375356 >> 172.21.15.45:0/3127375356 conn(0x7f6ba00fc7a0 msgr2=0x7f6ba00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.044+0000 7f6ba76f8640 1 -- 172.21.15.45:0/3127375356 shutdown_connections 2024-09-15T22:16:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.044+0000 7f6ba76f8640 1 -- 172.21.15.45:0/3127375356 wait complete. 2024-09-15T22:16:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.045+0000 7f6ba76f8640 1 Processor -- start 2024-09-15T22:16:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.045+0000 7f6ba76f8640 1 -- start start 2024-09-15T22:16:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.045+0000 7f6ba76f8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ba0102da0 0x7f6ba0100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:52.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.045+0000 7f6ba76f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba01036c0 0x7f6ba0100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.045+0000 7f6ba76f8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba010c180 0x7f6ba0101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.045+0000 7f6ba76f8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba0112080 con 0x7f6ba010c180 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.045+0000 7f6ba76f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba0111f00 con 0x7f6ba01036c0 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.045+0000 7f6ba76f8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba0112200 con 0x7f6ba0102da0 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.045+0000 7f6ba5c95640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba010c180 0x7f6ba0101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.045+0000 7f6ba5c95640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba010c180 0x7f6ba0101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48698/0 (socket says 172.21.15.45:48698) 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.045+0000 7f6ba5c95640 1 -- 172.21.15.45:0/442273152 learned_addr learned my addr 172.21.15.45:0/442273152 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6ba4c93640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba01036c0 0x7f6ba0100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6ba5494640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ba0102da0 0x7f6ba0100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6ba5c95640 1 -- 172.21.15.45:0/442273152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ba0102da0 msgr2=0x7f6ba0100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6ba5c95640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ba0102da0 0x7f6ba0100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6ba5c95640 1 -- 172.21.15.45:0/442273152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba01036c0 msgr2=0x7f6ba0100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6ba5c95640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba01036c0 0x7f6ba0100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:52.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6ba5c95640 1 -- 172.21.15.45:0/442273152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba01a6940 con 0x7f6ba010c180 2024-09-15T22:16:52.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6ba5494640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ba0102da0 0x7f6ba0100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:52.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6ba4c93640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba01036c0 0x7f6ba0100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:52.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6ba5c95640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba010c180 0x7f6ba0101480 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800cce0 tx=0x7f6b9800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:52.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6b967fc640 1 -- 172.21.15.45:0/442273152 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9800f450 con 0x7f6ba010c180 2024-09-15T22:16:52.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6ba76f8640 1 -- 172.21.15.45:0/442273152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba01a6c30 con 0x7f6ba010c180 2024-09-15T22:16:52.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6b967fc640 1 -- 172.21.15.45:0/442273152 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b9800faf0 con 0x7f6ba010c180 2024-09-15T22:16:52.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6b967fc640 1 -- 172.21.15.45:0/442273152 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98018cc0 con 0x7f6ba010c180 2024-09-15T22:16:52.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.046+0000 7f6ba76f8640 1 -- 172.21.15.45:0/442273152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba01a7170 con 0x7f6ba010c180 2024-09-15T22:16:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.047+0000 7f6ba76f8640 1 -- 172.21.15.45:0/442273152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba0103180 con 0x7f6ba010c180 2024-09-15T22:16:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.048+0000 7f6b967fc640 1 -- 172.21.15.45:0/442273152 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f6b9800f5f0 con 0x7f6ba010c180 2024-09-15T22:16:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.049+0000 7f6b967fc640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b8c0a3440 0x7f6b8c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.049+0000 7f6ba5494640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b8c0a3440 0x7f6b8c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.049+0000 7f6b967fc640 1 -- 172.21.15.45:0/442273152 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f6b980d0740 con 0x7f6ba010c180 2024-09-15T22:16:52.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.050+0000 7f6ba5494640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b8c0a3440 0x7f6b8c0a5900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0058c0 tx=0x7f6b9c005ec0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:52.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.053+0000 7f6b967fc640 1 -- 172.21.15.45:0/442273152 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b98014030 con 0x7f6ba010c180 2024-09-15T22:16:52.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.263+0000 7f6ba76f8640 1 -- 172.21.15.45:0/442273152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ba01071c0 con 0x7f6ba010c180 2024-09-15T22:16:52.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.264+0000 7f6b967fc640 1 -- 172.21.15.45:0/442273152 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f6b9809cc40 con 0x7f6ba010c180 2024-09-15T22:16:52.266 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:52.266 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:16:52.267 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:16:52.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.266+0000 7f6ba76f8640 1 -- 172.21.15.45:0/442273152 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b8c0a3440 msgr2=0x7f6b8c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:52.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.266+0000 7f6ba76f8640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b8c0a3440 0x7f6b8c0a5900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c0058c0 tx=0x7f6b9c005ec0 comp rx=0 tx=0).stop 2024-09-15T22:16:52.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.266+0000 7f6ba76f8640 1 -- 172.21.15.45:0/442273152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba010c180 msgr2=0x7f6ba0101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:52.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.266+0000 7f6ba76f8640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba010c180 0x7f6ba0101480 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800cce0 tx=0x7f6b9800a620 comp rx=0 tx=0).stop 2024-09-15T22:16:52.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.266+0000 7f6ba76f8640 1 -- 172.21.15.45:0/442273152 shutdown_connections 2024-09-15T22:16:52.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.266+0000 7f6ba76f8640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b8c0a3440 0x7f6b8c0a5900 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:52.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.266+0000 7f6ba76f8640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6ba010c180 0x7f6ba0101480 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:52.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.266+0000 7f6ba76f8640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba01036c0 0x7f6ba0100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:52.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.266+0000 7f6ba76f8640 1 --2- 172.21.15.45:0/442273152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6ba0102da0 0x7f6ba0100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:52.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.266+0000 7f6ba76f8640 1 -- 172.21.15.45:0/442273152 >> 172.21.15.45:0/442273152 conn(0x7f6ba00fc7a0 msgr2=0x7f6ba00fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:52.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.267+0000 7f6ba76f8640 1 -- 172.21.15.45:0/442273152 shutdown_connections 2024-09-15T22:16:52.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:52.267+0000 7f6ba76f8640 1 -- 172.21.15.45:0/442273152 wait complete. 2024-09-15T22:16:52.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:52 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/442273152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:52.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:52 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/442273152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:52.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:52 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/442273152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:16:52.976 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:16:53.239 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:53.540 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:53 smithi045 ceph-mon[31180]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:16:53.616 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:53 smithi165 ceph-mon[35551]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:16:53.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:53 smithi100 ceph-mon[35319]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:16:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.751+0000 7f674b8ae640 1 -- 172.21.15.45:0/1154675264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6744103660 msgr2=0x7f674410bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.751+0000 7f674b8ae640 1 --2- 172.21.15.45:0/1154675264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6744103660 0x7f674410bb50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f6734009900 tx=0x7f673402a480 comp rx=0 tx=0).stop 2024-09-15T22:16:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.751+0000 7f674b8ae640 1 -- 172.21.15.45:0/1154675264 shutdown_connections 2024-09-15T22:16:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.751+0000 7f674b8ae640 1 --2- 172.21.15.45:0/1154675264 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f674410c170 0x7f674410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.751+0000 7f674b8ae640 1 --2- 172.21.15.45:0/1154675264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6744103660 0x7f674410bb50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.751+0000 7f674b8ae640 1 --2- 172.21.15.45:0/1154675264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6744102d40 0x7f6744103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.751+0000 7f674b8ae640 1 -- 172.21.15.45:0/1154675264 >> 172.21.15.45:0/1154675264 conn(0x7f67440fc7a0 msgr2=0x7f67440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.751+0000 7f674b8ae640 1 -- 172.21.15.45:0/1154675264 shutdown_connections 2024-09-15T22:16:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.751+0000 7f674b8ae640 1 -- 172.21.15.45:0/1154675264 wait complete. 2024-09-15T22:16:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.752+0000 7f674b8ae640 1 Processor -- start 2024-09-15T22:16:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.752+0000 7f674b8ae640 1 -- start start 2024-09-15T22:16:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.752+0000 7f674b8ae640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6744102d40 0x7f67441009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.752+0000 7f674b8ae640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6744103660 0x7f6744100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.752+0000 7f674b8ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f674410c170 0x7f6744101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.752+0000 7f674b8ae640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f67441120f0 con 0x7f674410c170 2024-09-15T22:16:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.752+0000 7f674b8ae640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6744111f70 con 0x7f6744103660 2024-09-15T22:16:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.752+0000 7f674b8ae640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6744112270 con 0x7f6744102d40 2024-09-15T22:16:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.752+0000 7f6749e4b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f674410c170 0x7f6744101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.752+0000 7f6749e4b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f674410c170 0x7f6744101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48720/0 (socket says 172.21.15.45:48720) 2024-09-15T22:16:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.752+0000 7f6749e4b640 1 -- 172.21.15.45:0/4104153625 learned_addr learned my addr 172.21.15.45:0/4104153625 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.752+0000 7f674964a640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6744102d40 0x7f67441009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.752+0000 7f6748e49640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6744103660 0x7f6744100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.753+0000 7f6749e4b640 1 -- 172.21.15.45:0/4104153625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6744102d40 msgr2=0x7f67441009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.753+0000 7f6749e4b640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6744102d40 0x7f67441009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.753+0000 7f6749e4b640 1 -- 172.21.15.45:0/4104153625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6744103660 msgr2=0x7f6744100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.753+0000 7f6749e4b640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6744103660 0x7f6744100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.753+0000 7f6749e4b640 1 -- 172.21.15.45:0/4104153625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67441a69f0 con 0x7f674410c170 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.753+0000 7f6748e49640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6744103660 0x7f6744100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.753+0000 7f6749e4b640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f674410c170 0x7f6744101420 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f673c009fd0 tx=0x7f673c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.753+0000 7f673a7fc640 1 -- 172.21.15.45:0/4104153625 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c011830 con 0x7f674410c170 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.753+0000 7f673a7fc640 1 -- 172.21.15.45:0/4104153625 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f673c016070 con 0x7f674410c170 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.753+0000 7f674b8ae640 1 -- 172.21.15.45:0/4104153625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67441a6ce0 con 0x7f674410c170 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.753+0000 7f673a7fc640 1 -- 172.21.15.45:0/4104153625 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c00f2e0 con 0x7f674410c170 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.753+0000 7f674b8ae640 1 -- 172.21.15.45:0/4104153625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67441a71d0 con 0x7f674410c170 2024-09-15T22:16:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.755+0000 7f673a7fc640 1 -- 172.21.15.45:0/4104153625 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f673c01b460 con 0x7f674410c170 2024-09-15T22:16:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f674dc87740 1 Processor -- start 2024-09-15T22:16:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f674dc87740 1 -- start start 2024-09-15T22:16:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f674dc87740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef983b40 0x5609ef982090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f674dc87740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef9825d0 0x5609ef982a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f674dc87740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef98d370 0x5609ef98f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f674dc87740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5609ef8e82f0 con 0x5609ef983b40 2024-09-15T22:16:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f674dc87740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5609ef88fcf0 con 0x5609ef9825d0 2024-09-15T22:16:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f674dc87740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5609ef8e42b0 con 0x5609ef98d370 2024-09-15T22:16:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f6748e49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef983b40 0x5609ef982090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f6748e49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef983b40 0x5609ef982090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48732/0 (socket says 172.21.15.45:48732) 2024-09-15T22:16:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f6748e49640 1 -- 172.21.15.45:0/1874905380 learned_addr learned my addr 172.21.15.45:0/1874905380 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f673a7fc640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f67300a3440 0x7f67300a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f6748e49640 1 --2- 172.21.15.45:0/1874905380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef98d370 0x5609ef98f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f6749e4b640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f67300a3440 0x7f67300a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f674964a640 1 --2- 172.21.15.45:0/1874905380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef9825d0 0x5609ef982a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f6748e49640 1 -- 172.21.15.45:0/1874905380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef98d370 msgr2=0x5609ef98f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f6748e49640 1 --2- 172.21.15.45:0/1874905380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef98d370 0x5609ef98f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f6748e49640 1 -- 172.21.15.45:0/1874905380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef9825d0 msgr2=0x5609ef982a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f6748e49640 1 --2- 172.21.15.45:0/1874905380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef9825d0 0x5609ef982a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f6748e49640 1 -- 172.21.15.45:0/1874905380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609ef8743a0 con 0x5609ef983b40 2024-09-15T22:16:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.756+0000 7f673a7fc640 1 -- 172.21.15.45:0/4104153625 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f673c0cf820 con 0x7f674410c170 2024-09-15T22:16:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.757+0000 7f6748e49640 1 --2- 172.21.15.45:0/1874905380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef983b40 0x5609ef982090 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6734005ec0 tx=0x7f6734009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3517ba3a7d5c099 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.757+0000 7f6749e4b640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f67300a3440 0x7f67300a5900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f673c0ccc50 tx=0x7f673c0bd040 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.757+0000 7f672f7fe640 1 -- 172.21.15.45:0/1874905380 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734043030 con 0x5609ef983b40 2024-09-15T22:16:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.757+0000 7f672f7fe640 1 -- 172.21.15.45:0/1874905380 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6734005020 con 0x5609ef983b40 2024-09-15T22:16:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.757+0000 7f672f7fe640 1 -- 172.21.15.45:0/1874905380 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734035050 con 0x5609ef983b40 2024-09-15T22:16:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.757+0000 7f674dc87740 1 -- 172.21.15.45:0/1874905380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef983b40 msgr2=0x5609ef982090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 --2- 172.21.15.45:0/1874905380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef983b40 0x5609ef982090 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6734005ec0 tx=0x7f6734009560 comp rx=0 tx=0).stop 2024-09-15T22:16:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 -- 172.21.15.45:0/1874905380 shutdown_connections 2024-09-15T22:16:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 --2- 172.21.15.45:0/1874905380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef98d370 0x5609ef98f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 --2- 172.21.15.45:0/1874905380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef9825d0 0x5609ef982a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 --2- 172.21.15.45:0/1874905380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef983b40 0x5609ef982090 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 -- 172.21.15.45:0/1874905380 >> 172.21.15.45:0/1874905380 conn(0x5609ef94b310 msgr2=0x5609ef97ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 -- 172.21.15.45:0/1874905380 shutdown_connections 2024-09-15T22:16:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 -- 172.21.15.45:0/1874905380 wait complete. 2024-09-15T22:16:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 -- start start 2024-09-15T22:16:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 Processor -- start 2024-09-15T22:16:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef9825d0 0x5609ef98cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef983b40 0x5609ef989fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef98d370 0x5609ef98a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5609ef990010 con 0x5609ef9825d0 2024-09-15T22:16:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5609ef8a3060 con 0x5609ef98d370 2024-09-15T22:16:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.758+0000 7f674dc87740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5609ef990190 con 0x5609ef983b40 2024-09-15T22:16:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f674dc87740 10 client.0 _ll_register_callbacks cb 0x5609ef5f68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f6748e49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef9825d0 0x5609ef98cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f6748e49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef9825d0 0x5609ef98cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48742/0 (socket says 172.21.15.45:48742) 2024-09-15T22:16:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f6748e49640 1 -- 172.21.15.45:0/491538745 learned_addr learned my addr 172.21.15.45:0/491538745 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f674964a640 1 --2- 172.21.15.45:0/491538745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef983b40 0x5609ef989fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f6748e49640 1 -- 172.21.15.45:0/491538745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef983b40 msgr2=0x5609ef989fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f6748e49640 1 --2- 172.21.15.45:0/491538745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef983b40 0x5609ef989fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f6748e49640 1 -- 172.21.15.45:0/491538745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef98d370 msgr2=0x5609ef98a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f6748e49640 1 --2- 172.21.15.45:0/491538745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef98d370 0x5609ef98a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f6748e49640 1 -- 172.21.15.45:0/491538745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609ef6593c0 con 0x5609ef9825d0 2024-09-15T22:16:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f6748e49640 1 --2- 172.21.15.45:0/491538745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef9825d0 0x5609ef98cd10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6734000c00 tx=0x7f6734004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ad615964efaed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f672cff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f672cff9640 1 -- 172.21.15.45:0/491538745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673404c070 con 0x5609ef9825d0 2024-09-15T22:16:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f672cff9640 1 -- 172.21.15.45:0/491538745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f673403a680 con 0x5609ef9825d0 2024-09-15T22:16:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f674dc87740 1 -- 172.21.15.45:0/491538745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6734005020 con 0x5609ef9825d0 2024-09-15T22:16:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f672cff9640 1 -- 172.21.15.45:0/491538745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6734035030 con 0x5609ef9825d0 2024-09-15T22:16:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f674dc87740 10 client.15549 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.759+0000 7f674dc87740 1 -- 172.21.15.45:0/491538745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5609ef99ba90 con 0x5609ef9825d0 2024-09-15T22:16:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.760+0000 7f672cff9640 1 -- 172.21.15.45:0/491538745 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6734005020 con 0x5609ef9825d0 2024-09-15T22:16:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.760+0000 7f672cff9640 1 -- 172.21.15.45:0/491538745 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6734048810 con 0x5609ef9825d0 2024-09-15T22:16:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.760+0000 7f674dc87740 10 client.15549 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.760+0000 7f674dc87740 10 client.15549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.760+0000 7f674dc87740 20 client.15549 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.760+0000 7f674dc87740 1 --2- 172.21.15.45:0/491538745 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5609ef99cde0 0x5609ef99f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.760+0000 7f674dc87740 4 client.15549 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.760+0000 7f674dc87740 1 -- 172.21.15.45:0/491538745 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609ef8f5860 con 0x5609ef99cde0 2024-09-15T22:16:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.760+0000 7f674964a640 1 --2- 172.21.15.45:0/491538745 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5609ef99cde0 0x5609ef99f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.760+0000 7f672cff9640 10 client.15549 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.760+0000 7f674964a640 1 --2- 172.21.15.45:0/491538745 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5609ef99cde0 0x5609ef99f1d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eef5fa68f241e49a server_cookie=7beab1bd6acd20a1 in_seq=0 out_seq=0 2024-09-15T22:16:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.761+0000 7f672cff9640 1 -- 172.21.15.45:0/491538745 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5609ef8f5860 con 0x5609ef99cde0 2024-09-15T22:16:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.761+0000 7f672cff9640 10 client.15549 handle_command_reply: tid=0 2024-09-15T22:16:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.761+0000 7f674dc87740 1 client.15549 shutdown 2024-09-15T22:16:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.761+0000 7f674dc87740 1 -- 172.21.15.45:0/491538745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef9825d0 msgr2=0x5609ef98cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.761+0000 7f674dc87740 1 --2- 172.21.15.45:0/491538745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef9825d0 0x5609ef98cd10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6734000c00 tx=0x7f6734004ad0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.761+0000 7f674dc87740 1 -- 172.21.15.45:0/491538745 shutdown_connections 2024-09-15T22:16:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.761+0000 7f674dc87740 1 --2- 172.21.15.45:0/491538745 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5609ef99cde0 0x5609ef99f1d0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.761+0000 7f674dc87740 1 --2- 172.21.15.45:0/491538745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef98d370 0x5609ef98a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.761+0000 7f674dc87740 1 --2- 172.21.15.45:0/491538745 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef983b40 0x5609ef989fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.761+0000 7f674dc87740 1 --2- 172.21.15.45:0/491538745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef9825d0 0x5609ef98cd10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.761+0000 7f674dc87740 1 -- 172.21.15.45:0/491538745 >> 172.21.15.45:0/491538745 conn(0x5609ef94b310 msgr2=0x5609ef984930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:53.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.761+0000 7f672cff9640 0 client.15549 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:53.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.762+0000 7f674dc87740 1 -- 172.21.15.45:0/491538745 shutdown_connections 2024-09-15T22:16:53.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.762+0000 7f674dc87740 1 -- 172.21.15.45:0/491538745 wait complete. 2024-09-15T22:16:53.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.762+0000 7f674dc87740 20 client.15549 trim_cache size 0 max 16384 2024-09-15T22:16:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.775+0000 7f674dc87740 1 Processor -- start 2024-09-15T22:16:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.775+0000 7f674dc87740 1 -- start start 2024-09-15T22:16:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.775+0000 7f674dc87740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef9825d0 0x5609ef97dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.775+0000 7f674dc87740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef983b40 0x5609ef987240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.775+0000 7f674dc87740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 0x5609ef987780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.775+0000 7f674dc87740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f67441af0e0 con 0x5609ef98d370 2024-09-15T22:16:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.775+0000 7f674dc87740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f67441b1960 con 0x5609ef983b40 2024-09-15T22:16:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.775+0000 7f674dc87740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f67441af750 con 0x5609ef9825d0 2024-09-15T22:16:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f6748e49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 0x5609ef987780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f674964a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef983b40 0x5609ef987240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f6748e49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 0x5609ef987780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48750/0 (socket says 172.21.15.45:48750) 2024-09-15T22:16:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f6748e49640 1 -- 172.21.15.45:0/19414686 learned_addr learned my addr 172.21.15.45:0/19414686 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f6748e49640 1 --2- 172.21.15.45:0/19414686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef9825d0 0x5609ef97dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f6748e49640 1 -- 172.21.15.45:0/19414686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef9825d0 msgr2=0x5609ef97dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f6748e49640 1 --2- 172.21.15.45:0/19414686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef9825d0 0x5609ef97dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f6748e49640 1 -- 172.21.15.45:0/19414686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef983b40 msgr2=0x5609ef987240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f6748e49640 1 --2- 172.21.15.45:0/19414686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef983b40 0x5609ef987240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f6748e49640 1 -- 172.21.15.45:0/19414686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609ef985120 con 0x5609ef98d370 2024-09-15T22:16:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f674964a640 1 --2- 172.21.15.45:0/19414686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef983b40 0x5609ef987240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f6748e49640 1 --2- 172.21.15.45:0/19414686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 0x5609ef987780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6734031c40 tx=0x7f6734031b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82779f6d6d2b2de0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f672effd640 1 -- 172.21.15.45:0/19414686 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673404c070 con 0x5609ef98d370 2024-09-15T22:16:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f672effd640 1 -- 172.21.15.45:0/19414686 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6734048970 con 0x5609ef98d370 2024-09-15T22:16:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.776+0000 7f672effd640 1 -- 172.21.15.45:0/19414686 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734043040 con 0x5609ef98d370 2024-09-15T22:16:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.777+0000 7f674dc87740 1 -- 172.21.15.45:0/19414686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 msgr2=0x5609ef987780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.777+0000 7f674dc87740 1 --2- 172.21.15.45:0/19414686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 0x5609ef987780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6734031c40 tx=0x7f6734031b20 comp rx=0 tx=0).stop 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.777+0000 7f674dc87740 1 -- 172.21.15.45:0/19414686 shutdown_connections 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.777+0000 7f674dc87740 1 --2- 172.21.15.45:0/19414686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 0x5609ef987780 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.777+0000 7f674dc87740 1 --2- 172.21.15.45:0/19414686 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef983b40 0x5609ef987240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.777+0000 7f674dc87740 1 --2- 172.21.15.45:0/19414686 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef9825d0 0x5609ef97dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.777+0000 7f674dc87740 1 -- 172.21.15.45:0/19414686 >> 172.21.15.45:0/19414686 conn(0x5609ef94b310 msgr2=0x5609ef97d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.777+0000 7f674dc87740 1 -- 172.21.15.45:0/19414686 shutdown_connections 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.777+0000 7f674dc87740 1 -- 172.21.15.45:0/19414686 wait complete. 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.778+0000 7f674dc87740 1 -- start start 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.778+0000 7f674dc87740 1 Processor -- start 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.778+0000 7f674dc87740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef9825d0 0x5609ef9a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.778+0000 7f674dc87740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef983b40 0x5609ef9a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.778+0000 7f674dc87740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 0x5609efa06720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.778+0000 7f674dc87740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f67441afe20 con 0x5609ef98d370 2024-09-15T22:16:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.778+0000 7f674dc87740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f67441b1290 con 0x5609ef983b40 2024-09-15T22:16:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.778+0000 7f674dc87740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f67441b04f0 con 0x5609ef9825d0 2024-09-15T22:16:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.778+0000 7f674dc87740 10 client.0 _ll_register_callbacks cb 0x7f6734009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.778+0000 7f6748e49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 0x5609efa06720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.778+0000 7f6748e49640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 0x5609efa06720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48752/0 (socket says 172.21.15.45:48752) 2024-09-15T22:16:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.778+0000 7f6748e49640 1 -- 172.21.15.45:0/1200732748 learned_addr learned my addr 172.21.15.45:0/1200732748 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.778+0000 7f6748e49640 1 --2- 172.21.15.45:0/1200732748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef9825d0 0x5609ef9a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f674964a640 1 --2- 172.21.15.45:0/1200732748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef983b40 0x5609ef9a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f6748e49640 1 -- 172.21.15.45:0/1200732748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef9825d0 msgr2=0x5609ef9a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f6748e49640 1 --2- 172.21.15.45:0/1200732748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef9825d0 0x5609ef9a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f6748e49640 1 -- 172.21.15.45:0/1200732748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef983b40 msgr2=0x5609ef9a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f6748e49640 1 --2- 172.21.15.45:0/1200732748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef983b40 0x5609ef9a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f6748e49640 1 -- 172.21.15.45:0/1200732748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609efa06c60 con 0x5609ef98d370 2024-09-15T22:16:53.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f6748e49640 1 --2- 172.21.15.45:0/1200732748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 0x5609efa06720 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6734005ec0 tx=0x7f6734031570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fe204fb001b425 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:53.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f672cff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:53.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f672cff9640 1 -- 172.21.15.45:0/1200732748 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734043070 con 0x5609ef98d370 2024-09-15T22:16:53.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f672cff9640 1 -- 172.21.15.45:0/1200732748 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f6734048670 con 0x5609ef98d370 2024-09-15T22:16:53.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f674dc87740 1 -- 172.21.15.45:0/1200732748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6734048970 con 0x5609ef98d370 2024-09-15T22:16:53.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f672cff9640 1 -- 172.21.15.45:0/1200732748 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f673404c040 con 0x5609ef98d370 2024-09-15T22:16:53.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f674dc87740 10 client.15555 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:53.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.779+0000 7f674dc87740 1 -- 172.21.15.45:0/1200732748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5609efa06c60 con 0x5609ef98d370 2024-09-15T22:16:53.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.780+0000 7f672cff9640 1 -- 172.21.15.45:0/1200732748 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6734048970 con 0x5609ef98d370 2024-09-15T22:16:53.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.780+0000 7f672cff9640 1 -- 172.21.15.45:0/1200732748 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6734067030 con 0x5609ef98d370 2024-09-15T22:16:53.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.780+0000 7f674dc87740 10 client.15555 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:53.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.780+0000 7f674dc87740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:53.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.780+0000 7f674dc87740 20 client.15555 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:53.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.780+0000 7f674dc87740 1 --2- 172.21.15.45:0/1200732748 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5609efa08210 0x5609efa0a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:53.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.780+0000 7f674dc87740 4 client.15555 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:16:53.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.780+0000 7f674dc87740 1 -- 172.21.15.45:0/1200732748 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5609ef8efd70 con 0x5609efa08210 2024-09-15T22:16:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.780+0000 7f674964a640 1 --2- 172.21.15.45:0/1200732748 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5609efa08210 0x5609efa0a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.780+0000 7f672cff9640 10 client.15555 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.780+0000 7f674964a640 1 --2- 172.21.15.45:0/1200732748 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5609efa08210 0x5609efa0a600 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b661a69c307f0702 server_cookie=fb32dbc1a32b9fe2 in_seq=0 out_seq=0 2024-09-15T22:16:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f672cff9640 1 -- 172.21.15.45:0/1200732748 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5609ef8efd70 con 0x5609efa08210 2024-09-15T22:16:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f672cff9640 10 client.15555 handle_command_reply: tid=0 2024-09-15T22:16:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f674dc87740 1 client.15555 shutdown 2024-09-15T22:16:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f674dc87740 1 -- 172.21.15.45:0/1200732748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 msgr2=0x5609efa06720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f674dc87740 1 --2- 172.21.15.45:0/1200732748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 0x5609efa06720 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6734005ec0 tx=0x7f6734031570 comp rx=0 tx=0).stop 2024-09-15T22:16:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f674dc87740 1 -- 172.21.15.45:0/1200732748 shutdown_connections 2024-09-15T22:16:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f674dc87740 1 --2- 172.21.15.45:0/1200732748 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5609efa08210 0x5609efa0a600 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f674dc87740 1 --2- 172.21.15.45:0/1200732748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609ef98d370 0x5609efa06720 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f674dc87740 1 --2- 172.21.15.45:0/1200732748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5609ef983b40 0x5609ef9a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f674dc87740 1 --2- 172.21.15.45:0/1200732748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5609ef9825d0 0x5609ef9a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f674dc87740 1 -- 172.21.15.45:0/1200732748 >> 172.21.15.45:0/1200732748 conn(0x5609ef94b310 msgr2=0x5609ef984930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:53.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f672cff9640 0 client.15555 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:53.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f674dc87740 1 -- 172.21.15.45:0/1200732748 shutdown_connections 2024-09-15T22:16:53.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f674dc87740 1 -- 172.21.15.45:0/1200732748 wait complete. 2024-09-15T22:16:53.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.781+0000 7f674dc87740 20 client.15555 trim_cache size 0 max 16384 2024-09-15T22:16:53.796 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:16:53.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.782+0000 7f674b8ae640 1 -- 172.21.15.45:0/4104153625 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f67300a3440 msgr2=0x7f67300a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:53.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.782+0000 7f674b8ae640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f67300a3440 0x7f67300a5900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f673c0ccc50 tx=0x7f673c0bd040 comp rx=0 tx=0).stop 2024-09-15T22:16:53.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.782+0000 7f674b8ae640 1 -- 172.21.15.45:0/4104153625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f674410c170 msgr2=0x7f6744101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:53.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.782+0000 7f674b8ae640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f674410c170 0x7f6744101420 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f673c009fd0 tx=0x7f673c00b8e0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.782+0000 7f674b8ae640 1 -- 172.21.15.45:0/4104153625 shutdown_connections 2024-09-15T22:16:53.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.782+0000 7f674b8ae640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f67300a3440 0x7f67300a5900 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.782+0000 7f674b8ae640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f674410c170 0x7f6744101420 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.782+0000 7f674b8ae640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6744103660 0x7f6744100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.782+0000 7f674b8ae640 1 --2- 172.21.15.45:0/4104153625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6744102d40 0x7f67441009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:53.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.782+0000 7f674b8ae640 1 -- 172.21.15.45:0/4104153625 >> 172.21.15.45:0/4104153625 conn(0x7f67440fc7a0 msgr2=0x7f67440fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:53.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.782+0000 7f674b8ae640 1 -- 172.21.15.45:0/4104153625 shutdown_connections 2024-09-15T22:16:53.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:53.782+0000 7f674b8ae640 1 -- 172.21.15.45:0/4104153625 wait complete. 2024-09-15T22:16:55.546 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:55 smithi100 ceph-mon[35319]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:16:55.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:55 smithi045 ceph-mon[31180]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:16:55.584 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:16:55.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:16:55.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:55 smithi165 ceph-mon[35551]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:16:55.856 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.351+0000 7f734a40f640 1 -- 172.21.15.45:0/806315345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344101de0 msgr2=0x7f73441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.351+0000 7f734a40f640 1 --2- 172.21.15.45:0/806315345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344101de0 0x7f73441021c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7334009900 tx=0x7f733402a410 comp rx=0 tx=0).stop 2024-09-15T22:16:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.351+0000 7f734a40f640 1 -- 172.21.15.45:0/806315345 shutdown_connections 2024-09-15T22:16:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.351+0000 7f734a40f640 1 --2- 172.21.15.45:0/806315345 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7344106f10 0x7f734410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.351+0000 7f734a40f640 1 --2- 172.21.15.45:0/806315345 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7344102790 0x7f73441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.351+0000 7f734a40f640 1 --2- 172.21.15.45:0/806315345 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344101de0 0x7f73441021c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.351+0000 7f734a40f640 1 -- 172.21.15.45:0/806315345 >> 172.21.15.45:0/806315345 conn(0x7f73440fd8c0 msgr2=0x7f73440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.351+0000 7f734a40f640 1 -- 172.21.15.45:0/806315345 shutdown_connections 2024-09-15T22:16:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.351+0000 7f734a40f640 1 -- 172.21.15.45:0/806315345 wait complete. 2024-09-15T22:16:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.352+0000 7f734a40f640 1 Processor -- start 2024-09-15T22:16:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.352+0000 7f734a40f640 1 -- start start 2024-09-15T22:16:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.352+0000 7f734a40f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7344101de0 0x7f73440744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.352+0000 7f734a40f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344102790 0x7f7344074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.352+0000 7f734a40f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7344106f10 0x7f7344074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.352+0000 7f734a40f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7344112090 con 0x7f7344102790 2024-09-15T22:16:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.352+0000 7f734a40f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7344111f10 con 0x7f7344106f10 2024-09-15T22:16:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.352+0000 7f734a40f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7344112210 con 0x7f7344101de0 2024-09-15T22:16:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.352+0000 7f73437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344102790 0x7f7344074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.352+0000 7f73437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344102790 0x7f7344074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38726/0 (socket says 172.21.15.45:38726) 2024-09-15T22:16:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.352+0000 7f73437fe640 1 -- 172.21.15.45:0/1536405462 learned_addr learned my addr 172.21.15.45:0/1536405462 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.352+0000 7f73489ac640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7344106f10 0x7f7344074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.352+0000 7f7343fff640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7344101de0 0x7f73440744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.353+0000 7f73437fe640 1 -- 172.21.15.45:0/1536405462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7344101de0 msgr2=0x7f73440744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.353+0000 7f73437fe640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7344101de0 0x7f73440744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.353+0000 7f73437fe640 1 -- 172.21.15.45:0/1536405462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7344106f10 msgr2=0x7f7344074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.353+0000 7f73437fe640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7344106f10 0x7f7344074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.353+0000 7f73437fe640 1 -- 172.21.15.45:0/1536405462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73441a69b0 con 0x7f7344102790 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.353+0000 7f7343fff640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7344101de0 0x7f73440744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.353+0000 7f73489ac640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7344106f10 0x7f7344074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.353+0000 7f73437fe640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344102790 0x7f7344074a30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f733800c890 tx=0x7f733800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.353+0000 7f73417fa640 1 -- 172.21.15.45:0/1536405462 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7338004220 con 0x7f7344102790 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.353+0000 7f73417fa640 1 -- 172.21.15.45:0/1536405462 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f73380043c0 con 0x7f7344102790 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.353+0000 7f73417fa640 1 -- 172.21.15.45:0/1536405462 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7338004b10 con 0x7f7344102790 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.353+0000 7f734a40f640 1 -- 172.21.15.45:0/1536405462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73441a6ca0 con 0x7f7344102790 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.353+0000 7f734a40f640 1 -- 172.21.15.45:0/1536405462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73441a7190 con 0x7f7344102790 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.355+0000 7f73417fa640 1 -- 172.21.15.45:0/1536405462 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f73380051b0 con 0x7f7344102790 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.355+0000 7f734c7e8740 1 Processor -- start 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f734c7e8740 1 -- start start 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f734c7e8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f6ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f734c7e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6f480 0x558ad5f79800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f734c7e8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f79d40 0x558ad5f7c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f734c7e8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558ad5ed4280 con 0x558ad5f6eb60 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f734c7e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558ad5e7bb10 con 0x558ad5f6f480 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f734c7e8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558ad5ed0240 con 0x558ad5f79d40 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f73489ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f6ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f73489ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f6ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38728/0 (socket says 172.21.15.45:38728) 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f73489ac640 1 -- 172.21.15.45:0/1514191926 learned_addr learned my addr 172.21.15.45:0/1514191926 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f7343fff640 1 --2- 172.21.15.45:0/1514191926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6f480 0x558ad5f79800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f73437fe640 1 --2- 172.21.15.45:0/1514191926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f79d40 0x558ad5f7c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f73417fa640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f732c0a3440 0x7f732c0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.356+0000 7f7343fff640 1 -- 172.21.15.45:0/1514191926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f79d40 msgr2=0x558ad5f7c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.357+0000 7f7343fff640 1 --2- 172.21.15.45:0/1514191926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f79d40 0x558ad5f7c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.357+0000 7f73417fa640 1 -- 172.21.15.45:0/1536405462 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f73380d02a0 con 0x7f7344102790 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.357+0000 7f7343fff640 1 -- 172.21.15.45:0/1514191926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 msgr2=0x558ad5f6ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.357+0000 7f7343fff640 1 --2- 172.21.15.45:0/1514191926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f6ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.357+0000 7f7343fff640 1 -- 172.21.15.45:0/1514191926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ad5e881f0 con 0x558ad5f6f480 2024-09-15T22:16:56.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.357+0000 7f73489ac640 1 --2- 172.21.15.45:0/1514191926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f6ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:56.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.357+0000 7f73489ac640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f732c0a3440 0x7f732c0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.357+0000 7f7343fff640 1 --2- 172.21.15.45:0/1514191926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6f480 0x558ad5f79800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7334009230 tx=0x7f7334032c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df1a3174e5098d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:56.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.357+0000 7f732a7fc640 1 -- 172.21.15.45:0/1514191926 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733403f070 con 0x558ad5f6f480 2024-09-15T22:16:56.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.358+0000 7f732a7fc640 1 -- 172.21.15.45:0/1514191926 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7334031840 con 0x558ad5f6f480 2024-09-15T22:16:56.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.358+0000 7f732a7fc640 1 -- 172.21.15.45:0/1514191926 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7334035070 con 0x558ad5f6f480 2024-09-15T22:16:56.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.358+0000 7f734c7e8740 1 -- 172.21.15.45:0/1514191926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6f480 msgr2=0x558ad5f79800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:56.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.358+0000 7f73489ac640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f732c0a3440 0x7f732c0a5900 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f733c009fd0 tx=0x7f733c004a40 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.358+0000 7f734c7e8740 1 --2- 172.21.15.45:0/1514191926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6f480 0x558ad5f79800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7334009230 tx=0x7f7334032c80 comp rx=0 tx=0).stop 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.358+0000 7f734c7e8740 1 -- 172.21.15.45:0/1514191926 shutdown_connections 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.358+0000 7f734c7e8740 1 --2- 172.21.15.45:0/1514191926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f79d40 0x558ad5f7c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.358+0000 7f734c7e8740 1 --2- 172.21.15.45:0/1514191926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6f480 0x558ad5f79800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.358+0000 7f734c7e8740 1 --2- 172.21.15.45:0/1514191926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f6ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.358+0000 7f734c7e8740 1 -- 172.21.15.45:0/1514191926 >> 172.21.15.45:0/1514191926 conn(0x558ad5f6b0f0 msgr2=0x558ad5f6b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.358+0000 7f734c7e8740 1 -- 172.21.15.45:0/1514191926 shutdown_connections 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.358+0000 7f734c7e8740 1 -- 172.21.15.45:0/1514191926 wait complete. 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.359+0000 7f734c7e8740 1 -- start start 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.359+0000 7f734c7e8740 1 Processor -- start 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.359+0000 7f734c7e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6eb60 0x558ad5f76bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.359+0000 7f734c7e8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6f480 0x558ad5f77110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.359+0000 7f734c7e8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f79d40 0x558ad5f77650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.359+0000 7f734c7e8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558ad5f7c910 con 0x558ad5f79d40 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.359+0000 7f734c7e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558ad5e8ef10 con 0x558ad5f6eb60 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.359+0000 7f734c7e8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558ad5f7ca90 con 0x558ad5f6f480 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.359+0000 7f734c7e8740 10 client.0 _ll_register_callbacks cb 0x558ad5e57a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.359+0000 7f73489ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f79d40 0x558ad5f77650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f73489ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f79d40 0x558ad5f77650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38732/0 (socket says 172.21.15.45:38732) 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f73489ac640 1 -- 172.21.15.45:0/3385971791 learned_addr learned my addr 172.21.15.45:0/3385971791 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f7343fff640 1 --2- 172.21.15.45:0/3385971791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6eb60 0x558ad5f76bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f73437fe640 1 --2- 172.21.15.45:0/3385971791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6f480 0x558ad5f77110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f7343fff640 1 -- 172.21.15.45:0/3385971791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6f480 msgr2=0x558ad5f77110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f7343fff640 1 --2- 172.21.15.45:0/3385971791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6f480 0x558ad5f77110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f7343fff640 1 -- 172.21.15.45:0/3385971791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f79d40 msgr2=0x558ad5f77650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f7343fff640 1 --2- 172.21.15.45:0/3385971791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f79d40 0x558ad5f77650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f7343fff640 1 -- 172.21.15.45:0/3385971791 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ad5c456a0 con 0x558ad5f6eb60 2024-09-15T22:16:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f7343fff640 1 --2- 172.21.15.45:0/3385971791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6eb60 0x558ad5f76bd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f733402a930 tx=0x7f7334031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2e3bc097f10a00e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f73237fe640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-15T22:16:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f73237fe640 1 -- 172.21.15.45:0/3385971791 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733404a020 con 0x558ad5f6eb60 2024-09-15T22:16:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f734c7e8740 1 -- 172.21.15.45:0/3385971791 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7334031840 con 0x558ad5f6eb60 2024-09-15T22:16:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f73237fe640 1 -- 172.21.15.45:0/3385971791 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f7334005570 con 0x558ad5f6eb60 2024-09-15T22:16:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f73237fe640 1 -- 172.21.15.45:0/3385971791 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7334055050 con 0x558ad5f6eb60 2024-09-15T22:16:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f734c7e8740 10 client.25250 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.360+0000 7f734c7e8740 1 -- 172.21.15.45:0/3385971791 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558ad5f884c0 con 0x558ad5f6eb60 2024-09-15T22:16:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.361+0000 7f73237fe640 1 -- 172.21.15.45:0/3385971791 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7334031840 con 0x558ad5f6eb60 2024-09-15T22:16:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.361+0000 7f73237fe640 1 -- 172.21.15.45:0/3385971791 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f733403b770 con 0x558ad5f6eb60 2024-09-15T22:16:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.361+0000 7f734c7e8740 10 client.25250 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.361+0000 7f734c7e8740 10 client.25250 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.361+0000 7f734c7e8740 20 client.25250 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.361+0000 7f734c7e8740 1 --2- 172.21.15.45:0/3385971791 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558ad5f89810 0x558ad5f8bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.361+0000 7f734c7e8740 4 client.25250 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.361+0000 7f734c7e8740 1 -- 172.21.15.45:0/3385971791 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ad5ee17f0 con 0x558ad5f89810 2024-09-15T22:16:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.361+0000 7f73437fe640 1 --2- 172.21.15.45:0/3385971791 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558ad5f89810 0x558ad5f8bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.361+0000 7f73437fe640 1 --2- 172.21.15.45:0/3385971791 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558ad5f89810 0x558ad5f8bc00 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1970d2c196764c2e server_cookie=433170dcb90cc0c2 in_seq=0 out_seq=0 2024-09-15T22:16:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.361+0000 7f73237fe640 10 client.25250 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f73237fe640 1 -- 172.21.15.45:0/3385971791 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558ad5ee17f0 con 0x558ad5f89810 2024-09-15T22:16:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f73237fe640 10 client.25250 handle_command_reply: tid=0 2024-09-15T22:16:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f734c7e8740 1 client.25250 shutdown 2024-09-15T22:16:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f734c7e8740 1 -- 172.21.15.45:0/3385971791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6eb60 msgr2=0x558ad5f76bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f734c7e8740 1 --2- 172.21.15.45:0/3385971791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6eb60 0x558ad5f76bd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f733402a930 tx=0x7f7334031400 comp rx=0 tx=0).stop 2024-09-15T22:16:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f734c7e8740 1 -- 172.21.15.45:0/3385971791 shutdown_connections 2024-09-15T22:16:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f734c7e8740 1 --2- 172.21.15.45:0/3385971791 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558ad5f89810 0x558ad5f8bc00 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f734c7e8740 1 --2- 172.21.15.45:0/3385971791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f79d40 0x558ad5f77650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f734c7e8740 1 --2- 172.21.15.45:0/3385971791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6f480 0x558ad5f77110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f734c7e8740 1 --2- 172.21.15.45:0/3385971791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6eb60 0x558ad5f76bd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f73237fe640 0 client.25250 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:56.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f734c7e8740 1 -- 172.21.15.45:0/3385971791 >> 172.21.15.45:0/3385971791 conn(0x558ad5f6b0f0 msgr2=0x558ad5f70e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:56.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f734c7e8740 1 -- 172.21.15.45:0/3385971791 shutdown_connections 2024-09-15T22:16:56.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.362+0000 7f734c7e8740 1 -- 172.21.15.45:0/3385971791 wait complete. 2024-09-15T22:16:56.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.363+0000 7f734c7e8740 20 client.25250 trim_cache size 0 max 16384 2024-09-15T22:16:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.380+0000 7f734c7e8740 1 Processor -- start 2024-09-15T22:16:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.380+0000 7f734c7e8740 1 -- start start 2024-09-15T22:16:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.380+0000 7f734c7e8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6b0f0 0x558ad5f76380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.380+0000 7f734c7e8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f8ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.380+0000 7f734c7e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6f480 0x558ad5f8f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.380+0000 7f734c7e8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f73441af1c0 con 0x558ad5f6eb60 2024-09-15T22:16:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.380+0000 7f734c7e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f73441b1a40 con 0x558ad5f6f480 2024-09-15T22:16:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.380+0000 7f734c7e8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73441af830 con 0x558ad5f6b0f0 2024-09-15T22:16:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.380+0000 7f73437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f8ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.380+0000 7f73437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f8ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38748/0 (socket says 172.21.15.45:38748) 2024-09-15T22:16:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.380+0000 7f73437fe640 1 -- 172.21.15.45:0/3753305085 learned_addr learned my addr 172.21.15.45:0/3753305085 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.380+0000 7f73489ac640 1 --2- 172.21.15.45:0/3753305085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6f480 0x558ad5f8f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.380+0000 7f7343fff640 1 --2- 172.21.15.45:0/3753305085 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6b0f0 0x558ad5f76380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.381+0000 7f73437fe640 1 -- 172.21.15.45:0/3753305085 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6b0f0 msgr2=0x558ad5f76380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.381+0000 7f73437fe640 1 --2- 172.21.15.45:0/3753305085 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6b0f0 0x558ad5f76380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.381+0000 7f73437fe640 1 -- 172.21.15.45:0/3753305085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6f480 msgr2=0x558ad5f8f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.381+0000 7f73437fe640 1 --2- 172.21.15.45:0/3753305085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6f480 0x558ad5f8f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.381+0000 7f73437fe640 1 -- 172.21.15.45:0/3753305085 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ad5f6af20 con 0x558ad5f6eb60 2024-09-15T22:16:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.381+0000 7f73489ac640 1 --2- 172.21.15.45:0/3753305085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6f480 0x558ad5f8f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.381+0000 7f73437fe640 1 --2- 172.21.15.45:0/3753305085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f8ec20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f73380cdc80 tx=0x7f73380d27b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f449e9abeff45c6f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.381+0000 7f7329ffb640 1 -- 172.21.15.45:0/3753305085 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733801d040 con 0x558ad5f6eb60 2024-09-15T22:16:56.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.381+0000 7f7329ffb640 1 -- 172.21.15.45:0/3753305085 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f733809c7a0 con 0x558ad5f6eb60 2024-09-15T22:16:56.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.381+0000 7f7329ffb640 1 -- 172.21.15.45:0/3753305085 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73380bc0b0 con 0x558ad5f6eb60 2024-09-15T22:16:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.382+0000 7f734c7e8740 1 -- 172.21.15.45:0/3753305085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 msgr2=0x558ad5f8ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.382+0000 7f734c7e8740 1 --2- 172.21.15.45:0/3753305085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f8ec20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f73380cdc80 tx=0x7f73380d27b0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.382+0000 7f734c7e8740 1 -- 172.21.15.45:0/3753305085 shutdown_connections 2024-09-15T22:16:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.382+0000 7f734c7e8740 1 --2- 172.21.15.45:0/3753305085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6f480 0x558ad5f8f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.382+0000 7f734c7e8740 1 --2- 172.21.15.45:0/3753305085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f8ec20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.382+0000 7f734c7e8740 1 --2- 172.21.15.45:0/3753305085 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6b0f0 0x558ad5f76380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.382+0000 7f734c7e8740 1 -- 172.21.15.45:0/3753305085 >> 172.21.15.45:0/3753305085 conn(0x558ad5f725c0 msgr2=0x558ad5f78b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.382+0000 7f734c7e8740 1 -- 172.21.15.45:0/3753305085 shutdown_connections 2024-09-15T22:16:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.382+0000 7f734c7e8740 1 -- 172.21.15.45:0/3753305085 wait complete. 2024-09-15T22:16:56.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.382+0000 7f734c7e8740 1 -- start start 2024-09-15T22:16:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.382+0000 7f734c7e8740 1 Processor -- start 2024-09-15T22:16:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.382+0000 7f734c7e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6b0f0 0x558ad5f8f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f734c7e8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f8d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f734c7e8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6f480 0x558ad5f8d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f734c7e8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f73441aff00 con 0x558ad5f6eb60 2024-09-15T22:16:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f734c7e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f73441b1370 con 0x558ad5f6b0f0 2024-09-15T22:16:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f734c7e8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f73441b05d0 con 0x558ad5f6f480 2024-09-15T22:16:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f734c7e8740 10 client.0 _ll_register_callbacks cb 0x7f733c009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f8d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f8d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38758/0 (socket says 172.21.15.45:38758) 2024-09-15T22:16:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73437fe640 1 -- 172.21.15.45:0/2153580351 learned_addr learned my addr 172.21.15.45:0/2153580351 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:56.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f7343fff640 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6b0f0 0x558ad5f8f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73489ac640 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6f480 0x558ad5f8d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73437fe640 1 -- 172.21.15.45:0/2153580351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6f480 msgr2=0x558ad5f8d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73437fe640 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6f480 0x558ad5f8d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73437fe640 1 -- 172.21.15.45:0/2153580351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6b0f0 msgr2=0x558ad5f8f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73437fe640 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6b0f0 0x558ad5f8f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73437fe640 1 -- 172.21.15.45:0/2153580351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ad5f8df00 con 0x558ad5f6eb60 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73489ac640 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6f480 0x558ad5f8d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f7343fff640 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6b0f0 0x558ad5f8f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73437fe640 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f8d480 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f733809c030 tx=0x7f7338007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2465f9ccb44e833f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73237fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73237fe640 1 -- 172.21.15.45:0/2153580351 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733801d070 con 0x558ad5f6eb60 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f73237fe640 1 -- 172.21.15.45:0/2153580351 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f7338098710 con 0x558ad5f6eb60 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.383+0000 7f734c7e8740 1 -- 172.21.15.45:0/2153580351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f733809c7a0 con 0x558ad5f6eb60 2024-09-15T22:16:56.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.384+0000 7f73237fe640 1 -- 172.21.15.45:0/2153580351 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f73380a0450 con 0x558ad5f6eb60 2024-09-15T22:16:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.384+0000 7f734c7e8740 10 client.15573 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.384+0000 7f734c7e8740 1 -- 172.21.15.45:0/2153580351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558ad5ff4ec0 con 0x558ad5f6eb60 2024-09-15T22:16:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.384+0000 7f73237fe640 1 -- 172.21.15.45:0/2153580351 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f733809c7a0 con 0x558ad5f6eb60 2024-09-15T22:16:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.384+0000 7f73237fe640 1 -- 172.21.15.45:0/2153580351 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f73380bace0 con 0x558ad5f6eb60 2024-09-15T22:16:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.384+0000 7f734c7e8740 10 client.15573 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.384+0000 7f734c7e8740 10 client.15573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.384+0000 7f734c7e8740 20 client.15573 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.384+0000 7f734c7e8740 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558ad5f79d40 0x558ad5ff7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.384+0000 7f734c7e8740 4 client.15573 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:16:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.384+0000 7f734c7e8740 1 -- 172.21.15.45:0/2153580351 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558ad5edbd00 con 0x558ad5f79d40 2024-09-15T22:16:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.384+0000 7f7343fff640 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558ad5f79d40 0x558ad5ff7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.385+0000 7f7343fff640 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558ad5f79d40 0x558ad5ff7530 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc936092ad08963d server_cookie=cf2d3baf08a13296 in_seq=0 out_seq=0 2024-09-15T22:16:56.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.385+0000 7f73237fe640 10 client.15573 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.385+0000 7f73237fe640 1 -- 172.21.15.45:0/2153580351 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558ad5edbd00 con 0x558ad5f79d40 2024-09-15T22:16:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.385+0000 7f73237fe640 10 client.15573 handle_command_reply: tid=0 2024-09-15T22:16:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.385+0000 7f734c7e8740 1 client.15573 shutdown 2024-09-15T22:16:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734c7e8740 1 -- 172.21.15.45:0/2153580351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 msgr2=0x558ad5f8d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734c7e8740 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f8d480 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f733809c030 tx=0x7f7338007700 comp rx=0 tx=0).stop 2024-09-15T22:16:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734c7e8740 1 -- 172.21.15.45:0/2153580351 shutdown_connections 2024-09-15T22:16:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734c7e8740 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558ad5f79d40 0x558ad5ff7530 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734c7e8740 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558ad5f6f480 0x558ad5f8d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734c7e8740 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ad5f6eb60 0x558ad5f8d480 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734c7e8740 1 --2- 172.21.15.45:0/2153580351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558ad5f6b0f0 0x558ad5f8f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734c7e8740 1 -- 172.21.15.45:0/2153580351 >> 172.21.15.45:0/2153580351 conn(0x558ad5f725c0 msgr2=0x558ad5f705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f73237fe640 0 client.15573 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:56.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734c7e8740 1 -- 172.21.15.45:0/2153580351 shutdown_connections 2024-09-15T22:16:56.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734c7e8740 1 -- 172.21.15.45:0/2153580351 wait complete. 2024-09-15T22:16:56.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734c7e8740 20 client.15573 trim_cache size 0 max 16384 2024-09-15T22:16:56.393 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:16:56.393 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:16:56.393 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "0d76ed78-85d0-439a-b3aa-a024ef54b0ef", 2024-09-15T22:16:56.393 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:16:56.393 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:16:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734a40f640 1 -- 172.21.15.45:0/1536405462 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f732c0a3440 msgr2=0x7f732c0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734a40f640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f732c0a3440 0x7f732c0a5900 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f733c009fd0 tx=0x7f733c004a40 comp rx=0 tx=0).stop 2024-09-15T22:16:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734a40f640 1 -- 172.21.15.45:0/1536405462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344102790 msgr2=0x7f7344074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.386+0000 7f734a40f640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344102790 0x7f7344074a30 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f733800c890 tx=0x7f733800cd50 comp rx=0 tx=0).stop 2024-09-15T22:16:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.387+0000 7f734a40f640 1 -- 172.21.15.45:0/1536405462 shutdown_connections 2024-09-15T22:16:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.387+0000 7f734a40f640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f732c0a3440 0x7f732c0a5900 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.387+0000 7f734a40f640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7344106f10 0x7f7344074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.387+0000 7f734a40f640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344102790 0x7f7344074a30 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.387+0000 7f734a40f640 1 --2- 172.21.15.45:0/1536405462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7344101de0 0x7f73440744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:56.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.387+0000 7f734a40f640 1 -- 172.21.15.45:0/1536405462 >> 172.21.15.45:0/1536405462 conn(0x7f73440fd8c0 msgr2=0x7f73440feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:56.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.387+0000 7f734a40f640 1 -- 172.21.15.45:0/1536405462 shutdown_connections 2024-09-15T22:16:56.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:56.387+0000 7f734a40f640 1 -- 172.21.15.45:0/1536405462 wait complete. 2024-09-15T22:16:57.288 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:16:57.549 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:57.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:57 smithi045 ceph-mon[31180]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-15T22:16:57.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:57 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:16:57.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:57 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:57.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:57 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:16:57.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:57 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:57.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:57 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:16:57.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:57 smithi165 ceph-mon[35551]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-15T22:16:57.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:57 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:16:57.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:57 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:57.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:57 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:16:57.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:57 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:57.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:57 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:16:57.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:57 smithi100 ceph-mon[35319]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-15T22:16:57.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:57 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:16:57.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:57 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:57.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:57 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:16:57.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:57 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:16:57.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:57 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:16:58.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.059+0000 7f44d832d640 1 -- 172.21.15.45:0/3871459872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d0106f10 msgr2=0x7f44d010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:58.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.059+0000 7f44d832d640 1 --2- 172.21.15.45:0/3871459872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d0106f10 0x7f44d010ea90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009ca0 tx=0x7f44c802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.059+0000 7f44d832d640 1 -- 172.21.15.45:0/3871459872 shutdown_connections 2024-09-15T22:16:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.059+0000 7f44d832d640 1 --2- 172.21.15.45:0/3871459872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d0106f10 0x7f44d010ea90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.059+0000 7f44d832d640 1 --2- 172.21.15.45:0/3871459872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44d0102790 0x7f44d01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.059+0000 7f44d832d640 1 --2- 172.21.15.45:0/3871459872 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44d0101de0 0x7f44d01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.059+0000 7f44d832d640 1 -- 172.21.15.45:0/3871459872 >> 172.21.15.45:0/3871459872 conn(0x7f44d00fd8c0 msgr2=0x7f44d00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.059+0000 7f44d832d640 1 -- 172.21.15.45:0/3871459872 shutdown_connections 2024-09-15T22:16:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.059+0000 7f44d832d640 1 -- 172.21.15.45:0/3871459872 wait complete. 2024-09-15T22:16:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d832d640 1 Processor -- start 2024-09-15T22:16:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d832d640 1 -- start start 2024-09-15T22:16:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d832d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44d0101de0 0x7f44d0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d832d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44d0102790 0x7f44d01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d832d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d0106f10 0x7f44d019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d832d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44d0112090 con 0x7f44d0106f10 2024-09-15T22:16:58.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d832d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f44d0111f10 con 0x7f44d0101de0 2024-09-15T22:16:58.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d832d640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f44d0112210 con 0x7f44d0102790 2024-09-15T22:16:58.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d68ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d0106f10 0x7f44d019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d68ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d0106f10 0x7f44d019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38778/0 (socket says 172.21.15.45:38778) 2024-09-15T22:16:58.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d68ca640 1 -- 172.21.15.45:0/1462191841 learned_addr learned my addr 172.21.15.45:0/1462191841 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:58.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d58c8640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44d0102790 0x7f44d01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d60c9640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44d0101de0 0x7f44d0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d68ca640 1 -- 172.21.15.45:0/1462191841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44d0102790 msgr2=0x7f44d01989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:58.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d68ca640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44d0102790 0x7f44d01989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d68ca640 1 -- 172.21.15.45:0/1462191841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44d0101de0 msgr2=0x7f44d0198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:58.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d68ca640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44d0101de0 0x7f44d0198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d68ca640 1 -- 172.21.15.45:0/1462191841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d019d420 con 0x7f44d0106f10 2024-09-15T22:16:58.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.060+0000 7f44d60c9640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44d0101de0 0x7f44d0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:58.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.061+0000 7f44d68ca640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d0106f10 0x7f44d019cd40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f44c8006010 tx=0x7f44c80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:58.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.061+0000 7f44c77fe640 1 -- 172.21.15.45:0/1462191841 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c802fa20 con 0x7f44d0106f10 2024-09-15T22:16:58.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.061+0000 7f44d832d640 1 -- 172.21.15.45:0/1462191841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d019d6b0 con 0x7f44d0106f10 2024-09-15T22:16:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.061+0000 7f44c77fe640 1 -- 172.21.15.45:0/1462191841 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44c802fbc0 con 0x7f44d0106f10 2024-09-15T22:16:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.061+0000 7f44c77fe640 1 -- 172.21.15.45:0/1462191841 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c803a730 con 0x7f44d0106f10 2024-09-15T22:16:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.061+0000 7f44d832d640 1 -- 172.21.15.45:0/1462191841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d01a4ff0 con 0x7f44d0106f10 2024-09-15T22:16:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.063+0000 7f44c77fe640 1 -- 172.21.15.45:0/1462191841 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7f44c80305c0 con 0x7f44d0106f10 2024-09-15T22:16:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.063+0000 7f44da706740 1 Processor -- start 2024-09-15T22:16:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44da706740 1 -- start start 2024-09-15T22:16:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44da706740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596885163a0 0x559688516780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44da706740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 0x559688525550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44da706740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559688525a90 0x559688527e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44da706740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55968847c2e0 con 0x559688516cc0 2024-09-15T22:16:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44da706740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559688423ce0 con 0x5596885163a0 2024-09-15T22:16:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44da706740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5596884782a0 con 0x559688525a90 2024-09-15T22:16:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44c77fe640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f44bc0a3440 0x7f44bc0a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44d60c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 0x559688525550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44d60c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 0x559688525550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38780/0 (socket says 172.21.15.45:38780) 2024-09-15T22:16:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44d60c9640 1 -- 172.21.15.45:0/205777786 learned_addr learned my addr 172.21.15.45:0/205777786 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44d68ca640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f44bc0a3440 0x7f44bc0a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44d58c8640 1 --2- 172.21.15.45:0/205777786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559688525a90 0x559688527e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44d58c8640 1 --2- 172.21.15.45:0/205777786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596885163a0 0x559688516780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44c77fe640 1 -- 172.21.15.45:0/1462191841 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f44c80f18b0 con 0x7f44d0106f10 2024-09-15T22:16:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44d60c9640 1 -- 172.21.15.45:0/205777786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559688525a90 msgr2=0x559688527e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44d60c9640 1 --2- 172.21.15.45:0/205777786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559688525a90 0x559688527e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44d60c9640 1 -- 172.21.15.45:0/205777786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596885163a0 msgr2=0x559688516780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44d60c9640 1 --2- 172.21.15.45:0/205777786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596885163a0 0x559688516780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.064+0000 7f44d60c9640 1 -- 172.21.15.45:0/205777786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559688408440 con 0x559688516cc0 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.065+0000 7f44d60c9640 1 --2- 172.21.15.45:0/205777786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 0x559688525550 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009c50 tx=0x7f44cc00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ef1955cf182657 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.065+0000 7f44d68ca640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f44bc0a3440 0x7f44bc0a5900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f44c80eed40 tx=0x7f44c80a8050 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.065+0000 7f44c4dea640 1 -- 172.21.15.45:0/205777786 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc016070 con 0x559688516cc0 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.065+0000 7f44c4dea640 1 -- 172.21.15.45:0/205777786 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44cc00ee70 con 0x559688516cc0 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.065+0000 7f44c4dea640 1 -- 172.21.15.45:0/205777786 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0116d0 con 0x559688516cc0 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.066+0000 7f44da706740 1 -- 172.21.15.45:0/205777786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 msgr2=0x559688525550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.066+0000 7f44da706740 1 --2- 172.21.15.45:0/205777786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 0x559688525550 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009c50 tx=0x7f44cc00e6c0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.066+0000 7f44da706740 1 -- 172.21.15.45:0/205777786 shutdown_connections 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.066+0000 7f44da706740 1 --2- 172.21.15.45:0/205777786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559688525a90 0x559688527e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.066+0000 7f44da706740 1 --2- 172.21.15.45:0/205777786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 0x559688525550 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.066+0000 7f44da706740 1 --2- 172.21.15.45:0/205777786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596885163a0 0x559688516780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.066+0000 7f44da706740 1 -- 172.21.15.45:0/205777786 >> 172.21.15.45:0/205777786 conn(0x559688512a30 msgr2=0x559688512e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.066+0000 7f44da706740 1 -- 172.21.15.45:0/205777786 shutdown_connections 2024-09-15T22:16:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.066+0000 7f44da706740 1 -- 172.21.15.45:0/205777786 wait complete. 2024-09-15T22:16:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.066+0000 7f44da706740 1 -- start start 2024-09-15T22:16:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.066+0000 7f44da706740 1 Processor -- start 2024-09-15T22:16:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44da706740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596885163a0 0x5596885253e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44da706740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559688516cc0 0x559688522690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44da706740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 0x559688522bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44da706740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5596885286c0 con 0x559688525a90 2024-09-15T22:16:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44da706740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559688437050 con 0x559688516cc0 2024-09-15T22:16:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44da706740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559688528840 con 0x5596885163a0 2024-09-15T22:16:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44da706740 10 client.0 _ll_register_callbacks cb 0x559688477160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44d58c8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 0x559688522bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44d58c8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 0x559688522bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38784/0 (socket says 172.21.15.45:38784) 2024-09-15T22:16:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44d58c8640 1 -- 172.21.15.45:0/3297472475 learned_addr learned my addr 172.21.15.45:0/3297472475 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:58.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44d58c8640 1 --2- 172.21.15.45:0/3297472475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596885163a0 0x5596885253e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44d60c9640 1 --2- 172.21.15.45:0/3297472475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559688516cc0 0x559688522690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44d58c8640 1 -- 172.21.15.45:0/3297472475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596885163a0 msgr2=0x5596885253e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:58.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44d58c8640 1 --2- 172.21.15.45:0/3297472475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596885163a0 0x5596885253e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44d58c8640 1 -- 172.21.15.45:0/3297472475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559688516cc0 msgr2=0x559688522690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:58.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44d58c8640 1 --2- 172.21.15.45:0/3297472475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559688516cc0 0x559688522690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44d58c8640 1 -- 172.21.15.45:0/3297472475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596881ed3c0 con 0x559688525a90 2024-09-15T22:16:58.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44d58c8640 1 --2- 172.21.15.45:0/3297472475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 0x559688522bf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f44c0012db0 tx=0x7f44c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70daa82d03456003 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:58.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:58.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44b9ffb640 1 -- 172.21.15.45:0/3297472475 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c000fe60 con 0x559688525a90 2024-09-15T22:16:58.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.067+0000 7f44b9ffb640 1 -- 172.21.15.45:0/3297472475 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f44c0012050 con 0x559688525a90 2024-09-15T22:16:58.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.068+0000 7f44da706740 1 -- 172.21.15.45:0/3297472475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44cc00ee70 con 0x559688525a90 2024-09-15T22:16:58.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.068+0000 7f44b9ffb640 1 -- 172.21.15.45:0/3297472475 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f44c002b050 con 0x559688525a90 2024-09-15T22:16:58.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.068+0000 7f44da706740 10 client.15585 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:58.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.068+0000 7f44da706740 1 -- 172.21.15.45:0/3297472475 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5596885340d0 con 0x559688525a90 2024-09-15T22:16:58.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.068+0000 7f44b9ffb640 1 -- 172.21.15.45:0/3297472475 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44cc00ee70 con 0x559688525a90 2024-09-15T22:16:58.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.068+0000 7f44b9ffb640 1 -- 172.21.15.45:0/3297472475 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f44c0004a70 con 0x559688525a90 2024-09-15T22:16:58.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.068+0000 7f44da706740 10 client.15585 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:58.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.068+0000 7f44da706740 10 client.15585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:58.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.068+0000 7f44da706740 20 client.15585 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:58.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.068+0000 7f44da706740 1 --2- 172.21.15.45:0/3297472475 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559688535590 0x5596885379a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.068+0000 7f44da706740 4 client.15585 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.068+0000 7f44da706740 1 -- 172.21.15.45:0/3297472475 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559688489850 con 0x559688535590 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.069+0000 7f44d60c9640 1 --2- 172.21.15.45:0/3297472475 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559688535590 0x5596885379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.069+0000 7f44d60c9640 1 --2- 172.21.15.45:0/3297472475 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559688535590 0x5596885379a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=270a5cb89671e22d server_cookie=4babc2c944547d51 in_seq=0 out_seq=0 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.069+0000 7f44b9ffb640 10 client.15585 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44b9ffb640 1 -- 172.21.15.45:0/3297472475 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559688489850 con 0x559688535590 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44b9ffb640 10 client.15585 handle_command_reply: tid=0 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44da706740 1 client.15585 shutdown 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44da706740 1 -- 172.21.15.45:0/3297472475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 msgr2=0x559688522bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44da706740 1 --2- 172.21.15.45:0/3297472475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 0x559688522bf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f44c0012db0 tx=0x7f44c0004730 comp rx=0 tx=0).stop 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44da706740 1 -- 172.21.15.45:0/3297472475 shutdown_connections 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44da706740 1 --2- 172.21.15.45:0/3297472475 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559688535590 0x5596885379a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44da706740 1 --2- 172.21.15.45:0/3297472475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 0x559688522bf0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44da706740 1 --2- 172.21.15.45:0/3297472475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559688516cc0 0x559688522690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44da706740 1 --2- 172.21.15.45:0/3297472475 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596885163a0 0x5596885253e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44da706740 1 -- 172.21.15.45:0/3297472475 >> 172.21.15.45:0/3297472475 conn(0x559688512a30 msgr2=0x559688518790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:58.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44b9ffb640 0 client.15585 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:58.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44da706740 1 -- 172.21.15.45:0/3297472475 shutdown_connections 2024-09-15T22:16:58.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44da706740 1 -- 172.21.15.45:0/3297472475 wait complete. 2024-09-15T22:16:58.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.070+0000 7f44da706740 20 client.15585 trim_cache size 0 max 16384 2024-09-15T22:16:58.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.087+0000 7f44da706740 1 Processor -- start 2024-09-15T22:16:58.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.087+0000 7f44da706740 1 -- start start 2024-09-15T22:16:58.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.087+0000 7f44da706740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596885163a0 0x559688531960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.087+0000 7f44da706740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 0x559688520f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.087+0000 7f44da706740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559688525a90 0x559688524600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.087+0000 7f44da706740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44d01aad70 con 0x559688516cc0 2024-09-15T22:16:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.087+0000 7f44da706740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f44d01ad5f0 con 0x5596885163a0 2024-09-15T22:16:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.087+0000 7f44da706740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f44d01ab3e0 con 0x559688525a90 2024-09-15T22:16:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44d60c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 0x559688520f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44d60c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 0x559688520f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38800/0 (socket says 172.21.15.45:38800) 2024-09-15T22:16:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44d60c9640 1 -- 172.21.15.45:0/2937750577 learned_addr learned my addr 172.21.15.45:0/2937750577 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44d58c8640 1 --2- 172.21.15.45:0/2937750577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596885163a0 0x559688531960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44d60c9640 1 -- 172.21.15.45:0/2937750577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559688525a90 msgr2=0x559688524600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44d60c9640 1 --2- 172.21.15.45:0/2937750577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559688525a90 0x559688524600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44d60c9640 1 -- 172.21.15.45:0/2937750577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596885163a0 msgr2=0x559688531960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44d60c9640 1 --2- 172.21.15.45:0/2937750577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596885163a0 0x559688531960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44d60c9640 1 -- 172.21.15.45:0/2937750577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559688521640 con 0x559688516cc0 2024-09-15T22:16:58.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44d58c8640 1 --2- 172.21.15.45:0/2937750577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596885163a0 0x559688531960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:58.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44d60c9640 1 --2- 172.21.15.45:0/2937750577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 0x559688520f60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f44cc000c00 tx=0x7f44cc004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fad76a40c08d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:58.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44bbfff640 1 -- 172.21.15.45:0/2937750577 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc016040 con 0x559688516cc0 2024-09-15T22:16:58.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44bbfff640 1 -- 172.21.15.45:0/2937750577 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44cc00ee70 con 0x559688516cc0 2024-09-15T22:16:58.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.088+0000 7f44bbfff640 1 -- 172.21.15.45:0/2937750577 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc011470 con 0x559688516cc0 2024-09-15T22:16:58.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.089+0000 7f44da706740 1 -- 172.21.15.45:0/2937750577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 msgr2=0x559688520f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:58.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.089+0000 7f44da706740 1 --2- 172.21.15.45:0/2937750577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 0x559688520f60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f44cc000c00 tx=0x7f44cc004d60 comp rx=0 tx=0).stop 2024-09-15T22:16:58.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.089+0000 7f44da706740 1 -- 172.21.15.45:0/2937750577 shutdown_connections 2024-09-15T22:16:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.089+0000 7f44da706740 1 --2- 172.21.15.45:0/2937750577 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559688525a90 0x559688524600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.089+0000 7f44da706740 1 --2- 172.21.15.45:0/2937750577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688516cc0 0x559688520f60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.089+0000 7f44da706740 1 --2- 172.21.15.45:0/2937750577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5596885163a0 0x559688531960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.089+0000 7f44da706740 1 -- 172.21.15.45:0/2937750577 >> 172.21.15.45:0/2937750577 conn(0x559688512a30 msgr2=0x559688523ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.089+0000 7f44da706740 1 -- 172.21.15.45:0/2937750577 shutdown_connections 2024-09-15T22:16:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.089+0000 7f44da706740 1 -- 172.21.15.45:0/2937750577 wait complete. 2024-09-15T22:16:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.089+0000 7f44da706740 1 -- start start 2024-09-15T22:16:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.089+0000 7f44da706740 1 Processor -- start 2024-09-15T22:16:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44da706740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596885163a0 0x559688529f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44da706740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559688516cc0 0x55968852a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44da706740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 0x55968859f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44da706740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f44d01abab0 con 0x559688525a90 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44da706740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f44d01acf20 con 0x559688516cc0 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44da706740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f44d01ac180 con 0x5596885163a0 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44da706740 10 client.0 _ll_register_callbacks cb 0x7f44c000ac30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44d58c8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 0x55968859f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44d58c8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 0x55968859f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38802/0 (socket says 172.21.15.45:38802) 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44d58c8640 1 -- 172.21.15.45:0/744480724 learned_addr learned my addr 172.21.15.45:0/744480724 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44d58c8640 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596885163a0 0x559688529f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44d60c9640 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559688516cc0 0x55968852a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44d58c8640 1 -- 172.21.15.45:0/744480724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596885163a0 msgr2=0x559688529f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44d58c8640 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596885163a0 0x559688529f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44d58c8640 1 -- 172.21.15.45:0/744480724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559688516cc0 msgr2=0x55968852a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44d58c8640 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559688516cc0 0x55968852a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44d58c8640 1 -- 172.21.15.45:0/744480724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559688516af0 con 0x559688525a90 2024-09-15T22:16:58.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44d60c9640 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559688516cc0 0x55968852a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44d58c8640 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 0x55968859f240 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f44c0012db0 tx=0x7f44c000a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9deb804728eeec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44b9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:16:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44b9ffb640 1 -- 172.21.15.45:0/744480724 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c000ae00 con 0x559688525a90 2024-09-15T22:16:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44b9ffb640 1 -- 172.21.15.45:0/744480724 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f44c001a040 con 0x559688525a90 2024-09-15T22:16:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.090+0000 7f44da706740 1 -- 172.21.15.45:0/744480724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44cc00ee70 con 0x559688525a90 2024-09-15T22:16:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.091+0000 7f44b9ffb640 1 -- 172.21.15.45:0/744480724 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f44c003d050 con 0x559688525a90 2024-09-15T22:16:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.091+0000 7f44da706740 10 client.15591 fetch_fsmap learned FSMap version 21 2024-09-15T22:16:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.091+0000 7f44da706740 1 -- 172.21.15.45:0/744480724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5596885a0830 con 0x559688525a90 2024-09-15T22:16:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.091+0000 7f44b9ffb640 1 -- 172.21.15.45:0/744480724 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f44cc00ee70 con 0x559688525a90 2024-09-15T22:16:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.091+0000 7f44b9ffb640 1 -- 172.21.15.45:0/744480724 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f44c0005320 con 0x559688525a90 2024-09-15T22:16:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.091+0000 7f44da706740 10 client.15591 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:16:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.091+0000 7f44da706740 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:16:58.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.091+0000 7f44da706740 20 client.15591 populate_metadata read hostname 'smithi045' 2024-09-15T22:16:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.091+0000 7f44da706740 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5596885a1010 0x5596885a3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.091+0000 7f44da706740 4 client.15591 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:16:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.091+0000 7f44da706740 1 -- 172.21.15.45:0/744480724 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559688483d60 con 0x5596885a1010 2024-09-15T22:16:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.091+0000 7f44d60c9640 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5596885a1010 0x5596885a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44d60c9640 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5596885a1010 0x5596885a3430 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd9f0deef41ec7e7 server_cookie=52a3abcca43aa9fa in_seq=0 out_seq=0 2024-09-15T22:16:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44b9ffb640 10 client.15591 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44b9ffb640 1 -- 172.21.15.45:0/744480724 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559688483d60 con 0x5596885a1010 2024-09-15T22:16:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44b9ffb640 10 client.15591 handle_command_reply: tid=0 2024-09-15T22:16:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44da706740 1 client.15591 shutdown 2024-09-15T22:16:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44da706740 1 -- 172.21.15.45:0/744480724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 msgr2=0x55968859f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44da706740 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 0x55968859f240 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f44c0012db0 tx=0x7f44c000a2d0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44da706740 1 -- 172.21.15.45:0/744480724 shutdown_connections 2024-09-15T22:16:58.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44da706740 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5596885a1010 0x5596885a3430 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44da706740 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559688525a90 0x55968859f240 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44da706740 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559688516cc0 0x55968852a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44da706740 1 --2- 172.21.15.45:0/744480724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5596885163a0 0x559688529f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44b9ffb640 0 client.15591 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:16:58.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44da706740 1 -- 172.21.15.45:0/744480724 >> 172.21.15.45:0/744480724 conn(0x559688512a30 msgr2=0x559688523ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:58.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44da706740 1 -- 172.21.15.45:0/744480724 shutdown_connections 2024-09-15T22:16:58.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44da706740 1 -- 172.21.15.45:0/744480724 wait complete. 2024-09-15T22:16:58.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.092+0000 7f44da706740 20 client.15591 trim_cache size 0 max 16384 2024-09-15T22:16:58.100 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:16:58.100 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:16:58.101 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:16:58.101 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:16:58.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.093+0000 7f44d832d640 1 -- 172.21.15.45:0/1462191841 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f44bc0a3440 msgr2=0x7f44bc0a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:58.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.093+0000 7f44d832d640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f44bc0a3440 0x7f44bc0a5900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f44c80eed40 tx=0x7f44c80a8050 comp rx=0 tx=0).stop 2024-09-15T22:16:58.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.093+0000 7f44d832d640 1 -- 172.21.15.45:0/1462191841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d0106f10 msgr2=0x7f44d019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:58.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.093+0000 7f44d832d640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d0106f10 0x7f44d019cd40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f44c8006010 tx=0x7f44c80319f0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.093+0000 7f44d832d640 1 -- 172.21.15.45:0/1462191841 shutdown_connections 2024-09-15T22:16:58.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.093+0000 7f44d832d640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f44bc0a3440 0x7f44bc0a5900 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.093+0000 7f44d832d640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f44d0106f10 0x7f44d019cd40 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.093+0000 7f44d832d640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f44d0102790 0x7f44d01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.093+0000 7f44d832d640 1 --2- 172.21.15.45:0/1462191841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f44d0101de0 0x7f44d0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:58.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.093+0000 7f44d832d640 1 -- 172.21.15.45:0/1462191841 >> 172.21.15.45:0/1462191841 conn(0x7f44d00fd8c0 msgr2=0x7f44d00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:58.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.093+0000 7f44d832d640 1 -- 172.21.15.45:0/1462191841 shutdown_connections 2024-09-15T22:16:58.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:58.093+0000 7f44d832d640 1 -- 172.21.15.45:0/1462191841 wait complete. 2024-09-15T22:16:58.896 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:16:58.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:16:59.152 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:16:59.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:16:59 smithi045 ceph-mon[31180]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:16:59.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.634+0000 7fa811951640 1 -- 172.21.15.45:0/1105669693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80c10e480 msgr2=0x7fa80c110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:59.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.634+0000 7fa811951640 1 --2- 172.21.15.45:0/1105669693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80c10e480 0x7fa80c110870 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009900 tx=0x7fa7fc02a410 comp rx=0 tx=0).stop 2024-09-15T22:16:59.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.634+0000 7fa811951640 1 -- 172.21.15.45:0/1105669693 shutdown_connections 2024-09-15T22:16:59.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.634+0000 7fa811951640 1 --2- 172.21.15.45:0/1105669693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80c10e480 0x7fa80c110870 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.634+0000 7fa811951640 1 --2- 172.21.15.45:0/1105669693 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa80c101280 0x7fa80c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.634+0000 7fa811951640 1 --2- 172.21.15.45:0/1105669693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c1008d0 0x7fa80c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.634+0000 7fa811951640 1 -- 172.21.15.45:0/1105669693 >> 172.21.15.45:0/1105669693 conn(0x7fa80c0fc7a0 msgr2=0x7fa80c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:59.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.634+0000 7fa811951640 1 -- 172.21.15.45:0/1105669693 shutdown_connections 2024-09-15T22:16:59.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.634+0000 7fa811951640 1 -- 172.21.15.45:0/1105669693 wait complete. 2024-09-15T22:16:59.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.635+0000 7fa811951640 1 Processor -- start 2024-09-15T22:16:59.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.635+0000 7fa811951640 1 -- start start 2024-09-15T22:16:59.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.635+0000 7fa811951640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c1008d0 0x7fa80c1a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.635+0000 7fa811951640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa80c101280 0x7fa80c1a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.635+0000 7fa811951640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80c10e480 0x7fa80c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.635+0000 7fa811951640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c114320 con 0x7fa80c10e480 2024-09-15T22:16:59.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.635+0000 7fa811951640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c1141a0 con 0x7fa80c1008d0 2024-09-15T22:16:59.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.635+0000 7fa811951640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c1144a0 con 0x7fa80c101280 2024-09-15T22:16:59.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.635+0000 7fa80b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80c10e480 0x7fa80c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.635+0000 7fa80b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80c10e480 0x7fa80c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38814/0 (socket says 172.21.15.45:38814) 2024-09-15T22:16:59.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.635+0000 7fa80b7fe640 1 -- 172.21.15.45:0/2237836803 learned_addr learned my addr 172.21.15.45:0/2237836803 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:16:59.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.635+0000 7fa80a7fc640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa80c101280 0x7fa80c1a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.636+0000 7fa80affd640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c1008d0 0x7fa80c1a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.636+0000 7fa80b7fe640 1 -- 172.21.15.45:0/2237836803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa80c101280 msgr2=0x7fa80c1a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:59.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.636+0000 7fa80b7fe640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa80c101280 0x7fa80c1a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.636+0000 7fa80b7fe640 1 -- 172.21.15.45:0/2237836803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c1008d0 msgr2=0x7fa80c1a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:59.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.636+0000 7fa80b7fe640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c1008d0 0x7fa80c1a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.636+0000 7fa80b7fe640 1 -- 172.21.15.45:0/2237836803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80c19ad40 con 0x7fa80c10e480 2024-09-15T22:16:59.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.636+0000 7fa80affd640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c1008d0 0x7fa80c1a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:16:59.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.636+0000 7fa80b7fe640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80c10e480 0x7fa80c19a610 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009230 tx=0x7fa7fc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:59.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.636+0000 7fa81094f640 1 -- 172.21.15.45:0/2237836803 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc03f030 con 0x7fa80c10e480 2024-09-15T22:16:59.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.636+0000 7fa81094f640 1 -- 172.21.15.45:0/2237836803 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa7fc003af0 con 0x7fa80c10e480 2024-09-15T22:16:59.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.636+0000 7fa811951640 1 -- 172.21.15.45:0/2237836803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa80c19afd0 con 0x7fa80c10e480 2024-09-15T22:16:59.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.636+0000 7fa81094f640 1 -- 172.21.15.45:0/2237836803 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc035070 con 0x7fa80c10e480 2024-09-15T22:16:59.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.636+0000 7fa811951640 1 -- 172.21.15.45:0/2237836803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa80c1a7320 con 0x7fa80c10e480 2024-09-15T22:16:59.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.637+0000 7fa811951640 1 -- 172.21.15.45:0/2237836803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa80c100cb0 con 0x7fa80c10e480 2024-09-15T22:16:59.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.638+0000 7fa81094f640 1 -- 172.21.15.45:0/2237836803 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fa7fc042030 con 0x7fa80c10e480 2024-09-15T22:16:59.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.639+0000 7fa81094f640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa7f80a34c0 0x7fa7f80a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:16:59.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.639+0000 7fa80affd640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa7f80a34c0 0x7fa7f80a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:16:59.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.639+0000 7fa81094f640 1 -- 172.21.15.45:0/2237836803 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fa7fc0f0ee0 con 0x7fa80c10e480 2024-09-15T22:16:59.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.640+0000 7fa80affd640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa7f80a34c0 0x7fa7f80a5980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa804007eb0 tx=0x7fa8040073c0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:16:59.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.642+0000 7fa81094f640 1 -- 172.21.15.45:0/2237836803 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa7fc0bd380 con 0x7fa80c10e480 2024-09-15T22:16:59.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:16:59 smithi165 ceph-mon[35551]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:16:59.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:16:59 smithi100 ceph-mon[35319]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T22:16:59.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.859+0000 7fa811951640 1 -- 172.21.15.45:0/2237836803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa80c109610 con 0x7fa80c10e480 2024-09-15T22:16:59.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.860+0000 7fa81094f640 1 -- 172.21.15.45:0/2237836803 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fa7fc0bcc80 con 0x7fa80c10e480 2024-09-15T22:16:59.863 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:16:59.863 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:16:59.863 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:16:59.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.862+0000 7fa811951640 1 -- 172.21.15.45:0/2237836803 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa7f80a34c0 msgr2=0x7fa7f80a5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:59.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.862+0000 7fa811951640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa7f80a34c0 0x7fa7f80a5980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa804007eb0 tx=0x7fa8040073c0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.862+0000 7fa811951640 1 -- 172.21.15.45:0/2237836803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80c10e480 msgr2=0x7fa80c19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:16:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.862+0000 7fa811951640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80c10e480 0x7fa80c19a610 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009230 tx=0x7fa7fc004270 comp rx=0 tx=0).stop 2024-09-15T22:16:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.862+0000 7fa811951640 1 -- 172.21.15.45:0/2237836803 shutdown_connections 2024-09-15T22:16:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.862+0000 7fa811951640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa7f80a34c0 0x7fa7f80a5980 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.862+0000 7fa811951640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa80c10e480 0x7fa80c19a610 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.862+0000 7fa811951640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa80c101280 0x7fa80c1a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.862+0000 7fa811951640 1 --2- 172.21.15.45:0/2237836803 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa80c1008d0 0x7fa80c1a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:16:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.862+0000 7fa811951640 1 -- 172.21.15.45:0/2237836803 >> 172.21.15.45:0/2237836803 conn(0x7fa80c0fc7a0 msgr2=0x7fa80c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:16:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.862+0000 7fa811951640 1 -- 172.21.15.45:0/2237836803 shutdown_connections 2024-09-15T22:16:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:16:59.862+0000 7fa811951640 1 -- 172.21.15.45:0/2237836803 wait complete. 2024-09-15T22:17:00.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:00 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2237836803' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:00.678 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:17:00.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:00 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2237836803' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:00.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:00 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2237836803' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:00.952 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:01.050 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:17:00 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:17:00.873+0000 7fcfeeab5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:17:01.050 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:17:00 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:17:00.873+0000 7fcfeeab5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:17:01.050 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:17:00 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:17:00.873+0000 7fcfeeab5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:17:01.051 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:17:00 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:17:00.873+0000 7fcfeeab5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:17:01.051 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:17:00 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:17:00.873+0000 7fcfeeab5640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T22:17:01.405 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:01 smithi045 ceph-mon[31180]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-15T22:17:01.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:01 smithi165 ceph-mon[35551]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-15T22:17:01.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.488+0000 7fdfa8ed8640 1 -- 172.21.15.45:0/1139120389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa4102570 msgr2=0x7fdfa41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:01.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.488+0000 7fdfa8ed8640 1 --2- 172.21.15.45:0/1139120389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa4102570 0x7fdfa41029b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009900 tx=0x7fdf8c02a480 comp rx=0 tx=0).stop 2024-09-15T22:17:01.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.488+0000 7fdfa8ed8640 1 -- 172.21.15.45:0/1139120389 shutdown_connections 2024-09-15T22:17:01.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.488+0000 7fdfa8ed8640 1 --2- 172.21.15.45:0/1139120389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfa4102ef0 0x7fdfa410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.488+0000 7fdfa8ed8640 1 --2- 172.21.15.45:0/1139120389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa4102570 0x7fdfa41029b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.488+0000 7fdfa8ed8640 1 --2- 172.21.15.45:0/1139120389 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfa4100e20 0x7fdfa4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.488+0000 7fdfa8ed8640 1 -- 172.21.15.45:0/1139120389 >> 172.21.15.45:0/1139120389 conn(0x7fdfa40fc7d0 msgr2=0x7fdfa40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:01.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.488+0000 7fdfa8ed8640 1 -- 172.21.15.45:0/1139120389 shutdown_connections 2024-09-15T22:17:01.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.488+0000 7fdfa8ed8640 1 -- 172.21.15.45:0/1139120389 wait complete. 2024-09-15T22:17:01.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.488+0000 7fdfa8ed8640 1 Processor -- start 2024-09-15T22:17:01.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa8ed8640 1 -- start start 2024-09-15T22:17:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa8ed8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfa4100e20 0x7fdfa4199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa8ed8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa4102570 0x7fdfa41999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa8ed8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfa4102ef0 0x7fdfa41a4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa8ed8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa41110e0 con 0x7fdfa4102570 2024-09-15T22:17:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa8ed8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa4110f60 con 0x7fdfa4102ef0 2024-09-15T22:17:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa8ed8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa4111260 con 0x7fdfa4100e20 2024-09-15T22:17:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa4102570 0x7fdfa41999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa4102570 0x7fdfa41999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38838/0 (socket says 172.21.15.45:38838) 2024-09-15T22:17:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa1d9b640 1 -- 172.21.15.45:0/2724435694 learned_addr learned my addr 172.21.15.45:0/2724435694 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa2d9d640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfa4102ef0 0x7fdfa41a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa259c640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfa4100e20 0x7fdfa4199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa1d9b640 1 -- 172.21.15.45:0/2724435694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfa4100e20 msgr2=0x7fdfa4199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa1d9b640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfa4100e20 0x7fdfa4199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa1d9b640 1 -- 172.21.15.45:0/2724435694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfa4102ef0 msgr2=0x7fdfa41a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa1d9b640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfa4102ef0 0x7fdfa41a4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa1d9b640 1 -- 172.21.15.45:0/2724435694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa41a4a50 con 0x7fdfa4102570 2024-09-15T22:17:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa259c640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfa4100e20 0x7fdfa4199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:17:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.489+0000 7fdfa1d9b640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa4102570 0x7fdfa41999d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c006010 tx=0x7fdf8c004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.490+0000 7fdf9b7fe640 1 -- 172.21.15.45:0/2724435694 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c03f030 con 0x7fdfa4102570 2024-09-15T22:17:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.490+0000 7fdfa8ed8640 1 -- 172.21.15.45:0/2724435694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa41a4c20 con 0x7fdfa4102570 2024-09-15T22:17:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.490+0000 7fdf9b7fe640 1 -- 172.21.15.45:0/2724435694 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdf8c005500 con 0x7fdfa4102570 2024-09-15T22:17:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.490+0000 7fdfa8ed8640 1 -- 172.21.15.45:0/2724435694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa41a5080 con 0x7fdfa4102570 2024-09-15T22:17:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.490+0000 7fdf9b7fe640 1 -- 172.21.15.45:0/2724435694 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c049060 con 0x7fdfa4102570 2024-09-15T22:17:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.492+0000 7fdf9b7fe640 1 -- 172.21.15.45:0/2724435694 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 23) ==== 138531+0+0 (secure 0 0 0) 0x7fdf8c042030 con 0x7fdfa4102570 2024-09-15T22:17:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.492+0000 7fdfab2b1740 1 Processor -- start 2024-09-15T22:17:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.492+0000 7fdfab2b1740 1 -- start start 2024-09-15T22:17:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfab2b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc5b40 0x560e43dc4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfab2b1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dc45d0 0x560e43dc4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfab2b1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dcf370 0x560e43dd1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfab2b1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560e43d2a2f0 con 0x560e43dcf370 2024-09-15T22:17:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfab2b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560e43cd1cf0 con 0x560e43dc5b40 2024-09-15T22:17:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfab2b1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560e43d262b0 con 0x560e43dc45d0 2024-09-15T22:17:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdf9b7fe640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fdf900a3440 0x7fdf900a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfa1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dcf370 0x560e43dd1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfa2d9d640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fdf900a3440 0x7fdf900a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfa1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dcf370 0x560e43dd1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38852/0 (socket says 172.21.15.45:38852) 2024-09-15T22:17:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfa1d9b640 1 -- 172.21.15.45:0/3149245130 learned_addr learned my addr 172.21.15.45:0/3149245130 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfa2d9d640 1 --2- 172.21.15.45:0/3149245130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc5b40 0x560e43dc4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdf9b7fe640 1 -- 172.21.15.45:0/2724435694 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fdf8c0f0c20 con 0x7fdfa4102570 2024-09-15T22:17:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfa259c640 1 --2- 172.21.15.45:0/3149245130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dc45d0 0x560e43dc4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfa1d9b640 1 -- 172.21.15.45:0/3149245130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dc45d0 msgr2=0x560e43dc4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfa1d9b640 1 --2- 172.21.15.45:0/3149245130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dc45d0 0x560e43dc4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfa1d9b640 1 -- 172.21.15.45:0/3149245130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc5b40 msgr2=0x560e43dc4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfa1d9b640 1 --2- 172.21.15.45:0/3149245130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc5b40 0x560e43dc4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfa1d9b640 1 -- 172.21.15.45:0/3149245130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e43cb63a0 con 0x560e43dcf370 2024-09-15T22:17:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.493+0000 7fdfa259c640 1 --2- 172.21.15.45:0/3149245130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dc45d0 0x560e43dc4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:17:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.494+0000 7fdfa1d9b640 1 --2- 172.21.15.45:0/3149245130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dcf370 0x560e43dd1760 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0b93f0 tx=0x7fdf8c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3d8f3a3616c364 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.494+0000 7fdfa2d9d640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fdf900a3440 0x7fdf900a5900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdf940077f0 tx=0x7fdf94007de0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.494+0000 7fdf98ff9640 1 -- 172.21.15.45:0/3149245130 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c035070 con 0x560e43dcf370 2024-09-15T22:17:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.494+0000 7fdf98ff9640 1 -- 172.21.15.45:0/3149245130 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdf8c0047a0 con 0x560e43dcf370 2024-09-15T22:17:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.494+0000 7fdf98ff9640 1 -- 172.21.15.45:0/3149245130 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0b9090 con 0x560e43dcf370 2024-09-15T22:17:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3149245130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dcf370 msgr2=0x560e43dd1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3149245130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dcf370 0x560e43dd1760 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0b93f0 tx=0x7fdf8c02a480 comp rx=0 tx=0).stop 2024-09-15T22:17:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3149245130 shutdown_connections 2024-09-15T22:17:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3149245130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dcf370 0x560e43dd1760 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3149245130 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dc45d0 0x560e43dc4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3149245130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc5b40 0x560e43dc4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3149245130 >> 172.21.15.45:0/3149245130 conn(0x560e43d8d310 msgr2=0x560e43dc0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3149245130 shutdown_connections 2024-09-15T22:17:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3149245130 wait complete. 2024-09-15T22:17:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 -- start start 2024-09-15T22:17:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 Processor -- start 2024-09-15T22:17:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 0x560e43dced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc5b40 0x560e43dcc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dcf370 0x560e43dcc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560e43dd1e30 con 0x560e43dc45d0 2024-09-15T22:17:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560e43ce5060 con 0x560e43dc5b40 2024-09-15T22:17:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560e43dd1fb0 con 0x560e43dcf370 2024-09-15T22:17:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.495+0000 7fdfab2b1740 10 client.0 _ll_register_callbacks cb 0x560e43a388c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfa259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 0x560e43dced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfa259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 0x560e43dced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38866/0 (socket says 172.21.15.45:38866) 2024-09-15T22:17:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfa259c640 1 -- 172.21.15.45:0/171684291 learned_addr learned my addr 172.21.15.45:0/171684291 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfa1d9b640 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc5b40 0x560e43dcc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfa2d9d640 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dcf370 0x560e43dcc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfa259c640 1 -- 172.21.15.45:0/171684291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dcf370 msgr2=0x560e43dcc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfa259c640 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dcf370 0x560e43dcc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfa259c640 1 -- 172.21.15.45:0/171684291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc5b40 msgr2=0x560e43dcc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfa259c640 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc5b40 0x560e43dcc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfa259c640 1 -- 172.21.15.45:0/171684291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e43a9b3c0 con 0x560e43dc45d0 2024-09-15T22:17:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfa2d9d640 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dcf370 0x560e43dcc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfa259c640 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 0x560e43dced50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00bfa0 tx=0x7fdf9c00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a939ad886e7bbdbb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdf89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdf89ffb640 1 -- 172.21.15.45:0/171684291 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c018020 con 0x560e43dc45d0 2024-09-15T22:17:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdf89ffb640 1 -- 172.21.15.45:0/171684291 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fdf9c014870 con 0x560e43dc45d0 2024-09-15T22:17:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfab2b1740 1 -- 172.21.15.45:0/171684291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf8c0047a0 con 0x560e43dc45d0 2024-09-15T22:17:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdf89ffb640 1 -- 172.21.15.45:0/171684291 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdf9c023050 con 0x560e43dc45d0 2024-09-15T22:17:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfab2b1740 10 client.15615 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.496+0000 7fdfab2b1740 1 -- 172.21.15.45:0/171684291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560e43ddd800 con 0x560e43dc45d0 2024-09-15T22:17:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.497+0000 7fdf89ffb640 1 -- 172.21.15.45:0/171684291 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdf8c0047a0 con 0x560e43dc45d0 2024-09-15T22:17:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.497+0000 7fdf89ffb640 1 -- 172.21.15.45:0/171684291 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdf9c013b70 con 0x560e43dc45d0 2024-09-15T22:17:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.497+0000 7fdfab2b1740 10 client.15615 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.497+0000 7fdfab2b1740 10 client.15615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.497+0000 7fdfab2b1740 20 client.15615 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.497+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560e43ddec10 0x560e43de1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.497+0000 7fdfab2b1740 4 client.15615 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.497+0000 7fdfab2b1740 1 -- 172.21.15.45:0/171684291 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e43d37860 con 0x560e43ddec10 2024-09-15T22:17:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.497+0000 7fdfa1d9b640 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560e43ddec10 0x560e43de1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.498+0000 7fdf89ffb640 10 client.15615 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.498+0000 7fdfa1d9b640 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560e43ddec10 0x560e43de1020 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84b1de7e60471e13 server_cookie=6fe6ba4a6a07b410 in_seq=0 out_seq=0 2024-09-15T22:17:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.498+0000 7fdf89ffb640 1 -- 172.21.15.45:0/171684291 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e43d37860 con 0x560e43ddec10 2024-09-15T22:17:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.498+0000 7fdf89ffb640 10 client.15615 handle_command_reply: tid=0 2024-09-15T22:17:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.498+0000 7fdfab2b1740 1 client.15615 shutdown 2024-09-15T22:17:01.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.498+0000 7fdfab2b1740 1 -- 172.21.15.45:0/171684291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 msgr2=0x560e43dced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:01.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.498+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 0x560e43dced50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00bfa0 tx=0x7fdf9c00f670 comp rx=0 tx=0).stop 2024-09-15T22:17:01.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.498+0000 7fdfab2b1740 1 -- 172.21.15.45:0/171684291 shutdown_connections 2024-09-15T22:17:01.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.498+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560e43ddec10 0x560e43de1020 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.499+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dcf370 0x560e43dcc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.499+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc5b40 0x560e43dcc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.499+0000 7fdf89ffb640 0 client.15615 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:01.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.499+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/171684291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 0x560e43dced50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.499+0000 7fdfab2b1740 1 -- 172.21.15.45:0/171684291 >> 172.21.15.45:0/171684291 conn(0x560e43d8d310 msgr2=0x560e43dc6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:01.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.499+0000 7fdfab2b1740 1 -- 172.21.15.45:0/171684291 shutdown_connections 2024-09-15T22:17:01.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.499+0000 7fdfab2b1740 1 -- 172.21.15.45:0/171684291 wait complete. 2024-09-15T22:17:01.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.499+0000 7fdfab2b1740 20 client.15615 trim_cache size 0 max 16384 2024-09-15T22:17:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfab2b1740 1 Processor -- start 2024-09-15T22:17:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfab2b1740 1 -- start start 2024-09-15T22:17:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfab2b1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 0x560e43dcdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfab2b1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dc5b40 0x560e43dc7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfab2b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dcf370 0x560e43dc7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfab2b1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa41acee0 con 0x560e43dc45d0 2024-09-15T22:17:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfab2b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa41af760 con 0x560e43dcf370 2024-09-15T22:17:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfab2b1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa41ad550 con 0x560e43dc5b40 2024-09-15T22:17:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfa259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 0x560e43dcdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfa259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 0x560e43dcdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38876/0 (socket says 172.21.15.45:38876) 2024-09-15T22:17:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfa259c640 1 -- 172.21.15.45:0/3137103431 learned_addr learned my addr 172.21.15.45:0/3137103431 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfa259c640 1 -- 172.21.15.45:0/3137103431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dc5b40 msgr2=0x560e43dc7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfa259c640 1 --2- 172.21.15.45:0/3137103431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dc5b40 0x560e43dc7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfa259c640 1 -- 172.21.15.45:0/3137103431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dcf370 msgr2=0x560e43dc7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfa259c640 1 --2- 172.21.15.45:0/3137103431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dcf370 0x560e43dc7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.512+0000 7fdfa259c640 1 -- 172.21.15.45:0/3137103431 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e43dce970 con 0x560e43dc45d0 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.513+0000 7fdfa259c640 1 --2- 172.21.15.45:0/3137103431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 0x560e43dcdf70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c000c00 tx=0x7fdf9c013f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6731e8aade7e32e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.513+0000 7fdf8bfff640 1 -- 172.21.15.45:0/3137103431 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c02b070 con 0x560e43dc45d0 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.513+0000 7fdf8bfff640 1 -- 172.21.15.45:0/3137103431 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdf9c01c7e0 con 0x560e43dc45d0 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.513+0000 7fdf8bfff640 1 -- 172.21.15.45:0/3137103431 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c018050 con 0x560e43dc45d0 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.513+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3137103431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 msgr2=0x560e43dcdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.513+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3137103431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 0x560e43dcdf70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c000c00 tx=0x7fdf9c013f90 comp rx=0 tx=0).stop 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.513+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3137103431 shutdown_connections 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.513+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3137103431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dcf370 0x560e43dc7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.513+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3137103431 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dc5b40 0x560e43dc7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.513+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3137103431 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc45d0 0x560e43dcdf70 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.513+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3137103431 >> 172.21.15.45:0/3137103431 conn(0x560e43d8d310 msgr2=0x560e43dcd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3137103431 shutdown_connections 2024-09-15T22:17:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3137103431 wait complete. 2024-09-15T22:17:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfab2b1740 1 -- start start 2024-09-15T22:17:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfab2b1740 1 Processor -- start 2024-09-15T22:17:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfab2b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc45d0 0x560e43dd2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfab2b1740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc5b40 0x560e43dd3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfab2b1740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dcf370 0x560e43dd3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfab2b1740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa41adc20 con 0x560e43dc5b40 2024-09-15T22:17:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfab2b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa41af090 con 0x560e43dc45d0 2024-09-15T22:17:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfab2b1740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa41ae2f0 con 0x560e43dcf370 2024-09-15T22:17:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfab2b1740 10 client.0 _ll_register_callbacks cb 0x7fdf9c00b2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfa1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc5b40 0x560e43dd3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfa1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc5b40 0x560e43dd3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38884/0 (socket says 172.21.15.45:38884) 2024-09-15T22:17:01.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfa1d9b640 1 -- 172.21.15.45:0/3163422144 learned_addr learned my addr 172.21.15.45:0/3163422144 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:01.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfa2d9d640 1 --2- 172.21.15.45:0/3163422144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dcf370 0x560e43dd3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.514+0000 7fdfa259c640 1 --2- 172.21.15.45:0/3163422144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc45d0 0x560e43dd2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdfa1d9b640 1 -- 172.21.15.45:0/3163422144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dcf370 msgr2=0x560e43dd3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:01.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdfa1d9b640 1 --2- 172.21.15.45:0/3163422144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dcf370 0x560e43dd3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdfa1d9b640 1 -- 172.21.15.45:0/3163422144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc45d0 msgr2=0x560e43dd2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:01.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdfa1d9b640 1 --2- 172.21.15.45:0/3163422144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc45d0 0x560e43dd2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdfa1d9b640 1 -- 172.21.15.45:0/3163422144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e43e48970 con 0x560e43dc5b40 2024-09-15T22:17:01.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdfa1d9b640 1 --2- 172.21.15.45:0/3163422144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc5b40 0x560e43dd3440 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0bc720 tx=0x7fdf8c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20871ffc0c6dd782 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:01.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdf89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:01.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdf89ffb640 1 -- 172.21.15.45:0/3163422144 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c035040 con 0x560e43dc5b40 2024-09-15T22:17:01.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdf89ffb640 1 -- 172.21.15.45:0/3163422144 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7fdf8c004370 con 0x560e43dc5b40 2024-09-15T22:17:01.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3163422144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf9c01c7e0 con 0x560e43dc5b40 2024-09-15T22:17:01.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdf89ffb640 1 -- 172.21.15.45:0/3163422144 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdf8c0a0050 con 0x560e43dc5b40 2024-09-15T22:17:01.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdfab2b1740 10 client.15621 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:01.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3163422144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560e43e49c30 con 0x560e43dc5b40 2024-09-15T22:17:01.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.515+0000 7fdf89ffb640 1 -- 172.21.15.45:0/3163422144 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdf9c01c7e0 con 0x560e43dc5b40 2024-09-15T22:17:01.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.516+0000 7fdf89ffb640 1 -- 172.21.15.45:0/3163422144 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdf8c0b9090 con 0x560e43dc5b40 2024-09-15T22:17:01.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.516+0000 7fdfab2b1740 10 client.15621 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:01.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.516+0000 7fdfab2b1740 10 client.15621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:01.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.516+0000 7fdfab2b1740 20 client.15621 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:01.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.516+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3163422144 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560e43e4a220 0x560e43e4c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:01.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.516+0000 7fdfab2b1740 4 client.15621 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:17:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.516+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3163422144 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560e43d31d70 con 0x560e43e4a220 2024-09-15T22:17:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.516+0000 7fdfa259c640 1 --2- 172.21.15.45:0/3163422144 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560e43e4a220 0x560e43e4c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.516+0000 7fdfa259c640 1 --2- 172.21.15.45:0/3163422144 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560e43e4a220 0x560e43e4c640 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15c78ac667b208df server_cookie=1ab2afd327a06aad in_seq=0 out_seq=0 2024-09-15T22:17:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.516+0000 7fdf89ffb640 10 client.15621 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.516+0000 7fdf89ffb640 1 -- 172.21.15.45:0/3163422144 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560e43d31d70 con 0x560e43e4a220 2024-09-15T22:17:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.516+0000 7fdf89ffb640 10 client.15621 handle_command_reply: tid=0 2024-09-15T22:17:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.516+0000 7fdfab2b1740 1 client.15621 shutdown 2024-09-15T22:17:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3163422144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc5b40 msgr2=0x560e43dd3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3163422144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc5b40 0x560e43dd3440 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0bc720 tx=0x7fdf8c0035f0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3163422144 shutdown_connections 2024-09-15T22:17:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3163422144 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560e43e4a220 0x560e43e4c640 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3163422144 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560e43dcf370 0x560e43dd3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3163422144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560e43dc5b40 0x560e43dd3440 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfab2b1740 1 --2- 172.21.15.45:0/3163422144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560e43dc45d0 0x560e43dd2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3163422144 >> 172.21.15.45:0/3163422144 conn(0x560e43d8d310 msgr2=0x560e43dce080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:01.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdf89ffb640 0 client.15621 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:01.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3163422144 shutdown_connections 2024-09-15T22:17:01.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfab2b1740 1 -- 172.21.15.45:0/3163422144 wait complete. 2024-09-15T22:17:01.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfab2b1740 20 client.15621 trim_cache size 0 max 16384 2024-09-15T22:17:01.527 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:17:01.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfa8ed8640 1 -- 172.21.15.45:0/2724435694 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fdf900a3440 msgr2=0x7fdf900a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:01.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfa8ed8640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fdf900a3440 0x7fdf900a5900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdf940077f0 tx=0x7fdf94007de0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfa8ed8640 1 -- 172.21.15.45:0/2724435694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa4102570 msgr2=0x7fdfa41999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:01.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfa8ed8640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa4102570 0x7fdfa41999d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c006010 tx=0x7fdf8c004c00 comp rx=0 tx=0).stop 2024-09-15T22:17:01.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfa8ed8640 1 -- 172.21.15.45:0/2724435694 shutdown_connections 2024-09-15T22:17:01.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfa8ed8640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fdf900a3440 0x7fdf900a5900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfa8ed8640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdfa4102ef0 0x7fdfa41a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfa8ed8640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfa4102570 0x7fdfa41999d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfa8ed8640 1 --2- 172.21.15.45:0/2724435694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdfa4100e20 0x7fdfa4199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:01.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.517+0000 7fdfa8ed8640 1 -- 172.21.15.45:0/2724435694 >> 172.21.15.45:0/2724435694 conn(0x7fdfa40fc7d0 msgr2=0x7fdfa4106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:01.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.518+0000 7fdfa8ed8640 1 -- 172.21.15.45:0/2724435694 shutdown_connections 2024-09-15T22:17:01.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:01.518+0000 7fdfa8ed8640 1 -- 172.21.15.45:0/2724435694 wait complete. 2024-09-15T22:17:01.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:01 smithi100 ceph-mon[35319]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-15T22:17:03.327 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:17:03.327 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:17:03.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:03 smithi045 ceph-mon[31180]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:17:03.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:03 smithi045 ceph-mon[31180]: mgrmap e24: x(active, since 44s), standbys: z, y 2024-09-15T22:17:03.601 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:03.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:03 smithi165 ceph-mon[35551]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:17:03.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:03 smithi165 ceph-mon[35551]: mgrmap e24: x(active, since 44s), standbys: z, y 2024-09-15T22:17:03.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:03 smithi100 ceph-mon[35319]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:17:03.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:03 smithi100 ceph-mon[35319]: mgrmap e24: x(active, since 44s), standbys: z, y 2024-09-15T22:17:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.100+0000 7f37395ff640 1 -- 172.21.15.45:0/448720301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3734106f10 msgr2=0x7f373410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.100+0000 7f37395ff640 1 --2- 172.21.15.45:0/448720301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3734106f10 0x7f373410ea90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f372c009ca0 tx=0x7f372c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.100+0000 7f37395ff640 1 -- 172.21.15.45:0/448720301 shutdown_connections 2024-09-15T22:17:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.100+0000 7f37395ff640 1 --2- 172.21.15.45:0/448720301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3734106f10 0x7f373410ea90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.100+0000 7f37395ff640 1 --2- 172.21.15.45:0/448720301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3734102790 0x7f37341067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.100+0000 7f37395ff640 1 --2- 172.21.15.45:0/448720301 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3734101de0 0x7f37341021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.101+0000 7f37395ff640 1 -- 172.21.15.45:0/448720301 >> 172.21.15.45:0/448720301 conn(0x7f37340fd8c0 msgr2=0x7f37340ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:04.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.101+0000 7f37395ff640 1 -- 172.21.15.45:0/448720301 shutdown_connections 2024-09-15T22:17:04.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.101+0000 7f37395ff640 1 -- 172.21.15.45:0/448720301 wait complete. 2024-09-15T22:17:04.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.101+0000 7f37395ff640 1 Processor -- start 2024-09-15T22:17:04.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.101+0000 7f37395ff640 1 -- start start 2024-09-15T22:17:04.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.101+0000 7f37395ff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3734101de0 0x7f37340744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37395ff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3734102790 0x7f3734074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37395ff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3734106f10 0x7f3734074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37395ff640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3734112090 con 0x7f3734106f10 2024-09-15T22:17:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37395ff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3734111f10 con 0x7f3734102790 2024-09-15T22:17:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37395ff640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3734112210 con 0x7f3734101de0 2024-09-15T22:17:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3734106f10 0x7f3734074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3734106f10 0x7f3734074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38906/0 (socket says 172.21.15.45:38906) 2024-09-15T22:17:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37337fe640 1 -- 172.21.15.45:0/3891475297 learned_addr learned my addr 172.21.15.45:0/3891475297 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f3732ffd640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3734101de0 0x7f37340744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f372bfff640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3734102790 0x7f3734074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37337fe640 1 -- 172.21.15.45:0/3891475297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3734101de0 msgr2=0x7f37340744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37337fe640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3734101de0 0x7f37340744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37337fe640 1 -- 172.21.15.45:0/3891475297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3734102790 msgr2=0x7f3734074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37337fe640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3734102790 0x7f3734074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37337fe640 1 -- 172.21.15.45:0/3891475297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37341a6970 con 0x7f3734106f10 2024-09-15T22:17:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.102+0000 7f37337fe640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3734106f10 0x7f3734074f70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f372c006010 tx=0x7f372c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.103+0000 7f3730ff9640 1 -- 172.21.15.45:0/3891475297 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c02fa20 con 0x7f3734106f10 2024-09-15T22:17:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.103+0000 7f3730ff9640 1 -- 172.21.15.45:0/3891475297 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f372c02fbc0 con 0x7f3734106f10 2024-09-15T22:17:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.103+0000 7f37395ff640 1 -- 172.21.15.45:0/3891475297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37341a6c00 con 0x7f3734106f10 2024-09-15T22:17:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.103+0000 7f3730ff9640 1 -- 172.21.15.45:0/3891475297 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c046860 con 0x7f3734106f10 2024-09-15T22:17:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.103+0000 7f37395ff640 1 -- 172.21.15.45:0/3891475297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37341a7190 con 0x7f3734106f10 2024-09-15T22:17:04.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.105+0000 7f373b9d8740 1 Processor -- start 2024-09-15T22:17:04.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.105+0000 7f3730ff9640 1 -- 172.21.15.45:0/3891475297 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f372c046a00 con 0x7f3734106f10 2024-09-15T22:17:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.105+0000 7f373b9d8740 1 -- start start 2024-09-15T22:17:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f373b9d8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a3b60 0x5563665a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f373b9d8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665a4480 0x5563665ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f373b9d8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665aed40 0x5563665b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f373b9d8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556366509280 con 0x5563665a3b60 2024-09-15T22:17:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f373b9d8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5563664b0b10 con 0x5563665a4480 2024-09-15T22:17:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f373b9d8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556366505240 con 0x5563665aed40 2024-09-15T22:17:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f372bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a3b60 0x5563665a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f372bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a3b60 0x5563665a3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38922/0 (socket says 172.21.15.45:38922) 2024-09-15T22:17:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f372bfff640 1 -- 172.21.15.45:0/1367185187 learned_addr learned my addr 172.21.15.45:0/1367185187 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f372bfff640 1 --2- 172.21.15.45:0/1367185187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665aed40 0x5563665b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f3732ffd640 1 --2- 172.21.15.45:0/1367185187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665a4480 0x5563665ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f372bfff640 1 -- 172.21.15.45:0/1367185187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665aed40 msgr2=0x5563665b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f372bfff640 1 --2- 172.21.15.45:0/1367185187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665aed40 0x5563665b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f372bfff640 1 -- 172.21.15.45:0/1367185187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665a4480 msgr2=0x5563665ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.106+0000 7f372bfff640 1 --2- 172.21.15.45:0/1367185187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665a4480 0x5563665ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.107+0000 7f372bfff640 1 -- 172.21.15.45:0/1367185187 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563664bd1f0 con 0x5563665a3b60 2024-09-15T22:17:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.107+0000 7f3732ffd640 1 --2- 172.21.15.45:0/1367185187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665a4480 0x5563665ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.107+0000 7f3730ff9640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f37200a3550 0x7f37200a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.107+0000 7f372bfff640 1 --2- 172.21.15.45:0/1367185187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a3b60 0x5563665a3f40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f371c00adc0 tx=0x7f371c00a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08b85d6edd57e06 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.107+0000 7f3732ffd640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f37200a3550 0x7f37200a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.107+0000 7f3730ff9640 1 -- 172.21.15.45:0/3891475297 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f372c0f1860 con 0x7f3734106f10 2024-09-15T22:17:04.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.107+0000 7f37297fa640 1 -- 172.21.15.45:0/1367185187 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c005020 con 0x5563665a3b60 2024-09-15T22:17:04.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.107+0000 7f37297fa640 1 -- 172.21.15.45:0/1367185187 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f371c017030 con 0x5563665a3b60 2024-09-15T22:17:04.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.107+0000 7f37297fa640 1 -- 172.21.15.45:0/1367185187 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c00f6b0 con 0x5563665a3b60 2024-09-15T22:17:04.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.108+0000 7f373b9d8740 1 -- 172.21.15.45:0/1367185187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a3b60 msgr2=0x5563665a3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:04.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.108+0000 7f3732ffd640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f37200a3550 0x7f37200a5a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x5563665a0f50 tx=0x7f372400b390 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:04.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.108+0000 7f373b9d8740 1 --2- 172.21.15.45:0/1367185187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a3b60 0x5563665a3f40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f371c00adc0 tx=0x7f371c00a6e0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.108+0000 7f373b9d8740 1 -- 172.21.15.45:0/1367185187 shutdown_connections 2024-09-15T22:17:04.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.108+0000 7f373b9d8740 1 --2- 172.21.15.45:0/1367185187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665aed40 0x5563665b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.108+0000 7f373b9d8740 1 --2- 172.21.15.45:0/1367185187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665a4480 0x5563665ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.108+0000 7f373b9d8740 1 --2- 172.21.15.45:0/1367185187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a3b60 0x5563665a3f40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.108+0000 7f373b9d8740 1 -- 172.21.15.45:0/1367185187 >> 172.21.15.45:0/1367185187 conn(0x5563665a00f0 msgr2=0x5563665a04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:04.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.108+0000 7f373b9d8740 1 -- 172.21.15.45:0/1367185187 shutdown_connections 2024-09-15T22:17:04.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.108+0000 7f373b9d8740 1 -- 172.21.15.45:0/1367185187 wait complete. 2024-09-15T22:17:04.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f373b9d8740 1 -- start start 2024-09-15T22:17:04.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f373b9d8740 1 Processor -- start 2024-09-15T22:17:04.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f373b9d8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665abc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f373b9d8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665ac170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f373b9d8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 0x5563665ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f373b9d8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5563665b1910 con 0x5563665a4480 2024-09-15T22:17:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f373b9d8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5563664c3f10 con 0x5563665aed40 2024-09-15T22:17:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f373b9d8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5563665b1a90 con 0x5563665a3b60 2024-09-15T22:17:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f372bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f373b9d8740 10 client.0 _ll_register_callbacks cb 0x55636648ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f372bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665ac170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38934/0 (socket says 172.21.15.45:38934) 2024-09-15T22:17:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f372bfff640 1 -- 172.21.15.45:0/3079866285 learned_addr learned my addr 172.21.15.45:0/3079866285 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f3732ffd640 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f37337fe640 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 0x5563665ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f372bfff640 1 -- 172.21.15.45:0/3079866285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 msgr2=0x5563665abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f372bfff640 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665abc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f372bfff640 1 -- 172.21.15.45:0/3079866285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 msgr2=0x5563665ac6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f372bfff640 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 0x5563665ac6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f372bfff640 1 -- 172.21.15.45:0/3079866285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55636627a6a0 con 0x5563665a4480 2024-09-15T22:17:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.109+0000 7f37337fe640 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 0x5563665ac6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.110+0000 7f372bfff640 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665ac170 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f371c004f70 tx=0x7f371c004c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d4c0390fde7982 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.110+0000 7f371a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.110+0000 7f371a7fc640 1 -- 172.21.15.45:0/3079866285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c0051d0 con 0x5563665a4480 2024-09-15T22:17:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.110+0000 7f371a7fc640 1 -- 172.21.15.45:0/3079866285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f371c005370 con 0x5563665a4480 2024-09-15T22:17:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.110+0000 7f373b9d8740 1 -- 172.21.15.45:0/3079866285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f371c017030 con 0x5563665a4480 2024-09-15T22:17:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.110+0000 7f371a7fc640 1 -- 172.21.15.45:0/3079866285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f371c02e050 con 0x5563665a4480 2024-09-15T22:17:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.110+0000 7f373b9d8740 10 client.15633 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.110+0000 7f373b9d8740 1 -- 172.21.15.45:0/3079866285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5563665bd490 con 0x5563665a4480 2024-09-15T22:17:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.110+0000 7f371a7fc640 1 -- 172.21.15.45:0/3079866285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f371c017030 con 0x5563665a4480 2024-09-15T22:17:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.111+0000 7f371a7fc640 1 -- 172.21.15.45:0/3079866285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f371c00f450 con 0x5563665a4480 2024-09-15T22:17:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.111+0000 7f373b9d8740 10 client.15633 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.111+0000 7f373b9d8740 10 client.15633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.111+0000 7f373b9d8740 20 client.15633 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.111+0000 7f373b9d8740 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5563665be8f0 0x5563665c0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.111+0000 7f373b9d8740 4 client.15633 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.111+0000 7f373b9d8740 1 -- 172.21.15.45:0/3079866285 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563665167f0 con 0x5563665be8f0 2024-09-15T22:17:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.111+0000 7f3732ffd640 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5563665be8f0 0x5563665c0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.112+0000 7f371a7fc640 10 client.15633 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.112+0000 7f3732ffd640 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5563665be8f0 0x5563665c0ce0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dfe907ccf8711bc server_cookie=b451ce127c1bcf00 in_seq=0 out_seq=0 2024-09-15T22:17:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.112+0000 7f371a7fc640 1 -- 172.21.15.45:0/3079866285 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5563665167f0 con 0x5563665be8f0 2024-09-15T22:17:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.112+0000 7f371a7fc640 10 client.15633 handle_command_reply: tid=0 2024-09-15T22:17:04.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.112+0000 7f373b9d8740 1 client.15633 shutdown 2024-09-15T22:17:04.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.113+0000 7f373b9d8740 1 -- 172.21.15.45:0/3079866285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 msgr2=0x5563665ac170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:04.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.113+0000 7f373b9d8740 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665ac170 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f371c004f70 tx=0x7f371c004c40 comp rx=0 tx=0).stop 2024-09-15T22:17:04.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.113+0000 7f373b9d8740 1 -- 172.21.15.45:0/3079866285 shutdown_connections 2024-09-15T22:17:04.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.113+0000 7f373b9d8740 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5563665be8f0 0x5563665c0ce0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.113+0000 7f373b9d8740 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 0x5563665ac6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.113+0000 7f373b9d8740 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665ac170 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.113+0000 7f373b9d8740 1 --2- 172.21.15.45:0/3079866285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665abc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.113+0000 7f373b9d8740 1 -- 172.21.15.45:0/3079866285 >> 172.21.15.45:0/3079866285 conn(0x5563665a00f0 msgr2=0x5563665a5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:04.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.113+0000 7f371a7fc640 0 client.15633 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:04.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.113+0000 7f373b9d8740 1 -- 172.21.15.45:0/3079866285 shutdown_connections 2024-09-15T22:17:04.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.113+0000 7f373b9d8740 1 -- 172.21.15.45:0/3079866285 wait complete. 2024-09-15T22:17:04.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.113+0000 7f373b9d8740 20 client.15633 trim_cache size 0 max 16384 2024-09-15T22:17:04.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.145+0000 7f373b9d8740 1 Processor -- start 2024-09-15T22:17:04.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.145+0000 7f373b9d8740 1 -- start start 2024-09-15T22:17:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.145+0000 7f373b9d8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665ac500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.145+0000 7f373b9d8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665ada90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.145+0000 7f373b9d8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 0x5563665c6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.145+0000 7f373b9d8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f37341af110 con 0x5563665a4480 2024-09-15T22:17:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.145+0000 7f373b9d8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f37341b1990 con 0x5563665aed40 2024-09-15T22:17:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.145+0000 7f373b9d8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f37341af780 con 0x5563665a3b60 2024-09-15T22:17:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f372bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f372bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38944/0 (socket says 172.21.15.45:38944) 2024-09-15T22:17:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f372bfff640 1 -- 172.21.15.45:0/1229700125 learned_addr learned my addr 172.21.15.45:0/1229700125 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f3732ffd640 1 --2- 172.21.15.45:0/1229700125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f37337fe640 1 --2- 172.21.15.45:0/1229700125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 0x5563665c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f372bfff640 1 -- 172.21.15.45:0/1229700125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 msgr2=0x5563665ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:04.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f372bfff640 1 --2- 172.21.15.45:0/1229700125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665ac500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f372bfff640 1 -- 172.21.15.45:0/1229700125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 msgr2=0x5563665c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:04.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f372bfff640 1 --2- 172.21.15.45:0/1229700125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 0x5563665c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f372bfff640 1 -- 172.21.15.45:0/1229700125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55636659b830 con 0x5563665a4480 2024-09-15T22:17:04.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f372bfff640 1 --2- 172.21.15.45:0/1229700125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665ada90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f371c00f9c0 tx=0x7f371c00afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a06bd4518ceb9f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:04.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f3728ff9640 1 -- 172.21.15.45:0/1229700125 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c011c40 con 0x5563665a4480 2024-09-15T22:17:04.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f3728ff9640 1 -- 172.21.15.45:0/1229700125 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f371c017070 con 0x5563665a4480 2024-09-15T22:17:04.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.146+0000 7f3728ff9640 1 -- 172.21.15.45:0/1229700125 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c00f450 con 0x5563665a4480 2024-09-15T22:17:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.147+0000 7f373b9d8740 1 -- 172.21.15.45:0/1229700125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 msgr2=0x5563665ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.147+0000 7f373b9d8740 1 --2- 172.21.15.45:0/1229700125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665ada90 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f371c00f9c0 tx=0x7f371c00afd0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.147+0000 7f373b9d8740 1 -- 172.21.15.45:0/1229700125 shutdown_connections 2024-09-15T22:17:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.147+0000 7f373b9d8740 1 --2- 172.21.15.45:0/1229700125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 0x5563665c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.147+0000 7f373b9d8740 1 --2- 172.21.15.45:0/1229700125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665ada90 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.147+0000 7f373b9d8740 1 --2- 172.21.15.45:0/1229700125 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.147+0000 7f373b9d8740 1 -- 172.21.15.45:0/1229700125 >> 172.21.15.45:0/1229700125 conn(0x5563665a00f0 msgr2=0x5563665ad380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.147+0000 7f373b9d8740 1 -- 172.21.15.45:0/1229700125 shutdown_connections 2024-09-15T22:17:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.147+0000 7f373b9d8740 1 -- 172.21.15.45:0/1229700125 wait complete. 2024-09-15T22:17:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f373b9d8740 1 -- start start 2024-09-15T22:17:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f373b9d8740 1 Processor -- start 2024-09-15T22:17:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f373b9d8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f373b9d8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f373b9d8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 0x5563665b2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f373b9d8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f37341afe50 con 0x5563665a4480 2024-09-15T22:17:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f373b9d8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f37341b12c0 con 0x5563665aed40 2024-09-15T22:17:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f373b9d8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f37341b0520 con 0x5563665a3b60 2024-09-15T22:17:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f373b9d8740 10 client.0 _ll_register_callbacks cb 0x7f371c00ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f3732ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f372bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f3732ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665b7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:42798/0 (socket says 172.21.15.45:42798) 2024-09-15T22:17:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f3732ffd640 1 -- 172.21.15.45:0/4052477029 learned_addr learned my addr 172.21.15.45:0/4052477029 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.148+0000 7f37337fe640 1 --2- 172.21.15.45:0/4052477029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 0x5563665b2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f372bfff640 1 -- 172.21.15.45:0/4052477029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 msgr2=0x5563665b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f372bfff640 1 --2- 172.21.15.45:0/4052477029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665b7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f372bfff640 1 -- 172.21.15.45:0/4052477029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 msgr2=0x5563665b2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f372bfff640 1 --2- 172.21.15.45:0/4052477029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 0x5563665b2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f372bfff640 1 -- 172.21.15.45:0/4052477029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563665b30c0 con 0x5563665a4480 2024-09-15T22:17:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f3732ffd640 1 --2- 172.21.15.45:0/4052477029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f372bfff640 1 --2- 172.21.15.45:0/4052477029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665b2590 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55636659fb10 tx=0x7f371c00a930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab56e9c880c3ea66 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f371a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f371a7fc640 1 -- 172.21.15.45:0/4052477029 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c00f650 con 0x5563665a4480 2024-09-15T22:17:04.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f371a7fc640 1 -- 172.21.15.45:0/4052477029 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f371c00fa40 con 0x5563665a4480 2024-09-15T22:17:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f373b9d8740 1 -- 172.21.15.45:0/4052477029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f371c017070 con 0x5563665a4480 2024-09-15T22:17:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f371a7fc640 1 -- 172.21.15.45:0/4052477029 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f371c00fc40 con 0x5563665a4480 2024-09-15T22:17:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f373b9d8740 10 client.15639 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.149+0000 7f373b9d8740 1 -- 172.21.15.45:0/4052477029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556366629070 con 0x5563665a4480 2024-09-15T22:17:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.150+0000 7f371a7fc640 1 -- 172.21.15.45:0/4052477029 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f371c017070 con 0x5563665a4480 2024-09-15T22:17:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.150+0000 7f371a7fc640 1 -- 172.21.15.45:0/4052477029 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f371c004d50 con 0x5563665a4480 2024-09-15T22:17:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.150+0000 7f373b9d8740 10 client.15639 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.150+0000 7f373b9d8740 10 client.15639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.150+0000 7f373b9d8740 20 client.15639 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.150+0000 7f373b9d8740 1 --2- 172.21.15.45:0/4052477029 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5563666296b0 0x55636662bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.150+0000 7f373b9d8740 4 client.15639 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:17:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.150+0000 7f373b9d8740 1 -- 172.21.15.45:0/4052477029 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556366510d00 con 0x5563666296b0 2024-09-15T22:17:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.150+0000 7f3732ffd640 1 --2- 172.21.15.45:0/4052477029 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5563666296b0 0x55636662bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.150+0000 7f3732ffd640 1 --2- 172.21.15.45:0/4052477029 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5563666296b0 0x55636662bad0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dfae60d6e41c595 server_cookie=5a246a15b0d14f6c in_seq=0 out_seq=0 2024-09-15T22:17:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.150+0000 7f371a7fc640 10 client.15639 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f371a7fc640 1 -- 172.21.15.45:0/4052477029 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556366510d00 con 0x5563666296b0 2024-09-15T22:17:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f371a7fc640 10 client.15639 handle_command_reply: tid=0 2024-09-15T22:17:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f373b9d8740 1 client.15639 shutdown 2024-09-15T22:17:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f373b9d8740 1 -- 172.21.15.45:0/4052477029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 msgr2=0x5563665b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f373b9d8740 1 --2- 172.21.15.45:0/4052477029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665b2590 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x55636659fb10 tx=0x7f371c00a930 comp rx=0 tx=0).stop 2024-09-15T22:17:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f373b9d8740 1 -- 172.21.15.45:0/4052477029 shutdown_connections 2024-09-15T22:17:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f373b9d8740 1 --2- 172.21.15.45:0/4052477029 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5563666296b0 0x55636662bad0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f373b9d8740 1 --2- 172.21.15.45:0/4052477029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563665aed40 0x5563665b2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f373b9d8740 1 --2- 172.21.15.45:0/4052477029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5563665a4480 0x5563665b2590 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f373b9d8740 1 --2- 172.21.15.45:0/4052477029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5563665a3b60 0x5563665b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f371a7fc640 0 client.15639 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f373b9d8740 1 -- 172.21.15.45:0/4052477029 >> 172.21.15.45:0/4052477029 conn(0x5563665a00f0 msgr2=0x5563665ad1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:04.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f373b9d8740 1 -- 172.21.15.45:0/4052477029 shutdown_connections 2024-09-15T22:17:04.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f373b9d8740 1 -- 172.21.15.45:0/4052477029 wait complete. 2024-09-15T22:17:04.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.152+0000 7f373b9d8740 20 client.15639 trim_cache size 0 max 16384 2024-09-15T22:17:04.159 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:17:04.159 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:17:04.160 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "a2194e37-c80d-434a-9216-89a2e08706c7", 2024-09-15T22:17:04.160 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:17:04.160 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:17:04.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.153+0000 7f37395ff640 1 -- 172.21.15.45:0/3891475297 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f37200a3550 msgr2=0x7f37200a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:04.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.153+0000 7f37395ff640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f37200a3550 0x7f37200a5a10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x5563665a0f50 tx=0x7f372400b390 comp rx=0 tx=0).stop 2024-09-15T22:17:04.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.153+0000 7f37395ff640 1 -- 172.21.15.45:0/3891475297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3734106f10 msgr2=0x7f3734074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.153+0000 7f37395ff640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3734106f10 0x7f3734074f70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f372c006010 tx=0x7f372c0319f0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.153+0000 7f37395ff640 1 -- 172.21.15.45:0/3891475297 shutdown_connections 2024-09-15T22:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.153+0000 7f37395ff640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f37200a3550 0x7f37200a5a10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.153+0000 7f37395ff640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3734106f10 0x7f3734074f70 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.153+0000 7f37395ff640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3734102790 0x7f3734074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.153+0000 7f37395ff640 1 --2- 172.21.15.45:0/3891475297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3734101de0 0x7f37340744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.153+0000 7f37395ff640 1 -- 172.21.15.45:0/3891475297 >> 172.21.15.45:0/3891475297 conn(0x7f37340fd8c0 msgr2=0x7f37340feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.153+0000 7f37395ff640 1 -- 172.21.15.45:0/3891475297 shutdown_connections 2024-09-15T22:17:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:04.153+0000 7f37395ff640 1 -- 172.21.15.45:0/3891475297 wait complete. 2024-09-15T22:17:04.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:04 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:17:04.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:04 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:04.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:04 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:17:04.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:04 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:04.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:04 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:17:04.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:04 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:04.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:04 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:17:04.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:04 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:04.767 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:04 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:17:04.767 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:04 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:04.767 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:04 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:17:04.767 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:04 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:05.111 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:17:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:05.528 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:05 smithi045 ceph-mon[31180]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:17:05.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:05 smithi165 ceph-mon[35551]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:17:05.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:05 smithi100 ceph-mon[35319]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:17:06.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.035+0000 7f3d3046c640 1 -- 172.21.15.45:0/3875884759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d28102d90 msgr2=0x7f3d28103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:06.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.035+0000 7f3d3046c640 1 --2- 172.21.15.45:0/3875884759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d28102d90 0x7f3d28103170 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009930 tx=0x7f3d2402a420 comp rx=0 tx=0).stop 2024-09-15T22:17:06.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.036+0000 7f3d3046c640 1 -- 172.21.15.45:0/3875884759 shutdown_connections 2024-09-15T22:17:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.036+0000 7f3d3046c640 1 --2- 172.21.15.45:0/3875884759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d28108290 0x7f3d2810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.036+0000 7f3d3046c640 1 --2- 172.21.15.45:0/3875884759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d28103740 0x7f3d28107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.036+0000 7f3d3046c640 1 --2- 172.21.15.45:0/3875884759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d28102d90 0x7f3d28103170 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.036+0000 7f3d3046c640 1 -- 172.21.15.45:0/3875884759 >> 172.21.15.45:0/3875884759 conn(0x7f3d280fc7d0 msgr2=0x7f3d280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.036+0000 7f3d3046c640 1 -- 172.21.15.45:0/3875884759 shutdown_connections 2024-09-15T22:17:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.036+0000 7f3d3046c640 1 -- 172.21.15.45:0/3875884759 wait complete. 2024-09-15T22:17:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.036+0000 7f3d3046c640 1 Processor -- start 2024-09-15T22:17:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.036+0000 7f3d3046c640 1 -- start start 2024-09-15T22:17:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d3046c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d28102d90 0x7f3d281985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d3046c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d28103740 0x7f3d28198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d3046c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d28108290 0x7f3d2819ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d3046c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281121b0 con 0x7f3d28102d90 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d3046c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d28112030 con 0x7f3d28108290 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d3046c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3d28112330 con 0x7f3d28103740 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d2e208640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d28102d90 0x7f3d281985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d2e208640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d28102d90 0x7f3d281985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34630/0 (socket says 172.21.15.45:34630) 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d2e208640 1 -- 172.21.15.45:0/2298175010 learned_addr learned my addr 172.21.15.45:0/2298175010 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d2da07640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d28103740 0x7f3d28198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d2ea09640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d28108290 0x7f3d2819ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d2e208640 1 -- 172.21.15.45:0/2298175010 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d28103740 msgr2=0x7f3d28198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d2e208640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d28103740 0x7f3d28198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d2e208640 1 -- 172.21.15.45:0/2298175010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d28108290 msgr2=0x7f3d2819ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d2e208640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d28108290 0x7f3d2819ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d2e208640 1 -- 172.21.15.45:0/2298175010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d2819d590 con 0x7f3d28102d90 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.037+0000 7f3d2ea09640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d28108290 0x7f3d2819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:06.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.038+0000 7f3d2e208640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d28102d90 0x7f3d281985e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009230 tx=0x7f3d24004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.038+0000 7f3d1f7fe640 1 -- 172.21.15.45:0/2298175010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2403f030 con 0x7f3d28102d90 2024-09-15T22:17:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.038+0000 7f3d1f7fe640 1 -- 172.21.15.45:0/2298175010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3d24003af0 con 0x7f3d28102d90 2024-09-15T22:17:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.038+0000 7f3d1f7fe640 1 -- 172.21.15.45:0/2298175010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d24035070 con 0x7f3d28102d90 2024-09-15T22:17:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.038+0000 7f3d3046c640 1 -- 172.21.15.45:0/2298175010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d2819d820 con 0x7f3d28102d90 2024-09-15T22:17:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.038+0000 7f3d3046c640 1 -- 172.21.15.45:0/2298175010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d281a5160 con 0x7f3d28102d90 2024-09-15T22:17:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.041+0000 7f3d1f7fe640 1 -- 172.21.15.45:0/2298175010 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f3d24042030 con 0x7f3d28102d90 2024-09-15T22:17:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.042+0000 7f3d32845740 1 Processor -- start 2024-09-15T22:17:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.042+0000 7f3d32845740 1 -- start start 2024-09-15T22:17:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.042+0000 7f3d1f7fe640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3d140a34d0 0x7f3d140a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.042+0000 7f3d32845740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb2a20 0x5565afeb1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.042+0000 7f3d32845740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb1880 0x5565afeb1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.042+0000 7f3d32845740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afec7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.042+0000 7f3d32845740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5565afe172e0 con 0x5565afec4d20 2024-09-15T22:17:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.042+0000 7f3d32845740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5565afdbece0 con 0x5565afeb1880 2024-09-15T22:17:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.042+0000 7f3d32845740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5565afe132a0 con 0x5565afeb2a20 2024-09-15T22:17:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.042+0000 7f3d1f7fe640 1 -- 172.21.15.45:0/2298175010 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f3d240f0960 con 0x7f3d28102d90 2024-09-15T22:17:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.042+0000 7f3d2ea09640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3d140a34d0 0x7f3d140a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d2e208640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb2a20 0x5565afeb1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d2e208640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb2a20 0x5565afeb1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:51328/0 (socket says 172.21.15.45:51328) 2024-09-15T22:17:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d2e208640 1 -- 172.21.15.45:0/3069649280 learned_addr learned my addr 172.21.15.45:0/3069649280 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d2da07640 1 --2- 172.21.15.45:0/3069649280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb1880 0x5565afeb1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d2ea09640 1 --2- 172.21.15.45:0/3069649280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afec7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d2e208640 1 -- 172.21.15.45:0/3069649280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb1880 msgr2=0x5565afeb1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d2e208640 1 --2- 172.21.15.45:0/3069649280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb1880 0x5565afeb1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d2e208640 1 -- 172.21.15.45:0/3069649280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 msgr2=0x5565afec7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d2e208640 1 --2- 172.21.15.45:0/3069649280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afec7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d2e208640 1 -- 172.21.15.45:0/3069649280 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565afda3440 con 0x5565afeb2a20 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d2e208640 1 --2- 172.21.15.45:0/3069649280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb2a20 0x5565afeb1340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3d24003fd0 tx=0x7f3d240bc350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f53b8c145c254f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d2ea09640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3d140a34d0 0x7f3d140a5990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d20005fd0 tx=0x7f3d200139f0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d1cdea640 1 -- 172.21.15.45:0/3069649280 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d24049070 con 0x5565afeb2a20 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d1cdea640 1 -- 172.21.15.45:0/3069649280 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3d240bce50 con 0x5565afeb2a20 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.043+0000 7f3d1cdea640 1 -- 172.21.15.45:0/3069649280 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d240b8dc0 con 0x5565afeb2a20 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.044+0000 7f3d32845740 1 -- 172.21.15.45:0/3069649280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb2a20 msgr2=0x5565afeb1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.044+0000 7f3d32845740 1 --2- 172.21.15.45:0/3069649280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb2a20 0x5565afeb1340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3d24003fd0 tx=0x7f3d240bc350 comp rx=0 tx=0).stop 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.044+0000 7f3d32845740 1 -- 172.21.15.45:0/3069649280 shutdown_connections 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.044+0000 7f3d32845740 1 --2- 172.21.15.45:0/3069649280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afec7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.044+0000 7f3d32845740 1 --2- 172.21.15.45:0/3069649280 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb1880 0x5565afeb1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.044+0000 7f3d32845740 1 --2- 172.21.15.45:0/3069649280 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb2a20 0x5565afeb1340 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.044+0000 7f3d32845740 1 -- 172.21.15.45:0/3069649280 >> 172.21.15.45:0/3069649280 conn(0x5565afeada30 msgr2=0x5565afeade10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.044+0000 7f3d32845740 1 -- 172.21.15.45:0/3069649280 shutdown_connections 2024-09-15T22:17:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.044+0000 7f3d32845740 1 -- 172.21.15.45:0/3069649280 wait complete. 2024-09-15T22:17:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d32845740 1 -- start start 2024-09-15T22:17:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d32845740 1 Processor -- start 2024-09-15T22:17:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d32845740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb1880 0x5565afeb7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d32845740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb2a20 0x5565afeb4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d32845740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afeb5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d32845740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5565afec7810 con 0x5565afec4d20 2024-09-15T22:17:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d32845740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5565afdd2050 con 0x5565afeb2a20 2024-09-15T22:17:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d32845740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5565afec7990 con 0x5565afeb1880 2024-09-15T22:17:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d32845740 10 client.0 _ll_register_callbacks cb 0x5565afe12160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d2ea09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afeb5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d2ea09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afeb5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34642/0 (socket says 172.21.15.45:34642) 2024-09-15T22:17:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d2ea09640 1 -- 172.21.15.45:0/467572644 learned_addr learned my addr 172.21.15.45:0/467572644 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d2e208640 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb1880 0x5565afeb7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d2da07640 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb2a20 0x5565afeb4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d2e208640 1 -- 172.21.15.45:0/467572644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb2a20 msgr2=0x5565afeb4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d2e208640 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb2a20 0x5565afeb4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d2e208640 1 -- 172.21.15.45:0/467572644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 msgr2=0x5565afeb5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.045+0000 7f3d2e208640 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afeb5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.046+0000 7f3d2e208640 1 -- 172.21.15.45:0/467572644 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565afb883c0 con 0x5565afeb1880 2024-09-15T22:17:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.046+0000 7f3d2ea09640 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afeb5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.046+0000 7f3d2e208640 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb1880 0x5565afeb7b90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009a50 tx=0x7f3d24003ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=598d4a963003f576 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.046+0000 7f3d11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-15T22:17:06.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.046+0000 7f3d11ffb640 1 -- 172.21.15.45:0/467572644 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d24049050 con 0x5565afeb1880 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.046+0000 7f3d32845740 1 -- 172.21.15.45:0/467572644 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d240bce50 con 0x5565afeb1880 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.046+0000 7f3d11ffb640 1 -- 172.21.15.45:0/467572644 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f3d240bc9b0 con 0x5565afeb1880 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.046+0000 7f3d11ffb640 1 -- 172.21.15.45:0/467572644 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3d2403b540 con 0x5565afeb1880 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.046+0000 7f3d32845740 10 client.25213 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.046+0000 7f3d32845740 1 -- 172.21.15.45:0/467572644 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5565afec7810 con 0x5565afeb1880 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.046+0000 7f3d11ffb640 1 -- 172.21.15.45:0/467572644 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3d240bce50 con 0x5565afeb1880 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.047+0000 7f3d11ffb640 1 -- 172.21.15.45:0/467572644 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3d240edea0 con 0x5565afeb1880 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.047+0000 7f3d32845740 10 client.25213 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.047+0000 7f3d32845740 10 client.25213 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.047+0000 7f3d32845740 20 client.25213 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.047+0000 7f3d32845740 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5565afed43c0 0x5565afed67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.047+0000 7f3d32845740 4 client.25213 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.047+0000 7f3d32845740 1 -- 172.21.15.45:0/467572644 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565afe24850 con 0x5565afed43c0 2024-09-15T22:17:06.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.047+0000 7f3d2da07640 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5565afed43c0 0x5565afed67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.047+0000 7f3d2da07640 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5565afed43c0 0x5565afed67b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53bd5a3219e504f2 server_cookie=7b6ab7b048da315c in_seq=0 out_seq=0 2024-09-15T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.047+0000 7f3d11ffb640 10 client.25213 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d11ffb640 1 -- 172.21.15.45:0/467572644 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565afe24850 con 0x5565afed43c0 2024-09-15T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d11ffb640 10 client.25213 handle_command_reply: tid=0 2024-09-15T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d32845740 1 client.25213 shutdown 2024-09-15T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d32845740 1 -- 172.21.15.45:0/467572644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb1880 msgr2=0x5565afeb7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d32845740 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb1880 0x5565afeb7b90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009a50 tx=0x7f3d24003ed0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d32845740 1 -- 172.21.15.45:0/467572644 shutdown_connections 2024-09-15T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d32845740 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5565afed43c0 0x5565afed67b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d32845740 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afeb5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d32845740 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb2a20 0x5565afeb4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d11ffb640 0 client.25213 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:06.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d32845740 1 --2- 172.21.15.45:0/467572644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb1880 0x5565afeb7b90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d32845740 1 -- 172.21.15.45:0/467572644 >> 172.21.15.45:0/467572644 conn(0x5565afeada30 msgr2=0x5565afeb3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:06.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d32845740 1 -- 172.21.15.45:0/467572644 shutdown_connections 2024-09-15T22:17:06.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.048+0000 7f3d32845740 1 -- 172.21.15.45:0/467572644 wait complete. 2024-09-15T22:17:06.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.049+0000 7f3d32845740 20 client.25213 trim_cache size 0 max 16384 2024-09-15T22:17:06.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.070+0000 7f3d32845740 1 Processor -- start 2024-09-15T22:17:06.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.070+0000 7f3d32845740 1 -- start start 2024-09-15T22:17:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.070+0000 7f3d32845740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb1880 0x5565afed09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.070+0000 7f3d32845740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb2a20 0x5565afeaca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.070+0000 7f3d32845740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afedc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.070+0000 7f3d32845740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281aad50 con 0x5565afec4d20 2024-09-15T22:17:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.070+0000 7f3d32845740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281ad5d0 con 0x5565afeb2a20 2024-09-15T22:17:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.070+0000 7f3d32845740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281ab3c0 con 0x5565afeb1880 2024-09-15T22:17:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.070+0000 7f3d2ea09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afedc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.070+0000 7f3d2ea09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afedc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34650/0 (socket says 172.21.15.45:34650) 2024-09-15T22:17:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.070+0000 7f3d2ea09640 1 -- 172.21.15.45:0/1367475192 learned_addr learned my addr 172.21.15.45:0/1367475192 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.070+0000 7f3d2da07640 1 --2- 172.21.15.45:0/1367475192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb2a20 0x5565afeaca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.070+0000 7f3d2e208640 1 --2- 172.21.15.45:0/1367475192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb1880 0x5565afed09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.071+0000 7f3d2ea09640 1 -- 172.21.15.45:0/1367475192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb1880 msgr2=0x5565afed09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:06.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.071+0000 7f3d2ea09640 1 --2- 172.21.15.45:0/1367475192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb1880 0x5565afed09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.071+0000 7f3d2ea09640 1 -- 172.21.15.45:0/1367475192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb2a20 msgr2=0x5565afeaca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:06.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.071+0000 7f3d2ea09640 1 --2- 172.21.15.45:0/1367475192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb2a20 0x5565afeaca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.071+0000 7f3d2ea09640 1 -- 172.21.15.45:0/1367475192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565afed6b20 con 0x5565afec4d20 2024-09-15T22:17:06.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.071+0000 7f3d2da07640 1 --2- 172.21.15.45:0/1367475192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb2a20 0x5565afeaca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:06.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.071+0000 7f3d2e208640 1 --2- 172.21.15.45:0/1367475192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb1880 0x5565afed09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:06.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.071+0000 7f3d2ea09640 1 --2- 172.21.15.45:0/1367475192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afedc080 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3d200132e0 tx=0x7f3d2001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8e0869255cc8ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:06.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.071+0000 7f3d13fff640 1 -- 172.21.15.45:0/1367475192 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20020700 con 0x5565afec4d20 2024-09-15T22:17:06.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.071+0000 7f3d13fff640 1 -- 172.21.15.45:0/1367475192 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3d20020da0 con 0x5565afec4d20 2024-09-15T22:17:06.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.071+0000 7f3d13fff640 1 -- 172.21.15.45:0/1367475192 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20012e00 con 0x5565afec4d20 2024-09-15T22:17:06.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.072+0000 7f3d32845740 1 -- 172.21.15.45:0/1367475192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 msgr2=0x5565afedc080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:06.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.072+0000 7f3d32845740 1 --2- 172.21.15.45:0/1367475192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afedc080 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3d200132e0 tx=0x7f3d2001c000 comp rx=0 tx=0).stop 2024-09-15T22:17:06.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.072+0000 7f3d32845740 1 -- 172.21.15.45:0/1367475192 shutdown_connections 2024-09-15T22:17:06.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.072+0000 7f3d32845740 1 --2- 172.21.15.45:0/1367475192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afec4d20 0x5565afedc080 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.072+0000 7f3d32845740 1 --2- 172.21.15.45:0/1367475192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afeb2a20 0x5565afeaca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.072+0000 7f3d32845740 1 --2- 172.21.15.45:0/1367475192 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb1880 0x5565afed09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.072+0000 7f3d32845740 1 -- 172.21.15.45:0/1367475192 >> 172.21.15.45:0/1367475192 conn(0x5565afeada30 msgr2=0x5565afeac350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:06.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.072+0000 7f3d32845740 1 -- 172.21.15.45:0/1367475192 shutdown_connections 2024-09-15T22:17:06.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.072+0000 7f3d32845740 1 -- 172.21.15.45:0/1367475192 wait complete. 2024-09-15T22:17:06.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.072+0000 7f3d32845740 1 -- start start 2024-09-15T22:17:06.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d32845740 1 Processor -- start 2024-09-15T22:17:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d32845740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afeb1880 0x5565afec8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d32845740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb2a20 0x5565afec8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d32845740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afec4d20 0x5565afec93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d32845740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281aba90 con 0x5565afeb1880 2024-09-15T22:17:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d32845740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281acf00 con 0x5565afec4d20 2024-09-15T22:17:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d32845740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281ac160 con 0x5565afeb2a20 2024-09-15T22:17:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d32845740 10 client.0 _ll_register_callbacks cb 0x7f3d1800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d2e208640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afeb1880 0x5565afec8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d2e208640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afeb1880 0x5565afec8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34666/0 (socket says 172.21.15.45:34666) 2024-09-15T22:17:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d2e208640 1 -- 172.21.15.45:0/3245369612 learned_addr learned my addr 172.21.15.45:0/3245369612 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d2ea09640 1 --2- 172.21.15.45:0/3245369612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afec4d20 0x5565afec93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d2da07640 1 --2- 172.21.15.45:0/3245369612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb2a20 0x5565afec8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d2e208640 1 -- 172.21.15.45:0/3245369612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb2a20 msgr2=0x5565afec8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d2e208640 1 --2- 172.21.15.45:0/3245369612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb2a20 0x5565afec8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d2e208640 1 -- 172.21.15.45:0/3245369612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afec4d20 msgr2=0x5565afec93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d2e208640 1 --2- 172.21.15.45:0/3245369612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afec4d20 0x5565afec93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.073+0000 7f3d2e208640 1 -- 172.21.15.45:0/3245369612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565afeb7f00 con 0x5565afeb1880 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.074+0000 7f3d2e208640 1 --2- 172.21.15.45:0/3245369612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afeb1880 0x5565afec8920 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3d240bc6e0 tx=0x7f3d2402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274316d3ae137f35 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.074+0000 7f3d11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.074+0000 7f3d11ffb640 1 -- 172.21.15.45:0/3245369612 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d240da060 con 0x5565afeb1880 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.074+0000 7f3d11ffb640 1 -- 172.21.15.45:0/3245369612 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f3d240bbba0 con 0x5565afeb1880 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.074+0000 7f3d32845740 1 -- 172.21.15.45:0/3245369612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d20020da0 con 0x5565afeb1880 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.074+0000 7f3d11ffb640 1 -- 172.21.15.45:0/3245369612 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3d24049070 con 0x5565afeb1880 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.074+0000 7f3d32845740 10 client.15657 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.074+0000 7f3d32845740 1 -- 172.21.15.45:0/3245369612 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5565afeb7f00 con 0x5565afeb1880 2024-09-15T22:17:06.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.074+0000 7f3d11ffb640 1 -- 172.21.15.45:0/3245369612 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3d20020da0 con 0x5565afeb1880 2024-09-15T22:17:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.074+0000 7f3d11ffb640 1 -- 172.21.15.45:0/3245369612 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3d240bc9b0 con 0x5565afeb1880 2024-09-15T22:17:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.074+0000 7f3d32845740 10 client.15657 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.074+0000 7f3d32845740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.075+0000 7f3d32845740 20 client.15657 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.075+0000 7f3d32845740 1 --2- 172.21.15.45:0/3245369612 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5565aff3f490 0x5565aff41880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.075+0000 7f3d32845740 4 client.15657 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:17:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.075+0000 7f3d32845740 1 -- 172.21.15.45:0/3245369612 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5565afe1ed60 con 0x5565aff3f490 2024-09-15T22:17:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.075+0000 7f3d2da07640 1 --2- 172.21.15.45:0/3245369612 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5565aff3f490 0x5565aff41880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.075+0000 7f3d2da07640 1 --2- 172.21.15.45:0/3245369612 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5565aff3f490 0x5565aff41880 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be5c78965872af75 server_cookie=df181db654306f95 in_seq=0 out_seq=0 2024-09-15T22:17:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.075+0000 7f3d11ffb640 10 client.15657 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d11ffb640 1 -- 172.21.15.45:0/3245369612 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5565afe1ed60 con 0x5565aff3f490 2024-09-15T22:17:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d11ffb640 10 client.15657 handle_command_reply: tid=0 2024-09-15T22:17:06.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d32845740 1 client.15657 shutdown 2024-09-15T22:17:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d32845740 1 -- 172.21.15.45:0/3245369612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afeb1880 msgr2=0x5565afec8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d32845740 1 --2- 172.21.15.45:0/3245369612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afeb1880 0x5565afec8920 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3d240bc6e0 tx=0x7f3d2402a420 comp rx=0 tx=0).stop 2024-09-15T22:17:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d32845740 1 -- 172.21.15.45:0/3245369612 shutdown_connections 2024-09-15T22:17:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d32845740 1 --2- 172.21.15.45:0/3245369612 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5565aff3f490 0x5565aff41880 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d32845740 1 --2- 172.21.15.45:0/3245369612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5565afec4d20 0x5565afec93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d32845740 1 --2- 172.21.15.45:0/3245369612 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5565afeb2a20 0x5565afec8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d11ffb640 0 client.15657 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d32845740 1 --2- 172.21.15.45:0/3245369612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5565afeb1880 0x5565afec8920 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d32845740 1 -- 172.21.15.45:0/3245369612 >> 172.21.15.45:0/3245369612 conn(0x5565afeada30 msgr2=0x5565afeacb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d32845740 1 -- 172.21.15.45:0/3245369612 shutdown_connections 2024-09-15T22:17:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d32845740 1 -- 172.21.15.45:0/3245369612 wait complete. 2024-09-15T22:17:06.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.076+0000 7f3d32845740 20 client.15657 trim_cache size 0 max 16384 2024-09-15T22:17:06.084 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:17:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:17:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:17:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: "a2194e37-c80d-434a-9216-89a2e08706c7": { 2024-09-15T22:17:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:17:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "a2194e37-c80d-434a-9216-89a2e08706c7", 2024-09-15T22:17:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:17:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:06.084 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:17:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.077+0000 7f3d3046c640 1 -- 172.21.15.45:0/2298175010 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3d140a34d0 msgr2=0x7f3d140a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.077+0000 7f3d3046c640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3d140a34d0 0x7f3d140a5990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d20005fd0 tx=0x7f3d200139f0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.077+0000 7f3d3046c640 1 -- 172.21.15.45:0/2298175010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d28102d90 msgr2=0x7f3d281985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.077+0000 7f3d3046c640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d28102d90 0x7f3d281985e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009230 tx=0x7f3d24004270 comp rx=0 tx=0).stop 2024-09-15T22:17:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.077+0000 7f3d3046c640 1 -- 172.21.15.45:0/2298175010 shutdown_connections 2024-09-15T22:17:06.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.077+0000 7f3d3046c640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3d140a34d0 0x7f3d140a5990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.077+0000 7f3d3046c640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d28108290 0x7f3d2819ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.077+0000 7f3d3046c640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3d28103740 0x7f3d28198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.077+0000 7f3d3046c640 1 --2- 172.21.15.45:0/2298175010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3d28102d90 0x7f3d281985e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.077+0000 7f3d3046c640 1 -- 172.21.15.45:0/2298175010 >> 172.21.15.45:0/2298175010 conn(0x7f3d280fc7d0 msgr2=0x7f3d28106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.077+0000 7f3d3046c640 1 -- 172.21.15.45:0/2298175010 shutdown_connections 2024-09-15T22:17:06.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:06.077+0000 7f3d3046c640 1 -- 172.21.15.45:0/2298175010 wait complete. 2024-09-15T22:17:06.530 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.2 2024-09-15T22:17:06.530 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:17:06.904 INFO:tasks.cephfs.filesystem:scrub status for tag:a2194e37-c80d-434a-9216-89a2e08706c7 - {'path': '/', 'tag': 'a2194e37-c80d-434a-9216-89a2e08706c7', 'options': 'recursive,force'} 2024-09-15T22:17:06.980 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:07.422 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:07 smithi045 ceph-mon[31180]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-15T22:17:07.554 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:07 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:17:07.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.505+0000 7f080a8ec640 1 -- 172.21.15.45:0/3783803595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f080410c150 msgr2=0x7f080410e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:07.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.505+0000 7f080a8ec640 1 --2- 172.21.15.45:0/3783803595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f080410c150 0x7f080410e5f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009ca0 tx=0x7f07fc02a950 comp rx=0 tx=0).stop 2024-09-15T22:17:07.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.505+0000 7f080a8ec640 1 -- 172.21.15.45:0/3783803595 shutdown_connections 2024-09-15T22:17:07.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.505+0000 7f080a8ec640 1 --2- 172.21.15.45:0/3783803595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f080410c150 0x7f080410e5f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:07.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.505+0000 7f080a8ec640 1 --2- 172.21.15.45:0/3783803595 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804103640 0x7f080410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:07.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.505+0000 7f080a8ec640 1 --2- 172.21.15.45:0/3783803595 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0804102d20 0x7f0804103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:07.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.505+0000 7f080a8ec640 1 -- 172.21.15.45:0/3783803595 >> 172.21.15.45:0/3783803595 conn(0x7f08040fc780 msgr2=0x7f08040feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:07.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.505+0000 7f080a8ec640 1 -- 172.21.15.45:0/3783803595 shutdown_connections 2024-09-15T22:17:07.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.505+0000 7f080a8ec640 1 -- 172.21.15.45:0/3783803595 wait complete. 2024-09-15T22:17:07.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.506+0000 7f080a8ec640 1 Processor -- start 2024-09-15T22:17:07.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.506+0000 7f080a8ec640 1 -- start start 2024-09-15T22:17:07.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.506+0000 7f080a8ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0804102d20 0x7f0804100980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:07.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.506+0000 7f080a8ec640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804103640 0x7f0804100ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.506+0000 7f080a8ec640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f080410c150 0x7f0804101400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.506+0000 7f080a8ec640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0804112050 con 0x7f0804102d20 2024-09-15T22:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.506+0000 7f080a8ec640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0804111ed0 con 0x7f0804103640 2024-09-15T22:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.506+0000 7f080a8ec640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f08041121d0 con 0x7f080410c150 2024-09-15T22:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.506+0000 7f0803fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0804102d20 0x7f0804100980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f0803fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0804102d20 0x7f0804100980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34682/0 (socket says 172.21.15.45:34682) 2024-09-15T22:17:07.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f0803fff640 1 -- 172.21.15.45:0/3125525341 learned_addr learned my addr 172.21.15.45:0/3125525341 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f07fbfff640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804103640 0x7f0804100ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f0808e89640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f080410c150 0x7f0804101400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f0803fff640 1 -- 172.21.15.45:0/3125525341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f080410c150 msgr2=0x7f0804101400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f0803fff640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f080410c150 0x7f0804101400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f0803fff640 1 -- 172.21.15.45:0/3125525341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804103640 msgr2=0x7f0804100ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f0803fff640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804103640 0x7f0804100ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f0803fff640 1 -- 172.21.15.45:0/3125525341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08041a6950 con 0x7f0804102d20 2024-09-15T22:17:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f0803fff640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0804102d20 0x7f0804100980 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f07f400c920 tx=0x7f07f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f0801ffb640 1 -- 172.21.15.45:0/3125525341 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4007c70 con 0x7f0804102d20 2024-09-15T22:17:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f080a8ec640 1 -- 172.21.15.45:0/3125525341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08041a6c40 con 0x7f0804102d20 2024-09-15T22:17:07.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f0801ffb640 1 -- 172.21.15.45:0/3125525341 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f07f4007e10 con 0x7f0804102d20 2024-09-15T22:17:07.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f0801ffb640 1 -- 172.21.15.45:0/3125525341 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4018940 con 0x7f0804102d20 2024-09-15T22:17:07.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.507+0000 7f080a8ec640 1 -- 172.21.15.45:0/3125525341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08041a7180 con 0x7f0804102d20 2024-09-15T22:17:07.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.508+0000 7f080a8ec640 1 -- 172.21.15.45:0/3125525341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0804103100 con 0x7f0804102d20 2024-09-15T22:17:07.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.510+0000 7f0801ffb640 1 -- 172.21.15.45:0/3125525341 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f07f4018b00 con 0x7f0804102d20 2024-09-15T22:17:07.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.511+0000 7f0801ffb640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f07f00a34d0 0x7f07f00a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:07.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.511+0000 7f07fbfff640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f07f00a34d0 0x7f07f00a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:07.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.511+0000 7f0801ffb640 1 -- 172.21.15.45:0/3125525341 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f07f40d0750 con 0x7f0804102d20 2024-09-15T22:17:07.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.511+0000 7f07fbfff640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f07f00a34d0 0x7f07f00a5990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0804102410 tx=0x7f07ec00b2e0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:07.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.514+0000 7f0801ffb640 1 -- 172.21.15.45:0/3125525341 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f07f4014030 con 0x7f0804102d20 2024-09-15T22:17:07.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:07 smithi165 ceph-mon[35551]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-15T22:17:07.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:07 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:17:07.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.731+0000 7f080a8ec640 1 -- 172.21.15.45:0/3125525341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08041a74b0 con 0x7f0804102d20 2024-09-15T22:17:07.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.732+0000 7f0801ffb640 1 -- 172.21.15.45:0/3125525341 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f07f409cc00 con 0x7f0804102d20 2024-09-15T22:17:07.734 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:17:07.734 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:17:07.735 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:17:07.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.734+0000 7f080a8ec640 1 -- 172.21.15.45:0/3125525341 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f07f00a34d0 msgr2=0x7f07f00a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:07.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.734+0000 7f080a8ec640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f07f00a34d0 0x7f07f00a5990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0804102410 tx=0x7f07ec00b2e0 comp rx=0 tx=0).stop 2024-09-15T22:17:07.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.734+0000 7f080a8ec640 1 -- 172.21.15.45:0/3125525341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0804102d20 msgr2=0x7f0804100980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:07.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.734+0000 7f080a8ec640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0804102d20 0x7f0804100980 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f07f400c920 tx=0x7f07f400cde0 comp rx=0 tx=0).stop 2024-09-15T22:17:07.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.734+0000 7f080a8ec640 1 -- 172.21.15.45:0/3125525341 shutdown_connections 2024-09-15T22:17:07.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.734+0000 7f080a8ec640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f07f00a34d0 0x7f07f00a5990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:07.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.734+0000 7f080a8ec640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f080410c150 0x7f0804101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:07.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.734+0000 7f080a8ec640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0804103640 0x7f0804100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:07.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.734+0000 7f080a8ec640 1 --2- 172.21.15.45:0/3125525341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0804102d20 0x7f0804100980 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:07.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.734+0000 7f080a8ec640 1 -- 172.21.15.45:0/3125525341 >> 172.21.15.45:0/3125525341 conn(0x7f08040fc780 msgr2=0x7f08040fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:07.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.734+0000 7f080a8ec640 1 -- 172.21.15.45:0/3125525341 shutdown_connections 2024-09-15T22:17:07.737 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:07.734+0000 7f080a8ec640 1 -- 172.21.15.45:0/3125525341 wait complete. 2024-09-15T22:17:07.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:07 smithi100 ceph-mon[35319]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-15T22:17:07.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:07 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:17:08.497 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:08 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3125525341' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:08.524 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db / --timeout 90 --expiration 150.2 --await-for 45.0' 2024-09-15T22:17:08.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db / --timeout 90 --expiration 150.2 --await-for 45.0 2024-09-15T22:17:08.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:08 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3125525341' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:08 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3125525341' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:08.798 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:09.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.311+0000 7f782763f640 1 -- 172.21.15.45:0/584431426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78201036e0 msgr2=0x7f7820107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:09.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.311+0000 7f782763f640 1 --2- 172.21.15.45:0/584431426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78201036e0 0x7f7820107b90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7810009930 tx=0x7f781002a420 comp rx=0 tx=0).stop 2024-09-15T22:17:09.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.312+0000 7f782763f640 1 -- 172.21.15.45:0/584431426 shutdown_connections 2024-09-15T22:17:09.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.312+0000 7f782763f640 1 --2- 172.21.15.45:0/584431426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78201082a0 0x7f782010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.312+0000 7f782763f640 1 --2- 172.21.15.45:0/584431426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78201036e0 0x7f7820107b90 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.312+0000 7f782763f640 1 --2- 172.21.15.45:0/584431426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7820102d30 0x7f7820103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.312+0000 7f782763f640 1 -- 172.21.15.45:0/584431426 >> 172.21.15.45:0/584431426 conn(0x7f78200fc7d0 msgr2=0x7f78200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:09.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.312+0000 7f782763f640 1 -- 172.21.15.45:0/584431426 shutdown_connections 2024-09-15T22:17:09.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.312+0000 7f782763f640 1 -- 172.21.15.45:0/584431426 wait complete. 2024-09-15T22:17:09.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.312+0000 7f782763f640 1 Processor -- start 2024-09-15T22:17:09.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.312+0000 7f782763f640 1 -- start start 2024-09-15T22:17:09.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f782763f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7820102d30 0x7f7820100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f782763f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78201036e0 0x7f7820100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f782763f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78201082a0 0x7f7820101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f782763f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7820112200 con 0x7f7820102d30 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f782763f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7820112080 con 0x7f78201082a0 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f782763f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7820112380 con 0x7f78201036e0 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f78253db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7820102d30 0x7f7820100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f78253db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7820102d30 0x7f7820100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34704/0 (socket says 172.21.15.45:34704) 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f78253db640 1 -- 172.21.15.45:0/403785766 learned_addr learned my addr 172.21.15.45:0/403785766 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f7824bda640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78201036e0 0x7f7820100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f7825bdc640 1 --2- 172.21.15.45:0/403785766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78201082a0 0x7f7820101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f78253db640 1 -- 172.21.15.45:0/403785766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78201036e0 msgr2=0x7f7820100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f78253db640 1 --2- 172.21.15.45:0/403785766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78201036e0 0x7f7820100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f78253db640 1 -- 172.21.15.45:0/403785766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78201082a0 msgr2=0x7f7820101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f78253db640 1 --2- 172.21.15.45:0/403785766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78201082a0 0x7f7820101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.313+0000 7f78253db640 1 -- 172.21.15.45:0/403785766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78201a6b90 con 0x7f7820102d30 2024-09-15T22:17:09.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.314+0000 7f78253db640 1 --2- 172.21.15.45:0/403785766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7820102d30 0x7f7820100990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f781c00c890 tx=0x7f781c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:09.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.315+0000 7f78167fc640 1 -- 172.21.15.45:0/403785766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781c004220 con 0x7f7820102d30 2024-09-15T22:17:09.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.315+0000 7f78167fc640 1 -- 172.21.15.45:0/403785766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f781c0043c0 con 0x7f7820102d30 2024-09-15T22:17:09.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.315+0000 7f782763f640 1 -- 172.21.15.45:0/403785766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78201a6e80 con 0x7f7820102d30 2024-09-15T22:17:09.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.315+0000 7f78167fc640 1 -- 172.21.15.45:0/403785766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781c004b10 con 0x7f7820102d30 2024-09-15T22:17:09.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.316+0000 7f782763f640 1 -- 172.21.15.45:0/403785766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78201a72e0 con 0x7f7820102d30 2024-09-15T22:17:09.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.318+0000 7f78167fc640 1 -- 172.21.15.45:0/403785766 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f781c0051b0 con 0x7f7820102d30 2024-09-15T22:17:09.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f7829a18740 1 Processor -- start 2024-09-15T22:17:09.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f7829a18740 1 -- start start 2024-09-15T22:17:09.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f7829a18740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469525760 0x560469525b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f7829a18740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469526080 0x560469530400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f7829a18740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 0x560469532d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f7829a18740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56046948b2a0 con 0x560469530940 2024-09-15T22:17:09.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f7829a18740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560469432b10 con 0x560469526080 2024-09-15T22:17:09.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f7829a18740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560469487260 con 0x560469525760 2024-09-15T22:17:09.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f78167fc640 1 --2- 172.21.15.45:0/403785766 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f780c0a34d0 0x7f780c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f7824bda640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 0x560469532d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f7824bda640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 0x560469532d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34712/0 (socket says 172.21.15.45:34712) 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f7824bda640 1 -- 172.21.15.45:0/1323092632 learned_addr learned my addr 172.21.15.45:0/1323092632 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f7825bdc640 1 --2- 172.21.15.45:0/1323092632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469525760 0x560469525b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.319+0000 7f7825bdc640 1 --2- 172.21.15.45:0/403785766 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f780c0a34d0 0x7f780c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.320+0000 7f78167fc640 1 -- 172.21.15.45:0/403785766 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f781c0d0340 con 0x7f7820102d30 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.320+0000 7f78253db640 1 --2- 172.21.15.45:0/1323092632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469526080 0x560469530400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.320+0000 7f7824bda640 1 -- 172.21.15.45:0/1323092632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469525760 msgr2=0x560469525b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.320+0000 7f7824bda640 1 --2- 172.21.15.45:0/1323092632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469525760 0x560469525b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.320+0000 7f7824bda640 1 -- 172.21.15.45:0/1323092632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469526080 msgr2=0x560469530400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.320+0000 7f7824bda640 1 --2- 172.21.15.45:0/1323092632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469526080 0x560469530400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.320+0000 7f7824bda640 1 -- 172.21.15.45:0/1323092632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604691fcb90 con 0x560469530940 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.320+0000 7f7825bdc640 1 --2- 172.21.15.45:0/403785766 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f780c0a34d0 0x7f780c0a5990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f781800bd20 tx=0x7f7818009be0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:09.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.320+0000 7f7824bda640 1 --2- 172.21.15.45:0/1323092632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 0x560469532d30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7810005ec0 tx=0x7f78100316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c8db15322c1243 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:09.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.320+0000 7f780b7fe640 1 -- 172.21.15.45:0/1323092632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810040070 con 0x560469530940 2024-09-15T22:17:09.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.320+0000 7f780b7fe640 1 -- 172.21.15.45:0/1323092632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7810005020 con 0x560469530940 2024-09-15T22:17:09.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.320+0000 7f780b7fe640 1 -- 172.21.15.45:0/1323092632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810035040 con 0x560469530940 2024-09-15T22:17:09.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.321+0000 7f7829a18740 1 -- 172.21.15.45:0/1323092632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 msgr2=0x560469532d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:09.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.321+0000 7f7829a18740 1 --2- 172.21.15.45:0/1323092632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 0x560469532d30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7810005ec0 tx=0x7f78100316f0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.321+0000 7f7829a18740 1 -- 172.21.15.45:0/1323092632 shutdown_connections 2024-09-15T22:17:09.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.321+0000 7f7829a18740 1 --2- 172.21.15.45:0/1323092632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 0x560469532d30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.321+0000 7f7829a18740 1 --2- 172.21.15.45:0/1323092632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469526080 0x560469530400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.321+0000 7f7829a18740 1 --2- 172.21.15.45:0/1323092632 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469525760 0x560469525b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.321+0000 7f7829a18740 1 -- 172.21.15.45:0/1323092632 >> 172.21.15.45:0/1323092632 conn(0x560469521cf0 msgr2=0x5604695220d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:09.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.321+0000 7f7829a18740 1 -- 172.21.15.45:0/1323092632 shutdown_connections 2024-09-15T22:17:09.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.321+0000 7f7829a18740 1 -- 172.21.15.45:0/1323092632 wait complete. 2024-09-15T22:17:09.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.322+0000 7f7829a18740 1 -- start start 2024-09-15T22:17:09.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.322+0000 7f7829a18740 1 Processor -- start 2024-09-15T22:17:09.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.322+0000 7f7829a18740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469525760 0x56046952d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.322+0000 7f7829a18740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469526080 0x56046952dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.322+0000 7f7829a18740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 0x56046952e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f7829a18740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560469533510 con 0x560469530940 2024-09-15T22:17:09.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f7829a18740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5604694136e0 con 0x560469525760 2024-09-15T22:17:09.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f7825bdc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 0x56046952e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f7829a18740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560469533690 con 0x560469526080 2024-09-15T22:17:09.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f7824bda640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469526080 0x56046952dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f7829a18740 10 client.0 _ll_register_callbacks cb 0x560469437a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:09.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f78253db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469525760 0x56046952d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f7825bdc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 0x56046952e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34720/0 (socket says 172.21.15.45:34720) 2024-09-15T22:17:09.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f7825bdc640 1 -- 172.21.15.45:0/492672614 learned_addr learned my addr 172.21.15.45:0/492672614 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:09.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f78253db640 1 -- 172.21.15.45:0/492672614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469526080 msgr2=0x56046952dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:09.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f78253db640 1 --2- 172.21.15.45:0/492672614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469526080 0x56046952dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f78253db640 1 -- 172.21.15.45:0/492672614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 msgr2=0x56046952e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:09.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f78253db640 1 --2- 172.21.15.45:0/492672614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 0x56046952e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f78253db640 1 -- 172.21.15.45:0/492672614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56046953c9d0 con 0x560469525760 2024-09-15T22:17:09.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f7825bdc640 1 --2- 172.21.15.45:0/492672614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 0x56046952e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:09.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f7824bda640 1 --2- 172.21.15.45:0/492672614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469526080 0x56046952dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:09.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f78253db640 1 --2- 172.21.15.45:0/492672614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469525760 0x56046952d7e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f781c0cd540 tx=0x7f781c09ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=560c2b3a19a48ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f7808ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.323+0000 7f7808ff9640 1 -- 172.21.15.45:0/492672614 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781c01d040 con 0x560469525760 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.324+0000 7f7808ff9640 1 -- 172.21.15.45:0/492672614 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f781c0a47e0 con 0x560469525760 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.324+0000 7f7829a18740 1 -- 172.21.15.45:0/492672614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7810005020 con 0x560469525760 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.324+0000 7f7808ff9640 1 -- 172.21.15.45:0/492672614 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f781c0a4c70 con 0x560469525760 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.324+0000 7f7829a18740 10 client.25313 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.324+0000 7f7829a18740 1 -- 172.21.15.45:0/492672614 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56046953f2b0 con 0x560469525760 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.324+0000 7f7808ff9640 1 -- 172.21.15.45:0/492672614 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7810005020 con 0x560469525760 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.324+0000 7f7808ff9640 1 -- 172.21.15.45:0/492672614 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f781c09b500 con 0x560469525760 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.325+0000 7f7829a18740 10 client.25313 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.325+0000 7f7829a18740 10 client.25313 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.325+0000 7f7829a18740 20 client.25313 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.325+0000 7f7829a18740 1 --2- 172.21.15.45:0/492672614 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560469540710 0x560469542b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.325+0000 7f7829a18740 4 client.25313 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:09.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.325+0000 7f7829a18740 1 -- 172.21.15.45:0/492672614 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604694989d0 con 0x560469540710 2024-09-15T22:17:09.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.325+0000 7f7824bda640 1 --2- 172.21.15.45:0/492672614 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560469540710 0x560469542b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.326+0000 7f7824bda640 1 --2- 172.21.15.45:0/492672614 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560469540710 0x560469542b60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc724cf3966e3b16 server_cookie=c905e5f42063b338 in_seq=0 out_seq=0 2024-09-15T22:17:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.326+0000 7f7808ff9640 10 client.25313 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.326+0000 7f7808ff9640 1 -- 172.21.15.45:0/492672614 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604694989d0 con 0x560469540710 2024-09-15T22:17:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.326+0000 7f7808ff9640 10 client.25313 handle_command_reply: tid=0 2024-09-15T22:17:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.326+0000 7f7829a18740 1 client.25313 shutdown 2024-09-15T22:17:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.326+0000 7f7829a18740 1 -- 172.21.15.45:0/492672614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469525760 msgr2=0x56046952d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.326+0000 7f7829a18740 1 --2- 172.21.15.45:0/492672614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469525760 0x56046952d7e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f781c0cd540 tx=0x7f781c09ba90 comp rx=0 tx=0).stop 2024-09-15T22:17:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.327+0000 7f7829a18740 1 -- 172.21.15.45:0/492672614 shutdown_connections 2024-09-15T22:17:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.327+0000 7f7829a18740 1 --2- 172.21.15.45:0/492672614 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560469540710 0x560469542b60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.327+0000 7f7829a18740 1 --2- 172.21.15.45:0/492672614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469530940 0x56046952e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.327+0000 7f7829a18740 1 --2- 172.21.15.45:0/492672614 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469526080 0x56046952dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.327+0000 7f7829a18740 1 --2- 172.21.15.45:0/492672614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469525760 0x56046952d7e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.327+0000 7f7829a18740 1 -- 172.21.15.45:0/492672614 >> 172.21.15.45:0/492672614 conn(0x560469521cf0 msgr2=0x5604695279d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:09.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.327+0000 7f7808ff9640 0 client.25313 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:09.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.327+0000 7f7829a18740 1 -- 172.21.15.45:0/492672614 shutdown_connections 2024-09-15T22:17:09.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.327+0000 7f7829a18740 1 -- 172.21.15.45:0/492672614 wait complete. 2024-09-15T22:17:09.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.327+0000 7f7829a18740 20 client.25313 trim_cache size 0 max 16384 2024-09-15T22:17:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.344+0000 7f7829a18740 1 Processor -- start 2024-09-15T22:17:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.344+0000 7f7829a18740 1 -- start start 2024-09-15T22:17:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.344+0000 7f7829a18740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469525760 0x56046952c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.344+0000 7f7829a18740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469526080 0x560469548400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.344+0000 7f7829a18740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469530940 0x560469548940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.344+0000 7f7829a18740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78201af220 con 0x560469526080 2024-09-15T22:17:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.344+0000 7f7829a18740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f78201b1aa0 con 0x560469530940 2024-09-15T22:17:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.344+0000 7f7829a18740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f78201af890 con 0x560469525760 2024-09-15T22:17:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.345+0000 7f7824bda640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469526080 0x560469548400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.345+0000 7f7824bda640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469526080 0x560469548400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34734/0 (socket says 172.21.15.45:34734) 2024-09-15T22:17:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.345+0000 7f7824bda640 1 -- 172.21.15.45:0/3183717354 learned_addr learned my addr 172.21.15.45:0/3183717354 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.345+0000 7f7825bdc640 1 --2- 172.21.15.45:0/3183717354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469530940 0x560469548940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.345+0000 7f78253db640 1 --2- 172.21.15.45:0/3183717354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469525760 0x56046952c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.345+0000 7f7824bda640 1 -- 172.21.15.45:0/3183717354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469525760 msgr2=0x56046952c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.345+0000 7f7824bda640 1 --2- 172.21.15.45:0/3183717354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469525760 0x56046952c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.345+0000 7f7824bda640 1 -- 172.21.15.45:0/3183717354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469530940 msgr2=0x560469548940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.345+0000 7f7824bda640 1 --2- 172.21.15.45:0/3183717354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469530940 0x560469548940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.345+0000 7f7824bda640 1 -- 172.21.15.45:0/3183717354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560469529160 con 0x560469526080 2024-09-15T22:17:09.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.345+0000 7f7824bda640 1 --2- 172.21.15.45:0/3183717354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469526080 0x560469548400 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f78100096c0 tx=0x7f78100058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76eb2c0ab7c3ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:09.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.345+0000 7f780affd640 1 -- 172.21.15.45:0/3183717354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810040050 con 0x560469526080 2024-09-15T22:17:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.346+0000 7f780affd640 1 -- 172.21.15.45:0/3183717354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7810004440 con 0x560469526080 2024-09-15T22:17:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.346+0000 7f780affd640 1 -- 172.21.15.45:0/3183717354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7810035040 con 0x560469526080 2024-09-15T22:17:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.346+0000 7f7829a18740 1 -- 172.21.15.45:0/3183717354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469526080 msgr2=0x560469548400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.346+0000 7f7829a18740 1 --2- 172.21.15.45:0/3183717354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469526080 0x560469548400 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f78100096c0 tx=0x7f78100058d0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.346+0000 7f7829a18740 1 -- 172.21.15.45:0/3183717354 shutdown_connections 2024-09-15T22:17:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.346+0000 7f7829a18740 1 --2- 172.21.15.45:0/3183717354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469530940 0x560469548940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.346+0000 7f7829a18740 1 --2- 172.21.15.45:0/3183717354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469526080 0x560469548400 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.346+0000 7f7829a18740 1 --2- 172.21.15.45:0/3183717354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469525760 0x56046952c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.346+0000 7f7829a18740 1 -- 172.21.15.45:0/3183717354 >> 172.21.15.45:0/3183717354 conn(0x560469521cf0 msgr2=0x5604695279d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.346+0000 7f7829a18740 1 -- 172.21.15.45:0/3183717354 shutdown_connections 2024-09-15T22:17:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.346+0000 7f7829a18740 1 -- 172.21.15.45:0/3183717354 wait complete. 2024-09-15T22:17:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.347+0000 7f7829a18740 1 -- start start 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.347+0000 7f7829a18740 1 Processor -- start 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.347+0000 7f7829a18740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469525760 0x560469534700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.347+0000 7f7829a18740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469526080 0x560469534c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.347+0000 7f7829a18740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469530940 0x560469535180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.347+0000 7f7829a18740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f78201aff60 con 0x560469525760 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.347+0000 7f7829a18740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f78201b13d0 con 0x560469526080 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.347+0000 7f7829a18740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f78201b0630 con 0x560469530940 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.347+0000 7f7829a18740 10 client.0 _ll_register_callbacks cb 0x7f781c09bbf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.347+0000 7f78253db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469525760 0x560469534700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.347+0000 7f78253db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469525760 0x560469534700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34736/0 (socket says 172.21.15.45:34736) 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.347+0000 7f78253db640 1 -- 172.21.15.45:0/1006341229 learned_addr learned my addr 172.21.15.45:0/1006341229 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f7824bda640 1 --2- 172.21.15.45:0/1006341229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469526080 0x560469534c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f7825bdc640 1 --2- 172.21.15.45:0/1006341229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469530940 0x560469535180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f78253db640 1 -- 172.21.15.45:0/1006341229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469530940 msgr2=0x560469535180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f78253db640 1 --2- 172.21.15.45:0/1006341229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469530940 0x560469535180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f78253db640 1 -- 172.21.15.45:0/1006341229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469526080 msgr2=0x560469534c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f78253db640 1 --2- 172.21.15.45:0/1006341229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469526080 0x560469534c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f78253db640 1 -- 172.21.15.45:0/1006341229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56046952c790 con 0x560469525760 2024-09-15T22:17:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f78253db640 1 --2- 172.21.15.45:0/1006341229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469525760 0x560469534700 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f781c0058c0 tx=0x7f781c09bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9223f8caa79268 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f7808ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f7808ff9640 1 -- 172.21.15.45:0/1006341229 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781c01d040 con 0x560469525760 2024-09-15T22:17:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f7808ff9640 1 -- 172.21.15.45:0/1006341229 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9393+0+0 (secure 0 0 0) 0x7f781c0cdaf0 con 0x560469525760 2024-09-15T22:17:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f7829a18740 1 -- 172.21.15.45:0/1006341229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7810004440 con 0x560469525760 2024-09-15T22:17:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f7808ff9640 1 -- 172.21.15.45:0/1006341229 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f781c098350 con 0x560469525760 2024-09-15T22:17:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f7829a18740 10 client.15681 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.348+0000 7f7829a18740 1 -- 172.21.15.45:0/1006341229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5604695ab590 con 0x560469525760 2024-09-15T22:17:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.349+0000 7f7808ff9640 1 -- 172.21.15.45:0/1006341229 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7810004440 con 0x560469525760 2024-09-15T22:17:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.349+0000 7f7808ff9640 1 -- 172.21.15.45:0/1006341229 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f781c0079b0 con 0x560469525760 2024-09-15T22:17:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.349+0000 7f7829a18740 10 client.15681 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.349+0000 7f7829a18740 10 client.15681 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:17:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.349+0000 7f7829a18740 20 client.15681 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.349+0000 7f7829a18740 1 --2- 172.21.15.45:0/1006341229 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5604695abd10 0x5604695ae100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.349+0000 7f7829a18740 4 client.15681 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.2, "await_for": 45.0}] 2024-09-15T22:17:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.349+0000 7f7829a18740 1 -- 172.21.15.45:0/1006341229 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.2, "await_for": 45.0}) -- 0x560469492d20 con 0x5604695abd10 2024-09-15T22:17:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.349+0000 7f7824bda640 1 --2- 172.21.15.45:0/1006341229 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5604695abd10 0x5604695ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.350+0000 7f7808ff9640 10 client.15681 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.350+0000 7f7824bda640 1 --2- 172.21.15.45:0/1006341229 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5604695abd10 0x5604695ae100 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6a7fae921f67a7d server_cookie=a025fe0ebbff8d27 in_seq=0 out_seq=0 2024-09-15T22:17:09.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.358+0000 7f7808ff9640 1 -- 172.21.15.45:0/1006341229 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560469492d20 con 0x5604695abd10 2024-09-15T22:17:09.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.358+0000 7f7808ff9640 10 client.15681 handle_command_reply: tid=0 2024-09-15T22:17:09.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.358+0000 7f7829a18740 1 client.15681 shutdown 2024-09-15T22:17:09.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.359+0000 7f7829a18740 1 -- 172.21.15.45:0/1006341229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469525760 msgr2=0x560469534700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:09.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.359+0000 7f7829a18740 1 --2- 172.21.15.45:0/1006341229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469525760 0x560469534700 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f781c0058c0 tx=0x7f781c09bd20 comp rx=0 tx=0).stop 2024-09-15T22:17:09.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.359+0000 7f7829a18740 1 -- 172.21.15.45:0/1006341229 shutdown_connections 2024-09-15T22:17:09.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.359+0000 7f7829a18740 1 --2- 172.21.15.45:0/1006341229 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5604695abd10 0x5604695ae100 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.359+0000 7f7829a18740 1 --2- 172.21.15.45:0/1006341229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560469530940 0x560469535180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.359+0000 7f7829a18740 1 --2- 172.21.15.45:0/1006341229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560469526080 0x560469534c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.359+0000 7f7829a18740 1 --2- 172.21.15.45:0/1006341229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560469525760 0x560469534700 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.359+0000 7f7808ff9640 0 client.15681 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.359+0000 7f7829a18740 1 -- 172.21.15.45:0/1006341229 >> 172.21.15.45:0/1006341229 conn(0x560469521cf0 msgr2=0x56046952d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.359+0000 7f7829a18740 1 -- 172.21.15.45:0/1006341229 shutdown_connections 2024-09-15T22:17:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.359+0000 7f7829a18740 1 -- 172.21.15.45:0/1006341229 wait complete. 2024-09-15T22:17:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.359+0000 7f7829a18740 20 client.15681 trim_cache size 0 max 16384 2024-09-15T22:17:09.362 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:17:09.362 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 21, 2024-09-15T22:17:09.362 INFO:teuthology.orchestra.run.smithi045.stdout: "leader": 24476, 2024-09-15T22:17:09.362 INFO:teuthology.orchestra.run.smithi045.stdout: "set_version": 2, 2024-09-15T22:17:09.362 INFO:teuthology.orchestra.run.smithi045.stdout: "sets": { 2024-09-15T22:17:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "161b68ea": { 2024-09-15T22:17:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "version": 2, 2024-09-15T22:17:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "age_ref": 0.0, 2024-09-15T22:17:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "state": { 2024-09-15T22:17:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "QUIESCED", 2024-09-15T22:17:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.0 2024-09-15T22:17:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:17:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "timeout": 90.0, 2024-09-15T22:17:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "expiration": 150.2, 2024-09-15T22:17:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "members": { 2024-09-15T22:17:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "file:/": { 2024-09-15T22:17:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "excluded": false, 2024-09-15T22:17:09.363 INFO:teuthology.orchestra.run.smithi045.stdout: "state": { 2024-09-15T22:17:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "QUIESCED", 2024-09-15T22:17:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.0 2024-09-15T22:17:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:09.364 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:09.364 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:17:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.360+0000 7f782763f640 1 -- 172.21.15.45:0/403785766 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f780c0a34d0 msgr2=0x7f780c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.360+0000 7f782763f640 1 --2- 172.21.15.45:0/403785766 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f780c0a34d0 0x7f780c0a5990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f781800bd20 tx=0x7f7818009be0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.360+0000 7f782763f640 1 -- 172.21.15.45:0/403785766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7820102d30 msgr2=0x7f7820100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.360+0000 7f782763f640 1 --2- 172.21.15.45:0/403785766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7820102d30 0x7f7820100990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f781c00c890 tx=0x7f781c00cd50 comp rx=0 tx=0).stop 2024-09-15T22:17:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.360+0000 7f782763f640 1 -- 172.21.15.45:0/403785766 shutdown_connections 2024-09-15T22:17:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.360+0000 7f782763f640 1 --2- 172.21.15.45:0/403785766 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f780c0a34d0 0x7f780c0a5990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.360+0000 7f782763f640 1 --2- 172.21.15.45:0/403785766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78201082a0 0x7f7820101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.360+0000 7f782763f640 1 --2- 172.21.15.45:0/403785766 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f78201036e0 0x7f7820100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.360+0000 7f782763f640 1 --2- 172.21.15.45:0/403785766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7820102d30 0x7f7820100990 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.360+0000 7f782763f640 1 -- 172.21.15.45:0/403785766 >> 172.21.15.45:0/403785766 conn(0x7f78200fc7d0 msgr2=0x7f7820106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.360+0000 7f782763f640 1 -- 172.21.15.45:0/403785766 shutdown_connections 2024-09-15T22:17:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:09.360+0000 7f782763f640 1 -- 172.21.15.45:0/403785766 wait complete. 2024-09-15T22:17:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:09 smithi045 ceph-mon[31180]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 16 op/s 2024-09-15T22:17:09.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:09 smithi165 ceph-mon[35551]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 16 op/s 2024-09-15T22:17:09.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:09 smithi100 ceph-mon[35319]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 16 op/s 2024-09-15T22:17:10.160 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '161b68ea', quiesce took 3.6 seconds. Will release after: 26.599999999999998 2024-09-15T22:17:11.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:11 smithi165 ceph-mon[35551]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-15T22:17:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:11 smithi100 ceph-mon[35319]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-15T22:17:11.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:11 smithi045 ceph-mon[31180]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-09-15T22:17:13.602 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:13 smithi045 ceph-mon[31180]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-15T22:17:13.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:13 smithi165 ceph-mon[35551]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-15T22:17:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:13 smithi100 ceph-mon[35319]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-15T22:17:15.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:15 smithi165 ceph-mon[35551]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-15T22:17:15.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:15 smithi100 ceph-mon[35319]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-15T22:17:15.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:15 smithi045 ceph-mon[31180]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-15T22:17:17.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:17 smithi165 ceph-mon[35551]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-09-15T22:17:17.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:17 smithi100 ceph-mon[35319]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-09-15T22:17:17.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:17 smithi045 ceph-mon[31180]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-09-15T22:17:18.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-15T22:17:18.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-15T22:17:18.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:18 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-15T22:17:18.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-15T22:17:18.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-15T22:17:18.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:18 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-15T22:17:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-15T22:17:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-15T22:17:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:18 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2024-09-15T22:17:19.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:19 smithi165 ceph-mon[35551]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-15T22:17:19.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:19 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-15T22:17:19.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:19 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-15T22:17:19.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:19 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-15T22:17:19.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:19 smithi165 ceph-mon[35551]: osdmap e91: 12 total, 12 up, 12 in 2024-09-15T22:17:19.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:19 smithi100 ceph-mon[35319]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-15T22:17:19.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:19 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-15T22:17:19.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:19 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-15T22:17:19.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:19 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-15T22:17:19.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:19 smithi100 ceph-mon[35319]: osdmap e91: 12 total, 12 up, 12 in 2024-09-15T22:17:19.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:19 smithi045 ceph-mon[31180]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 853 B/s wr, 2 op/s 2024-09-15T22:17:19.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:19 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-15T22:17:19.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:19 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-15T22:17:19.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:19 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2024-09-15T22:17:19.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:19 smithi045 ceph-mon[31180]: osdmap e91: 12 total, 12 up, 12 in 2024-09-15T22:17:20.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:20 smithi165 ceph-mon[35551]: osdmap e92: 12 total, 12 up, 12 in 2024-09-15T22:17:20.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:20 smithi100 ceph-mon[35319]: osdmap e92: 12 total, 12 up, 12 in 2024-09-15T22:17:20.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:20 smithi045 ceph-mon[31180]: osdmap e92: 12 total, 12 up, 12 in 2024-09-15T22:17:21.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:21 smithi165 ceph-mon[35551]: pgmap v36: 129 pgs: 3 peering, 126 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-15T22:17:21.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:21 smithi165 ceph-mon[35551]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-15T22:17:21.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:21 smithi100 ceph-mon[35319]: pgmap v36: 129 pgs: 3 peering, 126 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-15T22:17:21.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:21 smithi100 ceph-mon[35319]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-15T22:17:21.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:21 smithi045 ceph-mon[31180]: pgmap v36: 129 pgs: 3 peering, 126 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-15T22:17:21.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:21 smithi045 ceph-mon[31180]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-15T22:17:23.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:23 smithi165 ceph-mon[35551]: pgmap v37: 129 pgs: 3 peering, 126 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-15T22:17:23.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:23 smithi100 ceph-mon[35319]: pgmap v37: 129 pgs: 3 peering, 126 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-15T22:17:23.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:23 smithi045 ceph-mon[31180]: pgmap v37: 129 pgs: 3 peering, 126 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-15T22:17:25.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:25 smithi165 ceph-mon[35551]: pgmap v38: 129 pgs: 3 peering, 126 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 127 B/s wr, 1 op/s 2024-09-15T22:17:25.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:25 smithi100 ceph-mon[35319]: pgmap v38: 129 pgs: 3 peering, 126 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 127 B/s wr, 1 op/s 2024-09-15T22:17:25.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:25 smithi045 ceph-mon[31180]: pgmap v38: 129 pgs: 3 peering, 126 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s rd, 127 B/s wr, 1 op/s 2024-09-15T22:17:26.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:26 smithi165 ceph-mon[35551]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 127 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:26.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:26 smithi165 ceph-mon[35551]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-15T22:17:26.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:26 smithi165 ceph-mon[35551]: Cluster is now healthy 2024-09-15T22:17:26.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:26 smithi100 ceph-mon[35319]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 127 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:26.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:26 smithi100 ceph-mon[35319]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-15T22:17:26.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:26 smithi100 ceph-mon[35319]: Cluster is now healthy 2024-09-15T22:17:26.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:26 smithi045 ceph-mon[31180]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 127 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:26.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:26 smithi045 ceph-mon[31180]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-15T22:17:26.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:26 smithi045 ceph-mon[31180]: Cluster is now healthy 2024-09-15T22:17:27.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:27 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:27.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:27 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:27.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:27 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:17:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:28 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:17:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:28 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:17:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:28 smithi045 ceph-mon[31180]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 110 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:28 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:28 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:28 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:17:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:28 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:17:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:28 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:17:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:28 smithi165 ceph-mon[35551]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 110 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:28 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:28 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:28 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:17:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:28 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:17:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:28 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:17:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:28 smithi100 ceph-mon[35319]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 110 B/s wr, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:28 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:17:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:28 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:17:28.995 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:28 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:17:30.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:30 smithi165 ceph-mon[35551]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1000 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:30.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:30 smithi100 ceph-mon[35319]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1000 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:31.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:30 smithi045 ceph-mon[31180]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1000 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:32.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:32 smithi165 ceph-mon[35551]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:32.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:32 smithi100 ceph-mon[35319]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:32 smithi045 ceph-mon[31180]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:34.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:34 smithi165 ceph-mon[35551]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:34.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:34 smithi100 ceph-mon[35319]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:35.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:34 smithi045 ceph-mon[31180]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:36.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:17:36.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:17:36.930 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:36 smithi045 ceph-mon[31180]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:36.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:36 smithi165 ceph-mon[35551]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:36.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:36 smithi100 ceph-mon[35319]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s; 0 B/s, 0 objects/s recovering 2024-09-15T22:17:37.088 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.684+0000 7f30db9cb640 1 -- 172.21.15.45:0/1012781649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d410c190 msgr2=0x7f30d410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.684+0000 7f30db9cb640 1 --2- 172.21.15.45:0/1012781649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d410c190 0x7f30d410e610 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009ca0 tx=0x7f30cc02a970 comp rx=0 tx=0).stop 2024-09-15T22:17:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.685+0000 7f30db9cb640 1 -- 172.21.15.45:0/1012781649 shutdown_connections 2024-09-15T22:17:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.685+0000 7f30db9cb640 1 --2- 172.21.15.45:0/1012781649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d410c190 0x7f30d410e610 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.685+0000 7f30db9cb640 1 --2- 172.21.15.45:0/1012781649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30d41036d0 0x7f30d410bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.685+0000 7f30db9cb640 1 --2- 172.21.15.45:0/1012781649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30d4102db0 0x7f30d4103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.685+0000 7f30db9cb640 1 -- 172.21.15.45:0/1012781649 >> 172.21.15.45:0/1012781649 conn(0x7f30d40fc7d0 msgr2=0x7f30d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:37.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.685+0000 7f30db9cb640 1 -- 172.21.15.45:0/1012781649 shutdown_connections 2024-09-15T22:17:37.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.685+0000 7f30db9cb640 1 -- 172.21.15.45:0/1012781649 wait complete. 2024-09-15T22:17:37.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.686+0000 7f30db9cb640 1 Processor -- start 2024-09-15T22:17:37.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.686+0000 7f30db9cb640 1 -- start start 2024-09-15T22:17:37.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.687+0000 7f30db9cb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30d4102db0 0x7f30d4198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.687+0000 7f30db9cb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30d41036d0 0x7f30d4198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.687+0000 7f30db9cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d410c190 0x7f30d419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.687+0000 7f30d9767640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30d4102db0 0x7f30d4198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.687+0000 7f30d9767640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30d4102db0 0x7f30d4198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:36720/0 (socket says 172.21.15.45:36720) 2024-09-15T22:17:37.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.687+0000 7f30d8f66640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30d41036d0 0x7f30d4198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.687+0000 7f30d8f66640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30d41036d0 0x7f30d4198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:54794/0 (socket says 172.21.15.45:54794) 2024-09-15T22:17:37.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.687+0000 7f30d9767640 1 -- 172.21.15.45:0/2521010009 learned_addr learned my addr 172.21.15.45:0/2521010009 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:37.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.687+0000 7f30db9cb640 1 -- 172.21.15.45:0/2521010009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4112140 con 0x7f30d410c190 2024-09-15T22:17:37.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.687+0000 7f30db9cb640 1 -- 172.21.15.45:0/2521010009 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4111fc0 con 0x7f30d4102db0 2024-09-15T22:17:37.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.687+0000 7f30db9cb640 1 -- 172.21.15.45:0/2521010009 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41122c0 con 0x7f30d41036d0 2024-09-15T22:17:37.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.687+0000 7f30d9f68640 1 --2- 172.21.15.45:0/2521010009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d410c190 0x7f30d419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.688+0000 7f30d9f68640 1 -- 172.21.15.45:0/2521010009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30d41036d0 msgr2=0x7f30d4198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:37.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.688+0000 7f30d9f68640 1 --2- 172.21.15.45:0/2521010009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30d41036d0 0x7f30d4198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.688+0000 7f30d9f68640 1 -- 172.21.15.45:0/2521010009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30d4102db0 msgr2=0x7f30d4198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:37.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.688+0000 7f30d9f68640 1 --2- 172.21.15.45:0/2521010009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30d4102db0 0x7f30d4198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:37.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.688+0000 7f30d9f68640 1 -- 172.21.15.45:0/2521010009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d419d4d0 con 0x7f30d410c190 2024-09-15T22:17:37.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.688+0000 7f30d9f68640 1 --2- 172.21.15.45:0/2521010009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d410c190 0x7f30d419cdf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f30cc02ae90 tx=0x7f30cc030c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:37.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.688+0000 7f30ca7fc640 1 -- 172.21.15.45:0/2521010009 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc034050 con 0x7f30d410c190 2024-09-15T22:17:37.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.689+0000 7f30db9cb640 1 -- 172.21.15.45:0/2521010009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d419d760 con 0x7f30d410c190 2024-09-15T22:17:37.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.689+0000 7f30ca7fc640 1 -- 172.21.15.45:0/2521010009 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f30cc02f8d0 con 0x7f30d410c190 2024-09-15T22:17:37.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.689+0000 7f30db9cb640 1 -- 172.21.15.45:0/2521010009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d419db80 con 0x7f30d410c190 2024-09-15T22:17:37.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.690+0000 7f30ca7fc640 1 -- 172.21.15.45:0/2521010009 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc039620 con 0x7f30d410c190 2024-09-15T22:17:37.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.690+0000 7f30bffff640 1 -- 172.21.15.45:0/2521010009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d4103190 con 0x7f30d410c190 2024-09-15T22:17:37.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.692+0000 7f30ca7fc640 1 -- 172.21.15.45:0/2521010009 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f30cc037020 con 0x7f30d410c190 2024-09-15T22:17:37.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.693+0000 7f30ca7fc640 1 --2- 172.21.15.45:0/2521010009 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f30c00a3550 0x7f30c00a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:37.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.694+0000 7f30ca7fc640 1 -- 172.21.15.45:0/2521010009 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f30cc0f12d0 con 0x7f30d410c190 2024-09-15T22:17:37.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.694+0000 7f30d9767640 1 --2- 172.21.15.45:0/2521010009 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f30c00a3550 0x7f30c00a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:37.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.694+0000 7f30d9767640 1 --2- 172.21.15.45:0/2521010009 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f30c00a3550 0x7f30c00a5a10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009ce0 tx=0x7f30d0005f90 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:37.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:37.701+0000 7f30ca7fc640 1 -- 172.21.15.45:0/2521010009 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f30cc0bd6d0 con 0x7f30d410c190 2024-09-15T22:17:37.705 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:38.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.118+0000 7f30bffff640 1 -- 172.21.15.45:0/2521010009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30d4062df0 con 0x7f30d410c190 2024-09-15T22:17:38.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.120+0000 7f30ca7fc640 1 -- 172.21.15.45:0/2521010009 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f30cc0bcfd0 con 0x7f30d410c190 2024-09-15T22:17:38.121 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:17:38.121 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:17:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:17:38.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.123+0000 7f30bffff640 1 -- 172.21.15.45:0/2521010009 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f30c00a3550 msgr2=0x7f30c00a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.123+0000 7f30bffff640 1 --2- 172.21.15.45:0/2521010009 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f30c00a3550 0x7f30c00a5a10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f30d0009ce0 tx=0x7f30d0005f90 comp rx=0 tx=0).stop 2024-09-15T22:17:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.123+0000 7f30bffff640 1 -- 172.21.15.45:0/2521010009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d410c190 msgr2=0x7f30d419cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.123+0000 7f30bffff640 1 --2- 172.21.15.45:0/2521010009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d410c190 0x7f30d419cdf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f30cc02ae90 tx=0x7f30cc030c80 comp rx=0 tx=0).stop 2024-09-15T22:17:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.125+0000 7f30bffff640 1 -- 172.21.15.45:0/2521010009 shutdown_connections 2024-09-15T22:17:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.125+0000 7f30bffff640 1 --2- 172.21.15.45:0/2521010009 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f30c00a3550 0x7f30c00a5a10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.125+0000 7f30bffff640 1 --2- 172.21.15.45:0/2521010009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30d410c190 0x7f30d419cdf0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.125+0000 7f30bffff640 1 --2- 172.21.15.45:0/2521010009 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f30d41036d0 0x7f30d4198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.125+0000 7f30bffff640 1 --2- 172.21.15.45:0/2521010009 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30d4102db0 0x7f30d4198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.125+0000 7f30bffff640 1 -- 172.21.15.45:0/2521010009 >> 172.21.15.45:0/2521010009 conn(0x7f30d40fc7d0 msgr2=0x7f30d40fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.125+0000 7f30bffff640 1 -- 172.21.15.45:0/2521010009 shutdown_connections 2024-09-15T22:17:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.125+0000 7f30bffff640 1 -- 172.21.15.45:0/2521010009 wait complete. 2024-09-15T22:17:38.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.220+0000 7fee300a7640 1 -- 172.21.15.45:0/1248438034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee28102ef0 msgr2=0x7fee2810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:38.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.220+0000 7fee300a7640 1 --2- 172.21.15.45:0/1248438034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee28102ef0 0x7fee2810da40 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fee20009ca0 tx=0x7fee2002a950 comp rx=0 tx=0).stop 2024-09-15T22:17:38.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.220+0000 7fee300a7640 1 -- 172.21.15.45:0/1248438034 shutdown_connections 2024-09-15T22:17:38.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.221+0000 7fee300a7640 1 --2- 172.21.15.45:0/1248438034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee28102ef0 0x7fee2810da40 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.221+0000 7fee300a7640 1 --2- 172.21.15.45:0/1248438034 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee28102570 0x7fee281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.221+0000 7fee300a7640 1 --2- 172.21.15.45:0/1248438034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee28100e20 0x7fee28101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.221+0000 7fee300a7640 1 -- 172.21.15.45:0/1248438034 >> 172.21.15.45:0/1248438034 conn(0x7fee280fc7d0 msgr2=0x7fee280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.221+0000 7fee300a7640 1 -- 172.21.15.45:0/1248438034 shutdown_connections 2024-09-15T22:17:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.221+0000 7fee300a7640 1 -- 172.21.15.45:0/1248438034 wait complete. 2024-09-15T22:17:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.222+0000 7fee300a7640 1 Processor -- start 2024-09-15T22:17:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.222+0000 7fee300a7640 1 -- start start 2024-09-15T22:17:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.223+0000 7fee300a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee28100e20 0x7fee28196160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.223+0000 7fee300a7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee28102570 0x7fee281966a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.223+0000 7fee300a7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee28102ef0 0x7fee2819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.223+0000 7fee300a7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fee2810ffa0 con 0x7fee28100e20 2024-09-15T22:17:38.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.223+0000 7fee2de43640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee28100e20 0x7fee28196160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.223+0000 7fee2de43640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee28100e20 0x7fee28196160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40632/0 (socket says 172.21.15.45:40632) 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.223+0000 7fee2de43640 1 -- 172.21.15.45:0/2167764919 learned_addr learned my addr 172.21.15.45:0/2167764919 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.223+0000 7fee300a7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fee2810fe20 con 0x7fee28102ef0 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.223+0000 7fee300a7640 1 -- 172.21.15.45:0/2167764919 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fee28110120 con 0x7fee28102570 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.223+0000 7fee2d642640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee28102570 0x7fee281966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.223+0000 7fee2e644640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee28102ef0 0x7fee2819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.224+0000 7fee2d642640 1 -- 172.21.15.45:0/2167764919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee28102ef0 msgr2=0x7fee2819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.224+0000 7fee2d642640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee28102ef0 0x7fee2819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.224+0000 7fee2d642640 1 -- 172.21.15.45:0/2167764919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee28100e20 msgr2=0x7fee28196160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.224+0000 7fee2d642640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee28100e20 0x7fee28196160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.224+0000 7fee2d642640 1 -- 172.21.15.45:0/2167764919 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2819b110 con 0x7fee28102570 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.224+0000 7fee2de43640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee28100e20 0x7fee28196160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.224+0000 7fee2d642640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee28102570 0x7fee281966a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fee18010ad0 tx=0x7fee18010f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:38.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.224+0000 7fee1effd640 1 -- 172.21.15.45:0/2167764919 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1800eab0 con 0x7fee28102570 2024-09-15T22:17:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.224+0000 7fee1effd640 1 -- 172.21.15.45:0/2167764919 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee1801a070 con 0x7fee28102570 2024-09-15T22:17:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.224+0000 7fee1effd640 1 -- 172.21.15.45:0/2167764919 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee180095f0 con 0x7fee28102570 2024-09-15T22:17:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.224+0000 7fee300a7640 1 -- 172.21.15.45:0/2167764919 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee2819b400 con 0x7fee28102570 2024-09-15T22:17:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.225+0000 7fee300a7640 1 -- 172.21.15.45:0/2167764919 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee2819b830 con 0x7fee28102570 2024-09-15T22:17:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.228+0000 7fee32480740 1 Processor -- start 2024-09-15T22:17:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.228+0000 7fee32480740 1 -- start start 2024-09-15T22:17:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.229+0000 7fee32480740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a94a0 0x5611ba2a9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.229+0000 7fee32480740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.229+0000 7fee32480740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2b4680 0x5611ba2b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.229+0000 7fee32480740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5611ba20f2e0 con 0x5611ba2a94a0 2024-09-15T22:17:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.229+0000 7fee32480740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5611ba1b6ce0 con 0x5611ba2a9dc0 2024-09-15T22:17:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.229+0000 7fee32480740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5611ba20b2a0 con 0x5611ba2b4680 2024-09-15T22:17:38.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.229+0000 7fee2e644640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a94a0 0x5611ba2a9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.229+0000 7fee2e644640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a94a0 0x5611ba2a9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40644/0 (socket says 172.21.15.45:40644) 2024-09-15T22:17:38.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.229+0000 7fee2e644640 1 -- 172.21.15.45:0/2793816079 learned_addr learned my addr 172.21.15.45:0/2793816079 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:38.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.229+0000 7fee2de43640 1 --2- 172.21.15.45:0/2793816079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.230+0000 7fee1effd640 1 -- 172.21.15.45:0/2167764919 <== mon.1 v2:172.21.15.165:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7fee18015410 con 0x7fee28102570 2024-09-15T22:17:38.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.231+0000 7fee2d642640 1 --2- 172.21.15.45:0/2793816079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2b4680 0x5611ba2b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.231+0000 7fee2e644640 1 -- 172.21.15.45:0/2793816079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2b4680 msgr2=0x5611ba2b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:38.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.231+0000 7fee2e644640 1 --2- 172.21.15.45:0/2793816079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2b4680 0x5611ba2b6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.231+0000 7fee2e644640 1 -- 172.21.15.45:0/2793816079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 msgr2=0x5611ba2b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:38.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.231+0000 7fee2e644640 1 --2- 172.21.15.45:0/2793816079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.231+0000 7fee2e644640 1 -- 172.21.15.45:0/2793816079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ba19b440 con 0x5611ba2a94a0 2024-09-15T22:17:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.231+0000 7fee2d642640 1 --2- 172.21.15.45:0/2793816079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2b4680 0x5611ba2b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.231+0000 7fee1effd640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fee140a34d0 0x7fee140a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.231+0000 7fee2de43640 1 --2- 172.21.15.45:0/2793816079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.232+0000 7fee1effd640 1 -- 172.21.15.45:0/2167764919 <== mon.1 v2:172.21.15.165:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fee180d0450 con 0x7fee28102570 2024-09-15T22:17:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.232+0000 7fee2de43640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fee140a34d0 0x7fee140a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.232+0000 7fee2e644640 1 --2- 172.21.15.45:0/2793816079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a94a0 0x5611ba2a9880 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fee20035000 tx=0x7fee20005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd24b7dff6b795f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.232+0000 7fee13fff640 1 -- 172.21.15.45:0/2793816079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2004c070 con 0x5611ba2a94a0 2024-09-15T22:17:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.232+0000 7fee13fff640 1 -- 172.21.15.45:0/2793816079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee2002fbf0 con 0x5611ba2a94a0 2024-09-15T22:17:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.232+0000 7fee13fff640 1 -- 172.21.15.45:0/2793816079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20034040 con 0x5611ba2a94a0 2024-09-15T22:17:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.233+0000 7fee32480740 1 -- 172.21.15.45:0/2793816079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a94a0 msgr2=0x5611ba2a9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:38.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.233+0000 7fee2de43640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fee140a34d0 0x7fee140a5990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee24009620 tx=0x7fee24005f90 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:38.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.233+0000 7fee32480740 1 --2- 172.21.15.45:0/2793816079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a94a0 0x5611ba2a9880 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fee20035000 tx=0x7fee20005d80 comp rx=0 tx=0).stop 2024-09-15T22:17:38.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.234+0000 7fee32480740 1 -- 172.21.15.45:0/2793816079 shutdown_connections 2024-09-15T22:17:38.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.234+0000 7fee32480740 1 --2- 172.21.15.45:0/2793816079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2b4680 0x5611ba2b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.234+0000 7fee32480740 1 --2- 172.21.15.45:0/2793816079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.234+0000 7fee32480740 1 --2- 172.21.15.45:0/2793816079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a94a0 0x5611ba2a9880 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.234+0000 7fee32480740 1 -- 172.21.15.45:0/2793816079 >> 172.21.15.45:0/2793816079 conn(0x5611ba2a5a30 msgr2=0x5611ba2a5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:38.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.234+0000 7fee32480740 1 -- 172.21.15.45:0/2793816079 shutdown_connections 2024-09-15T22:17:38.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.234+0000 7fee32480740 1 -- 172.21.15.45:0/2793816079 wait complete. 2024-09-15T22:17:38.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.234+0000 7fee32480740 1 -- start start 2024-09-15T22:17:38.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.234+0000 7fee32480740 1 Processor -- start 2024-09-15T22:17:38.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.235+0000 7fee32480740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a94a0 0x5611ba2b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.235+0000 7fee32480740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a9dc0 0x5611ba2b1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.235+0000 7fee32480740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2b4680 0x5611ba2b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.235+0000 7fee32480740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5611ba2b7250 con 0x5611ba2a9dc0 2024-09-15T22:17:38.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.235+0000 7fee32480740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5611ba1ca050 con 0x5611ba2a94a0 2024-09-15T22:17:38.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.235+0000 7fee32480740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5611ba2b73d0 con 0x5611ba2b4680 2024-09-15T22:17:38.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.235+0000 7fee2d642640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a9dc0 0x5611ba2b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.235+0000 7fee32480740 10 client.0 _ll_register_callbacks cb 0x5611ba20a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.235+0000 7fee2d642640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a9dc0 0x5611ba2b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40658/0 (socket says 172.21.15.45:40658) 2024-09-15T22:17:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.235+0000 7fee2d642640 1 -- 172.21.15.45:0/4231415057 learned_addr learned my addr 172.21.15.45:0/4231415057 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.235+0000 7fee2de43640 1 --2- 172.21.15.45:0/4231415057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a94a0 0x5611ba2b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.236+0000 7fee2e644640 1 --2- 172.21.15.45:0/4231415057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2b4680 0x5611ba2b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.236+0000 7fee2d642640 1 -- 172.21.15.45:0/4231415057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2b4680 msgr2=0x5611ba2b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.236+0000 7fee2d642640 1 --2- 172.21.15.45:0/4231415057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2b4680 0x5611ba2b18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.236+0000 7fee2d642640 1 -- 172.21.15.45:0/4231415057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a94a0 msgr2=0x5611ba2b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.236+0000 7fee2d642640 1 --2- 172.21.15.45:0/4231415057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a94a0 0x5611ba2b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.236+0000 7fee2d642640 1 -- 172.21.15.45:0/4231415057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611b9f803c0 con 0x5611ba2a9dc0 2024-09-15T22:17:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.236+0000 7fee2d642640 1 --2- 172.21.15.45:0/4231415057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a9dc0 0x5611ba2b1300 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fee1800e490 tx=0x7fee1809c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e4e31fd46413e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:38.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.236+0000 7fee117fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:38.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.236+0000 7fee117fa640 1 -- 172.21.15.45:0/4231415057 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee180a4d90 con 0x5611ba2a9dc0 2024-09-15T22:17:38.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.236+0000 7fee117fa640 1 -- 172.21.15.45:0/4231415057 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fee180d0120 con 0x5611ba2a9dc0 2024-09-15T22:17:38.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.236+0000 7fee32480740 1 -- 172.21.15.45:0/4231415057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee2002fbf0 con 0x5611ba2a9dc0 2024-09-15T22:17:38.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.237+0000 7fee117fa640 1 -- 172.21.15.45:0/4231415057 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fee180bc070 con 0x5611ba2a9dc0 2024-09-15T22:17:38.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.237+0000 7fee32480740 10 client.15699 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:38.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.237+0000 7fee32480740 1 -- 172.21.15.45:0/4231415057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5611ba2c2c40 con 0x5611ba2a9dc0 2024-09-15T22:17:38.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.237+0000 7fee117fa640 1 -- 172.21.15.45:0/4231415057 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee2002fbf0 con 0x5611ba2a9dc0 2024-09-15T22:17:38.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.238+0000 7fee117fa640 1 -- 172.21.15.45:0/4231415057 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fee1809b620 con 0x5611ba2a9dc0 2024-09-15T22:17:38.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.238+0000 7fee32480740 10 client.15699 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:38.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.238+0000 7fee32480740 10 client.15699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:38.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.238+0000 7fee32480740 20 client.15699 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:38.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.238+0000 7fee32480740 1 --2- 172.21.15.45:0/4231415057 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5611ba2c4100 0x5611ba2c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.238+0000 7fee32480740 4 client.15699 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:38.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.238+0000 7fee32480740 1 -- 172.21.15.45:0/4231415057 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611ba21c850 con 0x5611ba2c4100 2024-09-15T22:17:38.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.238+0000 7fee2de43640 1 --2- 172.21.15.45:0/4231415057 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5611ba2c4100 0x5611ba2c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.239+0000 7fee2de43640 1 --2- 172.21.15.45:0/4231415057 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5611ba2c4100 0x5611ba2c64f0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a9be1aa358a3a34 server_cookie=dcc721fcb7f7bd16 in_seq=0 out_seq=0 2024-09-15T22:17:38.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.239+0000 7fee117fa640 10 client.15699 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:38.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.239+0000 7fee117fa640 1 -- 172.21.15.45:0/4231415057 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611ba21c850 con 0x5611ba2c4100 2024-09-15T22:17:38.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.239+0000 7fee117fa640 10 client.15699 handle_command_reply: tid=0 2024-09-15T22:17:38.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.239+0000 7fee32480740 1 client.15699 shutdown 2024-09-15T22:17:38.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.240+0000 7fee32480740 1 -- 172.21.15.45:0/4231415057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a9dc0 msgr2=0x5611ba2b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:38.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.240+0000 7fee32480740 1 --2- 172.21.15.45:0/4231415057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a9dc0 0x5611ba2b1300 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fee1800e490 tx=0x7fee1809c820 comp rx=0 tx=0).stop 2024-09-15T22:17:38.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.240+0000 7fee32480740 1 -- 172.21.15.45:0/4231415057 shutdown_connections 2024-09-15T22:17:38.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.240+0000 7fee32480740 1 --2- 172.21.15.45:0/4231415057 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5611ba2c4100 0x5611ba2c64f0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.240+0000 7fee32480740 1 --2- 172.21.15.45:0/4231415057 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2b4680 0x5611ba2b18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.240+0000 7fee32480740 1 --2- 172.21.15.45:0/4231415057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2a9dc0 0x5611ba2b1300 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.240+0000 7fee32480740 1 --2- 172.21.15.45:0/4231415057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a94a0 0x5611ba2b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.240+0000 7fee32480740 1 -- 172.21.15.45:0/4231415057 >> 172.21.15.45:0/4231415057 conn(0x5611ba2a5a30 msgr2=0x5611ba2a4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.240+0000 7fee117fa640 0 client.15699 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.240+0000 7fee32480740 1 -- 172.21.15.45:0/4231415057 shutdown_connections 2024-09-15T22:17:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.240+0000 7fee32480740 1 -- 172.21.15.45:0/4231415057 wait complete. 2024-09-15T22:17:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.241+0000 7fee32480740 20 client.15699 trim_cache size 0 max 16384 2024-09-15T22:17:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.259+0000 7fee32480740 1 Processor -- start 2024-09-15T22:17:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.259+0000 7fee32480740 1 -- start start 2024-09-15T22:17:38.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.260+0000 7fee32480740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2a94a0 0x5611ba2a5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.260+0000 7fee32480740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.260+0000 7fee32480740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2b4680 0x5611ba2ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.260+0000 7fee2de43640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2a94a0 0x5611ba2a5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.260+0000 7fee2de43640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2a94a0 0x5611ba2a5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:54824/0 (socket says 172.21.15.45:54824) 2024-09-15T22:17:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.260+0000 7fee2d642640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.261+0000 7fee2e644640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2b4680 0x5611ba2ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.261+0000 7fee2d642640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2c04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:36762/0 (socket says 172.21.15.45:36762) 2024-09-15T22:17:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.261+0000 7fee2e644640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2b4680 0x5611ba2ac7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40672/0 (socket says 172.21.15.45:40672) 2024-09-15T22:17:38.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.261+0000 7fee2de43640 1 -- 172.21.15.45:0/3573079598 learned_addr learned my addr 172.21.15.45:0/3573079598 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.261+0000 7fee32480740 1 -- 172.21.15.45:0/3573079598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fee281aaf00 con 0x5611ba2b4680 2024-09-15T22:17:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.261+0000 7fee32480740 1 -- 172.21.15.45:0/3573079598 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fee281ad780 con 0x5611ba2a9dc0 2024-09-15T22:17:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.261+0000 7fee32480740 1 -- 172.21.15.45:0/3573079598 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fee281ab570 con 0x5611ba2a94a0 2024-09-15T22:17:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.262+0000 7fee2e644640 1 -- 172.21.15.45:0/3573079598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2a94a0 msgr2=0x5611ba2a5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.262+0000 7fee2e644640 1 --2- 172.21.15.45:0/3573079598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2a94a0 0x5611ba2a5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.262+0000 7fee2e644640 1 -- 172.21.15.45:0/3573079598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 msgr2=0x5611ba2c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.262+0000 7fee2e644640 1 --2- 172.21.15.45:0/3573079598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2c04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.262+0000 7fee2e644640 1 -- 172.21.15.45:0/3573079598 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ba2b02b0 con 0x5611ba2b4680 2024-09-15T22:17:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.262+0000 7fee2e644640 1 --2- 172.21.15.45:0/3573079598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2b4680 0x5611ba2ac7f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fee2002ae70 tx=0x7fee20003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc409634978baaad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.263+0000 7fee137fe640 1 -- 172.21.15.45:0/3573079598 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20055070 con 0x5611ba2b4680 2024-09-15T22:17:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.263+0000 7fee137fe640 1 -- 172.21.15.45:0/3573079598 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee2002f3a0 con 0x5611ba2b4680 2024-09-15T22:17:38.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.263+0000 7fee137fe640 1 -- 172.21.15.45:0/3573079598 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2004c030 con 0x5611ba2b4680 2024-09-15T22:17:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.264+0000 7fee32480740 1 -- 172.21.15.45:0/3573079598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2b4680 msgr2=0x5611ba2ac7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.264+0000 7fee32480740 1 --2- 172.21.15.45:0/3573079598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2b4680 0x5611ba2ac7f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fee2002ae70 tx=0x7fee20003f20 comp rx=0 tx=0).stop 2024-09-15T22:17:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.264+0000 7fee32480740 1 -- 172.21.15.45:0/3573079598 shutdown_connections 2024-09-15T22:17:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.264+0000 7fee32480740 1 --2- 172.21.15.45:0/3573079598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2b4680 0x5611ba2ac7f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.264+0000 7fee32480740 1 --2- 172.21.15.45:0/3573079598 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.264+0000 7fee32480740 1 --2- 172.21.15.45:0/3573079598 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2a94a0 0x5611ba2a5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.264+0000 7fee32480740 1 -- 172.21.15.45:0/3573079598 >> 172.21.15.45:0/3573079598 conn(0x5611ba2a5a30 msgr2=0x5611ba2ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.264+0000 7fee32480740 1 -- 172.21.15.45:0/3573079598 shutdown_connections 2024-09-15T22:17:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.264+0000 7fee32480740 1 -- 172.21.15.45:0/3573079598 wait complete. 2024-09-15T22:17:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.265+0000 7fee32480740 1 -- start start 2024-09-15T22:17:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.265+0000 7fee32480740 1 Processor -- start 2024-09-15T22:17:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.265+0000 7fee32480740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2a94a0 0x5611ba2bc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee32480740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2bced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee32480740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2b4680 0x5611ba2ade70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee32480740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fee281abc40 con 0x5611ba2b4680 2024-09-15T22:17:38.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee32480740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fee281ad0b0 con 0x5611ba2a9dc0 2024-09-15T22:17:38.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee32480740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fee281ac310 con 0x5611ba2a94a0 2024-09-15T22:17:38.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee2de43640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2a94a0 0x5611ba2bc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee2de43640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2a94a0 0x5611ba2bc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:54832/0 (socket says 172.21.15.45:54832) 2024-09-15T22:17:38.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee2de43640 1 -- 172.21.15.45:0/1258538265 learned_addr learned my addr 172.21.15.45:0/1258538265 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:38.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee32480740 10 client.0 _ll_register_callbacks cb 0x7fee18015c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:38.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee2d642640 1 --2- 172.21.15.45:0/1258538265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2bced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee2de43640 1 -- 172.21.15.45:0/1258538265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 msgr2=0x5611ba2bced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:38.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee2de43640 1 --2- 172.21.15.45:0/1258538265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2bced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee2de43640 1 -- 172.21.15.45:0/1258538265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2b4680 msgr2=0x5611ba2ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee2de43640 1 --2- 172.21.15.45:0/1258538265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2b4680 0x5611ba2ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.266+0000 7fee2de43640 1 -- 172.21.15.45:0/1258538265 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611ba2ae6a0 con 0x5611ba2a94a0 2024-09-15T22:17:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.267+0000 7fee2de43640 1 --2- 172.21.15.45:0/1258538265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2a94a0 0x5611ba2bc990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee2400f9e0 tx=0x7fee240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fd52192e3caa1db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.267+0000 7fee117fa640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-15T22:17:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.267+0000 7fee117fa640 1 -- 172.21.15.45:0/1258538265 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2401d5f0 con 0x5611ba2a94a0 2024-09-15T22:17:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.267+0000 7fee117fa640 1 -- 172.21.15.45:0/1258538265 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fee24018030 con 0x5611ba2a94a0 2024-09-15T22:17:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.267+0000 7fee32480740 1 -- 172.21.15.45:0/1258538265 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee2002f3a0 con 0x5611ba2a94a0 2024-09-15T22:17:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.267+0000 7fee117fa640 1 -- 172.21.15.45:0/1258538265 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fee2401d790 con 0x5611ba2a94a0 2024-09-15T22:17:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.267+0000 7fee32480740 10 client.25255 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.267+0000 7fee32480740 1 -- 172.21.15.45:0/1258538265 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5611ba32e9a0 con 0x5611ba2a94a0 2024-09-15T22:17:38.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.268+0000 7fee117fa640 1 -- 172.21.15.45:0/1258538265 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fee2401de30 con 0x5611ba2a94a0 2024-09-15T22:17:38.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.268+0000 7fee117fa640 1 -- 172.21.15.45:0/1258538265 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fee240323c0 con 0x5611ba2a94a0 2024-09-15T22:17:38.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.268+0000 7fee32480740 10 client.25255 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:38.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.268+0000 7fee32480740 10 client.25255 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:38.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.268+0000 7fee32480740 20 client.25255 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:38.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.269+0000 7fee32480740 1 --2- 172.21.15.45:0/1258538265 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5611ba32f170 0x5611ba3315f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:38.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.269+0000 7fee32480740 4 client.25255 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:17:38.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.269+0000 7fee32480740 1 -- 172.21.15.45:0/1258538265 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fee2002f3a0 con 0x5611ba32f170 2024-09-15T22:17:38.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.269+0000 7fee2d642640 1 --2- 172.21.15.45:0/1258538265 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5611ba32f170 0x5611ba3315f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:38.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee2d642640 1 --2- 172.21.15.45:0/1258538265 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5611ba32f170 0x5611ba3315f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9052c90894cfd58a server_cookie=a5e554044e4b0c83 in_seq=0 out_seq=0 2024-09-15T22:17:38.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee117fa640 10 client.25255 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:38.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee117fa640 1 -- 172.21.15.45:0/1258538265 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fee2002f3a0 con 0x5611ba32f170 2024-09-15T22:17:38.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee117fa640 10 client.25255 handle_command_reply: tid=0 2024-09-15T22:17:38.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee32480740 1 client.25255 shutdown 2024-09-15T22:17:38.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee32480740 1 -- 172.21.15.45:0/1258538265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2a94a0 msgr2=0x5611ba2bc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:38.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee32480740 1 --2- 172.21.15.45:0/1258538265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2a94a0 0x5611ba2bc990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee2400f9e0 tx=0x7fee240046c0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee32480740 1 -- 172.21.15.45:0/1258538265 shutdown_connections 2024-09-15T22:17:38.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee32480740 1 --2- 172.21.15.45:0/1258538265 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5611ba32f170 0x5611ba3315f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee32480740 1 --2- 172.21.15.45:0/1258538265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611ba2b4680 0x5611ba2ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee32480740 1 --2- 172.21.15.45:0/1258538265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5611ba2a9dc0 0x5611ba2bced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee32480740 1 --2- 172.21.15.45:0/1258538265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5611ba2a94a0 0x5611ba2bc990 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee2400f9e0 tx=0x7fee240046c0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee32480740 1 -- 172.21.15.45:0/1258538265 >> 172.21.15.45:0/1258538265 conn(0x5611ba2a5a30 msgr2=0x5611ba2ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:38.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.270+0000 7fee117fa640 0 client.25255 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:38.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.271+0000 7fee32480740 1 -- 172.21.15.45:0/1258538265 shutdown_connections 2024-09-15T22:17:38.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.271+0000 7fee32480740 1 -- 172.21.15.45:0/1258538265 wait complete. 2024-09-15T22:17:38.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.271+0000 7fee32480740 20 client.25255 trim_cache size 0 max 16384 2024-09-15T22:17:38.667 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:17:38.667 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:17:38.667 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:17:38.667 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:17:38.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.271+0000 7fee300a7640 1 -- 172.21.15.45:0/2167764919 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fee140a34d0 msgr2=0x7fee140a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:38.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.271+0000 7fee300a7640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fee140a34d0 0x7fee140a5990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee24009620 tx=0x7fee24005f90 comp rx=0 tx=0).stop 2024-09-15T22:17:38.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.271+0000 7fee300a7640 1 -- 172.21.15.45:0/2167764919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee28102570 msgr2=0x7fee281966a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:38.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.271+0000 7fee300a7640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee28102570 0x7fee281966a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fee18010ad0 tx=0x7fee18010f90 comp rx=0 tx=0).stop 2024-09-15T22:17:38.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.271+0000 7fee300a7640 1 -- 172.21.15.45:0/2167764919 shutdown_connections 2024-09-15T22:17:38.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.271+0000 7fee300a7640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fee140a34d0 0x7fee140a5990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.271+0000 7fee300a7640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee28102ef0 0x7fee2819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.271+0000 7fee300a7640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fee28102570 0x7fee281966a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.271+0000 7fee300a7640 1 --2- 172.21.15.45:0/2167764919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee28100e20 0x7fee28196160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:38.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.272+0000 7fee300a7640 1 -- 172.21.15.45:0/2167764919 >> 172.21.15.45:0/2167764919 conn(0x7fee280fc7d0 msgr2=0x7fee280fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:38.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.272+0000 7fee300a7640 1 -- 172.21.15.45:0/2167764919 shutdown_connections 2024-09-15T22:17:38.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:38.272+0000 7fee300a7640 1 -- 172.21.15.45:0/2167764919 wait complete. 2024-09-15T22:17:38.669 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:38 smithi045 ceph-mon[31180]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:17:38.669 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:38 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2521010009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:38.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:38 smithi165 ceph-mon[35551]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:17:38.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:38 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2521010009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:38.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:38 smithi100 ceph-mon[35319]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:17:38.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:38 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2521010009' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:39.283 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:17:39.283 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:17:39.747 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db --set-id 161b68ea --release --await' 2024-09-15T22:17:39.747 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db --set-id 161b68ea --release --await 2024-09-15T22:17:39.803 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:40.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.383+0000 7fcb18da1640 1 -- 172.21.15.45:0/2220264513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb141082a0 msgr2=0x7fcb1410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:40.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.383+0000 7fcb18da1640 1 --2- 172.21.15.45:0/2220264513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb141082a0 0x7fcb1410ec40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009cd0 tx=0x7fcb0c02a8f0 comp rx=0 tx=0).stop 2024-09-15T22:17:40.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.384+0000 7fcb18da1640 1 -- 172.21.15.45:0/2220264513 shutdown_connections 2024-09-15T22:17:40.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.384+0000 7fcb18da1640 1 --2- 172.21.15.45:0/2220264513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb141082a0 0x7fcb1410ec40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:40.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.384+0000 7fcb18da1640 1 --2- 172.21.15.45:0/2220264513 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb141036e0 0x7fcb14107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:40.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.384+0000 7fcb18da1640 1 --2- 172.21.15.45:0/2220264513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb14102d30 0x7fcb14103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:40.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.384+0000 7fcb18da1640 1 -- 172.21.15.45:0/2220264513 >> 172.21.15.45:0/2220264513 conn(0x7fcb140fc7d0 msgr2=0x7fcb140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:40.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.384+0000 7fcb18da1640 1 -- 172.21.15.45:0/2220264513 shutdown_connections 2024-09-15T22:17:40.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.384+0000 7fcb18da1640 1 -- 172.21.15.45:0/2220264513 wait complete. 2024-09-15T22:17:40.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.385+0000 7fcb18da1640 1 Processor -- start 2024-09-15T22:17:40.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.385+0000 7fcb18da1640 1 -- start start 2024-09-15T22:17:40.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.386+0000 7fcb18da1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb14102d30 0x7fcb14198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:40.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.386+0000 7fcb18da1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb141036e0 0x7fcb14198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:40.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.386+0000 7fcb18da1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb141082a0 0x7fcb1419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:40.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.386+0000 7fcb18da1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14112210 con 0x7fcb14102d30 2024-09-15T22:17:40.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.386+0000 7fcb18da1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14112090 con 0x7fcb141082a0 2024-09-15T22:17:40.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.386+0000 7fcb18da1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14112390 con 0x7fcb141036e0 2024-09-15T22:17:40.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.386+0000 7fcb1259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb14102d30 0x7fcb14198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:40.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.386+0000 7fcb1259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb14102d30 0x7fcb14198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40696/0 (socket says 172.21.15.45:40696) 2024-09-15T22:17:40.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.386+0000 7fcb1259c640 1 -- 172.21.15.45:0/364925359 learned_addr learned my addr 172.21.15.45:0/364925359 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:40.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.386+0000 7fcb11d9b640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb141036e0 0x7fcb14198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:40.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.386+0000 7fcb12d9d640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb141082a0 0x7fcb1419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:40.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.387+0000 7fcb1259c640 1 -- 172.21.15.45:0/364925359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb141036e0 msgr2=0x7fcb14198b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:40.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.387+0000 7fcb1259c640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb141036e0 0x7fcb14198b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:40.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.387+0000 7fcb1259c640 1 -- 172.21.15.45:0/364925359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb141082a0 msgr2=0x7fcb1419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:40.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.387+0000 7fcb1259c640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb141082a0 0x7fcb1419cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:40.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.387+0000 7fcb1259c640 1 -- 172.21.15.45:0/364925359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1419d5e0 con 0x7fcb14102d30 2024-09-15T22:17:40.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.387+0000 7fcb11d9b640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb141036e0 0x7fcb14198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:17:40.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.387+0000 7fcb1259c640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb14102d30 0x7fcb14198630 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400d950 tx=0x7fcb0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:40.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.387+0000 7fcb037fe640 1 -- 172.21.15.45:0/364925359 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04017070 con 0x7fcb14102d30 2024-09-15T22:17:40.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.387+0000 7fcb037fe640 1 -- 172.21.15.45:0/364925359 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb04009c30 con 0x7fcb14102d30 2024-09-15T22:17:40.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.387+0000 7fcb18da1640 1 -- 172.21.15.45:0/364925359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1419d8d0 con 0x7fcb14102d30 2024-09-15T22:17:40.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.387+0000 7fcb037fe640 1 -- 172.21.15.45:0/364925359 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0400f740 con 0x7fcb14102d30 2024-09-15T22:17:40.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.387+0000 7fcb18da1640 1 -- 172.21.15.45:0/364925359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb141008c0 con 0x7fcb14102d30 2024-09-15T22:17:40.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.388+0000 7fcb18da1640 1 -- 172.21.15.45:0/364925359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb14103110 con 0x7fcb14102d30 2024-09-15T22:17:40.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.390+0000 7fcb037fe640 1 -- 172.21.15.45:0/364925359 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7fcb04010a80 con 0x7fcb14102d30 2024-09-15T22:17:40.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.390+0000 7fcb037fe640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a34d0 0x7fcafc0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:40.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.390+0000 7fcb11d9b640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a34d0 0x7fcafc0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:40.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.391+0000 7fcb037fe640 1 -- 172.21.15.45:0/364925359 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fcb040cffe0 con 0x7fcb14102d30 2024-09-15T22:17:40.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.391+0000 7fcb11d9b640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a34d0 0x7fcafc0a5990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcb08005e00 tx=0x7fcb08005c70 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:40.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.395+0000 7fcb037fe640 1 -- 172.21.15.45:0/364925359 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcb04009de0 con 0x7fcb14102d30 2024-09-15T22:17:40.527 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:40.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.621+0000 7fcb18da1640 1 -- 172.21.15.45:0/364925359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb14100a90 con 0x7fcb14102d30 2024-09-15T22:17:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.622+0000 7fcb037fe640 1 -- 172.21.15.45:0/364925359 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fcb0409c3b0 con 0x7fcb14102d30 2024-09-15T22:17:40.623 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:17:40.623 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:17:40.623 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:17:40.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.625+0000 7fcb18da1640 1 -- 172.21.15.45:0/364925359 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a34d0 msgr2=0x7fcafc0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.625+0000 7fcb18da1640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a34d0 0x7fcafc0a5990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcb08005e00 tx=0x7fcb08005c70 comp rx=0 tx=0).stop 2024-09-15T22:17:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.625+0000 7fcb18da1640 1 -- 172.21.15.45:0/364925359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb14102d30 msgr2=0x7fcb14198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.625+0000 7fcb18da1640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb14102d30 0x7fcb14198630 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400d950 tx=0x7fcb0400de10 comp rx=0 tx=0).stop 2024-09-15T22:17:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.625+0000 7fcb18da1640 1 -- 172.21.15.45:0/364925359 shutdown_connections 2024-09-15T22:17:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.625+0000 7fcb18da1640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a34d0 0x7fcafc0a5990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.625+0000 7fcb18da1640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb141082a0 0x7fcb1419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.625+0000 7fcb18da1640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb141036e0 0x7fcb14198b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.625+0000 7fcb18da1640 1 --2- 172.21.15.45:0/364925359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb14102d30 0x7fcb14198630 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.625+0000 7fcb18da1640 1 -- 172.21.15.45:0/364925359 >> 172.21.15.45:0/364925359 conn(0x7fcb140fc7d0 msgr2=0x7fcb140fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.625+0000 7fcb18da1640 1 -- 172.21.15.45:0/364925359 shutdown_connections 2024-09-15T22:17:40.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:40.626+0000 7fcb18da1640 1 -- 172.21.15.45:0/364925359 wait complete. 2024-09-15T22:17:40.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:40 smithi165 ceph-mon[35551]: pgmap v46: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:17:40.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:40 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/364925359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:40.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:40 smithi100 ceph-mon[35319]: pgmap v46: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:17:40.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:40 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/364925359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:40 smithi045 ceph-mon[31180]: pgmap v46: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:17:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:40 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/364925359' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:41.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.174+0000 7f3de1c69640 1 -- 172.21.15.45:0/3270599246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ddc1036e0 msgr2=0x7f3ddc107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.174+0000 7f3de1c69640 1 --2- 172.21.15.45:0/3270599246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ddc1036e0 0x7f3ddc107b90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4009930 tx=0x7f3dc402a420 comp rx=0 tx=0).stop 2024-09-15T22:17:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.174+0000 7f3de1c69640 1 -- 172.21.15.45:0/3270599246 shutdown_connections 2024-09-15T22:17:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.174+0000 7f3de1c69640 1 --2- 172.21.15.45:0/3270599246 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ddc1082a0 0x7f3ddc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.174+0000 7f3de1c69640 1 --2- 172.21.15.45:0/3270599246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ddc1036e0 0x7f3ddc107b90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.174+0000 7f3de1c69640 1 --2- 172.21.15.45:0/3270599246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ddc102d30 0x7f3ddc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.174+0000 7f3de1c69640 1 -- 172.21.15.45:0/3270599246 >> 172.21.15.45:0/3270599246 conn(0x7f3ddc0fc7d0 msgr2=0x7f3ddc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.174+0000 7f3de1c69640 1 -- 172.21.15.45:0/3270599246 shutdown_connections 2024-09-15T22:17:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.175+0000 7f3de1c69640 1 -- 172.21.15.45:0/3270599246 wait complete. 2024-09-15T22:17:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.175+0000 7f3de1c69640 1 Processor -- start 2024-09-15T22:17:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.175+0000 7f3de1c69640 1 -- start start 2024-09-15T22:17:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3de1c69640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ddc102d30 0x7f3ddc100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3de1c69640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ddc1036e0 0x7f3ddc100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3de1c69640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ddc1082a0 0x7f3ddc101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3ddb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ddc102d30 0x7f3ddc100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3de1c69640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc1121c0 con 0x7f3ddc102d30 2024-09-15T22:17:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3de1c69640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc112040 con 0x7f3ddc1082a0 2024-09-15T22:17:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3de1c69640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc112340 con 0x7f3ddc1036e0 2024-09-15T22:17:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3ddb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ddc102d30 0x7f3ddc100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40706/0 (socket says 172.21.15.45:40706) 2024-09-15T22:17:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3ddb7fe640 1 -- 172.21.15.45:0/3721598177 learned_addr learned my addr 172.21.15.45:0/3721598177 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3dd2ffd640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ddc1036e0 0x7f3ddc100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3ddbfff640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ddc1082a0 0x7f3ddc101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3ddb7fe640 1 -- 172.21.15.45:0/3721598177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ddc1036e0 msgr2=0x7f3ddc100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3ddb7fe640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ddc1036e0 0x7f3ddc100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3ddb7fe640 1 -- 172.21.15.45:0/3721598177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ddc1082a0 msgr2=0x7f3ddc101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3ddb7fe640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ddc1082a0 0x7f3ddc101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.176+0000 7f3ddb7fe640 1 -- 172.21.15.45:0/3721598177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ddc1a6b40 con 0x7f3ddc102d30 2024-09-15T22:17:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.177+0000 7f3ddb7fe640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ddc102d30 0x7f3ddc100990 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00e9f0 tx=0x7f3dcc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.177+0000 7f3dd97fa640 1 -- 172.21.15.45:0/3721598177 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00cd80 con 0x7f3ddc102d30 2024-09-15T22:17:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.177+0000 7f3de1c69640 1 -- 172.21.15.45:0/3721598177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ddc1a6e30 con 0x7f3ddc102d30 2024-09-15T22:17:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.177+0000 7f3de1c69640 1 -- 172.21.15.45:0/3721598177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ddc1a72e0 con 0x7f3ddc102d30 2024-09-15T22:17:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.178+0000 7f3dd97fa640 1 -- 172.21.15.45:0/3721598177 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3dcc010930 con 0x7f3ddc102d30 2024-09-15T22:17:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.178+0000 7f3dd97fa640 1 -- 172.21.15.45:0/3721598177 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc026060 con 0x7f3ddc102d30 2024-09-15T22:17:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.180+0000 7f3de4042740 1 Processor -- start 2024-09-15T22:17:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.180+0000 7f3de4042740 1 -- start start 2024-09-15T22:17:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.180+0000 7f3de4042740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb569f80 0x560ffb56a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.180+0000 7f3de4042740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb56a8a0 0x560ffb57d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.180+0000 7f3de4042740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb57fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.180+0000 7f3de4042740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560ffb4cf620 con 0x560ffb56a8a0 2024-09-15T22:17:41.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.180+0000 7f3de4042740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560ffb476e50 con 0x560ffb57da50 2024-09-15T22:17:41.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.180+0000 7f3de4042740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560ffb4cb5e0 con 0x560ffb569f80 2024-09-15T22:17:41.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.180+0000 7f3ddbfff640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb569f80 0x560ffb56a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.181+0000 7f3dd2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb57fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.181+0000 7f3dd2ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb57fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:36814/0 (socket says 172.21.15.45:36814) 2024-09-15T22:17:41.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.181+0000 7f3dd2ffd640 1 -- 172.21.15.45:0/2257966048 learned_addr learned my addr 172.21.15.45:0/2257966048 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:41.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.181+0000 7f3dd2ffd640 1 -- 172.21.15.45:0/2257966048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb569f80 msgr2=0x560ffb56a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:41.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.181+0000 7f3dd2ffd640 1 --2- 172.21.15.45:0/2257966048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb569f80 0x560ffb56a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.181+0000 7f3dd2ffd640 1 -- 172.21.15.45:0/2257966048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb56a8a0 msgr2=0x560ffb57d510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:17:41.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.181+0000 7f3dd2ffd640 1 --2- 172.21.15.45:0/2257966048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb56a8a0 0x560ffb57d510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.181+0000 7f3dd2ffd640 1 -- 172.21.15.45:0/2257966048 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ffb467d40 con 0x560ffb57da50 2024-09-15T22:17:41.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.181+0000 7f3dd97fa640 1 -- 172.21.15.45:0/3721598177 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f3dcc010430 con 0x7f3ddc102d30 2024-09-15T22:17:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.181+0000 7f3dd2ffd640 1 --2- 172.21.15.45:0/2257966048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb57fe40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4000c00 tx=0x7f3dc4031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f14bb43e7d21df36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.181+0000 7f3dd1ffb640 1 -- 172.21.15.45:0/2257966048 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4035040 con 0x560ffb57da50 2024-09-15T22:17:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.182+0000 7f3dd1ffb640 1 -- 172.21.15.45:0/2257966048 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3dc4031840 con 0x560ffb57da50 2024-09-15T22:17:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.182+0000 7f3dd1ffb640 1 -- 172.21.15.45:0/2257966048 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc40049d0 con 0x560ffb57da50 2024-09-15T22:17:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.182+0000 7f3de4042740 1 -- 172.21.15.45:0/2257966048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 msgr2=0x560ffb57fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.182+0000 7f3de4042740 1 --2- 172.21.15.45:0/2257966048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb57fe40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4000c00 tx=0x7f3dc4031400 comp rx=0 tx=0).stop 2024-09-15T22:17:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.182+0000 7f3de4042740 1 -- 172.21.15.45:0/2257966048 shutdown_connections 2024-09-15T22:17:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.182+0000 7f3de4042740 1 --2- 172.21.15.45:0/2257966048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb57fe40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.182+0000 7f3de4042740 1 --2- 172.21.15.45:0/2257966048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb56a8a0 0x560ffb57d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.182+0000 7f3de4042740 1 --2- 172.21.15.45:0/2257966048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb569f80 0x560ffb56a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.182+0000 7f3de4042740 1 -- 172.21.15.45:0/2257966048 >> 172.21.15.45:0/2257966048 conn(0x560ffb5665f0 msgr2=0x560ffb5669d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.182+0000 7f3de4042740 1 -- 172.21.15.45:0/2257966048 shutdown_connections 2024-09-15T22:17:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.182+0000 7f3de4042740 1 -- 172.21.15.45:0/2257966048 wait complete. 2024-09-15T22:17:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.183+0000 7f3dd97fa640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3dc80a3460 0x7f3dc80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.183+0000 7f3de4042740 1 -- start start 2024-09-15T22:17:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.183+0000 7f3dd97fa640 1 -- 172.21.15.45:0/3721598177 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f3dcc0d0640 con 0x7f3ddc102d30 2024-09-15T22:17:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.183+0000 7f3ddbfff640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3dc80a3460 0x7f3dc80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.183+0000 7f3de4042740 1 Processor -- start 2024-09-15T22:17:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3ddbfff640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3dc80a3460 0x7f3dc80a5920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4005fd0 tx=0x7f3dd4009500 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3de4042740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb569f80 0x560ffb57a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3de4042740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb56a8a0 0x560ffb57ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3de4042740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb57b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3de4042740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560ffb580560 con 0x560ffb569f80 2024-09-15T22:17:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3de4042740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560ffb457f10 con 0x560ffb57da50 2024-09-15T22:17:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3de4042740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560ffb5806e0 con 0x560ffb56a8a0 2024-09-15T22:17:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3ddb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb569f80 0x560ffb57a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3ddb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb569f80 0x560ffb57a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40716/0 (socket says 172.21.15.45:40716) 2024-09-15T22:17:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3ddb7fe640 1 -- 172.21.15.45:0/4220088344 learned_addr learned my addr 172.21.15.45:0/4220088344 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3de4042740 10 client.0 _ll_register_callbacks cb 0x560ffb47bdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3dd2ffd640 1 --2- 172.21.15.45:0/4220088344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb56a8a0 0x560ffb57ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3ddb7fe640 1 -- 172.21.15.45:0/4220088344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb56a8a0 msgr2=0x560ffb57ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3ddbfff640 1 --2- 172.21.15.45:0/4220088344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb57b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3ddb7fe640 1 --2- 172.21.15.45:0/4220088344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb56a8a0 0x560ffb57ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3ddb7fe640 1 -- 172.21.15.45:0/4220088344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 msgr2=0x560ffb57b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3ddb7fe640 1 --2- 172.21.15.45:0/4220088344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb57b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3ddb7fe640 1 -- 172.21.15.45:0/4220088344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ffb1de580 con 0x560ffb569f80 2024-09-15T22:17:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3ddb7fe640 1 --2- 172.21.15.45:0/4220088344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb569f80 0x560ffb57a920 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00c6a0 tx=0x7f3dcc09c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f3ecce62b22e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.184+0000 7f3dbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.185+0000 7f3dbaffd640 1 -- 172.21.15.45:0/4220088344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc0d03c0 con 0x560ffb569f80 2024-09-15T22:17:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.185+0000 7f3de4042740 1 -- 172.21.15.45:0/4220088344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dc4031840 con 0x560ffb569f80 2024-09-15T22:17:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.185+0000 7f3dbaffd640 1 -- 172.21.15.45:0/4220088344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f3dcc0bc0e0 con 0x560ffb569f80 2024-09-15T22:17:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.185+0000 7f3dbaffd640 1 -- 172.21.15.45:0/4220088344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3dcc0bc2e0 con 0x560ffb569f80 2024-09-15T22:17:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.185+0000 7f3de4042740 10 client.15717 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.185+0000 7f3de4042740 1 -- 172.21.15.45:0/4220088344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560ffb2a8960 con 0x560ffb569f80 2024-09-15T22:17:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.185+0000 7f3dbaffd640 1 -- 172.21.15.45:0/4220088344 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3dc4031840 con 0x560ffb569f80 2024-09-15T22:17:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.186+0000 7f3dbaffd640 1 -- 172.21.15.45:0/4220088344 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3dcc09b7b0 con 0x560ffb569f80 2024-09-15T22:17:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.186+0000 7f3de4042740 10 client.15717 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.186+0000 7f3de4042740 10 client.15717 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:17:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.186+0000 7f3de4042740 20 client.15717 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.186+0000 7f3de4042740 1 --2- 172.21.15.45:0/4220088344 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560ffb58d5b0 0x560ffb58f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.186+0000 7f3de4042740 4 client.15717 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.186+0000 7f3de4042740 1 -- 172.21.15.45:0/4220088344 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ffb4dcb90 con 0x560ffb58d5b0 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.186+0000 7f3dd2ffd640 1 --2- 172.21.15.45:0/4220088344 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560ffb58d5b0 0x560ffb58f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.187+0000 7f3dd2ffd640 1 --2- 172.21.15.45:0/4220088344 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560ffb58d5b0 0x560ffb58f9c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbafdb21bdfa8b8a server_cookie=8a114ac3c244002d in_seq=0 out_seq=0 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.187+0000 7f3dbaffd640 10 client.15717 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.187+0000 7f3dbaffd640 1 -- 172.21.15.45:0/4220088344 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ffb4dcb90 con 0x560ffb58d5b0 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.187+0000 7f3dbaffd640 10 client.15717 handle_command_reply: tid=0 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.187+0000 7f3de4042740 1 client.15717 shutdown 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.187+0000 7f3de4042740 1 -- 172.21.15.45:0/4220088344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb569f80 msgr2=0x560ffb57a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.187+0000 7f3de4042740 1 --2- 172.21.15.45:0/4220088344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb569f80 0x560ffb57a920 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00c6a0 tx=0x7f3dcc09c4a0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.188+0000 7f3de4042740 1 -- 172.21.15.45:0/4220088344 shutdown_connections 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.188+0000 7f3de4042740 1 --2- 172.21.15.45:0/4220088344 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560ffb58d5b0 0x560ffb58f9c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.188+0000 7f3dbaffd640 0 client.15717 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.188+0000 7f3de4042740 1 --2- 172.21.15.45:0/4220088344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb57b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.188+0000 7f3de4042740 1 --2- 172.21.15.45:0/4220088344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb56a8a0 0x560ffb57ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.188+0000 7f3de4042740 1 --2- 172.21.15.45:0/4220088344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb569f80 0x560ffb57a920 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.188+0000 7f3de4042740 1 -- 172.21.15.45:0/4220088344 >> 172.21.15.45:0/4220088344 conn(0x560ffb5665f0 msgr2=0x560ffb565750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.188+0000 7f3de4042740 1 -- 172.21.15.45:0/4220088344 shutdown_connections 2024-09-15T22:17:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.188+0000 7f3de4042740 1 -- 172.21.15.45:0/4220088344 wait complete. 2024-09-15T22:17:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.188+0000 7f3de4042740 20 client.15717 trim_cache size 0 max 16384 2024-09-15T22:17:41.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.221+0000 7f3de4042740 1 Processor -- start 2024-09-15T22:17:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.221+0000 7f3de4042740 1 -- start start 2024-09-15T22:17:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.221+0000 7f3de4042740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb569f80 0x560ffb565a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.221+0000 7f3de4042740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb56a8a0 0x560ffb595290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.221+0000 7f3de4042740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb57da50 0x560ffb5957d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.221+0000 7f3de4042740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc00df20 con 0x560ffb57da50 2024-09-15T22:17:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.221+0000 7f3de4042740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc0107a0 con 0x560ffb569f80 2024-09-15T22:17:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.221+0000 7f3de4042740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc00e590 con 0x560ffb56a8a0 2024-09-15T22:17:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.222+0000 7f3ddb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb569f80 0x560ffb565a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.222+0000 7f3ddbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb57da50 0x560ffb5957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.222+0000 7f3dd2ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb56a8a0 0x560ffb595290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.222+0000 7f3dd2ffd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb56a8a0 0x560ffb595290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:54912/0 (socket says 172.21.15.45:54912) 2024-09-15T22:17:41.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.222+0000 7f3dd2ffd640 1 -- 172.21.15.45:0/1797879599 learned_addr learned my addr 172.21.15.45:0/1797879599 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.222+0000 7f3dd2ffd640 1 -- 172.21.15.45:0/1797879599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb569f80 msgr2=0x560ffb565a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.222+0000 7f3dd2ffd640 1 --2- 172.21.15.45:0/1797879599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb569f80 0x560ffb565a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.222+0000 7f3dd2ffd640 1 -- 172.21.15.45:0/1797879599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb57da50 msgr2=0x560ffb5957d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.222+0000 7f3dd2ffd640 1 --2- 172.21.15.45:0/1797879599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb57da50 0x560ffb5957d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.222+0000 7f3dd2ffd640 1 -- 172.21.15.45:0/1797879599 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ffb5798f0 con 0x560ffb56a8a0 2024-09-15T22:17:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.222+0000 7f3ddb7fe640 1 --2- 172.21.15.45:0/1797879599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb569f80 0x560ffb565a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.223+0000 7f3dd2ffd640 1 --2- 172.21.15.45:0/1797879599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb56a8a0 0x560ffb595290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4004650 tx=0x7f3dc40054f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b397c432134711dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.223+0000 7f3dd17fa640 1 -- 172.21.15.45:0/1797879599 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4035040 con 0x560ffb56a8a0 2024-09-15T22:17:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.223+0000 7f3dd17fa640 1 -- 172.21.15.45:0/1797879599 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3dc403c940 con 0x560ffb56a8a0 2024-09-15T22:17:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.223+0000 7f3dd17fa640 1 -- 172.21.15.45:0/1797879599 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dc404e930 con 0x560ffb56a8a0 2024-09-15T22:17:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.224+0000 7f3de4042740 1 -- 172.21.15.45:0/1797879599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb56a8a0 msgr2=0x560ffb595290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.224+0000 7f3de4042740 1 --2- 172.21.15.45:0/1797879599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb56a8a0 0x560ffb595290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3dc4004650 tx=0x7f3dc40054f0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.224+0000 7f3de4042740 1 -- 172.21.15.45:0/1797879599 shutdown_connections 2024-09-15T22:17:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.224+0000 7f3de4042740 1 --2- 172.21.15.45:0/1797879599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb57da50 0x560ffb5957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.224+0000 7f3de4042740 1 --2- 172.21.15.45:0/1797879599 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb56a8a0 0x560ffb595290 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.224+0000 7f3de4042740 1 --2- 172.21.15.45:0/1797879599 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb569f80 0x560ffb565a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.224+0000 7f3de4042740 1 -- 172.21.15.45:0/1797879599 >> 172.21.15.45:0/1797879599 conn(0x560ffb5665f0 msgr2=0x560ffb57c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:41.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.224+0000 7f3de4042740 1 -- 172.21.15.45:0/1797879599 shutdown_connections 2024-09-15T22:17:41.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.224+0000 7f3de4042740 1 -- 172.21.15.45:0/1797879599 wait complete. 2024-09-15T22:17:41.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.225+0000 7f3de4042740 1 -- start start 2024-09-15T22:17:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.225+0000 7f3de4042740 1 Processor -- start 2024-09-15T22:17:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.225+0000 7f3de4042740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb569f80 0x560ffb585e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.225+0000 7f3de4042740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb56a8a0 0x560ffb5829d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3de4042740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb582f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3de4042740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc00ec60 con 0x560ffb56a8a0 2024-09-15T22:17:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3de4042740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc0100d0 con 0x560ffb57da50 2024-09-15T22:17:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3de4042740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc00f330 con 0x560ffb569f80 2024-09-15T22:17:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3ddb7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb569f80 0x560ffb585e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3ddb7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb569f80 0x560ffb585e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:54922/0 (socket says 172.21.15.45:54922) 2024-09-15T22:17:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3ddb7fe640 1 -- 172.21.15.45:0/200562350 learned_addr learned my addr 172.21.15.45:0/200562350 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3de4042740 10 client.0 _ll_register_callbacks cb 0x7f3dcc09bcc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3ddbfff640 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb582f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3dd2ffd640 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb56a8a0 0x560ffb5829d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3ddbfff640 1 -- 172.21.15.45:0/200562350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb569f80 msgr2=0x560ffb585e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:41.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3ddbfff640 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb569f80 0x560ffb585e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3ddbfff640 1 -- 172.21.15.45:0/200562350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb56a8a0 msgr2=0x560ffb5829d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:41.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3ddbfff640 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb56a8a0 0x560ffb5829d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.226+0000 7f3ddbfff640 1 -- 172.21.15.45:0/200562350 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ffb583450 con 0x560ffb57da50 2024-09-15T22:17:41.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.227+0000 7f3dd2ffd640 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb56a8a0 0x560ffb5829d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:17:41.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.227+0000 7f3ddbfff640 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb582f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4011db0 tx=0x7f3dd4016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7455a1def297a709 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:41.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.227+0000 7f3dbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-15T22:17:41.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.227+0000 7f3dbaffd640 1 -- 172.21.15.45:0/200562350 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd402e060 con 0x560ffb57da50 2024-09-15T22:17:41.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.227+0000 7f3de4042740 1 -- 172.21.15.45:0/200562350 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3dc403c940 con 0x560ffb57da50 2024-09-15T22:17:41.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.227+0000 7f3dbaffd640 1 -- 172.21.15.45:0/200562350 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f3dd400f480 con 0x560ffb57da50 2024-09-15T22:17:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.227+0000 7f3dbaffd640 1 -- 172.21.15.45:0/200562350 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3dd4035050 con 0x560ffb57da50 2024-09-15T22:17:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.227+0000 7f3de4042740 10 client.25361 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.227+0000 7f3de4042740 1 -- 172.21.15.45:0/200562350 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560ffb5f9020 con 0x560ffb57da50 2024-09-15T22:17:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.227+0000 7f3dbaffd640 1 -- 172.21.15.45:0/200562350 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3dc403c940 con 0x560ffb57da50 2024-09-15T22:17:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.228+0000 7f3dbaffd640 1 -- 172.21.15.45:0/200562350 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3dd40299b0 con 0x560ffb57da50 2024-09-15T22:17:41.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.228+0000 7f3de4042740 10 client.25361 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:41.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.228+0000 7f3de4042740 10 client.25361 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:17:41.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.228+0000 7f3de4042740 20 client.25361 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:41.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.228+0000 7f3de4042740 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560ffb5f97d0 0x560ffb5fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:41.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.228+0000 7f3de4042740 4 client.25361 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "161b68ea", "release": true, "await": true}] 2024-09-15T22:17:41.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.228+0000 7f3de4042740 1 -- 172.21.15.45:0/200562350 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "quiesce db", "set_id": "161b68ea", "release": true, "await": true}) -- 0x560ffb4d70a0 con 0x560ffb5f97d0 2024-09-15T22:17:41.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.228+0000 7f3ddb7fe640 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560ffb5f97d0 0x560ffb5fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:41.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.228+0000 7f3dbaffd640 10 client.25361 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:41.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.228+0000 7f3ddb7fe640 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560ffb5f97d0 0x560ffb5fbbf0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b243bbb830becd8 server_cookie=e37a2de846d2b888 in_seq=0 out_seq=0 2024-09-15T22:17:41.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3dbaffd640 1 -- 172.21.15.45:0/200562350 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560ffb4d70a0 con 0x560ffb5f97d0 2024-09-15T22:17:41.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3dbaffd640 10 client.25361 handle_command_reply: tid=0 2024-09-15T22:17:41.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3de4042740 1 client.25361 shutdown 2024-09-15T22:17:41.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3de4042740 1 -- 172.21.15.45:0/200562350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 msgr2=0x560ffb582f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:41.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3de4042740 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb582f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4011db0 tx=0x7f3dd4016000 comp rx=0 tx=0).stop 2024-09-15T22:17:41.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3de4042740 1 -- 172.21.15.45:0/200562350 shutdown_connections 2024-09-15T22:17:41.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3de4042740 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560ffb5f97d0 0x560ffb5fbbf0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3de4042740 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560ffb57da50 0x560ffb582f10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3de4042740 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ffb56a8a0 0x560ffb5829d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3de4042740 1 --2- 172.21.15.45:0/200562350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560ffb569f80 0x560ffb585e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3dbaffd640 0 client.25361 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:41.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3de4042740 1 -- 172.21.15.45:0/200562350 >> 172.21.15.45:0/200562350 conn(0x560ffb5665f0 msgr2=0x560ffb56b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:41.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3de4042740 1 -- 172.21.15.45:0/200562350 shutdown_connections 2024-09-15T22:17:41.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3de4042740 1 -- 172.21.15.45:0/200562350 wait complete. 2024-09-15T22:17:41.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.230+0000 7f3de4042740 20 client.25361 trim_cache size 0 max 16384 2024-09-15T22:17:41.235 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:17:41.235 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 21, 2024-09-15T22:17:41.235 INFO:teuthology.orchestra.run.smithi045.stdout: "leader": 24476, 2024-09-15T22:17:41.236 INFO:teuthology.orchestra.run.smithi045.stdout: "set_version": 4, 2024-09-15T22:17:41.236 INFO:teuthology.orchestra.run.smithi045.stdout: "sets": { 2024-09-15T22:17:41.236 INFO:teuthology.orchestra.run.smithi045.stdout: "161b68ea": { 2024-09-15T22:17:41.236 INFO:teuthology.orchestra.run.smithi045.stdout: "version": 4, 2024-09-15T22:17:41.236 INFO:teuthology.orchestra.run.smithi045.stdout: "age_ref": 0.0, 2024-09-15T22:17:41.236 INFO:teuthology.orchestra.run.smithi045.stdout: "state": { 2024-09-15T22:17:41.236 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RELEASED", 2024-09-15T22:17:41.236 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.0 2024-09-15T22:17:41.236 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:17:41.236 INFO:teuthology.orchestra.run.smithi045.stdout: "timeout": 90.0, 2024-09-15T22:17:41.236 INFO:teuthology.orchestra.run.smithi045.stdout: "expiration": 150.2, 2024-09-15T22:17:41.236 INFO:teuthology.orchestra.run.smithi045.stdout: "members": { 2024-09-15T22:17:41.237 INFO:teuthology.orchestra.run.smithi045.stdout: "file:/": { 2024-09-15T22:17:41.237 INFO:teuthology.orchestra.run.smithi045.stdout: "excluded": false, 2024-09-15T22:17:41.237 INFO:teuthology.orchestra.run.smithi045.stdout: "state": { 2024-09-15T22:17:41.237 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RELEASED", 2024-09-15T22:17:41.237 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.0 2024-09-15T22:17:41.237 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:41.237 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:41.237 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:41.237 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:41.237 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:41.237 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:17:41.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.231+0000 7f3de1c69640 1 -- 172.21.15.45:0/3721598177 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3dc80a3460 msgr2=0x7f3dc80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:41.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.231+0000 7f3de1c69640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3dc80a3460 0x7f3dc80a5920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4005fd0 tx=0x7f3dd4009500 comp rx=0 tx=0).stop 2024-09-15T22:17:41.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.231+0000 7f3de1c69640 1 -- 172.21.15.45:0/3721598177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ddc102d30 msgr2=0x7f3ddc100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:41.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.231+0000 7f3de1c69640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ddc102d30 0x7f3ddc100990 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00e9f0 tx=0x7f3dcc00eeb0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.231+0000 7f3de1c69640 1 -- 172.21.15.45:0/3721598177 shutdown_connections 2024-09-15T22:17:41.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.231+0000 7f3de1c69640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3dc80a3460 0x7f3dc80a5920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.231+0000 7f3de1c69640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ddc1082a0 0x7f3ddc101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.231+0000 7f3de1c69640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3ddc1036e0 0x7f3ddc100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.231+0000 7f3de1c69640 1 --2- 172.21.15.45:0/3721598177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ddc102d30 0x7f3ddc100990 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:41.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.231+0000 7f3de1c69640 1 -- 172.21.15.45:0/3721598177 >> 172.21.15.45:0/3721598177 conn(0x7f3ddc0fc7d0 msgr2=0x7f3ddc106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:41.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.232+0000 7f3de1c69640 1 -- 172.21.15.45:0/3721598177 shutdown_connections 2024-09-15T22:17:41.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:41.232+0000 7f3de1c69640 1 -- 172.21.15.45:0/3721598177 wait complete. 2024-09-15T22:17:42.058 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:17:42.517 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '161b68ea', total seconds elapsed: 36.0 2024-09-15T22:17:42.593 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:42.756 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:42 smithi045 ceph-mon[31180]: pgmap v47: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:17:42.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:42 smithi165 ceph-mon[35551]: pgmap v47: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:17:42.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:42 smithi100 ceph-mon[35319]: pgmap v47: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:17:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.153+0000 7fcb17645640 1 -- 172.21.15.45:0/4014066821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1010e500 msgr2=0x7fcb10110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.153+0000 7fcb17645640 1 --2- 172.21.15.45:0/4014066821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1010e500 0x7fcb10110910 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009ca0 tx=0x7fcb0802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.153+0000 7fcb17645640 1 -- 172.21.15.45:0/4014066821 shutdown_connections 2024-09-15T22:17:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.153+0000 7fcb17645640 1 --2- 172.21.15.45:0/4014066821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1010e500 0x7fcb10110910 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.153+0000 7fcb17645640 1 --2- 172.21.15.45:0/4014066821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb10101440 0x7fcb1010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.153+0000 7fcb17645640 1 --2- 172.21.15.45:0/4014066821 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb10100b20 0x7fcb10100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.153+0000 7fcb17645640 1 -- 172.21.15.45:0/4014066821 >> 172.21.15.45:0/4014066821 conn(0x7fcb100fc7d0 msgr2=0x7fcb100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.153+0000 7fcb17645640 1 -- 172.21.15.45:0/4014066821 shutdown_connections 2024-09-15T22:17:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.153+0000 7fcb17645640 1 -- 172.21.15.45:0/4014066821 wait complete. 2024-09-15T22:17:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.154+0000 7fcb17645640 1 Processor -- start 2024-09-15T22:17:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.154+0000 7fcb17645640 1 -- start start 2024-09-15T22:17:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.154+0000 7fcb17645640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb10100b20 0x7fcb101a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.154+0000 7fcb17645640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb10101440 0x7fcb101a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.154+0000 7fcb17645640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1010e500 0x7fcb1019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.154+0000 7fcb17645640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcb10114390 con 0x7fcb1010e500 2024-09-15T22:17:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.154+0000 7fcb17645640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb10114210 con 0x7fcb10101440 2024-09-15T22:17:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.154+0000 7fcb17645640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb10114510 con 0x7fcb10100b20 2024-09-15T22:17:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.154+0000 7fcb15be2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1010e500 0x7fcb1019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.154+0000 7fcb15be2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1010e500 0x7fcb1019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40744/0 (socket says 172.21.15.45:40744) 2024-09-15T22:17:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.154+0000 7fcb15be2640 1 -- 172.21.15.45:0/1610356058 learned_addr learned my addr 172.21.15.45:0/1610356058 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb14be0640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb10101440 0x7fcb101a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb153e1640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb10100b20 0x7fcb101a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb15be2640 1 -- 172.21.15.45:0/1610356058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb10100b20 msgr2=0x7fcb101a05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb15be2640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb10100b20 0x7fcb101a05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb15be2640 1 -- 172.21.15.45:0/1610356058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb10101440 msgr2=0x7fcb101a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb15be2640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb10101440 0x7fcb101a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb15be2640 1 -- 172.21.15.45:0/1610356058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1019aef0 con 0x7fcb1010e500 2024-09-15T22:17:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb153e1640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb10100b20 0x7fcb101a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:17:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb15be2640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1010e500 0x7fcb1019a680 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcb080319f0 tx=0x7fcb08031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb067fc640 1 -- 172.21.15.45:0/1610356058 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb08003c30 con 0x7fcb1010e500 2024-09-15T22:17:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb17645640 1 -- 172.21.15.45:0/1610356058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1019b180 con 0x7fcb1010e500 2024-09-15T22:17:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb067fc640 1 -- 172.21.15.45:0/1610356058 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb08003dd0 con 0x7fcb1010e500 2024-09-15T22:17:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb067fc640 1 -- 172.21.15.45:0/1610356058 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0802fd50 con 0x7fcb1010e500 2024-09-15T22:17:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.155+0000 7fcb17645640 1 -- 172.21.15.45:0/1610356058 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb101a7530 con 0x7fcb1010e500 2024-09-15T22:17:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.158+0000 7fcb19a1e740 1 Processor -- start 2024-09-15T22:17:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.158+0000 7fcb067fc640 1 -- 172.21.15.45:0/1610356058 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7fcb08004050 con 0x7fcb1010e500 2024-09-15T22:17:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.158+0000 7fcb19a1e740 1 -- start start 2024-09-15T22:17:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.158+0000 7fcb19a1e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 0x55a078ae1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.158+0000 7fcb19a1e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae15d0 0x55a078ae1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb19a1e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078aec370 0x55a078aee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb19a1e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a078a472f0 con 0x55a078ae2b40 2024-09-15T22:17:43.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb19a1e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a0789eecf0 con 0x55a078aec370 2024-09-15T22:17:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb19a1e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a078a432b0 con 0x55a078ae15d0 2024-09-15T22:17:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb14be0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 0x55a078ae1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb14be0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 0x55a078ae1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40748/0 (socket says 172.21.15.45:40748) 2024-09-15T22:17:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb14be0640 1 -- 172.21.15.45:0/2077475714 learned_addr learned my addr 172.21.15.45:0/2077475714 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb153e1640 1 --2- 172.21.15.45:0/2077475714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae15d0 0x55a078ae1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb14be0640 1 --2- 172.21.15.45:0/2077475714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078aec370 0x55a078aee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb14be0640 1 -- 172.21.15.45:0/2077475714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae15d0 msgr2=0x55a078ae1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb14be0640 1 --2- 172.21.15.45:0/2077475714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae15d0 0x55a078ae1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb14be0640 1 -- 172.21.15.45:0/2077475714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078aec370 msgr2=0x55a078aee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb14be0640 1 --2- 172.21.15.45:0/2077475714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078aec370 0x55a078aee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb14be0640 1 -- 172.21.15.45:0/2077475714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0789d33a0 con 0x55a078ae2b40 2024-09-15T22:17:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb067fc640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a3550 0x7fcafc0a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb153e1640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a3550 0x7fcafc0a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.159+0000 7fcb14be0640 1 --2- 172.21.15.45:0/2077475714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 0x55a078ae1090 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000bb30 tx=0x7fcb000040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6abc0fa11697503 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:43.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.160+0000 7fcb067fc640 1 -- 172.21.15.45:0/1610356058 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fcb080f1460 con 0x7fcb1010e500 2024-09-15T22:17:43.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.160+0000 7fcafb7fe640 1 -- 172.21.15.45:0/2077475714 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb00010460 con 0x55a078ae2b40 2024-09-15T22:17:43.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.160+0000 7fcafb7fe640 1 -- 172.21.15.45:0/2077475714 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb00010b00 con 0x55a078ae2b40 2024-09-15T22:17:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.161+0000 7fcafb7fe640 1 -- 172.21.15.45:0/2077475714 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0000f9f0 con 0x55a078ae2b40 2024-09-15T22:17:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.161+0000 7fcb19a1e740 1 -- 172.21.15.45:0/2077475714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 msgr2=0x55a078ae1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.161+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/2077475714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 0x55a078ae1090 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000bb30 tx=0x7fcb000040f0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.161+0000 7fcb153e1640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a3550 0x7fcafc0a5a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55a078adeac0 tx=0x7fcb0c00b710 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.161+0000 7fcb19a1e740 1 -- 172.21.15.45:0/2077475714 shutdown_connections 2024-09-15T22:17:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.161+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/2077475714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078aec370 0x55a078aee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.161+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/2077475714 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae15d0 0x55a078ae1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.161+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/2077475714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 0x55a078ae1090 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.161+0000 7fcb19a1e740 1 -- 172.21.15.45:0/2077475714 >> 172.21.15.45:0/2077475714 conn(0x55a078aaa310 msgr2=0x55a078addc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:43.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.161+0000 7fcb19a1e740 1 -- 172.21.15.45:0/2077475714 shutdown_connections 2024-09-15T22:17:43.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.161+0000 7fcb19a1e740 1 -- 172.21.15.45:0/2077475714 wait complete. 2024-09-15T22:17:43.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.161+0000 7fcb19a1e740 1 -- start start 2024-09-15T22:17:43.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.161+0000 7fcb19a1e740 1 Processor -- start 2024-09-15T22:17:43.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb19a1e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078ae15d0 0x55a078aebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb19a1e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae2b40 0x55a078ae8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb19a1e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078aec370 0x55a078ae93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb19a1e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a078aef0b0 con 0x55a078aec370 2024-09-15T22:17:43.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb19a1e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a078a02060 con 0x55a078ae15d0 2024-09-15T22:17:43.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb19a1e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a078aef230 con 0x55a078ae2b40 2024-09-15T22:17:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb19a1e740 10 client.0 _ll_register_callbacks cb 0x55a0787558c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb15be2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078aec370 0x55a078ae93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb14be0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae2b40 0x55a078ae8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb15be2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078aec370 0x55a078ae93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40756/0 (socket says 172.21.15.45:40756) 2024-09-15T22:17:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb15be2640 1 -- 172.21.15.45:0/1922528012 learned_addr learned my addr 172.21.15.45:0/1922528012 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb153e1640 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078ae15d0 0x55a078aebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb14be0640 1 -- 172.21.15.45:0/1922528012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078ae15d0 msgr2=0x55a078aebbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb14be0640 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078ae15d0 0x55a078aebbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb14be0640 1 -- 172.21.15.45:0/1922528012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078aec370 msgr2=0x55a078ae93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb14be0640 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078aec370 0x55a078ae93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb14be0640 1 -- 172.21.15.45:0/1922528012 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0787b83c0 con 0x55a078ae2b40 2024-09-15T22:17:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb15be2640 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078aec370 0x55a078ae93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.162+0000 7fcb153e1640 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078ae15d0 0x55a078aebbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:17:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.163+0000 7fcb14be0640 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae2b40 0x55a078ae8e90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000b450 tx=0x7fcb00004160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe581fef1dd4a0c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.163+0000 7fcaf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-15T22:17:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.163+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/1922528012 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0000fb80 con 0x55a078ae2b40 2024-09-15T22:17:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.163+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1922528012 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb00010b00 con 0x55a078ae2b40 2024-09-15T22:17:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.163+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/1922528012 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fcb0000fd20 con 0x55a078ae2b40 2024-09-15T22:17:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.163+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/1922528012 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcb00032050 con 0x55a078ae2b40 2024-09-15T22:17:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.163+0000 7fcb19a1e740 10 client.25291 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.163+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1922528012 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a078afaa90 con 0x55a078ae2b40 2024-09-15T22:17:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.164+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/1922528012 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb00010b00 con 0x55a078ae2b40 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.164+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/1922528012 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcb00020440 con 0x55a078ae2b40 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.164+0000 7fcb19a1e740 10 client.25291 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.164+0000 7fcb19a1e740 10 client.25291 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.164+0000 7fcb19a1e740 20 client.25291 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.164+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a078afbf40 0x55a078afe330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.164+0000 7fcb19a1e740 4 client.25291 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.164+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1922528012 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a078a54860 con 0x55a078afbf40 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.164+0000 7fcb153e1640 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a078afbf40 0x55a078afe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.165+0000 7fcb153e1640 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a078afbf40 0x55a078afe330 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c72f3253ba68a370 server_cookie=fa150e99109255e2 in_seq=0 out_seq=0 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.165+0000 7fcaf8ff9640 10 client.25291 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.165+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/1922528012 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a078a54860 con 0x55a078afbf40 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.165+0000 7fcaf8ff9640 10 client.25291 handle_command_reply: tid=0 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.166+0000 7fcb19a1e740 1 client.25291 shutdown 2024-09-15T22:17:43.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.166+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1922528012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae2b40 msgr2=0x55a078ae8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.166+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae2b40 0x55a078ae8e90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000b450 tx=0x7fcb00004160 comp rx=0 tx=0).stop 2024-09-15T22:17:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.166+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1922528012 shutdown_connections 2024-09-15T22:17:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.166+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a078afbf40 0x55a078afe330 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.166+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078aec370 0x55a078ae93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.166+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae2b40 0x55a078ae8e90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.166+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/1922528012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078ae15d0 0x55a078aebbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.166+0000 7fcaf8ff9640 0 client.25291 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.166+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1922528012 >> 172.21.15.45:0/1922528012 conn(0x55a078aaa310 msgr2=0x55a078ae3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.166+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1922528012 shutdown_connections 2024-09-15T22:17:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.166+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1922528012 wait complete. 2024-09-15T22:17:43.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.166+0000 7fcb19a1e740 20 client.25291 trim_cache size 0 max 16384 2024-09-15T22:17:43.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.179+0000 7fcb19a1e740 1 Processor -- start 2024-09-15T22:17:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.179+0000 7fcb19a1e740 1 -- start start 2024-09-15T22:17:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb19a1e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae15d0 0x55a078b039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb19a1e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae2b40 0x55a078b03f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb19a1e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078aec370 0x55a078ae8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb19a1e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101af2d0 con 0x55a078ae15d0 2024-09-15T22:17:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb19a1e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101b1b50 con 0x55a078aec370 2024-09-15T22:17:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb19a1e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101af940 con 0x55a078ae2b40 2024-09-15T22:17:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb153e1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae15d0 0x55a078b039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb153e1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae15d0 0x55a078b039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40766/0 (socket says 172.21.15.45:40766) 2024-09-15T22:17:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb153e1640 1 -- 172.21.15.45:0/3585053746 learned_addr learned my addr 172.21.15.45:0/3585053746 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb14be0640 1 --2- 172.21.15.45:0/3585053746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae2b40 0x55a078b03f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb15be2640 1 --2- 172.21.15.45:0/3585053746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078aec370 0x55a078ae8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb153e1640 1 -- 172.21.15.45:0/3585053746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae2b40 msgr2=0x55a078b03f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb153e1640 1 --2- 172.21.15.45:0/3585053746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae2b40 0x55a078b03f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb153e1640 1 -- 172.21.15.45:0/3585053746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078aec370 msgr2=0x55a078ae8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb153e1640 1 --2- 172.21.15.45:0/3585053746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078aec370 0x55a078ae8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb153e1640 1 -- 172.21.15.45:0/3585053746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a078aeef50 con 0x55a078ae15d0 2024-09-15T22:17:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcb153e1640 1 --2- 172.21.15.45:0/3585053746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae15d0 0x55a078b039c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x55a078afe960 tx=0x7fcb0c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56eafcad5f71d19 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.180+0000 7fcafaffd640 1 -- 172.21.15.45:0/3585053746 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c012d50 con 0x55a078ae15d0 2024-09-15T22:17:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.181+0000 7fcafaffd640 1 -- 172.21.15.45:0/3585053746 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb0c020e30 con 0x55a078ae15d0 2024-09-15T22:17:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.181+0000 7fcafaffd640 1 -- 172.21.15.45:0/3585053746 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c004b20 con 0x55a078ae15d0 2024-09-15T22:17:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.181+0000 7fcb19a1e740 1 -- 172.21.15.45:0/3585053746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae15d0 msgr2=0x55a078b039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.181+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/3585053746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae15d0 0x55a078b039c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x55a078afe960 tx=0x7fcb0c014000 comp rx=0 tx=0).stop 2024-09-15T22:17:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.181+0000 7fcb19a1e740 1 -- 172.21.15.45:0/3585053746 shutdown_connections 2024-09-15T22:17:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.181+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/3585053746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078aec370 0x55a078ae8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.181+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/3585053746 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078ae2b40 0x55a078b03f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.181+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/3585053746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae15d0 0x55a078b039c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.181+0000 7fcb19a1e740 1 -- 172.21.15.45:0/3585053746 >> 172.21.15.45:0/3585053746 conn(0x55a078aaa310 msgr2=0x55a078ae7f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.181+0000 7fcb19a1e740 1 -- 172.21.15.45:0/3585053746 shutdown_connections 2024-09-15T22:17:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.181+0000 7fcb19a1e740 1 -- 172.21.15.45:0/3585053746 wait complete. 2024-09-15T22:17:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.182+0000 7fcb19a1e740 1 -- start start 2024-09-15T22:17:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.182+0000 7fcb19a1e740 1 Processor -- start 2024-09-15T22:17:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.182+0000 7fcb19a1e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078ae15d0 0x55a078af4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.182+0000 7fcb19a1e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 0x55a078af4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.182+0000 7fcb19a1e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078aec370 0x55a078ae54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.182+0000 7fcb19a1e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101b0010 con 0x55a078ae2b40 2024-09-15T22:17:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.182+0000 7fcb19a1e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101b1480 con 0x55a078ae15d0 2024-09-15T22:17:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.182+0000 7fcb19a1e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb101b06e0 con 0x55a078aec370 2024-09-15T22:17:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.182+0000 7fcb19a1e740 10 client.0 _ll_register_callbacks cb 0x7fcb0000b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb14be0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 0x55a078af4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb14be0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 0x55a078af4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40778/0 (socket says 172.21.15.45:40778) 2024-09-15T22:17:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb15be2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078aec370 0x55a078ae54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb14be0640 1 -- 172.21.15.45:0/1076314400 learned_addr learned my addr 172.21.15.45:0/1076314400 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb153e1640 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078ae15d0 0x55a078af4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb14be0640 1 -- 172.21.15.45:0/1076314400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078aec370 msgr2=0x55a078ae54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb14be0640 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078aec370 0x55a078ae54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb14be0640 1 -- 172.21.15.45:0/1076314400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078ae15d0 msgr2=0x55a078af4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb14be0640 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078ae15d0 0x55a078af4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb14be0640 1 -- 172.21.15.45:0/1076314400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a078ae4120 con 0x55a078ae2b40 2024-09-15T22:17:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb153e1640 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078ae15d0 0x55a078af4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:17:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb15be2640 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078aec370 0x55a078ae54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb14be0640 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 0x55a078af4ab0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcb000058c0 tx=0x7fcb00010b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43c6ce98537480 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcaf8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/1076314400 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0000f3c0 con 0x55a078ae2b40 2024-09-15T22:17:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/1076314400 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fcb0000f560 con 0x55a078ae2b40 2024-09-15T22:17:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1076314400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb0c020e30 con 0x55a078ae2b40 2024-09-15T22:17:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.183+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/1076314400 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcb00020440 con 0x55a078ae2b40 2024-09-15T22:17:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.184+0000 7fcb19a1e740 10 client.15741 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.184+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1076314400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a078b66030 con 0x55a078ae2b40 2024-09-15T22:17:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.184+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/1076314400 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb0c020e30 con 0x55a078ae2b40 2024-09-15T22:17:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.184+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/1076314400 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcb00005150 con 0x55a078ae2b40 2024-09-15T22:17:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.184+0000 7fcb19a1e740 10 client.15741 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.184+0000 7fcb19a1e740 10 client.15741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.184+0000 7fcb19a1e740 20 client.15741 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.184+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a078b667d0 0x55a078b68bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.184+0000 7fcb19a1e740 4 client.15741 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:17:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.184+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1076314400 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a078a4ed70 con 0x55a078b667d0 2024-09-15T22:17:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.184+0000 7fcb153e1640 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a078b667d0 0x55a078b68bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcb153e1640 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a078b667d0 0x55a078b68bf0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57e80fa0291506aa server_cookie=9a86b31a989900db in_seq=0 out_seq=0 2024-09-15T22:17:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcaf8ff9640 10 client.15741 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/1076314400 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a078a4ed70 con 0x55a078b667d0 2024-09-15T22:17:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcaf8ff9640 10 client.15741 handle_command_reply: tid=0 2024-09-15T22:17:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcb19a1e740 1 client.15741 shutdown 2024-09-15T22:17:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1076314400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 msgr2=0x55a078af4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 0x55a078af4ab0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcb000058c0 tx=0x7fcb00010b00 comp rx=0 tx=0).stop 2024-09-15T22:17:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1076314400 shutdown_connections 2024-09-15T22:17:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a078b667d0 0x55a078b68bf0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a078aec370 0x55a078ae54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a078ae2b40 0x55a078af4ab0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcaf8ff9640 0 client.15741 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcb19a1e740 1 --2- 172.21.15.45:0/1076314400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a078ae15d0 0x55a078af4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1076314400 >> 172.21.15.45:0/1076314400 conn(0x55a078aaa310 msgr2=0x55a078ae3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.185+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1076314400 shutdown_connections 2024-09-15T22:17:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb19a1e740 1 -- 172.21.15.45:0/1076314400 wait complete. 2024-09-15T22:17:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb19a1e740 20 client.15741 trim_cache size 0 max 16384 2024-09-15T22:17:43.194 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:17:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb17645640 1 -- 172.21.15.45:0/1610356058 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a3550 msgr2=0x7fcafc0a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb17645640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a3550 0x7fcafc0a5a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55a078adeac0 tx=0x7fcb0c00b710 comp rx=0 tx=0).stop 2024-09-15T22:17:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb17645640 1 -- 172.21.15.45:0/1610356058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1010e500 msgr2=0x7fcb1019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb17645640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1010e500 0x7fcb1019a680 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcb080319f0 tx=0x7fcb08031a20 comp rx=0 tx=0).stop 2024-09-15T22:17:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb17645640 1 -- 172.21.15.45:0/1610356058 shutdown_connections 2024-09-15T22:17:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb17645640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a3550 0x7fcafc0a5a10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb17645640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb1010e500 0x7fcb1019a680 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb17645640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb10101440 0x7fcb101a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb17645640 1 --2- 172.21.15.45:0/1610356058 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb10100b20 0x7fcb101a05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:43.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb17645640 1 -- 172.21.15.45:0/1610356058 >> 172.21.15.45:0/1610356058 conn(0x7fcb100fc7d0 msgr2=0x7fcb100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb17645640 1 -- 172.21.15.45:0/1610356058 shutdown_connections 2024-09-15T22:17:43.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:43.186+0000 7fcb17645640 1 -- 172.21.15.45:0/1610356058 wait complete. 2024-09-15T22:17:44.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:44 smithi165 ceph-mon[35551]: pgmap v48: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:17:44.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:44 smithi100 ceph-mon[35319]: pgmap v48: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:17:45.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:44 smithi045 ceph-mon[31180]: pgmap v48: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:17:45.097 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:17:45.097 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:17:45.361 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:45.394 INFO:tasks.workunit.client.0.smithi045.stderr:Updating files: 93% (12064/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-15T22:17:46.257 INFO:tasks.workunit.client.0.smithi045.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-15T22:17:46.257 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-15T22:17:46.257 INFO:tasks.workunit.client.0.smithi045.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-15T22:17:46.257 INFO:tasks.workunit.client.0.smithi045.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-15T22:17:46.257 INFO:tasks.workunit.client.0.smithi045.stderr:state without impacting any branches by switching back to a branch. 2024-09-15T22:17:46.257 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-15T22:17:46.257 INFO:tasks.workunit.client.0.smithi045.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-15T22:17:46.257 INFO:tasks.workunit.client.0.smithi045.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-15T22:17:46.257 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-15T22:17:46.258 INFO:tasks.workunit.client.0.smithi045.stderr: git switch -c 2024-09-15T22:17:46.258 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-15T22:17:46.258 INFO:tasks.workunit.client.0.smithi045.stderr:Or undo this operation with: 2024-09-15T22:17:46.258 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-15T22:17:46.258 INFO:tasks.workunit.client.0.smithi045.stderr: git switch - 2024-09-15T22:17:46.258 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-15T22:17:46.258 INFO:tasks.workunit.client.0.smithi045.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-15T22:17:46.258 INFO:tasks.workunit.client.0.smithi045.stderr: 2024-09-15T22:17:46.258 INFO:tasks.workunit.client.0.smithi045.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-15T22:17:46.262 DEBUG:teuthology.orchestra.run.smithi045:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-15T22:17:46.481 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:17:46.482 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:17:46.482 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "3fa0ee7d-0a6d-43b5-b02f-77a37e3c1049", 2024-09-15T22:17:46.482 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:17:46.482 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:17:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.066+0000 7f7033a10640 1 -- 172.21.15.45:0/1038718647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f702c101dd0 msgr2=0x7f702c1021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.066+0000 7f7033a10640 1 --2- 172.21.15.45:0/1038718647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f702c101dd0 0x7f702c1021b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7028009900 tx=0x7f702802a410 comp rx=0 tx=0).stop 2024-09-15T22:17:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.066+0000 7f7033a10640 1 -- 172.21.15.45:0/1038718647 shutdown_connections 2024-09-15T22:17:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.066+0000 7f7033a10640 1 --2- 172.21.15.45:0/1038718647 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f702c106f00 0x7f702c10ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.066+0000 7f7033a10640 1 --2- 172.21.15.45:0/1038718647 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f702c102780 0x7f702c1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.066+0000 7f7033a10640 1 --2- 172.21.15.45:0/1038718647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f702c101dd0 0x7f702c1021b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.066+0000 7f7033a10640 1 -- 172.21.15.45:0/1038718647 >> 172.21.15.45:0/1038718647 conn(0x7f702c0fd8b0 msgr2=0x7f702c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.066+0000 7f7033a10640 1 -- 172.21.15.45:0/1038718647 shutdown_connections 2024-09-15T22:17:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.066+0000 7f7033a10640 1 -- 172.21.15.45:0/1038718647 wait complete. 2024-09-15T22:17:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.067+0000 7f7033a10640 1 Processor -- start 2024-09-15T22:17:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.067+0000 7f7033a10640 1 -- start start 2024-09-15T22:17:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.067+0000 7f7033a10640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f702c101dd0 0x7f702c198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.067+0000 7f7033a10640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f702c102780 0x7f702c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.067+0000 7f7033a10640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f702c106f00 0x7f702c19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.067+0000 7f7033a10640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f702c112080 con 0x7f702c106f00 2024-09-15T22:17:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.067+0000 7f7033a10640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f702c111f00 con 0x7f702c101dd0 2024-09-15T22:17:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.067+0000 7f7033a10640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f702c112200 con 0x7f702c102780 2024-09-15T22:17:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.067+0000 7f7031fad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f702c106f00 0x7f702c19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.067+0000 7f7031fad640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f702c106f00 0x7f702c19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36196/0 (socket says 172.21.15.45:36196) 2024-09-15T22:17:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.067+0000 7f7031fad640 1 -- 172.21.15.45:0/2487639426 learned_addr learned my addr 172.21.15.45:0/2487639426 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.067+0000 7f70317ac640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f702c101dd0 0x7f702c198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.068+0000 7f7030fab640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f702c102780 0x7f702c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.068+0000 7f7031fad640 1 -- 172.21.15.45:0/2487639426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f702c102780 msgr2=0x7f702c198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.068+0000 7f7031fad640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f702c102780 0x7f702c198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.068+0000 7f7031fad640 1 -- 172.21.15.45:0/2487639426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f702c101dd0 msgr2=0x7f702c198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.068+0000 7f7031fad640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f702c101dd0 0x7f702c198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.068+0000 7f7031fad640 1 -- 172.21.15.45:0/2487639426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702c19d4f0 con 0x7f702c106f00 2024-09-15T22:17:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.068+0000 7f7030fab640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f702c102780 0x7f702c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:17:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.068+0000 7f7031fad640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f702c106f00 0x7f702c19ce10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f702400eaa0 tx=0x7f702400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.068+0000 7f70227fc640 1 -- 172.21.15.45:0/2487639426 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702400cdb0 con 0x7f702c106f00 2024-09-15T22:17:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.068+0000 7f7033a10640 1 -- 172.21.15.45:0/2487639426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702c19d7e0 con 0x7f702c106f00 2024-09-15T22:17:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.068+0000 7f70227fc640 1 -- 172.21.15.45:0/2487639426 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7024004b20 con 0x7f702c106f00 2024-09-15T22:17:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.068+0000 7f70227fc640 1 -- 172.21.15.45:0/2487639426 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7024011760 con 0x7f702c106f00 2024-09-15T22:17:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.068+0000 7f7033a10640 1 -- 172.21.15.45:0/2487639426 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f702c1a50c0 con 0x7f702c106f00 2024-09-15T22:17:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.071+0000 7f70227fc640 1 -- 172.21.15.45:0/2487639426 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f7024004cd0 con 0x7f702c106f00 2024-09-15T22:17:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.071+0000 7f7035de9740 1 Processor -- start 2024-09-15T22:17:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.071+0000 7f7035de9740 1 -- start start 2024-09-15T22:17:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.071+0000 7f7035de9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c4a80 0x55a1169c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7035de9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c53a0 0x55a1169d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7035de9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169d4150 0x55a1169d6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7035de9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a11692a280 con 0x55a1169c4a80 2024-09-15T22:17:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7035de9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a1168d1b10 con 0x55a1169d4150 2024-09-15T22:17:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7035de9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a116926240 con 0x55a1169c53a0 2024-09-15T22:17:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7030fab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c4a80 0x55a1169c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7030fab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c4a80 0x55a1169c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36206/0 (socket says 172.21.15.45:36206) 2024-09-15T22:17:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7030fab640 1 -- 172.21.15.45:0/907939193 learned_addr learned my addr 172.21.15.45:0/907939193 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f70227fc640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f70180a34d0 0x7f70180a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f70317ac640 1 --2- 172.21.15.45:0/907939193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c53a0 0x55a1169d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7030fab640 1 --2- 172.21.15.45:0/907939193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169d4150 0x55a1169d6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7030fab640 1 -- 172.21.15.45:0/907939193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c53a0 msgr2=0x55a1169d3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7030fab640 1 --2- 172.21.15.45:0/907939193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c53a0 0x55a1169d3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7030fab640 1 -- 172.21.15.45:0/907939193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169d4150 msgr2=0x55a1169d6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7030fab640 1 --2- 172.21.15.45:0/907939193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169d4150 0x55a1169d6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7030fab640 1 -- 172.21.15.45:0/907939193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1168de1f0 con 0x55a1169c4a80 2024-09-15T22:17:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7031fad640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f70180a34d0 0x7f70180a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f70227fc640 1 -- 172.21.15.45:0/2487639426 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f70240d05c0 con 0x7f702c106f00 2024-09-15T22:17:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.072+0000 7f7030fab640 1 --2- 172.21.15.45:0/907939193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c4a80 0x55a1169c4e60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f701c013660 tx=0x7f701c00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60523e486da683db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.073+0000 7f70177fe640 1 -- 172.21.15.45:0/907939193 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c019030 con 0x55a1169c4a80 2024-09-15T22:17:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.073+0000 7f70177fe640 1 -- 172.21.15.45:0/907939193 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f701c005520 con 0x55a1169c4a80 2024-09-15T22:17:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.073+0000 7f70177fe640 1 -- 172.21.15.45:0/907939193 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c0117a0 con 0x55a1169c4a80 2024-09-15T22:17:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.073+0000 7f7031fad640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f70180a34d0 0x7f70180a5990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70240cd7d0 tx=0x7f702406be50 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.073+0000 7f7035de9740 1 -- 172.21.15.45:0/907939193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c4a80 msgr2=0x55a1169c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.073+0000 7f7035de9740 1 --2- 172.21.15.45:0/907939193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c4a80 0x55a1169c4e60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f701c013660 tx=0x7f701c00b760 comp rx=0 tx=0).stop 2024-09-15T22:17:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.073+0000 7f7035de9740 1 -- 172.21.15.45:0/907939193 shutdown_connections 2024-09-15T22:17:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.073+0000 7f7035de9740 1 --2- 172.21.15.45:0/907939193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169d4150 0x55a1169d6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.073+0000 7f7035de9740 1 --2- 172.21.15.45:0/907939193 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c53a0 0x55a1169d3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.073+0000 7f7035de9740 1 --2- 172.21.15.45:0/907939193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c4a80 0x55a1169c4e60 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.073+0000 7f7035de9740 1 -- 172.21.15.45:0/907939193 >> 172.21.15.45:0/907939193 conn(0x55a1169c10f0 msgr2=0x55a1169c14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.074+0000 7f7035de9740 1 -- 172.21.15.45:0/907939193 shutdown_connections 2024-09-15T22:17:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.074+0000 7f7035de9740 1 -- 172.21.15.45:0/907939193 wait complete. 2024-09-15T22:17:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.074+0000 7f7035de9740 1 -- start start 2024-09-15T22:17:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.074+0000 7f7035de9740 1 Processor -- start 2024-09-15T22:17:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.074+0000 7f7035de9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c4a80 0x55a1169d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.074+0000 7f7035de9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 0x55a1169d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.074+0000 7f7035de9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169d4150 0x55a1169d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.074+0000 7f7035de9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a1169d6cc0 con 0x55a1169c53a0 2024-09-15T22:17:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.074+0000 7f7035de9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a1168e4f10 con 0x55a1169d4150 2024-09-15T22:17:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.074+0000 7f7035de9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a1169d6e40 con 0x55a1169c4a80 2024-09-15T22:17:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f7035de9740 10 client.0 _ll_register_callbacks cb 0x55a1168ada40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f70317ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 0x55a1169d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f70317ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 0x55a1169d1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36210/0 (socket says 172.21.15.45:36210) 2024-09-15T22:17:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f70317ac640 1 -- 172.21.15.45:0/881175004 learned_addr learned my addr 172.21.15.45:0/881175004 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f7030fab640 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169d4150 0x55a1169d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f70317ac640 1 -- 172.21.15.45:0/881175004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c4a80 msgr2=0x55a1169d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f7030fab640 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c4a80 0x55a1169d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f70317ac640 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c4a80 0x55a1169d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f70317ac640 1 -- 172.21.15.45:0/881175004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169d4150 msgr2=0x55a1169d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f70317ac640 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169d4150 0x55a1169d1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f70317ac640 1 -- 172.21.15.45:0/881175004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a11669b6a0 con 0x55a1169c53a0 2024-09-15T22:17:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f7030fab640 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c4a80 0x55a1169d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f70317ac640 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 0x55a1169d1650 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7028009900 tx=0x7f7028031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb269b7d5abcf7f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f7014ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f7014ff9640 1 -- 172.21.15.45:0/881175004 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028035040 con 0x55a1169c53a0 2024-09-15T22:17:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f7035de9740 1 -- 172.21.15.45:0/881175004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f701c005520 con 0x55a1169c53a0 2024-09-15T22:17:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.075+0000 7f7014ff9640 1 -- 172.21.15.45:0/881175004 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f7028004240 con 0x55a1169c53a0 2024-09-15T22:17:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.076+0000 7f7014ff9640 1 -- 172.21.15.45:0/881175004 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7028031a60 con 0x55a1169c53a0 2024-09-15T22:17:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.076+0000 7f7035de9740 10 client.15753 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.076+0000 7f7035de9740 1 -- 172.21.15.45:0/881175004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a1169e29e0 con 0x55a1169c53a0 2024-09-15T22:17:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.076+0000 7f7014ff9640 1 -- 172.21.15.45:0/881175004 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f701c005520 con 0x55a1169c53a0 2024-09-15T22:17:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.076+0000 7f7014ff9640 1 -- 172.21.15.45:0/881175004 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f702803c740 con 0x55a1169c53a0 2024-09-15T22:17:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.076+0000 7f7035de9740 10 client.15753 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.076+0000 7f7035de9740 10 client.15753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.076+0000 7f7035de9740 20 client.15753 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.076+0000 7f7035de9740 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1169e3ef0 0x55a1169e6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.076+0000 7f7035de9740 4 client.15753 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.076+0000 7f7035de9740 1 -- 172.21.15.45:0/881175004 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1169377f0 con 0x55a1169e3ef0 2024-09-15T22:17:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.076+0000 7f7030fab640 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1169e3ef0 0x55a1169e6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.077+0000 7f7014ff9640 10 client.15753 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.077+0000 7f7030fab640 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1169e3ef0 0x55a1169e6310 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=679a4182621e69bd server_cookie=56df92d404c44cfd in_seq=0 out_seq=0 2024-09-15T22:17:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.077+0000 7f7014ff9640 1 -- 172.21.15.45:0/881175004 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a1169377f0 con 0x55a1169e3ef0 2024-09-15T22:17:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.077+0000 7f7014ff9640 10 client.15753 handle_command_reply: tid=0 2024-09-15T22:17:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.077+0000 7f7035de9740 1 client.15753 shutdown 2024-09-15T22:17:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.078+0000 7f7035de9740 1 -- 172.21.15.45:0/881175004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 msgr2=0x55a1169d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.078+0000 7f7035de9740 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 0x55a1169d1650 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7028009900 tx=0x7f7028031870 comp rx=0 tx=0).stop 2024-09-15T22:17:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.078+0000 7f7035de9740 1 -- 172.21.15.45:0/881175004 shutdown_connections 2024-09-15T22:17:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.078+0000 7f7035de9740 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1169e3ef0 0x55a1169e6310 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.078+0000 7f7035de9740 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169d4150 0x55a1169d1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.078+0000 7f7035de9740 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 0x55a1169d1650 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.078+0000 7f7014ff9640 0 client.15753 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.078+0000 7f7035de9740 1 --2- 172.21.15.45:0/881175004 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c4a80 0x55a1169d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.078+0000 7f7035de9740 1 -- 172.21.15.45:0/881175004 >> 172.21.15.45:0/881175004 conn(0x55a1169c10f0 msgr2=0x55a1169c6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.078+0000 7f7035de9740 1 -- 172.21.15.45:0/881175004 shutdown_connections 2024-09-15T22:17:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.078+0000 7f7035de9740 1 -- 172.21.15.45:0/881175004 wait complete. 2024-09-15T22:17:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.078+0000 7f7035de9740 20 client.15753 trim_cache size 0 max 16384 2024-09-15T22:17:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.095+0000 7f7035de9740 1 Processor -- start 2024-09-15T22:17:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.095+0000 7f7035de9740 1 -- start start 2024-09-15T22:17:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7035de9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c4a80 0x55a1169d19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7035de9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169c53a0 0x55a1169ebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7035de9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169d4150 0x55a1169ec120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7035de9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f702c1ab020 con 0x55a1169d4150 2024-09-15T22:17:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7035de9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f702c1ad8a0 con 0x55a1169c53a0 2024-09-15T22:17:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7035de9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f702c1ab690 con 0x55a1169c4a80 2024-09-15T22:17:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7030fab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169d4150 0x55a1169ec120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7030fab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169d4150 0x55a1169ec120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36212/0 (socket says 172.21.15.45:36212) 2024-09-15T22:17:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7030fab640 1 -- 172.21.15.45:0/2784038713 learned_addr learned my addr 172.21.15.45:0/2784038713 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f70317ac640 1 --2- 172.21.15.45:0/2784038713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169c53a0 0x55a1169ebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7030fab640 1 -- 172.21.15.45:0/2784038713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c4a80 msgr2=0x55a1169d19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7030fab640 1 --2- 172.21.15.45:0/2784038713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c4a80 0x55a1169d19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7030fab640 1 -- 172.21.15.45:0/2784038713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169c53a0 msgr2=0x55a1169ebbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7030fab640 1 --2- 172.21.15.45:0/2784038713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169c53a0 0x55a1169ebbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7030fab640 1 -- 172.21.15.45:0/2784038713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1169cf660 con 0x55a1169d4150 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7030fab640 1 --2- 172.21.15.45:0/2784038713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169d4150 0x55a1169ec120 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f701c013660 tx=0x7f701c005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a8b5070b693fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.096+0000 7f7016ffd640 1 -- 172.21.15.45:0/2784038713 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c019040 con 0x55a1169d4150 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.097+0000 7f7016ffd640 1 -- 172.21.15.45:0/2784038713 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f701c005410 con 0x55a1169d4150 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.097+0000 7f7016ffd640 1 -- 172.21.15.45:0/2784038713 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701c0297e0 con 0x55a1169d4150 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.097+0000 7f7035de9740 1 -- 172.21.15.45:0/2784038713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169d4150 msgr2=0x55a1169ec120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.097+0000 7f7035de9740 1 --2- 172.21.15.45:0/2784038713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169d4150 0x55a1169ec120 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f701c013660 tx=0x7f701c005c50 comp rx=0 tx=0).stop 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.097+0000 7f7035de9740 1 -- 172.21.15.45:0/2784038713 shutdown_connections 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.097+0000 7f7035de9740 1 --2- 172.21.15.45:0/2784038713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169d4150 0x55a1169ec120 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.097+0000 7f7035de9740 1 --2- 172.21.15.45:0/2784038713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169c53a0 0x55a1169ebbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.097+0000 7f7035de9740 1 --2- 172.21.15.45:0/2784038713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169c4a80 0x55a1169d19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.097+0000 7f7035de9740 1 -- 172.21.15.45:0/2784038713 >> 172.21.15.45:0/2784038713 conn(0x55a1169c10f0 msgr2=0x55a1169c6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.097+0000 7f7035de9740 1 -- 172.21.15.45:0/2784038713 shutdown_connections 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.097+0000 7f7035de9740 1 -- 172.21.15.45:0/2784038713 wait complete. 2024-09-15T22:17:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.098+0000 7f7035de9740 1 -- start start 2024-09-15T22:17:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.098+0000 7f7035de9740 1 Processor -- start 2024-09-15T22:17:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.098+0000 7f7035de9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169c4a80 0x55a1169dc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.098+0000 7f7035de9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 0x55a1169d90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.098+0000 7f7035de9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169d4150 0x55a1169d95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.098+0000 7f7035de9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f702c1abd60 con 0x55a1169c53a0 2024-09-15T22:17:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.098+0000 7f7035de9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f702c1ad1d0 con 0x55a1169c4a80 2024-09-15T22:17:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.098+0000 7f7035de9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f702c1ac430 con 0x55a1169d4150 2024-09-15T22:17:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.098+0000 7f7035de9740 10 client.0 _ll_register_callbacks cb 0x7f7028005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.098+0000 7f70317ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 0x55a1169d90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f70317ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 0x55a1169d90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36224/0 (socket says 172.21.15.45:36224) 2024-09-15T22:17:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f70317ac640 1 -- 172.21.15.45:0/2671835563 learned_addr learned my addr 172.21.15.45:0/2671835563 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f7030fab640 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169d4150 0x55a1169d95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f7030fab640 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169c4a80 0x55a1169dc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f70317ac640 1 -- 172.21.15.45:0/2671835563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169d4150 msgr2=0x55a1169d95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f70317ac640 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169d4150 0x55a1169d95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f70317ac640 1 -- 172.21.15.45:0/2671835563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169c4a80 msgr2=0x55a1169dc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f70317ac640 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169c4a80 0x55a1169dc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f70317ac640 1 -- 172.21.15.45:0/2671835563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1169d9c50 con 0x55a1169c53a0 2024-09-15T22:17:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f7030fab640 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169c4a80 0x55a1169dc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:17:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f70317ac640 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 0x55a1169d90a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f702803cd00 tx=0x7f7028000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce993bdba1f0045b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f7014ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f7014ff9640 1 -- 172.21.15.45:0/2671835563 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028058060 con 0x55a1169c53a0 2024-09-15T22:17:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f7014ff9640 1 -- 172.21.15.45:0/2671835563 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f702803c640 con 0x55a1169c53a0 2024-09-15T22:17:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f7035de9740 1 -- 172.21.15.45:0/2671835563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f701c005410 con 0x55a1169c53a0 2024-09-15T22:17:46.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f7014ff9640 1 -- 172.21.15.45:0/2671835563 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f702805f050 con 0x55a1169c53a0 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f7035de9740 10 client.15759 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.099+0000 7f7035de9740 1 -- 172.21.15.45:0/2671835563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a116a4fa70 con 0x55a1169c53a0 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.100+0000 7f7014ff9640 1 -- 172.21.15.45:0/2671835563 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f701c005410 con 0x55a1169c53a0 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.100+0000 7f7014ff9640 1 -- 172.21.15.45:0/2671835563 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7028004910 con 0x55a1169c53a0 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.100+0000 7f7035de9740 10 client.15759 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.100+0000 7f7035de9740 10 client.15759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.100+0000 7f7035de9740 20 client.15759 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.100+0000 7f7035de9740 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a116a50160 0x55a116a52580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.100+0000 7f7035de9740 4 client.15759 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.100+0000 7f7035de9740 1 -- 172.21.15.45:0/2671835563 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a116931d00 con 0x55a116a50160 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.100+0000 7f7030fab640 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a116a50160 0x55a116a52580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.101+0000 7f7014ff9640 10 client.15759 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.101+0000 7f7030fab640 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a116a50160 0x55a116a52580 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d3d96f6f80f6ea3 server_cookie=92c9967616464238 in_seq=0 out_seq=0 2024-09-15T22:17:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7014ff9640 1 -- 172.21.15.45:0/2671835563 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a116931d00 con 0x55a116a50160 2024-09-15T22:17:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7014ff9640 10 client.15759 handle_command_reply: tid=0 2024-09-15T22:17:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7035de9740 1 client.15759 shutdown 2024-09-15T22:17:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7035de9740 1 -- 172.21.15.45:0/2671835563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 msgr2=0x55a1169d90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7035de9740 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 0x55a1169d90a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f702803cd00 tx=0x7f7028000bc0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7035de9740 1 -- 172.21.15.45:0/2671835563 shutdown_connections 2024-09-15T22:17:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7035de9740 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a116a50160 0x55a116a52580 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7014ff9640 0 client.15759 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7035de9740 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1169d4150 0x55a1169d95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7035de9740 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1169c53a0 0x55a1169d90a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7035de9740 1 --2- 172.21.15.45:0/2671835563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1169c4a80 0x55a1169dc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7035de9740 1 -- 172.21.15.45:0/2671835563 >> 172.21.15.45:0/2671835563 conn(0x55a1169c10f0 msgr2=0x55a1169bfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7035de9740 1 -- 172.21.15.45:0/2671835563 shutdown_connections 2024-09-15T22:17:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7035de9740 1 -- 172.21.15.45:0/2671835563 wait complete. 2024-09-15T22:17:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.102+0000 7f7035de9740 20 client.15759 trim_cache size 0 max 16384 2024-09-15T22:17:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.103+0000 7f7033a10640 1 -- 172.21.15.45:0/2487639426 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f70180a34d0 msgr2=0x7f70180a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.103+0000 7f7033a10640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f70180a34d0 0x7f70180a5990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70240cd7d0 tx=0x7f702406be50 comp rx=0 tx=0).stop 2024-09-15T22:17:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.103+0000 7f7033a10640 1 -- 172.21.15.45:0/2487639426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f702c106f00 msgr2=0x7f702c19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.103+0000 7f7033a10640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f702c106f00 0x7f702c19ce10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f702400eaa0 tx=0x7f702400ef60 comp rx=0 tx=0).stop 2024-09-15T22:17:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.103+0000 7f7033a10640 1 -- 172.21.15.45:0/2487639426 shutdown_connections 2024-09-15T22:17:46.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.103+0000 7f7033a10640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f70180a34d0 0x7f70180a5990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.103+0000 7f7033a10640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f702c106f00 0x7f702c19ce10 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.103+0000 7f7033a10640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f702c102780 0x7f702c198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.103+0000 7f7033a10640 1 --2- 172.21.15.45:0/2487639426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f702c101dd0 0x7f702c198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.103+0000 7f7033a10640 1 -- 172.21.15.45:0/2487639426 >> 172.21.15.45:0/2487639426 conn(0x7f702c0fd8b0 msgr2=0x7f702c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.103+0000 7f7033a10640 1 -- 172.21.15.45:0/2487639426 shutdown_connections 2024-09-15T22:17:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:46.103+0000 7f7033a10640 1 -- 172.21.15.45:0/2487639426 wait complete. 2024-09-15T22:17:46.502 INFO:tasks.workunit.client.0.smithi045.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-15T22:17:46.502 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T22:17:46.502 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-15T22:17:46.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:46 smithi045 ceph-mon[31180]: pgmap v49: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:17:46.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:46 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:17:46.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:46 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:46.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:46 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:17:46.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:46 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:46 smithi165 ceph-mon[35551]: pgmap v49: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:17:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:46 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:17:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:46 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:46 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:17:46.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:46 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:46.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:46 smithi100 ceph-mon[35319]: pgmap v49: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:17:46.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:46 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:17:46.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:46 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:46.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:46 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:17:46.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:46 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:47.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:17:47.941 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:47.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:47 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:17:47.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:47 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:17:48.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:47 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:17:48.154 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-15T22:17:48.257 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-15T22:17:48.309 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T22:17:48.311 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T22:17:48.311 INFO:tasks.workunit.client.0.smithi045.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-15T22:17:48.352 INFO:tasks.workunit.client.0.smithi045.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T22:17:48.354 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:17:48.354 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-15T22:17:48.371 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-15T22:17:48.372 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-15T22:17:48.373 DEBUG:teuthology.orchestra.run.smithi045:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-15T22:17:48.455 INFO:tasks.workunit.client.0.smithi045.stderr:+ KERNEL=linux-4.0.5 2024-09-15T22:17:48.455 INFO:tasks.workunit.client.0.smithi045.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-09-15T22:17:48.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.504+0000 7f8bcd404640 1 -- 172.21.15.45:0/2246664786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc8100870 msgr2=0x7f8bc810e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.504+0000 7f8bcd404640 1 --2- 172.21.15.45:0/2246664786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc8100870 0x7f8bc810e9d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009900 tx=0x7f8bc002a410 comp rx=0 tx=0).stop 2024-09-15T22:17:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.504+0000 7f8bcd404640 1 -- 172.21.15.45:0/2246664786 shutdown_connections 2024-09-15T22:17:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.504+0000 7f8bcd404640 1 --2- 172.21.15.45:0/2246664786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc8100870 0x7f8bc810e9d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.504+0000 7f8bcd404640 1 --2- 172.21.15.45:0/2246664786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bc80ffed0 0x7f8bc8100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.504+0000 7f8bcd404640 1 --2- 172.21.15.45:0/2246664786 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bc8106b30 0x7f8bc8106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.504+0000 7f8bcd404640 1 -- 172.21.15.45:0/2246664786 >> 172.21.15.45:0/2246664786 conn(0x7f8bc8077010 msgr2=0x7f8bc80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.504+0000 7f8bcd404640 1 -- 172.21.15.45:0/2246664786 shutdown_connections 2024-09-15T22:17:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.504+0000 7f8bcd404640 1 -- 172.21.15.45:0/2246664786 wait complete. 2024-09-15T22:17:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bcd404640 1 Processor -- start 2024-09-15T22:17:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bcd404640 1 -- start start 2024-09-15T22:17:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bcd404640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc80ffed0 0x7f8bc81010b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bcd404640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bc8100870 0x7f8bc81015f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bcd404640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bc8106b30 0x7f8bc8101b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bcd404640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc8112120 con 0x7f8bc80ffed0 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bcd404640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc8111fa0 con 0x7f8bc8106b30 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bcd404640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc81122a0 con 0x7f8bc8100870 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bc6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc80ffed0 0x7f8bc81010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bc6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc80ffed0 0x7f8bc81010b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36252/0 (socket says 172.21.15.45:36252) 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bc6ffd640 1 -- 172.21.15.45:0/2481815807 learned_addr learned my addr 172.21.15.45:0/2481815807 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bc67fc640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bc8100870 0x7f8bc81015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bc6ffd640 1 -- 172.21.15.45:0/2481815807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bc8100870 msgr2=0x7f8bc81015f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bc8100870 0x7f8bc81015f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bc6ffd640 1 -- 172.21.15.45:0/2481815807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bc8106b30 msgr2=0x7f8bc8101b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bc8106b30 0x7f8bc8101b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bc6ffd640 1 -- 172.21.15.45:0/2481815807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc81a6980 con 0x7f8bc80ffed0 2024-09-15T22:17:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.505+0000 7f8bc67fc640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bc8100870 0x7f8bc81015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.506+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc80ffed0 0x7f8bc81010b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800eab0 tx=0x7f8bb800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.506+0000 7f8baffff640 1 -- 172.21.15.45:0/2481815807 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb800ce40 con 0x7f8bc80ffed0 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.506+0000 7f8baffff640 1 -- 172.21.15.45:0/2481815807 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bb8011970 con 0x7f8bc80ffed0 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.506+0000 7f8bcd404640 1 -- 172.21.15.45:0/2481815807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc81a6c70 con 0x7f8bc80ffed0 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.506+0000 7f8baffff640 1 -- 172.21.15.45:0/2481815807 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb8010bb0 con 0x7f8bc80ffed0 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.506+0000 7f8bcd404640 1 -- 172.21.15.45:0/2481815807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bc81a71b0 con 0x7f8bc80ffed0 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.508+0000 7f8baffff640 1 -- 172.21.15.45:0/2481815807 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 24) ==== 138588+0+0 (secure 0 0 0) 0x7f8bb8010d50 con 0x7f8bc80ffed0 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.508+0000 7f8bcf7dd740 1 Processor -- start 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.508+0000 7f8bcf7dd740 1 -- start start 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bcf7dd740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e077ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bcf7dd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fff90 0x562e0780a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bcf7dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e0780a850 0x562e0780cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bcf7dd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x562e077652e0 con 0x562e077fff90 2024-09-15T22:17:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bcf7dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562e0770cce0 con 0x562e0780a850 2024-09-15T22:17:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bcf7dd740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562e077612a0 con 0x562e077ff670 2024-09-15T22:17:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bc6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fff90 0x562e0780a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bc6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fff90 0x562e0780a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36266/0 (socket says 172.21.15.45:36266) 2024-09-15T22:17:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bc6ffd640 1 -- 172.21.15.45:0/1550078501 learned_addr learned my addr 172.21.15.45:0/1550078501 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bc67fc640 1 --2- 172.21.15.45:0/1550078501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e0780a850 0x562e0780cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bc77fe640 1 --2- 172.21.15.45:0/1550078501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e077ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8baffff640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8bb00a34d0 0x7f8bb00a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bc6ffd640 1 -- 172.21.15.45:0/1550078501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 msgr2=0x562e077ffa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/1550078501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e077ffa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bc6ffd640 1 -- 172.21.15.45:0/1550078501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e0780a850 msgr2=0x562e0780cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/1550078501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e0780a850 0x562e0780cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bc6ffd640 1 -- 172.21.15.45:0/1550078501 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e076f1440 con 0x562e077fff90 2024-09-15T22:17:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bc67fc640 1 --2- 172.21.15.45:0/1550078501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e0780a850 0x562e0780cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:17:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bc77fe640 1 --2- 172.21.15.45:0/1550078501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e077ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8bc77fe640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8bb00a34d0 0x7f8bb00a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.509+0000 7f8baffff640 1 -- 172.21.15.45:0/2481815807 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f8bb80d0a40 con 0x7f8bc80ffed0 2024-09-15T22:17:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.510+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/1550078501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fff90 0x562e0780a310 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80cdd60 tx=0x7f8bb8067050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47aac4eb1a5a647 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.510+0000 7f8bad7fa640 1 -- 172.21.15.45:0/1550078501 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb809c070 con 0x562e077fff90 2024-09-15T22:17:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.510+0000 7f8bad7fa640 1 -- 172.21.15.45:0/1550078501 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bb8067560 con 0x562e077fff90 2024-09-15T22:17:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.510+0000 7f8bad7fa640 1 -- 172.21.15.45:0/1550078501 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb806c3a0 con 0x562e077fff90 2024-09-15T22:17:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.510+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/1550078501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fff90 msgr2=0x562e0780a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.510+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/1550078501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fff90 0x562e0780a310 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80cdd60 tx=0x7f8bb8067050 comp rx=0 tx=0).stop 2024-09-15T22:17:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.510+0000 7f8bc77fe640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8bb00a34d0 0x7f8bb00a5990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009230 tx=0x7f8bc0009260 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.510+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/1550078501 shutdown_connections 2024-09-15T22:17:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.510+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/1550078501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e0780a850 0x562e0780cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.510+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/1550078501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fff90 0x562e0780a310 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/1550078501 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e077ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/1550078501 >> 172.21.15.45:0/1550078501 conn(0x562e077fbc00 msgr2=0x562e077fbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/1550078501 shutdown_connections 2024-09-15T22:17:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/1550078501 wait complete. 2024-09-15T22:17:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bcf7dd740 1 -- start start 2024-09-15T22:17:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bcf7dd740 1 Processor -- start 2024-09-15T22:17:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bcf7dd740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e0780a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bcf7dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 0x562e078073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bcf7dd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e0780a850 0x562e07807920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bcf7dd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x562e0780d420 con 0x562e0780a850 2024-09-15T22:17:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bcf7dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562e07720050 con 0x562e077fff90 2024-09-15T22:17:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bcf7dd740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562e0780d5a0 con 0x562e077ff670 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bcf7dd740 10 client.0 _ll_register_callbacks cb 0x562e07760160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bc77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e0780a850 0x562e07807920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bc77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e0780a850 0x562e07807920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36282/0 (socket says 172.21.15.45:36282) 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bc77fe640 1 -- 172.21.15.45:0/757696545 learned_addr learned my addr 172.21.15.45:0/757696545 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.511+0000 7f8bc67fc640 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 0x562e078073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e0780a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8bc77fe640 1 -- 172.21.15.45:0/757696545 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 msgr2=0x562e0780a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8bc77fe640 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e0780a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8bc77fe640 1 -- 172.21.15.45:0/757696545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 msgr2=0x562e078073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8bc77fe640 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 0x562e078073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8bc77fe640 1 -- 172.21.15.45:0/757696545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e074d63c0 con 0x562e0780a850 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e0780a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8bc77fe640 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e0780a850 0x562e07807920 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0031a80 tx=0x7f8bc0031ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff700d0fad16cec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8baaff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8baaff5640 1 -- 172.21.15.45:0/757696545 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0035040 con 0x562e0780a850 2024-09-15T22:17:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8baaff5640 1 -- 172.21.15.45:0/757696545 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f8bc0005230 con 0x562e0780a850 2024-09-15T22:17:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/757696545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bb8067560 con 0x562e0780a850 2024-09-15T22:17:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8baaff5640 1 -- 172.21.15.45:0/757696545 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8bc0056050 con 0x562e0780a850 2024-09-15T22:17:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8bcf7dd740 10 client.15771 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/757696545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562e07818d60 con 0x562e0780a850 2024-09-15T22:17:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.512+0000 7f8baaff5640 1 -- 172.21.15.45:0/757696545 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bb8067560 con 0x562e0780a850 2024-09-15T22:17:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.513+0000 7f8baaff5640 1 -- 172.21.15.45:0/757696545 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8bc0051030 con 0x562e0780a850 2024-09-15T22:17:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.513+0000 7f8bcf7dd740 10 client.15771 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.513+0000 7f8bcf7dd740 10 client.15771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.513+0000 7f8bcf7dd740 20 client.15771 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.513+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562e0781a2c0 0x562e0781c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.513+0000 7f8bcf7dd740 4 client.15771 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.513+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/757696545 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e07772850 con 0x562e0781a2c0 2024-09-15T22:17:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.513+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562e0781a2c0 0x562e0781c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562e0781a2c0 0x562e0781c700 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94c341c5eb1bb95f server_cookie=6dbe824335bba92e in_seq=0 out_seq=0 2024-09-15T22:17:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8baaff5640 10 client.15771 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8baaff5640 1 -- 172.21.15.45:0/757696545 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e07772850 con 0x562e0781a2c0 2024-09-15T22:17:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8baaff5640 10 client.15771 handle_command_reply: tid=0 2024-09-15T22:17:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8bcf7dd740 1 client.15771 shutdown 2024-09-15T22:17:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/757696545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e0780a850 msgr2=0x562e07807920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e0780a850 0x562e07807920 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0031a80 tx=0x7f8bc0031ab0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/757696545 shutdown_connections 2024-09-15T22:17:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562e0781a2c0 0x562e0781c700 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e0780a850 0x562e07807920 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 0x562e078073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/757696545 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e0780a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8baaff5640 0 client.15771 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.514+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/757696545 >> 172.21.15.45:0/757696545 conn(0x562e077fbc00 msgr2=0x562e077fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.515+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/757696545 shutdown_connections 2024-09-15T22:17:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.515+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/757696545 wait complete. 2024-09-15T22:17:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.515+0000 7f8bcf7dd740 20 client.15771 trim_cache size 0 max 16384 2024-09-15T22:17:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bcf7dd740 1 Processor -- start 2024-09-15T22:17:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bcf7dd740 1 -- start start 2024-09-15T22:17:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bcf7dd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fbc00 0x562e07821fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bcf7dd740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e07822510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bcf7dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 0x562e07804680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bcf7dd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc81af170 con 0x562e077fbc00 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bcf7dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc81b19f0 con 0x562e077fff90 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bcf7dd740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc81af7e0 con 0x562e077ff670 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bc6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fbc00 0x562e07821fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bc6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fbc00 0x562e07821fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36292/0 (socket says 172.21.15.45:36292) 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bc6ffd640 1 -- 172.21.15.45:0/1024685914 learned_addr learned my addr 172.21.15.45:0/1024685914 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bc67fc640 1 --2- 172.21.15.45:0/1024685914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e07822510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bc77fe640 1 --2- 172.21.15.45:0/1024685914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 0x562e07804680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bc6ffd640 1 -- 172.21.15.45:0/1024685914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 msgr2=0x562e07822510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/1024685914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e07822510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bc6ffd640 1 -- 172.21.15.45:0/1024685914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 msgr2=0x562e07804680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/1024685914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 0x562e07804680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bc6ffd640 1 -- 172.21.15.45:0/1024685914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e077ff4a0 con 0x562e077fbc00 2024-09-15T22:17:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.532+0000 7f8bc67fc640 1 --2- 172.21.15.45:0/1024685914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e07822510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:17:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.533+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/1024685914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fbc00 0x562e07821fd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8bb809c6a0 tx=0x7f8bb80d4550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dcaa3ae8e61e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.533+0000 7f8bacff9640 1 -- 172.21.15.45:0/1024685914 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb809ce10 con 0x562e077fbc00 2024-09-15T22:17:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.533+0000 7f8bacff9640 1 -- 172.21.15.45:0/1024685914 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bb809c710 con 0x562e077fbc00 2024-09-15T22:17:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.533+0000 7f8bacff9640 1 -- 172.21.15.45:0/1024685914 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb809aaa0 con 0x562e077fbc00 2024-09-15T22:17:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.533+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/1024685914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fbc00 msgr2=0x562e07821fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.533+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/1024685914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fbc00 0x562e07821fd0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8bb809c6a0 tx=0x7f8bb80d4550 comp rx=0 tx=0).stop 2024-09-15T22:17:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.533+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/1024685914 shutdown_connections 2024-09-15T22:17:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.533+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/1024685914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 0x562e07804680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.533+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/1024685914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077ff670 0x562e07822510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.533+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/1024685914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077fbc00 0x562e07821fd0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.533+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/1024685914 >> 172.21.15.45:0/1024685914 conn(0x562e07807a80 msgr2=0x562e07805cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:48.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.533+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/1024685914 shutdown_connections 2024-09-15T22:17:48.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.533+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/1024685914 wait complete. 2024-09-15T22:17:48.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.534+0000 7f8bcf7dd740 1 -- start start 2024-09-15T22:17:48.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.534+0000 7f8bcf7dd740 1 Processor -- start 2024-09-15T22:17:48.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.534+0000 7f8bcf7dd740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077fbc00 0x562e078109c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.534+0000 7f8bcf7dd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077ff670 0x562e07810f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.534+0000 7f8bcf7dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 0x562e07883fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.534+0000 7f8bcf7dd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc81afeb0 con 0x562e077ff670 2024-09-15T22:17:48.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.534+0000 7f8bcf7dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc81b1320 con 0x562e077fff90 2024-09-15T22:17:48.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.534+0000 7f8bcf7dd740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8bc81b0580 con 0x562e077fbc00 2024-09-15T22:17:48.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.534+0000 7f8bcf7dd740 10 client.0 _ll_register_callbacks cb 0x7f8bc0040040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:48.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.534+0000 7f8bc67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077ff670 0x562e07810f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.534+0000 7f8bc67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077ff670 0x562e07810f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36304/0 (socket says 172.21.15.45:36304) 2024-09-15T22:17:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.534+0000 7f8bc67fc640 1 -- 172.21.15.45:0/3571373068 learned_addr learned my addr 172.21.15.45:0/3571373068 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.534+0000 7f8bc77fe640 1 --2- 172.21.15.45:0/3571373068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 0x562e07883fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/3571373068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077fbc00 0x562e078109c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8bc67fc640 1 -- 172.21.15.45:0/3571373068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077fbc00 msgr2=0x562e078109c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8bc67fc640 1 --2- 172.21.15.45:0/3571373068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077fbc00 0x562e078109c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8bc67fc640 1 -- 172.21.15.45:0/3571373068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 msgr2=0x562e07883fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8bc67fc640 1 --2- 172.21.15.45:0/3571373068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 0x562e07883fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8bc67fc640 1 -- 172.21.15.45:0/3571373068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e078844f0 con 0x562e077ff670 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8bc67fc640 1 --2- 172.21.15.45:0/3571373068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077ff670 0x562e07810f00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8102b40 tx=0x7f8bbc011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca83b6bff09a73b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8baaff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8baaff5640 1 -- 172.21.15.45:0/3571373068 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc005020 con 0x562e077ff670 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8baaff5640 1 -- 172.21.15.45:0/3571373068 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f8bbc0051c0 con 0x562e077ff670 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/3571373068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bb809c710 con 0x562e077ff670 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8baaff5640 1 -- 172.21.15.45:0/3571373068 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8bbc0053c0 con 0x562e077ff670 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8bcf7dd740 10 client.15777 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.535+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/3571373068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562e07885730 con 0x562e077ff670 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.536+0000 7f8baaff5640 1 -- 172.21.15.45:0/3571373068 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bb809c710 con 0x562e077ff670 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.536+0000 7f8baaff5640 1 -- 172.21.15.45:0/3571373068 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8bbc01a070 con 0x562e077ff670 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.536+0000 7f8bcf7dd740 10 client.15777 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.536+0000 7f8bcf7dd740 10 client.15777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.536+0000 7f8bcf7dd740 20 client.15777 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.536+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/3571373068 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562e0780a850 0x562e07887fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.536+0000 7f8bcf7dd740 4 client.15777 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.536+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/3571373068 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562e0776cd60 con 0x562e0780a850 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.536+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/3571373068 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562e0780a850 0x562e07887fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8bc6ffd640 1 --2- 172.21.15.45:0/3571373068 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562e0780a850 0x562e07887fa0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89ce12b949286d5f server_cookie=89dfb2e55336fc9 in_seq=0 out_seq=0 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8baaff5640 10 client.15777 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8baaff5640 1 -- 172.21.15.45:0/3571373068 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562e0776cd60 con 0x562e0780a850 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8baaff5640 10 client.15777 handle_command_reply: tid=0 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8bcf7dd740 1 client.15777 shutdown 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/3571373068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077ff670 msgr2=0x562e07810f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/3571373068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077ff670 0x562e07810f00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8102b40 tx=0x7f8bbc011ec0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/3571373068 shutdown_connections 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/3571373068 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562e0780a850 0x562e07887fa0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/3571373068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562e077fff90 0x562e07883fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/3571373068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e077ff670 0x562e07810f00 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8bcf7dd740 1 --2- 172.21.15.45:0/3571373068 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562e077fbc00 0x562e078109c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/3571373068 >> 172.21.15.45:0/3571373068 conn(0x562e07807a80 msgr2=0x562e07808c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8baaff5640 0 client.15777 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/3571373068 shutdown_connections 2024-09-15T22:17:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8bcf7dd740 1 -- 172.21.15.45:0/3571373068 wait complete. 2024-09-15T22:17:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.537+0000 7f8bcf7dd740 20 client.15777 trim_cache size 0 max 16384 2024-09-15T22:17:48.559 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:17:48.559 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:17:48.560 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:17:48.560 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:17:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.538+0000 7f8bcd404640 1 -- 172.21.15.45:0/2481815807 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8bb00a34d0 msgr2=0x7f8bb00a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.538+0000 7f8bcd404640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8bb00a34d0 0x7f8bb00a5990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009230 tx=0x7f8bc0009260 comp rx=0 tx=0).stop 2024-09-15T22:17:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.538+0000 7f8bcd404640 1 -- 172.21.15.45:0/2481815807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc80ffed0 msgr2=0x7f8bc81010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.538+0000 7f8bcd404640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc80ffed0 0x7f8bc81010b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8bb800eab0 tx=0x7f8bb800ef70 comp rx=0 tx=0).stop 2024-09-15T22:17:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.538+0000 7f8bcd404640 1 -- 172.21.15.45:0/2481815807 shutdown_connections 2024-09-15T22:17:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.538+0000 7f8bcd404640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8bb00a34d0 0x7f8bb00a5990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.538+0000 7f8bcd404640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bc8106b30 0x7f8bc8101b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.538+0000 7f8bcd404640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8bc8100870 0x7f8bc81015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.538+0000 7f8bcd404640 1 --2- 172.21.15.45:0/2481815807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8bc80ffed0 0x7f8bc81010b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.538+0000 7f8bcd404640 1 -- 172.21.15.45:0/2481815807 >> 172.21.15.45:0/2481815807 conn(0x7f8bc8077010 msgr2=0x7f8bc8104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.538+0000 7f8bcd404640 1 -- 172.21.15.45:0/2481815807 shutdown_connections 2024-09-15T22:17:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:48.538+0000 7f8bcd404640 1 -- 172.21.15.45:0/2481815807 wait complete. 2024-09-15T22:17:48.808 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:48 smithi045 ceph-mon[31180]: pgmap v50: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:17:48.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:48 smithi165 ceph-mon[35551]: pgmap v50: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:17:48.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:48 smithi100 ceph-mon[35319]: pgmap v50: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:17:49.291 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:17:49.291 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:17:49.591 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.079+0000 7f6b57b00640 1 -- 172.21.15.45:0/1443969495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b50103660 msgr2=0x7f6b5010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.079+0000 7f6b57b00640 1 --2- 172.21.15.45:0/1443969495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b50103660 0x7f6b5010bb50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009900 tx=0x7f6b4402a480 comp rx=0 tx=0).stop 2024-09-15T22:17:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.079+0000 7f6b57b00640 1 -- 172.21.15.45:0/1443969495 shutdown_connections 2024-09-15T22:17:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.079+0000 7f6b57b00640 1 --2- 172.21.15.45:0/1443969495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b5010c170 0x7f6b5010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.079+0000 7f6b57b00640 1 --2- 172.21.15.45:0/1443969495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b50103660 0x7f6b5010bb50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.079+0000 7f6b57b00640 1 --2- 172.21.15.45:0/1443969495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b50102d40 0x7f6b50103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.079+0000 7f6b57b00640 1 -- 172.21.15.45:0/1443969495 >> 172.21.15.45:0/1443969495 conn(0x7f6b500fc7a0 msgr2=0x7f6b500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.079+0000 7f6b57b00640 1 -- 172.21.15.45:0/1443969495 shutdown_connections 2024-09-15T22:17:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.079+0000 7f6b57b00640 1 -- 172.21.15.45:0/1443969495 wait complete. 2024-09-15T22:17:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.079+0000 7f6b57b00640 1 Processor -- start 2024-09-15T22:17:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.079+0000 7f6b57b00640 1 -- start start 2024-09-15T22:17:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.079+0000 7f6b57b00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b50102d40 0x7f6b501985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b57b00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50103660 0x7f6b50198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b57b00640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b5010c170 0x7f6b5019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b57b00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50112090 con 0x7f6b50102d40 2024-09-15T22:17:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b57b00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50111f10 con 0x7f6b50103660 2024-09-15T22:17:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b57b00640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6b50112210 con 0x7f6b5010c170 2024-09-15T22:17:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b5589c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b50102d40 0x7f6b501985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b5589c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b50102d40 0x7f6b501985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36326/0 (socket says 172.21.15.45:36326) 2024-09-15T22:17:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b5589c640 1 -- 172.21.15.45:0/4146361239 learned_addr learned my addr 172.21.15.45:0/4146361239 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b5509b640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50103660 0x7f6b50198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b5609d640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b5010c170 0x7f6b5019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b5589c640 1 -- 172.21.15.45:0/4146361239 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b5010c170 msgr2=0x7f6b5019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b5589c640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b5010c170 0x7f6b5019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b5589c640 1 -- 172.21.15.45:0/4146361239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50103660 msgr2=0x7f6b50198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b5589c640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50103660 0x7f6b50198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b5589c640 1 -- 172.21.15.45:0/4146361239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5019d560 con 0x7f6b50102d40 2024-09-15T22:17:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b5589c640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b50102d40 0x7f6b501985b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00d770 tx=0x7f6b4c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b42ffd640 1 -- 172.21.15.45:0/4146361239 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c017070 con 0x7f6b50102d40 2024-09-15T22:17:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b57b00640 1 -- 172.21.15.45:0/4146361239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5019d850 con 0x7f6b50102d40 2024-09-15T22:17:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b42ffd640 1 -- 172.21.15.45:0/4146361239 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b4c005520 con 0x7f6b50102d40 2024-09-15T22:17:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b42ffd640 1 -- 172.21.15.45:0/4146361239 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c010460 con 0x7f6b50102d40 2024-09-15T22:17:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.080+0000 7f6b57b00640 1 -- 172.21.15.45:0/4146361239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b501a5130 con 0x7f6b50102d40 2024-09-15T22:17:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.081+0000 7f6b57b00640 1 -- 172.21.15.45:0/4146361239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b5006b070 con 0x7f6b50102d40 2024-09-15T22:17:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.083+0000 7f6b42ffd640 1 -- 172.21.15.45:0/4146361239 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6b4c004ea0 con 0x7f6b50102d40 2024-09-15T22:17:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.083+0000 7f6b42ffd640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b3c0a33b0 0x7f6b3c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.083+0000 7f6b5509b640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b3c0a33b0 0x7f6b3c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.083+0000 7f6b42ffd640 1 -- 172.21.15.45:0/4146361239 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f6b4c0cff20 con 0x7f6b50102d40 2024-09-15T22:17:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.084+0000 7f6b5509b640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b3c0a33b0 0x7f6b3c0a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009230 tx=0x7f6b440058d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.087+0000 7f6b42ffd640 1 -- 172.21.15.45:0/4146361239 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6b4c09bef0 con 0x7f6b50102d40 2024-09-15T22:17:50.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.300+0000 7f6b57b00640 1 -- 172.21.15.45:0/4146361239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b501071e0 con 0x7f6b50102d40 2024-09-15T22:17:50.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.301+0000 7f6b42ffd640 1 -- 172.21.15.45:0/4146361239 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f6b4c0a01f0 con 0x7f6b50102d40 2024-09-15T22:17:50.303 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:17:50.303 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:17:50.303 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:17:50.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.303+0000 7f6b57b00640 1 -- 172.21.15.45:0/4146361239 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b3c0a33b0 msgr2=0x7f6b3c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:50.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.303+0000 7f6b57b00640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b3c0a33b0 0x7f6b3c0a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009230 tx=0x7f6b440058d0 comp rx=0 tx=0).stop 2024-09-15T22:17:50.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.303+0000 7f6b57b00640 1 -- 172.21.15.45:0/4146361239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b50102d40 msgr2=0x7f6b501985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:50.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.303+0000 7f6b57b00640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b50102d40 0x7f6b501985b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00d770 tx=0x7f6b4c00dc30 comp rx=0 tx=0).stop 2024-09-15T22:17:50.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.303+0000 7f6b57b00640 1 -- 172.21.15.45:0/4146361239 shutdown_connections 2024-09-15T22:17:50.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.303+0000 7f6b57b00640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b3c0a33b0 0x7f6b3c0a5870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:50.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.303+0000 7f6b57b00640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b5010c170 0x7f6b5019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:50.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.303+0000 7f6b57b00640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b50103660 0x7f6b50198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:50.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.303+0000 7f6b57b00640 1 --2- 172.21.15.45:0/4146361239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b50102d40 0x7f6b501985b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:50.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.303+0000 7f6b57b00640 1 -- 172.21.15.45:0/4146361239 >> 172.21.15.45:0/4146361239 conn(0x7f6b500fc7a0 msgr2=0x7f6b500fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:50.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.303+0000 7f6b57b00640 1 -- 172.21.15.45:0/4146361239 shutdown_connections 2024-09-15T22:17:50.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:50.303+0000 7f6b57b00640 1 -- 172.21.15.45:0/4146361239 wait complete. 2024-09-15T22:17:50.947 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:50 smithi045 ceph-mon[31180]: pgmap v51: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-15T22:17:50.947 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:50 smithi045 ceph-mon[31180]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-15T22:17:50.947 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:50 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/4146361239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:50.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:50 smithi165 ceph-mon[35551]: pgmap v51: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-15T22:17:50.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:50 smithi165 ceph-mon[35551]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-15T22:17:50.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:50 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/4146361239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:50.975 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:17:50.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:50 smithi100 ceph-mon[35319]: pgmap v51: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-15T22:17:50.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:50 smithi100 ceph-mon[35319]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-09-15T22:17:50.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:50 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/4146361239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:17:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:51.371 INFO:tasks.workunit.client.0.smithi045.stderr:+ mkdir untar_tar 2024-09-15T22:17:51.374 INFO:tasks.workunit.client.0.smithi045.stderr:+ cd untar_tar 2024-09-15T22:17:51.374 INFO:tasks.workunit.client.0.smithi045.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-09-15T22:17:51.441 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ 2024-09-15T22:17:51.443 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-15T22:17:51.444 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-15T22:17:51.445 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-15T22:17:51.446 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-15T22:17:51.447 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-15T22:17:51.448 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-15T22:17:51.449 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-15T22:17:51.449 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-15T22:17:51.450 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-15T22:17:51.451 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-15T22:17:51.452 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-15T22:17:51.453 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-15T22:17:51.454 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-15T22:17:51.455 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-15T22:17:51.456 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-15T22:17:51.457 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-15T22:17:51.457 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-15T22:17:51.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-15T22:17:51.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-15T22:17:51.460 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-15T22:17:51.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-15T22:17:51.462 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-15T22:17:51.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-15T22:17:51.464 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-15T22:17:51.466 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-15T22:17:51.467 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-15T22:17:51.468 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-15T22:17:51.469 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-15T22:17:51.471 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-15T22:17:51.472 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-15T22:17:51.474 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-15T22:17:51.475 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-15T22:17:51.476 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-15T22:17:51.478 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-15T22:17:51.479 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-15T22:17:51.481 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-15T22:17:51.482 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-15T22:17:51.484 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-15T22:17:51.485 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-15T22:17:51.487 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-15T22:17:51.488 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-15T22:17:51.490 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-15T22:17:51.491 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-15T22:17:51.493 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-15T22:17:51.494 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-15T22:17:51.495 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-15T22:17:51.497 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-15T22:17:51.498 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-15T22:17:51.499 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-15T22:17:51.501 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-15T22:17:51.502 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-15T22:17:51.503 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-15T22:17:51.504 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-15T22:17:51.506 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-15T22:17:51.507 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-15T22:17:51.508 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-15T22:17:51.510 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-15T22:17:51.511 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-15T22:17:51.512 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-15T22:17:51.513 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-15T22:17:51.515 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-15T22:17:51.516 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-15T22:17:51.517 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-15T22:17:51.518 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-15T22:17:51.519 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-15T22:17:51.520 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-15T22:17:51.521 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-15T22:17:51.523 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-15T22:17:51.524 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-15T22:17:51.524 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-15T22:17:51.525 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-15T22:17:51.526 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-15T22:17:51.527 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-15T22:17:51.528 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-15T22:17:51.529 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-15T22:17:51.529 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-15T22:17:51.530 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-15T22:17:51.531 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-15T22:17:51.532 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-15T22:17:51.533 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-15T22:17:51.534 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-15T22:17:51.535 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-15T22:17:51.536 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-15T22:17:51.537 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-15T22:17:51.538 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-15T22:17:51.538 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-15T22:17:51.539 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-15T22:17:51.543 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-15T22:17:51.544 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-15T22:17:51.545 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-15T22:17:51.580 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-15T22:17:51.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-15T22:17:51.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-15T22:17:51.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-15T22:17:51.583 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-15T22:17:51.584 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-15T22:17:51.584 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-15T22:17:51.585 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-15T22:17:51.586 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-15T22:17:51.587 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-15T22:17:51.588 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-15T22:17:51.589 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-15T22:17:51.589 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-15T22:17:51.590 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-15T22:17:51.591 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-15T22:17:51.592 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-15T22:17:51.592 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-15T22:17:51.593 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-15T22:17:51.594 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-15T22:17:51.595 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-15T22:17:51.596 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-15T22:17:51.596 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-15T22:17:51.597 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-15T22:17:51.598 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-15T22:17:51.599 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-15T22:17:51.600 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-15T22:17:51.600 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-15T22:17:51.601 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-15T22:17:51.602 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-15T22:17:51.603 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-15T22:17:51.604 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-15T22:17:51.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-15T22:17:51.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-15T22:17:51.607 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-15T22:17:51.608 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-15T22:17:51.609 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-15T22:17:51.609 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-15T22:17:51.610 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-15T22:17:51.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-15T22:17:51.612 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-15T22:17:51.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-15T22:17:51.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-15T22:17:51.614 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-15T22:17:51.615 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-15T22:17:51.616 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-15T22:17:51.617 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-15T22:17:51.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-15T22:17:51.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-15T22:17:51.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-15T22:17:51.621 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-15T22:17:51.622 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-15T22:17:51.622 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-15T22:17:51.623 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-15T22:17:51.625 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-15T22:17:51.625 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-15T22:17:51.626 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-15T22:17:51.627 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-15T22:17:51.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-15T22:17:51.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-15T22:17:51.629 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-15T22:17:51.630 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-15T22:17:51.631 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-15T22:17:51.632 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-15T22:17:51.633 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-15T22:17:51.634 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-15T22:17:51.635 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-15T22:17:51.636 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-15T22:17:51.636 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-15T22:17:51.637 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-15T22:17:51.638 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-15T22:17:51.639 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-15T22:17:51.640 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-15T22:17:51.640 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-15T22:17:51.641 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-15T22:17:51.642 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-15T22:17:51.643 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-15T22:17:51.644 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-15T22:17:51.645 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-15T22:17:51.646 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-15T22:17:51.647 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-15T22:17:51.648 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-15T22:17:51.648 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-15T22:17:51.649 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-15T22:17:51.650 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-15T22:17:51.651 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-15T22:17:51.652 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-15T22:17:51.653 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-15T22:17:51.654 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-15T22:17:51.654 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-15T22:17:51.655 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-15T22:17:51.656 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-15T22:17:51.657 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-15T22:17:51.658 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-15T22:17:51.659 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-15T22:17:51.660 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-15T22:17:51.661 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-15T22:17:51.662 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-15T22:17:51.663 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-15T22:17:51.664 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-15T22:17:51.665 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-15T22:17:51.666 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-15T22:17:51.666 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-15T22:17:51.670 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-15T22:17:51.671 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-15T22:17:51.672 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-15T22:17:51.672 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-15T22:17:51.673 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-15T22:17:51.674 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-15T22:17:51.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.753+0000 7fbc9dd51640 1 -- 172.21.15.45:0/3411851968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc9810c160 msgr2=0x7fbc9810e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:51.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.753+0000 7fbc9dd51640 1 --2- 172.21.15.45:0/3411851968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc9810c160 0x7fbc9810e5f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009ca0 tx=0x7fbc9002a950 comp rx=0 tx=0).stop 2024-09-15T22:17:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.753+0000 7fbc9dd51640 1 -- 172.21.15.45:0/3411851968 shutdown_connections 2024-09-15T22:17:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.753+0000 7fbc9dd51640 1 --2- 172.21.15.45:0/3411851968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc9810c160 0x7fbc9810e5f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.753+0000 7fbc9dd51640 1 --2- 172.21.15.45:0/3411851968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc981036e0 0x7fbc9810bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.753+0000 7fbc9dd51640 1 --2- 172.21.15.45:0/3411851968 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc98102dc0 0x7fbc981031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.753+0000 7fbc9dd51640 1 -- 172.21.15.45:0/3411851968 >> 172.21.15.45:0/3411851968 conn(0x7fbc980fc780 msgr2=0x7fbc980feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.753+0000 7fbc9dd51640 1 -- 172.21.15.45:0/3411851968 shutdown_connections 2024-09-15T22:17:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.753+0000 7fbc9dd51640 1 -- 172.21.15.45:0/3411851968 wait complete. 2024-09-15T22:17:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.753+0000 7fbc9dd51640 1 Processor -- start 2024-09-15T22:17:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.753+0000 7fbc9dd51640 1 -- start start 2024-09-15T22:17:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc9dd51640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc98102dc0 0x7fbc98198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc9dd51640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc981036e0 0x7fbc98198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc9dd51640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc9810c160 0x7fbc9819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc9dd51640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbc981120d0 con 0x7fbc98102dc0 2024-09-15T22:17:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc9dd51640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbc98111f50 con 0x7fbc981036e0 2024-09-15T22:17:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc9dd51640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbc98112250 con 0x7fbc9810c160 2024-09-15T22:17:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc98102dc0 0x7fbc98198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc98102dc0 0x7fbc98198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36352/0 (socket says 172.21.15.45:36352) 2024-09-15T22:17:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc977fe640 1 -- 172.21.15.45:0/404789692 learned_addr learned my addr 172.21.15.45:0/404789692 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc97fff640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc9810c160 0x7fbc9819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc96ffd640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc981036e0 0x7fbc98198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc977fe640 1 -- 172.21.15.45:0/404789692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc9810c160 msgr2=0x7fbc9819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc977fe640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc9810c160 0x7fbc9819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc977fe640 1 -- 172.21.15.45:0/404789692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc981036e0 msgr2=0x7fbc98198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc977fe640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc981036e0 0x7fbc98198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc977fe640 1 -- 172.21.15.45:0/404789692 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9819d500 con 0x7fbc98102dc0 2024-09-15T22:17:51.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc96ffd640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc981036e0 0x7fbc98198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:51.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc977fe640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc98102dc0 0x7fbc98198550 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800b4a0 tx=0x7fbc8800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:51.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.754+0000 7fbc94ff9640 1 -- 172.21.15.45:0/404789692 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88014070 con 0x7fbc98102dc0 2024-09-15T22:17:51.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.755+0000 7fbc94ff9640 1 -- 172.21.15.45:0/404789692 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc88010b10 con 0x7fbc98102dc0 2024-09-15T22:17:51.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.755+0000 7fbc9dd51640 1 -- 172.21.15.45:0/404789692 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9819d7f0 con 0x7fbc98102dc0 2024-09-15T22:17:51.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.755+0000 7fbc94ff9640 1 -- 172.21.15.45:0/404789692 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88017d60 con 0x7fbc98102dc0 2024-09-15T22:17:51.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.755+0000 7fbc9dd51640 1 -- 172.21.15.45:0/404789692 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc981a50d0 con 0x7fbc98102dc0 2024-09-15T22:17:51.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.757+0000 7fbc94ff9640 1 -- 172.21.15.45:0/404789692 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fbc88017070 con 0x7fbc98102dc0 2024-09-15T22:17:51.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.757+0000 7fbca012a740 1 Processor -- start 2024-09-15T22:17:51.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.757+0000 7fbca012a740 1 -- start start 2024-09-15T22:17:51.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.757+0000 7fbca012a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832eb40 0x55e61832d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.757+0000 7fbca012a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832d5d0 0x55e61832da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.757+0000 7fbca012a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e61833a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.757+0000 7fbca012a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e6182932f0 con 0x55e618338370 2024-09-15T22:17:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.757+0000 7fbca012a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e61823acf0 con 0x55e61832eb40 2024-09-15T22:17:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.757+0000 7fbca012a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e61828f2b0 con 0x55e61832d5d0 2024-09-15T22:17:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832eb40 0x55e61832d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc94ff9640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbc800a3430 0x7fbc800a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832eb40 0x55e61832d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:51304/0 (socket says 172.21.15.45:51304) 2024-09-15T22:17:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc97fff640 1 -- 172.21.15.45:0/2480113017 learned_addr learned my addr 172.21.15.45:0/2480113017 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc96ffd640 1 --2- 172.21.15.45:0/2480113017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e61833a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc977fe640 1 --2- 172.21.15.45:0/2480113017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832d5d0 0x55e61832da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc97fff640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbc800a3430 0x7fbc800a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc94ff9640 1 -- 172.21.15.45:0/404789692 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fbc880cf3e0 con 0x7fbc98102dc0 2024-09-15T22:17:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc96ffd640 1 -- 172.21.15.45:0/2480113017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832d5d0 msgr2=0x55e61832da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc96ffd640 1 --2- 172.21.15.45:0/2480113017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832d5d0 0x55e61832da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.781 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc96ffd640 1 -- 172.21.15.45:0/2480113017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832eb40 msgr2=0x55e61832d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc96ffd640 1 --2- 172.21.15.45:0/2480113017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832eb40 0x55e61832d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc96ffd640 1 -- 172.21.15.45:0/2480113017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e61821f3a0 con 0x55e618338370 2024-09-15T22:17:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc97fff640 1 --2- 172.21.15.45:0/2480113017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832eb40 0x55e61832d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc96ffd640 1 --2- 172.21.15.45:0/2480113017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e61833a760 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c009b60 tx=0x7fbc8c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f23875dee90e53 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc97fff640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbc800a3430 0x7fbc800a58f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbc90030040 tx=0x7fbc9002a950 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc7dffb640 1 -- 172.21.15.45:0/2480113017 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c016070 con 0x55e618338370 2024-09-15T22:17:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc7dffb640 1 -- 172.21.15.45:0/2480113017 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc8c005520 con 0x55e618338370 2024-09-15T22:17:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.758+0000 7fbc7dffb640 1 -- 172.21.15.45:0/2480113017 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c011470 con 0x55e618338370 2024-09-15T22:17:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.759+0000 7fbca012a740 1 -- 172.21.15.45:0/2480113017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 msgr2=0x55e61833a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.759+0000 7fbca012a740 1 --2- 172.21.15.45:0/2480113017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e61833a760 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c009b60 tx=0x7fbc8c009f60 comp rx=0 tx=0).stop 2024-09-15T22:17:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.759+0000 7fbca012a740 1 -- 172.21.15.45:0/2480113017 shutdown_connections 2024-09-15T22:17:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.759+0000 7fbca012a740 1 --2- 172.21.15.45:0/2480113017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e61833a760 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.759+0000 7fbca012a740 1 --2- 172.21.15.45:0/2480113017 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832d5d0 0x55e61832da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.759+0000 7fbca012a740 1 --2- 172.21.15.45:0/2480113017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832eb40 0x55e61832d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.759+0000 7fbca012a740 1 -- 172.21.15.45:0/2480113017 >> 172.21.15.45:0/2480113017 conn(0x55e6182f6310 msgr2=0x55e618329c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.759+0000 7fbca012a740 1 -- 172.21.15.45:0/2480113017 shutdown_connections 2024-09-15T22:17:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.759+0000 7fbca012a740 1 -- 172.21.15.45:0/2480113017 wait complete. 2024-09-15T22:17:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbca012a740 1 -- start start 2024-09-15T22:17:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbca012a740 1 Processor -- start 2024-09-15T22:17:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbca012a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832d5d0 0x55e618337d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbca012a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832eb40 0x55e618334fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbca012a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e618335570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbca012a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e61833b070 con 0x55e618338370 2024-09-15T22:17:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbca012a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e61824e060 con 0x55e61832d5d0 2024-09-15T22:17:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbca012a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e61833b1f0 con 0x55e61832eb40 2024-09-15T22:17:51.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e618335570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbca012a740 10 client.0 _ll_register_callbacks cb 0x55e617fa18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e618335570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36384/0 (socket says 172.21.15.45:36384) 2024-09-15T22:17:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbc97fff640 1 -- 172.21.15.45:0/1673255427 learned_addr learned my addr 172.21.15.45:0/1673255427 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbc977fe640 1 --2- 172.21.15.45:0/1673255427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832d5d0 0x55e618337d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.760+0000 7fbc96ffd640 1 --2- 172.21.15.45:0/1673255427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832eb40 0x55e618334fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.761+0000 7fbc97fff640 1 -- 172.21.15.45:0/1673255427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832eb40 msgr2=0x55e618334fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.761+0000 7fbc97fff640 1 --2- 172.21.15.45:0/1673255427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832eb40 0x55e618334fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.761+0000 7fbc97fff640 1 -- 172.21.15.45:0/1673255427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832d5d0 msgr2=0x55e618337d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.761+0000 7fbc97fff640 1 --2- 172.21.15.45:0/1673255427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832d5d0 0x55e618337d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.761+0000 7fbc97fff640 1 -- 172.21.15.45:0/1673255427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6180043c0 con 0x55e618338370 2024-09-15T22:17:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.761+0000 7fbc97fff640 1 --2- 172.21.15.45:0/1673255427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e618335570 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbc90003bf0 tx=0x7fbc900095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a2915dbf62daf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.761+0000 7fbc76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:51.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.761+0000 7fbc76ffd640 1 -- 172.21.15.45:0/1673255427 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc90034040 con 0x55e618338370 2024-09-15T22:17:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.761+0000 7fbc76ffd640 1 -- 172.21.15.45:0/1673255427 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fbc90004640 con 0x55e618338370 2024-09-15T22:17:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.761+0000 7fbca012a740 1 -- 172.21.15.45:0/1673255427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc8c005520 con 0x55e618338370 2024-09-15T22:17:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.761+0000 7fbc76ffd640 1 -- 172.21.15.45:0/1673255427 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbc90004840 con 0x55e618338370 2024-09-15T22:17:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.761+0000 7fbca012a740 10 client.15795 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.761+0000 7fbca012a740 1 -- 172.21.15.45:0/1673255427 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e618346ac0 con 0x55e618338370 2024-09-15T22:17:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.762+0000 7fbc76ffd640 1 -- 172.21.15.45:0/1673255427 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc8c005520 con 0x55e618338370 2024-09-15T22:17:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.762+0000 7fbc76ffd640 1 -- 172.21.15.45:0/1673255427 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbc9003a690 con 0x55e618338370 2024-09-15T22:17:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.762+0000 7fbca012a740 10 client.15795 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.762+0000 7fbca012a740 10 client.15795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.762+0000 7fbca012a740 20 client.15795 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.762+0000 7fbca012a740 1 --2- 172.21.15.45:0/1673255427 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e618347f80 0x55e61834a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.762+0000 7fbca012a740 4 client.15795 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:51.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.762+0000 7fbca012a740 1 -- 172.21.15.45:0/1673255427 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6182a0860 con 0x55e618347f80 2024-09-15T22:17:51.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.762+0000 7fbc977fe640 1 --2- 172.21.15.45:0/1673255427 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e618347f80 0x55e61834a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.762+0000 7fbc977fe640 1 --2- 172.21.15.45:0/1673255427 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e618347f80 0x55e61834a400 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fa6b8cd36c3587e server_cookie=376d824c0f554a1f in_seq=0 out_seq=0 2024-09-15T22:17:51.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.762+0000 7fbc76ffd640 10 client.15795 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:51.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbc76ffd640 1 -- 172.21.15.45:0/1673255427 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6182a0860 con 0x55e618347f80 2024-09-15T22:17:51.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbc76ffd640 10 client.15795 handle_command_reply: tid=0 2024-09-15T22:17:51.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbca012a740 1 client.15795 shutdown 2024-09-15T22:17:51.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbca012a740 1 -- 172.21.15.45:0/1673255427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 msgr2=0x55e618335570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:51.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbca012a740 1 --2- 172.21.15.45:0/1673255427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e618335570 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fbc90003bf0 tx=0x7fbc900095c0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbca012a740 1 -- 172.21.15.45:0/1673255427 shutdown_connections 2024-09-15T22:17:51.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbca012a740 1 --2- 172.21.15.45:0/1673255427 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e618347f80 0x55e61834a400 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbca012a740 1 --2- 172.21.15.45:0/1673255427 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e618335570 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbc76ffd640 0 client.15795 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:51.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbca012a740 1 --2- 172.21.15.45:0/1673255427 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832eb40 0x55e618334fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbca012a740 1 --2- 172.21.15.45:0/1673255427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832d5d0 0x55e618337d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbca012a740 1 -- 172.21.15.45:0/1673255427 >> 172.21.15.45:0/1673255427 conn(0x55e6182f6310 msgr2=0x55e61832f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:51.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbca012a740 1 -- 172.21.15.45:0/1673255427 shutdown_connections 2024-09-15T22:17:51.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.763+0000 7fbca012a740 1 -- 172.21.15.45:0/1673255427 wait complete. 2024-09-15T22:17:51.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.764+0000 7fbca012a740 20 client.15795 trim_cache size 0 max 16384 2024-09-15T22:17:51.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.776+0000 7fbca012a740 1 Processor -- start 2024-09-15T22:17:51.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbca012a740 1 -- start start 2024-09-15T22:17:51.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbca012a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e61832d5d0 0x55e618336f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbca012a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832eb40 0x55e618340860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbca012a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e618338370 0x55e618340da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbca012a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbc981ad260 con 0x55e61832d5d0 2024-09-15T22:17:51.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbca012a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbc981afae0 con 0x55e618338370 2024-09-15T22:17:51.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbca012a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbc981ad8d0 con 0x55e61832eb40 2024-09-15T22:17:51.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbc977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e61832d5d0 0x55e618336f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbc977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e61832d5d0 0x55e618336f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36394/0 (socket says 172.21.15.45:36394) 2024-09-15T22:17:51.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbc977fe640 1 -- 172.21.15.45:0/1645202124 learned_addr learned my addr 172.21.15.45:0/1645202124 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:51.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbc96ffd640 1 --2- 172.21.15.45:0/1645202124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832eb40 0x55e618340860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbc97fff640 1 --2- 172.21.15.45:0/1645202124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e618338370 0x55e618340da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbc977fe640 1 -- 172.21.15.45:0/1645202124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832eb40 msgr2=0x55e618340860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbc977fe640 1 --2- 172.21.15.45:0/1645202124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832eb40 0x55e618340860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbc977fe640 1 -- 172.21.15.45:0/1645202124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e618338370 msgr2=0x55e618340da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbc977fe640 1 --2- 172.21.15.45:0/1645202124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e618338370 0x55e618340da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbc977fe640 1 -- 172.21.15.45:0/1645202124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e61834aa80 con 0x55e61832d5d0 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbc97fff640 1 --2- 172.21.15.45:0/1645202124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e618338370 0x55e618340da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.777+0000 7fbc977fe640 1 --2- 172.21.15.45:0/1645202124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e61832d5d0 0x55e618336f40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800be60 tx=0x7fbc880d1830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac671b5818cead78 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.778+0000 7fbc7d7fa640 1 -- 172.21.15.45:0/1645202124 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc880cce60 con 0x55e61832d5d0 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.778+0000 7fbc7d7fa640 1 -- 172.21.15.45:0/1645202124 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc880cf120 con 0x55e61832d5d0 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.778+0000 7fbc7d7fa640 1 -- 172.21.15.45:0/1645202124 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8801e040 con 0x55e61832d5d0 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.778+0000 7fbca012a740 1 -- 172.21.15.45:0/1645202124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e61832d5d0 msgr2=0x55e618336f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.778+0000 7fbca012a740 1 --2- 172.21.15.45:0/1645202124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e61832d5d0 0x55e618336f40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800be60 tx=0x7fbc880d1830 comp rx=0 tx=0).stop 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.778+0000 7fbca012a740 1 -- 172.21.15.45:0/1645202124 shutdown_connections 2024-09-15T22:17:51.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.778+0000 7fbca012a740 1 --2- 172.21.15.45:0/1645202124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e618338370 0x55e618340da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.778+0000 7fbca012a740 1 --2- 172.21.15.45:0/1645202124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832eb40 0x55e618340860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.778+0000 7fbca012a740 1 --2- 172.21.15.45:0/1645202124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e61832d5d0 0x55e618336f40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.778+0000 7fbca012a740 1 -- 172.21.15.45:0/1645202124 >> 172.21.15.45:0/1645202124 conn(0x55e6182f6310 msgr2=0x55e618336830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.778+0000 7fbca012a740 1 -- 172.21.15.45:0/1645202124 shutdown_connections 2024-09-15T22:17:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.778+0000 7fbca012a740 1 -- 172.21.15.45:0/1645202124 wait complete. 2024-09-15T22:17:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.779+0000 7fbca012a740 1 -- start start 2024-09-15T22:17:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.779+0000 7fbca012a740 1 Processor -- start 2024-09-15T22:17:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.779+0000 7fbca012a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832d5d0 0x55e618332620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.779+0000 7fbca012a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832eb40 0x55e618332b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.779+0000 7fbca012a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e6183312a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.779+0000 7fbca012a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbc981adfa0 con 0x55e618338370 2024-09-15T22:17:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.779+0000 7fbca012a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbc981af410 con 0x55e61832eb40 2024-09-15T22:17:51.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.779+0000 7fbca012a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbc981ae670 con 0x55e61832d5d0 2024-09-15T22:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.779+0000 7fbca012a740 10 client.0 _ll_register_callbacks cb 0x7fbc9002fc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.779+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e6183312a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.779+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e6183312a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36400/0 (socket says 172.21.15.45:36400) 2024-09-15T22:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.779+0000 7fbc97fff640 1 -- 172.21.15.45:0/339525379 learned_addr learned my addr 172.21.15.45:0/339525379 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.779+0000 7fbc977fe640 1 --2- 172.21.15.45:0/339525379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832d5d0 0x55e618332620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbc96ffd640 1 --2- 172.21.15.45:0/339525379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832eb40 0x55e618332b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbc97fff640 1 -- 172.21.15.45:0/339525379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832d5d0 msgr2=0x55e618332620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbc97fff640 1 --2- 172.21.15.45:0/339525379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832d5d0 0x55e618332620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbc97fff640 1 -- 172.21.15.45:0/339525379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832eb40 msgr2=0x55e618332b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbc97fff640 1 --2- 172.21.15.45:0/339525379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832eb40 0x55e618332b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbc97fff640 1 -- 172.21.15.45:0/339525379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e618331ad0 con 0x55e618338370 2024-09-15T22:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbc97fff640 1 --2- 172.21.15.45:0/339525379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e6183312a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbc9002ae70 tx=0x7fbc900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7cc3dc944e278a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:51.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbc76ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbc76ffd640 1 -- 172.21.15.45:0/339525379 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9002f7d0 con 0x55e618338370 2024-09-15T22:17:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbc76ffd640 1 -- 172.21.15.45:0/339525379 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fbc9003a840 con 0x55e618338370 2024-09-15T22:17:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbca012a740 1 -- 172.21.15.45:0/339525379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc880cf120 con 0x55e618338370 2024-09-15T22:17:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbc76ffd640 1 -- 172.21.15.45:0/339525379 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbc90030440 con 0x55e618338370 2024-09-15T22:17:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbca012a740 10 client.15801 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.780+0000 7fbca012a740 1 -- 172.21.15.45:0/339525379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e6183b7800 con 0x55e618338370 2024-09-15T22:17:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.781+0000 7fbc76ffd640 1 -- 172.21.15.45:0/339525379 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbc880cf120 con 0x55e618338370 2024-09-15T22:17:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.781+0000 7fbc76ffd640 1 -- 172.21.15.45:0/339525379 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbc90066030 con 0x55e618338370 2024-09-15T22:17:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.781+0000 7fbca012a740 10 client.15801 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.781+0000 7fbca012a740 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.781+0000 7fbca012a740 20 client.15801 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.781+0000 7fbca012a740 1 --2- 172.21.15.45:0/339525379 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e6183b7f40 0x55e6183ba360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:51.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.781+0000 7fbca012a740 4 client.15801 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.781+0000 7fbca012a740 1 -- 172.21.15.45:0/339525379 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e61829ad70 con 0x55e6183b7f40 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.781+0000 7fbc977fe640 1 --2- 172.21.15.45:0/339525379 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e6183b7f40 0x55e6183ba360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbc76ffd640 10 client.15801 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbc977fe640 1 --2- 172.21.15.45:0/339525379 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e6183b7f40 0x55e6183ba360 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17c1815de322d931 server_cookie=3e4bda66d2b099f9 in_seq=0 out_seq=0 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbc76ffd640 1 -- 172.21.15.45:0/339525379 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e61829ad70 con 0x55e6183b7f40 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbc76ffd640 10 client.15801 handle_command_reply: tid=0 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbca012a740 1 client.15801 shutdown 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbca012a740 1 -- 172.21.15.45:0/339525379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 msgr2=0x55e6183312a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbca012a740 1 --2- 172.21.15.45:0/339525379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e6183312a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbc9002ae70 tx=0x7fbc900046c0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbca012a740 1 -- 172.21.15.45:0/339525379 shutdown_connections 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbca012a740 1 --2- 172.21.15.45:0/339525379 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e6183b7f40 0x55e6183ba360 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbca012a740 1 --2- 172.21.15.45:0/339525379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e618338370 0x55e6183312a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbca012a740 1 --2- 172.21.15.45:0/339525379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e61832eb40 0x55e618332b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbca012a740 1 --2- 172.21.15.45:0/339525379 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e61832d5d0 0x55e618332620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbca012a740 1 -- 172.21.15.45:0/339525379 >> 172.21.15.45:0/339525379 conn(0x55e6182f6310 msgr2=0x55e618328d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:51.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbc76ffd640 0 client.15801 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:51.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbca012a740 1 -- 172.21.15.45:0/339525379 shutdown_connections 2024-09-15T22:17:51.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbca012a740 1 -- 172.21.15.45:0/339525379 wait complete. 2024-09-15T22:17:51.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.782+0000 7fbca012a740 20 client.15801 trim_cache size 0 max 16384 2024-09-15T22:17:51.798 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:17:51.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.783+0000 7fbc9dd51640 1 -- 172.21.15.45:0/404789692 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbc800a3430 msgr2=0x7fbc800a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:51.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.783+0000 7fbc9dd51640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbc800a3430 0x7fbc800a58f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbc90030040 tx=0x7fbc9002a950 comp rx=0 tx=0).stop 2024-09-15T22:17:51.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.783+0000 7fbc9dd51640 1 -- 172.21.15.45:0/404789692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc98102dc0 msgr2=0x7fbc98198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:51.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.783+0000 7fbc9dd51640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc98102dc0 0x7fbc98198550 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800b4a0 tx=0x7fbc8800b960 comp rx=0 tx=0).stop 2024-09-15T22:17:51.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.783+0000 7fbc9dd51640 1 -- 172.21.15.45:0/404789692 shutdown_connections 2024-09-15T22:17:51.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.783+0000 7fbc9dd51640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbc800a3430 0x7fbc800a58f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.783+0000 7fbc9dd51640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbc9810c160 0x7fbc9819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.783+0000 7fbc9dd51640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc981036e0 0x7fbc98198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.783+0000 7fbc9dd51640 1 --2- 172.21.15.45:0/404789692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc98102dc0 0x7fbc98198550 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:51.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.783+0000 7fbc9dd51640 1 -- 172.21.15.45:0/404789692 >> 172.21.15.45:0/404789692 conn(0x7fbc980fc780 msgr2=0x7fbc980fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:51.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.783+0000 7fbc9dd51640 1 -- 172.21.15.45:0/404789692 shutdown_connections 2024-09-15T22:17:51.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:51.783+0000 7fbc9dd51640 1 -- 172.21.15.45:0/404789692 wait complete. 2024-09-15T22:17:52.382 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-15T22:17:52.383 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-15T22:17:52.384 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-15T22:17:52.385 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-15T22:17:52.385 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-15T22:17:52.386 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-15T22:17:52.387 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-15T22:17:52.388 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-15T22:17:52.389 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-15T22:17:52.390 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-15T22:17:52.391 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-15T22:17:52.392 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-15T22:17:52.393 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-15T22:17:52.394 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-15T22:17:52.395 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-15T22:17:52.396 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-15T22:17:52.397 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-15T22:17:52.397 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-15T22:17:52.398 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-15T22:17:52.399 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-15T22:17:52.401 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-15T22:17:52.402 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-15T22:17:52.402 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-15T22:17:52.403 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-15T22:17:52.404 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-15T22:17:52.405 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-15T22:17:52.406 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-15T22:17:52.407 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-15T22:17:52.408 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-15T22:17:52.409 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-15T22:17:52.409 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-15T22:17:52.410 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-15T22:17:52.411 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-15T22:17:52.412 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-15T22:17:52.413 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-15T22:17:52.413 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-15T22:17:52.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-15T22:17:52.415 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-15T22:17:52.416 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-15T22:17:52.417 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-15T22:17:52.418 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-15T22:17:52.419 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-15T22:17:52.420 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-15T22:17:52.421 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-15T22:17:52.422 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-15T22:17:52.423 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-15T22:17:52.424 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-15T22:17:52.425 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-15T22:17:52.425 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-15T22:17:52.426 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-15T22:17:52.427 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-15T22:17:52.428 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-15T22:17:52.429 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-15T22:17:52.430 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-15T22:17:52.431 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-15T22:17:52.432 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-15T22:17:52.433 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-15T22:17:52.434 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-15T22:17:52.434 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-15T22:17:52.435 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-15T22:17:52.436 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-15T22:17:52.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-15T22:17:52.438 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-15T22:17:52.439 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/Changes 2024-09-15T22:17:52.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-15T22:17:52.441 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-15T22:17:52.441 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-15T22:17:52.442 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-15T22:17:52.444 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-15T22:17:52.445 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-15T22:17:52.446 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-15T22:17:52.448 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-15T22:17:52.448 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-15T22:17:52.448 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-15T22:17:52.449 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-15T22:17:52.451 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-15T22:17:52.451 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-15T22:17:52.452 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-15T22:17:52.453 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-15T22:17:52.454 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-15T22:17:52.456 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-15T22:17:52.457 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-15T22:17:52.458 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-15T22:17:52.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-15T22:17:52.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-15T22:17:52.460 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-15T22:17:52.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-15T22:17:52.462 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-15T22:17:52.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-15T22:17:52.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-15T22:17:52.464 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-15T22:17:52.465 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-15T22:17:52.466 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-15T22:17:52.467 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-15T22:17:52.467 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-15T22:17:52.468 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-15T22:17:52.469 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-15T22:17:52.470 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-15T22:17:52.471 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-15T22:17:52.472 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-15T22:17:52.473 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-15T22:17:52.474 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-15T22:17:52.475 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-15T22:17:52.476 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-15T22:17:52.477 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-15T22:17:52.478 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-15T22:17:52.479 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-15T22:17:52.480 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-15T22:17:52.481 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-15T22:17:52.482 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-15T22:17:52.483 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-15T22:17:52.485 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-15T22:17:52.486 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-15T22:17:52.487 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-15T22:17:52.488 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-15T22:17:52.489 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-15T22:17:52.490 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-15T22:17:52.491 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-15T22:17:52.492 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-15T22:17:52.493 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-15T22:17:52.494 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-15T22:17:52.495 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-15T22:17:52.496 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-15T22:17:52.498 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-15T22:17:52.499 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-15T22:17:52.500 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-15T22:17:52.501 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-15T22:17:52.502 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-15T22:17:52.503 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-15T22:17:52.504 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-15T22:17:52.504 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-15T22:17:52.505 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-15T22:17:52.506 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-15T22:17:52.507 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-15T22:17:52.508 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-15T22:17:52.509 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-15T22:17:52.509 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-15T22:17:52.510 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-15T22:17:52.511 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-15T22:17:52.512 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-15T22:17:52.513 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-15T22:17:52.514 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-15T22:17:52.515 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-15T22:17:52.515 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-15T22:17:52.516 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-15T22:17:52.517 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-15T22:17:52.518 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-15T22:17:52.519 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-15T22:17:52.520 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-15T22:17:52.521 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-15T22:17:52.522 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-15T22:17:52.523 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-15T22:17:52.523 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-15T22:17:52.524 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-15T22:17:52.525 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-15T22:17:52.526 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-15T22:17:52.527 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-15T22:17:52.528 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-15T22:17:52.529 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-15T22:17:52.530 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-15T22:17:52.531 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-15T22:17:52.532 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-15T22:17:52.533 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-15T22:17:52.533 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-15T22:17:52.534 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-15T22:17:52.535 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-15T22:17:52.536 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-15T22:17:52.537 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-15T22:17:52.537 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-15T22:17:52.541 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-15T22:17:52.541 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-15T22:17:52.541 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-15T22:17:52.541 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-15T22:17:52.542 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-15T22:17:52.543 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-15T22:17:52.544 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-15T22:17:52.545 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-15T22:17:52.545 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-15T22:17:52.546 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-15T22:17:52.547 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-15T22:17:52.548 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-15T22:17:52.549 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-15T22:17:52.550 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-15T22:17:52.551 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-15T22:17:52.552 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-15T22:17:52.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-15T22:17:52.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-15T22:17:52.554 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-15T22:17:52.555 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-15T22:17:52.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-15T22:17:52.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-15T22:17:52.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-15T22:17:52.558 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-15T22:17:52.559 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-15T22:17:52.560 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-15T22:17:52.561 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-15T22:17:52.561 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-15T22:17:52.562 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-15T22:17:52.563 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-15T22:17:52.564 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-15T22:17:52.565 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-15T22:17:52.566 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-15T22:17:52.567 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-15T22:17:52.567 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-15T22:17:52.568 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-15T22:17:52.569 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-15T22:17:52.570 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-15T22:17:52.571 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-15T22:17:52.571 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-15T22:17:52.572 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-15T22:17:52.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-15T22:17:52.574 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-15T22:17:52.575 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-15T22:17:52.576 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-15T22:17:52.577 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-15T22:17:52.577 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-15T22:17:52.578 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-15T22:17:52.579 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-15T22:17:52.580 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-15T22:17:52.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-15T22:17:52.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-15T22:17:52.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-15T22:17:52.583 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-15T22:17:52.584 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-15T22:17:52.585 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-15T22:17:52.585 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-15T22:17:52.586 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-15T22:17:52.587 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-15T22:17:52.588 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-15T22:17:52.589 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-15T22:17:52.590 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-15T22:17:52.591 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-15T22:17:52.591 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-15T22:17:52.592 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-15T22:17:52.593 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-15T22:17:52.594 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-15T22:17:52.595 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-15T22:17:52.596 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-15T22:17:52.597 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-15T22:17:52.598 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-15T22:17:52.599 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-15T22:17:52.600 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-15T22:17:52.601 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-15T22:17:52.601 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-15T22:17:52.602 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-15T22:17:52.603 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-15T22:17:52.604 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-15T22:17:52.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-15T22:17:52.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-15T22:17:52.607 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-15T22:17:52.608 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-15T22:17:52.609 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-15T22:17:52.610 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-15T22:17:52.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-15T22:17:52.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-15T22:17:52.612 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-15T22:17:52.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-15T22:17:52.614 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-15T22:17:52.615 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-15T22:17:52.616 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-15T22:17:52.617 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-15T22:17:52.618 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-15T22:17:52.619 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-15T22:17:52.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-15T22:17:52.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-15T22:17:52.622 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-15T22:17:52.622 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-15T22:17:52.623 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-15T22:17:52.624 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-15T22:17:52.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:52 smithi045 ceph-mon[31180]: pgmap v52: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-15T22:17:52.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:52 smithi165 ceph-mon[35551]: pgmap v52: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-15T22:17:52.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:52 smithi100 ceph-mon[35319]: pgmap v52: 129 pgs: 129 active+clean; 1.3 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 341 B/s wr, 2 op/s 2024-09-15T22:17:53.586 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:17:53.586 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:17:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:54.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.405+0000 7f53893ba640 1 -- 172.21.15.45:0/678672112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5384102790 msgr2=0x7f53841067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:54.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.405+0000 7f53893ba640 1 --2- 172.21.15.45:0/678672112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5384102790 0x7f53841067e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5378009900 tx=0x7f537802a410 comp rx=0 tx=0).stop 2024-09-15T22:17:54.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.405+0000 7f53893ba640 1 -- 172.21.15.45:0/678672112 shutdown_connections 2024-09-15T22:17:54.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.405+0000 7f53893ba640 1 --2- 172.21.15.45:0/678672112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384106f10 0x7f538410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.405+0000 7f53893ba640 1 --2- 172.21.15.45:0/678672112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5384102790 0x7f53841067e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.405+0000 7f53893ba640 1 --2- 172.21.15.45:0/678672112 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5384101de0 0x7f53841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.405+0000 7f53893ba640 1 -- 172.21.15.45:0/678672112 >> 172.21.15.45:0/678672112 conn(0x7f53840fd8c0 msgr2=0x7f53840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.406+0000 7f53893ba640 1 -- 172.21.15.45:0/678672112 shutdown_connections 2024-09-15T22:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.406+0000 7f53893ba640 1 -- 172.21.15.45:0/678672112 wait complete. 2024-09-15T22:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.406+0000 7f53893ba640 1 Processor -- start 2024-09-15T22:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f53893ba640 1 -- start start 2024-09-15T22:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f53893ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5384101de0 0x7f5384198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f53893ba640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5384102790 0x7f5384198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f53893ba640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384106f10 0x7f538419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f53893ba640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5384112090 con 0x7f5384101de0 2024-09-15T22:17:54.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f53893ba640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5384111f10 con 0x7f5384106f10 2024-09-15T22:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f53893ba640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5384112210 con 0x7f5384102790 2024-09-15T22:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f5382ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5384101de0 0x7f5384198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f5382ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5384101de0 0x7f5384198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40924/0 (socket says 172.21.15.45:40924) 2024-09-15T22:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f53837fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384106f10 0x7f538419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f5382ffd640 1 -- 172.21.15.45:0/2832341403 learned_addr learned my addr 172.21.15.45:0/2832341403 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f53827fc640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5384102790 0x7f5384198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f5382ffd640 1 -- 172.21.15.45:0/2832341403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5384102790 msgr2=0x7f5384198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:54.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f5382ffd640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5384102790 0x7f5384198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f5382ffd640 1 -- 172.21.15.45:0/2832341403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384106f10 msgr2=0x7f538419ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f5382ffd640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384106f10 0x7f538419ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f5382ffd640 1 -- 172.21.15.45:0/2832341403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538419d540 con 0x7f5384101de0 2024-09-15T22:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f53837fe640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384106f10 0x7f538419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.407+0000 7f5382ffd640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5384101de0 0x7f5384198590 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f537400eb90 tx=0x7f537400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.408+0000 7f536bfff640 1 -- 172.21.15.45:0/2832341403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5374004d20 con 0x7f5384101de0 2024-09-15T22:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.408+0000 7f536bfff640 1 -- 172.21.15.45:0/2832341403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f537400ee90 con 0x7f5384101de0 2024-09-15T22:17:54.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.408+0000 7f53893ba640 1 -- 172.21.15.45:0/2832341403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538419d830 con 0x7f5384101de0 2024-09-15T22:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.408+0000 7f536bfff640 1 -- 172.21.15.45:0/2832341403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53740108b0 con 0x7f5384101de0 2024-09-15T22:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.408+0000 7f53893ba640 1 -- 172.21.15.45:0/2832341403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53841a5110 con 0x7f5384101de0 2024-09-15T22:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.410+0000 7f536bfff640 1 -- 172.21.15.45:0/2832341403 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5374005020 con 0x7f5384101de0 2024-09-15T22:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.410+0000 7f538b793740 1 Processor -- start 2024-09-15T22:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.410+0000 7f538b793740 1 -- start start 2024-09-15T22:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f538b793740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97876b60 0x561f97876f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f538b793740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97881800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f538b793740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97881d40 0x561f97884130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f538b793740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561f977dc280 con 0x561f97877480 2024-09-15T22:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f538b793740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561f97783b10 con 0x561f97881d40 2024-09-15T22:17:54.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f538b793740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561f977d8240 con 0x561f97876b60 2024-09-15T22:17:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f536bfff640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f536c0a3430 0x7f536c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f5382ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97881800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f5382ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97881800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40928/0 (socket says 172.21.15.45:40928) 2024-09-15T22:17:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f5382ffd640 1 -- 172.21.15.45:0/2997739668 learned_addr learned my addr 172.21.15.45:0/2997739668 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f53837fe640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f536c0a3430 0x7f536c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f53827fc640 1 --2- 172.21.15.45:0/2997739668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97881d40 0x561f97884130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f53837fe640 1 --2- 172.21.15.45:0/2997739668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97876b60 0x561f97876f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f536bfff640 1 -- 172.21.15.45:0/2832341403 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f53740d0770 con 0x7f5384101de0 2024-09-15T22:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f5382ffd640 1 -- 172.21.15.45:0/2997739668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97876b60 msgr2=0x561f97876f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f5382ffd640 1 --2- 172.21.15.45:0/2997739668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97876b60 0x561f97876f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f5382ffd640 1 -- 172.21.15.45:0/2997739668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97881d40 msgr2=0x561f97884130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f5382ffd640 1 --2- 172.21.15.45:0/2997739668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97881d40 0x561f97884130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f5382ffd640 1 -- 172.21.15.45:0/2997739668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f977901f0 con 0x561f97877480 2024-09-15T22:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f5382ffd640 1 --2- 172.21.15.45:0/2997739668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97881800 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f537409c850 tx=0x7f5374005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30cea395d99e5f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:54.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.411+0000 7f53837fe640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f536c0a3430 0x7f536c0a58f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f537c011890 tx=0x7f537c009c80 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.412+0000 7f53697fa640 1 -- 172.21.15.45:0/2997739668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537409bff0 con 0x561f97877480 2024-09-15T22:17:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.412+0000 7f53697fa640 1 -- 172.21.15.45:0/2997739668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f537409cd90 con 0x561f97877480 2024-09-15T22:17:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.412+0000 7f53697fa640 1 -- 172.21.15.45:0/2997739668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537409c690 con 0x561f97877480 2024-09-15T22:17:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.412+0000 7f538b793740 1 -- 172.21.15.45:0/2997739668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 msgr2=0x561f97881800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.412+0000 7f538b793740 1 --2- 172.21.15.45:0/2997739668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97881800 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f537409c850 tx=0x7f5374005a10 comp rx=0 tx=0).stop 2024-09-15T22:17:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.412+0000 7f538b793740 1 -- 172.21.15.45:0/2997739668 shutdown_connections 2024-09-15T22:17:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.412+0000 7f538b793740 1 --2- 172.21.15.45:0/2997739668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97881d40 0x561f97884130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.412+0000 7f538b793740 1 --2- 172.21.15.45:0/2997739668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97881800 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.412+0000 7f538b793740 1 --2- 172.21.15.45:0/2997739668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97876b60 0x561f97876f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.412+0000 7f538b793740 1 -- 172.21.15.45:0/2997739668 >> 172.21.15.45:0/2997739668 conn(0x561f978730f0 msgr2=0x561f978734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.412+0000 7f538b793740 1 -- 172.21.15.45:0/2997739668 shutdown_connections 2024-09-15T22:17:54.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.412+0000 7f538b793740 1 -- 172.21.15.45:0/2997739668 wait complete. 2024-09-15T22:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f538b793740 1 -- start start 2024-09-15T22:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f538b793740 1 Processor -- start 2024-09-15T22:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f538b793740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97876b60 0x561f9787ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f538b793740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f9787f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f538b793740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97881d40 0x561f9787f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f538b793740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561f97884910 con 0x561f97877480 2024-09-15T22:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f538b793740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561f97796f10 con 0x561f97876b60 2024-09-15T22:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f538b793740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561f97884a90 con 0x561f97881d40 2024-09-15T22:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f538b793740 10 client.0 _ll_register_callbacks cb 0x561f9775fa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:54.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f53827fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f9787f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f53827fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f9787f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40934/0 (socket says 172.21.15.45:40934) 2024-09-15T22:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f5382ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97876b60 0x561f9787ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f53827fc640 1 -- 172.21.15.45:0/3497623961 learned_addr learned my addr 172.21.15.45:0/3497623961 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.413+0000 7f53837fe640 1 --2- 172.21.15.45:0/3497623961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97881d40 0x561f9787f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f53827fc640 1 -- 172.21.15.45:0/3497623961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97881d40 msgr2=0x561f9787f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f53827fc640 1 --2- 172.21.15.45:0/3497623961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97881d40 0x561f9787f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f53827fc640 1 -- 172.21.15.45:0/3497623961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97876b60 msgr2=0x561f9787ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:54.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f53827fc640 1 --2- 172.21.15.45:0/3497623961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97876b60 0x561f9787ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f53827fc640 1 -- 172.21.15.45:0/3497623961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f9754d6a0 con 0x561f97877480 2024-09-15T22:17:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f5382ffd640 1 --2- 172.21.15.45:0/3497623961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97876b60 0x561f9787ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f53827fc640 1 --2- 172.21.15.45:0/3497623961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f9787f190 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5378009900 tx=0x7f5378031870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25afff187469f08a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f5366ff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f5366ff5640 1 -- 172.21.15.45:0/3497623961 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378035040 con 0x561f97877480 2024-09-15T22:17:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f5366ff5640 1 -- 172.21.15.45:0/3497623961 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f5378004460 con 0x561f97877480 2024-09-15T22:17:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f538b793740 1 -- 172.21.15.45:0/3497623961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f537409cd90 con 0x561f97877480 2024-09-15T22:17:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f5366ff5640 1 -- 172.21.15.45:0/3497623961 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f537804d050 con 0x561f97877480 2024-09-15T22:17:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f538b793740 10 client.15813 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f538b793740 1 -- 172.21.15.45:0/3497623961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561f97890540 con 0x561f97877480 2024-09-15T22:17:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.414+0000 7f5366ff5640 1 -- 172.21.15.45:0/3497623961 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f537409cd90 con 0x561f97877480 2024-09-15T22:17:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.415+0000 7f5366ff5640 1 -- 172.21.15.45:0/3497623961 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5378004c50 con 0x561f97877480 2024-09-15T22:17:54.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.415+0000 7f538b793740 10 client.15813 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:54.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.415+0000 7f538b793740 10 client.15813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:54.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.415+0000 7f538b793740 20 client.15813 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:54.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.415+0000 7f538b793740 1 --2- 172.21.15.45:0/3497623961 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f97891a00 0x561f97893e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.415+0000 7f538b793740 4 client.15813 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:54.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.415+0000 7f538b793740 1 -- 172.21.15.45:0/3497623961 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f977e97f0 con 0x561f97891a00 2024-09-15T22:17:54.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.415+0000 7f5382ffd640 1 --2- 172.21.15.45:0/3497623961 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f97891a00 0x561f97893e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.415+0000 7f5366ff5640 10 client.15813 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:54.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.415+0000 7f5382ffd640 1 --2- 172.21.15.45:0/3497623961 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f97891a00 0x561f97893e10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69d22fc52535947 server_cookie=d4744a816bc13859 in_seq=0 out_seq=0 2024-09-15T22:17:54.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f5366ff5640 1 -- 172.21.15.45:0/3497623961 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f977e97f0 con 0x561f97891a00 2024-09-15T22:17:54.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f5366ff5640 10 client.15813 handle_command_reply: tid=0 2024-09-15T22:17:54.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f538b793740 1 client.15813 shutdown 2024-09-15T22:17:54.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f538b793740 1 -- 172.21.15.45:0/3497623961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 msgr2=0x561f9787f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:54.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f538b793740 1 --2- 172.21.15.45:0/3497623961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f9787f190 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5378009900 tx=0x7f5378031870 comp rx=0 tx=0).stop 2024-09-15T22:17:54.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f538b793740 1 -- 172.21.15.45:0/3497623961 shutdown_connections 2024-09-15T22:17:54.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f538b793740 1 --2- 172.21.15.45:0/3497623961 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f97891a00 0x561f97893e10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f538b793740 1 --2- 172.21.15.45:0/3497623961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97881d40 0x561f9787f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f5366ff5640 0 client.15813 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:54.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f538b793740 1 --2- 172.21.15.45:0/3497623961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f9787f190 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f538b793740 1 --2- 172.21.15.45:0/3497623961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97876b60 0x561f9787ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f538b793740 1 -- 172.21.15.45:0/3497623961 >> 172.21.15.45:0/3497623961 conn(0x561f978730f0 msgr2=0x561f97872270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:54.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f538b793740 1 -- 172.21.15.45:0/3497623961 shutdown_connections 2024-09-15T22:17:54.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f538b793740 1 -- 172.21.15.45:0/3497623961 wait complete. 2024-09-15T22:17:54.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.417+0000 7f538b793740 20 client.15813 trim_cache size 0 max 16384 2024-09-15T22:17:54.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.436+0000 7f538b793740 1 Processor -- start 2024-09-15T22:17:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.436+0000 7f538b793740 1 -- start start 2024-09-15T22:17:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.436+0000 7f538b793740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97876b60 0x561f978795c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.436+0000 7f538b793740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97899720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.436+0000 7f538b793740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97881d40 0x561f97899c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.436+0000 7f538b793740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f53841ad170 con 0x561f97877480 2024-09-15T22:17:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.436+0000 7f538b793740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53841af9f0 con 0x561f97881d40 2024-09-15T22:17:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.436+0000 7f538b793740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f53841ad7e0 con 0x561f97876b60 2024-09-15T22:17:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.436+0000 7f53827fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97899720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.436+0000 7f53827fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97899720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40938/0 (socket says 172.21.15.45:40938) 2024-09-15T22:17:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.436+0000 7f53827fc640 1 -- 172.21.15.45:0/1935332588 learned_addr learned my addr 172.21.15.45:0/1935332588 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.436+0000 7f5382ffd640 1 --2- 172.21.15.45:0/1935332588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97876b60 0x561f978795c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.436+0000 7f53837fe640 1 --2- 172.21.15.45:0/1935332588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97881d40 0x561f97899c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.437+0000 7f53827fc640 1 -- 172.21.15.45:0/1935332588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97876b60 msgr2=0x561f978795c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.437+0000 7f53827fc640 1 --2- 172.21.15.45:0/1935332588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97876b60 0x561f978795c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.437+0000 7f53827fc640 1 -- 172.21.15.45:0/1935332588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97881d40 msgr2=0x561f97899c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.437+0000 7f53827fc640 1 --2- 172.21.15.45:0/1935332588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97881d40 0x561f97899c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.437+0000 7f53827fc640 1 -- 172.21.15.45:0/1935332588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9787d1a0 con 0x561f97877480 2024-09-15T22:17:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.437+0000 7f53827fc640 1 --2- 172.21.15.45:0/1935332588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97899720 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5378033000 tx=0x7f5378001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fc3000b576d730 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.437+0000 7f5368ff9640 1 -- 172.21.15.45:0/1935332588 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378035070 con 0x561f97877480 2024-09-15T22:17:54.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.437+0000 7f5368ff9640 1 -- 172.21.15.45:0/1935332588 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5378040070 con 0x561f97877480 2024-09-15T22:17:54.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.437+0000 7f5368ff9640 1 -- 172.21.15.45:0/1935332588 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378004260 con 0x561f97877480 2024-09-15T22:17:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.438+0000 7f538b793740 1 -- 172.21.15.45:0/1935332588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 msgr2=0x561f97899720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.438+0000 7f538b793740 1 --2- 172.21.15.45:0/1935332588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97899720 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5378033000 tx=0x7f5378001e70 comp rx=0 tx=0).stop 2024-09-15T22:17:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.438+0000 7f538b793740 1 -- 172.21.15.45:0/1935332588 shutdown_connections 2024-09-15T22:17:54.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.438+0000 7f538b793740 1 --2- 172.21.15.45:0/1935332588 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97881d40 0x561f97899c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.438+0000 7f538b793740 1 --2- 172.21.15.45:0/1935332588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97899720 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.438+0000 7f538b793740 1 --2- 172.21.15.45:0/1935332588 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97876b60 0x561f978795c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.438+0000 7f538b793740 1 -- 172.21.15.45:0/1935332588 >> 172.21.15.45:0/1935332588 conn(0x561f978730f0 msgr2=0x561f97880bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.438+0000 7f538b793740 1 -- 172.21.15.45:0/1935332588 shutdown_connections 2024-09-15T22:17:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.438+0000 7f538b793740 1 -- 172.21.15.45:0/1935332588 wait complete. 2024-09-15T22:17:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.438+0000 7f538b793740 1 -- start start 2024-09-15T22:17:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.438+0000 7f538b793740 1 Processor -- start 2024-09-15T22:17:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f538b793740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97876b60 0x561f97886250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f538b793740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97886790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f538b793740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97881d40 0x561f978fb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f538b793740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f53841adeb0 con 0x561f97877480 2024-09-15T22:17:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f538b793740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f53841af320 con 0x561f97876b60 2024-09-15T22:17:54.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f538b793740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f53841ae580 con 0x561f97881d40 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f538b793740 10 client.0 _ll_register_callbacks cb 0x7f53740093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f53827fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97886790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f53827fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97886790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40948/0 (socket says 172.21.15.45:40948) 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f53827fc640 1 -- 172.21.15.45:0/2050164368 learned_addr learned my addr 172.21.15.45:0/2050164368 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f5382ffd640 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97876b60 0x561f97886250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f53837fe640 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97881d40 0x561f978fb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f53827fc640 1 -- 172.21.15.45:0/2050164368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97881d40 msgr2=0x561f978fb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f53827fc640 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97881d40 0x561f978fb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f53827fc640 1 -- 172.21.15.45:0/2050164368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97876b60 msgr2=0x561f97886250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f53827fc640 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97876b60 0x561f97886250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f53827fc640 1 -- 172.21.15.45:0/2050164368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f978fbd30 con 0x561f97877480 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f5382ffd640 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97876b60 0x561f97886250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f53827fc640 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97886790 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5378032c50 tx=0x7f5378031b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd9afd565e86aab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.439+0000 7f5366ff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:17:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f5366ff5640 1 -- 172.21.15.45:0/2050164368 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378035040 con 0x561f97877480 2024-09-15T22:17:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f5366ff5640 1 -- 172.21.15.45:0/2050164368 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f5378004460 con 0x561f97877480 2024-09-15T22:17:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f538b793740 1 -- 172.21.15.45:0/2050164368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5378040070 con 0x561f97877480 2024-09-15T22:17:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f5366ff5640 1 -- 172.21.15.45:0/2050164368 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5378003e60 con 0x561f97877480 2024-09-15T22:17:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f538b793740 10 client.15819 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f538b793740 1 -- 172.21.15.45:0/2050164368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561f978fd050 con 0x561f97877480 2024-09-15T22:17:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f5366ff5640 1 -- 172.21.15.45:0/2050164368 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5378040070 con 0x561f97877480 2024-09-15T22:17:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f5366ff5640 1 -- 172.21.15.45:0/2050164368 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5378004c10 con 0x561f97877480 2024-09-15T22:17:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f538b793740 10 client.15819 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f538b793740 10 client.15819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f538b793740 20 client.15819 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f538b793740 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f978fd710 0x561f978ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f538b793740 4 client.15819 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:17:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.440+0000 7f538b793740 1 -- 172.21.15.45:0/2050164368 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561f977e3d00 con 0x561f978fd710 2024-09-15T22:17:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.441+0000 7f5382ffd640 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f978fd710 0x561f978ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.441+0000 7f5382ffd640 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f978fd710 0x561f978ffb30 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12cf04345efe699f server_cookie=cf531f08f6ebf8c1 in_seq=0 out_seq=0 2024-09-15T22:17:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.441+0000 7f5366ff5640 10 client.15819 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:54.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f5366ff5640 1 -- 172.21.15.45:0/2050164368 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561f977e3d00 con 0x561f978fd710 2024-09-15T22:17:54.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f5366ff5640 10 client.15819 handle_command_reply: tid=0 2024-09-15T22:17:54.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f538b793740 1 client.15819 shutdown 2024-09-15T22:17:54.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f538b793740 1 -- 172.21.15.45:0/2050164368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 msgr2=0x561f97886790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:54.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f538b793740 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97886790 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5378032c50 tx=0x7f5378031b00 comp rx=0 tx=0).stop 2024-09-15T22:17:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f538b793740 1 -- 172.21.15.45:0/2050164368 shutdown_connections 2024-09-15T22:17:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f538b793740 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f978fd710 0x561f978ffb30 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f538b793740 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f97881d40 0x561f978fb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f538b793740 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f97877480 0x561f97886790 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f538b793740 1 --2- 172.21.15.45:0/2050164368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f97876b60 0x561f97886250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f538b793740 1 -- 172.21.15.45:0/2050164368 >> 172.21.15.45:0/2050164368 conn(0x561f978730f0 msgr2=0x561f9788cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f5366ff5640 0 client.15819 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f538b793740 1 -- 172.21.15.45:0/2050164368 shutdown_connections 2024-09-15T22:17:54.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.497+0000 7f538b793740 1 -- 172.21.15.45:0/2050164368 wait complete. 2024-09-15T22:17:54.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.498+0000 7f538b793740 20 client.15819 trim_cache size 0 max 16384 2024-09-15T22:17:54.502 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:17:54.502 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:17:54.502 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "211cca01-82df-489c-86f4-c5ceef255eec", 2024-09-15T22:17:54.502 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:17:54.502 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:17:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.498+0000 7f53893ba640 1 -- 172.21.15.45:0/2832341403 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f536c0a3430 msgr2=0x7f536c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.498+0000 7f53893ba640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f536c0a3430 0x7f536c0a58f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f537c011890 tx=0x7f537c009c80 comp rx=0 tx=0).stop 2024-09-15T22:17:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.498+0000 7f53893ba640 1 -- 172.21.15.45:0/2832341403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5384101de0 msgr2=0x7f5384198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.498+0000 7f53893ba640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5384101de0 0x7f5384198590 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f537400eb90 tx=0x7f537400c6a0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.498+0000 7f53893ba640 1 -- 172.21.15.45:0/2832341403 shutdown_connections 2024-09-15T22:17:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.498+0000 7f53893ba640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f536c0a3430 0x7f536c0a58f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.498+0000 7f53893ba640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5384106f10 0x7f538419ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.498+0000 7f53893ba640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5384102790 0x7f5384198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.498+0000 7f53893ba640 1 --2- 172.21.15.45:0/2832341403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5384101de0 0x7f5384198590 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.498+0000 7f53893ba640 1 -- 172.21.15.45:0/2832341403 >> 172.21.15.45:0/2832341403 conn(0x7f53840fd8c0 msgr2=0x7f53840fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.499+0000 7f53893ba640 1 -- 172.21.15.45:0/2832341403 shutdown_connections 2024-09-15T22:17:54.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:54.499+0000 7f53893ba640 1 -- 172.21.15.45:0/2832341403 wait complete. 2024-09-15T22:17:54.526 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-15T22:17:54.529 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-15T22:17:54.533 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-15T22:17:54.534 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-15T22:17:54.535 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-15T22:17:54.536 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-15T22:17:54.537 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-15T22:17:54.538 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-15T22:17:54.539 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-15T22:17:54.540 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-15T22:17:54.541 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-15T22:17:54.542 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-15T22:17:54.543 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-15T22:17:54.544 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-15T22:17:54.545 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-15T22:17:54.546 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-15T22:17:54.547 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-15T22:17:54.548 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-15T22:17:54.549 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-15T22:17:54.550 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-15T22:17:54.550 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-15T22:17:54.551 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-15T22:17:54.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-15T22:17:54.554 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-15T22:17:54.555 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-15T22:17:54.556 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-15T22:17:54.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-15T22:17:54.558 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-15T22:17:54.559 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-15T22:17:54.560 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-15T22:17:54.561 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-15T22:17:54.563 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-15T22:17:54.564 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-15T22:17:54.566 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-15T22:17:54.567 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-15T22:17:54.568 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-15T22:17:54.568 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-15T22:17:54.569 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-15T22:17:54.570 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-15T22:17:54.571 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-15T22:17:54.572 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-15T22:17:54.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-15T22:17:54.574 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-15T22:17:54.575 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-15T22:17:54.575 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-15T22:17:54.576 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-15T22:17:54.577 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-15T22:17:54.578 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-15T22:17:54.579 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-15T22:17:54.580 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-15T22:17:54.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-15T22:17:54.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/Makefile 2024-09-15T22:17:54.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-15T22:17:54.583 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-15T22:17:54.584 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-15T22:17:54.585 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-15T22:17:54.586 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-15T22:17:54.587 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-15T22:17:54.588 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-15T22:17:54.588 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-15T22:17:54.589 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-15T22:17:54.590 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-15T22:17:54.591 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-15T22:17:54.592 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-15T22:17:54.593 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-15T22:17:54.594 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-15T22:17:54.595 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-15T22:17:54.596 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-15T22:17:54.597 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-15T22:17:54.598 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-15T22:17:54.599 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-15T22:17:54.600 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-15T22:17:54.601 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-15T22:17:54.602 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-15T22:17:54.603 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-15T22:17:54.604 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-15T22:17:54.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-15T22:17:54.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-15T22:17:54.607 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-15T22:17:54.608 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-15T22:17:54.609 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-15T22:17:54.610 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-15T22:17:54.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-15T22:17:54.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-15T22:17:54.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-15T22:17:54.614 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-15T22:17:54.615 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-15T22:17:54.616 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-15T22:17:54.616 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-15T22:17:54.617 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-15T22:17:54.618 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-15T22:17:54.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-15T22:17:54.621 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-15T22:17:54.622 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-15T22:17:54.623 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-15T22:17:54.625 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-15T22:17:54.627 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-15T22:17:54.627 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-15T22:17:54.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-15T22:17:54.630 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-15T22:17:54.631 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-15T22:17:54.632 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-15T22:17:54.634 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-15T22:17:54.635 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-15T22:17:54.636 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-15T22:17:54.637 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-15T22:17:54.638 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-15T22:17:54.639 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-15T22:17:54.640 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-15T22:17:54.641 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-15T22:17:54.642 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-15T22:17:54.643 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-15T22:17:54.644 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-15T22:17:54.645 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-15T22:17:54.645 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-15T22:17:54.646 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-15T22:17:54.647 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-15T22:17:54.648 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/ 2024-09-15T22:17:54.649 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-15T22:17:54.650 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-15T22:17:54.651 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-15T22:17:54.652 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-15T22:17:54.653 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-15T22:17:54.654 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-15T22:17:54.654 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-15T22:17:54.655 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-15T22:17:54.656 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-15T22:17:54.657 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-15T22:17:54.658 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-15T22:17:54.658 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-15T22:17:54.659 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-15T22:17:54.660 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-15T22:17:54.661 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-15T22:17:54.662 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/README 2024-09-15T22:17:54.663 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-15T22:17:54.664 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-15T22:17:54.664 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-15T22:17:54.665 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-15T22:17:54.666 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-15T22:17:54.667 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-15T22:17:54.667 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-15T22:17:54.668 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-15T22:17:54.669 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-15T22:17:54.670 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-15T22:17:54.671 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-15T22:17:54.672 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-15T22:17:54.673 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-15T22:17:54.674 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-15T22:17:54.675 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-15T22:17:54.676 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-15T22:17:54.676 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-15T22:17:54.677 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-15T22:17:54.678 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-15T22:17:54.679 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-15T22:17:54.680 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-15T22:17:54.681 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-15T22:17:54.682 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-15T22:17:54.683 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-15T22:17:54.685 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-15T22:17:54.686 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-15T22:17:54.687 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-15T22:17:54.688 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-15T22:17:54.690 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-15T22:17:54.691 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-15T22:17:54.692 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-15T22:17:54.696 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-15T22:17:54.696 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-15T22:17:54.696 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-15T22:17:54.696 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-15T22:17:54.697 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-15T22:17:54.698 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-15T22:17:54.699 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-15T22:17:54.700 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-15T22:17:54.701 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-15T22:17:54.702 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-15T22:17:54.702 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-15T22:17:54.703 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-15T22:17:54.704 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-15T22:17:54.705 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-15T22:17:54.706 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-15T22:17:54.706 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-15T22:17:54.707 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-15T22:17:54.708 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-15T22:17:54.709 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-15T22:17:54.710 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-15T22:17:54.711 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-15T22:17:54.712 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-15T22:17:54.712 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-15T22:17:54.713 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-15T22:17:54.714 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-15T22:17:54.715 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-15T22:17:54.715 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-15T22:17:54.716 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-15T22:17:54.717 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-15T22:17:54.717 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-15T22:17:54.718 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-15T22:17:54.719 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-15T22:17:54.720 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-15T22:17:54.721 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-15T22:17:54.721 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-15T22:17:54.722 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-15T22:17:54.723 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-15T22:17:54.724 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-15T22:17:54.725 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-15T22:17:54.726 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-15T22:17:54.726 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-15T22:17:54.727 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-15T22:17:54.728 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-15T22:17:54.729 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-15T22:17:54.730 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-15T22:17:54.730 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-15T22:17:54.731 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-15T22:17:54.732 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-15T22:17:54.733 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-15T22:17:54.734 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-15T22:17:54.734 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-15T22:17:54.735 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-15T22:17:54.736 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-15T22:17:54.737 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-15T22:17:54.737 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-15T22:17:54.738 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-15T22:17:54.739 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-15T22:17:54.740 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-15T22:17:54.740 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-15T22:17:54.741 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-15T22:17:54.742 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-15T22:17:54.743 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-15T22:17:54.744 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-15T22:17:54.745 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-15T22:17:54.746 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-15T22:17:54.747 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-15T22:17:54.748 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-15T22:17:54.749 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-15T22:17:54.750 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/ 2024-09-15T22:17:54.751 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-15T22:17:54.751 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-15T22:17:54.752 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-15T22:17:54.753 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-15T22:17:54.754 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-15T22:17:54.755 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-15T22:17:54.755 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-15T22:17:54.756 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-15T22:17:54.757 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-15T22:17:54.758 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-15T22:17:54.759 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-15T22:17:54.759 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-15T22:17:54.760 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-15T22:17:54.761 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-15T22:17:54.762 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-15T22:17:54.762 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-15T22:17:54.763 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-15T22:17:54.764 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-15T22:17:54.765 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-15T22:17:54.765 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-15T22:17:54.766 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-15T22:17:54.767 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-15T22:17:54.768 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-15T22:17:54.768 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-15T22:17:54.769 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-15T22:17:54.770 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-15T22:17:54.770 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-15T22:17:54.771 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-15T22:17:54.772 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-15T22:17:54.773 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-15T22:17:54.773 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-15T22:17:54.774 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-15T22:17:54.775 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-15T22:17:54.776 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-15T22:17:54.776 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-15T22:17:54.777 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-15T22:17:54.778 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-15T22:17:54.779 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-15T22:17:54.780 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-15T22:17:54.781 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-15T22:17:54.781 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-15T22:17:54.782 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-15T22:17:54.783 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-15T22:17:54.784 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-15T22:17:54.784 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-15T22:17:54.785 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-15T22:17:54.786 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-15T22:17:54.787 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-15T22:17:54.787 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-15T22:17:54.788 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-15T22:17:54.789 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-15T22:17:54.790 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-15T22:17:54.791 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-15T22:17:54.792 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-15T22:17:54.793 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-15T22:17:54.793 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-15T22:17:54.794 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-15T22:17:54.795 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-15T22:17:54.796 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-15T22:17:54.797 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-15T22:17:54.798 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-15T22:17:54.799 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-15T22:17:54.800 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-15T22:17:54.801 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-15T22:17:54.802 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-15T22:17:54.803 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/connector/ 2024-09-15T22:17:54.804 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-15T22:17:54.805 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-15T22:17:54.805 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-15T22:17:54.806 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-15T22:17:54.807 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-15T22:17:54.808 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/console/ 2024-09-15T22:17:54.809 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-15T22:17:54.810 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-15T22:17:54.810 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-15T22:17:54.811 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-15T22:17:54.812 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-15T22:17:54.813 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-15T22:17:54.813 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-15T22:17:54.814 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-15T22:17:54.815 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-15T22:17:54.816 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-15T22:17:54.817 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-15T22:17:54.817 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-15T22:17:54.818 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-15T22:17:54.819 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-15T22:17:54.820 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-15T22:17:54.821 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-15T22:17:54.822 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-15T22:17:54.823 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-15T22:17:54.824 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-15T22:17:54.824 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-15T22:17:54.825 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-15T22:17:54.826 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-15T22:17:54.827 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cris/ 2024-09-15T22:17:54.828 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/cris/README 2024-09-15T22:17:54.829 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-15T22:17:54.830 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-15T22:17:54.831 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-15T22:17:54.832 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-15T22:17:54.833 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-15T22:17:54.833 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-15T22:17:54.834 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-15T22:17:54.835 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-15T22:17:54.836 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-15T22:17:54.837 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-15T22:17:54.838 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-15T22:17:54.838 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-15T22:17:54.839 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-15T22:17:54.840 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-15T22:17:54.841 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-15T22:17:54.842 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-15T22:17:54.842 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-15T22:17:54.843 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-15T22:17:54.845 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-15T22:17:54.846 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-15T22:17:54.847 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-15T22:17:54.847 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-15T22:17:54.848 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-15T22:17:54.849 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-15T22:17:54.850 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-15T22:17:54.850 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-15T22:17:54.851 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-15T22:17:54.852 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-15T22:17:54.853 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-15T22:17:54.854 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-15T22:17:54.854 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-15T22:17:54.855 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-15T22:17:54.856 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-15T22:17:54.857 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-15T22:17:54.857 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-15T22:17:54.858 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-15T22:17:54.859 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-15T22:17:54.860 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-15T22:17:54.861 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-15T22:17:54.862 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-15T22:17:54.862 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-15T22:17:54.863 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-15T22:17:54.864 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-15T22:17:54.866 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-15T22:17:54.866 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-15T22:17:54.867 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-15T22:17:54.868 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-15T22:17:54.868 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-15T22:17:54.869 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-15T22:17:54.870 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-15T22:17:54.871 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-15T22:17:54.871 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-15T22:17:54.872 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-15T22:17:54.873 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-15T22:17:54.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-15T22:17:54.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-15T22:17:54.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-15T22:17:54.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-15T22:17:54.877 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-15T22:17:54.878 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-15T22:17:54.879 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-15T22:17:54.880 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-15T22:17:54.880 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-15T22:17:54.881 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-15T22:17:54.882 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-15T22:17:54.883 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-15T22:17:54.884 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-15T22:17:54.885 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-15T22:17:54.886 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-15T22:17:54.887 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-15T22:17:54.888 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-15T22:17:54.889 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-15T22:17:54.890 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-15T22:17:54.891 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-15T22:17:54.892 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-15T22:17:54.893 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-15T22:17:54.894 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-15T22:17:54.895 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-15T22:17:54.896 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-15T22:17:54.897 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-15T22:17:54.898 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-15T22:17:54.899 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-15T22:17:54.900 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-15T22:17:54.901 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-15T22:17:54.902 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-15T22:17:54.903 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-15T22:17:54.904 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-15T22:17:54.905 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-15T22:17:54.905 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-15T22:17:54.906 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-15T22:17:54.907 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-15T22:17:54.908 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-15T22:17:54.909 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-15T22:17:54.910 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-15T22:17:54.911 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-15T22:17:54.912 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-15T22:17:54.912 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-15T22:17:54.913 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-15T22:17:54.914 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-15T22:17:54.915 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-15T22:17:54.916 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-15T22:17:54.917 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-15T22:17:54.917 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-15T22:17:54.918 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-15T22:17:54.919 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-15T22:17:54.920 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-15T22:17:54.921 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-15T22:17:54.922 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-15T22:17:54.923 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-15T22:17:54.924 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-15T22:17:54.924 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-15T22:17:54.925 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-15T22:17:54.926 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-15T22:17:54.927 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-15T22:17:54.927 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-15T22:17:54.928 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-15T22:17:54.929 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-15T22:17:54.930 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-15T22:17:54.931 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-15T22:17:54.932 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-15T22:17:54.933 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-15T22:17:54.933 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-15T22:17:54.934 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-15T22:17:54.935 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-15T22:17:54.936 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-15T22:17:54.937 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-15T22:17:54.938 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-15T22:17:54.938 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-15T22:17:54.939 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-15T22:17:54.940 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-15T22:17:54.941 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-15T22:17:54.942 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-15T22:17:54.943 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-15T22:17:54.944 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-15T22:17:54.944 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-15T22:17:54.945 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-15T22:17:54.946 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-15T22:17:54.947 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-15T22:17:54.948 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-15T22:17:54.949 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-15T22:17:54.950 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-15T22:17:54.951 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-15T22:17:54.952 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-15T22:17:54.953 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-15T22:17:54.953 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-15T22:17:54.954 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-15T22:17:54.955 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-15T22:17:54.956 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-15T22:17:54.957 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-15T22:17:54.958 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-15T22:17:54.958 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-15T22:17:54.959 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-15T22:17:54.960 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-15T22:17:54.961 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-15T22:17:54.961 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-15T22:17:54.962 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-15T22:17:54.963 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-15T22:17:54.964 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-15T22:17:54.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:54 smithi165 ceph-mon[35551]: pgmap v53: 129 pgs: 129 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 51 KiB/s wr, 6 op/s 2024-09-15T22:17:54.964 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-15T22:17:54.965 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-15T22:17:54.966 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-15T22:17:54.967 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-15T22:17:54.967 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-15T22:17:54.968 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-15T22:17:54.969 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-15T22:17:54.970 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-15T22:17:54.970 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-15T22:17:54.971 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-15T22:17:54.972 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-15T22:17:54.973 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-15T22:17:54.973 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-15T22:17:54.974 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-15T22:17:54.975 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-15T22:17:54.976 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-15T22:17:54.977 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-15T22:17:54.978 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-15T22:17:54.978 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-15T22:17:54.979 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-15T22:17:54.980 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-15T22:17:54.981 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-15T22:17:54.982 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-15T22:17:54.983 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-15T22:17:54.984 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-15T22:17:54.984 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-15T22:17:54.985 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-15T22:17:54.986 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-15T22:17:54.987 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-15T22:17:54.988 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-15T22:17:54.989 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-15T22:17:54.990 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-15T22:17:54.991 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-15T22:17:54.992 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-15T22:17:54.993 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-15T22:17:54.994 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-15T22:17:54.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:54 smithi100 ceph-mon[35319]: pgmap v53: 129 pgs: 129 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 51 KiB/s wr, 6 op/s 2024-09-15T22:17:54.994 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-15T22:17:54.995 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-15T22:17:54.996 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:54 smithi045 ceph-mon[31180]: pgmap v53: 129 pgs: 129 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 51 KiB/s wr, 6 op/s 2024-09-15T22:17:54.996 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-15T22:17:54.997 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-15T22:17:54.998 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-15T22:17:54.999 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-15T22:17:55.000 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-15T22:17:55.001 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-15T22:17:55.198 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:17:55.198 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-15T22:17:55.199 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-15T22:17:55.201 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-15T22:17:55.202 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-15T22:17:55.202 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-15T22:17:55.203 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-15T22:17:55.204 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-15T22:17:55.205 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-15T22:17:55.205 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-15T22:17:55.206 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-15T22:17:55.207 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-15T22:17:55.207 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-15T22:17:55.208 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-15T22:17:55.209 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-15T22:17:55.210 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-15T22:17:55.211 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-15T22:17:55.211 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-15T22:17:55.212 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-15T22:17:55.213 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-15T22:17:55.213 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-15T22:17:55.214 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-15T22:17:55.215 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-15T22:17:55.216 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-15T22:17:55.217 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-15T22:17:55.217 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-15T22:17:55.218 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-15T22:17:55.219 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-15T22:17:55.220 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-15T22:17:55.221 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-15T22:17:55.221 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-15T22:17:55.222 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-15T22:17:55.223 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-15T22:17:55.224 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-15T22:17:55.224 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-15T22:17:55.225 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-15T22:17:55.226 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-15T22:17:55.227 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-15T22:17:55.227 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-15T22:17:55.228 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-15T22:17:55.229 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-15T22:17:55.230 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-15T22:17:55.230 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-15T22:17:55.231 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-15T22:17:55.232 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-15T22:17:55.233 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-15T22:17:55.233 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-15T22:17:55.234 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-15T22:17:55.235 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-15T22:17:55.236 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-15T22:17:55.236 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-15T22:17:55.237 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-15T22:17:55.238 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-15T22:17:55.239 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-15T22:17:55.239 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-15T22:17:55.240 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-15T22:17:55.241 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-15T22:17:55.242 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-15T22:17:55.243 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-15T22:17:55.243 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-15T22:17:55.244 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-15T22:17:55.245 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-15T22:17:55.246 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-15T22:17:55.247 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-15T22:17:55.247 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-15T22:17:55.248 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-15T22:17:55.249 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-15T22:17:55.249 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-15T22:17:55.250 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-15T22:17:55.251 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-15T22:17:55.252 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-15T22:17:55.253 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-15T22:17:55.255 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-15T22:17:55.255 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-15T22:17:55.255 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-15T22:17:55.256 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-15T22:17:55.256 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-15T22:17:55.257 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-15T22:17:55.258 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-15T22:17:55.259 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-15T22:17:55.259 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-15T22:17:55.260 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-15T22:17:55.261 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-15T22:17:55.262 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-15T22:17:55.263 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-15T22:17:55.264 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-15T22:17:55.265 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-15T22:17:55.266 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-15T22:17:55.267 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-15T22:17:55.268 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-15T22:17:55.269 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-15T22:17:55.269 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-15T22:17:55.270 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-15T22:17:55.271 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-15T22:17:55.272 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-15T22:17:55.272 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-15T22:17:55.273 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-15T22:17:55.274 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-15T22:17:55.275 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-15T22:17:55.275 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-15T22:17:55.276 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-15T22:17:55.277 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-15T22:17:55.278 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-15T22:17:55.279 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-15T22:17:55.279 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-15T22:17:55.280 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-15T22:17:55.281 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-15T22:17:55.282 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-15T22:17:55.282 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-15T22:17:55.283 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-15T22:17:55.284 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-15T22:17:55.285 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-15T22:17:55.285 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-15T22:17:55.286 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-15T22:17:55.287 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-15T22:17:55.288 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-15T22:17:55.289 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-15T22:17:55.290 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-15T22:17:55.290 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-15T22:17:55.291 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-15T22:17:55.292 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-15T22:17:55.292 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-15T22:17:55.293 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-15T22:17:55.294 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-15T22:17:55.295 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-15T22:17:55.296 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-15T22:17:55.296 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-15T22:17:55.297 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-15T22:17:55.298 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-15T22:17:55.299 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-15T22:17:55.300 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-15T22:17:55.300 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-15T22:17:55.301 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-15T22:17:55.302 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-15T22:17:55.303 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-15T22:17:55.303 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-15T22:17:55.304 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-15T22:17:55.305 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-15T22:17:55.305 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-15T22:17:55.307 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-15T22:17:55.308 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-15T22:17:55.308 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-15T22:17:55.309 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-15T22:17:55.309 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-15T22:17:55.310 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-15T22:17:55.311 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-15T22:17:55.312 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-15T22:17:55.313 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-15T22:17:55.313 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-15T22:17:55.314 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-15T22:17:55.315 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-15T22:17:55.316 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-15T22:17:55.317 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-15T22:17:55.317 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-15T22:17:55.318 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-15T22:17:55.319 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-15T22:17:55.320 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-15T22:17:55.321 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-15T22:17:55.321 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-15T22:17:55.322 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-15T22:17:55.323 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-15T22:17:55.323 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-15T22:17:55.324 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-15T22:17:55.325 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-15T22:17:55.326 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-15T22:17:55.327 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-15T22:17:55.327 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-15T22:17:55.328 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-15T22:17:55.329 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-15T22:17:55.330 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-15T22:17:55.331 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-15T22:17:55.331 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-15T22:17:55.332 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-15T22:17:55.333 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-15T22:17:55.333 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-15T22:17:55.334 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-15T22:17:55.335 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-15T22:17:55.336 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-15T22:17:55.336 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-15T22:17:55.337 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-15T22:17:55.338 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-15T22:17:55.339 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-15T22:17:55.340 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-15T22:17:55.341 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-15T22:17:55.341 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-15T22:17:55.342 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-15T22:17:55.343 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-15T22:17:55.344 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-15T22:17:55.344 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-15T22:17:55.345 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-15T22:17:55.346 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-15T22:17:55.346 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-15T22:17:55.348 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-15T22:17:55.348 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-15T22:17:55.349 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-15T22:17:55.350 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-15T22:17:55.350 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-15T22:17:55.351 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-15T22:17:55.352 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-15T22:17:55.353 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-15T22:17:55.353 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-15T22:17:55.354 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-15T22:17:55.355 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-15T22:17:55.356 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-15T22:17:55.357 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-15T22:17:55.358 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-15T22:17:55.358 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-15T22:17:55.359 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-15T22:17:55.360 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-15T22:17:55.360 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-15T22:17:55.361 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-15T22:17:55.362 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-15T22:17:55.362 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-15T22:17:55.363 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-15T22:17:55.364 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-15T22:17:55.365 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-15T22:17:55.365 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-15T22:17:55.366 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-15T22:17:55.367 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-15T22:17:55.368 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-15T22:17:55.368 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-15T22:17:55.369 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-15T22:17:55.370 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-15T22:17:55.371 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-15T22:17:55.372 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-15T22:17:55.373 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-15T22:17:55.373 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-15T22:17:55.374 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-15T22:17:55.375 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-15T22:17:55.375 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-15T22:17:55.376 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-15T22:17:55.377 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-15T22:17:55.378 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-15T22:17:55.378 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-15T22:17:55.379 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-15T22:17:55.380 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-15T22:17:55.381 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-15T22:17:55.381 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-15T22:17:55.382 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-15T22:17:55.383 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-15T22:17:55.384 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-15T22:17:55.384 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-15T22:17:55.385 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-15T22:17:55.386 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-15T22:17:55.387 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-15T22:17:55.387 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-15T22:17:55.388 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-15T22:17:55.389 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-15T22:17:55.390 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-15T22:17:55.390 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-15T22:17:55.391 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-15T22:17:55.392 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-15T22:17:55.393 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-15T22:17:55.393 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-15T22:17:55.394 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-15T22:17:55.395 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-15T22:17:55.396 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-15T22:17:55.397 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-15T22:17:55.397 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-15T22:17:55.398 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-15T22:17:55.399 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-15T22:17:55.400 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-15T22:17:55.400 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-15T22:17:55.401 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-15T22:17:55.402 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-15T22:17:55.403 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-15T22:17:55.404 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-15T22:17:55.405 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-15T22:17:55.405 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-15T22:17:55.406 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-15T22:17:55.407 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-15T22:17:55.407 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-15T22:17:55.409 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-15T22:17:55.409 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-15T22:17:55.410 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-15T22:17:55.410 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-15T22:17:55.411 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-15T22:17:55.412 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-15T22:17:55.413 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-15T22:17:55.413 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-15T22:17:55.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-15T22:17:55.415 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-15T22:17:55.416 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-15T22:17:55.417 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-15T22:17:55.418 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-15T22:17:55.418 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-15T22:17:55.419 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-15T22:17:55.420 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-15T22:17:55.421 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-15T22:17:55.421 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-15T22:17:55.422 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-15T22:17:55.423 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-15T22:17:55.424 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-15T22:17:55.424 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-15T22:17:55.425 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-15T22:17:55.426 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-15T22:17:55.427 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-15T22:17:55.428 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-15T22:17:55.429 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-15T22:17:55.429 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-15T22:17:55.430 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-15T22:17:55.431 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-15T22:17:55.432 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-15T22:17:55.433 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-15T22:17:55.433 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-15T22:17:55.434 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-15T22:17:55.435 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-15T22:17:55.435 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-15T22:17:55.436 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-15T22:17:55.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-15T22:17:55.438 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-15T22:17:55.439 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-15T22:17:55.439 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-15T22:17:55.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-15T22:17:55.441 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-15T22:17:55.442 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-15T22:17:55.442 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-15T22:17:55.443 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-15T22:17:55.444 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-15T22:17:55.445 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-15T22:17:55.446 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-15T22:17:55.446 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-15T22:17:55.447 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-15T22:17:55.448 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-15T22:17:55.449 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-15T22:17:55.449 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-15T22:17:55.451 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-15T22:17:55.451 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-15T22:17:55.452 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-15T22:17:55.452 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-15T22:17:55.453 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-15T22:17:55.454 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-15T22:17:55.455 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-15T22:17:55.456 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-15T22:17:55.456 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-15T22:17:55.457 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-15T22:17:55.458 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-15T22:17:55.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-15T22:17:55.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-15T22:17:55.460 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-15T22:17:55.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-15T22:17:55.462 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-15T22:17:55.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-15T22:17:55.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-15T22:17:55.464 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-15T22:17:55.465 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:17:55.465 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-15T22:17:55.466 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-15T22:17:55.467 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-15T22:17:55.467 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-15T22:17:55.468 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-15T22:17:55.469 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-15T22:17:55.470 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-15T22:17:55.470 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-15T22:17:55.471 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-15T22:17:55.472 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-15T22:17:55.473 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-15T22:17:55.473 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-15T22:17:55.474 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-15T22:17:55.475 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-15T22:17:55.477 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-15T22:17:55.477 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-15T22:17:55.477 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-15T22:17:55.478 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-15T22:17:55.479 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-15T22:17:55.480 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-15T22:17:55.480 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-15T22:17:55.481 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-15T22:17:55.482 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-15T22:17:55.483 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-15T22:17:55.484 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-15T22:17:55.484 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-15T22:17:55.485 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-15T22:17:55.486 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-15T22:17:55.486 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-15T22:17:55.487 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-15T22:17:55.488 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-15T22:17:55.490 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-15T22:17:55.490 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-15T22:17:55.490 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-15T22:17:55.491 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-15T22:17:55.492 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-15T22:17:55.493 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-15T22:17:55.493 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-15T22:17:55.494 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-15T22:17:55.495 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-15T22:17:55.496 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-15T22:17:55.497 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-15T22:17:55.497 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-15T22:17:55.498 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-15T22:17:55.499 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-15T22:17:55.500 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-15T22:17:55.500 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-15T22:17:55.501 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-15T22:17:55.502 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-15T22:17:55.503 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-15T22:17:55.504 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-15T22:17:55.505 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-15T22:17:55.506 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-15T22:17:55.506 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-15T22:17:55.507 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-15T22:17:55.508 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-15T22:17:55.512 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-15T22:17:55.512 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-15T22:17:55.512 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-15T22:17:55.513 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-15T22:17:55.513 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-15T22:17:55.513 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-15T22:17:55.514 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-15T22:17:55.515 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-15T22:17:55.516 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-15T22:17:55.517 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-15T22:17:55.518 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-15T22:17:55.519 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-15T22:17:55.520 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-15T22:17:55.520 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-15T22:17:55.521 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-15T22:17:55.522 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-15T22:17:55.523 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-15T22:17:55.524 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-15T22:17:55.524 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-15T22:17:55.525 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-15T22:17:55.526 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-15T22:17:55.527 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-15T22:17:55.528 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-15T22:17:55.529 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-15T22:17:55.530 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-15T22:17:55.530 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-15T22:17:55.531 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-15T22:17:55.532 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-15T22:17:55.533 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-15T22:17:55.534 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-15T22:17:55.535 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-15T22:17:55.536 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-15T22:17:55.537 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-15T22:17:55.537 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-15T22:17:55.538 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-15T22:17:55.539 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-15T22:17:55.540 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-15T22:17:55.541 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-15T22:17:55.542 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-15T22:17:55.542 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-15T22:17:55.543 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-15T22:17:55.544 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-15T22:17:55.545 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-15T22:17:55.546 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-15T22:17:55.547 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-15T22:17:55.548 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-15T22:17:55.549 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-15T22:17:55.550 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-15T22:17:55.551 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-15T22:17:55.552 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-15T22:17:55.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-15T22:17:55.554 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-15T22:17:55.556 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-15T22:17:55.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-15T22:17:55.558 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-15T22:17:55.559 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-15T22:17:55.560 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-15T22:17:55.562 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-15T22:17:55.562 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-15T22:17:55.564 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-15T22:17:55.565 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-15T22:17:55.566 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-15T22:17:55.567 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-15T22:17:55.569 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-15T22:17:55.570 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-15T22:17:55.571 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-15T22:17:55.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-15T22:17:55.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-15T22:17:55.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-15T22:17:55.575 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-15T22:17:55.575 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-15T22:17:55.577 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-15T22:17:55.578 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-15T22:17:55.579 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-15T22:17:55.580 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-15T22:17:55.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-15T22:17:55.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-15T22:17:55.583 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-15T22:17:55.584 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-15T22:17:55.585 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-15T22:17:55.586 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-15T22:17:55.587 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-15T22:17:55.588 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-15T22:17:55.589 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-15T22:17:55.590 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-15T22:17:55.591 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-15T22:17:55.592 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-15T22:17:55.593 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-15T22:17:55.595 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-15T22:17:55.596 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-15T22:17:55.597 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-15T22:17:55.598 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-15T22:17:55.599 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-15T22:17:55.600 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-15T22:17:55.601 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-15T22:17:55.602 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-15T22:17:55.603 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-15T22:17:55.604 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-15T22:17:55.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-15T22:17:55.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-15T22:17:55.607 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-15T22:17:55.608 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-15T22:17:55.609 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-15T22:17:55.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-15T22:17:55.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-15T22:17:55.612 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-15T22:17:55.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-15T22:17:55.614 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-15T22:17:55.615 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-15T22:17:55.616 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-15T22:17:55.617 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-15T22:17:55.618 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-15T22:17:55.619 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-15T22:17:55.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-15T22:17:55.621 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-15T22:17:55.622 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-15T22:17:55.624 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-15T22:17:55.625 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-15T22:17:55.626 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-15T22:17:55.627 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-15T22:17:55.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-15T22:17:55.629 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-15T22:17:55.630 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-15T22:17:55.631 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-15T22:17:55.632 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-15T22:17:55.633 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-15T22:17:55.635 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-15T22:17:55.635 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-15T22:17:55.636 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-15T22:17:55.637 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-15T22:17:55.638 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-15T22:17:55.639 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-15T22:17:55.640 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-15T22:17:55.641 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-15T22:17:55.642 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-15T22:17:55.644 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-15T22:17:55.645 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-15T22:17:55.646 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-15T22:17:55.647 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-15T22:17:55.648 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-15T22:17:55.649 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-15T22:17:55.650 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-15T22:17:55.651 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-15T22:17:55.652 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-15T22:17:55.653 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-15T22:17:55.654 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-15T22:17:55.655 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-15T22:17:55.656 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-15T22:17:55.657 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-15T22:17:55.658 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-15T22:17:55.660 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-15T22:17:55.661 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-15T22:17:55.662 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-15T22:17:55.663 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-15T22:17:55.664 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-15T22:17:55.665 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-15T22:17:55.666 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-15T22:17:55.667 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-15T22:17:55.668 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-15T22:17:55.669 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-15T22:17:55.670 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-15T22:17:55.671 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-15T22:17:55.672 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-15T22:17:55.674 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-15T22:17:55.675 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-15T22:17:55.676 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-15T22:17:55.678 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-15T22:17:55.679 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-15T22:17:55.680 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-15T22:17:55.681 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-15T22:17:55.683 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-15T22:17:55.684 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-15T22:17:55.685 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-15T22:17:55.686 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-15T22:17:55.688 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-15T22:17:55.689 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-15T22:17:55.690 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-15T22:17:55.691 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-15T22:17:55.693 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-15T22:17:55.694 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-15T22:17:55.695 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-15T22:17:55.696 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-15T22:17:55.698 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-15T22:17:55.699 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-15T22:17:55.700 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-15T22:17:55.701 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-15T22:17:55.703 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-15T22:17:55.704 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-15T22:17:55.705 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-15T22:17:55.706 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-15T22:17:55.707 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-15T22:17:55.709 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-15T22:17:55.710 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-15T22:17:55.711 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-15T22:17:55.713 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-15T22:17:55.717 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-15T22:17:55.717 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-15T22:17:55.717 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-15T22:17:55.718 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-15T22:17:55.719 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-15T22:17:55.722 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-15T22:17:55.723 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-15T22:17:55.724 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-15T22:17:55.726 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-15T22:17:55.727 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-15T22:17:55.728 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-15T22:17:55.729 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-15T22:17:55.731 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-15T22:17:55.732 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-15T22:17:55.733 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-15T22:17:55.735 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-15T22:17:55.735 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-15T22:17:55.737 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-15T22:17:55.738 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-15T22:17:55.739 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-15T22:17:55.740 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-15T22:17:55.742 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-15T22:17:55.743 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-15T22:17:55.744 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-15T22:17:55.745 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-15T22:17:55.747 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-15T22:17:55.748 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-15T22:17:55.749 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-15T22:17:55.750 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-15T22:17:55.751 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-15T22:17:55.753 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-15T22:17:55.754 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-15T22:17:55.755 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-15T22:17:55.756 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-15T22:17:55.758 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-15T22:17:55.759 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-15T22:17:55.760 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-15T22:17:55.761 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-15T22:17:55.763 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-15T22:17:55.764 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-15T22:17:55.765 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-15T22:17:55.766 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-15T22:17:55.768 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-15T22:17:55.769 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-15T22:17:55.770 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-15T22:17:55.771 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-15T22:17:55.772 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-15T22:17:55.773 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-15T22:17:55.775 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-15T22:17:55.776 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-15T22:17:55.777 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-15T22:17:55.778 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-15T22:17:55.780 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-15T22:17:55.781 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-15T22:17:55.782 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-15T22:17:55.783 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-15T22:17:55.785 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-15T22:17:55.786 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-15T22:17:55.787 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-15T22:17:55.788 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-15T22:17:55.790 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-15T22:17:55.791 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-15T22:17:55.792 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-15T22:17:55.793 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-15T22:17:55.795 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-15T22:17:55.796 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-15T22:17:55.797 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-15T22:17:55.798 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-15T22:17:55.800 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-15T22:17:55.801 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-15T22:17:55.802 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-15T22:17:55.803 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-15T22:17:55.804 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-15T22:17:55.806 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-15T22:17:55.807 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-15T22:17:55.808 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-15T22:17:55.809 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-15T22:17:55.810 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-15T22:17:55.812 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-15T22:17:55.813 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-15T22:17:55.814 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-15T22:17:55.815 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-15T22:17:55.817 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-15T22:17:55.818 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-15T22:17:55.819 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-15T22:17:55.820 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-15T22:17:55.821 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-15T22:17:55.822 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-15T22:17:55.824 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-15T22:17:55.825 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-15T22:17:55.826 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-15T22:17:55.827 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-15T22:17:55.829 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-15T22:17:55.830 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-15T22:17:55.831 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-15T22:17:55.832 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-15T22:17:55.834 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-15T22:17:55.835 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-15T22:17:55.836 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-15T22:17:55.837 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-15T22:17:55.839 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-15T22:17:55.840 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-15T22:17:55.841 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-15T22:17:55.842 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-15T22:17:55.844 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-15T22:17:55.845 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-15T22:17:55.849 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-15T22:17:55.850 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-15T22:17:55.851 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-15T22:17:55.853 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-15T22:17:55.854 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-15T22:17:55.855 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-15T22:17:55.856 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-15T22:17:55.857 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-15T22:17:55.859 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-15T22:17:55.860 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-15T22:17:55.861 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-15T22:17:55.862 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-15T22:17:55.864 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-15T22:17:55.865 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-15T22:17:55.866 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-15T22:17:55.868 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-15T22:17:55.869 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-15T22:17:55.870 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-15T22:17:55.871 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-15T22:17:55.872 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-15T22:17:55.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-15T22:17:55.874 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:55 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:17:55.874 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:55 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:55.874 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:55 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:17:55.875 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:55 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:55.875 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-15T22:17:55.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-15T22:17:55.877 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-15T22:17:55.879 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-15T22:17:55.880 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-15T22:17:55.881 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-15T22:17:55.882 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-15T22:17:55.883 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-15T22:17:55.884 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-15T22:17:55.885 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-15T22:17:55.887 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-15T22:17:55.888 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-15T22:17:55.889 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-15T22:17:55.890 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-15T22:17:55.892 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-15T22:17:55.893 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-15T22:17:55.894 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-15T22:17:55.895 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-15T22:17:55.896 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-15T22:17:55.897 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-15T22:17:55.898 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-15T22:17:55.899 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-15T22:17:55.900 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-15T22:17:55.901 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-15T22:17:55.902 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-15T22:17:55.903 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-15T22:17:55.904 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-15T22:17:55.905 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-15T22:17:55.907 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-15T22:17:55.908 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-15T22:17:55.909 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-15T22:17:55.910 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-15T22:17:55.912 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-15T22:17:55.913 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-15T22:17:55.914 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-15T22:17:55.915 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-15T22:17:55.916 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-15T22:17:55.918 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-15T22:17:55.920 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-15T22:17:55.920 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-15T22:17:55.921 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-15T22:17:55.923 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-15T22:17:55.924 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-15T22:17:55.925 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-15T22:17:55.926 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-15T22:17:55.927 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-15T22:17:55.929 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-15T22:17:55.930 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-15T22:17:55.931 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-15T22:17:55.933 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-15T22:17:55.934 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-15T22:17:55.935 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-15T22:17:55.936 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-15T22:17:55.937 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-15T22:17:55.939 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-15T22:17:55.940 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-15T22:17:55.941 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-15T22:17:55.942 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-15T22:17:55.944 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-15T22:17:55.945 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-15T22:17:55.946 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-15T22:17:55.948 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-15T22:17:55.949 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-15T22:17:55.950 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-15T22:17:55.951 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-15T22:17:55.952 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-15T22:17:55.953 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-15T22:17:55.955 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-15T22:17:55.956 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-15T22:17:55.957 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-15T22:17:55.958 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-15T22:17:55.960 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-15T22:17:55.961 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-15T22:17:55.962 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-15T22:17:55.963 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-15T22:17:55.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:55 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:17:55.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:55 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:55.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:55 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:17:55.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:55 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:55.965 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-15T22:17:55.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.961+0000 7f155534c640 1 -- 172.21.15.45:0/369246727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1550102de0 msgr2=0x7f15501031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:55.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.961+0000 7f155534c640 1 --2- 172.21.15.45:0/369246727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1550102de0 0x7f15501031c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1540009900 tx=0x7f154002a480 comp rx=0 tx=0).stop 2024-09-15T22:17:55.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.961+0000 7f155534c640 1 -- 172.21.15.45:0/369246727 shutdown_connections 2024-09-15T22:17:55.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.962+0000 7f155534c640 1 --2- 172.21.15.45:0/369246727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f155010c180 0x7f155010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.962+0000 7f155534c640 1 --2- 172.21.15.45:0/369246727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1550103700 0x7f155010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.962+0000 7f155534c640 1 --2- 172.21.15.45:0/369246727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1550102de0 0x7f15501031c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.962+0000 7f155534c640 1 -- 172.21.15.45:0/369246727 >> 172.21.15.45:0/369246727 conn(0x7f15500fc7a0 msgr2=0x7f15500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:55.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.962+0000 7f155534c640 1 -- 172.21.15.45:0/369246727 shutdown_connections 2024-09-15T22:17:55.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.962+0000 7f155534c640 1 -- 172.21.15.45:0/369246727 wait complete. 2024-09-15T22:17:55.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.962+0000 7f155534c640 1 Processor -- start 2024-09-15T22:17:55.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f155534c640 1 -- start start 2024-09-15T22:17:55.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f155534c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1550102de0 0x7f15501984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f155534c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1550103700 0x7f1550198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f155534c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f155010c180 0x7f155019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f155534c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1550112070 con 0x7f155010c180 2024-09-15T22:17:55.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f155534c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1550111ef0 con 0x7f1550103700 2024-09-15T22:17:55.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f155534c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f15501121f0 con 0x7f1550102de0 2024-09-15T22:17:55.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f154f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f155010c180 0x7f155019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f154effd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1550102de0 0x7f15501984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f154f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f155010c180 0x7f155019cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40960/0 (socket says 172.21.15.45:40960) 2024-09-15T22:17:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f154f7fe640 1 -- 172.21.15.45:0/2794793817 learned_addr learned my addr 172.21.15.45:0/2794793817 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f154e7fc640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1550103700 0x7f1550198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f154e7fc640 1 -- 172.21.15.45:0/2794793817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1550102de0 msgr2=0x7f15501984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f154e7fc640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1550102de0 0x7f15501984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f154e7fc640 1 -- 172.21.15.45:0/2794793817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f155010c180 msgr2=0x7f155019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f154e7fc640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f155010c180 0x7f155019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f154e7fc640 1 -- 172.21.15.45:0/2794793817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155019d4a0 con 0x7f1550103700 2024-09-15T22:17:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f154effd640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1550102de0 0x7f15501984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.963+0000 7f154f7fe640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f155010c180 0x7f155019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.964+0000 7f154e7fc640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1550103700 0x7f1550198a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1544005fd0 tx=0x7f154400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.964+0000 7f1537fff640 1 -- 172.21.15.45:0/2794793817 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544009c30 con 0x7f1550103700 2024-09-15T22:17:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.964+0000 7f155534c640 1 -- 172.21.15.45:0/2794793817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f155019d790 con 0x7f1550103700 2024-09-15T22:17:55.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.964+0000 7f1537fff640 1 -- 172.21.15.45:0/2794793817 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1544009dd0 con 0x7f1550103700 2024-09-15T22:17:55.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.964+0000 7f1537fff640 1 -- 172.21.15.45:0/2794793817 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544010460 con 0x7f1550103700 2024-09-15T22:17:55.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.964+0000 7f155534c640 1 -- 172.21.15.45:0/2794793817 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15501a5070 con 0x7f1550103700 2024-09-15T22:17:55.969 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-15T22:17:55.969 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-15T22:17:55.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.966+0000 7f1537fff640 1 -- 172.21.15.45:0/2794793817 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1544004000 con 0x7f1550103700 2024-09-15T22:17:55.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f1557725740 1 Processor -- start 2024-09-15T22:17:55.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f1557725740 1 -- start start 2024-09-15T22:17:55.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f1557725740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17d380 0x56163b17d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f1557725740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b17dca0 0x56163b18c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f1537fff640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f15380a33b0 0x7f15380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f1557725740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b18ca90 0x56163b18ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f1557725740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56163b0e32e0 con 0x56163b17dca0 2024-09-15T22:17:55.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f1557725740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56163b08ace0 con 0x56163b18ca90 2024-09-15T22:17:55.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f1557725740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56163b0df2a0 con 0x56163b17d380 2024-09-15T22:17:55.971 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-15T22:17:55.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f154effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b17dca0 0x56163b18c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f154e7fc640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f15380a33b0 0x7f15380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f154effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b17dca0 0x56163b18c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40972/0 (socket says 172.21.15.45:40972) 2024-09-15T22:17:55.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f154f7fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17d380 0x56163b17d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f154effd640 1 -- 172.21.15.45:0/1511713079 learned_addr learned my addr 172.21.15.45:0/1511713079 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:55.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.967+0000 7f154f7fe640 1 --2- 172.21.15.45:0/1511713079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b18ca90 0x56163b18ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.968+0000 7f1537fff640 1 -- 172.21.15.45:0/2794793817 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f15440cfbf0 con 0x7f1550103700 2024-09-15T22:17:55.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.968+0000 7f154f7fe640 1 -- 172.21.15.45:0/1511713079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b18ca90 msgr2=0x56163b18ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:55.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.968+0000 7f154f7fe640 1 --2- 172.21.15.45:0/1511713079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b18ca90 0x56163b18ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.968+0000 7f154f7fe640 1 -- 172.21.15.45:0/1511713079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b17dca0 msgr2=0x56163b18c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:55.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.968+0000 7f154f7fe640 1 --2- 172.21.15.45:0/1511713079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b17dca0 0x56163b18c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.968+0000 7f154f7fe640 1 -- 172.21.15.45:0/1511713079 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56163b06f440 con 0x56163b17d380 2024-09-15T22:17:55.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.968+0000 7f154effd640 1 --2- 172.21.15.45:0/1511713079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b17dca0 0x56163b18c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:17:55.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.968+0000 7f154f7fe640 1 --2- 172.21.15.45:0/1511713079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17d380 0x56163b17d760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1548009aa0 tx=0x7f1548009a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=519b25eafb41913c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:55.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.968+0000 7f154e7fc640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f15380a33b0 0x7f15380a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f15440a41f0 tx=0x7f154406e990 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:55.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.968+0000 7f15357fa640 1 -- 172.21.15.45:0/1511713079 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548011d00 con 0x56163b17d380 2024-09-15T22:17:55.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.968+0000 7f15357fa640 1 -- 172.21.15.45:0/1511713079 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1548004b20 con 0x56163b17d380 2024-09-15T22:17:55.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.968+0000 7f15357fa640 1 -- 172.21.15.45:0/1511713079 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15480059a0 con 0x56163b17d380 2024-09-15T22:17:55.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.969+0000 7f1557725740 1 -- 172.21.15.45:0/1511713079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17d380 msgr2=0x56163b17d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:55.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.969+0000 7f1557725740 1 --2- 172.21.15.45:0/1511713079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17d380 0x56163b17d760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1548009aa0 tx=0x7f1548009a30 comp rx=0 tx=0).stop 2024-09-15T22:17:55.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.969+0000 7f1557725740 1 -- 172.21.15.45:0/1511713079 shutdown_connections 2024-09-15T22:17:55.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.969+0000 7f1557725740 1 --2- 172.21.15.45:0/1511713079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b18ca90 0x56163b18ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.969+0000 7f1557725740 1 --2- 172.21.15.45:0/1511713079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b17dca0 0x56163b18c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.969+0000 7f1557725740 1 --2- 172.21.15.45:0/1511713079 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17d380 0x56163b17d760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.969+0000 7f1557725740 1 -- 172.21.15.45:0/1511713079 >> 172.21.15.45:0/1511713079 conn(0x56163b179a30 msgr2=0x56163b179e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:55.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.969+0000 7f1557725740 1 -- 172.21.15.45:0/1511713079 shutdown_connections 2024-09-15T22:17:55.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.969+0000 7f1557725740 1 -- 172.21.15.45:0/1511713079 wait complete. 2024-09-15T22:17:55.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.969+0000 7f1557725740 1 -- start start 2024-09-15T22:17:55.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.969+0000 7f1557725740 1 Processor -- start 2024-09-15T22:17:55.975 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-15T22:17:55.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f1557725740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b18c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f1557725740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b189650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f1557725740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b189b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f1557725740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56163b18f660 con 0x56163b18ca90 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f1557725740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56163b09e050 con 0x56163b17d380 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f1557725740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56163b18f7e0 con 0x56163b17dca0 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f1557725740 10 client.0 _ll_register_callbacks cb 0x56163b0de160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f154effd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b189650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f154f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b189b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f154effd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b189650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:34076/0 (socket says 172.21.15.45:34076) 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f154effd640 1 -- 172.21.15.45:0/2565895375 learned_addr learned my addr 172.21.15.45:0/2565895375 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f154f7fe640 1 --2- 172.21.15.45:0/2565895375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b18c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f154effd640 1 -- 172.21.15.45:0/2565895375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 msgr2=0x56163b18c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f154effd640 1 --2- 172.21.15.45:0/2565895375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b18c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f154effd640 1 -- 172.21.15.45:0/2565895375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 msgr2=0x56163b189b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:55.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f154effd640 1 --2- 172.21.15.45:0/2565895375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b189b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f154effd640 1 -- 172.21.15.45:0/2565895375 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56163ae543c0 con 0x56163b17dca0 2024-09-15T22:17:55.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f154effd640 1 --2- 172.21.15.45:0/2565895375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b189650 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1540033000 tx=0x7f1540005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20f31f90ef6eb65d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:55.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.970+0000 7f1532ff5640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-15T22:17:55.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1532ff5640 1 -- 172.21.15.45:0/2565895375 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1540035040 con 0x56163b17dca0 2024-09-15T22:17:55.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1557725740 1 -- 172.21.15.45:0/2565895375 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1548004b20 con 0x56163b17dca0 2024-09-15T22:17:55.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1532ff5640 1 -- 172.21.15.45:0/2565895375 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f1540004050 con 0x56163b17dca0 2024-09-15T22:17:55.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1532ff5640 1 -- 172.21.15.45:0/2565895375 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1540004250 con 0x56163b17dca0 2024-09-15T22:17:55.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1557725740 10 client.25375 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:55.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1557725740 1 -- 172.21.15.45:0/2565895375 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56163b19b060 con 0x56163b17dca0 2024-09-15T22:17:55.978 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-15T22:17:55.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1532ff5640 1 -- 172.21.15.45:0/2565895375 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1548004b20 con 0x56163b17dca0 2024-09-15T22:17:55.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1532ff5640 1 -- 172.21.15.45:0/2565895375 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1540003980 con 0x56163b17dca0 2024-09-15T22:17:55.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1557725740 10 client.25375 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:55.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1557725740 10 client.25375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:55.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1557725740 20 client.25375 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:55.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1557725740 1 --2- 172.21.15.45:0/2565895375 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56163b19c470 0x56163b19e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1557725740 4 client.25375 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:17:55.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.971+0000 7f1557725740 1 -- 172.21.15.45:0/2565895375 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56163b0f0850 con 0x56163b19c470 2024-09-15T22:17:55.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.972+0000 7f154f7fe640 1 --2- 172.21.15.45:0/2565895375 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56163b19c470 0x56163b19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.972+0000 7f154f7fe640 1 --2- 172.21.15.45:0/2565895375 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56163b19c470 0x56163b19e890 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=766c398e1cbe0ec3 server_cookie=cb8b76a334091564 in_seq=0 out_seq=0 2024-09-15T22:17:55.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.972+0000 7f1532ff5640 10 client.25375 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:55.980 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-15T22:17:55.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.974+0000 7f1532ff5640 1 -- 172.21.15.45:0/2565895375 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56163b0f0850 con 0x56163b19c470 2024-09-15T22:17:55.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.974+0000 7f1532ff5640 10 client.25375 handle_command_reply: tid=0 2024-09-15T22:17:55.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.974+0000 7f1557725740 1 client.25375 shutdown 2024-09-15T22:17:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.974+0000 7f1557725740 1 -- 172.21.15.45:0/2565895375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 msgr2=0x56163b189650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.974+0000 7f1557725740 1 --2- 172.21.15.45:0/2565895375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b189650 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1540033000 tx=0x7f1540005040 comp rx=0 tx=0).stop 2024-09-15T22:17:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.975+0000 7f1557725740 1 -- 172.21.15.45:0/2565895375 shutdown_connections 2024-09-15T22:17:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.975+0000 7f1557725740 1 --2- 172.21.15.45:0/2565895375 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56163b19c470 0x56163b19e890 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.975+0000 7f1557725740 1 --2- 172.21.15.45:0/2565895375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b189b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.975+0000 7f1557725740 1 --2- 172.21.15.45:0/2565895375 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b189650 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.975+0000 7f1532ff5640 0 client.25375 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.975+0000 7f1557725740 1 --2- 172.21.15.45:0/2565895375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b18c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.975+0000 7f1557725740 1 -- 172.21.15.45:0/2565895375 >> 172.21.15.45:0/2565895375 conn(0x56163b179a30 msgr2=0x56163b17f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.975+0000 7f1557725740 1 -- 172.21.15.45:0/2565895375 shutdown_connections 2024-09-15T22:17:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.975+0000 7f1557725740 1 -- 172.21.15.45:0/2565895375 wait complete. 2024-09-15T22:17:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.975+0000 7f1557725740 20 client.25375 trim_cache size 0 max 16384 2024-09-15T22:17:55.983 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-15T22:17:55.983 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-15T22:17:55.983 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-15T22:17:55.983 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-15T22:17:55.983 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-15T22:17:55.984 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-15T22:17:55.985 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-15T22:17:55.986 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-15T22:17:55.987 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-15T22:17:55.988 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-15T22:17:55.989 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-15T22:17:55.991 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-15T22:17:55.992 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-15T22:17:55.993 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-15T22:17:55.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:55 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:17:55.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:55 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:55.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:55 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:17:55.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:55 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:17:55.994 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-15T22:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.992+0000 7f1557725740 1 Processor -- start 2024-09-15T22:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.992+0000 7f1557725740 1 -- start start 2024-09-15T22:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.992+0000 7f1557725740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b198900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.992+0000 7f1557725740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b187f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.992+0000 7f1557725740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b1a4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.992+0000 7f1557725740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f15501aaf70 con 0x56163b18ca90 2024-09-15T22:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.992+0000 7f1557725740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15501ad7f0 con 0x56163b17d380 2024-09-15T22:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.992+0000 7f1557725740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f15501ab5e0 con 0x56163b17dca0 2024-09-15T22:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f154f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b1a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f154f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b1a4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40986/0 (socket says 172.21.15.45:40986) 2024-09-15T22:17:55.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f154f7fe640 1 -- 172.21.15.45:0/4227688038 learned_addr learned my addr 172.21.15.45:0/4227688038 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:55.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f154f7fe640 1 --2- 172.21.15.45:0/4227688038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f154effd640 1 --2- 172.21.15.45:0/4227688038 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b187f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:55.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f154f7fe640 1 -- 172.21.15.45:0/4227688038 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 msgr2=0x56163b187f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:55.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f154f7fe640 1 --2- 172.21.15.45:0/4227688038 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b187f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f154f7fe640 1 -- 172.21.15.45:0/4227688038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 msgr2=0x56163b198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:55.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f154f7fe640 1 --2- 172.21.15.45:0/4227688038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f154f7fe640 1 -- 172.21.15.45:0/4227688038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56163b18f1c0 con 0x56163b18ca90 2024-09-15T22:17:55.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f154f7fe640 1 --2- 172.21.15.45:0/4227688038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b1a4160 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1548009600 tx=0x7f1548015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4021df7adf27914a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:55.997 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-15T22:17:55.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f1534ff9640 1 -- 172.21.15.45:0/4227688038 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15480303d0 con 0x56163b18ca90 2024-09-15T22:17:55.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f1534ff9640 1 -- 172.21.15.45:0/4227688038 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1548034070 con 0x56163b18ca90 2024-09-15T22:17:55.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.993+0000 7f1534ff9640 1 -- 172.21.15.45:0/4227688038 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154802f970 con 0x56163b18ca90 2024-09-15T22:17:55.998 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.994+0000 7f1557725740 1 -- 172.21.15.45:0/4227688038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 msgr2=0x56163b1a4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:55.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.994+0000 7f1557725740 1 --2- 172.21.15.45:0/4227688038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b1a4160 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1548009600 tx=0x7f1548015040 comp rx=0 tx=0).stop 2024-09-15T22:17:55.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.994+0000 7f1557725740 1 -- 172.21.15.45:0/4227688038 shutdown_connections 2024-09-15T22:17:55.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.994+0000 7f1557725740 1 --2- 172.21.15.45:0/4227688038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b1a4160 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.994+0000 7f1557725740 1 --2- 172.21.15.45:0/4227688038 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b187f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.994+0000 7f1557725740 1 --2- 172.21.15.45:0/4227688038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:55.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.994+0000 7f1557725740 1 -- 172.21.15.45:0/4227688038 >> 172.21.15.45:0/4227688038 conn(0x56163b179a30 msgr2=0x56163b18b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:55.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.994+0000 7f1557725740 1 -- 172.21.15.45:0/4227688038 shutdown_connections 2024-09-15T22:17:55.999 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.994+0000 7f1557725740 1 -- 172.21.15.45:0/4227688038 wait complete. 2024-09-15T22:17:55.999 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-15T22:17:56.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.994+0000 7f1557725740 1 -- start start 2024-09-15T22:17:56.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.994+0000 7f1557725740 1 Processor -- start 2024-09-15T22:17:56.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f1557725740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b183c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f1557725740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b194a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f1557725740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b194fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f1557725740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f15501abcb0 con 0x56163b18ca90 2024-09-15T22:17:56.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f1557725740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15501ad120 con 0x56163b17d380 2024-09-15T22:17:56.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f1557725740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f15501ac380 con 0x56163b17dca0 2024-09-15T22:17:56.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f1557725740 10 client.0 _ll_register_callbacks cb 0x7f1540031490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f154f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b183c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f154f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b183c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:46978/0 (socket says 172.21.15.45:46978) 2024-09-15T22:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f154f7fe640 1 -- 172.21.15.45:0/3777419550 learned_addr learned my addr 172.21.15.45:0/3777419550 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f154f7fe640 1 --2- 172.21.15.45:0/3777419550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b194fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f154effd640 1 --2- 172.21.15.45:0/3777419550 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b194a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f154f7fe640 1 -- 172.21.15.45:0/3777419550 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 msgr2=0x56163b194a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f154f7fe640 1 --2- 172.21.15.45:0/3777419550 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b194a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f154f7fe640 1 -- 172.21.15.45:0/3777419550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 msgr2=0x56163b194fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f154f7fe640 1 --2- 172.21.15.45:0/3777419550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b194fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f154f7fe640 1 -- 172.21.15.45:0/3777419550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56163b195650 con 0x56163b17d380 2024-09-15T22:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f154f7fe640 1 --2- 172.21.15.45:0/3777419550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b183c70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1548009ee0 tx=0x7f154802f550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5299e7be2214923f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:17:56.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.995+0000 7f1532ff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-15T22:17:56.003 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-15T22:17:56.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1532ff5640 1 -- 172.21.15.45:0/3777419550 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154803d020 con 0x56163b17d380 2024-09-15T22:17:56.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1557725740 1 -- 172.21.15.45:0/3777419550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1548034070 con 0x56163b17d380 2024-09-15T22:17:56.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1532ff5640 1 -- 172.21.15.45:0/3777419550 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f154802f850 con 0x56163b17d380 2024-09-15T22:17:56.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1532ff5640 1 -- 172.21.15.45:0/3777419550 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f154802fa50 con 0x56163b17d380 2024-09-15T22:17:56.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1557725740 10 client.25460 fetch_fsmap learned FSMap version 21 2024-09-15T22:17:56.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1557725740 1 -- 172.21.15.45:0/3777419550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56163b20b980 con 0x56163b17d380 2024-09-15T22:17:56.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1532ff5640 1 -- 172.21.15.45:0/3777419550 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1548034070 con 0x56163b17d380 2024-09-15T22:17:56.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1532ff5640 1 -- 172.21.15.45:0/3777419550 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1548038030 con 0x56163b17d380 2024-09-15T22:17:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1557725740 10 client.25460 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:17:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1557725740 10 client.25460 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:17:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1557725740 20 client.25460 populate_metadata read hostname 'smithi045' 2024-09-15T22:17:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1557725740 1 --2- 172.21.15.45:0/3777419550 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56163b20bde0 0x56163b20e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:17:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1557725740 4 client.25460 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:17:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f1557725740 1 -- 172.21.15.45:0/3777419550 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56163b0ead60 con 0x56163b20bde0 2024-09-15T22:17:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.996+0000 7f154effd640 1 --2- 172.21.15.45:0/3777419550 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56163b20bde0 0x56163b20e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:17:56.005 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-15T22:17:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.997+0000 7f1532ff5640 10 client.25460 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:55.997+0000 7f154effd640 1 --2- 172.21.15.45:0/3777419550 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56163b20bde0 0x56163b20e1d0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0eb6c7b9c945775 server_cookie=28d521a5ddd4592b in_seq=0 out_seq=0 2024-09-15T22:17:56.006 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-15T22:17:56.006 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-15T22:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1532ff5640 1 -- 172.21.15.45:0/3777419550 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56163b0ead60 con 0x56163b20bde0 2024-09-15T22:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1532ff5640 10 client.25460 handle_command_reply: tid=0 2024-09-15T22:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1557725740 1 client.25460 shutdown 2024-09-15T22:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1557725740 1 -- 172.21.15.45:0/3777419550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 msgr2=0x56163b183c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1557725740 1 --2- 172.21.15.45:0/3777419550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b183c70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1548009ee0 tx=0x7f154802f550 comp rx=0 tx=0).stop 2024-09-15T22:17:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1557725740 1 -- 172.21.15.45:0/3777419550 shutdown_connections 2024-09-15T22:17:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1557725740 1 --2- 172.21.15.45:0/3777419550 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56163b20bde0 0x56163b20e1d0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1557725740 1 --2- 172.21.15.45:0/3777419550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56163b18ca90 0x56163b194fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1557725740 1 --2- 172.21.15.45:0/3777419550 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56163b17dca0 0x56163b194a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1532ff5640 0 client.25460 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:17:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1557725740 1 --2- 172.21.15.45:0/3777419550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56163b17d380 0x56163b183c70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1557725740 1 -- 172.21.15.45:0/3777419550 >> 172.21.15.45:0/3777419550 conn(0x56163b179a30 msgr2=0x56163b178350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1557725740 1 -- 172.21.15.45:0/3777419550 shutdown_connections 2024-09-15T22:17:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1557725740 1 -- 172.21.15.45:0/3777419550 wait complete. 2024-09-15T22:17:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.000+0000 7f1557725740 20 client.25460 trim_cache size 0 max 16384 2024-09-15T22:17:56.009 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:17:56.009 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:17:56.009 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:17:56.009 INFO:teuthology.orchestra.run.smithi045.stdout: "211cca01-82df-489c-86f4-c5ceef255eec": { 2024-09-15T22:17:56.009 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:17:56.009 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "211cca01-82df-489c-86f4-c5ceef255eec", 2024-09-15T22:17:56.009 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:17:56.009 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:56.009 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:17:56.009 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:17:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.001+0000 7f155534c640 1 -- 172.21.15.45:0/2794793817 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f15380a33b0 msgr2=0x7f15380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.001+0000 7f155534c640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f15380a33b0 0x7f15380a5870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f15440a41f0 tx=0x7f154406e990 comp rx=0 tx=0).stop 2024-09-15T22:17:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.001+0000 7f155534c640 1 -- 172.21.15.45:0/2794793817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1550103700 msgr2=0x7f1550198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:17:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.001+0000 7f155534c640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1550103700 0x7f1550198a30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1544005fd0 tx=0x7f154400dde0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.001+0000 7f155534c640 1 -- 172.21.15.45:0/2794793817 shutdown_connections 2024-09-15T22:17:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.001+0000 7f155534c640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f15380a33b0 0x7f15380a5870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.001+0000 7f155534c640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f155010c180 0x7f155019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.001+0000 7f155534c640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1550103700 0x7f1550198a30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.011 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-15T22:17:56.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.001+0000 7f155534c640 1 --2- 172.21.15.45:0/2794793817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1550102de0 0x7f15501984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:17:56.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.001+0000 7f155534c640 1 -- 172.21.15.45:0/2794793817 >> 172.21.15.45:0/2794793817 conn(0x7f15500fc7a0 msgr2=0x7f15500fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:17:56.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.001+0000 7f155534c640 1 -- 172.21.15.45:0/2794793817 shutdown_connections 2024-09-15T22:17:56.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:17:56.001+0000 7f155534c640 1 -- 172.21.15.45:0/2794793817 wait complete. 2024-09-15T22:17:56.012 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-15T22:17:56.012 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-15T22:17:56.012 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-15T22:17:56.013 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-15T22:17:56.013 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-15T22:17:56.013 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-15T22:17:56.013 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-15T22:17:56.013 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-15T22:17:56.013 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-15T22:17:56.014 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-15T22:17:56.015 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-15T22:17:56.016 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-15T22:17:56.017 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-15T22:17:56.018 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-15T22:17:56.019 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-15T22:17:56.020 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-15T22:17:56.021 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-15T22:17:56.022 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-15T22:17:56.024 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-15T22:17:56.025 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-15T22:17:56.026 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-15T22:17:56.027 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-15T22:17:56.028 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-15T22:17:56.029 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-15T22:17:56.030 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-15T22:17:56.031 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-15T22:17:56.033 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-15T22:17:56.034 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-15T22:17:56.035 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-15T22:17:56.036 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-15T22:17:56.037 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-15T22:17:56.038 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-15T22:17:56.039 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-15T22:17:56.040 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-15T22:17:56.042 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-15T22:17:56.043 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-15T22:17:56.044 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-15T22:17:56.045 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-15T22:17:56.046 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-15T22:17:56.047 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-15T22:17:56.048 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-15T22:17:56.049 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-15T22:17:56.050 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-15T22:17:56.051 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-15T22:17:56.052 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-15T22:17:56.053 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-15T22:17:56.053 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-15T22:17:56.054 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-15T22:17:56.055 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-15T22:17:56.056 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-15T22:17:56.057 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-15T22:17:56.058 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-15T22:17:56.059 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-15T22:17:56.059 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-15T22:17:56.060 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-15T22:17:56.061 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-15T22:17:56.062 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-15T22:17:56.063 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-15T22:17:56.064 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-15T22:17:56.064 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-15T22:17:56.065 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-15T22:17:56.066 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-15T22:17:56.067 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-15T22:17:56.068 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-15T22:17:56.069 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-15T22:17:56.070 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-15T22:17:56.071 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-15T22:17:56.072 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-15T22:17:56.073 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-15T22:17:56.073 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-15T22:17:56.074 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-15T22:17:56.075 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-15T22:17:56.076 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-15T22:17:56.077 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-15T22:17:56.078 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-15T22:17:56.079 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-15T22:17:56.080 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-15T22:17:56.081 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-15T22:17:56.082 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-15T22:17:56.082 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-15T22:17:56.083 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-15T22:17:56.084 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-15T22:17:56.085 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-15T22:17:56.086 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-15T22:17:56.087 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-15T22:17:56.088 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-15T22:17:56.089 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-15T22:17:56.090 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-15T22:17:56.091 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-15T22:17:56.091 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-15T22:17:56.092 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-15T22:17:56.093 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-15T22:17:56.094 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-15T22:17:56.095 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-15T22:17:56.096 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-15T22:17:56.097 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-15T22:17:56.098 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-15T22:17:56.099 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-15T22:17:56.100 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-15T22:17:56.101 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-15T22:17:56.102 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-15T22:17:56.103 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-15T22:17:56.103 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-15T22:17:56.104 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-15T22:17:56.105 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-15T22:17:56.106 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-15T22:17:56.107 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-15T22:17:56.108 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-15T22:17:56.109 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-15T22:17:56.110 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-15T22:17:56.111 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-15T22:17:56.112 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-15T22:17:56.113 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-15T22:17:56.114 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-15T22:17:56.115 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-15T22:17:56.116 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-15T22:17:56.117 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-15T22:17:56.117 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-15T22:17:56.118 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-15T22:17:56.121 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-15T22:17:56.121 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-15T22:17:56.121 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-15T22:17:56.124 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-15T22:17:56.124 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-15T22:17:56.124 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-15T22:17:56.124 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-15T22:17:56.125 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-15T22:17:56.126 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-15T22:17:56.127 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-15T22:17:56.128 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-15T22:17:56.129 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-15T22:17:56.130 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-15T22:17:56.131 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-15T22:17:56.131 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-15T22:17:56.132 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-15T22:17:56.133 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-15T22:17:56.134 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-15T22:17:56.135 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-15T22:17:56.136 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-15T22:17:56.137 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-15T22:17:56.138 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-15T22:17:56.139 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-15T22:17:56.140 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-15T22:17:56.141 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-15T22:17:56.142 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-15T22:17:56.143 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-15T22:17:56.144 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-15T22:17:56.144 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-15T22:17:56.145 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-15T22:17:56.146 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-15T22:17:56.147 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-15T22:17:56.149 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-15T22:17:56.149 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-15T22:17:56.152 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-15T22:17:56.152 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-15T22:17:56.152 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-15T22:17:56.153 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-15T22:17:56.154 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-15T22:17:56.155 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-15T22:17:56.155 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-15T22:17:56.156 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-15T22:17:56.157 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-15T22:17:56.157 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-15T22:17:56.158 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-15T22:17:56.159 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-15T22:17:56.160 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-15T22:17:56.161 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-15T22:17:56.162 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-15T22:17:56.163 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-15T22:17:56.163 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-15T22:17:56.164 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-15T22:17:56.165 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-15T22:17:56.166 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-15T22:17:56.167 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-15T22:17:56.168 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-15T22:17:56.169 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-15T22:17:56.170 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-15T22:17:56.386 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-15T22:17:56.387 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-15T22:17:56.388 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-15T22:17:56.389 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-15T22:17:56.390 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-15T22:17:56.391 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-15T22:17:56.392 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-15T22:17:56.392 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-15T22:17:56.393 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-15T22:17:56.394 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-15T22:17:56.395 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-15T22:17:56.396 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-15T22:17:56.397 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-15T22:17:56.397 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-15T22:17:56.398 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-15T22:17:56.399 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-15T22:17:56.400 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-15T22:17:56.401 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-15T22:17:56.402 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-15T22:17:56.403 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-15T22:17:56.404 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-15T22:17:56.405 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-15T22:17:56.406 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-15T22:17:56.407 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-15T22:17:56.407 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-15T22:17:56.408 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-15T22:17:56.409 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-15T22:17:56.410 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-15T22:17:56.410 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-15T22:17:56.411 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-15T22:17:56.412 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-15T22:17:56.413 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-15T22:17:56.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-15T22:17:56.415 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-15T22:17:56.416 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-15T22:17:56.417 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-15T22:17:56.418 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-15T22:17:56.419 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-15T22:17:56.419 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-15T22:17:56.420 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-15T22:17:56.421 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-15T22:17:56.422 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-15T22:17:56.422 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-15T22:17:56.423 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-15T22:17:56.424 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-15T22:17:56.425 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-15T22:17:56.425 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-15T22:17:56.426 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-15T22:17:56.427 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-15T22:17:56.428 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-15T22:17:56.428 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-15T22:17:56.429 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-15T22:17:56.430 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-15T22:17:56.431 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-15T22:17:56.432 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-15T22:17:56.433 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-15T22:17:56.434 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-15T22:17:56.435 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-15T22:17:56.436 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-15T22:17:56.436 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-15T22:17:56.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-15T22:17:56.438 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-15T22:17:56.439 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-15T22:17:56.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-15T22:17:56.441 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-15T22:17:56.442 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-15T22:17:56.443 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-15T22:17:56.444 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-15T22:17:56.445 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-15T22:17:56.445 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-15T22:17:56.446 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-15T22:17:56.447 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-15T22:17:56.448 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-15T22:17:56.449 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-15T22:17:56.450 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-15T22:17:56.451 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-15T22:17:56.452 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-15T22:17:56.453 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-15T22:17:56.454 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-15T22:17:56.455 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-15T22:17:56.456 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-15T22:17:56.456 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-15T22:17:56.457 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-15T22:17:56.458 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-15T22:17:56.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-15T22:17:56.460 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-15T22:17:56.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-15T22:17:56.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-15T22:17:56.462 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-15T22:17:56.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-15T22:17:56.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-15T22:17:56.464 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-15T22:17:56.465 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-15T22:17:56.466 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-15T22:17:56.467 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-15T22:17:56.468 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-15T22:17:56.468 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-15T22:17:56.469 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-15T22:17:56.470 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-15T22:17:56.471 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-15T22:17:56.472 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-15T22:17:56.473 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-15T22:17:56.473 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-15T22:17:56.474 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-15T22:17:56.475 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-15T22:17:56.476 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-15T22:17:56.476 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-15T22:17:56.477 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-15T22:17:56.478 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-15T22:17:56.479 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-15T22:17:56.480 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-15T22:17:56.481 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-15T22:17:56.482 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-15T22:17:56.483 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-15T22:17:56.484 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-15T22:17:56.485 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-15T22:17:56.486 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-15T22:17:56.486 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-15T22:17:56.487 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-15T22:17:56.488 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-15T22:17:56.489 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-15T22:17:56.489 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-15T22:17:56.490 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-15T22:17:56.491 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-15T22:17:56.492 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-15T22:17:56.493 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-15T22:17:56.494 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-15T22:17:56.495 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-15T22:17:56.496 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-15T22:17:56.496 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-15T22:17:56.497 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-15T22:17:56.498 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-15T22:17:56.499 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-15T22:17:56.500 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-15T22:17:56.500 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-15T22:17:56.501 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-15T22:17:56.502 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-15T22:17:56.503 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-15T22:17:56.504 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-15T22:17:56.505 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-15T22:17:56.506 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-15T22:17:56.507 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-15T22:17:56.507 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-15T22:17:56.508 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-15T22:17:56.509 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-15T22:17:56.510 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-15T22:17:56.511 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-15T22:17:56.512 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-15T22:17:56.513 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-15T22:17:56.513 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-15T22:17:56.514 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-15T22:17:56.515 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-15T22:17:56.516 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-15T22:17:56.517 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-15T22:17:56.518 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-15T22:17:56.519 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-15T22:17:56.519 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-15T22:17:56.520 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-15T22:17:56.521 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-15T22:17:56.522 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-15T22:17:56.523 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-15T22:17:56.524 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-15T22:17:56.525 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-15T22:17:56.526 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-15T22:17:56.527 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-15T22:17:56.528 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-15T22:17:56.532 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-15T22:17:56.532 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-15T22:17:56.532 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-15T22:17:56.532 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-15T22:17:56.533 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-15T22:17:56.533 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-15T22:17:56.534 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-15T22:17:56.535 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-15T22:17:56.535 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-15T22:17:56.536 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-15T22:17:56.537 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-15T22:17:56.538 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-15T22:17:56.538 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-15T22:17:56.539 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-15T22:17:56.540 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-15T22:17:56.541 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-15T22:17:56.542 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-15T22:17:56.543 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-15T22:17:56.544 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-15T22:17:56.545 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-15T22:17:56.546 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-15T22:17:56.547 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-15T22:17:56.548 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-15T22:17:56.549 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-15T22:17:56.550 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-15T22:17:56.550 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-15T22:17:56.551 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-15T22:17:56.552 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-15T22:17:56.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-15T22:17:56.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-15T22:17:56.554 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-15T22:17:56.555 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-15T22:17:56.556 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-15T22:17:56.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-15T22:17:56.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-15T22:17:56.558 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-15T22:17:56.559 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-15T22:17:56.560 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-15T22:17:56.560 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-15T22:17:56.561 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-15T22:17:56.562 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-15T22:17:56.563 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-15T22:17:56.564 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-15T22:17:56.565 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-15T22:17:56.566 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-15T22:17:56.567 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-15T22:17:56.570 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-15T22:17:56.570 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-15T22:17:56.570 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-15T22:17:56.570 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-15T22:17:56.571 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-15T22:17:56.571 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-15T22:17:56.572 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-15T22:17:56.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-15T22:17:56.574 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-15T22:17:56.575 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-15T22:17:56.576 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-15T22:17:56.577 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-15T22:17:56.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-15T22:17:56.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-15T22:17:56.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-15T22:17:56.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-15T22:17:56.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-15T22:17:56.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-15T22:17:56.583 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-15T22:17:56.584 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-15T22:17:56.585 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-15T22:17:56.586 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-15T22:17:56.587 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-15T22:17:56.588 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-15T22:17:56.589 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-15T22:17:56.590 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-15T22:17:56.591 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-15T22:17:56.591 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-15T22:17:56.592 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-15T22:17:56.593 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-15T22:17:56.594 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-15T22:17:56.594 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-15T22:17:56.595 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-15T22:17:56.596 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-15T22:17:56.597 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-15T22:17:56.598 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-15T22:17:56.599 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-15T22:17:56.599 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-15T22:17:56.600 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-15T22:17:56.601 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-15T22:17:56.602 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-15T22:17:56.603 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-15T22:17:56.604 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-15T22:17:56.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-15T22:17:56.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-15T22:17:56.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-15T22:17:56.607 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-15T22:17:56.608 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-15T22:17:56.609 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-15T22:17:56.610 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-15T22:17:56.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-15T22:17:56.612 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-15T22:17:56.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-15T22:17:56.614 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-15T22:17:56.615 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-15T22:17:56.616 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-15T22:17:56.616 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-15T22:17:56.617 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-15T22:17:56.618 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-15T22:17:56.619 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-15T22:17:56.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-15T22:17:56.621 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-15T22:17:56.622 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-15T22:17:56.623 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-15T22:17:56.624 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-15T22:17:56.624 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-15T22:17:56.625 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-15T22:17:56.626 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-15T22:17:56.627 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-15T22:17:56.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-15T22:17:56.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-15T22:17:56.629 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-15T22:17:56.630 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-15T22:17:56.631 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-15T22:17:56.632 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-15T22:17:56.632 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-15T22:17:56.633 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-15T22:17:56.634 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-15T22:17:56.635 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-15T22:17:56.636 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-15T22:17:56.636 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-15T22:17:56.637 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-15T22:17:56.638 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-15T22:17:56.639 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-15T22:17:56.639 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-15T22:17:56.640 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-15T22:17:56.641 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-15T22:17:56.642 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-15T22:17:56.643 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-15T22:17:56.643 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-15T22:17:56.644 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-15T22:17:56.645 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-15T22:17:56.646 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-15T22:17:56.647 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-15T22:17:56.647 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-15T22:17:56.648 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-15T22:17:56.649 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-15T22:17:56.650 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-15T22:17:56.650 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-15T22:17:56.651 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-15T22:17:56.652 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-15T22:17:56.653 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-15T22:17:56.654 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-15T22:17:56.655 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-15T22:17:56.656 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-15T22:17:56.657 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-15T22:17:56.658 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-15T22:17:56.659 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-15T22:17:56.660 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-15T22:17:56.660 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-15T22:17:56.661 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-15T22:17:56.662 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-15T22:17:56.663 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-15T22:17:56.664 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-15T22:17:56.665 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-15T22:17:56.666 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-15T22:17:56.667 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-15T22:17:56.668 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-15T22:17:56.669 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-15T22:17:56.670 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-15T22:17:56.671 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-15T22:17:56.671 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-15T22:17:56.672 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-15T22:17:56.673 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-15T22:17:56.674 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-15T22:17:56.675 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-15T22:17:56.675 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-15T22:17:56.676 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-15T22:17:56.677 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-15T22:17:56.678 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-15T22:17:56.678 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-15T22:17:56.679 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-15T22:17:56.680 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-15T22:17:56.681 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-15T22:17:56.682 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-15T22:17:56.683 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-15T22:17:56.683 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-15T22:17:56.684 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-15T22:17:56.685 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-15T22:17:56.686 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-15T22:17:56.687 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-15T22:17:56.688 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-15T22:17:56.688 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-15T22:17:56.689 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-15T22:17:56.690 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-15T22:17:56.691 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-15T22:17:56.691 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-15T22:17:56.692 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-15T22:17:56.693 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-15T22:17:56.694 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-15T22:17:56.695 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-15T22:17:56.696 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-15T22:17:56.697 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-15T22:17:56.697 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-15T22:17:56.698 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-15T22:17:56.699 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-15T22:17:56.700 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-15T22:17:56.701 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-15T22:17:56.702 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-15T22:17:56.702 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-15T22:17:56.703 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-15T22:17:56.704 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-15T22:17:56.705 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-15T22:17:56.705 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-15T22:17:56.706 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-15T22:17:56.707 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-15T22:17:56.708 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-15T22:17:56.709 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-15T22:17:56.709 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-15T22:17:56.710 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-15T22:17:56.711 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-15T22:17:56.712 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-15T22:17:56.713 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-15T22:17:56.714 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-15T22:17:56.715 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-15T22:17:56.716 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-15T22:17:56.717 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-15T22:17:56.718 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-15T22:17:56.719 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-15T22:17:56.720 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-15T22:17:56.721 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-15T22:17:56.721 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-15T22:17:56.722 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-15T22:17:56.723 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-15T22:17:56.724 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-15T22:17:56.725 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-15T22:17:56.726 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-15T22:17:56.727 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-15T22:17:56.727 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-15T22:17:56.728 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-15T22:17:56.729 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-15T22:17:56.730 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-15T22:17:56.731 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-15T22:17:56.732 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-15T22:17:56.733 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-15T22:17:56.734 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-15T22:17:56.736 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-15T22:17:56.736 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-15T22:17:56.737 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-15T22:17:56.737 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-15T22:17:56.738 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-15T22:17:56.739 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-15T22:17:56.740 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-15T22:17:56.741 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-15T22:17:56.742 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-15T22:17:56.743 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-15T22:17:56.743 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-15T22:17:56.744 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-15T22:17:56.745 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-15T22:17:56.746 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-15T22:17:56.747 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-15T22:17:56.748 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-15T22:17:56.749 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-15T22:17:56.750 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-15T22:17:56.751 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-15T22:17:56.752 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-15T22:17:56.753 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-15T22:17:56.754 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-15T22:17:56.754 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-15T22:17:56.755 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-15T22:17:56.756 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-15T22:17:56.757 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-15T22:17:56.758 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-15T22:17:56.758 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-15T22:17:56.759 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-15T22:17:56.760 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-15T22:17:56.761 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-15T22:17:56.762 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-15T22:17:56.763 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-15T22:17:56.764 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-15T22:17:56.765 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-15T22:17:56.766 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-15T22:17:56.766 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-15T22:17:56.767 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-15T22:17:56.768 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-15T22:17:56.769 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-15T22:17:56.770 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-15T22:17:56.771 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-15T22:17:56.772 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-15T22:17:56.773 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-15T22:17:56.773 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-15T22:17:56.774 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-15T22:17:56.775 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-15T22:17:56.776 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-15T22:17:56.777 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-15T22:17:56.778 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-15T22:17:56.779 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-15T22:17:56.780 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-15T22:17:56.781 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-15T22:17:56.782 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-15T22:17:56.782 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-15T22:17:56.784 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-15T22:17:56.785 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-15T22:17:56.785 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-15T22:17:56.786 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-15T22:17:56.787 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-15T22:17:56.788 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-15T22:17:56.789 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-15T22:17:56.790 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-15T22:17:56.791 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-15T22:17:56.792 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-15T22:17:56.793 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-15T22:17:56.794 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-15T22:17:56.795 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-15T22:17:56.796 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-15T22:17:56.797 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-15T22:17:56.798 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-15T22:17:56.798 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-15T22:17:56.799 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-15T22:17:56.800 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-15T22:17:56.801 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-15T22:17:56.801 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-15T22:17:56.803 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-15T22:17:56.803 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-15T22:17:56.804 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-15T22:17:56.805 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-15T22:17:56.805 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-15T22:17:56.806 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-15T22:17:56.807 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-15T22:17:56.808 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-15T22:17:56.809 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-15T22:17:56.809 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-15T22:17:56.810 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-15T22:17:56.811 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-15T22:17:56.812 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-15T22:17:56.812 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-15T22:17:56.813 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-15T22:17:56.814 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-15T22:17:56.815 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-15T22:17:56.816 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-15T22:17:56.825 INFO:tasks.cephfs.filesystem:scrub status for tag:211cca01-82df-489c-86f4-c5ceef255eec - {'path': '/', 'tag': '211cca01-82df-489c-86f4-c5ceef255eec', 'options': 'recursive,force'} 2024-09-15T22:17:56.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:56 smithi165 ceph-mon[35551]: pgmap v54: 129 pgs: 129 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 51 KiB/s wr, 5 op/s 2024-09-15T22:17:56.992 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-15T22:17:56.993 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-15T22:17:56.993 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:56 smithi100 ceph-mon[35319]: pgmap v54: 129 pgs: 129 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 51 KiB/s wr, 5 op/s 2024-09-15T22:17:56.994 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-15T22:17:56.995 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-15T22:17:56.996 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-15T22:17:56.997 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-15T22:17:56.998 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-15T22:17:56.999 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-15T22:17:57.000 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-15T22:17:57.001 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-15T22:17:57.002 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-15T22:17:57.003 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-15T22:17:57.004 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-15T22:17:57.005 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-15T22:17:57.006 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-15T22:17:57.007 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-15T22:17:57.008 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-15T22:17:57.009 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-15T22:17:57.010 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-15T22:17:57.011 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-15T22:17:57.012 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-15T22:17:57.013 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-15T22:17:57.014 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-15T22:17:57.015 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-15T22:17:57.017 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-15T22:17:57.018 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-15T22:17:57.018 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-15T22:17:57.019 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-15T22:17:57.020 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-15T22:17:57.021 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-15T22:17:57.022 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-15T22:17:57.023 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-15T22:17:57.024 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-15T22:17:57.025 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-15T22:17:57.025 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-15T22:17:57.026 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-15T22:17:57.027 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-15T22:17:57.028 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-15T22:17:57.029 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-15T22:17:57.030 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-15T22:17:57.031 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-15T22:17:57.032 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-15T22:17:57.032 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-15T22:17:57.033 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-15T22:17:57.034 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-15T22:17:57.035 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-15T22:17:57.036 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-15T22:17:57.036 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-15T22:17:57.037 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-15T22:17:57.038 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-15T22:17:57.039 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-15T22:17:57.040 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-15T22:17:57.041 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-15T22:17:57.041 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-15T22:17:57.042 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-15T22:17:57.043 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-15T22:17:57.044 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-15T22:17:57.045 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-15T22:17:57.046 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-15T22:17:57.046 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-15T22:17:57.047 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-15T22:17:57.048 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-15T22:17:57.049 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-15T22:17:57.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:56 smithi045 ceph-mon[31180]: pgmap v54: 129 pgs: 129 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 51 KiB/s wr, 5 op/s 2024-09-15T22:17:57.050 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-15T22:17:57.051 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-15T22:17:57.052 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-15T22:17:57.052 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-15T22:17:57.054 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-15T22:17:57.054 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-15T22:17:57.055 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-15T22:17:57.056 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-15T22:17:57.056 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-15T22:17:57.057 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-15T22:17:57.058 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-15T22:17:57.059 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-15T22:17:57.060 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-15T22:17:57.060 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-15T22:17:57.061 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-15T22:17:57.062 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-15T22:17:57.063 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-15T22:17:57.063 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-15T22:17:57.064 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-15T22:17:57.065 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-15T22:17:57.066 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-15T22:17:57.066 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-15T22:17:57.067 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-15T22:17:57.068 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-15T22:17:57.069 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-15T22:17:57.070 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-15T22:17:57.071 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-15T22:17:57.071 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-15T22:17:57.072 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-15T22:17:57.073 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-15T22:17:57.074 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-15T22:17:57.075 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-15T22:17:57.075 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-15T22:17:57.076 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-15T22:17:57.077 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-15T22:17:57.078 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-15T22:17:57.079 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-15T22:17:57.079 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-15T22:17:57.080 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-15T22:17:57.081 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-15T22:17:57.082 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-15T22:17:57.082 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-15T22:17:57.083 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-15T22:17:57.084 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-15T22:17:57.085 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-15T22:17:57.086 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-15T22:17:57.087 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-15T22:17:57.088 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-15T22:17:57.089 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-15T22:17:57.090 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-15T22:17:57.091 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-15T22:17:57.091 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-15T22:17:57.092 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-15T22:17:57.093 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-15T22:17:57.094 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-15T22:17:57.095 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/ 2024-09-15T22:17:57.096 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-15T22:17:57.097 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-15T22:17:57.098 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-15T22:17:57.098 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-15T22:17:57.099 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-15T22:17:57.100 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-15T22:17:57.101 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-15T22:17:57.102 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-15T22:17:57.102 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-15T22:17:57.103 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-15T22:17:57.104 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-15T22:17:57.105 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-15T22:17:57.106 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-15T22:17:57.107 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-15T22:17:57.107 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-15T22:17:57.108 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-15T22:17:57.109 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-15T22:17:57.110 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-15T22:17:57.111 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-15T22:17:57.112 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-15T22:17:57.113 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-15T22:17:57.114 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-15T22:17:57.114 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-15T22:17:57.115 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-15T22:17:57.116 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-15T22:17:57.117 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-15T22:17:57.118 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-15T22:17:57.119 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-15T22:17:57.120 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-15T22:17:57.121 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-15T22:17:57.121 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-15T22:17:57.122 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-15T22:17:57.123 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-15T22:17:57.124 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-15T22:17:57.125 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-15T22:17:57.126 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-15T22:17:57.126 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-15T22:17:57.127 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-15T22:17:57.128 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-15T22:17:57.129 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-15T22:17:57.130 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-15T22:17:57.131 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-15T22:17:57.131 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-15T22:17:57.132 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-15T22:17:57.133 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-15T22:17:57.134 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-15T22:17:57.135 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-15T22:17:57.136 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-15T22:17:57.137 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-15T22:17:57.138 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-15T22:17:57.139 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-15T22:17:57.139 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-15T22:17:57.140 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-15T22:17:57.144 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-15T22:17:57.144 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-15T22:17:57.144 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-15T22:17:57.144 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-15T22:17:57.145 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-15T22:17:57.145 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-15T22:17:57.146 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-15T22:17:57.147 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-15T22:17:57.148 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-15T22:17:57.149 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-15T22:17:57.150 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-15T22:17:57.151 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-15T22:17:57.151 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-15T22:17:57.152 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-15T22:17:57.153 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-15T22:17:57.154 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-15T22:17:57.155 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-15T22:17:57.156 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-15T22:17:57.157 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-15T22:17:57.158 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-15T22:17:57.159 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-15T22:17:57.160 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-15T22:17:57.161 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-15T22:17:57.162 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-15T22:17:57.163 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-15T22:17:57.164 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-15T22:17:57.165 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-15T22:17:57.166 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-15T22:17:57.167 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-15T22:17:57.168 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-15T22:17:57.169 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-15T22:17:57.170 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-15T22:17:57.171 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-15T22:17:57.172 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-15T22:17:57.173 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-15T22:17:57.174 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-15T22:17:57.175 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-15T22:17:57.176 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-15T22:17:57.177 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-15T22:17:57.177 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-15T22:17:57.178 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-15T22:17:57.179 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-15T22:17:57.180 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-15T22:17:57.181 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-15T22:17:57.181 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-15T22:17:57.182 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-15T22:17:57.183 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-15T22:17:57.184 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-15T22:17:57.185 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-15T22:17:57.186 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-15T22:17:57.187 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-15T22:17:57.188 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-15T22:17:57.189 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-15T22:17:57.190 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-15T22:17:57.190 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-15T22:17:57.191 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-15T22:17:57.192 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-15T22:17:57.193 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-15T22:17:57.194 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-15T22:17:57.195 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-15T22:17:57.195 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-15T22:17:57.196 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-15T22:17:57.197 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-15T22:17:57.197 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-15T22:17:57.198 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-15T22:17:57.199 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-15T22:17:57.200 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-15T22:17:57.201 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-15T22:17:57.202 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-15T22:17:57.203 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-15T22:17:57.204 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-15T22:17:57.205 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-15T22:17:57.206 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-15T22:17:57.207 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-15T22:17:57.208 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-15T22:17:57.208 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-15T22:17:57.210 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-15T22:17:57.211 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-15T22:17:57.212 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-15T22:17:57.212 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-15T22:17:57.213 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-15T22:17:57.215 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-15T22:17:57.215 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-15T22:17:57.216 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-15T22:17:57.217 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-15T22:17:57.218 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-15T22:17:57.219 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-15T22:17:57.220 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-15T22:17:57.220 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-15T22:17:57.221 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-15T22:17:57.222 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-15T22:17:57.223 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-15T22:17:57.224 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-15T22:17:57.225 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-15T22:17:57.226 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-15T22:17:57.227 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-15T22:17:57.228 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-15T22:17:57.229 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-15T22:17:57.229 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-15T22:17:57.230 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-15T22:17:57.231 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-15T22:17:57.232 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-15T22:17:57.233 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-15T22:17:57.234 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-15T22:17:57.235 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-15T22:17:57.236 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-15T22:17:57.238 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-15T22:17:57.238 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-15T22:17:57.239 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-15T22:17:57.240 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-15T22:17:57.242 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-15T22:17:57.243 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-15T22:17:57.244 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-15T22:17:57.246 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-15T22:17:57.247 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/ 2024-09-15T22:17:57.248 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-15T22:17:57.250 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-15T22:17:57.252 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-15T22:17:57.253 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-15T22:17:57.254 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-15T22:17:57.255 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-15T22:17:57.256 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-15T22:17:57.257 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-15T22:17:57.258 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-15T22:17:57.259 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-15T22:17:57.260 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-15T22:17:57.364 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-15T22:17:57.365 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-15T22:17:57.366 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-15T22:17:57.367 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-15T22:17:57.368 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-15T22:17:57.368 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-15T22:17:57.369 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-15T22:17:57.370 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-15T22:17:57.371 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-15T22:17:57.372 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-15T22:17:57.373 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hid/ 2024-09-15T22:17:57.374 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-15T22:17:57.375 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-15T22:17:57.376 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-15T22:17:57.376 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-15T22:17:57.377 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-15T22:17:57.378 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-15T22:17:57.379 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-15T22:17:57.380 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-15T22:17:57.381 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-15T22:17:57.382 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-15T22:17:57.383 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-15T22:17:57.384 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-15T22:17:57.384 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-15T22:17:57.385 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-15T22:17:57.386 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-15T22:17:57.387 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-15T22:17:57.388 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-15T22:17:57.389 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-15T22:17:57.390 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-15T22:17:57.391 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-15T22:17:57.392 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-15T22:17:57.393 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-15T22:17:57.394 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-15T22:17:57.395 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-15T22:17:57.395 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-15T22:17:57.397 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-15T22:17:57.397 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-15T22:17:57.398 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-15T22:17:57.399 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-15T22:17:57.400 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-15T22:17:57.401 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-15T22:17:57.402 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-15T22:17:57.402 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-15T22:17:57.403 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-15T22:17:57.404 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-15T22:17:57.405 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-15T22:17:57.406 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-15T22:17:57.407 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-15T22:17:57.408 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-15T22:17:57.409 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-15T22:17:57.409 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-15T22:17:57.410 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-15T22:17:57.411 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-15T22:17:57.412 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-15T22:17:57.413 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-15T22:17:57.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-15T22:17:57.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-15T22:17:57.415 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-15T22:17:57.416 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-15T22:17:57.417 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-15T22:17:57.418 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-15T22:17:57.419 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-15T22:17:57.420 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-15T22:17:57.421 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-15T22:17:57.421 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-15T22:17:57.422 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-15T22:17:57.423 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-15T22:17:57.424 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-15T22:17:57.424 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-15T22:17:57.425 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-15T22:17:57.426 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-15T22:17:57.427 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-15T22:17:57.428 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-15T22:17:57.429 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-15T22:17:57.430 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-15T22:17:57.431 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-15T22:17:57.431 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-15T22:17:57.432 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-15T22:17:57.433 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-15T22:17:57.434 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-15T22:17:57.435 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-15T22:17:57.436 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-15T22:17:57.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-15T22:17:57.438 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-15T22:17:57.438 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-15T22:17:57.439 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-15T22:17:57.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-15T22:17:57.441 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-15T22:17:57.442 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-15T22:17:57.443 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-15T22:17:57.444 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-15T22:17:57.444 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-15T22:17:57.445 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-15T22:17:57.446 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-15T22:17:57.447 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-15T22:17:57.448 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-15T22:17:57.448 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-15T22:17:57.449 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-15T22:17:57.450 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-15T22:17:57.451 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-15T22:17:57.452 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-15T22:17:57.452 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-15T22:17:57.453 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-15T22:17:57.454 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-15T22:17:57.455 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-15T22:17:57.456 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-15T22:17:57.457 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-15T22:17:57.457 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-15T22:17:57.458 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-15T22:17:57.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-15T22:17:57.460 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-15T22:17:57.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-15T22:17:57.462 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-15T22:17:57.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-15T22:17:57.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-15T22:17:57.464 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-15T22:17:57.465 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-15T22:17:57.466 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-15T22:17:57.467 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-15T22:17:57.468 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-15T22:17:57.469 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-15T22:17:57.469 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-15T22:17:57.470 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-15T22:17:57.471 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-15T22:17:57.472 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-15T22:17:57.473 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-15T22:17:57.474 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-15T22:17:57.475 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-15T22:17:57.476 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-15T22:17:57.477 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-15T22:17:57.478 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-15T22:17:57.478 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-15T22:17:57.479 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-15T22:17:57.480 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-15T22:17:57.481 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-15T22:17:57.482 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-15T22:17:57.482 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-15T22:17:57.483 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-15T22:17:57.484 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-15T22:17:57.485 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-15T22:17:57.486 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-15T22:17:57.487 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-15T22:17:57.488 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-15T22:17:57.488 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-15T22:17:57.490 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-15T22:17:57.490 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-15T22:17:57.492 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-15T22:17:57.492 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-15T22:17:57.493 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-15T22:17:57.494 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-15T22:17:57.495 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-15T22:17:57.495 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-15T22:17:57.496 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-15T22:17:57.497 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-15T22:17:57.498 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-15T22:17:57.498 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-15T22:17:57.499 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-15T22:17:57.500 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-15T22:17:57.501 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-15T22:17:57.502 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-15T22:17:57.502 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-15T22:17:57.503 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-15T22:17:57.504 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-15T22:17:57.505 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-15T22:17:57.506 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-15T22:17:57.507 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-15T22:17:57.508 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-15T22:17:57.509 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-15T22:17:57.510 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-15T22:17:57.511 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-15T22:17:57.511 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-15T22:17:57.512 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-15T22:17:57.513 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-15T22:17:57.514 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-15T22:17:57.514 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-15T22:17:57.515 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-15T22:17:57.516 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-15T22:17:57.517 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-15T22:17:57.518 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-15T22:17:57.518 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-15T22:17:57.519 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-15T22:17:57.520 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-15T22:17:57.521 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-15T22:17:57.522 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-15T22:17:57.523 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-15T22:17:57.524 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-15T22:17:57.525 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-15T22:17:57.526 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-15T22:17:57.527 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-15T22:17:57.528 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-15T22:17:57.529 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-15T22:17:57.529 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-15T22:17:57.530 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-15T22:17:57.531 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-15T22:17:57.532 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-15T22:17:57.533 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-15T22:17:57.534 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-15T22:17:57.535 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-15T22:17:57.536 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-15T22:17:57.537 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-15T22:17:57.538 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-15T22:17:57.538 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-15T22:17:57.539 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-15T22:17:57.540 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-15T22:17:57.541 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-15T22:17:57.542 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-15T22:17:57.543 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-15T22:17:57.544 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-15T22:17:57.545 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-15T22:17:57.545 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/ 2024-09-15T22:17:57.546 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-15T22:17:57.547 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-15T22:17:57.548 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-15T22:17:57.549 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-15T22:17:57.550 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-15T22:17:57.551 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-15T22:17:57.551 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-15T22:17:57.552 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-15T22:17:57.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-15T22:17:57.554 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-15T22:17:57.554 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-15T22:17:57.555 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-15T22:17:57.556 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-15T22:17:57.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/init.txt 2024-09-15T22:17:57.558 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-15T22:17:57.559 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/ 2024-09-15T22:17:57.560 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-15T22:17:57.560 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-15T22:17:57.561 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-15T22:17:57.562 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-15T22:17:57.563 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-15T22:17:57.564 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-15T22:17:57.565 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-15T22:17:57.565 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-15T22:17:57.566 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-15T22:17:57.567 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-15T22:17:57.568 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-15T22:17:57.569 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-15T22:17:57.569 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-15T22:17:57.570 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-15T22:17:57.571 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-15T22:17:57.572 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-15T22:17:57.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-15T22:17:57.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-15T22:17:57.574 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-15T22:17:57.575 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-15T22:17:57.576 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-15T22:17:57.577 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-15T22:17:57.577 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-15T22:17:57.578 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-15T22:17:57.579 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-15T22:17:57.580 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-15T22:17:57.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-15T22:17:57.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-15T22:17:57.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-15T22:17:57.583 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-15T22:17:57.584 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-15T22:17:57.585 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-15T22:17:57.586 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-15T22:17:57.587 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-15T22:17:57.588 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-15T22:17:57.589 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-15T22:17:57.590 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-15T22:17:57.590 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-15T22:17:57.591 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-15T22:17:57.592 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-15T22:17:57.593 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-15T22:17:57.594 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-15T22:17:57.595 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-15T22:17:57.596 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-15T22:17:57.597 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-15T22:17:57.598 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-15T22:17:57.598 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-15T22:17:57.599 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-15T22:17:57.600 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-15T22:17:57.601 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-15T22:17:57.602 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-15T22:17:57.603 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-15T22:17:57.604 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-15T22:17:57.604 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-15T22:17:57.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-15T22:17:57.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-15T22:17:57.607 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-15T22:17:57.608 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-15T22:17:57.609 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-15T22:17:57.610 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-15T22:17:57.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-15T22:17:57.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-15T22:17:57.612 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-15T22:17:57.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-15T22:17:57.614 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-15T22:17:57.615 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-15T22:17:57.616 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-15T22:17:57.616 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-15T22:17:57.617 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-15T22:17:57.618 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-15T22:17:57.619 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-15T22:17:57.620 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-15T22:17:57.621 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-15T22:17:57.621 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-15T22:17:57.622 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-15T22:17:57.623 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-15T22:17:57.624 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/java.txt 2024-09-15T22:17:57.625 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-15T22:17:57.626 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-15T22:17:57.627 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-15T22:17:57.628 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-15T22:17:57.629 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-15T22:17:57.630 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-15T22:17:57.630 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-15T22:17:57.631 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-15T22:17:57.632 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-15T22:17:57.633 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-15T22:17:57.634 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-15T22:17:57.634 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-15T22:17:57.635 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-15T22:17:57.636 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-15T22:17:57.637 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-15T22:17:57.639 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-15T22:17:57.640 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-15T22:17:57.641 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-15T22:17:57.642 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-15T22:17:57.643 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-15T22:17:57.644 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-15T22:17:57.645 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-15T22:17:57.646 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-15T22:17:57.647 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-15T22:17:57.648 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-15T22:17:57.649 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-15T22:17:57.650 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-15T22:17:57.651 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-15T22:17:57.651 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-15T22:17:57.652 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-15T22:17:57.653 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-15T22:17:57.654 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-15T22:17:57.655 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-15T22:17:57.655 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-15T22:17:57.656 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-15T22:17:57.657 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-15T22:17:57.658 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-15T22:17:57.659 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-15T22:17:57.660 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-15T22:17:57.660 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/ 2024-09-15T22:17:57.661 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-15T22:17:57.662 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-15T22:17:57.663 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-15T22:17:57.664 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-15T22:17:57.664 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-15T22:17:57.665 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-15T22:17:57.666 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-15T22:17:57.667 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-15T22:17:57.668 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-15T22:17:57.668 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-15T22:17:57.669 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-15T22:17:57.670 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-15T22:17:57.671 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/ 2024-09-15T22:17:57.672 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-15T22:17:57.673 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-15T22:17:57.674 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-15T22:17:57.675 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-15T22:17:57.676 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-15T22:17:57.677 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-15T22:17:57.677 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-15T22:17:57.678 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-15T22:17:57.679 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-15T22:17:57.680 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-15T22:17:57.681 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-15T22:17:57.681 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-15T22:17:57.682 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-15T22:17:57.683 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-15T22:17:57.684 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-15T22:17:57.685 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-15T22:17:57.686 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-15T22:17:57.687 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-15T22:17:57.688 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-15T22:17:57.689 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-15T22:17:57.690 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/md.txt 2024-09-15T22:17:57.691 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-15T22:17:57.692 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-15T22:17:57.873 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-15T22:17:57.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-15T22:17:57.874 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-15T22:17:57.875 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/metag/ 2024-09-15T22:17:57.876 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-15T22:17:57.877 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-15T22:17:57.877 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/ 2024-09-15T22:17:57.878 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-15T22:17:57.879 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-15T22:17:57.880 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-15T22:17:57.880 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-15T22:17:57.881 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-15T22:17:57.882 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-15T22:17:57.883 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-15T22:17:57.884 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-15T22:17:57.884 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-15T22:17:57.886 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-15T22:17:57.886 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mips/ 2024-09-15T22:17:57.887 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-15T22:17:57.888 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-15T22:17:57.889 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-15T22:17:57.890 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-15T22:17:57.891 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-15T22:17:57.892 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-15T22:17:57.893 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-15T22:17:57.893 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-15T22:17:57.894 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-15T22:17:57.895 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-15T22:17:57.896 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-15T22:17:57.897 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-15T22:17:57.898 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-15T22:17:57.898 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-15T22:17:57.899 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-15T22:17:57.900 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-15T22:17:57.901 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-15T22:17:57.902 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-15T22:17:57.902 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-15T22:17:57.903 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-15T22:17:57.904 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-15T22:17:57.905 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-15T22:17:57.905 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-15T22:17:57.906 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-15T22:17:57.907 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-15T22:17:57.908 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-15T22:17:57.909 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-15T22:17:57.909 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-15T22:17:57.910 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-15T22:17:57.911 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-15T22:17:57.912 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-15T22:17:57.913 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-15T22:17:57.913 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-15T22:17:57.914 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-15T22:17:57.915 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-15T22:17:57.916 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-15T22:17:57.916 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-15T22:17:57.917 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-15T22:17:57.918 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-15T22:17:57.919 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-15T22:17:57.919 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-15T22:17:57.920 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-15T22:17:57.921 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-15T22:17:57.922 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-15T22:17:57.923 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-15T22:17:57.923 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ 2024-09-15T22:17:57.925 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-15T22:17:57.925 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-15T22:17:57.926 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-15T22:17:57.927 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-15T22:17:57.928 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-15T22:17:57.928 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-15T22:17:57.929 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-15T22:17:57.930 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-15T22:17:57.931 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-15T22:17:57.932 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-15T22:17:57.932 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-15T22:17:57.933 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-15T22:17:57.934 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-15T22:17:57.935 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-15T22:17:57.936 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-15T22:17:57.937 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-15T22:17:57.937 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-15T22:17:57.938 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-15T22:17:57.939 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-15T22:17:57.940 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-15T22:17:57.941 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-15T22:17:57.942 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-15T22:17:57.943 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-15T22:17:57.944 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-15T22:17:57.944 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-15T22:17:57.945 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-15T22:17:57.946 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-15T22:17:57.947 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-15T22:17:57.948 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-15T22:17:57.948 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-15T22:17:57.949 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-15T22:17:57.950 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-15T22:17:57.951 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-15T22:17:57.951 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-15T22:17:57.952 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-15T22:17:57.953 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-15T22:17:57.954 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-15T22:17:57.955 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-15T22:17:57.956 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-15T22:17:57.956 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-15T22:17:57.957 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-15T22:17:57.958 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-15T22:17:57.959 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-15T22:17:57.960 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-15T22:17:57.961 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-15T22:17:57.962 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-15T22:17:57.963 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-15T22:17:57.964 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-15T22:17:57.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:57 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:17:57.965 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-15T22:17:57.966 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-15T22:17:57.967 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-15T22:17:57.968 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-15T22:17:57.968 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-15T22:17:57.969 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-15T22:17:57.970 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-15T22:17:57.971 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-15T22:17:57.972 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-15T22:17:57.973 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-15T22:17:57.973 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-15T22:17:57.974 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-15T22:17:57.975 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-15T22:17:57.976 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-15T22:17:57.977 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-15T22:17:57.978 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-15T22:17:57.979 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-15T22:17:57.980 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-15T22:17:57.981 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-15T22:17:57.982 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-15T22:17:57.982 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-15T22:17:57.983 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-15T22:17:57.984 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-15T22:17:57.985 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-15T22:17:57.986 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-15T22:17:57.987 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-15T22:17:57.988 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-15T22:17:57.989 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-15T22:17:57.990 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-15T22:17:57.991 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-15T22:17:57.992 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-15T22:17:57.993 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-15T22:17:57.993 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-15T22:17:57.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:57 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:17:57.994 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-15T22:17:57.995 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-15T22:17:57.996 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-15T22:17:57.997 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-15T22:17:57.998 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-15T22:17:58.001 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-15T22:17:58.001 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-15T22:17:58.002 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-15T22:17:58.002 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-15T22:17:58.002 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-15T22:17:58.003 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-15T22:17:58.004 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-15T22:17:58.005 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-15T22:17:58.006 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-15T22:17:58.007 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-15T22:17:58.008 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-15T22:17:58.009 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-15T22:17:58.009 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-15T22:17:58.010 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-15T22:17:58.011 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-15T22:17:58.012 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-15T22:17:58.013 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-15T22:17:58.014 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-15T22:17:58.014 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-15T22:17:58.015 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-15T22:17:58.016 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-15T22:17:58.017 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-15T22:17:58.017 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-15T22:17:58.018 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-15T22:17:58.019 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-15T22:17:58.020 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-15T22:17:58.021 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-15T22:17:58.021 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-15T22:17:58.022 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-15T22:17:58.023 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-15T22:17:58.024 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-15T22:17:58.025 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-15T22:17:58.025 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-15T22:17:58.026 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-15T22:17:58.027 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-15T22:17:58.028 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-15T22:17:58.029 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-15T22:17:58.030 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-15T22:17:58.030 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-15T22:17:58.031 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-15T22:17:58.032 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-15T22:17:58.033 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-15T22:17:58.034 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-15T22:17:58.035 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-15T22:17:58.036 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-15T22:17:58.037 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-15T22:17:58.038 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-15T22:17:58.039 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-15T22:17:58.040 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-15T22:17:58.041 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-15T22:17:58.042 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-15T22:17:58.042 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-15T22:17:58.043 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-15T22:17:58.044 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-15T22:17:58.045 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-15T22:17:58.046 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-15T22:17:58.047 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-15T22:17:58.048 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-15T22:17:58.049 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-15T22:17:58.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:57 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:17:58.050 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-15T22:17:58.050 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-15T22:17:58.052 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-15T22:17:58.053 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-15T22:17:58.053 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-15T22:17:58.054 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-15T22:17:58.055 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-15T22:17:58.056 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-15T22:17:58.057 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-15T22:17:58.058 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-15T22:17:58.059 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-15T22:17:58.060 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-15T22:17:58.061 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-15T22:17:58.062 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-15T22:17:58.063 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-15T22:17:58.064 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/phy/ 2024-09-15T22:17:58.065 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-15T22:17:58.066 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-15T22:17:58.067 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-15T22:17:58.068 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/platform/ 2024-09-15T22:17:58.069 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-15T22:17:58.070 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-15T22:17:58.071 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/ 2024-09-15T22:17:58.072 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-15T22:17:58.073 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-15T22:17:58.074 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-15T22:17:58.075 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-15T22:17:58.076 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-15T22:17:58.077 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-15T22:17:58.078 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-15T22:17:58.079 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-15T22:17:58.080 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-15T22:17:58.081 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-15T22:17:58.082 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-15T22:17:58.083 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-15T22:17:58.084 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-15T22:17:58.085 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-15T22:17:58.086 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-15T22:17:58.087 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-15T22:17:58.088 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-15T22:17:58.089 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-15T22:17:58.090 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-15T22:17:58.091 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-15T22:17:58.092 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-15T22:17:58.093 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-15T22:17:58.094 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-15T22:17:58.095 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-15T22:17:58.096 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-15T22:17:58.097 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-15T22:17:58.098 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-15T22:17:58.099 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-15T22:17:58.100 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-15T22:17:58.101 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-15T22:17:58.102 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-15T22:17:58.103 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-15T22:17:58.104 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-15T22:17:58.105 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-15T22:17:58.106 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-15T22:17:58.107 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-15T22:17:58.108 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-15T22:17:58.109 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-15T22:17:58.110 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-15T22:17:58.111 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-15T22:17:58.112 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-15T22:17:58.113 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-15T22:17:58.114 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-15T22:17:58.115 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-15T22:17:58.116 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-15T22:17:58.117 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-15T22:17:58.118 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pps/ 2024-09-15T22:17:58.119 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-15T22:17:58.120 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-15T22:17:58.121 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-15T22:17:58.123 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-15T22:17:58.124 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-15T22:17:58.125 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-15T22:17:58.126 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-15T22:17:58.126 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-15T22:17:58.128 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-15T22:17:58.129 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-15T22:17:58.130 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-15T22:17:58.131 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pti/ 2024-09-15T22:17:58.132 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-15T22:17:58.133 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-15T22:17:58.134 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-15T22:17:58.135 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-15T22:17:58.136 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-15T22:17:58.137 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-15T22:17:58.138 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-15T22:17:58.139 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-15T22:17:58.140 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-15T22:17:58.141 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-15T22:17:58.142 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-15T22:17:58.143 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-15T22:17:58.144 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-15T22:17:58.145 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-15T22:17:58.146 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-15T22:17:58.147 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-15T22:17:58.148 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-15T22:17:58.150 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-15T22:17:58.151 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-15T22:17:58.152 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-15T22:17:58.153 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/ 2024-09-15T22:17:58.154 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-15T22:17:58.155 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-15T22:17:58.156 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-15T22:17:58.157 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-15T22:17:58.158 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-15T22:17:58.159 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-15T22:17:58.160 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-15T22:17:58.165 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-15T22:17:58.165 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-15T22:17:58.165 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-15T22:17:58.166 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-15T22:17:58.166 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-15T22:17:58.166 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-15T22:17:58.167 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-15T22:17:58.168 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-15T22:17:58.169 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-15T22:17:58.170 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-15T22:17:58.171 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-15T22:17:58.172 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-15T22:17:58.173 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-15T22:17:58.174 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-15T22:17:58.175 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-15T22:17:58.177 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-15T22:17:58.177 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-15T22:17:58.178 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-15T22:17:58.179 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-15T22:17:58.180 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-15T22:17:58.181 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-15T22:17:58.182 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-15T22:17:58.183 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-15T22:17:58.184 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-15T22:17:58.185 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-15T22:17:58.186 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-15T22:17:58.188 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-15T22:17:58.188 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-15T22:17:58.189 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-15T22:17:58.190 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-15T22:17:58.191 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-15T22:17:58.192 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-15T22:17:58.193 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-15T22:17:58.195 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-15T22:17:58.195 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-15T22:17:58.196 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-15T22:17:58.197 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-15T22:17:58.198 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-15T22:17:58.199 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-15T22:17:58.200 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-15T22:17:58.201 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-15T22:17:58.202 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-15T22:17:58.203 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-15T22:17:58.204 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-15T22:17:58.205 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-15T22:17:58.206 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-15T22:17:58.207 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-15T22:17:58.208 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-15T22:17:58.209 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-15T22:17:58.210 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-15T22:17:58.211 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-15T22:17:58.212 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-15T22:17:58.213 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-15T22:17:58.215 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-15T22:17:58.215 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-15T22:17:58.216 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-15T22:17:58.217 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-15T22:17:58.218 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-15T22:17:58.220 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-15T22:17:58.221 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-15T22:17:58.222 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-15T22:17:58.223 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-15T22:17:58.224 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-15T22:17:58.225 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-15T22:17:58.226 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-15T22:17:58.227 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-15T22:17:58.228 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-15T22:17:58.229 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-15T22:17:58.230 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-15T22:17:58.231 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-15T22:17:58.232 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-15T22:17:58.233 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-15T22:17:58.234 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-15T22:17:58.235 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-15T22:17:58.236 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-15T22:17:58.237 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-15T22:17:58.239 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-15T22:17:58.240 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-15T22:17:58.241 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/ 2024-09-15T22:17:58.242 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-15T22:17:58.242 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-15T22:17:58.244 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-15T22:17:58.244 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-15T22:17:58.245 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-15T22:17:58.247 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-15T22:17:58.248 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-15T22:17:58.248 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-15T22:17:58.249 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-15T22:17:58.250 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-15T22:17:58.251 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-15T22:17:58.252 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-15T22:17:58.253 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-15T22:17:58.253 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-15T22:17:58.254 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/ 2024-09-15T22:17:58.255 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-15T22:17:58.256 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-15T22:17:58.256 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-15T22:17:58.257 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-15T22:17:58.258 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-15T22:17:58.259 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-15T22:17:58.260 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-15T22:17:58.260 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-15T22:17:58.261 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-15T22:17:58.262 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sh/ 2024-09-15T22:17:58.263 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-15T22:17:58.264 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-15T22:17:58.264 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-15T22:17:58.265 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/ 2024-09-15T22:17:58.266 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-15T22:17:58.267 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-15T22:17:58.268 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-15T22:17:58.269 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-15T22:17:58.269 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-15T22:17:58.270 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-15T22:17:58.271 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-15T22:17:58.272 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-15T22:17:58.273 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-15T22:17:58.274 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-15T22:17:58.274 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-15T22:17:58.275 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-15T22:17:58.276 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-15T22:17:58.277 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-15T22:17:58.278 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-15T22:17:58.279 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-15T22:17:58.280 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-15T22:17:58.281 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-15T22:17:58.281 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-15T22:17:58.282 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-15T22:17:58.283 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-15T22:17:58.283 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-15T22:17:58.284 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-15T22:17:58.285 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-15T22:17:58.286 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-15T22:17:58.287 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-15T22:17:58.288 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-15T22:17:58.289 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-15T22:17:58.289 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-15T22:17:58.290 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-15T22:17:58.291 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-15T22:17:58.292 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-15T22:17:58.292 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-15T22:17:58.293 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-15T22:17:58.294 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-15T22:17:58.294 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-15T22:17:58.295 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-15T22:17:58.296 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-15T22:17:58.297 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-15T22:17:58.297 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-15T22:17:58.298 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-15T22:17:58.299 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-15T22:17:58.300 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-15T22:17:58.301 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-15T22:17:58.302 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-15T22:17:58.303 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-15T22:17:58.304 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-15T22:17:58.305 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-15T22:17:58.305 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-15T22:17:58.306 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-15T22:17:58.307 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-15T22:17:58.308 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-15T22:17:58.309 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-15T22:17:58.309 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-15T22:17:58.310 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-15T22:17:58.311 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-15T22:17:58.312 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-15T22:17:58.313 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-15T22:17:58.313 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-15T22:17:58.314 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-15T22:17:58.315 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-15T22:17:58.315 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-15T22:17:58.316 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-15T22:17:58.317 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/ 2024-09-15T22:17:58.318 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-15T22:17:58.319 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-15T22:17:58.320 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-15T22:17:58.321 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-15T22:17:58.321 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-15T22:17:58.322 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-15T22:17:58.323 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-15T22:17:58.324 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-15T22:17:58.325 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-15T22:17:58.326 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-15T22:17:58.327 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-15T22:17:58.327 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-15T22:17:58.328 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-15T22:17:58.329 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-15T22:17:58.330 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-15T22:17:58.331 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-15T22:17:58.332 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-15T22:17:58.333 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-15T22:17:58.334 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-15T22:17:58.335 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-15T22:17:58.336 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-15T22:17:58.336 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-15T22:17:58.337 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-15T22:17:58.338 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-15T22:17:58.339 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-15T22:17:58.340 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-15T22:17:58.341 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-15T22:17:58.342 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/target/ 2024-09-15T22:17:58.343 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-15T22:17:58.344 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-15T22:17:58.345 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-15T22:17:58.346 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-15T22:17:58.347 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-15T22:17:58.348 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-15T22:17:58.349 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-15T22:17:58.350 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-15T22:17:58.350 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-15T22:17:58.351 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-15T22:17:58.352 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-15T22:17:58.353 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-15T22:17:58.354 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/ 2024-09-15T22:17:58.355 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-15T22:17:58.356 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-15T22:17:58.357 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-15T22:17:58.358 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-15T22:17:58.359 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-15T22:17:58.360 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-15T22:17:58.361 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-15T22:17:58.362 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-15T22:17:58.363 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-15T22:17:58.364 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-15T22:17:58.370 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-15T22:17:58.370 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-15T22:17:58.370 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-15T22:17:58.370 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/ 2024-09-15T22:17:58.370 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-15T22:17:58.370 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-15T22:17:58.371 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-15T22:17:58.371 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-15T22:17:58.372 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-15T22:17:58.373 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-15T22:17:58.374 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-15T22:17:58.376 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-15T22:17:58.376 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-15T22:17:58.377 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-15T22:17:58.378 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-15T22:17:58.379 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-15T22:17:58.380 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-15T22:17:58.381 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-15T22:17:58.382 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-15T22:17:58.382 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-15T22:17:58.383 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-15T22:17:58.384 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-15T22:17:58.385 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-15T22:17:58.386 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-15T22:17:58.387 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/ 2024-09-15T22:17:58.388 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-15T22:17:58.389 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-15T22:17:58.390 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-15T22:17:58.391 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-15T22:17:58.392 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-15T22:17:58.393 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-15T22:17:58.394 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-15T22:17:58.395 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-15T22:17:58.396 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-15T22:17:58.396 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-15T22:17:58.397 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-15T22:17:58.398 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-15T22:17:58.399 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-15T22:17:58.400 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-15T22:17:58.400 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-15T22:17:58.401 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-15T22:17:58.402 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-15T22:17:58.403 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-15T22:17:58.404 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-15T22:17:58.404 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-15T22:17:58.405 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-15T22:17:58.406 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-15T22:17:58.407 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-15T22:17:58.408 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-15T22:17:58.409 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-15T22:17:58.410 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-15T22:17:58.411 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-15T22:17:58.412 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-15T22:17:58.412 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-15T22:17:58.413 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-15T22:17:58.414 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-15T22:17:58.415 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-15T22:17:58.416 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-15T22:17:58.417 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-15T22:17:58.418 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-15T22:17:58.418 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-15T22:17:58.419 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-15T22:17:58.420 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-15T22:17:58.421 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-15T22:17:58.421 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-15T22:17:58.422 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-15T22:17:58.423 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-15T22:17:58.424 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-15T22:17:58.425 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-15T22:17:58.426 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-15T22:17:58.427 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-15T22:17:58.428 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-15T22:17:58.429 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-15T22:17:58.430 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-15T22:17:58.431 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-15T22:17:58.432 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-15T22:17:58.433 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-15T22:17:58.434 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-15T22:17:58.435 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-15T22:17:58.436 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-15T22:17:58.437 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-15T22:17:58.438 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-15T22:17:58.439 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-15T22:17:58.440 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-15T22:17:58.441 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-15T22:17:58.441 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-15T22:17:58.442 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-15T22:17:58.443 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-15T22:17:58.444 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-15T22:17:58.445 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-15T22:17:58.446 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-15T22:17:58.447 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-15T22:17:58.448 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-15T22:17:58.449 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-15T22:17:58.450 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-15T22:17:58.451 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-15T22:17:58.452 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-15T22:17:58.453 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-15T22:17:58.454 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-15T22:17:58.455 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-15T22:17:58.456 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-15T22:17:58.457 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-15T22:17:58.458 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-15T22:17:58.459 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-15T22:17:58.460 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-15T22:17:58.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-15T22:17:58.461 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-15T22:17:58.462 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-15T22:17:58.463 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-15T22:17:58.464 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-15T22:17:58.465 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-15T22:17:58.465 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-15T22:17:58.466 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-15T22:17:58.467 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-15T22:17:58.468 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-15T22:17:58.469 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-15T22:17:58.470 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-15T22:17:58.473 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-15T22:17:58.473 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-15T22:17:58.473 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-15T22:17:58.473 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-15T22:17:58.474 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-15T22:17:58.475 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-15T22:17:58.476 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-15T22:17:58.477 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-15T22:17:58.478 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-15T22:17:58.479 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-15T22:17:58.480 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-15T22:17:58.481 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-15T22:17:58.482 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-15T22:17:58.483 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-15T22:17:58.484 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-15T22:17:58.484 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-15T22:17:58.485 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-15T22:17:58.486 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-15T22:17:58.487 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-15T22:17:58.488 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-15T22:17:58.489 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-15T22:17:58.490 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-15T22:17:58.491 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-15T22:17:58.492 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-15T22:17:58.493 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-15T22:17:58.494 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-15T22:17:58.495 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-15T22:17:58.496 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-15T22:17:58.497 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-15T22:17:58.497 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-15T22:17:58.498 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-15T22:17:58.499 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-15T22:17:58.500 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-15T22:17:58.501 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-15T22:17:58.502 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-15T22:17:58.502 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-15T22:17:58.503 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-15T22:17:58.505 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-15T22:17:58.505 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-15T22:17:58.506 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-15T22:17:58.507 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-15T22:17:58.507 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-15T22:17:58.508 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-15T22:17:58.509 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-15T22:17:58.510 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-15T22:17:58.510 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-15T22:17:58.511 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-15T22:17:58.512 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-15T22:17:58.513 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-15T22:17:58.514 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-15T22:17:58.515 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-15T22:17:58.516 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-15T22:17:58.516 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-15T22:17:58.517 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-15T22:17:58.518 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-15T22:17:58.519 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-15T22:17:58.520 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-15T22:17:58.521 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-15T22:17:58.523 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/ 2024-09-15T22:17:58.523 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-15T22:17:58.524 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-15T22:17:58.525 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-15T22:17:58.526 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-15T22:17:58.527 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-15T22:17:58.528 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-15T22:17:58.528 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-15T22:17:58.529 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-15T22:17:58.530 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-15T22:17:58.531 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-15T22:17:58.532 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-15T22:17:58.533 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-15T22:17:58.534 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-15T22:17:58.534 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-15T22:17:58.535 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-15T22:17:58.536 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-15T22:17:58.537 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-15T22:17:58.537 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-15T22:17:58.538 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-15T22:17:58.540 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-15T22:17:58.540 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-15T22:17:58.541 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-15T22:17:58.542 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-15T22:17:58.542 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-15T22:17:58.543 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-15T22:17:58.544 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/ 2024-09-15T22:17:58.545 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-15T22:17:58.546 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-15T22:17:58.546 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-15T22:17:58.547 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-15T22:17:58.548 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-15T22:17:58.549 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-15T22:17:58.549 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-15T22:17:58.550 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-15T22:17:58.551 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-15T22:17:58.552 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-15T22:17:58.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-15T22:17:58.553 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-15T22:17:58.554 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-15T22:17:58.555 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-15T22:17:58.556 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-15T22:17:58.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-15T22:17:58.557 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-15T22:17:58.558 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-15T22:17:58.559 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-15T22:17:58.560 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-15T22:17:58.561 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-15T22:17:58.562 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-15T22:17:58.563 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-15T22:17:58.563 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-15T22:17:58.564 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-15T22:17:58.565 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-15T22:17:58.566 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-15T22:17:58.566 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-15T22:17:58.567 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-15T22:17:58.568 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-15T22:17:58.569 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-15T22:17:58.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-15T22:17:58.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-15T22:17:58.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-15T22:17:58.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/ 2024-09-15T22:17:58.573 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-15T22:17:58.574 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-15T22:17:58.575 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-15T22:17:58.576 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-15T22:17:58.576 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-15T22:17:58.577 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-15T22:17:58.578 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-15T22:17:58.579 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-15T22:17:58.579 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-15T22:17:58.580 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-15T22:17:58.581 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-15T22:17:58.582 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-15T22:17:58.583 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-15T22:17:58.584 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-15T22:17:58.585 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-15T22:17:58.586 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-15T22:17:58.587 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-15T22:17:58.588 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-15T22:17:58.589 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-15T22:17:58.590 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-15T22:17:58.591 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-15T22:17:58.591 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-15T22:17:58.592 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-15T22:17:58.593 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-15T22:17:58.594 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-15T22:17:58.595 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-15T22:17:58.596 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-15T22:17:58.597 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-15T22:17:58.598 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-15T22:17:58.599 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-15T22:17:58.600 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-15T22:17:58.601 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-15T22:17:58.602 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-15T22:17:58.603 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-15T22:17:58.604 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-15T22:17:58.605 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-15T22:17:58.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-15T22:17:58.606 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-15T22:17:58.607 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-15T22:17:58.608 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-15T22:17:58.609 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-15T22:17:58.610 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-15T22:17:58.610 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-15T22:17:58.611 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-15T22:17:58.612 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-15T22:17:58.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-15T22:17:58.613 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-15T22:17:58.815 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-15T22:17:58.816 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-15T22:17:58.817 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-15T22:17:58.818 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-15T22:17:58.819 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-15T22:17:58.821 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-15T22:17:58.822 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-15T22:17:58.822 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-15T22:17:58.823 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-15T22:17:58.824 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-15T22:17:58.825 INFO:tasks.workunit.client.0.smithi045.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-15T22:17:58.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:17:58 smithi165 ceph-mon[35551]: pgmap v55: 129 pgs: 129 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 51 KiB/s wr, 5 op/s 2024-09-15T22:17:58.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:17:58 smithi100 ceph-mon[35319]: pgmap v55: 129 pgs: 129 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 51 KiB/s wr, 5 op/s 2024-09-15T22:17:59.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:17:58 smithi045 ceph-mon[31180]: pgmap v55: 129 pgs: 129 active+clean; 1.8 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 51 KiB/s wr, 5 op/s 2024-09-15T22:18:00.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:00 smithi165 ceph-mon[35551]: pgmap v56: 129 pgs: 129 active+clean; 91 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 7.6 MiB/s wr, 52 op/s 2024-09-15T22:18:00.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:00 smithi100 ceph-mon[35319]: pgmap v56: 129 pgs: 129 active+clean; 91 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 7.6 MiB/s wr, 52 op/s 2024-09-15T22:18:01.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:00 smithi045 ceph-mon[31180]: pgmap v56: 129 pgs: 129 active+clean; 91 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 7.6 MiB/s wr, 52 op/s 2024-09-15T22:18:02.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:02 smithi165 ceph-mon[35551]: pgmap v57: 129 pgs: 129 active+clean; 91 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 7.6 MiB/s wr, 51 op/s 2024-09-15T22:18:02.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:02 smithi100 ceph-mon[35319]: pgmap v57: 129 pgs: 129 active+clean; 91 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 7.6 MiB/s wr, 51 op/s 2024-09-15T22:18:03.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:02 smithi045 ceph-mon[31180]: pgmap v57: 129 pgs: 129 active+clean; 91 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 7.6 MiB/s wr, 51 op/s 2024-09-15T22:18:03.777 INFO:tasks.workunit.client.0.smithi045.stderr:+ tar cf doc.tar linux-4.0.5 2024-09-15T22:18:04.657 INFO:tasks.workunit.client.0.smithi045.stderr:+ tar xf doc.tar 2024-09-15T22:18:04.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:04 smithi165 ceph-mon[35551]: pgmap v58: 129 pgs: 129 active+clean; 93 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 7.8 MiB/s wr, 76 op/s 2024-09-15T22:18:04.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:04 smithi100 ceph-mon[35319]: pgmap v58: 129 pgs: 129 active+clean; 93 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 7.8 MiB/s wr, 76 op/s 2024-09-15T22:18:05.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:04 smithi045 ceph-mon[31180]: pgmap v58: 129 pgs: 129 active+clean; 93 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 7.8 MiB/s wr, 76 op/s 2024-09-15T22:18:06.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:06 smithi165 ceph-mon[35551]: pgmap v59: 129 pgs: 129 active+clean; 93 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 7.8 MiB/s wr, 72 op/s 2024-09-15T22:18:06.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:06 smithi100 ceph-mon[35319]: pgmap v59: 129 pgs: 129 active+clean; 93 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 7.8 MiB/s wr, 72 op/s 2024-09-15T22:18:07.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:06 smithi045 ceph-mon[31180]: pgmap v59: 129 pgs: 129 active+clean; 93 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 7.8 MiB/s wr, 72 op/s 2024-09-15T22:18:08.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:08 smithi165 ceph-mon[35551]: pgmap v60: 129 pgs: 129 active+clean; 93 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 7.8 MiB/s wr, 72 op/s 2024-09-15T22:18:08.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:08 smithi100 ceph-mon[35319]: pgmap v60: 129 pgs: 129 active+clean; 93 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 7.8 MiB/s wr, 72 op/s 2024-09-15T22:18:09.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:08 smithi045 ceph-mon[31180]: pgmap v60: 129 pgs: 129 active+clean; 93 MiB data, 613 MiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 7.8 MiB/s wr, 72 op/s 2024-09-15T22:18:10.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:10 smithi165 ceph-mon[35551]: pgmap v61: 129 pgs: 129 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.7 MiB/s wr, 103 op/s 2024-09-15T22:18:10.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:10 smithi100 ceph-mon[35319]: pgmap v61: 129 pgs: 129 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.7 MiB/s wr, 103 op/s 2024-09-15T22:18:11.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:10 smithi045 ceph-mon[31180]: pgmap v61: 129 pgs: 129 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.7 MiB/s wr, 103 op/s 2024-09-15T22:18:12.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:12 smithi165 ceph-mon[35551]: pgmap v62: 129 pgs: 129 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 56 op/s 2024-09-15T22:18:12.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:12 smithi100 ceph-mon[35319]: pgmap v62: 129 pgs: 129 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 56 op/s 2024-09-15T22:18:13.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:12 smithi045 ceph-mon[31180]: pgmap v62: 129 pgs: 129 active+clean; 104 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 56 op/s 2024-09-15T22:18:14.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:14 smithi165 ceph-mon[35551]: pgmap v63: 129 pgs: 129 active+clean; 163 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.3 MiB/s wr, 406 op/s 2024-09-15T22:18:14.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:14 smithi100 ceph-mon[35319]: pgmap v63: 129 pgs: 129 active+clean; 163 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.3 MiB/s wr, 406 op/s 2024-09-15T22:18:15.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:14 smithi045 ceph-mon[31180]: pgmap v63: 129 pgs: 129 active+clean; 163 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.3 MiB/s wr, 406 op/s 2024-09-15T22:18:16.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:16 smithi165 ceph-mon[35551]: pgmap v64: 129 pgs: 129 active+clean; 163 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.0 MiB/s wr, 380 op/s 2024-09-15T22:18:16.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:16 smithi100 ceph-mon[35319]: pgmap v64: 129 pgs: 129 active+clean; 163 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.0 MiB/s wr, 380 op/s 2024-09-15T22:18:17.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:16 smithi045 ceph-mon[31180]: pgmap v64: 129 pgs: 129 active+clean; 163 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.0 MiB/s wr, 380 op/s 2024-09-15T22:18:18.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:18 smithi165 ceph-mon[35551]: pgmap v65: 129 pgs: 129 active+clean; 163 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.0 MiB/s wr, 380 op/s 2024-09-15T22:18:18.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:18 smithi100 ceph-mon[35319]: pgmap v65: 129 pgs: 129 active+clean; 163 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.0 MiB/s wr, 380 op/s 2024-09-15T22:18:19.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:18 smithi045 ceph-mon[31180]: pgmap v65: 129 pgs: 129 active+clean; 163 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.0 MiB/s wr, 380 op/s 2024-09-15T22:18:20.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:20 smithi045 ceph-mon[31180]: pgmap v66: 129 pgs: 129 active+clean; 178 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.4 MiB/s wr, 646 op/s 2024-09-15T22:18:20.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:20 smithi165 ceph-mon[35551]: pgmap v66: 129 pgs: 129 active+clean; 178 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.4 MiB/s wr, 646 op/s 2024-09-15T22:18:20.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:20 smithi100 ceph-mon[35319]: pgmap v66: 129 pgs: 129 active+clean; 178 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.4 MiB/s wr, 646 op/s 2024-09-15T22:18:22.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:22 smithi165 ceph-mon[35551]: pgmap v67: 129 pgs: 129 active+clean; 178 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 615 op/s 2024-09-15T22:18:22.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:22 smithi100 ceph-mon[35319]: pgmap v67: 129 pgs: 129 active+clean; 178 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 615 op/s 2024-09-15T22:18:23.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:22 smithi045 ceph-mon[31180]: pgmap v67: 129 pgs: 129 active+clean; 178 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.5 MiB/s wr, 615 op/s 2024-09-15T22:18:23.175 INFO:tasks.workunit.client.0.smithi045.stderr:+ sync 2024-09-15T22:18:24.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:24 smithi165 ceph-mon[35551]: pgmap v68: 129 pgs: 129 active+clean; 198 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.3 MiB/s wr, 768 op/s 2024-09-15T22:18:24.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:24 smithi100 ceph-mon[35319]: pgmap v68: 129 pgs: 129 active+clean; 198 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.3 MiB/s wr, 768 op/s 2024-09-15T22:18:25.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:24 smithi045 ceph-mon[31180]: pgmap v68: 129 pgs: 129 active+clean; 198 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.3 MiB/s wr, 768 op/s 2024-09-15T22:18:25.780 INFO:tasks.workunit.client.0.smithi045.stderr:+ tar c linux-4.0.5 2024-09-15T22:18:26.097 INFO:tasks.workunit.client.0.smithi045.stderr:+ rm -rf linux-4.0.5 2024-09-15T22:18:26.826 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:18:26.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:26 smithi165 ceph-mon[35551]: pgmap v69: 129 pgs: 129 active+clean; 206 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.9 MiB/s wr, 502 op/s 2024-09-15T22:18:26.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:26 smithi100 ceph-mon[35319]: pgmap v69: 129 pgs: 129 active+clean; 206 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.9 MiB/s wr, 502 op/s 2024-09-15T22:18:27.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:26 smithi045 ceph-mon[31180]: pgmap v69: 129 pgs: 129 active+clean; 206 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.9 MiB/s wr, 502 op/s 2024-09-15T22:18:27.098 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:18:27.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.662+0000 7ff23fc77640 1 -- 172.21.15.45:0/3938943644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff238106f20 msgr2=0x7ff23810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:27.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.662+0000 7ff23fc77640 1 --2- 172.21.15.45:0/3938943644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff238106f20 0x7ff23810eaa0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff230009ca0 tx=0x7ff23002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.662+0000 7ff23fc77640 1 -- 172.21.15.45:0/3938943644 shutdown_connections 2024-09-15T22:18:27.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.662+0000 7ff23fc77640 1 --2- 172.21.15.45:0/3938943644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff238106f20 0x7ff23810eaa0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.662+0000 7ff23fc77640 1 --2- 172.21.15.45:0/3938943644 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff2381027a0 0x7ff2381067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.662+0000 7ff23fc77640 1 --2- 172.21.15.45:0/3938943644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff238101df0 0x7ff2381021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.662+0000 7ff23fc77640 1 -- 172.21.15.45:0/3938943644 >> 172.21.15.45:0/3938943644 conn(0x7ff2380fd8b0 msgr2=0x7ff2380ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.662+0000 7ff23fc77640 1 -- 172.21.15.45:0/3938943644 shutdown_connections 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.662+0000 7ff23fc77640 1 -- 172.21.15.45:0/3938943644 wait complete. 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.662+0000 7ff23fc77640 1 Processor -- start 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.662+0000 7ff23fc77640 1 -- start start 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23fc77640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff238101df0 0x7ff238198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23fc77640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2381027a0 0x7ff2381989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23fc77640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff238106f20 0x7ff23819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23fc77640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff2381120a0 con 0x7ff238101df0 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23fc77640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff238111f20 con 0x7ff2381027a0 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23fc77640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff238112220 con 0x7ff238106f20 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23da13640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff238101df0 0x7ff238198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23d212640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2381027a0 0x7ff2381989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23d212640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2381027a0 0x7ff2381989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:55580/0 (socket says 172.21.15.45:55580) 2024-09-15T22:18:27.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23da13640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff238101df0 0x7ff238198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37448/0 (socket says 172.21.15.45:37448) 2024-09-15T22:18:27.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23d212640 1 -- 172.21.15.45:0/2172882297 learned_addr learned my addr 172.21.15.45:0/2172882297 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:27.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23e214640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff238106f20 0x7ff23819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23d212640 1 -- 172.21.15.45:0/2172882297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff238106f20 msgr2=0x7ff23819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:27.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23d212640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff238106f20 0x7ff23819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23d212640 1 -- 172.21.15.45:0/2172882297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff238101df0 msgr2=0x7ff238198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:27.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23d212640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff238101df0 0x7ff238198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23d212640 1 -- 172.21.15.45:0/2172882297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23819d430 con 0x7ff2381027a0 2024-09-15T22:18:27.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23e214640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff238106f20 0x7ff23819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:18:27.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23da13640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff238101df0 0x7ff238198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:27.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.663+0000 7ff23d212640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2381027a0 0x7ff2381989c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff22800d770 tx=0x7ff22800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:27.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.664+0000 7ff22effd640 1 -- 172.21.15.45:0/2172882297 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff228017070 con 0x7ff2381027a0 2024-09-15T22:18:27.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.664+0000 7ff23fc77640 1 -- 172.21.15.45:0/2172882297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff23819d720 con 0x7ff2381027a0 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.664+0000 7ff22effd640 1 -- 172.21.15.45:0/2172882297 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff228005520 con 0x7ff2381027a0 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.664+0000 7ff22effd640 1 -- 172.21.15.45:0/2172882297 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff228010460 con 0x7ff2381027a0 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.664+0000 7ff23fc77640 1 -- 172.21.15.45:0/2172882297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2381a5000 con 0x7ff2381027a0 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.666+0000 7ff242050740 1 Processor -- start 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.666+0000 7ff242050740 1 -- start start 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.666+0000 7ff22effd640 1 -- 172.21.15.45:0/2172882297 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff228004ea0 con 0x7ff2381027a0 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff242050740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5644400934a0 0x564440093880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff242050740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x56444009e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff242050740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56444009e680 0x5644400a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff242050740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56443fff92e0 con 0x56444009e680 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff242050740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56443ffa0ce0 con 0x564440093dc0 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff242050740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56443fff52a0 con 0x5644400934a0 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff23da13640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x56444009e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff23d212640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56444009e680 0x5644400a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff23da13640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x56444009e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:55596/0 (socket says 172.21.15.45:55596) 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff23da13640 1 -- 172.21.15.45:0/2349887187 learned_addr learned my addr 172.21.15.45:0/2349887187 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff23e214640 1 --2- 172.21.15.45:0/2349887187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5644400934a0 0x564440093880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff23da13640 1 -- 172.21.15.45:0/2349887187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5644400934a0 msgr2=0x564440093880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff23da13640 1 --2- 172.21.15.45:0/2349887187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5644400934a0 0x564440093880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff23da13640 1 -- 172.21.15.45:0/2349887187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56444009e680 msgr2=0x5644400a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff23da13640 1 --2- 172.21.15.45:0/2349887187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56444009e680 0x5644400a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.667+0000 7ff23da13640 1 -- 172.21.15.45:0/2349887187 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56443ff85440 con 0x564440093dc0 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.668+0000 7ff23da13640 1 --2- 172.21.15.45:0/2349887187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x56444009e140 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2340115f0 tx=0x7ff234011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c10d4ea19d3a4db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.668+0000 7ff22effd640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff2240a33b0 0x7ff2240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.668+0000 7ff223fff640 1 -- 172.21.15.45:0/2349887187 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23401e070 con 0x564440093dc0 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.668+0000 7ff23e214640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff2240a33b0 0x7ff2240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.668+0000 7ff223fff640 1 -- 172.21.15.45:0/2349887187 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff23400fb40 con 0x564440093dc0 2024-09-15T22:18:27.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.668+0000 7ff223fff640 1 -- 172.21.15.45:0/2349887187 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234019cb0 con 0x564440093dc0 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.668+0000 7ff22effd640 1 -- 172.21.15.45:0/2172882297 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7ff2280cfb30 con 0x7ff2381027a0 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.669+0000 7ff242050740 1 -- 172.21.15.45:0/2349887187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 msgr2=0x56444009e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.669+0000 7ff23e214640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff2240a33b0 0x7ff2240a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff230009430 tx=0x7ff230005c30 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.669+0000 7ff242050740 1 --2- 172.21.15.45:0/2349887187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x56444009e140 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2340115f0 tx=0x7ff234011ab0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.669+0000 7ff242050740 1 -- 172.21.15.45:0/2349887187 shutdown_connections 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.669+0000 7ff242050740 1 --2- 172.21.15.45:0/2349887187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56444009e680 0x5644400a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.669+0000 7ff242050740 1 --2- 172.21.15.45:0/2349887187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x56444009e140 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.669+0000 7ff242050740 1 --2- 172.21.15.45:0/2349887187 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5644400934a0 0x564440093880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.669+0000 7ff242050740 1 -- 172.21.15.45:0/2349887187 >> 172.21.15.45:0/2349887187 conn(0x56444008fa30 msgr2=0x56444008fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.669+0000 7ff242050740 1 -- 172.21.15.45:0/2349887187 shutdown_connections 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.669+0000 7ff242050740 1 -- 172.21.15.45:0/2349887187 wait complete. 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.669+0000 7ff242050740 1 -- start start 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.669+0000 7ff242050740 1 Processor -- start 2024-09-15T22:18:27.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff242050740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 0x56444009dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff242050740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x56444009b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff242050740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56444009e680 0x56444009b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff242050740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5644400a1250 con 0x5644400934a0 2024-09-15T22:18:27.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff242050740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56443ffb4050 con 0x564440093dc0 2024-09-15T22:18:27.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff242050740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5644400a13d0 con 0x56444009e680 2024-09-15T22:18:27.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff242050740 10 client.0 _ll_register_callbacks cb 0x56443fff4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:27.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff23da13640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 0x56444009dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff23da13640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 0x56444009dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37480/0 (socket says 172.21.15.45:37480) 2024-09-15T22:18:27.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff23d212640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x56444009b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff23da13640 1 -- 172.21.15.45:0/1168026354 learned_addr learned my addr 172.21.15.45:0/1168026354 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:27.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff23e214640 1 --2- 172.21.15.45:0/1168026354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56444009e680 0x56444009b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff23da13640 1 -- 172.21.15.45:0/1168026354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56444009e680 msgr2=0x56444009b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:27.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff23da13640 1 --2- 172.21.15.45:0/1168026354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56444009e680 0x56444009b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff23da13640 1 -- 172.21.15.45:0/1168026354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 msgr2=0x56444009b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff23da13640 1 --2- 172.21.15.45:0/1168026354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x56444009b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff23da13640 1 -- 172.21.15.45:0/1168026354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56443fd6a3c0 con 0x5644400934a0 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff23d212640 1 --2- 172.21.15.45:0/1168026354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x56444009b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff23da13640 1 --2- 172.21.15.45:0/1168026354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 0x56444009dfc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff234019990 tx=0x7ff234019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b4c750a6406b69 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.670+0000 7ff2217fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.671+0000 7ff2217fa640 1 -- 172.21.15.45:0/1168026354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23401e040 con 0x5644400934a0 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.671+0000 7ff242050740 1 -- 172.21.15.45:0/1168026354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff23400fb40 con 0x5644400934a0 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.671+0000 7ff2217fa640 1 -- 172.21.15.45:0/1168026354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7ff23400f700 con 0x5644400934a0 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.671+0000 7ff2217fa640 1 -- 172.21.15.45:0/1168026354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff23402f050 con 0x5644400934a0 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.671+0000 7ff242050740 10 client.15849 fetch_fsmap learned FSMap version 21 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.671+0000 7ff242050740 1 -- 172.21.15.45:0/1168026354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5644400acc60 con 0x5644400934a0 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.671+0000 7ff2217fa640 1 -- 172.21.15.45:0/1168026354 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff23400fb40 con 0x5644400934a0 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.671+0000 7ff2217fa640 1 -- 172.21.15.45:0/1168026354 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff23402a030 con 0x5644400934a0 2024-09-15T22:18:27.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.671+0000 7ff242050740 10 client.15849 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.671+0000 7ff242050740 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.672+0000 7ff242050740 20 client.15849 populate_metadata read hostname 'smithi045' 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.672+0000 7ff242050740 1 --2- 172.21.15.45:0/1168026354 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5644400ae120 0x5644400b0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.672+0000 7ff242050740 4 client.15849 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.672+0000 7ff242050740 1 -- 172.21.15.45:0/1168026354 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564440006850 con 0x5644400ae120 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.672+0000 7ff23d212640 1 --2- 172.21.15.45:0/1168026354 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5644400ae120 0x5644400b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.672+0000 7ff2217fa640 10 client.15849 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.672+0000 7ff23d212640 1 --2- 172.21.15.45:0/1168026354 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5644400ae120 0x5644400b0510 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5c0463c6d891134 server_cookie=5c812ba356acad3f in_seq=0 out_seq=0 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff2217fa640 1 -- 172.21.15.45:0/1168026354 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564440006850 con 0x5644400ae120 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff2217fa640 10 client.15849 handle_command_reply: tid=0 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff242050740 1 client.15849 shutdown 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff242050740 1 -- 172.21.15.45:0/1168026354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 msgr2=0x56444009dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff242050740 1 --2- 172.21.15.45:0/1168026354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 0x56444009dfc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff234019990 tx=0x7ff234019670 comp rx=0 tx=0).stop 2024-09-15T22:18:27.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff242050740 1 -- 172.21.15.45:0/1168026354 shutdown_connections 2024-09-15T22:18:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff242050740 1 --2- 172.21.15.45:0/1168026354 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5644400ae120 0x5644400b0510 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff242050740 1 --2- 172.21.15.45:0/1168026354 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56444009e680 0x56444009b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff242050740 1 --2- 172.21.15.45:0/1168026354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x56444009b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff242050740 1 --2- 172.21.15.45:0/1168026354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 0x56444009dfc0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff2217fa640 0 client.15849 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff242050740 1 -- 172.21.15.45:0/1168026354 >> 172.21.15.45:0/1168026354 conn(0x56444008fa30 msgr2=0x564440095710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff242050740 1 -- 172.21.15.45:0/1168026354 shutdown_connections 2024-09-15T22:18:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.673+0000 7ff242050740 1 -- 172.21.15.45:0/1168026354 wait complete. 2024-09-15T22:18:27.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.674+0000 7ff242050740 20 client.15849 trim_cache size 0 max 16384 2024-09-15T22:18:27.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.691+0000 7ff242050740 1 Processor -- start 2024-09-15T22:18:27.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.691+0000 7ff242050740 1 -- start start 2024-09-15T22:18:27.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.691+0000 7ff242050740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 0x5644400aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.691+0000 7ff242050740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x5644400b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.691+0000 7ff242050740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56444009e680 0x5644400b6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.691+0000 7ff242050740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff2381ad0a0 con 0x5644400934a0 2024-09-15T22:18:27.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.691+0000 7ff242050740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff2381af920 con 0x564440093dc0 2024-09-15T22:18:27.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.691+0000 7ff242050740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff2381ad710 con 0x56444009e680 2024-09-15T22:18:27.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.691+0000 7ff23da13640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 0x5644400aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.691+0000 7ff23da13640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 0x5644400aa4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37492/0 (socket says 172.21.15.45:37492) 2024-09-15T22:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.691+0000 7ff23da13640 1 -- 172.21.15.45:0/2126882228 learned_addr learned my addr 172.21.15.45:0/2126882228 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.691+0000 7ff23d212640 1 --2- 172.21.15.45:0/2126882228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x5644400b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.692+0000 7ff23e214640 1 --2- 172.21.15.45:0/2126882228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56444009e680 0x5644400b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.692+0000 7ff23da13640 1 -- 172.21.15.45:0/2126882228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56444009e680 msgr2=0x5644400b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.692+0000 7ff23da13640 1 --2- 172.21.15.45:0/2126882228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56444009e680 0x5644400b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.692+0000 7ff23da13640 1 -- 172.21.15.45:0/2126882228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 msgr2=0x5644400b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.692+0000 7ff23da13640 1 --2- 172.21.15.45:0/2126882228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x5644400b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.692+0000 7ff23da13640 1 -- 172.21.15.45:0/2126882228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56444009e330 con 0x5644400934a0 2024-09-15T22:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.692+0000 7ff23e214640 1 --2- 172.21.15.45:0/2126882228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56444009e680 0x5644400b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.692+0000 7ff23da13640 1 --2- 172.21.15.45:0/2126882228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 0x5644400aa4b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff234003900 tx=0x7ff234009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a48fcf4f28ce79f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.692+0000 7ff2237fe640 1 -- 172.21.15.45:0/2126882228 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23401e040 con 0x5644400934a0 2024-09-15T22:18:27.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.692+0000 7ff2237fe640 1 -- 172.21.15.45:0/2126882228 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff234011070 con 0x5644400934a0 2024-09-15T22:18:27.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.692+0000 7ff2237fe640 1 -- 172.21.15.45:0/2126882228 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23400fa30 con 0x5644400934a0 2024-09-15T22:18:27.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.693+0000 7ff242050740 1 -- 172.21.15.45:0/2126882228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 msgr2=0x5644400aa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.693+0000 7ff242050740 1 --2- 172.21.15.45:0/2126882228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 0x5644400aa4b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff234003900 tx=0x7ff234009b50 comp rx=0 tx=0).stop 2024-09-15T22:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.693+0000 7ff242050740 1 -- 172.21.15.45:0/2126882228 shutdown_connections 2024-09-15T22:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.693+0000 7ff242050740 1 --2- 172.21.15.45:0/2126882228 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56444009e680 0x5644400b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.693+0000 7ff242050740 1 --2- 172.21.15.45:0/2126882228 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564440093dc0 0x5644400b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.693+0000 7ff242050740 1 --2- 172.21.15.45:0/2126882228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5644400934a0 0x5644400aa4b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.693+0000 7ff242050740 1 -- 172.21.15.45:0/2126882228 >> 172.21.15.45:0/2126882228 conn(0x56444008fa30 msgr2=0x564440096900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.693+0000 7ff242050740 1 -- 172.21.15.45:0/2126882228 shutdown_connections 2024-09-15T22:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.693+0000 7ff242050740 1 -- 172.21.15.45:0/2126882228 wait complete. 2024-09-15T22:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.693+0000 7ff242050740 1 -- start start 2024-09-15T22:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.693+0000 7ff242050740 1 Processor -- start 2024-09-15T22:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff242050740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644400934a0 0x5644400a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff242050740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564440093dc0 0x5644400a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff242050740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56444009e680 0x5644400a2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff242050740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff2381adde0 con 0x56444009e680 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff242050740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff2381af250 con 0x5644400934a0 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff242050740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff2381ae4b0 con 0x564440093dc0 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff242050740 10 client.0 _ll_register_callbacks cb 0x7ff23401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff23e214640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56444009e680 0x5644400a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff23e214640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56444009e680 0x5644400a2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37498/0 (socket says 172.21.15.45:37498) 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff23e214640 1 -- 172.21.15.45:0/4063069467 learned_addr learned my addr 172.21.15.45:0/4063069467 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff23da13640 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644400934a0 0x5644400a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff23d212640 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564440093dc0 0x5644400a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff23e214640 1 -- 172.21.15.45:0/4063069467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564440093dc0 msgr2=0x5644400a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff23e214640 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564440093dc0 0x5644400a1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff23e214640 1 -- 172.21.15.45:0/4063069467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644400934a0 msgr2=0x5644400a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff23e214640 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644400934a0 0x5644400a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff23e214640 1 -- 172.21.15.45:0/4063069467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564440116db0 con 0x56444009e680 2024-09-15T22:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff23da13640 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644400934a0 0x5644400a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff23e214640 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56444009e680 0x5644400a2060 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff230009ca0 tx=0x7ff23002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdb4862eb6df7f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.694+0000 7ff2217fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff2217fa640 1 -- 172.21.15.45:0/4063069467 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230004250 con 0x56444009e680 2024-09-15T22:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff242050740 1 -- 172.21.15.45:0/4063069467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff234011070 con 0x56444009e680 2024-09-15T22:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff2217fa640 1 -- 172.21.15.45:0/4063069467 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7ff230041030 con 0x56444009e680 2024-09-15T22:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff2217fa640 1 -- 172.21.15.45:0/4063069467 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff2300043f0 con 0x56444009e680 2024-09-15T22:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff242050740 10 client.15855 fetch_fsmap learned FSMap version 21 2024-09-15T22:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff242050740 1 -- 172.21.15.45:0/4063069467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564440117fd0 con 0x56444009e680 2024-09-15T22:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff2217fa640 1 -- 172.21.15.45:0/4063069467 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff234011070 con 0x56444009e680 2024-09-15T22:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff2217fa640 1 -- 172.21.15.45:0/4063069467 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff2300305c0 con 0x56444009e680 2024-09-15T22:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff242050740 10 client.15855 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:18:27.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff242050740 10 client.15855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff242050740 20 client.15855 populate_metadata read hostname 'smithi045' 2024-09-15T22:18:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff242050740 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x564440118750 0x56444011ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff242050740 4 client.15855 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:18:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff242050740 1 -- 172.21.15.45:0/4063069467 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564440000d60 con 0x564440118750 2024-09-15T22:18:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.695+0000 7ff23da13640 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x564440118750 0x56444011ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.696+0000 7ff23da13640 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x564440118750 0x56444011ab70 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e0c799ab1d5e8b1 server_cookie=11c185cc296864d5 in_seq=0 out_seq=0 2024-09-15T22:18:27.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.696+0000 7ff2217fa640 10 client.15855 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff2217fa640 1 -- 172.21.15.45:0/4063069467 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564440000d60 con 0x564440118750 2024-09-15T22:18:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff2217fa640 10 client.15855 handle_command_reply: tid=0 2024-09-15T22:18:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff242050740 1 client.15855 shutdown 2024-09-15T22:18:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff242050740 1 -- 172.21.15.45:0/4063069467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56444009e680 msgr2=0x5644400a2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff242050740 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56444009e680 0x5644400a2060 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff230009ca0 tx=0x7ff23002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff242050740 1 -- 172.21.15.45:0/4063069467 shutdown_connections 2024-09-15T22:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff242050740 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x564440118750 0x56444011ab70 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff242050740 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56444009e680 0x5644400a2060 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff242050740 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564440093dc0 0x5644400a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff2217fa640 0 client.15855 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff242050740 1 --2- 172.21.15.45:0/4063069467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5644400934a0 0x5644400a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff242050740 1 -- 172.21.15.45:0/4063069467 >> 172.21.15.45:0/4063069467 conn(0x56444008fa30 msgr2=0x56444008e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff242050740 1 -- 172.21.15.45:0/4063069467 shutdown_connections 2024-09-15T22:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff242050740 1 -- 172.21.15.45:0/4063069467 wait complete. 2024-09-15T22:18:27.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.698+0000 7ff242050740 20 client.15855 trim_cache size 0 max 16384 2024-09-15T22:18:27.704 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:18:27.705 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:18:27.705 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:18:27.705 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:18:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.699+0000 7ff23fc77640 1 -- 172.21.15.45:0/2172882297 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff2240a33b0 msgr2=0x7ff2240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.699+0000 7ff23fc77640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff2240a33b0 0x7ff2240a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff230009430 tx=0x7ff230005c30 comp rx=0 tx=0).stop 2024-09-15T22:18:27.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.699+0000 7ff23fc77640 1 -- 172.21.15.45:0/2172882297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2381027a0 msgr2=0x7ff2381989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.699+0000 7ff23fc77640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2381027a0 0x7ff2381989c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff22800d770 tx=0x7ff22800dc30 comp rx=0 tx=0).stop 2024-09-15T22:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.699+0000 7ff23fc77640 1 -- 172.21.15.45:0/2172882297 shutdown_connections 2024-09-15T22:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.699+0000 7ff23fc77640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff2240a33b0 0x7ff2240a5870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.699+0000 7ff23fc77640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff238106f20 0x7ff23819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.699+0000 7ff23fc77640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff2381027a0 0x7ff2381989c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.699+0000 7ff23fc77640 1 --2- 172.21.15.45:0/2172882297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff238101df0 0x7ff238198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.699+0000 7ff23fc77640 1 -- 172.21.15.45:0/2172882297 >> 172.21.15.45:0/2172882297 conn(0x7ff2380fd8b0 msgr2=0x7ff2380fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.699+0000 7ff23fc77640 1 -- 172.21.15.45:0/2172882297 shutdown_connections 2024-09-15T22:18:27.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:27.699+0000 7ff23fc77640 1 -- 172.21.15.45:0/2172882297 wait complete. 2024-09-15T22:18:28.516 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:18:28.516 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:18:28.795 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:18:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:28 smithi045 ceph-mon[31180]: pgmap v70: 129 pgs: 129 active+clean; 206 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.9 MiB/s wr, 502 op/s 2024-09-15T22:18:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:28 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:28 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:28 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:28 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:28.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:28 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:28.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:28 smithi165 ceph-mon[35551]: pgmap v70: 129 pgs: 129 active+clean; 206 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.9 MiB/s wr, 502 op/s 2024-09-15T22:18:28.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:28 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:28 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:28 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:28 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:28.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:28 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:28 smithi100 ceph-mon[35319]: pgmap v70: 129 pgs: 129 active+clean; 206 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.9 MiB/s wr, 502 op/s 2024-09-15T22:18:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:28 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:18:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:28 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:28 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:28 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:28 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:29.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.383+0000 7f17564dd640 1 -- 172.21.15.45:0/2753128385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1750102790 msgr2=0x7f17501067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:29.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.383+0000 7f17564dd640 1 --2- 172.21.15.45:0/2753128385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1750102790 0x7f17501067e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1744009900 tx=0x7f174402a410 comp rx=0 tx=0).stop 2024-09-15T22:18:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.383+0000 7f17564dd640 1 -- 172.21.15.45:0/2753128385 shutdown_connections 2024-09-15T22:18:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.383+0000 7f17564dd640 1 --2- 172.21.15.45:0/2753128385 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1750106f10 0x7f175010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.383+0000 7f17564dd640 1 --2- 172.21.15.45:0/2753128385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1750102790 0x7f17501067e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.383+0000 7f17564dd640 1 --2- 172.21.15.45:0/2753128385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1750101de0 0x7f17501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.383+0000 7f17564dd640 1 -- 172.21.15.45:0/2753128385 >> 172.21.15.45:0/2753128385 conn(0x7f17500fd8c0 msgr2=0x7f17500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.383+0000 7f17564dd640 1 -- 172.21.15.45:0/2753128385 shutdown_connections 2024-09-15T22:18:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.383+0000 7f17564dd640 1 -- 172.21.15.45:0/2753128385 wait complete. 2024-09-15T22:18:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.384+0000 7f17564dd640 1 Processor -- start 2024-09-15T22:18:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.384+0000 7f17564dd640 1 -- start start 2024-09-15T22:18:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.384+0000 7f17564dd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1750101de0 0x7f17501a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:29.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.384+0000 7f17564dd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1750102790 0x7f17501a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.384+0000 7f17564dd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1750106f10 0x7f175019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.384+0000 7f17564dd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1750112090 con 0x7f1750102790 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.384+0000 7f17564dd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1750111f10 con 0x7f1750101de0 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.384+0000 7f17564dd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1750112210 con 0x7f1750106f10 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.384+0000 7f174ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1750101de0 0x7f17501a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.384+0000 7f174f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1750102790 0x7f17501a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.384+0000 7f174ffff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1750101de0 0x7f17501a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:55634/0 (socket says 172.21.15.45:55634) 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.384+0000 7f174ffff640 1 -- 172.21.15.45:0/1747497590 learned_addr learned my addr 172.21.15.45:0/1747497590 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f1754a7a640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1750106f10 0x7f175019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f174ffff640 1 -- 172.21.15.45:0/1747497590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1750106f10 msgr2=0x7f175019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f174ffff640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1750106f10 0x7f175019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f174ffff640 1 -- 172.21.15.45:0/1747497590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1750102790 msgr2=0x7f17501a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f174ffff640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1750102790 0x7f17501a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:29.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f174ffff640 1 -- 172.21.15.45:0/1747497590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175019acf0 con 0x7f1750101de0 2024-09-15T22:18:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f1754a7a640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1750106f10 0x7f175019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:18:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f174f7fe640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1750102790 0x7f17501a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f174ffff640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1750101de0 0x7f17501a0400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f174000e9f0 tx=0x7f174000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f174d7fa640 1 -- 172.21.15.45:0/1747497590 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174000cd80 con 0x7f1750101de0 2024-09-15T22:18:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f174d7fa640 1 -- 172.21.15.45:0/1747497590 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1740010930 con 0x7f1750101de0 2024-09-15T22:18:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f17564dd640 1 -- 172.21.15.45:0/1747497590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175019afe0 con 0x7f1750101de0 2024-09-15T22:18:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f174d7fa640 1 -- 172.21.15.45:0/1747497590 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740018b00 con 0x7f1750101de0 2024-09-15T22:18:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.385+0000 7f17564dd640 1 -- 172.21.15.45:0/1747497590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17501a72d0 con 0x7f1750101de0 2024-09-15T22:18:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.386+0000 7f17564dd640 1 -- 172.21.15.45:0/1747497590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17501021c0 con 0x7f1750101de0 2024-09-15T22:18:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.388+0000 7f174d7fa640 1 -- 172.21.15.45:0/1747497590 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1740018ca0 con 0x7f1750101de0 2024-09-15T22:18:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.388+0000 7f174d7fa640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f17380a33b0 0x7f17380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.388+0000 7f174f7fe640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f17380a33b0 0x7f17380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:29.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.388+0000 7f174d7fa640 1 -- 172.21.15.45:0/1747497590 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f17400d0880 con 0x7f1750101de0 2024-09-15T22:18:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.389+0000 7f174f7fe640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f17380a33b0 0x7f17380a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1744009230 tx=0x7f17440058d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:29.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.393+0000 7f174d7fa640 1 -- 172.21.15.45:0/1747497590 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f174009cea0 con 0x7f1750101de0 2024-09-15T22:18:29.669 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:18:29.669 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:18:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.613+0000 7f17564dd640 1 -- 172.21.15.45:0/1747497590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17501a7500 con 0x7f1750101de0 2024-09-15T22:18:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.614+0000 7f174d7fa640 1 -- 172.21.15.45:0/1747497590 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f174009c7a0 con 0x7f1750101de0 2024-09-15T22:18:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:18:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.616+0000 7f17564dd640 1 -- 172.21.15.45:0/1747497590 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f17380a33b0 msgr2=0x7f17380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.616+0000 7f17564dd640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f17380a33b0 0x7f17380a5870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1744009230 tx=0x7f17440058d0 comp rx=0 tx=0).stop 2024-09-15T22:18:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.616+0000 7f17564dd640 1 -- 172.21.15.45:0/1747497590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1750101de0 msgr2=0x7f17501a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.616+0000 7f17564dd640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1750101de0 0x7f17501a0400 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f174000e9f0 tx=0x7f174000eeb0 comp rx=0 tx=0).stop 2024-09-15T22:18:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.616+0000 7f17564dd640 1 -- 172.21.15.45:0/1747497590 shutdown_connections 2024-09-15T22:18:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.616+0000 7f17564dd640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f17380a33b0 0x7f17380a5870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.616+0000 7f17564dd640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1750106f10 0x7f175019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.616+0000 7f17564dd640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1750102790 0x7f17501a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:29.670 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.616+0000 7f17564dd640 1 --2- 172.21.15.45:0/1747497590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1750101de0 0x7f17501a0400 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.616+0000 7f17564dd640 1 -- 172.21.15.45:0/1747497590 >> 172.21.15.45:0/1747497590 conn(0x7f17500fd8c0 msgr2=0x7f17500feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.616+0000 7f17564dd640 1 -- 172.21.15.45:0/1747497590 shutdown_connections 2024-09-15T22:18:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:29.616+0000 7f17564dd640 1 -- 172.21.15.45:0/1747497590 wait complete. 2024-09-15T22:18:29.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:29 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:29.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:29 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:29.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:29 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:29.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:29 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1747497590' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:18:29.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:29 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:29.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:29 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:29.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:29 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:29.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:29 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1747497590' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:18:30.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:29 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:18:30.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:29 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:18:30.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:29 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:18:30.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:29 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1747497590' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:18:30.691 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:18:30.959 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:18:31.274 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:31 smithi045 ceph-mon[31180]: pgmap v71: 129 pgs: 129 active+clean; 221 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.2 MiB/s wr, 659 op/s 2024-09-15T22:18:31.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:31 smithi165 ceph-mon[35551]: pgmap v71: 129 pgs: 129 active+clean; 221 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.2 MiB/s wr, 659 op/s 2024-09-15T22:18:31.497 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:31 smithi100 ceph-mon[35319]: pgmap v71: 129 pgs: 129 active+clean; 221 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 5.2 MiB/s wr, 659 op/s 2024-09-15T22:18:31.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.525+0000 7f40bce54640 1 -- 172.21.15.45:0/1670820797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b8102da0 msgr2=0x7f40b8103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:31.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.525+0000 7f40bce54640 1 --2- 172.21.15.45:0/1670820797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b8102da0 0x7f40b8103180 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009900 tx=0x7f40a802a480 comp rx=0 tx=0).stop 2024-09-15T22:18:31.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.526+0000 7f40bce54640 1 -- 172.21.15.45:0/1670820797 shutdown_connections 2024-09-15T22:18:31.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.526+0000 7f40bce54640 1 --2- 172.21.15.45:0/1670820797 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40b810c180 0x7f40b810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.526+0000 7f40bce54640 1 --2- 172.21.15.45:0/1670820797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40b81036c0 0x7f40b810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.526+0000 7f40bce54640 1 --2- 172.21.15.45:0/1670820797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b8102da0 0x7f40b8103180 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.526+0000 7f40bce54640 1 -- 172.21.15.45:0/1670820797 >> 172.21.15.45:0/1670820797 conn(0x7f40b80fc7a0 msgr2=0x7f40b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:31.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.526+0000 7f40bce54640 1 -- 172.21.15.45:0/1670820797 shutdown_connections 2024-09-15T22:18:31.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.526+0000 7f40bce54640 1 -- 172.21.15.45:0/1670820797 wait complete. 2024-09-15T22:18:31.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.526+0000 7f40bce54640 1 Processor -- start 2024-09-15T22:18:31.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40bce54640 1 -- start start 2024-09-15T22:18:31.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40bce54640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40b8102da0 0x7f40b8100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40bce54640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40b81036c0 0x7f40b8100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40bce54640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b810c180 0x7f40b8101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40bce54640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f40b8112080 con 0x7f40b810c180 2024-09-15T22:18:31.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40bce54640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40b8111f00 con 0x7f40b8102da0 2024-09-15T22:18:31.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40bce54640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f40b8112200 con 0x7f40b81036c0 2024-09-15T22:18:31.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40b659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40b8102da0 0x7f40b8100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40b6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b810c180 0x7f40b8101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40b659c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40b8102da0 0x7f40b8100a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:55648/0 (socket says 172.21.15.45:55648) 2024-09-15T22:18:31.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40b659c640 1 -- 172.21.15.45:0/2215956960 learned_addr learned my addr 172.21.15.45:0/2215956960 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:31.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40b5d9b640 1 --2- 172.21.15.45:0/2215956960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40b81036c0 0x7f40b8100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40b659c640 1 -- 172.21.15.45:0/2215956960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40b81036c0 msgr2=0x7f40b8100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:31.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40b659c640 1 --2- 172.21.15.45:0/2215956960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40b81036c0 0x7f40b8100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40b659c640 1 -- 172.21.15.45:0/2215956960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b810c180 msgr2=0x7f40b8101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:31.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40b659c640 1 --2- 172.21.15.45:0/2215956960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b810c180 0x7f40b8101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.527+0000 7f40b659c640 1 -- 172.21.15.45:0/2215956960 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b81a69c0 con 0x7f40b8102da0 2024-09-15T22:18:31.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.528+0000 7f40b659c640 1 --2- 172.21.15.45:0/2215956960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40b8102da0 0x7f40b8100a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f40a8006010 tx=0x7f40a80042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:31.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.528+0000 7f40a77fe640 1 -- 172.21.15.45:0/2215956960 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a803f030 con 0x7f40b8102da0 2024-09-15T22:18:31.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.528+0000 7f40a77fe640 1 -- 172.21.15.45:0/2215956960 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f40a8003d00 con 0x7f40b8102da0 2024-09-15T22:18:31.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.528+0000 7f40bce54640 1 -- 172.21.15.45:0/2215956960 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b81a6c50 con 0x7f40b8102da0 2024-09-15T22:18:31.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.528+0000 7f40a77fe640 1 -- 172.21.15.45:0/2215956960 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8035070 con 0x7f40b8102da0 2024-09-15T22:18:31.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.528+0000 7f40bce54640 1 -- 172.21.15.45:0/2215956960 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b81a7130 con 0x7f40b8102da0 2024-09-15T22:18:31.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.530+0000 7f40a77fe640 1 -- 172.21.15.45:0/2215956960 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f40a8042030 con 0x7f40b8102da0 2024-09-15T22:18:31.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.530+0000 7f40bf22d740 1 Processor -- start 2024-09-15T22:18:31.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40bf22d740 1 -- start start 2024-09-15T22:18:31.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40bf22d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c9b40 0x556f071c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40bf22d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c85d0 0x556f071c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40bf22d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071d3370 0x556f071d5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40bf22d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556f0712e2f0 con 0x556f071c85d0 2024-09-15T22:18:31.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40bf22d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556f070d5cf0 con 0x556f071c9b40 2024-09-15T22:18:31.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40bf22d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556f0712a2b0 con 0x556f071d3370 2024-09-15T22:18:31.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40b659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c85d0 0x556f071c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40b6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c9b40 0x556f071c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40b6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c9b40 0x556f071c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:55664/0 (socket says 172.21.15.45:55664) 2024-09-15T22:18:31.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40b6d9d640 1 -- 172.21.15.45:0/1647542679 learned_addr learned my addr 172.21.15.45:0/1647542679 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:31.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40b5d9b640 1 --2- 172.21.15.45:0/1647542679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071d3370 0x556f071d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40b6d9d640 1 -- 172.21.15.45:0/1647542679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071d3370 msgr2=0x556f071d5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:31.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/1647542679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071d3370 0x556f071d5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40b6d9d640 1 -- 172.21.15.45:0/1647542679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c85d0 msgr2=0x556f071c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:31.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/1647542679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c85d0 0x556f071c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40b6d9d640 1 -- 172.21.15.45:0/1647542679 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f070ba3a0 con 0x556f071c9b40 2024-09-15T22:18:31.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40a77fe640 1 --2- 172.21.15.45:0/2215956960 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f40a00a33b0 0x7f40a00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.531+0000 7f40b659c640 1 --2- 172.21.15.45:0/2215956960 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f40a00a33b0 0x7f40a00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.532+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/1647542679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c9b40 0x556f071c8090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009f70 tx=0x7f40b0010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda9ca0435788922 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:31.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.532+0000 7f40a77fe640 1 -- 172.21.15.45:0/2215956960 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f40a80f0450 con 0x7f40b8102da0 2024-09-15T22:18:31.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.532+0000 7f40a4ff9640 1 -- 172.21.15.45:0/1647542679 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0016070 con 0x556f071c9b40 2024-09-15T22:18:31.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.532+0000 7f40a4ff9640 1 -- 172.21.15.45:0/1647542679 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f40b0004d20 con 0x556f071c9b40 2024-09-15T22:18:31.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.532+0000 7f40a4ff9640 1 -- 172.21.15.45:0/1647542679 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b00128f0 con 0x556f071c9b40 2024-09-15T22:18:31.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.532+0000 7f40b659c640 1 --2- 172.21.15.45:0/2215956960 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f40a00a33b0 0x7f40a00a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x556f071c5ac0 tx=0x7f40a80f3f00 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:31.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.532+0000 7f40bf22d740 1 -- 172.21.15.45:0/1647542679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c9b40 msgr2=0x556f071c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:31.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.532+0000 7f40bf22d740 1 --2- 172.21.15.45:0/1647542679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c9b40 0x556f071c8090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009f70 tx=0x7f40b0010800 comp rx=0 tx=0).stop 2024-09-15T22:18:31.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 -- 172.21.15.45:0/1647542679 shutdown_connections 2024-09-15T22:18:31.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 --2- 172.21.15.45:0/1647542679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071d3370 0x556f071d5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 --2- 172.21.15.45:0/1647542679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c85d0 0x556f071c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 --2- 172.21.15.45:0/1647542679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c9b40 0x556f071c8090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 -- 172.21.15.45:0/1647542679 >> 172.21.15.45:0/1647542679 conn(0x556f07191310 msgr2=0x556f071c4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:31.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 -- 172.21.15.45:0/1647542679 shutdown_connections 2024-09-15T22:18:31.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 -- 172.21.15.45:0/1647542679 wait complete. 2024-09-15T22:18:31.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 -- start start 2024-09-15T22:18:31.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 Processor -- start 2024-09-15T22:18:31.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c85d0 0x556f071d2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 0x556f071d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071d3370 0x556f071d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556f071d6070 con 0x556f071c9b40 2024-09-15T22:18:31.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556f070e9060 con 0x556f071c85d0 2024-09-15T22:18:31.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556f071d61f0 con 0x556f071d3370 2024-09-15T22:18:31.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40bf22d740 10 client.0 _ll_register_callbacks cb 0x556f06e3c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:31.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.533+0000 7f40b5d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 0x556f071d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f40b5d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 0x556f071d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37536/0 (socket says 172.21.15.45:37536) 2024-09-15T22:18:31.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f40b5d9b640 1 -- 172.21.15.45:0/1136120303 learned_addr learned my addr 172.21.15.45:0/1136120303 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:31.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c85d0 0x556f071d2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071d3370 0x556f071d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f40b5d9b640 1 -- 172.21.15.45:0/1136120303 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071d3370 msgr2=0x556f071d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:31.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f40b5d9b640 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071d3370 0x556f071d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f40b5d9b640 1 -- 172.21.15.45:0/1136120303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c85d0 msgr2=0x556f071d2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f40b5d9b640 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c85d0 0x556f071d2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f40b5d9b640 1 -- 172.21.15.45:0/1136120303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f06e9f3c0 con 0x556f071c9b40 2024-09-15T22:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c85d0 0x556f071d2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f40b5d9b640 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 0x556f071d0030 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f40ac012700 tx=0x7f40ac012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c764df78418f15c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f409dffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f409dffb640 1 -- 172.21.15.45:0/1136120303 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00f8c0 con 0x556f071c9b40 2024-09-15T22:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f409dffb640 1 -- 172.21.15.45:0/1136120303 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f40ac00fa60 con 0x556f071c9b40 2024-09-15T22:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.534+0000 7f40bf22d740 1 -- 172.21.15.45:0/1136120303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40b0004d20 con 0x556f071c9b40 2024-09-15T22:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.535+0000 7f409dffb640 1 -- 172.21.15.45:0/1136120303 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f40ac025050 con 0x556f071c9b40 2024-09-15T22:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.535+0000 7f40bf22d740 10 client.15873 fetch_fsmap learned FSMap version 21 2024-09-15T22:18:31.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.535+0000 7f40bf22d740 1 -- 172.21.15.45:0/1136120303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556f071e1c00 con 0x556f071c9b40 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.535+0000 7f409dffb640 1 -- 172.21.15.45:0/1136120303 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f40b0004d20 con 0x556f071c9b40 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.535+0000 7f409dffb640 1 -- 172.21.15.45:0/1136120303 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f40ac010430 con 0x556f071c9b40 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.535+0000 7f40bf22d740 10 client.15873 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.535+0000 7f40bf22d740 10 client.15873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.535+0000 7f40bf22d740 20 client.15873 populate_metadata read hostname 'smithi045' 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.535+0000 7f40bf22d740 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556f071e30c0 0x556f071e54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.535+0000 7f40bf22d740 4 client.15873 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.535+0000 7f40bf22d740 1 -- 172.21.15.45:0/1136120303 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f0713b860 con 0x556f071e30c0 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.535+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556f071e30c0 0x556f071e54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.536+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556f071e30c0 0x556f071e54d0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df55b855ec1ec06f server_cookie=f589ef520f59f1b3 in_seq=0 out_seq=0 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.536+0000 7f409dffb640 10 client.15873 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f409dffb640 1 -- 172.21.15.45:0/1136120303 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556f0713b860 con 0x556f071e30c0 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f409dffb640 10 client.15873 handle_command_reply: tid=0 2024-09-15T22:18:31.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f40bf22d740 1 client.15873 shutdown 2024-09-15T22:18:31.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f40bf22d740 1 -- 172.21.15.45:0/1136120303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 msgr2=0x556f071d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:31.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f40bf22d740 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 0x556f071d0030 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f40ac012700 tx=0x7f40ac012bc0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f40bf22d740 1 -- 172.21.15.45:0/1136120303 shutdown_connections 2024-09-15T22:18:31.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f40bf22d740 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556f071e30c0 0x556f071e54d0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f40bf22d740 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071d3370 0x556f071d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f40bf22d740 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 0x556f071d0030 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f409dffb640 0 client.15873 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f40bf22d740 1 --2- 172.21.15.45:0/1136120303 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c85d0 0x556f071d2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f40bf22d740 1 -- 172.21.15.45:0/1136120303 >> 172.21.15.45:0/1136120303 conn(0x556f07191310 msgr2=0x556f071ca930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f40bf22d740 1 -- 172.21.15.45:0/1136120303 shutdown_connections 2024-09-15T22:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.537+0000 7f40bf22d740 1 -- 172.21.15.45:0/1136120303 wait complete. 2024-09-15T22:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.538+0000 7f40bf22d740 20 client.15873 trim_cache size 0 max 16384 2024-09-15T22:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.550+0000 7f40bf22d740 1 Processor -- start 2024-09-15T22:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40bf22d740 1 -- start start 2024-09-15T22:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40bf22d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071c85d0 0x556f071df370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40bf22d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 0x556f071d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40bf22d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071d3370 0x556f071eada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40bf22d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81af2d0 con 0x556f071c9b40 2024-09-15T22:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40bf22d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81b1b50 con 0x556f071d3370 2024-09-15T22:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40bf22d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81af940 con 0x556f071c85d0 2024-09-15T22:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40b5d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 0x556f071d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40b5d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 0x556f071d1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37548/0 (socket says 172.21.15.45:37548) 2024-09-15T22:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40b5d9b640 1 -- 172.21.15.45:0/3817720393 learned_addr learned my addr 172.21.15.45:0/3817720393 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/3817720393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071d3370 0x556f071eada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/3817720393 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071c85d0 0x556f071df370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40b5d9b640 1 -- 172.21.15.45:0/3817720393 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071c85d0 msgr2=0x556f071df370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40b5d9b640 1 --2- 172.21.15.45:0/3817720393 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071c85d0 0x556f071df370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40b5d9b640 1 -- 172.21.15.45:0/3817720393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071d3370 msgr2=0x556f071eada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40b5d9b640 1 --2- 172.21.15.45:0/3817720393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071d3370 0x556f071eada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40b5d9b640 1 -- 172.21.15.45:0/3817720393 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f071c8d50 con 0x556f071c9b40 2024-09-15T22:18:31.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.551+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/3817720393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071d3370 0x556f071eada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:31.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.552+0000 7f40b5d9b640 1 --2- 172.21.15.45:0/3817720393 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 0x556f071d1fa0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0109f0 tx=0x7f40ac009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f802cbd09f1e6c4d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:31.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.552+0000 7f409ffff640 1 -- 172.21.15.45:0/3817720393 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac011eb0 con 0x556f071c9b40 2024-09-15T22:18:31.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.552+0000 7f409ffff640 1 -- 172.21.15.45:0/3817720393 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f40ac0055d0 con 0x556f071c9b40 2024-09-15T22:18:31.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.552+0000 7f409ffff640 1 -- 172.21.15.45:0/3817720393 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00f860 con 0x556f071c9b40 2024-09-15T22:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.552+0000 7f40bf22d740 1 -- 172.21.15.45:0/3817720393 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 msgr2=0x556f071d1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.552+0000 7f40bf22d740 1 --2- 172.21.15.45:0/3817720393 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 0x556f071d1fa0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0109f0 tx=0x7f40ac009f20 comp rx=0 tx=0).stop 2024-09-15T22:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.553+0000 7f40bf22d740 1 -- 172.21.15.45:0/3817720393 shutdown_connections 2024-09-15T22:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.553+0000 7f40bf22d740 1 --2- 172.21.15.45:0/3817720393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071d3370 0x556f071eada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.553+0000 7f40bf22d740 1 --2- 172.21.15.45:0/3817720393 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071c9b40 0x556f071d1fa0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.553+0000 7f40bf22d740 1 --2- 172.21.15.45:0/3817720393 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071c85d0 0x556f071df370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.553+0000 7f40bf22d740 1 -- 172.21.15.45:0/3817720393 >> 172.21.15.45:0/3817720393 conn(0x556f07191310 msgr2=0x556f071d1890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.553+0000 7f40bf22d740 1 -- 172.21.15.45:0/3817720393 shutdown_connections 2024-09-15T22:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.553+0000 7f40bf22d740 1 -- 172.21.15.45:0/3817720393 wait complete. 2024-09-15T22:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.553+0000 7f40bf22d740 1 -- start start 2024-09-15T22:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.553+0000 7f40bf22d740 1 Processor -- start 2024-09-15T22:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40bf22d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c85d0 0x556f071d7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40bf22d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071c9b40 0x556f071d7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40bf22d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071d3370 0x556f071d7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40bf22d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81b0010 con 0x556f071d3370 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40bf22d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81b1480 con 0x556f071c85d0 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40bf22d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f40b81b06e0 con 0x556f071c9b40 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40bf22d740 10 client.0 _ll_register_callbacks cb 0x7f40ac009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40b6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071d3370 0x556f071d7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40b6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c85d0 0x556f071d7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40b6d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c85d0 0x556f071d7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:55694/0 (socket says 172.21.15.45:55694) 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40b5d9b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071c9b40 0x556f071d7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40b6d9d640 1 -- 172.21.15.45:0/2725659364 learned_addr learned my addr 172.21.15.45:0/2725659364 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40b6d9d640 1 -- 172.21.15.45:0/2725659364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071c9b40 msgr2=0x556f071d7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/2725659364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071c9b40 0x556f071d7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40b6d9d640 1 -- 172.21.15.45:0/2725659364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c85d0 msgr2=0x556f071d7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:31.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/2725659364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c85d0 0x556f071d7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40b6d9d640 1 -- 172.21.15.45:0/2725659364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f0724cf10 con 0x556f071d3370 2024-09-15T22:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f40b6d9d640 1 --2- 172.21.15.45:0/2725659364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071d3370 0x556f071d7ed0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009a80 tx=0x7f40ac009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bee948f293c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.554+0000 7f409dffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f409dffb640 1 -- 172.21.15.45:0/2725659364 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b0016040 con 0x556f071d3370 2024-09-15T22:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f409dffb640 1 -- 172.21.15.45:0/2725659364 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f40b001a410 con 0x556f071d3370 2024-09-15T22:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f40bf22d740 1 -- 172.21.15.45:0/2725659364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40ac0055d0 con 0x556f071d3370 2024-09-15T22:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f409dffb640 1 -- 172.21.15.45:0/2725659364 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f40b0023040 con 0x556f071d3370 2024-09-15T22:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f40bf22d740 10 client.15879 fetch_fsmap learned FSMap version 21 2024-09-15T22:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f40bf22d740 1 -- 172.21.15.45:0/2725659364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556f0724e1b0 con 0x556f071d3370 2024-09-15T22:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f409dffb640 1 -- 172.21.15.45:0/2725659364 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f40ac0055d0 con 0x556f071d3370 2024-09-15T22:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f409dffb640 1 -- 172.21.15.45:0/2725659364 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f40b0029040 con 0x556f071d3370 2024-09-15T22:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f40bf22d740 10 client.15879 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:18:31.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f40bf22d740 10 client.15879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f40bf22d740 20 client.15879 populate_metadata read hostname 'smithi045' 2024-09-15T22:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f40bf22d740 1 --2- 172.21.15.45:0/2725659364 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556f0724e740 0x556f07250b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f40bf22d740 4 client.15879 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f40bf22d740 1 -- 172.21.15.45:0/2725659364 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556f07135d70 con 0x556f0724e740 2024-09-15T22:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.555+0000 7f40b5d9b640 1 --2- 172.21.15.45:0/2725659364 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556f0724e740 0x556f07250b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f409dffb640 10 client.15879 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f40b5d9b640 1 --2- 172.21.15.45:0/2725659364 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556f0724e740 0x556f07250b60 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49155fce9035aec1 server_cookie=6fcef571396d8098 in_seq=0 out_seq=0 2024-09-15T22:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f409dffb640 1 -- 172.21.15.45:0/2725659364 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556f07135d70 con 0x556f0724e740 2024-09-15T22:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f409dffb640 10 client.15879 handle_command_reply: tid=0 2024-09-15T22:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f40bf22d740 1 client.15879 shutdown 2024-09-15T22:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f40bf22d740 1 -- 172.21.15.45:0/2725659364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071d3370 msgr2=0x556f071d7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f40bf22d740 1 --2- 172.21.15.45:0/2725659364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071d3370 0x556f071d7ed0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f40b0009a80 tx=0x7f40ac009e30 comp rx=0 tx=0).stop 2024-09-15T22:18:31.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f40bf22d740 1 -- 172.21.15.45:0/2725659364 shutdown_connections 2024-09-15T22:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f40bf22d740 1 --2- 172.21.15.45:0/2725659364 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556f0724e740 0x556f07250b60 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f40bf22d740 1 --2- 172.21.15.45:0/2725659364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f071d3370 0x556f071d7ed0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f40bf22d740 1 --2- 172.21.15.45:0/2725659364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556f071c9b40 0x556f071d7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f40bf22d740 1 --2- 172.21.15.45:0/2725659364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556f071c85d0 0x556f071d7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f40bf22d740 1 -- 172.21.15.45:0/2725659364 >> 172.21.15.45:0/2725659364 conn(0x556f07191310 msgr2=0x556f071d20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f409dffb640 0 client.15879 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f40bf22d740 1 -- 172.21.15.45:0/2725659364 shutdown_connections 2024-09-15T22:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.556+0000 7f40bf22d740 1 -- 172.21.15.45:0/2725659364 wait complete. 2024-09-15T22:18:31.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.557+0000 7f40bf22d740 20 client.15879 trim_cache size 0 max 16384 2024-09-15T22:18:31.575 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:18:31.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.557+0000 7f40bce54640 1 -- 172.21.15.45:0/2215956960 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f40a00a33b0 msgr2=0x7f40a00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:31.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.557+0000 7f40bce54640 1 --2- 172.21.15.45:0/2215956960 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f40a00a33b0 0x7f40a00a5870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x556f071c5ac0 tx=0x7f40a80f3f00 comp rx=0 tx=0).stop 2024-09-15T22:18:31.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.557+0000 7f40bce54640 1 -- 172.21.15.45:0/2215956960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40b8102da0 msgr2=0x7f40b8100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:31.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.557+0000 7f40bce54640 1 --2- 172.21.15.45:0/2215956960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40b8102da0 0x7f40b8100a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f40a8006010 tx=0x7f40a80042f0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.557+0000 7f40bce54640 1 -- 172.21.15.45:0/2215956960 shutdown_connections 2024-09-15T22:18:31.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.557+0000 7f40bce54640 1 --2- 172.21.15.45:0/2215956960 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f40a00a33b0 0x7f40a00a5870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.557+0000 7f40bce54640 1 --2- 172.21.15.45:0/2215956960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40b810c180 0x7f40b8101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.557+0000 7f40bce54640 1 --2- 172.21.15.45:0/2215956960 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f40b81036c0 0x7f40b8100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.557+0000 7f40bce54640 1 --2- 172.21.15.45:0/2215956960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40b8102da0 0x7f40b8100a00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:31.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.557+0000 7f40bce54640 1 -- 172.21.15.45:0/2215956960 >> 172.21.15.45:0/2215956960 conn(0x7f40b80fc7a0 msgr2=0x7f40b80fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:31.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.557+0000 7f40bce54640 1 -- 172.21.15.45:0/2215956960 shutdown_connections 2024-09-15T22:18:31.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:31.557+0000 7f40bce54640 1 -- 172.21.15.45:0/2215956960 wait complete. 2024-09-15T22:18:33.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:33 smithi045 ceph-mon[31180]: pgmap v72: 129 pgs: 129 active+clean; 221 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 393 op/s 2024-09-15T22:18:33.430 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:18:33.430 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:18:33.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:33 smithi165 ceph-mon[35551]: pgmap v72: 129 pgs: 129 active+clean; 221 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 393 op/s 2024-09-15T22:18:33.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:33 smithi100 ceph-mon[35319]: pgmap v72: 129 pgs: 129 active+clean; 221 MiB data, 1020 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.8 MiB/s wr, 393 op/s 2024-09-15T22:18:33.691 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:18:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.186+0000 7faacb3db640 1 -- 172.21.15.45:0/1967017282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac4102ef0 msgr2=0x7faac410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.186+0000 7faacb3db640 1 --2- 172.21.15.45:0/1967017282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac4102ef0 0x7faac410da40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7faabc009ca0 tx=0x7faabc02a950 comp rx=0 tx=0).stop 2024-09-15T22:18:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.186+0000 7faacb3db640 1 -- 172.21.15.45:0/1967017282 shutdown_connections 2024-09-15T22:18:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.186+0000 7faacb3db640 1 --2- 172.21.15.45:0/1967017282 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac4102ef0 0x7faac410da40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.186+0000 7faacb3db640 1 --2- 172.21.15.45:0/1967017282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac4102570 0x7faac41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.186+0000 7faacb3db640 1 --2- 172.21.15.45:0/1967017282 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faac4100e20 0x7faac4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.186+0000 7faacb3db640 1 -- 172.21.15.45:0/1967017282 >> 172.21.15.45:0/1967017282 conn(0x7faac40fc7d0 msgr2=0x7faac40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.186+0000 7faacb3db640 1 -- 172.21.15.45:0/1967017282 shutdown_connections 2024-09-15T22:18:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.186+0000 7faacb3db640 1 -- 172.21.15.45:0/1967017282 wait complete. 2024-09-15T22:18:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faacb3db640 1 Processor -- start 2024-09-15T22:18:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faacb3db640 1 -- start start 2024-09-15T22:18:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faacb3db640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac4100e20 0x7faac40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faacb3db640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac4102570 0x7faac40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faacb3db640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faac4102ef0 0x7faac40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faacb3db640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7faac41110a0 con 0x7faac4100e20 2024-09-15T22:18:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faacb3db640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faac4110f20 con 0x7faac4102570 2024-09-15T22:18:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faacb3db640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faac4111220 con 0x7faac4102ef0 2024-09-15T22:18:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faac9177640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac4100e20 0x7faac40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faac9177640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac4100e20 0x7faac40fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37580/0 (socket says 172.21.15.45:37580) 2024-09-15T22:18:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faac9177640 1 -- 172.21.15.45:0/796613649 learned_addr learned my addr 172.21.15.45:0/796613649 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faac8976640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac4102570 0x7faac40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faac9978640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faac4102ef0 0x7faac40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faac9177640 1 -- 172.21.15.45:0/796613649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faac4102ef0 msgr2=0x7faac40fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faac9177640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faac4102ef0 0x7faac40fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faac9177640 1 -- 172.21.15.45:0/796613649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac4102570 msgr2=0x7faac40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faac9177640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac4102570 0x7faac40fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faac9177640 1 -- 172.21.15.45:0/796613649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac41a69f0 con 0x7faac4100e20 2024-09-15T22:18:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.187+0000 7faac8976640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac4102570 0x7faac40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.188+0000 7faac9177640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac4100e20 0x7faac40fcc80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7faac000e9f0 tx=0x7faac000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.188+0000 7faaba7fc640 1 -- 172.21.15.45:0/796613649 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac000cd80 con 0x7faac4100e20 2024-09-15T22:18:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.188+0000 7faaba7fc640 1 -- 172.21.15.45:0/796613649 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faac0005520 con 0x7faac4100e20 2024-09-15T22:18:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.188+0000 7faacb3db640 1 -- 172.21.15.45:0/796613649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac41a6ce0 con 0x7faac4100e20 2024-09-15T22:18:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.188+0000 7faaba7fc640 1 -- 172.21.15.45:0/796613649 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac0010690 con 0x7faac4100e20 2024-09-15T22:18:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.188+0000 7faacb3db640 1 -- 172.21.15.45:0/796613649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac41a71c0 con 0x7faac4100e20 2024-09-15T22:18:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.190+0000 7faaba7fc640 1 -- 172.21.15.45:0/796613649 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7faac00046c0 con 0x7faac4100e20 2024-09-15T22:18:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faacd7b4740 1 Processor -- start 2024-09-15T22:18:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faacd7b4740 1 -- start start 2024-09-15T22:18:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faacd7b4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8bb60 0x564f8fa8bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faaba7fc640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7faab00a3430 0x7faab00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faacd7b4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa8c480 0x564f8fa96800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faacd7b4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa96d40 0x564f8fa99130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faacd7b4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f8f9f1280 con 0x564f8fa8c480 2024-09-15T22:18:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faacd7b4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564f8f998b10 con 0x564f8fa96d40 2024-09-15T22:18:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faacd7b4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564f8f9ed240 con 0x564f8fa8bb60 2024-09-15T22:18:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faac8976640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa8c480 0x564f8fa96800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faac9177640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7faab00a3430 0x7faab00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faac8976640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa8c480 0x564f8fa96800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37588/0 (socket says 172.21.15.45:37588) 2024-09-15T22:18:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faac8976640 1 -- 172.21.15.45:0/967420992 learned_addr learned my addr 172.21.15.45:0/967420992 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faac9978640 1 --2- 172.21.15.45:0/967420992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8bb60 0x564f8fa8bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faac9978640 1 --2- 172.21.15.45:0/967420992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa96d40 0x564f8fa99130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faaba7fc640 1 -- 172.21.15.45:0/796613649 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7faac00d0460 con 0x7faac4100e20 2024-09-15T22:18:34.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faac9978640 1 -- 172.21.15.45:0/967420992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa96d40 msgr2=0x564f8fa99130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.191+0000 7faac9978640 1 --2- 172.21.15.45:0/967420992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa96d40 0x564f8fa99130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.192+0000 7faac9978640 1 -- 172.21.15.45:0/967420992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa8c480 msgr2=0x564f8fa96800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.192+0000 7faac9978640 1 --2- 172.21.15.45:0/967420992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa8c480 0x564f8fa96800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.192+0000 7faac9978640 1 -- 172.21.15.45:0/967420992 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f8f9a51f0 con 0x564f8fa8bb60 2024-09-15T22:18:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.192+0000 7faac9177640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7faab00a3430 0x7faab00a58f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faac00987e0 tx=0x7faac006c060 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.192+0000 7faac9978640 1 --2- 172.21.15.45:0/967420992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8bb60 0x564f8fa8bf40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faabc005e30 tx=0x7faabc009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=171f46513006616e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.192+0000 7faaaf7fe640 1 -- 172.21.15.45:0/967420992 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc034040 con 0x564f8fa8bb60 2024-09-15T22:18:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.192+0000 7faaaf7fe640 1 -- 172.21.15.45:0/967420992 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faabc02fca0 con 0x564f8fa8bb60 2024-09-15T22:18:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.192+0000 7faaaf7fe640 1 -- 172.21.15.45:0/967420992 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc004290 con 0x564f8fa8bb60 2024-09-15T22:18:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.193+0000 7faacd7b4740 1 -- 172.21.15.45:0/967420992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8bb60 msgr2=0x564f8fa8bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.193+0000 7faacd7b4740 1 --2- 172.21.15.45:0/967420992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8bb60 0x564f8fa8bf40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faabc005e30 tx=0x7faabc009360 comp rx=0 tx=0).stop 2024-09-15T22:18:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.193+0000 7faacd7b4740 1 -- 172.21.15.45:0/967420992 shutdown_connections 2024-09-15T22:18:34.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.193+0000 7faacd7b4740 1 --2- 172.21.15.45:0/967420992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa96d40 0x564f8fa99130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.193+0000 7faacd7b4740 1 --2- 172.21.15.45:0/967420992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa8c480 0x564f8fa96800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.193+0000 7faacd7b4740 1 --2- 172.21.15.45:0/967420992 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8bb60 0x564f8fa8bf40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.193+0000 7faacd7b4740 1 -- 172.21.15.45:0/967420992 >> 172.21.15.45:0/967420992 conn(0x564f8fa880f0 msgr2=0x564f8fa884d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.193+0000 7faacd7b4740 1 -- 172.21.15.45:0/967420992 shutdown_connections 2024-09-15T22:18:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.193+0000 7faacd7b4740 1 -- 172.21.15.45:0/967420992 wait complete. 2024-09-15T22:18:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.193+0000 7faacd7b4740 1 -- start start 2024-09-15T22:18:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.193+0000 7faacd7b4740 1 Processor -- start 2024-09-15T22:18:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faacd7b4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8bb60 0x564f8fa93c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faacd7b4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8c480 0x564f8fa94140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faacd7b4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8fa94680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faacd7b4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f8fa99910 con 0x564f8fa96d40 2024-09-15T22:18:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faacd7b4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564f8f9abf10 con 0x564f8fa8c480 2024-09-15T22:18:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faacd7b4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x564f8fa99a90 con 0x564f8fa8bb60 2024-09-15T22:18:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faacd7b4740 10 client.0 _ll_register_callbacks cb 0x564f8f974a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faac9978640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8bb60 0x564f8fa93c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faac9978640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8fa94680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faac8976640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8c480 0x564f8fa94140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faac9978640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8fa94680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37602/0 (socket says 172.21.15.45:37602) 2024-09-15T22:18:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faac9978640 1 -- 172.21.15.45:0/52224297 learned_addr learned my addr 172.21.15.45:0/52224297 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faac9978640 1 -- 172.21.15.45:0/52224297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8bb60 msgr2=0x564f8fa93c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faac9978640 1 --2- 172.21.15.45:0/52224297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8bb60 0x564f8fa93c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faac9978640 1 -- 172.21.15.45:0/52224297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8c480 msgr2=0x564f8fa94140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faac9978640 1 --2- 172.21.15.45:0/52224297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8c480 0x564f8fa94140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faac9978640 1 -- 172.21.15.45:0/52224297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f8f7626a0 con 0x564f8fa96d40 2024-09-15T22:18:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faac8976640 1 --2- 172.21.15.45:0/52224297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8c480 0x564f8fa94140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faac9978640 1 --2- 172.21.15.45:0/52224297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8fa94680 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7faabc02ae70 tx=0x7faabc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a3669b48beab54 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faaacff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:18:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.194+0000 7faaacff9640 1 -- 172.21.15.45:0/52224297 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc04e070 con 0x564f8fa96d40 2024-09-15T22:18:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faaacff9640 1 -- 172.21.15.45:0/52224297 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7faabc003f50 con 0x564f8fa96d40 2024-09-15T22:18:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faacd7b4740 1 -- 172.21.15.45:0/52224297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faabc02fca0 con 0x564f8fa96d40 2024-09-15T22:18:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faaacff9640 1 -- 172.21.15.45:0/52224297 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faabc034070 con 0x564f8fa96d40 2024-09-15T22:18:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faacd7b4740 10 client.15891 fetch_fsmap learned FSMap version 21 2024-09-15T22:18:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faacd7b4740 1 -- 172.21.15.45:0/52224297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564f8fa99910 con 0x564f8fa96d40 2024-09-15T22:18:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faaacff9640 1 -- 172.21.15.45:0/52224297 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faabc02fca0 con 0x564f8fa96d40 2024-09-15T22:18:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faaacff9640 1 -- 172.21.15.45:0/52224297 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faabc030880 con 0x564f8fa96d40 2024-09-15T22:18:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faacd7b4740 10 client.15891 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:18:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faacd7b4740 10 client.15891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faacd7b4740 20 client.15891 populate_metadata read hostname 'smithi045' 2024-09-15T22:18:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faacd7b4740 1 --2- 172.21.15.45:0/52224297 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x564f8faa6670 0x564f8faa8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faacd7b4740 4 client.15891 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:18:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faacd7b4740 1 -- 172.21.15.45:0/52224297 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f8f9fe7f0 con 0x564f8faa6670 2024-09-15T22:18:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.195+0000 7faac8976640 1 --2- 172.21.15.45:0/52224297 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x564f8faa6670 0x564f8faa8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.196+0000 7faac8976640 1 --2- 172.21.15.45:0/52224297 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x564f8faa6670 0x564f8faa8a60 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bc4fa35f2faa5ce server_cookie=ad63d1d8333eef7b in_seq=0 out_seq=0 2024-09-15T22:18:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.196+0000 7faaacff9640 10 client.15891 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faaacff9640 1 -- 172.21.15.45:0/52224297 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f8f9fe7f0 con 0x564f8faa6670 2024-09-15T22:18:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faaacff9640 10 client.15891 handle_command_reply: tid=0 2024-09-15T22:18:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faacd7b4740 1 client.15891 shutdown 2024-09-15T22:18:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faacd7b4740 1 -- 172.21.15.45:0/52224297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 msgr2=0x564f8fa94680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faacd7b4740 1 --2- 172.21.15.45:0/52224297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8fa94680 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7faabc02ae70 tx=0x7faabc005fd0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faacd7b4740 1 -- 172.21.15.45:0/52224297 shutdown_connections 2024-09-15T22:18:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faacd7b4740 1 --2- 172.21.15.45:0/52224297 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x564f8faa6670 0x564f8faa8a60 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faacd7b4740 1 --2- 172.21.15.45:0/52224297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8fa94680 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faacd7b4740 1 --2- 172.21.15.45:0/52224297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8c480 0x564f8fa94140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faacd7b4740 1 --2- 172.21.15.45:0/52224297 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8bb60 0x564f8fa93c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faaacff9640 0 client.15891 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faacd7b4740 1 -- 172.21.15.45:0/52224297 >> 172.21.15.45:0/52224297 conn(0x564f8fa880f0 msgr2=0x564f8fa8de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faacd7b4740 1 -- 172.21.15.45:0/52224297 shutdown_connections 2024-09-15T22:18:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faacd7b4740 1 -- 172.21.15.45:0/52224297 wait complete. 2024-09-15T22:18:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.197+0000 7faacd7b4740 20 client.15891 trim_cache size 0 max 16384 2024-09-15T22:18:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faacd7b4740 1 Processor -- start 2024-09-15T22:18:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faacd7b4740 1 -- start start 2024-09-15T22:18:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faacd7b4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8bb60 0x564f8fa8e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faacd7b4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8c480 0x564f8fa92ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faacd7b4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8faae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faacd7b4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7faac41af310 con 0x564f8fa96d40 2024-09-15T22:18:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faacd7b4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faac41b1b90 con 0x564f8fa8bb60 2024-09-15T22:18:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faacd7b4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faac41af980 con 0x564f8fa8c480 2024-09-15T22:18:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faac9978640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8faae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faac9978640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8faae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59822/0 (socket says 172.21.15.45:59822) 2024-09-15T22:18:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faac9978640 1 -- 172.21.15.45:0/2062972031 learned_addr learned my addr 172.21.15.45:0/2062972031 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faac9978640 1 --2- 172.21.15.45:0/2062972031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8bb60 0x564f8fa8e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faac8976640 1 --2- 172.21.15.45:0/2062972031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8c480 0x564f8fa92ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faac9978640 1 -- 172.21.15.45:0/2062972031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8c480 msgr2=0x564f8fa92ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faac9978640 1 --2- 172.21.15.45:0/2062972031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8c480 0x564f8fa92ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faac9978640 1 -- 172.21.15.45:0/2062972031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8bb60 msgr2=0x564f8fa8e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:34.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faac9978640 1 --2- 172.21.15.45:0/2062972031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8bb60 0x564f8fa8e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faac9978640 1 -- 172.21.15.45:0/2062972031 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f8fa87f20 con 0x564f8fa96d40 2024-09-15T22:18:34.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faac9978640 1 --2- 172.21.15.45:0/2062972031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8faae150 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7faabc003a10 tx=0x7faabc000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d40ec1b4db481c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:34.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faaaeffd640 1 -- 172.21.15.45:0/2062972031 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc067070 con 0x564f8fa96d40 2024-09-15T22:18:34.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faaaeffd640 1 -- 172.21.15.45:0/2062972031 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faabc02f6b0 con 0x564f8fa96d40 2024-09-15T22:18:34.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.216+0000 7faaaeffd640 1 -- 172.21.15.45:0/2062972031 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc04e070 con 0x564f8fa96d40 2024-09-15T22:18:34.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.217+0000 7faacd7b4740 1 -- 172.21.15.45:0/2062972031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 msgr2=0x564f8faae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:34.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.217+0000 7faacd7b4740 1 --2- 172.21.15.45:0/2062972031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8faae150 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7faabc003a10 tx=0x7faabc000f40 comp rx=0 tx=0).stop 2024-09-15T22:18:34.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.217+0000 7faacd7b4740 1 -- 172.21.15.45:0/2062972031 shutdown_connections 2024-09-15T22:18:34.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.217+0000 7faacd7b4740 1 --2- 172.21.15.45:0/2062972031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8faae150 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.217+0000 7faacd7b4740 1 --2- 172.21.15.45:0/2062972031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8c480 0x564f8fa92ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.217+0000 7faacd7b4740 1 --2- 172.21.15.45:0/2062972031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8bb60 0x564f8fa8e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.217+0000 7faacd7b4740 1 -- 172.21.15.45:0/2062972031 >> 172.21.15.45:0/2062972031 conn(0x564f8fa880f0 msgr2=0x564f8fa923a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.217+0000 7faacd7b4740 1 -- 172.21.15.45:0/2062972031 shutdown_connections 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.217+0000 7faacd7b4740 1 -- 172.21.15.45:0/2062972031 wait complete. 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.217+0000 7faacd7b4740 1 -- start start 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.217+0000 7faacd7b4740 1 Processor -- start 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faacd7b4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8bb60 0x564f8fa9f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faacd7b4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8c480 0x564f8fa90880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faacd7b4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8fa90dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faacd7b4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7faac41b0050 con 0x564f8fa96d40 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faacd7b4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faac41b14c0 con 0x564f8fa8bb60 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faacd7b4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faac41b0720 con 0x564f8fa8c480 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faacd7b4740 10 client.0 _ll_register_callbacks cb 0x7faab4009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faac9978640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8fa90dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faac9978640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8fa90dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59830/0 (socket says 172.21.15.45:59830) 2024-09-15T22:18:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faac9978640 1 -- 172.21.15.45:0/3192813295 learned_addr learned my addr 172.21.15.45:0/3192813295 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faac9978640 1 --2- 172.21.15.45:0/3192813295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8bb60 0x564f8fa9f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faac8976640 1 --2- 172.21.15.45:0/3192813295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8c480 0x564f8fa90880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faac9978640 1 -- 172.21.15.45:0/3192813295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8c480 msgr2=0x564f8fa90880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faac9978640 1 --2- 172.21.15.45:0/3192813295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8c480 0x564f8fa90880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faac9978640 1 -- 172.21.15.45:0/3192813295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8bb60 msgr2=0x564f8fa9f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faac9978640 1 --2- 172.21.15.45:0/3192813295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8bb60 0x564f8fa9f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faac9978640 1 -- 172.21.15.45:0/3192813295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f8fa915a0 con 0x564f8fa96d40 2024-09-15T22:18:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faac9978640 1 --2- 172.21.15.45:0/3192813295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8fa90dc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7faabc009620 tx=0x7faabc02fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bc13cd5e834987 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.218+0000 7faaacff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:18:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faaacff9640 1 -- 172.21.15.45:0/3192813295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faabc071060 con 0x564f8fa96d40 2024-09-15T22:18:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faaacff9640 1 -- 172.21.15.45:0/3192813295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7faabc053040 con 0x564f8fa96d40 2024-09-15T22:18:34.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faacd7b4740 1 -- 172.21.15.45:0/3192813295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faabc02f6b0 con 0x564f8fa96d40 2024-09-15T22:18:34.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faaacff9640 1 -- 172.21.15.45:0/3192813295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faabc04e070 con 0x564f8fa96d40 2024-09-15T22:18:34.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faacd7b4740 10 client.15897 fetch_fsmap learned FSMap version 21 2024-09-15T22:18:34.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faacd7b4740 1 -- 172.21.15.45:0/3192813295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564f8fb110b0 con 0x564f8fa96d40 2024-09-15T22:18:34.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faaacff9640 1 -- 172.21.15.45:0/3192813295 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faabc02f6b0 con 0x564f8fa96d40 2024-09-15T22:18:34.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faaacff9640 1 -- 172.21.15.45:0/3192813295 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faabc003ee0 con 0x564f8fa96d40 2024-09-15T22:18:34.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faacd7b4740 10 client.15897 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:18:34.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faacd7b4740 10 client.15897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:34.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faacd7b4740 20 client.15897 populate_metadata read hostname 'smithi045' 2024-09-15T22:18:34.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faacd7b4740 1 --2- 172.21.15.45:0/3192813295 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x564f8fb11590 0x564f8fb13980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:34.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faacd7b4740 4 client.15897 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:18:34.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faacd7b4740 1 -- 172.21.15.45:0/3192813295 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564f8f9f8d00 con 0x564f8fb11590 2024-09-15T22:18:34.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.219+0000 7faac8976640 1 --2- 172.21.15.45:0/3192813295 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x564f8fb11590 0x564f8fb13980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:34.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.220+0000 7faaacff9640 10 client.15897 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:34.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.220+0000 7faac8976640 1 --2- 172.21.15.45:0/3192813295 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x564f8fb11590 0x564f8fb13980 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0bd05fe30b7677d server_cookie=91e45fb78900f2bc in_seq=0 out_seq=0 2024-09-15T22:18:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faaacff9640 1 -- 172.21.15.45:0/3192813295 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564f8f9f8d00 con 0x564f8fb11590 2024-09-15T22:18:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faaacff9640 10 client.15897 handle_command_reply: tid=0 2024-09-15T22:18:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacd7b4740 1 client.15897 shutdown 2024-09-15T22:18:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacd7b4740 1 -- 172.21.15.45:0/3192813295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 msgr2=0x564f8fa90dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacd7b4740 1 --2- 172.21.15.45:0/3192813295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8fa90dc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7faabc009620 tx=0x7faabc02fee0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacd7b4740 1 -- 172.21.15.45:0/3192813295 shutdown_connections 2024-09-15T22:18:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacd7b4740 1 --2- 172.21.15.45:0/3192813295 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x564f8fb11590 0x564f8fb13980 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faaacff9640 0 client.15897 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacd7b4740 1 --2- 172.21.15.45:0/3192813295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f8fa96d40 0x564f8fa90dc0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacd7b4740 1 --2- 172.21.15.45:0/3192813295 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x564f8fa8c480 0x564f8fa90880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacd7b4740 1 --2- 172.21.15.45:0/3192813295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564f8fa8bb60 0x564f8fa9f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacd7b4740 1 -- 172.21.15.45:0/3192813295 >> 172.21.15.45:0/3192813295 conn(0x564f8fa880f0 msgr2=0x564f8fa943e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacd7b4740 1 -- 172.21.15.45:0/3192813295 shutdown_connections 2024-09-15T22:18:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacd7b4740 1 -- 172.21.15.45:0/3192813295 wait complete. 2024-09-15T22:18:34.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacd7b4740 20 client.15897 trim_cache size 0 max 16384 2024-09-15T22:18:34.235 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:18:34.235 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:18:34.236 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "e3a7060b-3dcf-48b2-85b8-ba31dcd6ca48", 2024-09-15T22:18:34.236 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:18:34.236 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:18:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacb3db640 1 -- 172.21.15.45:0/796613649 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7faab00a3430 msgr2=0x7faab00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacb3db640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7faab00a3430 0x7faab00a58f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faac00987e0 tx=0x7faac006c060 comp rx=0 tx=0).stop 2024-09-15T22:18:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacb3db640 1 -- 172.21.15.45:0/796613649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac4100e20 msgr2=0x7faac40fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacb3db640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac4100e20 0x7faac40fcc80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7faac000e9f0 tx=0x7faac000edf0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacb3db640 1 -- 172.21.15.45:0/796613649 shutdown_connections 2024-09-15T22:18:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacb3db640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7faab00a3430 0x7faab00a58f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacb3db640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faac4102ef0 0x7faac40fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacb3db640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faac4102570 0x7faac40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacb3db640 1 --2- 172.21.15.45:0/796613649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac4100e20 0x7faac40fcc80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacb3db640 1 -- 172.21.15.45:0/796613649 >> 172.21.15.45:0/796613649 conn(0x7faac40fc7d0 msgr2=0x7faac406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:34.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacb3db640 1 -- 172.21.15.45:0/796613649 shutdown_connections 2024-09-15T22:18:34.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:34.232+0000 7faacb3db640 1 -- 172.21.15.45:0/796613649 wait complete. 2024-09-15T22:18:35.123 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:35 smithi045 ceph-mon[31180]: pgmap v73: 129 pgs: 129 active+clean; 227 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.8 MiB/s wr, 514 op/s 2024-09-15T22:18:35.123 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:35 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:18:35.123 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:35 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:18:35.123 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:35 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:18:35.150 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:18:35.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:35 smithi165 ceph-mon[35551]: pgmap v73: 129 pgs: 129 active+clean; 227 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.8 MiB/s wr, 514 op/s 2024-09-15T22:18:35.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:35 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:18:35.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:35 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:18:35.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:35 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:18:35.487 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:18:35.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:35 smithi100 ceph-mon[35319]: pgmap v73: 129 pgs: 129 active+clean; 227 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 4.8 MiB/s wr, 514 op/s 2024-09-15T22:18:35.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:35 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:18:35.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:35 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:18:35.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:35 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:18:35.989 INFO:tasks.workunit.client.0.smithi045.stderr:+ tar xf doc.tar 2024-09-15T22:18:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.096+0000 7f8580e57640 1 -- 172.21.15.45:0/121022288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c100e20 msgr2=0x7f857c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.096+0000 7f8580e57640 1 --2- 172.21.15.45:0/121022288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c100e20 0x7f857c101200 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f856c009900 tx=0x7f856c02a480 comp rx=0 tx=0).stop 2024-09-15T22:18:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.096+0000 7f8580e57640 1 -- 172.21.15.45:0/121022288 shutdown_connections 2024-09-15T22:18:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.096+0000 7f8580e57640 1 --2- 172.21.15.45:0/121022288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f857c102ef0 0x7f857c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.096+0000 7f8580e57640 1 --2- 172.21.15.45:0/121022288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f857c102570 0x7f857c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.096+0000 7f8580e57640 1 --2- 172.21.15.45:0/121022288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c100e20 0x7f857c101200 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.096+0000 7f8580e57640 1 -- 172.21.15.45:0/121022288 >> 172.21.15.45:0/121022288 conn(0x7f857c0fc7d0 msgr2=0x7f857c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.096+0000 7f8580e57640 1 -- 172.21.15.45:0/121022288 shutdown_connections 2024-09-15T22:18:36.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.096+0000 7f8580e57640 1 -- 172.21.15.45:0/121022288 wait complete. 2024-09-15T22:18:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.097+0000 7f8580e57640 1 Processor -- start 2024-09-15T22:18:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.097+0000 7f8580e57640 1 -- start start 2024-09-15T22:18:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.097+0000 7f8580e57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c100e20 0x7f857c1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.097+0000 7f8580e57640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f857c102570 0x7f857c199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.097+0000 7f8580e57640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f857c102ef0 0x7f857c1a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.097+0000 7f8580e57640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f857c111070 con 0x7f857c100e20 2024-09-15T22:18:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.097+0000 7f8580e57640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f857c110ef0 con 0x7f857c102570 2024-09-15T22:18:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.097+0000 7f8580e57640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f857c1111f0 con 0x7f857c102ef0 2024-09-15T22:18:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.097+0000 7f857a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c100e20 0x7f857c1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.097+0000 7f857a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c100e20 0x7f857c1993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59856/0 (socket says 172.21.15.45:59856) 2024-09-15T22:18:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.097+0000 7f857a59c640 1 -- 172.21.15.45:0/2874504779 learned_addr learned my addr 172.21.15.45:0/2874504779 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:36.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.097+0000 7f8579d9b640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f857c102570 0x7f857c199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.098+0000 7f857ad9d640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f857c102ef0 0x7f857c1a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.098+0000 7f857a59c640 1 -- 172.21.15.45:0/2874504779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f857c102ef0 msgr2=0x7f857c1a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.098+0000 7f857a59c640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f857c102ef0 0x7f857c1a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.098+0000 7f857a59c640 1 -- 172.21.15.45:0/2874504779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f857c102570 msgr2=0x7f857c199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.098+0000 7f857a59c640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f857c102570 0x7f857c199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.098+0000 7f857a59c640 1 -- 172.21.15.45:0/2874504779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857c1a4980 con 0x7f857c100e20 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.098+0000 7f857a59c640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c100e20 0x7f857c1993c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f856c006010 tx=0x7f856c004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.098+0000 7f856b7fe640 1 -- 172.21.15.45:0/2874504779 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c03f030 con 0x7f857c100e20 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.098+0000 7f856b7fe640 1 -- 172.21.15.45:0/2874504779 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f856c005500 con 0x7f857c100e20 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.098+0000 7f856b7fe640 1 -- 172.21.15.45:0/2874504779 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c035070 con 0x7f857c100e20 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.098+0000 7f8580e57640 1 -- 172.21.15.45:0/2874504779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f857c1a4b50 con 0x7f857c100e20 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.098+0000 7f8580e57640 1 -- 172.21.15.45:0/2874504779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f857c1a4fa0 con 0x7f857c100e20 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.100+0000 7f856b7fe640 1 -- 172.21.15.45:0/2874504779 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f856c042030 con 0x7f857c100e20 2024-09-15T22:18:36.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.101+0000 7f8583230740 1 Processor -- start 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.101+0000 7f8583230740 1 -- start start 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.101+0000 7f8583230740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 0x558979359880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.101+0000 7f8583230740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979359dc0 0x558979364140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.101+0000 7f8583230740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979364680 0x558979366a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.101+0000 7f8583230740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5589792bf2e0 con 0x558979364680 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.101+0000 7f8583230740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558979266ce0 con 0x558979359dc0 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.101+0000 7f8583230740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5589792bb2a0 con 0x5589793594a0 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.101+0000 7f857a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979359dc0 0x558979364140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.101+0000 7f857a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979359dc0 0x558979364140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:33942/0 (socket says 172.21.15.45:33942) 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.101+0000 7f857a59c640 1 -- 172.21.15.45:0/112598342 learned_addr learned my addr 172.21.15.45:0/112598342 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.101+0000 7f8579d9b640 1 --2- 172.21.15.45:0/112598342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979364680 0x558979366a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.102+0000 7f857ad9d640 1 --2- 172.21.15.45:0/112598342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 0x558979359880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.102+0000 7f856b7fe640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f85640a33b0 0x7f85640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.102+0000 7f856b7fe640 1 -- 172.21.15.45:0/2874504779 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f856c0f0540 con 0x7f857c100e20 2024-09-15T22:18:36.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.102+0000 7f857ad9d640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f85640a33b0 0x7f85640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.102+0000 7f8579d9b640 1 -- 172.21.15.45:0/112598342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 msgr2=0x558979359880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:36.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.102+0000 7f8579d9b640 1 --2- 172.21.15.45:0/112598342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 0x558979359880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.102+0000 7f8579d9b640 1 -- 172.21.15.45:0/112598342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979359dc0 msgr2=0x558979364140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:36.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.102+0000 7f8579d9b640 1 --2- 172.21.15.45:0/112598342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979359dc0 0x558979364140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.102+0000 7f8579d9b640 1 -- 172.21.15.45:0/112598342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55897924b440 con 0x558979364680 2024-09-15T22:18:36.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.102+0000 7f857a59c640 1 --2- 172.21.15.45:0/112598342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979359dc0 0x558979364140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:18:36.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.102+0000 7f8579d9b640 1 --2- 172.21.15.45:0/112598342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979364680 0x558979366a70 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8570009bf0 tx=0x7f8570011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7202861a41574d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:36.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.102+0000 7f857ad9d640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f85640a33b0 0x7f85640a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8574012a70 tx=0x7f8574004ab0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:36.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.103+0000 7f8568ff9640 1 -- 172.21.15.45:0/112598342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857001e070 con 0x558979364680 2024-09-15T22:18:36.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.103+0000 7f8568ff9640 1 -- 172.21.15.45:0/112598342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8570009da0 con 0x558979364680 2024-09-15T22:18:36.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.103+0000 7f8568ff9640 1 -- 172.21.15.45:0/112598342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8570018910 con 0x558979364680 2024-09-15T22:18:36.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.103+0000 7f8583230740 1 -- 172.21.15.45:0/112598342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979364680 msgr2=0x558979366a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:36.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.103+0000 7f8583230740 1 --2- 172.21.15.45:0/112598342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979364680 0x558979366a70 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8570009bf0 tx=0x7f8570011810 comp rx=0 tx=0).stop 2024-09-15T22:18:36.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.103+0000 7f8583230740 1 -- 172.21.15.45:0/112598342 shutdown_connections 2024-09-15T22:18:36.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.103+0000 7f8583230740 1 --2- 172.21.15.45:0/112598342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979364680 0x558979366a70 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.103+0000 7f8583230740 1 --2- 172.21.15.45:0/112598342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979359dc0 0x558979364140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.103+0000 7f8583230740 1 --2- 172.21.15.45:0/112598342 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 0x558979359880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.103+0000 7f8583230740 1 -- 172.21.15.45:0/112598342 >> 172.21.15.45:0/112598342 conn(0x558979355a30 msgr2=0x558979355e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.104+0000 7f8583230740 1 -- 172.21.15.45:0/112598342 shutdown_connections 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.104+0000 7f8583230740 1 -- 172.21.15.45:0/112598342 wait complete. 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.104+0000 7f8583230740 1 -- start start 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.104+0000 7f8583230740 1 Processor -- start 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.104+0000 7f8583230740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 0x558979363fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.104+0000 7f8583230740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979359dc0 0x558979361250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.104+0000 7f8583230740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979364680 0x558979361790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.104+0000 7f8583230740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558979367250 con 0x558979359dc0 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.104+0000 7f8583230740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55897927a050 con 0x558979364680 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.104+0000 7f8583230740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5589793673d0 con 0x5589793594a0 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.104+0000 7f8583230740 10 client.0 _ll_register_callbacks cb 0x5589792ba160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f8579d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979359dc0 0x558979361250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f8579d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979359dc0 0x558979361250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59876/0 (socket says 172.21.15.45:59876) 2024-09-15T22:18:36.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f857ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979364680 0x558979361790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f8579d9b640 1 -- 172.21.15.45:0/4191683243 learned_addr learned my addr 172.21.15.45:0/4191683243 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:36.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f857a59c640 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 0x558979363fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f8579d9b640 1 -- 172.21.15.45:0/4191683243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 msgr2=0x558979363fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:36.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f8579d9b640 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 0x558979363fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f8579d9b640 1 -- 172.21.15.45:0/4191683243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979364680 msgr2=0x558979361790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:36.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f8579d9b640 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979364680 0x558979361790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f8579d9b640 1 -- 172.21.15.45:0/4191683243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589790303c0 con 0x558979359dc0 2024-09-15T22:18:36.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f857a59c640 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 0x558979363fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:18:36.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f857ad9d640 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979364680 0x558979361790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:36.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f8579d9b640 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979359dc0 0x558979361250 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f85700185f0 tx=0x7f8570005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de84d54c4baa2f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:36.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f8561ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:18:36.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f8561ffb640 1 -- 172.21.15.45:0/4191683243 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857001e040 con 0x558979359dc0 2024-09-15T22:18:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f8583230740 1 -- 172.21.15.45:0/4191683243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8570009da0 con 0x558979359dc0 2024-09-15T22:18:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.105+0000 7f8561ffb640 1 -- 172.21.15.45:0/4191683243 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f8570018690 con 0x558979359dc0 2024-09-15T22:18:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.106+0000 7f8561ffb640 1 -- 172.21.15.45:0/4191683243 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8570032050 con 0x558979359dc0 2024-09-15T22:18:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.106+0000 7f8583230740 10 client.15909 fetch_fsmap learned FSMap version 21 2024-09-15T22:18:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.106+0000 7f8583230740 1 -- 172.21.15.45:0/4191683243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558979372c00 con 0x558979359dc0 2024-09-15T22:18:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.106+0000 7f8561ffb640 1 -- 172.21.15.45:0/4191683243 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8570009da0 con 0x558979359dc0 2024-09-15T22:18:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.106+0000 7f8561ffb640 1 -- 172.21.15.45:0/4191683243 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8570003bf0 con 0x558979359dc0 2024-09-15T22:18:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.106+0000 7f8583230740 10 client.15909 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:18:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.106+0000 7f8583230740 10 client.15909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.106+0000 7f8583230740 20 client.15909 populate_metadata read hostname 'smithi045' 2024-09-15T22:18:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.106+0000 7f8583230740 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5589793740c0 0x5589793764b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.106+0000 7f8583230740 4 client.15909 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:18:36.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.106+0000 7f8583230740 1 -- 172.21.15.45:0/4191683243 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589792cc850 con 0x5589793740c0 2024-09-15T22:18:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.106+0000 7f857a59c640 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5589793740c0 0x5589793764b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.107+0000 7f857a59c640 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5589793740c0 0x5589793764b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48f56d9b2e09513d server_cookie=97d06ace88e8f275 in_seq=0 out_seq=0 2024-09-15T22:18:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.107+0000 7f8561ffb640 10 client.15909 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8561ffb640 1 -- 172.21.15.45:0/4191683243 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5589792cc850 con 0x5589793740c0 2024-09-15T22:18:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8561ffb640 10 client.15909 handle_command_reply: tid=0 2024-09-15T22:18:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8583230740 1 client.15909 shutdown 2024-09-15T22:18:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8583230740 1 -- 172.21.15.45:0/4191683243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979359dc0 msgr2=0x558979361250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8583230740 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979359dc0 0x558979361250 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f85700185f0 tx=0x7f8570005d30 comp rx=0 tx=0).stop 2024-09-15T22:18:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8583230740 1 -- 172.21.15.45:0/4191683243 shutdown_connections 2024-09-15T22:18:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8583230740 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5589793740c0 0x5589793764b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8583230740 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979364680 0x558979361790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8583230740 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979359dc0 0x558979361250 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8583230740 1 --2- 172.21.15.45:0/4191683243 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 0x558979363fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8583230740 1 -- 172.21.15.45:0/4191683243 >> 172.21.15.45:0/4191683243 conn(0x558979355a30 msgr2=0x55897935b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:36.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8561ffb640 0 client.15909 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:36.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8583230740 1 -- 172.21.15.45:0/4191683243 shutdown_connections 2024-09-15T22:18:36.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8583230740 1 -- 172.21.15.45:0/4191683243 wait complete. 2024-09-15T22:18:36.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.108+0000 7f8583230740 20 client.15909 trim_cache size 0 max 16384 2024-09-15T22:18:36.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.125+0000 7f8583230740 1 Processor -- start 2024-09-15T22:18:36.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.125+0000 7f8583230740 1 -- start start 2024-09-15T22:18:36.127 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:36 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:18:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f8583230740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 0x5589793704e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f8583230740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979359dc0 0x55897937bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f8583230740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979364680 0x55897937c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f8583230740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f857c1ad040 con 0x558979359dc0 2024-09-15T22:18:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f8583230740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f857c1af8c0 con 0x558979364680 2024-09-15T22:18:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f8583230740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f857c1ad6b0 con 0x5589793594a0 2024-09-15T22:18:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f8579d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979359dc0 0x55897937bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f857ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979364680 0x55897937c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f857ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979364680 0x55897937c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:33952/0 (socket says 172.21.15.45:33952) 2024-09-15T22:18:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f857ad9d640 1 -- 172.21.15.45:0/3196494722 learned_addr learned my addr 172.21.15.45:0/3196494722 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:36.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f857a59c640 1 --2- 172.21.15.45:0/3196494722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 0x5589793704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f857ad9d640 1 -- 172.21.15.45:0/3196494722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 msgr2=0x5589793704e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f857ad9d640 1 --2- 172.21.15.45:0/3196494722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 0x5589793704e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f857ad9d640 1 -- 172.21.15.45:0/3196494722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979359dc0 msgr2=0x55897937bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f857ad9d640 1 --2- 172.21.15.45:0/3196494722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979359dc0 0x55897937bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f857ad9d640 1 -- 172.21.15.45:0/3196494722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558979359bf0 con 0x558979364680 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.126+0000 7f857ad9d640 1 --2- 172.21.15.45:0/3196494722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979364680 0x55897937c180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f85740073d0 tx=0x7f8574007700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0321aea12454e28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.127+0000 7f8563fff640 1 -- 172.21.15.45:0/3196494722 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574008e60 con 0x558979364680 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.127+0000 7f8563fff640 1 -- 172.21.15.45:0/3196494722 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8574025070 con 0x558979364680 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.127+0000 7f8563fff640 1 -- 172.21.15.45:0/3196494722 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857402ac60 con 0x558979364680 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.127+0000 7f8583230740 1 -- 172.21.15.45:0/3196494722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979364680 msgr2=0x55897937c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.127+0000 7f8583230740 1 --2- 172.21.15.45:0/3196494722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979364680 0x55897937c180 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f85740073d0 tx=0x7f8574007700 comp rx=0 tx=0).stop 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.127+0000 7f8583230740 1 -- 172.21.15.45:0/3196494722 shutdown_connections 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.127+0000 7f8583230740 1 --2- 172.21.15.45:0/3196494722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558979364680 0x55897937c180 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.127+0000 7f8583230740 1 --2- 172.21.15.45:0/3196494722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979359dc0 0x55897937bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.127+0000 7f8583230740 1 --2- 172.21.15.45:0/3196494722 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5589793594a0 0x5589793704e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.127+0000 7f8583230740 1 -- 172.21.15.45:0/3196494722 >> 172.21.15.45:0/3196494722 conn(0x558979355a30 msgr2=0x55897935fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:36.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.127+0000 7f8583230740 1 -- 172.21.15.45:0/3196494722 shutdown_connections 2024-09-15T22:18:36.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.127+0000 7f8583230740 1 -- 172.21.15.45:0/3196494722 wait complete. 2024-09-15T22:18:36.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.128+0000 7f8583230740 1 -- start start 2024-09-15T22:18:36.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.128+0000 7f8583230740 1 Processor -- start 2024-09-15T22:18:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.128+0000 7f8583230740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589793594a0 0x5589793677d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.128+0000 7f8583230740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558979359dc0 0x558979367d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.128+0000 7f8583230740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979364680 0x5589793dcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.128+0000 7f8583230740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f857c1add80 con 0x558979364680 2024-09-15T22:18:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.128+0000 7f8583230740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f857c1af1f0 con 0x5589793594a0 2024-09-15T22:18:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.128+0000 7f8583230740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f857c1ae450 con 0x558979359dc0 2024-09-15T22:18:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.128+0000 7f8583230740 10 client.0 _ll_register_callbacks cb 0x7f857001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.128+0000 7f857a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589793594a0 0x5589793677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.128+0000 7f857a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589793594a0 0x5589793677d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:33968/0 (socket says 172.21.15.45:33968) 2024-09-15T22:18:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.128+0000 7f857a59c640 1 -- 172.21.15.45:0/1670530176 learned_addr learned my addr 172.21.15.45:0/1670530176 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:36.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f8579d9b640 1 --2- 172.21.15.45:0/1670530176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558979359dc0 0x558979367d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f857ad9d640 1 --2- 172.21.15.45:0/1670530176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979364680 0x5589793dcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f857a59c640 1 -- 172.21.15.45:0/1670530176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558979359dc0 msgr2=0x558979367d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f857a59c640 1 --2- 172.21.15.45:0/1670530176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558979359dc0 0x558979367d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f857a59c640 1 -- 172.21.15.45:0/1670530176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979364680 msgr2=0x5589793dcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f857a59c640 1 --2- 172.21.15.45:0/1670530176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979364680 0x5589793dcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f857a59c640 1 -- 172.21.15.45:0/1670530176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589793dd140 con 0x5589793594a0 2024-09-15T22:18:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f857a59c640 1 --2- 172.21.15.45:0/1670530176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589793594a0 0x5589793677d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f856c0bc390 tx=0x7f856c0b8040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22f2059a72d413a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f8561ffb640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-15T22:18:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f8561ffb640 1 -- 172.21.15.45:0/1670530176 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c049040 con 0x5589793594a0 2024-09-15T22:18:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f8561ffb640 1 -- 172.21.15.45:0/1670530176 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f856c0f3d80 con 0x5589793594a0 2024-09-15T22:18:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f8583230740 1 -- 172.21.15.45:0/1670530176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8574025070 con 0x5589793594a0 2024-09-15T22:18:36.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f8561ffb640 1 -- 172.21.15.45:0/1670530176 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f856c0056b0 con 0x5589793594a0 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f8583230740 10 client.25538 fetch_fsmap learned FSMap version 21 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.129+0000 7f8583230740 1 -- 172.21.15.45:0/1670530176 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5589793de3a0 con 0x5589793594a0 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.130+0000 7f8561ffb640 1 -- 172.21.15.45:0/1670530176 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8574025070 con 0x5589793594a0 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.130+0000 7f8561ffb640 1 -- 172.21.15.45:0/1670530176 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f856c0edaf0 con 0x5589793594a0 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.130+0000 7f8583230740 10 client.25538 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.130+0000 7f8583230740 10 client.25538 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.130+0000 7f8583230740 20 client.25538 populate_metadata read hostname 'smithi045' 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.130+0000 7f8583230740 1 --2- 172.21.15.45:0/1670530176 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5589793dea70 0x5589793e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.130+0000 7f8583230740 4 client.25538 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.130+0000 7f8583230740 1 -- 172.21.15.45:0/1670530176 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5589792c6d60 con 0x5589793dea70 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.130+0000 7f8579d9b640 1 --2- 172.21.15.45:0/1670530176 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5589793dea70 0x5589793e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.130+0000 7f8579d9b640 1 --2- 172.21.15.45:0/1670530176 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5589793dea70 0x5589793e0e60 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e9517dc624f7ebb server_cookie=8643cd16018ddfa0 in_seq=0 out_seq=0 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.130+0000 7f8561ffb640 10 client.25538 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:36.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.131+0000 7f8561ffb640 1 -- 172.21.15.45:0/1670530176 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5589792c6d60 con 0x5589793dea70 2024-09-15T22:18:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.131+0000 7f8561ffb640 10 client.25538 handle_command_reply: tid=0 2024-09-15T22:18:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.131+0000 7f8583230740 1 client.25538 shutdown 2024-09-15T22:18:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.131+0000 7f8583230740 1 -- 172.21.15.45:0/1670530176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589793594a0 msgr2=0x5589793677d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.131+0000 7f8583230740 1 --2- 172.21.15.45:0/1670530176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589793594a0 0x5589793677d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f856c0bc390 tx=0x7f856c0b8040 comp rx=0 tx=0).stop 2024-09-15T22:18:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.131+0000 7f8583230740 1 -- 172.21.15.45:0/1670530176 shutdown_connections 2024-09-15T22:18:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.131+0000 7f8583230740 1 --2- 172.21.15.45:0/1670530176 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5589793dea70 0x5589793e0e60 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.131+0000 7f8583230740 1 --2- 172.21.15.45:0/1670530176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558979364680 0x5589793dcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.131+0000 7f8583230740 1 --2- 172.21.15.45:0/1670530176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558979359dc0 0x558979367d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.131+0000 7f8583230740 1 --2- 172.21.15.45:0/1670530176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589793594a0 0x5589793677d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.131+0000 7f8561ffb640 0 client.25538 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.131+0000 7f8583230740 1 -- 172.21.15.45:0/1670530176 >> 172.21.15.45:0/1670530176 conn(0x558979355a30 msgr2=0x558979362ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8583230740 1 -- 172.21.15.45:0/1670530176 shutdown_connections 2024-09-15T22:18:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8583230740 1 -- 172.21.15.45:0/1670530176 wait complete. 2024-09-15T22:18:36.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8583230740 20 client.25538 trim_cache size 0 max 16384 2024-09-15T22:18:36.138 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:18:36.138 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:18:36.138 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:18:36.138 INFO:teuthology.orchestra.run.smithi045.stdout: "e3a7060b-3dcf-48b2-85b8-ba31dcd6ca48": { 2024-09-15T22:18:36.138 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:18:36.138 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "e3a7060b-3dcf-48b2-85b8-ba31dcd6ca48", 2024-09-15T22:18:36.138 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:18:36.138 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:18:36.138 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:18:36.138 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:18:36.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8580e57640 1 -- 172.21.15.45:0/2874504779 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f85640a33b0 msgr2=0x7f85640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:36.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8580e57640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f85640a33b0 0x7f85640a5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8574012a70 tx=0x7f8574004ab0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8580e57640 1 -- 172.21.15.45:0/2874504779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c100e20 msgr2=0x7f857c1993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:36.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8580e57640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c100e20 0x7f857c1993c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f856c006010 tx=0x7f856c004c00 comp rx=0 tx=0).stop 2024-09-15T22:18:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8580e57640 1 -- 172.21.15.45:0/2874504779 shutdown_connections 2024-09-15T22:18:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8580e57640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f85640a33b0 0x7f85640a5870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8580e57640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f857c102ef0 0x7f857c1a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8580e57640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f857c102570 0x7f857c199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8580e57640 1 --2- 172.21.15.45:0/2874504779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c100e20 0x7f857c1993c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8580e57640 1 -- 172.21.15.45:0/2874504779 >> 172.21.15.45:0/2874504779 conn(0x7f857c0fc7d0 msgr2=0x7f857c106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.132+0000 7f8580e57640 1 -- 172.21.15.45:0/2874504779 shutdown_connections 2024-09-15T22:18:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:36.133+0000 7f8580e57640 1 -- 172.21.15.45:0/2874504779 wait complete. 2024-09-15T22:18:36.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:36 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:18:36.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:36 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:18:36.953 INFO:tasks.cephfs.filesystem:scrub status for tag:e3a7060b-3dcf-48b2-85b8-ba31dcd6ca48 - {'path': '/', 'tag': 'e3a7060b-3dcf-48b2-85b8-ba31dcd6ca48', 'options': 'recursive,force'} 2024-09-15T22:18:37.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:37 smithi045 ceph-mon[31180]: pgmap v74: 129 pgs: 129 active+clean; 224 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 421 op/s 2024-09-15T22:18:37.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:37 smithi165 ceph-mon[35551]: pgmap v74: 129 pgs: 129 active+clean; 224 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 421 op/s 2024-09-15T22:18:37.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:37 smithi100 ceph-mon[35319]: pgmap v74: 129 pgs: 129 active+clean; 224 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.0 MiB/s wr, 421 op/s 2024-09-15T22:18:38.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:38 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:18:38.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:38 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:18:38.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:38 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:18:38.603 INFO:tasks.quiescer.fs.[cephfs]:Total duration (39.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-15T22:18:38.603 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.55 2024-09-15T22:18:38.604 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:18:38.864 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:18:39.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:39 smithi045 ceph-mon[31180]: pgmap v75: 129 pgs: 129 active+clean; 224 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 337 op/s 2024-09-15T22:18:39.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.388+0000 7f58e20aa640 1 -- 172.21.15.45:0/1572868048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58dc100a80 msgr2=0x7f58dc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.388+0000 7f58e20aa640 1 --2- 172.21.15.45:0/1572868048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58dc100a80 0x7f58dc100ee0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009930 tx=0x7f58d002a420 comp rx=0 tx=0).stop 2024-09-15T22:18:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.388+0000 7f58e20aa640 1 -- 172.21.15.45:0/1572868048 shutdown_connections 2024-09-15T22:18:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.388+0000 7f58e20aa640 1 --2- 172.21.15.45:0/1572868048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58dc101420 0x7f58dc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.388+0000 7f58e20aa640 1 --2- 172.21.15.45:0/1572868048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58dc100a80 0x7f58dc100ee0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.388+0000 7f58e20aa640 1 --2- 172.21.15.45:0/1572868048 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58dc106a80 0x7f58dc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.388+0000 7f58e20aa640 1 -- 172.21.15.45:0/1572868048 >> 172.21.15.45:0/1572868048 conn(0x7f58dc0fc780 msgr2=0x7f58dc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.388+0000 7f58e20aa640 1 -- 172.21.15.45:0/1572868048 shutdown_connections 2024-09-15T22:18:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.388+0000 7f58e20aa640 1 -- 172.21.15.45:0/1572868048 wait complete. 2024-09-15T22:18:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.388+0000 7f58e20aa640 1 Processor -- start 2024-09-15T22:18:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58e20aa640 1 -- start start 2024-09-15T22:18:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58e20aa640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58dc100a80 0x7f58dc198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:39.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58e20aa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58dc101420 0x7f58dc198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58e20aa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58dc106a80 0x7f58dc19ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58e20aa640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f58dc110fa0 con 0x7f58dc106a80 2024-09-15T22:18:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58e20aa640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f58dc110e20 con 0x7f58dc101420 2024-09-15T22:18:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58e20aa640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f58dc111120 con 0x7f58dc100a80 2024-09-15T22:18:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58dbfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58dc106a80 0x7f58dc19ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58daffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58dc101420 0x7f58dc198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58daffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58dc101420 0x7f58dc198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:33986/0 (socket says 172.21.15.45:33986) 2024-09-15T22:18:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58daffd640 1 -- 172.21.15.45:0/3534073155 learned_addr learned my addr 172.21.15.45:0/3534073155 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58db7fe640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58dc100a80 0x7f58dc198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58daffd640 1 -- 172.21.15.45:0/3534073155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58dc100a80 msgr2=0x7f58dc198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58daffd640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58dc100a80 0x7f58dc198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:39.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58daffd640 1 -- 172.21.15.45:0/3534073155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58dc106a80 msgr2=0x7f58dc19ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58daffd640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58dc106a80 0x7f58dc19ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58daffd640 1 -- 172.21.15.45:0/3534073155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58dc19d500 con 0x7f58dc101420 2024-09-15T22:18:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.389+0000 7f58dbfff640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58dc106a80 0x7f58dc19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:18:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.390+0000 7f58daffd640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58dc101420 0x7f58dc198a90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009230 tx=0x7f58d0004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.390+0000 7f58d8ff9640 1 -- 172.21.15.45:0/3534073155 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d003f030 con 0x7f58dc101420 2024-09-15T22:18:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.390+0000 7f58e20aa640 1 -- 172.21.15.45:0/3534073155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58dc19d790 con 0x7f58dc101420 2024-09-15T22:18:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.390+0000 7f58d8ff9640 1 -- 172.21.15.45:0/3534073155 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f58d0003af0 con 0x7f58dc101420 2024-09-15T22:18:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.390+0000 7f58d8ff9640 1 -- 172.21.15.45:0/3534073155 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d0035070 con 0x7f58dc101420 2024-09-15T22:18:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.390+0000 7f58e20aa640 1 -- 172.21.15.45:0/3534073155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58dc1a50d0 con 0x7f58dc101420 2024-09-15T22:18:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.391+0000 7f58e20aa640 1 -- 172.21.15.45:0/3534073155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58dc1021c0 con 0x7f58dc101420 2024-09-15T22:18:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.392+0000 7f58d8ff9640 1 -- 172.21.15.45:0/3534073155 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f58d0042030 con 0x7f58dc101420 2024-09-15T22:18:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.393+0000 7f58d8ff9640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f58c40a33b0 0x7f58c40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:39.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.393+0000 7f58db7fe640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f58c40a33b0 0x7f58c40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.393+0000 7f58d8ff9640 1 -- 172.21.15.45:0/3534073155 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f58d00f0720 con 0x7f58dc101420 2024-09-15T22:18:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.393+0000 7f58db7fe640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f58c40a33b0 0x7f58c40a5870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f58cc005c40 tx=0x7f58cc00a570 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:39.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.396+0000 7f58d8ff9640 1 -- 172.21.15.45:0/3534073155 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f58d00bc6f0 con 0x7f58dc101420 2024-09-15T22:18:39.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:39 smithi165 ceph-mon[35551]: pgmap v75: 129 pgs: 129 active+clean; 224 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 337 op/s 2024-09-15T22:18:39.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:39 smithi100 ceph-mon[35319]: pgmap v75: 129 pgs: 129 active+clean; 224 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 337 op/s 2024-09-15T22:18:39.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.626+0000 7f58e20aa640 1 -- 172.21.15.45:0/3534073155 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58dc100ee0 con 0x7f58dc101420 2024-09-15T22:18:39.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.626+0000 7f58d8ff9640 1 -- 172.21.15.45:0/3534073155 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f58dc100ee0 con 0x7f58dc101420 2024-09-15T22:18:39.628 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:18:39.628 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:18:39.628 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:18:39.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.628+0000 7f58e20aa640 1 -- 172.21.15.45:0/3534073155 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f58c40a33b0 msgr2=0x7f58c40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:39.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.629+0000 7f58e20aa640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f58c40a33b0 0x7f58c40a5870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f58cc005c40 tx=0x7f58cc00a570 comp rx=0 tx=0).stop 2024-09-15T22:18:39.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.629+0000 7f58e20aa640 1 -- 172.21.15.45:0/3534073155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58dc101420 msgr2=0x7f58dc198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:39.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.629+0000 7f58e20aa640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58dc101420 0x7f58dc198a90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f58d0009230 tx=0x7f58d0004270 comp rx=0 tx=0).stop 2024-09-15T22:18:39.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.629+0000 7f58e20aa640 1 -- 172.21.15.45:0/3534073155 shutdown_connections 2024-09-15T22:18:39.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.629+0000 7f58e20aa640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f58c40a33b0 0x7f58c40a5870 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:39.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.629+0000 7f58e20aa640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58dc106a80 0x7f58dc19ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:39.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.629+0000 7f58e20aa640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58dc101420 0x7f58dc198a90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:39.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.629+0000 7f58e20aa640 1 --2- 172.21.15.45:0/3534073155 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f58dc100a80 0x7f58dc198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:39.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.629+0000 7f58e20aa640 1 -- 172.21.15.45:0/3534073155 >> 172.21.15.45:0/3534073155 conn(0x7f58dc0fc780 msgr2=0x7f58dc06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:39.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.629+0000 7f58e20aa640 1 -- 172.21.15.45:0/3534073155 shutdown_connections 2024-09-15T22:18:39.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:39.629+0000 7f58e20aa640 1 -- 172.21.15.45:0/3534073155 wait complete. 2024-09-15T22:18:40.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:40 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3534073155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:18:40.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:40 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3534073155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:18:40.468 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0' 2024-09-15T22:18:40.468 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0 2024-09-15T22:18:40.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:40 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3534073155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:18:40.725 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:18:41.136 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:41 smithi045 ceph-mon[31180]: pgmap v76: 129 pgs: 129 active+clean; 222 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 445 op/s 2024-09-15T22:18:41.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.264+0000 7fe0d1a43640 1 -- 172.21.15.45:0/2475102813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc106f10 msgr2=0x7fe0cc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:41.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.264+0000 7fe0d1a43640 1 --2- 172.21.15.45:0/2475102813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc106f10 0x7fe0cc10ea90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009ca0 tx=0x7fe0c402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.264+0000 7fe0d1a43640 1 -- 172.21.15.45:0/2475102813 shutdown_connections 2024-09-15T22:18:41.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.264+0000 7fe0d1a43640 1 --2- 172.21.15.45:0/2475102813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc106f10 0x7fe0cc10ea90 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.264+0000 7fe0d1a43640 1 --2- 172.21.15.45:0/2475102813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0cc102790 0x7fe0cc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.264+0000 7fe0d1a43640 1 --2- 172.21.15.45:0/2475102813 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0cc101de0 0x7fe0cc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.264+0000 7fe0d1a43640 1 -- 172.21.15.45:0/2475102813 >> 172.21.15.45:0/2475102813 conn(0x7fe0cc0fd8c0 msgr2=0x7fe0cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:41.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.264+0000 7fe0d1a43640 1 -- 172.21.15.45:0/2475102813 shutdown_connections 2024-09-15T22:18:41.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.264+0000 7fe0d1a43640 1 -- 172.21.15.45:0/2475102813 wait complete. 2024-09-15T22:18:41.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.265+0000 7fe0d1a43640 1 Processor -- start 2024-09-15T22:18:41.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.265+0000 7fe0d1a43640 1 -- start start 2024-09-15T22:18:41.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.265+0000 7fe0d1a43640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc101de0 0x7fe0cc19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.265+0000 7fe0d1a43640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0cc102790 0x7fe0cc19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.265+0000 7fe0d1a43640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0cc106f10 0x7fe0cc19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.265+0000 7fe0d1a43640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc075720 con 0x7fe0cc101de0 2024-09-15T22:18:41.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.265+0000 7fe0d1a43640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc0755a0 con 0x7fe0cc106f10 2024-09-15T22:18:41.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.265+0000 7fe0d1a43640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc0758a0 con 0x7fe0cc102790 2024-09-15T22:18:41.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.265+0000 7fe0caffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc101de0 0x7fe0cc19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.265+0000 7fe0caffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc101de0 0x7fe0cc19a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59936/0 (socket says 172.21.15.45:59936) 2024-09-15T22:18:41.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.265+0000 7fe0caffd640 1 -- 172.21.15.45:0/2086253386 learned_addr learned my addr 172.21.15.45:0/2086253386 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:41.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.265+0000 7fe0ca7fc640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0cc102790 0x7fe0cc19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.266+0000 7fe0cb7fe640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0cc106f10 0x7fe0cc19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.266+0000 7fe0caffd640 1 -- 172.21.15.45:0/2086253386 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0cc102790 msgr2=0x7fe0cc19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:41.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.266+0000 7fe0caffd640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0cc102790 0x7fe0cc19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.266+0000 7fe0caffd640 1 -- 172.21.15.45:0/2086253386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0cc106f10 msgr2=0x7fe0cc19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:41.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.266+0000 7fe0caffd640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0cc106f10 0x7fe0cc19ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.266+0000 7fe0caffd640 1 -- 172.21.15.45:0/2086253386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0cc19f600 con 0x7fe0cc101de0 2024-09-15T22:18:41.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.266+0000 7fe0caffd640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc101de0 0x7fe0cc19a650 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00d770 tx=0x7fe0bc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:41.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.266+0000 7fe0d0a41640 1 -- 172.21.15.45:0/2086253386 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc017070 con 0x7fe0cc101de0 2024-09-15T22:18:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.266+0000 7fe0d1a43640 1 -- 172.21.15.45:0/2086253386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0cc19f8f0 con 0x7fe0cc101de0 2024-09-15T22:18:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.266+0000 7fe0d0a41640 1 -- 172.21.15.45:0/2086253386 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0bc005520 con 0x7fe0cc101de0 2024-09-15T22:18:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.266+0000 7fe0d0a41640 1 -- 172.21.15.45:0/2086253386 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc010460 con 0x7fe0cc101de0 2024-09-15T22:18:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.266+0000 7fe0d1a43640 1 -- 172.21.15.45:0/2086253386 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0cc1a71d0 con 0x7fe0cc101de0 2024-09-15T22:18:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.268+0000 7fe0d0a41640 1 -- 172.21.15.45:0/2086253386 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe0bc004ea0 con 0x7fe0cc101de0 2024-09-15T22:18:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.268+0000 7fe0d3e1c740 1 Processor -- start 2024-09-15T22:18:41.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0d3e1c740 1 -- start start 2024-09-15T22:18:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0d3e1c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f1f850 0x560eb4f1fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0d3e1c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f20170 0x560eb4f2a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0d3e1c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f2aa30 0x560eb4f2ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0d3e1c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560eb4e84160 con 0x560eb4f2aa30 2024-09-15T22:18:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0d3e1c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560eb4e2b720 con 0x560eb4f20170 2024-09-15T22:18:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0d3e1c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560eb4e80120 con 0x560eb4f1f850 2024-09-15T22:18:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0ca7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f2aa30 0x560eb4f2ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0ca7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f2aa30 0x560eb4f2ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59938/0 (socket says 172.21.15.45:59938) 2024-09-15T22:18:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0ca7fc640 1 -- 172.21.15.45:0/1134453589 learned_addr learned my addr 172.21.15.45:0/1134453589 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0cb7fe640 1 --2- 172.21.15.45:0/1134453589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f1f850 0x560eb4f1fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0caffd640 1 --2- 172.21.15.45:0/1134453589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f20170 0x560eb4f2a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0d0a41640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe0b40a33b0 0x7fe0b40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0ca7fc640 1 -- 172.21.15.45:0/1134453589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f1f850 msgr2=0x560eb4f1fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:41.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0ca7fc640 1 --2- 172.21.15.45:0/1134453589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f1f850 0x560eb4f1fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0ca7fc640 1 -- 172.21.15.45:0/1134453589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f20170 msgr2=0x560eb4f2a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:41.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0ca7fc640 1 --2- 172.21.15.45:0/1134453589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f20170 0x560eb4f2a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0ca7fc640 1 -- 172.21.15.45:0/1134453589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb4bf5ba0 con 0x560eb4f2aa30 2024-09-15T22:18:41.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0cb7fe640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe0b40a33b0 0x7fe0b40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.269+0000 7fe0d0a41640 1 -- 172.21.15.45:0/2086253386 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fe0bc0cfd10 con 0x7fe0cc101de0 2024-09-15T22:18:41.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.270+0000 7fe0ca7fc640 1 --2- 172.21.15.45:0/1134453589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f2aa30 0x560eb4f2ce20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000bc10 tx=0x7fe0c000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e25b92f64b66ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:41.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.270+0000 7fe0b1ffb640 1 -- 172.21.15.45:0/1134453589 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0015070 con 0x560eb4f2aa30 2024-09-15T22:18:41.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.270+0000 7fe0b1ffb640 1 -- 172.21.15.45:0/1134453589 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0c0011940 con 0x560eb4f2aa30 2024-09-15T22:18:41.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.270+0000 7fe0b1ffb640 1 -- 172.21.15.45:0/1134453589 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0010930 con 0x560eb4f2aa30 2024-09-15T22:18:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.270+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/1134453589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f2aa30 msgr2=0x560eb4f2ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.270+0000 7fe0cb7fe640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe0b40a33b0 0x7fe0b40a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4005e30 tx=0x7fe0c40095c0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.270+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/1134453589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f2aa30 0x560eb4f2ce20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000bc10 tx=0x7fe0c000f730 comp rx=0 tx=0).stop 2024-09-15T22:18:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.270+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/1134453589 shutdown_connections 2024-09-15T22:18:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.270+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/1134453589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f2aa30 0x560eb4f2ce20 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.270+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/1134453589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f20170 0x560eb4f2a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.270+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/1134453589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f1f850 0x560eb4f1fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.270+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/1134453589 >> 172.21.15.45:0/1134453589 conn(0x560eb4f1bde0 msgr2=0x560eb4f1c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.271+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/1134453589 shutdown_connections 2024-09-15T22:18:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.271+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/1134453589 wait complete. 2024-09-15T22:18:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.271+0000 7fe0d3e1c740 1 -- start start 2024-09-15T22:18:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.271+0000 7fe0d3e1c740 1 Processor -- start 2024-09-15T22:18:41.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.271+0000 7fe0d3e1c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 0x560eb4f27940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.271+0000 7fe0d3e1c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f20170 0x560eb4f27e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.271+0000 7fe0d3e1c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 0x560eb4f283c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.271+0000 7fe0d3e1c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560eb4f2d600 con 0x560eb4f1f850 2024-09-15T22:18:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.271+0000 7fe0d3e1c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560eb4e0c900 con 0x560eb4f2aa30 2024-09-15T22:18:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.271+0000 7fe0d3e1c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560eb4f2d780 con 0x560eb4f20170 2024-09-15T22:18:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.271+0000 7fe0d3e1c740 10 client.0 _ll_register_callbacks cb 0x560eb4e0a780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.271+0000 7fe0caffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 0x560eb4f27940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.271+0000 7fe0caffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 0x560eb4f27940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59954/0 (socket says 172.21.15.45:59954) 2024-09-15T22:18:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0caffd640 1 -- 172.21.15.45:0/210506810 learned_addr learned my addr 172.21.15.45:0/210506810 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0ca7fc640 1 --2- 172.21.15.45:0/210506810 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f20170 0x560eb4f27e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0cb7fe640 1 --2- 172.21.15.45:0/210506810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 0x560eb4f283c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0caffd640 1 -- 172.21.15.45:0/210506810 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f20170 msgr2=0x560eb4f27e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:41.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0caffd640 1 --2- 172.21.15.45:0/210506810 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f20170 0x560eb4f27e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0caffd640 1 -- 172.21.15.45:0/210506810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 msgr2=0x560eb4f283c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0caffd640 1 --2- 172.21.15.45:0/210506810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 0x560eb4f283c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0caffd640 1 -- 172.21.15.45:0/210506810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb4e4cc50 con 0x560eb4f1f850 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0caffd640 1 --2- 172.21.15.45:0/210506810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 0x560eb4f27940 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0cd100 tx=0x7fe0bc00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627a4dbc0d23599a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0aaffd640 1 -- 172.21.15.45:0/210506810 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc020070 con 0x560eb4f1f850 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0aaffd640 1 -- 172.21.15.45:0/210506810 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fe0bc0982a0 con 0x560eb4f1f850 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/210506810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0c0011940 con 0x560eb4f1f850 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0aaffd640 1 -- 172.21.15.45:0/210506810 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe0bc09b770 con 0x560eb4f1f850 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0d3e1c740 10 client.15933 fetch_fsmap learned FSMap version 21 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.272+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/210506810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560eb4f39330 con 0x560eb4f1f850 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.273+0000 7fe0aaffd640 1 -- 172.21.15.45:0/210506810 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0c0011940 con 0x560eb4f1f850 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.273+0000 7fe0aaffd640 1 -- 172.21.15.45:0/210506810 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe0bc005190 con 0x560eb4f1f850 2024-09-15T22:18:41.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.273+0000 7fe0d3e1c740 10 client.15933 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:18:41.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.273+0000 7fe0d3e1c740 10 client.15933 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:18:41.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.273+0000 7fe0d3e1c740 20 client.15933 populate_metadata read hostname 'smithi045' 2024-09-15T22:18:41.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.273+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/210506810 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560eb4f3a7f0 0x560eb4f3cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.273+0000 7fe0d3e1c740 4 client.15933 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:18:41.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.273+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/210506810 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560eb4e91890 con 0x560eb4f3a7f0 2024-09-15T22:18:41.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.273+0000 7fe0ca7fc640 1 --2- 172.21.15.45:0/210506810 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560eb4f3a7f0 0x560eb4f3cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.273+0000 7fe0aaffd640 10 client.15933 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:41.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.273+0000 7fe0ca7fc640 1 --2- 172.21.15.45:0/210506810 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560eb4f3a7f0 0x560eb4f3cc80 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52ffb5cfd7f559dc server_cookie=aff400aa38e1f0d0 in_seq=0 out_seq=0 2024-09-15T22:18:41.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.274+0000 7fe0aaffd640 1 -- 172.21.15.45:0/210506810 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560eb4e91890 con 0x560eb4f3a7f0 2024-09-15T22:18:41.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.274+0000 7fe0aaffd640 10 client.15933 handle_command_reply: tid=0 2024-09-15T22:18:41.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.274+0000 7fe0d3e1c740 1 client.15933 shutdown 2024-09-15T22:18:41.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.274+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/210506810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 msgr2=0x560eb4f27940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:41.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.274+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/210506810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 0x560eb4f27940 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc0cd100 tx=0x7fe0bc00b480 comp rx=0 tx=0).stop 2024-09-15T22:18:41.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.274+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/210506810 shutdown_connections 2024-09-15T22:18:41.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.274+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/210506810 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560eb4f3a7f0 0x560eb4f3cc80 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.274+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/210506810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 0x560eb4f283c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.274+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/210506810 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f20170 0x560eb4f27e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.274+0000 7fe0aaffd640 0 client.15933 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.274+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/210506810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 0x560eb4f27940 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.274+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/210506810 >> 172.21.15.45:0/210506810 conn(0x560eb4f1bde0 msgr2=0x560eb4f21ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.275+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/210506810 shutdown_connections 2024-09-15T22:18:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.275+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/210506810 wait complete. 2024-09-15T22:18:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.275+0000 7fe0d3e1c740 20 client.15933 trim_cache size 0 max 16384 2024-09-15T22:18:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0d3e1c740 1 Processor -- start 2024-09-15T22:18:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0d3e1c740 1 -- start start 2024-09-15T22:18:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0d3e1c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 0x560eb4f26880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0d3e1c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f20170 0x560eb4f22bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0d3e1c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 0x560eb4f42570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0d3e1c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1af220 con 0x560eb4f1f850 2024-09-15T22:18:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0d3e1c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1b1aa0 con 0x560eb4f2aa30 2024-09-15T22:18:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0d3e1c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1af890 con 0x560eb4f20170 2024-09-15T22:18:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0caffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 0x560eb4f26880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0caffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 0x560eb4f26880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59960/0 (socket says 172.21.15.45:59960) 2024-09-15T22:18:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0caffd640 1 -- 172.21.15.45:0/3875602517 learned_addr learned my addr 172.21.15.45:0/3875602517 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0cb7fe640 1 --2- 172.21.15.45:0/3875602517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 0x560eb4f42570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0ca7fc640 1 --2- 172.21.15.45:0/3875602517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f20170 0x560eb4f22bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0caffd640 1 -- 172.21.15.45:0/3875602517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f20170 msgr2=0x560eb4f22bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0caffd640 1 --2- 172.21.15.45:0/3875602517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f20170 0x560eb4f22bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0caffd640 1 -- 172.21.15.45:0/3875602517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 msgr2=0x560eb4f42570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0caffd640 1 --2- 172.21.15.45:0/3875602517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 0x560eb4f42570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.292+0000 7fe0caffd640 1 -- 172.21.15.45:0/3875602517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb4f1ca70 con 0x560eb4f1f850 2024-09-15T22:18:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.293+0000 7fe0caffd640 1 --2- 172.21.15.45:0/3875602517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 0x560eb4f26880 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc09bbc0 tx=0x7fe0bc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c7fcdf0e379897 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.293+0000 7fe0b17fa640 1 -- 172.21.15.45:0/3875602517 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc014020 con 0x560eb4f1f850 2024-09-15T22:18:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.293+0000 7fe0b17fa640 1 -- 172.21.15.45:0/3875602517 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe0bc09bc30 con 0x560eb4f1f850 2024-09-15T22:18:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.293+0000 7fe0b17fa640 1 -- 172.21.15.45:0/3875602517 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc020070 con 0x560eb4f1f850 2024-09-15T22:18:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.293+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/3875602517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 msgr2=0x560eb4f26880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.293+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/3875602517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 0x560eb4f26880 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc09bbc0 tx=0x7fe0bc009c30 comp rx=0 tx=0).stop 2024-09-15T22:18:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.293+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/3875602517 shutdown_connections 2024-09-15T22:18:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.293+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/3875602517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 0x560eb4f42570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.293+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/3875602517 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f20170 0x560eb4f22bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.293+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/3875602517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f1f850 0x560eb4f26880 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.293+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/3875602517 >> 172.21.15.45:0/3875602517 conn(0x560eb4f1bde0 msgr2=0x560eb4f21ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:41.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.293+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/3875602517 shutdown_connections 2024-09-15T22:18:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.294+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/3875602517 wait complete. 2024-09-15T22:18:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.294+0000 7fe0d3e1c740 1 -- start start 2024-09-15T22:18:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.294+0000 7fe0d3e1c740 1 Processor -- start 2024-09-15T22:18:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.294+0000 7fe0d3e1c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f1f850 0x560eb4f33100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.294+0000 7fe0d3e1c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f20170 0x560eb4f2e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.294+0000 7fe0d3e1c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 0x560eb4f2e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.294+0000 7fe0d3e1c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1aff60 con 0x560eb4f20170 2024-09-15T22:18:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.294+0000 7fe0d3e1c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1b13d0 con 0x560eb4f2aa30 2024-09-15T22:18:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.294+0000 7fe0d3e1c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1b0630 con 0x560eb4f1f850 2024-09-15T22:18:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.294+0000 7fe0d3e1c740 10 client.0 _ll_register_callbacks cb 0x7fe0bc0d3550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:18:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.294+0000 7fe0ca7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f20170 0x560eb4f2e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0ca7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f20170 0x560eb4f2e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59970/0 (socket says 172.21.15.45:59970) 2024-09-15T22:18:41.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0ca7fc640 1 -- 172.21.15.45:0/2675782241 learned_addr learned my addr 172.21.15.45:0/2675782241 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0cb7fe640 1 --2- 172.21.15.45:0/2675782241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 0x560eb4f2e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0caffd640 1 --2- 172.21.15.45:0/2675782241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f1f850 0x560eb4f33100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0ca7fc640 1 -- 172.21.15.45:0/2675782241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f1f850 msgr2=0x560eb4f33100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0ca7fc640 1 --2- 172.21.15.45:0/2675782241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f1f850 0x560eb4f33100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0ca7fc640 1 -- 172.21.15.45:0/2675782241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 msgr2=0x560eb4f2e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:18:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0ca7fc640 1 --2- 172.21.15.45:0/2675782241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 0x560eb4f2e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0ca7fc640 1 -- 172.21.15.45:0/2675782241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb4f28910 con 0x560eb4f20170 2024-09-15T22:18:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0ca7fc640 1 --2- 172.21.15.45:0/2675782241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f20170 0x560eb4f2e430 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0014040 tx=0x7fe0c0005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804d1a770ad6da8c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0aaffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:18:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0aaffd640 1 -- 172.21.15.45:0/2675782241 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0015040 con 0x560eb4f20170 2024-09-15T22:18:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0aaffd640 1 -- 172.21.15.45:0/2675782241 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fe0c0004240 con 0x560eb4f20170 2024-09-15T22:18:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/2675782241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560eb4e8bbe0 con 0x560eb4f20170 2024-09-15T22:18:41.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0aaffd640 1 -- 172.21.15.45:0/2675782241 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe0c0034050 con 0x560eb4f20170 2024-09-15T22:18:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0d3e1c740 10 client.15939 fetch_fsmap learned FSMap version 21 2024-09-15T22:18:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.295+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/2675782241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560eb4f226c0 con 0x560eb4f20170 2024-09-15T22:18:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.296+0000 7fe0aaffd640 1 -- 172.21.15.45:0/2675782241 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x560eb4e8bbe0 con 0x560eb4f20170 2024-09-15T22:18:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.296+0000 7fe0aaffd640 1 -- 172.21.15.45:0/2675782241 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe0c0004b00 con 0x560eb4f20170 2024-09-15T22:18:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.296+0000 7fe0d3e1c740 10 client.15939 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:18:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.296+0000 7fe0d3e1c740 10 client.15939 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:18:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.296+0000 7fe0d3e1c740 20 client.15939 populate_metadata read hostname 'smithi045' 2024-09-15T22:18:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.296+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/2675782241 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560eb4fa5750 0x560eb4fa7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.296+0000 7fe0d3e1c740 4 client.15939 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}] 2024-09-15T22:18:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.296+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/2675782241 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}) -- 0x560eb4e07f40 con 0x560eb4fa5750 2024-09-15T22:18:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.296+0000 7fe0caffd640 1 --2- 172.21.15.45:0/2675782241 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560eb4fa5750 0x560eb4fa7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.296+0000 7fe0caffd640 1 --2- 172.21.15.45:0/2675782241 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560eb4fa5750 0x560eb4fa7b70 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95411b3875c22c79 server_cookie=3d70b2616ddc3701 in_seq=0 out_seq=0 2024-09-15T22:18:41.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:41.296+0000 7fe0aaffd640 10 client.15939 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:41.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:41 smithi165 ceph-mon[35551]: pgmap v76: 129 pgs: 129 active+clean; 222 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 445 op/s 2024-09-15T22:18:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:41 smithi100 ceph-mon[35319]: pgmap v76: 129 pgs: 129 active+clean; 222 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 445 op/s 2024-09-15T22:18:43.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:43 smithi045 ceph-mon[31180]: pgmap v77: 129 pgs: 129 active+clean; 222 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 288 op/s 2024-09-15T22:18:43.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:43 smithi165 ceph-mon[35551]: pgmap v77: 129 pgs: 129 active+clean; 222 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 288 op/s 2024-09-15T22:18:43.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:43 smithi100 ceph-mon[35319]: pgmap v77: 129 pgs: 129 active+clean; 222 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 288 op/s 2024-09-15T22:18:45.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:45 smithi045 ceph-mon[31180]: pgmap v78: 129 pgs: 129 active+clean; 230 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 433 op/s 2024-09-15T22:18:45.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:45 smithi165 ceph-mon[35551]: pgmap v78: 129 pgs: 129 active+clean; 230 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 433 op/s 2024-09-15T22:18:45.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:45 smithi100 ceph-mon[35319]: pgmap v78: 129 pgs: 129 active+clean; 230 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 433 op/s 2024-09-15T22:18:47.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:47 smithi045 ceph-mon[31180]: pgmap v79: 129 pgs: 129 active+clean; 230 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 318 op/s 2024-09-15T22:18:47.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:47 smithi165 ceph-mon[35551]: pgmap v79: 129 pgs: 129 active+clean; 230 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 318 op/s 2024-09-15T22:18:47.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.473+0000 7fe0aaffd640 1 -- 172.21.15.45:0/2675782241 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560eb4e07f40 con 0x560eb4fa5750 2024-09-15T22:18:47.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.473+0000 7fe0aaffd640 10 client.15939 handle_command_reply: tid=0 2024-09-15T22:18:47.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.473+0000 7fe0d3e1c740 1 client.15939 shutdown 2024-09-15T22:18:47.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.473+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/2675782241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f20170 msgr2=0x560eb4f2e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:47.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.473+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/2675782241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f20170 0x560eb4f2e430 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0014040 tx=0x7fe0c0005ee0 comp rx=0 tx=0).stop 2024-09-15T22:18:47.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.473+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/2675782241 shutdown_connections 2024-09-15T22:18:47.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.473+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/2675782241 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560eb4fa5750 0x560eb4fa7b70 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:47.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.474+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/2675782241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560eb4f2aa30 0x560eb4f2e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:47.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.474+0000 7fe0aaffd640 0 client.15939 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:18:47.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.474+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/2675782241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560eb4f20170 0x560eb4f2e430 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.474+0000 7fe0d3e1c740 1 --2- 172.21.15.45:0/2675782241 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560eb4f1f850 0x560eb4f33100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.474+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/2675782241 >> 172.21.15.45:0/2675782241 conn(0x560eb4f1bde0 msgr2=0x560eb4f212a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.474+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/2675782241 shutdown_connections 2024-09-15T22:18:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.474+0000 7fe0d3e1c740 1 -- 172.21.15.45:0/2675782241 wait complete. 2024-09-15T22:18:47.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.474+0000 7fe0d3e1c740 20 client.15939 trim_cache size 0 max 16384 2024-09-15T22:18:47.477 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:18:47.477 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 21, 2024-09-15T22:18:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "leader": 24476, 2024-09-15T22:18:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "set_version": 6, 2024-09-15T22:18:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "sets": { 2024-09-15T22:18:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "9a9863fc": { 2024-09-15T22:18:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "version": 6, 2024-09-15T22:18:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "age_ref": 0.0, 2024-09-15T22:18:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "state": { 2024-09-15T22:18:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "QUIESCED", 2024-09-15T22:18:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.0 2024-09-15T22:18:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:18:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "timeout": 90.0, 2024-09-15T22:18:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "expiration": 139.6, 2024-09-15T22:18:47.478 INFO:teuthology.orchestra.run.smithi045.stdout: "members": { 2024-09-15T22:18:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "file:/": { 2024-09-15T22:18:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "excluded": false, 2024-09-15T22:18:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "state": { 2024-09-15T22:18:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "QUIESCED", 2024-09-15T22:18:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.0 2024-09-15T22:18:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:18:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:18:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:18:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:18:47.479 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:18:47.479 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:18:47.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.475+0000 7fe0d1a43640 1 -- 172.21.15.45:0/2086253386 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe0b40a33b0 msgr2=0x7fe0b40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:47.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.475+0000 7fe0d1a43640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe0b40a33b0 0x7fe0b40a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4005e30 tx=0x7fe0c40095c0 comp rx=0 tx=0).stop 2024-09-15T22:18:47.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.475+0000 7fe0d1a43640 1 -- 172.21.15.45:0/2086253386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc101de0 msgr2=0x7fe0cc19a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:47.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.475+0000 7fe0d1a43640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc101de0 0x7fe0cc19a650 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00d770 tx=0x7fe0bc00dc30 comp rx=0 tx=0).stop 2024-09-15T22:18:47.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.475+0000 7fe0d1a43640 1 -- 172.21.15.45:0/2086253386 shutdown_connections 2024-09-15T22:18:47.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.475+0000 7fe0d1a43640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe0b40a33b0 0x7fe0b40a5870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:47.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.475+0000 7fe0d1a43640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0cc106f10 0x7fe0cc19ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:47.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.475+0000 7fe0d1a43640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe0cc102790 0x7fe0cc19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:47.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.475+0000 7fe0d1a43640 1 --2- 172.21.15.45:0/2086253386 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0cc101de0 0x7fe0cc19a650 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:47.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.475+0000 7fe0d1a43640 1 -- 172.21.15.45:0/2086253386 >> 172.21.15.45:0/2086253386 conn(0x7fe0cc0fd8c0 msgr2=0x7fe0cc0fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:47.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.475+0000 7fe0d1a43640 1 -- 172.21.15.45:0/2086253386 shutdown_connections 2024-09-15T22:18:47.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:47.475+0000 7fe0d1a43640 1 -- 172.21.15.45:0/2086253386 wait complete. 2024-09-15T22:18:47.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:47 smithi100 ceph-mon[35319]: pgmap v79: 129 pgs: 129 active+clean; 230 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 318 op/s 2024-09-15T22:18:48.341 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9a9863fc', quiesce took 9.7 seconds. Will release after: 9.850000000000001 2024-09-15T22:18:49.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:49 smithi165 ceph-mon[35551]: pgmap v80: 129 pgs: 129 active+clean; 230 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 258 op/s 2024-09-15T22:18:49.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:49 smithi100 ceph-mon[35319]: pgmap v80: 129 pgs: 129 active+clean; 230 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 258 op/s 2024-09-15T22:18:49.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:49 smithi045 ceph-mon[31180]: pgmap v80: 129 pgs: 129 active+clean; 230 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 258 op/s 2024-09-15T22:18:51.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:51 smithi165 ceph-mon[35551]: pgmap v81: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 534 op/s 2024-09-15T22:18:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:51 smithi100 ceph-mon[35319]: pgmap v81: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 534 op/s 2024-09-15T22:18:51.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:51 smithi045 ceph-mon[31180]: pgmap v81: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 534 op/s 2024-09-15T22:18:53.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:53 smithi165 ceph-mon[35551]: pgmap v82: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 427 op/s 2024-09-15T22:18:53.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:53 smithi100 ceph-mon[35319]: pgmap v82: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 427 op/s 2024-09-15T22:18:53.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:53 smithi045 ceph-mon[31180]: pgmap v82: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 427 op/s 2024-09-15T22:18:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:55 smithi165 ceph-mon[35551]: pgmap v83: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 431 op/s 2024-09-15T22:18:55.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:55 smithi100 ceph-mon[35319]: pgmap v83: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 431 op/s 2024-09-15T22:18:55.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:55 smithi045 ceph-mon[31180]: pgmap v83: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.8 MiB/s wr, 431 op/s 2024-09-15T22:18:57.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:57 smithi165 ceph-mon[35551]: pgmap v84: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 1.1 MiB/s wr, 286 op/s 2024-09-15T22:18:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:57 smithi100 ceph-mon[35319]: pgmap v84: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 1.1 MiB/s wr, 286 op/s 2024-09-15T22:18:57.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:57 smithi045 ceph-mon[31180]: pgmap v84: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 1.1 MiB/s wr, 286 op/s 2024-09-15T22:18:58.192 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:18:58.463 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:18:59.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.096+0000 7f061e135640 1 -- 172.21.15.45:0/624928956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0618102570 msgr2=0x7f06181029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:59.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.096+0000 7f061e135640 1 --2- 172.21.15.45:0/624928956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0618102570 0x7f06181029b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f060c009900 tx=0x7f060c02a480 comp rx=0 tx=0).stop 2024-09-15T22:18:59.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.096+0000 7f061e135640 1 -- 172.21.15.45:0/624928956 shutdown_connections 2024-09-15T22:18:59.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.096+0000 7f061e135640 1 --2- 172.21.15.45:0/624928956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0618102ef0 0x7f061810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:59.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.096+0000 7f061e135640 1 --2- 172.21.15.45:0/624928956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0618102570 0x7f06181029b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:59.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.096+0000 7f061e135640 1 --2- 172.21.15.45:0/624928956 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0618100e20 0x7f0618101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:59.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.096+0000 7f061e135640 1 -- 172.21.15.45:0/624928956 >> 172.21.15.45:0/624928956 conn(0x7f06180fc7d0 msgr2=0x7f06180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:59.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.096+0000 7f061e135640 1 -- 172.21.15.45:0/624928956 shutdown_connections 2024-09-15T22:18:59.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.096+0000 7f061e135640 1 -- 172.21.15.45:0/624928956 wait complete. 2024-09-15T22:18:59.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.096+0000 7f061e135640 1 Processor -- start 2024-09-15T22:18:59.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f061e135640 1 -- start start 2024-09-15T22:18:59.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f061e135640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0618100e20 0x7f0618199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:59.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f061e135640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0618102570 0x7f06181999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:59.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f061e135640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0618102ef0 0x7f06181a4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:59.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f061e135640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f06181110e0 con 0x7f0618102570 2024-09-15T22:18:59.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f061e135640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0618110f60 con 0x7f0618102ef0 2024-09-15T22:18:59.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f061e135640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0618111260 con 0x7f0618100e20 2024-09-15T22:18:59.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f0616ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0618102570 0x7f06181999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:59.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f0616ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0618102570 0x7f06181999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45036/0 (socket says 172.21.15.45:45036) 2024-09-15T22:18:59.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f0616ffd640 1 -- 172.21.15.45:0/3942194148 learned_addr learned my addr 172.21.15.45:0/3942194148 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:18:59.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f06177fe640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0618100e20 0x7f0618199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:59.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f0617fff640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0618102ef0 0x7f06181a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:59.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f0616ffd640 1 -- 172.21.15.45:0/3942194148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0618100e20 msgr2=0x7f0618199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f0616ffd640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0618100e20 0x7f0618199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f0616ffd640 1 -- 172.21.15.45:0/3942194148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0618102ef0 msgr2=0x7f06181a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f0616ffd640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0618102ef0 0x7f06181a4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f0616ffd640 1 -- 172.21.15.45:0/3942194148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06181a4a50 con 0x7f0618102570 2024-09-15T22:18:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.097+0000 7f0617fff640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0618102ef0 0x7f06181a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:18:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.098+0000 7f0616ffd640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0618102570 0x7f06181999d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f060c006010 tx=0x7f060c004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.098+0000 7f0614ff9640 1 -- 172.21.15.45:0/3942194148 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c03f030 con 0x7f0618102570 2024-09-15T22:18:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.098+0000 7f061e135640 1 -- 172.21.15.45:0/3942194148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06181a4c20 con 0x7f0618102570 2024-09-15T22:18:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.098+0000 7f0614ff9640 1 -- 172.21.15.45:0/3942194148 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f060c005500 con 0x7f0618102570 2024-09-15T22:18:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.098+0000 7f0614ff9640 1 -- 172.21.15.45:0/3942194148 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c035070 con 0x7f0618102570 2024-09-15T22:18:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.098+0000 7f061e135640 1 -- 172.21.15.45:0/3942194148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06181a50d0 con 0x7f0618102570 2024-09-15T22:18:59.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.099+0000 7f061e135640 1 -- 172.21.15.45:0/3942194148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0618101200 con 0x7f0618102570 2024-09-15T22:18:59.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.100+0000 7f0614ff9640 1 -- 172.21.15.45:0/3942194148 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f060c042030 con 0x7f0618102570 2024-09-15T22:18:59.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.101+0000 7f0614ff9640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f06000a33b0 0x7f06000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:18:59.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.101+0000 7f06177fe640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f06000a33b0 0x7f06000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:18:59.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.101+0000 7f0614ff9640 1 -- 172.21.15.45:0/3942194148 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f060c0f0d00 con 0x7f0618102570 2024-09-15T22:18:59.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.101+0000 7f06177fe640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f06000a33b0 0x7f06000a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0608009990 tx=0x7f0608009110 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:18:59.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.104+0000 7f0614ff9640 1 -- 172.21.15.45:0/3942194148 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f060c0bd320 con 0x7f0618102570 2024-09-15T22:18:59.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:18:59 smithi045 ceph-mon[31180]: pgmap v85: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 1.0 MiB/s wr, 280 op/s 2024-09-15T22:18:59.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.315+0000 7f061e135640 1 -- 172.21.15.45:0/3942194148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06181a5360 con 0x7f0618102570 2024-09-15T22:18:59.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.316+0000 7f0614ff9640 1 -- 172.21.15.45:0/3942194148 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f060c0bcc20 con 0x7f0618102570 2024-09-15T22:18:59.318 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:18:59.318 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:18:59.319 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:18:59.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.318+0000 7f061e135640 1 -- 172.21.15.45:0/3942194148 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f06000a33b0 msgr2=0x7f06000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:59.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.318+0000 7f061e135640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f06000a33b0 0x7f06000a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0608009990 tx=0x7f0608009110 comp rx=0 tx=0).stop 2024-09-15T22:18:59.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.318+0000 7f061e135640 1 -- 172.21.15.45:0/3942194148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0618102570 msgr2=0x7f06181999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:18:59.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.318+0000 7f061e135640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0618102570 0x7f06181999d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f060c006010 tx=0x7f060c004c00 comp rx=0 tx=0).stop 2024-09-15T22:18:59.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.318+0000 7f061e135640 1 -- 172.21.15.45:0/3942194148 shutdown_connections 2024-09-15T22:18:59.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.318+0000 7f061e135640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f06000a33b0 0x7f06000a5870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:59.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.318+0000 7f061e135640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0618102ef0 0x7f06181a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:59.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.318+0000 7f061e135640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0618102570 0x7f06181999d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:59.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.318+0000 7f061e135640 1 --2- 172.21.15.45:0/3942194148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0618100e20 0x7f0618199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:18:59.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.318+0000 7f061e135640 1 -- 172.21.15.45:0/3942194148 >> 172.21.15.45:0/3942194148 conn(0x7f06180fc7d0 msgr2=0x7f0618106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:18:59.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.318+0000 7f061e135640 1 -- 172.21.15.45:0/3942194148 shutdown_connections 2024-09-15T22:18:59.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:18:59.318+0000 7f061e135640 1 -- 172.21.15.45:0/3942194148 wait complete. 2024-09-15T22:18:59.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:18:59 smithi165 ceph-mon[35551]: pgmap v85: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 1.0 MiB/s wr, 280 op/s 2024-09-15T22:18:59.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:18:59 smithi100 ceph-mon[35319]: pgmap v85: 129 pgs: 129 active+clean; 240 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 1.0 MiB/s wr, 280 op/s 2024-09-15T22:19:00.200 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db --set-id 9a9863fc --release --await' 2024-09-15T22:19:00.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db --set-id 9a9863fc --release --await 2024-09-15T22:19:00.456 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:00.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:00 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3942194148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:00.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:00 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3942194148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:00.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:00 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3942194148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:00.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.930+0000 7f0787e25640 1 -- 172.21.15.45:0/4233012767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0780103660 msgr2=0x7f078010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.930+0000 7f0787e25640 1 --2- 172.21.15.45:0/4233012767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0780103660 0x7f078010bb50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0770009900 tx=0x7f077002a480 comp rx=0 tx=0).stop 2024-09-15T22:19:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.930+0000 7f0787e25640 1 -- 172.21.15.45:0/4233012767 shutdown_connections 2024-09-15T22:19:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.930+0000 7f0787e25640 1 --2- 172.21.15.45:0/4233012767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f078010c170 0x7f078010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.930+0000 7f0787e25640 1 --2- 172.21.15.45:0/4233012767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0780103660 0x7f078010bb50 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.930+0000 7f0787e25640 1 --2- 172.21.15.45:0/4233012767 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0780102d40 0x7f0780103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.930+0000 7f0787e25640 1 -- 172.21.15.45:0/4233012767 >> 172.21.15.45:0/4233012767 conn(0x7f07800fc7a0 msgr2=0x7f07800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.930+0000 7f0787e25640 1 -- 172.21.15.45:0/4233012767 shutdown_connections 2024-09-15T22:19:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.930+0000 7f0787e25640 1 -- 172.21.15.45:0/4233012767 wait complete. 2024-09-15T22:19:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f0787e25640 1 Processor -- start 2024-09-15T22:19:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f0787e25640 1 -- start start 2024-09-15T22:19:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f0787e25640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0780102d40 0x7f07801009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f0787e25640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0780103660 0x7f0780100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f0787e25640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f078010c170 0x7f0780101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f0787e25640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0780112090 con 0x7f078010c170 2024-09-15T22:19:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f0787e25640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0780111f10 con 0x7f0780103660 2024-09-15T22:19:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f0787e25640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0780112210 con 0x7f0780102d40 2024-09-15T22:19:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f07863c2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f078010c170 0x7f0780101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f07863c2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f078010c170 0x7f0780101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45052/0 (socket says 172.21.15.45:45052) 2024-09-15T22:19:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f07863c2640 1 -- 172.21.15.45:0/3526818469 learned_addr learned my addr 172.21.15.45:0/3526818469 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f0785bc1640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0780102d40 0x7f07801009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f07853c0640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0780103660 0x7f0780100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f07863c2640 1 -- 172.21.15.45:0/3526818469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0780102d40 msgr2=0x7f07801009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f07863c2640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0780102d40 0x7f07801009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f07863c2640 1 -- 172.21.15.45:0/3526818469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0780103660 msgr2=0x7f0780100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f07863c2640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0780103660 0x7f0780100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.931+0000 7f07863c2640 1 -- 172.21.15.45:0/3526818469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07801a6970 con 0x7f078010c170 2024-09-15T22:19:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.932+0000 7f07863c2640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f078010c170 0x7f0780101420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f077800cce0 tx=0x7f077800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.932+0000 7f0776ffd640 1 -- 172.21.15.45:0/3526818469 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077800f450 con 0x7f078010c170 2024-09-15T22:19:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.932+0000 7f0776ffd640 1 -- 172.21.15.45:0/3526818469 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f077800faf0 con 0x7f078010c170 2024-09-15T22:19:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.932+0000 7f0787e25640 1 -- 172.21.15.45:0/3526818469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07801a6c60 con 0x7f078010c170 2024-09-15T22:19:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.932+0000 7f0776ffd640 1 -- 172.21.15.45:0/3526818469 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0778018cc0 con 0x7f078010c170 2024-09-15T22:19:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.932+0000 7f0787e25640 1 -- 172.21.15.45:0/3526818469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07801a7150 con 0x7f078010c170 2024-09-15T22:19:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.935+0000 7f0776ffd640 1 -- 172.21.15.45:0/3526818469 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f077800f5f0 con 0x7f078010c170 2024-09-15T22:19:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.935+0000 7f078a1fe740 1 Processor -- start 2024-09-15T22:19:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.935+0000 7f078a1fe740 1 -- start start 2024-09-15T22:19:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.935+0000 7f078a1fe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 0x55a9cda8e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.935+0000 7f078a1fe740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda8e980 0x55a9cda98d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.935+0000 7f078a1fe740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 0x55a9cda9b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.935+0000 7f078a1fe740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a9cd9f3620 con 0x55a9cda99240 2024-09-15T22:19:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.935+0000 7f078a1fe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a9cd99ae50 con 0x55a9cda8e060 2024-09-15T22:19:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.935+0000 7f078a1fe740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a9cd9ef5e0 con 0x55a9cda8e980 2024-09-15T22:19:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f07853c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 0x55a9cda9b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f07853c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 0x55a9cda9b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45060/0 (socket says 172.21.15.45:45060) 2024-09-15T22:19:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f07853c0640 1 -- 172.21.15.45:0/4068864591 learned_addr learned my addr 172.21.15.45:0/4068864591 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f07853c0640 1 --2- 172.21.15.45:0/4068864591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 0x55a9cda8e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f0776ffd640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f076c0a33b0 0x7f076c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f0785bc1640 1 --2- 172.21.15.45:0/4068864591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda8e980 0x55a9cda98d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f07863c2640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f076c0a33b0 0x7f076c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f07853c0640 1 -- 172.21.15.45:0/4068864591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda8e980 msgr2=0x55a9cda98d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f07853c0640 1 --2- 172.21.15.45:0/4068864591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda8e980 0x55a9cda98d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f07853c0640 1 -- 172.21.15.45:0/4068864591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 msgr2=0x55a9cda8e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f07853c0640 1 --2- 172.21.15.45:0/4068864591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 0x55a9cda8e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f07853c0640 1 -- 172.21.15.45:0/4068864591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9cd98bd40 con 0x55a9cda99240 2024-09-15T22:19:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f0776ffd640 1 -- 172.21.15.45:0/3526818469 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f07780d05d0 con 0x7f078010c170 2024-09-15T22:19:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f07853c0640 1 --2- 172.21.15.45:0/4068864591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 0x55a9cda9b630 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f07700057c0 tx=0x7f0770000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6670dcc65d9ad48e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f07863c2640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f076c0a33b0 0x7f076c0a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f077809c420 tx=0x7f0778018720 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.936+0000 7f076bfff640 1 -- 172.21.15.45:0/4068864591 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770035040 con 0x55a9cda99240 2024-09-15T22:19:00.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.937+0000 7f076bfff640 1 -- 172.21.15.45:0/4068864591 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f07700035f0 con 0x55a9cda99240 2024-09-15T22:19:00.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.937+0000 7f076bfff640 1 -- 172.21.15.45:0/4068864591 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077003e660 con 0x55a9cda99240 2024-09-15T22:19:00.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.937+0000 7f078a1fe740 1 -- 172.21.15.45:0/4068864591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 msgr2=0x55a9cda9b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:00.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.937+0000 7f078a1fe740 1 --2- 172.21.15.45:0/4068864591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 0x55a9cda9b630 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f07700057c0 tx=0x7f0770000bc0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.937+0000 7f078a1fe740 1 -- 172.21.15.45:0/4068864591 shutdown_connections 2024-09-15T22:19:00.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.937+0000 7f078a1fe740 1 --2- 172.21.15.45:0/4068864591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 0x55a9cda9b630 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.937+0000 7f078a1fe740 1 --2- 172.21.15.45:0/4068864591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda8e980 0x55a9cda98d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.937+0000 7f078a1fe740 1 --2- 172.21.15.45:0/4068864591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 0x55a9cda8e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.937+0000 7f078a1fe740 1 -- 172.21.15.45:0/4068864591 >> 172.21.15.45:0/4068864591 conn(0x55a9cda8a5f0 msgr2=0x55a9cda8a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:00.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.937+0000 7f078a1fe740 1 -- 172.21.15.45:0/4068864591 shutdown_connections 2024-09-15T22:19:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.937+0000 7f078a1fe740 1 -- 172.21.15.45:0/4068864591 wait complete. 2024-09-15T22:19:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.938+0000 7f078a1fe740 1 -- start start 2024-09-15T22:19:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.938+0000 7f078a1fe740 1 Processor -- start 2024-09-15T22:19:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.938+0000 7f078a1fe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 0x55a9cda961e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.938+0000 7f078a1fe740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda8e980 0x55a9cda96720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.938+0000 7f078a1fe740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 0x55a9cda96c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.938+0000 7f078a1fe740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a9cda9be10 con 0x55a9cda99240 2024-09-15T22:19:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.938+0000 7f078a1fe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a9cd97bf10 con 0x55a9cda8e060 2024-09-15T22:19:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.938+0000 7f078a1fe740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a9cda9bf90 con 0x55a9cda8e980 2024-09-15T22:19:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.938+0000 7f078a1fe740 10 client.0 _ll_register_callbacks cb 0x55a9cd99fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07853c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 0x55a9cda96c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07853c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 0x55a9cda96c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45072/0 (socket says 172.21.15.45:45072) 2024-09-15T22:19:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07853c0640 1 -- 172.21.15.45:0/1483537988 learned_addr learned my addr 172.21.15.45:0/1483537988 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07853c0640 1 --2- 172.21.15.45:0/1483537988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 0x55a9cda961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f0785bc1640 1 --2- 172.21.15.45:0/1483537988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda8e980 0x55a9cda96720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07853c0640 1 -- 172.21.15.45:0/1483537988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda8e980 msgr2=0x55a9cda96720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07853c0640 1 --2- 172.21.15.45:0/1483537988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda8e980 0x55a9cda96720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07853c0640 1 -- 172.21.15.45:0/1483537988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 msgr2=0x55a9cda961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07853c0640 1 --2- 172.21.15.45:0/1483537988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 0x55a9cda961e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07853c0640 1 -- 172.21.15.45:0/1483537988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9cd702580 con 0x55a9cda99240 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07853c0640 1 --2- 172.21.15.45:0/1483537988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 0x55a9cda96c60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0770031520 tx=0x7f077002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571e6d13c09e23be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07697fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07697fa640 1 -- 172.21.15.45:0/1483537988 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770042070 con 0x55a9cda99240 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f078a1fe740 1 -- 172.21.15.45:0/1483537988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07700035f0 con 0x55a9cda99240 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07697fa640 1 -- 172.21.15.45:0/1483537988 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f077003f030 con 0x55a9cda99240 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f07697fa640 1 -- 172.21.15.45:0/1483537988 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0770059050 con 0x55a9cda99240 2024-09-15T22:19:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f078a1fe740 10 client.15957 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.939+0000 7f078a1fe740 1 -- 172.21.15.45:0/1483537988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a9cd7cc960 con 0x55a9cda99240 2024-09-15T22:19:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.940+0000 7f07697fa640 1 -- 172.21.15.45:0/1483537988 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f07700035f0 con 0x55a9cda99240 2024-09-15T22:19:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.940+0000 7f07697fa640 1 -- 172.21.15.45:0/1483537988 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f077003a040 con 0x55a9cda99240 2024-09-15T22:19:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.940+0000 7f078a1fe740 10 client.15957 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.940+0000 7f078a1fe740 10 client.15957 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:19:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.940+0000 7f078a1fe740 20 client.15957 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.940+0000 7f078a1fe740 1 --2- 172.21.15.45:0/1483537988 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a9cdaa8d10 0x55a9cdaab100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.940+0000 7f078a1fe740 4 client.15957 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.940+0000 7f078a1fe740 1 -- 172.21.15.45:0/1483537988 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9cda00b90 con 0x55a9cdaa8d10 2024-09-15T22:19:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.940+0000 7f0785bc1640 1 --2- 172.21.15.45:0/1483537988 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a9cdaa8d10 0x55a9cdaab100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.941+0000 7f0785bc1640 1 --2- 172.21.15.45:0/1483537988 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a9cdaa8d10 0x55a9cdaab100 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=131e7a341f58444b server_cookie=ef379358167a66f3 in_seq=0 out_seq=0 2024-09-15T22:19:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.941+0000 7f07697fa640 10 client.15957 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.941+0000 7f07697fa640 1 -- 172.21.15.45:0/1483537988 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9cda00b90 con 0x55a9cdaa8d10 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.941+0000 7f07697fa640 10 client.15957 handle_command_reply: tid=0 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.941+0000 7f078a1fe740 1 client.15957 shutdown 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.941+0000 7f078a1fe740 1 -- 172.21.15.45:0/1483537988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 msgr2=0x55a9cda96c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.941+0000 7f078a1fe740 1 --2- 172.21.15.45:0/1483537988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 0x55a9cda96c60 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0770031520 tx=0x7f077002a480 comp rx=0 tx=0).stop 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.941+0000 7f078a1fe740 1 -- 172.21.15.45:0/1483537988 shutdown_connections 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.941+0000 7f078a1fe740 1 --2- 172.21.15.45:0/1483537988 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a9cdaa8d10 0x55a9cdaab100 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.942+0000 7f078a1fe740 1 --2- 172.21.15.45:0/1483537988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda99240 0x55a9cda96c60 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.942+0000 7f078a1fe740 1 --2- 172.21.15.45:0/1483537988 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda8e980 0x55a9cda96720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.942+0000 7f078a1fe740 1 --2- 172.21.15.45:0/1483537988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 0x55a9cda961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.942+0000 7f07697fa640 0 client.15957 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.942+0000 7f078a1fe740 1 -- 172.21.15.45:0/1483537988 >> 172.21.15.45:0/1483537988 conn(0x55a9cda8a5f0 msgr2=0x55a9cda902d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.942+0000 7f078a1fe740 1 -- 172.21.15.45:0/1483537988 shutdown_connections 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.942+0000 7f078a1fe740 1 -- 172.21.15.45:0/1483537988 wait complete. 2024-09-15T22:19:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.942+0000 7f078a1fe740 20 client.15957 trim_cache size 0 max 16384 2024-09-15T22:19:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f078a1fe740 1 Processor -- start 2024-09-15T22:19:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f078a1fe740 1 -- start start 2024-09-15T22:19:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f078a1fe740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e060 0x55a9cdaae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f078a1fe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e980 0x55a9cdaae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f078a1fe740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda99240 0x55a9cda93480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f078a1fe740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f07801af2d0 con 0x55a9cda8e060 2024-09-15T22:19:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f078a1fe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f07801b1b50 con 0x55a9cda8e980 2024-09-15T22:19:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f078a1fe740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f07801af940 con 0x55a9cda99240 2024-09-15T22:19:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f07853c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e060 0x55a9cdaae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f07853c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e060 0x55a9cdaae120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45078/0 (socket says 172.21.15.45:45078) 2024-09-15T22:19:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f07853c0640 1 -- 172.21.15.45:0/3159505271 learned_addr learned my addr 172.21.15.45:0/3159505271 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f07853c0640 1 --2- 172.21.15.45:0/3159505271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda99240 0x55a9cda93480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f07853c0640 1 -- 172.21.15.45:0/3159505271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda99240 msgr2=0x55a9cda93480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f0785bc1640 1 --2- 172.21.15.45:0/3159505271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e980 0x55a9cdaae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f07853c0640 1 --2- 172.21.15.45:0/3159505271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda99240 0x55a9cda93480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f07853c0640 1 -- 172.21.15.45:0/3159505271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e980 msgr2=0x55a9cdaae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f07853c0640 1 --2- 172.21.15.45:0/3159505271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e980 0x55a9cdaae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.959+0000 7f07853c0640 1 -- 172.21.15.45:0/3159505271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9cda9b860 con 0x55a9cda8e060 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.960+0000 7f07853c0640 1 --2- 172.21.15.45:0/3159505271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e060 0x55a9cdaae120 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0770009630 tx=0x7f0770001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8241475d8e65caae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.960+0000 7f076b7fe640 1 -- 172.21.15.45:0/3159505271 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770042070 con 0x55a9cda8e060 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.960+0000 7f076b7fe640 1 -- 172.21.15.45:0/3159505271 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f077003e710 con 0x55a9cda8e060 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.960+0000 7f076b7fe640 1 -- 172.21.15.45:0/3159505271 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770035030 con 0x55a9cda8e060 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.960+0000 7f078a1fe740 1 -- 172.21.15.45:0/3159505271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e060 msgr2=0x55a9cdaae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.960+0000 7f078a1fe740 1 --2- 172.21.15.45:0/3159505271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e060 0x55a9cdaae120 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0770009630 tx=0x7f0770001e50 comp rx=0 tx=0).stop 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.960+0000 7f078a1fe740 1 -- 172.21.15.45:0/3159505271 shutdown_connections 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.960+0000 7f078a1fe740 1 --2- 172.21.15.45:0/3159505271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda99240 0x55a9cda93480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.960+0000 7f078a1fe740 1 --2- 172.21.15.45:0/3159505271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e980 0x55a9cdaae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.960+0000 7f078a1fe740 1 --2- 172.21.15.45:0/3159505271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e060 0x55a9cdaae120 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.960+0000 7f078a1fe740 1 -- 172.21.15.45:0/3159505271 >> 172.21.15.45:0/3159505271 conn(0x55a9cda8a5f0 msgr2=0x55a9cda97a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:00.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.960+0000 7f078a1fe740 1 -- 172.21.15.45:0/3159505271 shutdown_connections 2024-09-15T22:19:00.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.960+0000 7f078a1fe740 1 -- 172.21.15.45:0/3159505271 wait complete. 2024-09-15T22:19:00.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.961+0000 7f078a1fe740 1 -- start start 2024-09-15T22:19:00.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.961+0000 7f078a1fe740 1 Processor -- start 2024-09-15T22:19:00.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.961+0000 7f078a1fe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 0x55a9cdaacac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.961+0000 7f078a1fe740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e980 0x55a9cdaad000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.961+0000 7f078a1fe740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda99240 0x55a9cdaadf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.961+0000 7f078a1fe740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f07801b0010 con 0x55a9cda8e980 2024-09-15T22:19:00.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.961+0000 7f078a1fe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f07801b1480 con 0x55a9cda8e060 2024-09-15T22:19:00.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.961+0000 7f078a1fe740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f07801b06e0 con 0x55a9cda99240 2024-09-15T22:19:00.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.961+0000 7f078a1fe740 10 client.0 _ll_register_callbacks cb 0x7f0770031ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.961+0000 7f0785bc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e980 0x55a9cdaad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.961+0000 7f0785bc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e980 0x55a9cdaad000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45084/0 (socket says 172.21.15.45:45084) 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.961+0000 7f0785bc1640 1 -- 172.21.15.45:0/2623270118 learned_addr learned my addr 172.21.15.45:0/2623270118 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f07853c0640 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 0x55a9cdaacac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f07853c0640 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda99240 0x55a9cdaadf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f0785bc1640 1 -- 172.21.15.45:0/2623270118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda99240 msgr2=0x55a9cdaadf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f0785bc1640 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda99240 0x55a9cdaadf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f0785bc1640 1 -- 172.21.15.45:0/2623270118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 msgr2=0x55a9cdaacac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f0785bc1640 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 0x55a9cdaacac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f0785bc1640 1 -- 172.21.15.45:0/2623270118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9cdaae750 con 0x55a9cda8e980 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f07853c0640 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda99240 0x55a9cdaadf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f0785bc1640 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e980 0x55a9cdaad000 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x55a9cda8b450 tx=0x7f077c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834aded6c3ae7fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f07697fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f07697fa640 1 -- 172.21.15.45:0/2623270118 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077c01d830 con 0x55a9cda8e980 2024-09-15T22:19:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f07697fa640 1 -- 172.21.15.45:0/2623270118 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f077c01d9d0 con 0x55a9cda8e980 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f078a1fe740 1 -- 172.21.15.45:0/2623270118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f077003e710 con 0x55a9cda8e980 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f07697fa640 1 -- 172.21.15.45:0/2623270118 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f077c02c050 con 0x55a9cda8e980 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f078a1fe740 10 client.15963 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.962+0000 7f078a1fe740 1 -- 172.21.15.45:0/2623270118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a9cdb142e0 con 0x55a9cda8e980 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.963+0000 7f07697fa640 1 -- 172.21.15.45:0/2623270118 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f077003e710 con 0x55a9cda8e980 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.963+0000 7f07697fa640 1 -- 172.21.15.45:0/2623270118 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f077c01c430 con 0x55a9cda8e980 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.963+0000 7f078a1fe740 10 client.15963 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.963+0000 7f078a1fe740 10 client.15963 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.963+0000 7f078a1fe740 20 client.15963 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.963+0000 7f078a1fe740 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a9cdb14ae0 0x55a9cdb16f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.963+0000 7f078a1fe740 4 client.15963 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9a9863fc", "release": true, "await": true}] 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.963+0000 7f078a1fe740 1 -- 172.21.15.45:0/2623270118 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9a9863fc", "release": true, "await": true}) -- 0x55a9cd9fb0a0 con 0x55a9cdb14ae0 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.963+0000 7f07853c0640 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a9cdb14ae0 0x55a9cdb16f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.963+0000 7f07697fa640 10 client.15963 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:00.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:00.963+0000 7f07853c0640 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a9cdb14ae0 0x55a9cdb16f00 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50792a25c398fa21 server_cookie=f9b62f3e68da75d8 in_seq=0 out_seq=0 2024-09-15T22:19:01.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.124+0000 7f07697fa640 1 -- 172.21.15.45:0/2623270118 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55a9cd9fb0a0 con 0x55a9cdb14ae0 2024-09-15T22:19:01.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.124+0000 7f07697fa640 10 client.15963 handle_command_reply: tid=0 2024-09-15T22:19:01.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.124+0000 7f078a1fe740 1 client.15963 shutdown 2024-09-15T22:19:01.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.125+0000 7f078a1fe740 1 -- 172.21.15.45:0/2623270118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e980 msgr2=0x55a9cdaad000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:01.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.125+0000 7f078a1fe740 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e980 0x55a9cdaad000 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x55a9cda8b450 tx=0x7f077c0118d0 comp rx=0 tx=0).stop 2024-09-15T22:19:01.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.125+0000 7f078a1fe740 1 -- 172.21.15.45:0/2623270118 shutdown_connections 2024-09-15T22:19:01.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.125+0000 7f078a1fe740 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a9cdb14ae0 0x55a9cdb16f00 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:01.128 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:01 smithi045 ceph-mon[31180]: pgmap v86: 129 pgs: 129 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 2.3 MiB/s wr, 396 op/s 2024-09-15T22:19:01.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.125+0000 7f078a1fe740 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a9cda99240 0x55a9cdaadf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:01.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.125+0000 7f078a1fe740 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a9cda8e980 0x55a9cdaad000 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:01.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.125+0000 7f078a1fe740 1 --2- 172.21.15.45:0/2623270118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a9cda8e060 0x55a9cdaacac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:01.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.125+0000 7f078a1fe740 1 -- 172.21.15.45:0/2623270118 >> 172.21.15.45:0/2623270118 conn(0x55a9cda8a5f0 msgr2=0x55a9cda88f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:01.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.125+0000 7f07697fa640 0 client.15963 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:01.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.125+0000 7f078a1fe740 1 -- 172.21.15.45:0/2623270118 shutdown_connections 2024-09-15T22:19:01.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.125+0000 7f078a1fe740 1 -- 172.21.15.45:0/2623270118 wait complete. 2024-09-15T22:19:01.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.125+0000 7f078a1fe740 20 client.15963 trim_cache size 0 max 16384 2024-09-15T22:19:01.129 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:19:01.129 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 21, 2024-09-15T22:19:01.129 INFO:teuthology.orchestra.run.smithi045.stdout: "leader": 24476, 2024-09-15T22:19:01.129 INFO:teuthology.orchestra.run.smithi045.stdout: "set_version": 8, 2024-09-15T22:19:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "sets": { 2024-09-15T22:19:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "9a9863fc": { 2024-09-15T22:19:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "version": 8, 2024-09-15T22:19:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "age_ref": 0.0, 2024-09-15T22:19:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "state": { 2024-09-15T22:19:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RELEASED", 2024-09-15T22:19:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.0 2024-09-15T22:19:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:19:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "timeout": 90.0, 2024-09-15T22:19:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "expiration": 139.6, 2024-09-15T22:19:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "members": { 2024-09-15T22:19:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "file:/": { 2024-09-15T22:19:01.130 INFO:teuthology.orchestra.run.smithi045.stdout: "excluded": false, 2024-09-15T22:19:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: "state": { 2024-09-15T22:19:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RELEASED", 2024-09-15T22:19:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.0 2024-09-15T22:19:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:01.131 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:01.131 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:19:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.126+0000 7f0787e25640 1 -- 172.21.15.45:0/3526818469 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f076c0a33b0 msgr2=0x7f076c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.126+0000 7f0787e25640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f076c0a33b0 0x7f076c0a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f077809c420 tx=0x7f0778018720 comp rx=0 tx=0).stop 2024-09-15T22:19:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.126+0000 7f0787e25640 1 -- 172.21.15.45:0/3526818469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f078010c170 msgr2=0x7f0780101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.126+0000 7f0787e25640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f078010c170 0x7f0780101420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f077800cce0 tx=0x7f077800a620 comp rx=0 tx=0).stop 2024-09-15T22:19:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.126+0000 7f0787e25640 1 -- 172.21.15.45:0/3526818469 shutdown_connections 2024-09-15T22:19:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.126+0000 7f0787e25640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f076c0a33b0 0x7f076c0a5870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:01.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.126+0000 7f0787e25640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f078010c170 0x7f0780101420 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:01.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.126+0000 7f0787e25640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0780103660 0x7f0780100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:01.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.126+0000 7f0787e25640 1 --2- 172.21.15.45:0/3526818469 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0780102d40 0x7f07801009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:01.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.126+0000 7f0787e25640 1 -- 172.21.15.45:0/3526818469 >> 172.21.15.45:0/3526818469 conn(0x7f07800fc7a0 msgr2=0x7f07800fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:01.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.126+0000 7f0787e25640 1 -- 172.21.15.45:0/3526818469 shutdown_connections 2024-09-15T22:19:01.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:01.126+0000 7f0787e25640 1 -- 172.21.15.45:0/3526818469 wait complete. 2024-09-15T22:19:01.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:01 smithi165 ceph-mon[35551]: pgmap v86: 129 pgs: 129 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 2.3 MiB/s wr, 396 op/s 2024-09-15T22:19:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:01 smithi100 ceph-mon[35319]: pgmap v86: 129 pgs: 129 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 911 KiB/s rd, 2.3 MiB/s wr, 396 op/s 2024-09-15T22:19:01.922 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9a9863fc', total seconds elapsed: 23.3 2024-09-15T22:19:01.922 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.55 2024-09-15T22:19:01.922 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:19:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:02.588 INFO:tasks.workunit.client.0.smithi045.stderr:+ sync 2024-09-15T22:19:03.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.208+0000 7f104662f640 1 -- 172.21.15.45:0/1083527961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1040100e20 msgr2=0x7f1040101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.208+0000 7f104662f640 1 --2- 172.21.15.45:0/1083527961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1040100e20 0x7f1040101200 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1030009900 tx=0x7f103002a480 comp rx=0 tx=0).stop 2024-09-15T22:19:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.208+0000 7f104662f640 1 -- 172.21.15.45:0/1083527961 shutdown_connections 2024-09-15T22:19:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.208+0000 7f104662f640 1 --2- 172.21.15.45:0/1083527961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1040102ef0 0x7f104010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.208+0000 7f104662f640 1 --2- 172.21.15.45:0/1083527961 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1040102570 0x7f10401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.208+0000 7f104662f640 1 --2- 172.21.15.45:0/1083527961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1040100e20 0x7f1040101200 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.208+0000 7f104662f640 1 -- 172.21.15.45:0/1083527961 >> 172.21.15.45:0/1083527961 conn(0x7f10400fc7d0 msgr2=0x7f10400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.208+0000 7f104662f640 1 -- 172.21.15.45:0/1083527961 shutdown_connections 2024-09-15T22:19:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.208+0000 7f104662f640 1 -- 172.21.15.45:0/1083527961 wait complete. 2024-09-15T22:19:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.208+0000 7f104662f640 1 Processor -- start 2024-09-15T22:19:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.208+0000 7f104662f640 1 -- start start 2024-09-15T22:19:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f104662f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1040100e20 0x7f10401986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f104662f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1040102570 0x7f1040198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:03.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f104662f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1040102ef0 0x7f104019cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f104662f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f10401110e0 con 0x7f1040102570 2024-09-15T22:19:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f104662f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1040110f60 con 0x7f1040100e20 2024-09-15T22:19:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f104662f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1040111260 con 0x7f1040102ef0 2024-09-15T22:19:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f103f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1040102570 0x7f1040198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f103f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1040102570 0x7f1040198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45104/0 (socket says 172.21.15.45:45104) 2024-09-15T22:19:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f103f7fe640 1 -- 172.21.15.45:0/1695427921 learned_addr learned my addr 172.21.15.45:0/1695427921 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f103ffff640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1040100e20 0x7f10401986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f1044bcc640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1040102ef0 0x7f104019cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f103f7fe640 1 -- 172.21.15.45:0/1695427921 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1040102ef0 msgr2=0x7f104019cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f103f7fe640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1040102ef0 0x7f104019cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f103f7fe640 1 -- 172.21.15.45:0/1695427921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1040100e20 msgr2=0x7f10401986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f103f7fe640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1040100e20 0x7f10401986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:03.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f103f7fe640 1 -- 172.21.15.45:0/1695427921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104019d650 con 0x7f1040102570 2024-09-15T22:19:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.209+0000 7f103ffff640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1040100e20 0x7f10401986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.210+0000 7f103f7fe640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1040102570 0x7f1040198be0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f103400b4a0 tx=0x7f103400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.210+0000 7f103d7fa640 1 -- 172.21.15.45:0/1695427921 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034014070 con 0x7f1040102570 2024-09-15T22:19:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.210+0000 7f103d7fa640 1 -- 172.21.15.45:0/1695427921 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1034010b10 con 0x7f1040102570 2024-09-15T22:19:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.210+0000 7f104662f640 1 -- 172.21.15.45:0/1695427921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104019d940 con 0x7f1040102570 2024-09-15T22:19:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.210+0000 7f103d7fa640 1 -- 172.21.15.45:0/1695427921 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1034017d60 con 0x7f1040102570 2024-09-15T22:19:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.210+0000 7f104662f640 1 -- 172.21.15.45:0/1695427921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10401a5220 con 0x7f1040102570 2024-09-15T22:19:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.211+0000 7f104662f640 1 -- 172.21.15.45:0/1695427921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1040101200 con 0x7f1040102570 2024-09-15T22:19:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.212+0000 7f103d7fa640 1 -- 172.21.15.45:0/1695427921 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1034017070 con 0x7f1040102570 2024-09-15T22:19:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.213+0000 7f103d7fa640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10280a33b0 0x7f10280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.213+0000 7f103d7fa640 1 -- 172.21.15.45:0/1695427921 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f10340cf6c0 con 0x7f1040102570 2024-09-15T22:19:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.213+0000 7f103ffff640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10280a33b0 0x7f10280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:03.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.214+0000 7f103ffff640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10280a33b0 0x7f10280a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1030009230 tx=0x7f10300058d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:03.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.216+0000 7f103d7fa640 1 -- 172.21.15.45:0/1695427921 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f103409b740 con 0x7f1040102570 2024-09-15T22:19:03.237 INFO:tasks.workunit.client.0.smithi045.stderr:+ tar c linux-4.0.5 2024-09-15T22:19:03.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.434+0000 7f104662f640 1 -- 172.21.15.45:0/1695427921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f104010a0d0 con 0x7f1040102570 2024-09-15T22:19:03.436 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:03 smithi045 ceph-mon[31180]: pgmap v87: 129 pgs: 129 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2024-09-15T22:19:03.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.435+0000 7f103d7fa640 1 -- 172.21.15.45:0/1695427921 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f103409fa40 con 0x7f1040102570 2024-09-15T22:19:03.437 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:19:03.437 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:19:03.438 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:19:03.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.437+0000 7f104662f640 1 -- 172.21.15.45:0/1695427921 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10280a33b0 msgr2=0x7f10280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:03.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.437+0000 7f104662f640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10280a33b0 0x7f10280a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1030009230 tx=0x7f10300058d0 comp rx=0 tx=0).stop 2024-09-15T22:19:03.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.437+0000 7f104662f640 1 -- 172.21.15.45:0/1695427921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1040102570 msgr2=0x7f1040198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:03.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.437+0000 7f104662f640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1040102570 0x7f1040198be0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f103400b4a0 tx=0x7f103400b960 comp rx=0 tx=0).stop 2024-09-15T22:19:03.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.437+0000 7f104662f640 1 -- 172.21.15.45:0/1695427921 shutdown_connections 2024-09-15T22:19:03.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.437+0000 7f104662f640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10280a33b0 0x7f10280a5870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:03.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.437+0000 7f104662f640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1040102ef0 0x7f104019cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:03.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.437+0000 7f104662f640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1040102570 0x7f1040198be0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:03.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.437+0000 7f104662f640 1 --2- 172.21.15.45:0/1695427921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1040100e20 0x7f10401986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:03.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.437+0000 7f104662f640 1 -- 172.21.15.45:0/1695427921 >> 172.21.15.45:0/1695427921 conn(0x7f10400fc7d0 msgr2=0x7f104006a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:03.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.437+0000 7f104662f640 1 -- 172.21.15.45:0/1695427921 shutdown_connections 2024-09-15T22:19:03.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:03.437+0000 7f104662f640 1 -- 172.21.15.45:0/1695427921 wait complete. 2024-09-15T22:19:03.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:03 smithi165 ceph-mon[35551]: pgmap v87: 129 pgs: 129 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2024-09-15T22:19:03.482 INFO:tasks.workunit.client.0.smithi045.stdout:Ok 2024-09-15T22:19:03.483 INFO:tasks.workunit.client.0.smithi045.stderr:+ echo Ok 2024-09-15T22:19:03.484 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-15T22:19:03.484 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-15T22:19:03.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:03 smithi100 ceph-mon[35319]: pgmap v87: 129 pgs: 129 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 1.3 MiB/s wr, 119 op/s 2024-09-15T22:19:04.200 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0' 2024-09-15T22:19:04.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0 2024-09-15T22:19:04.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:04 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1695427921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:04.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:04 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1695427921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:04.513 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:04.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:04 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1695427921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:05.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.027+0000 7f4870fdd640 1 -- 172.21.15.45:0/2226540407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c106f10 msgr2=0x7f486c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:05.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.027+0000 7f4870fdd640 1 --2- 172.21.15.45:0/2226540407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c106f10 0x7f486c10ea90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4864009ca0 tx=0x7f486402a8c0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.027+0000 7f4870fdd640 1 -- 172.21.15.45:0/2226540407 shutdown_connections 2024-09-15T22:19:05.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.027+0000 7f4870fdd640 1 --2- 172.21.15.45:0/2226540407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c106f10 0x7f486c10ea90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.027+0000 7f4870fdd640 1 --2- 172.21.15.45:0/2226540407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f486c102790 0x7f486c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.027+0000 7f4870fdd640 1 --2- 172.21.15.45:0/2226540407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f486c101de0 0x7f486c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.027+0000 7f4870fdd640 1 -- 172.21.15.45:0/2226540407 >> 172.21.15.45:0/2226540407 conn(0x7f486c0fd8c0 msgr2=0x7f486c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:05.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.027+0000 7f4870fdd640 1 -- 172.21.15.45:0/2226540407 shutdown_connections 2024-09-15T22:19:05.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.027+0000 7f4870fdd640 1 -- 172.21.15.45:0/2226540407 wait complete. 2024-09-15T22:19:05.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.027+0000 7f4870fdd640 1 Processor -- start 2024-09-15T22:19:05.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f4870fdd640 1 -- start start 2024-09-15T22:19:05.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f4870fdd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f486c101de0 0x7f486c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f4870fdd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c102790 0x7f486c1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f4870fdd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f486c106f10 0x7f486c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f4870fdd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f486c112090 con 0x7f486c102790 2024-09-15T22:19:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f4870fdd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f486c111f10 con 0x7f486c106f10 2024-09-15T22:19:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f4870fdd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f486c112210 con 0x7f486c101de0 2024-09-15T22:19:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f4869d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c102790 0x7f486c1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f486ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f486c106f10 0x7f486c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f4869d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c102790 0x7f486c1989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35412/0 (socket says 172.21.15.45:35412) 2024-09-15T22:19:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f486a59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f486c101de0 0x7f486c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f4869d9b640 1 -- 172.21.15.45:0/595745428 learned_addr learned my addr 172.21.15.45:0/595745428 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f486ad9d640 1 -- 172.21.15.45:0/595745428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f486c101de0 msgr2=0x7f486c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f486ad9d640 1 --2- 172.21.15.45:0/595745428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f486c101de0 0x7f486c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f486ad9d640 1 -- 172.21.15.45:0/595745428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c102790 msgr2=0x7f486c1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:05.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f486ad9d640 1 --2- 172.21.15.45:0/595745428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c102790 0x7f486c1989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.028+0000 7f486ad9d640 1 -- 172.21.15.45:0/595745428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486c19d450 con 0x7f486c106f10 2024-09-15T22:19:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.029+0000 7f486ad9d640 1 --2- 172.21.15.45:0/595745428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f486c106f10 0x7f486c19cd70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f486402ade0 tx=0x7f48640319f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.029+0000 7f485b7fe640 1 -- 172.21.15.45:0/595745428 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864003b70 con 0x7f486c106f10 2024-09-15T22:19:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.029+0000 7f4870fdd640 1 -- 172.21.15.45:0/595745428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486c19d6e0 con 0x7f486c106f10 2024-09-15T22:19:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.029+0000 7f485b7fe640 1 -- 172.21.15.45:0/595745428 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4864003d10 con 0x7f486c106f10 2024-09-15T22:19:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.029+0000 7f485b7fe640 1 -- 172.21.15.45:0/595745428 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486402fc10 con 0x7f486c106f10 2024-09-15T22:19:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.029+0000 7f4870fdd640 1 -- 172.21.15.45:0/595745428 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f486c1a5020 con 0x7f486c106f10 2024-09-15T22:19:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.031+0000 7f48733b6740 1 Processor -- start 2024-09-15T22:19:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.031+0000 7f485b7fe640 1 -- 172.21.15.45:0/595745428 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4864004050 con 0x7f486c106f10 2024-09-15T22:19:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f48733b6740 1 -- start start 2024-09-15T22:19:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f48733b6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f22850 0x55b1a2f22c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f48733b6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f23170 0x55b1a2f2d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f48733b6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f2da30 0x55b1a2f2fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f48733b6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b1a2e87160 con 0x55b1a2f2da30 2024-09-15T22:19:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f48733b6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b1a2e2e720 con 0x55b1a2f22850 2024-09-15T22:19:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f48733b6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b1a2e83120 con 0x55b1a2f23170 2024-09-15T22:19:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f4869d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f22850 0x55b1a2f22c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f4869d9b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f22850 0x55b1a2f22c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:58940/0 (socket says 172.21.15.45:58940) 2024-09-15T22:19:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f4869d9b640 1 -- 172.21.15.45:0/774311555 learned_addr learned my addr 172.21.15.45:0/774311555 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f4869d9b640 1 --2- 172.21.15.45:0/774311555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f2da30 0x55b1a2f2fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f486a59c640 1 --2- 172.21.15.45:0/774311555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f23170 0x55b1a2f2d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f4869d9b640 1 -- 172.21.15.45:0/774311555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f23170 msgr2=0x55b1a2f2d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f4869d9b640 1 --2- 172.21.15.45:0/774311555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f23170 0x55b1a2f2d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f485b7fe640 1 --2- 172.21.15.45:0/595745428 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f48540a33b0 0x7f48540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f4869d9b640 1 -- 172.21.15.45:0/774311555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f2da30 msgr2=0x55b1a2f2fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:05.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f4869d9b640 1 --2- 172.21.15.45:0/774311555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f2da30 0x55b1a2f2fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.032+0000 7f4869d9b640 1 -- 172.21.15.45:0/774311555 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1a2bf8ba0 con 0x55b1a2f22850 2024-09-15T22:19:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.033+0000 7f486ad9d640 1 --2- 172.21.15.45:0/595745428 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f48540a33b0 0x7f48540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.033+0000 7f4869d9b640 1 --2- 172.21.15.45:0/774311555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f22850 0x55b1a2f22c30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4860011740 tx=0x7f486000a6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e260152f1aa0e6ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.033+0000 7f485b7fe640 1 -- 172.21.15.45:0/595745428 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f48640f10e0 con 0x7f486c106f10 2024-09-15T22:19:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.033+0000 7f4858ff9640 1 -- 172.21.15.45:0/774311555 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860004020 con 0x55b1a2f22850 2024-09-15T22:19:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.033+0000 7f4858ff9640 1 -- 172.21.15.45:0/774311555 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4860005520 con 0x55b1a2f22850 2024-09-15T22:19:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.033+0000 7f4858ff9640 1 -- 172.21.15.45:0/774311555 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4860004d00 con 0x55b1a2f22850 2024-09-15T22:19:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 -- 172.21.15.45:0/774311555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f22850 msgr2=0x55b1a2f22c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f486ad9d640 1 --2- 172.21.15.45:0/595745428 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f48540a33b0 0x7f48540a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48640ee630 tx=0x7f4864049000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 --2- 172.21.15.45:0/774311555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f22850 0x55b1a2f22c30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4860011740 tx=0x7f486000a6e0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 -- 172.21.15.45:0/774311555 shutdown_connections 2024-09-15T22:19:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 --2- 172.21.15.45:0/774311555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f2da30 0x55b1a2f2fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 --2- 172.21.15.45:0/774311555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f23170 0x55b1a2f2d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 --2- 172.21.15.45:0/774311555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f22850 0x55b1a2f22c30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 -- 172.21.15.45:0/774311555 >> 172.21.15.45:0/774311555 conn(0x55b1a2f1ede0 msgr2=0x55b1a2f1f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 -- 172.21.15.45:0/774311555 shutdown_connections 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 -- 172.21.15.45:0/774311555 wait complete. 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 -- start start 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 Processor -- start 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f22850 0x55b1a2f2a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f23170 0x55b1a2f2af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f2da30 0x55b1a2f2b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b1a2f30600 con 0x55b1a2f2da30 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b1a2e0f900 con 0x55b1a2f22850 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.034+0000 7f48733b6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b1a2f30780 con 0x55b1a2f23170 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f48733b6740 10 client.0 _ll_register_callbacks cb 0x55b1a2e0d780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:05.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f4869d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f2da30 0x55b1a2f2b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f486a59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f23170 0x55b1a2f2af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f486a59c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f23170 0x55b1a2f2af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:44690/0 (socket says 172.21.15.45:44690) 2024-09-15T22:19:05.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f4869d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f2da30 0x55b1a2f2b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35436/0 (socket says 172.21.15.45:35436) 2024-09-15T22:19:05.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f486a59c640 1 -- 172.21.15.45:0/3090355611 learned_addr learned my addr 172.21.15.45:0/3090355611 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:05.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f4869d9b640 1 --2- 172.21.15.45:0/3090355611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f22850 0x55b1a2f2a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f486a59c640 1 -- 172.21.15.45:0/3090355611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f22850 msgr2=0x55b1a2f2a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:05.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f486a59c640 1 --2- 172.21.15.45:0/3090355611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f22850 0x55b1a2f2a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f486a59c640 1 -- 172.21.15.45:0/3090355611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f2da30 msgr2=0x55b1a2f2b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:05.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f486a59c640 1 --2- 172.21.15.45:0/3090355611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f2da30 0x55b1a2f2b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f486a59c640 1 -- 172.21.15.45:0/3090355611 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1a2e4fc50 con 0x55b1a2f23170 2024-09-15T22:19:05.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f4869d9b640 1 --2- 172.21.15.45:0/3090355611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f22850 0x55b1a2f2a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:05.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f486a59c640 1 --2- 172.21.15.45:0/3090355611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f23170 0x55b1a2f2af10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f485c012740 tx=0x7f485c012c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9161151cb40c2bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f4851ffb640 10 client.0 ms_handle_connect on v2:172.21.15.165:3300/0 2024-09-15T22:19:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f4851ffb640 1 -- 172.21.15.45:0/3090355611 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c00f920 con 0x55b1a2f23170 2024-09-15T22:19:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f4851ffb640 1 -- 172.21.15.45:0/3090355611 <== mon.1 v2:172.21.15.165:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f485c00fac0 con 0x55b1a2f23170 2024-09-15T22:19:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.035+0000 7f48733b6740 1 -- 172.21.15.45:0/3090355611 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4860005520 con 0x55b1a2f23170 2024-09-15T22:19:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.036+0000 7f4851ffb640 1 -- 172.21.15.45:0/3090355611 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f485c00fcc0 con 0x55b1a2f23170 2024-09-15T22:19:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.036+0000 7f48733b6740 10 client.25498 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.036+0000 7f48733b6740 1 -- 172.21.15.45:0/3090355611 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b1a2f3c3b0 con 0x55b1a2f23170 2024-09-15T22:19:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.036+0000 7f4851ffb640 1 -- 172.21.15.45:0/3090355611 <== mon.1 v2:172.21.15.165:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4860005520 con 0x55b1a2f23170 2024-09-15T22:19:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.036+0000 7f4851ffb640 1 -- 172.21.15.45:0/3090355611 <== mon.1 v2:172.21.15.165:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f485c01c420 con 0x55b1a2f23170 2024-09-15T22:19:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.036+0000 7f48733b6740 10 client.25498 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.036+0000 7f48733b6740 10 client.25498 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:19:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.036+0000 7f48733b6740 20 client.25498 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:05.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.036+0000 7f48733b6740 1 --2- 172.21.15.45:0/3090355611 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b1a2f3d910 0x55b1a2f3fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.036+0000 7f48733b6740 4 client.25498 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.036+0000 7f48733b6740 1 -- 172.21.15.45:0/3090355611 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1a2e94890 con 0x55b1a2f3d910 2024-09-15T22:19:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.036+0000 7f4869d9b640 1 --2- 172.21.15.45:0/3090355611 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b1a2f3d910 0x55b1a2f3fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.037+0000 7f4869d9b640 1 --2- 172.21.15.45:0/3090355611 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b1a2f3d910 0x55b1a2f3fd30 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9beb6a1189560909 server_cookie=2b5b63624c469019 in_seq=0 out_seq=0 2024-09-15T22:19:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.037+0000 7f4851ffb640 10 client.25498 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f4851ffb640 1 -- 172.21.15.45:0/3090355611 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b1a2e94890 con 0x55b1a2f3d910 2024-09-15T22:19:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f4851ffb640 10 client.25498 handle_command_reply: tid=0 2024-09-15T22:19:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f48733b6740 1 client.25498 shutdown 2024-09-15T22:19:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f48733b6740 1 -- 172.21.15.45:0/3090355611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f23170 msgr2=0x55b1a2f2af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f48733b6740 1 --2- 172.21.15.45:0/3090355611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f23170 0x55b1a2f2af10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f485c012740 tx=0x7f485c012c00 comp rx=0 tx=0).stop 2024-09-15T22:19:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f48733b6740 1 -- 172.21.15.45:0/3090355611 shutdown_connections 2024-09-15T22:19:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f48733b6740 1 --2- 172.21.15.45:0/3090355611 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b1a2f3d910 0x55b1a2f3fd30 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f48733b6740 1 --2- 172.21.15.45:0/3090355611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f2da30 0x55b1a2f2b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f48733b6740 1 --2- 172.21.15.45:0/3090355611 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f23170 0x55b1a2f2af10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f4851ffb640 0 client.25498 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:05.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f48733b6740 1 --2- 172.21.15.45:0/3090355611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f22850 0x55b1a2f2a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f48733b6740 1 -- 172.21.15.45:0/3090355611 >> 172.21.15.45:0/3090355611 conn(0x55b1a2f1ede0 msgr2=0x55b1a2f24ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:05.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f48733b6740 1 -- 172.21.15.45:0/3090355611 shutdown_connections 2024-09-15T22:19:05.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f48733b6740 1 -- 172.21.15.45:0/3090355611 wait complete. 2024-09-15T22:19:05.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.038+0000 7f48733b6740 20 client.25498 trim_cache size 0 max 16384 2024-09-15T22:19:05.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.056+0000 7f48733b6740 1 Processor -- start 2024-09-15T22:19:05.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.056+0000 7f48733b6740 1 -- start start 2024-09-15T22:19:05.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.056+0000 7f48733b6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f22850 0x55b1a2f29930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.056+0000 7f48733b6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f23170 0x55b1a2f455e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.056+0000 7f48733b6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f2da30 0x55b1a2f45b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.056+0000 7f48733b6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f486c1ad100 con 0x55b1a2f23170 2024-09-15T22:19:05.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.056+0000 7f48733b6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f486c1af980 con 0x55b1a2f2da30 2024-09-15T22:19:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.056+0000 7f48733b6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f486c1ad770 con 0x55b1a2f22850 2024-09-15T22:19:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.056+0000 7f486a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f23170 0x55b1a2f455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.056+0000 7f486a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f23170 0x55b1a2f455e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35444/0 (socket says 172.21.15.45:35444) 2024-09-15T22:19:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.056+0000 7f486a59c640 1 -- 172.21.15.45:0/1841781876 learned_addr learned my addr 172.21.15.45:0/1841781876 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.056+0000 7f4869d9b640 1 --2- 172.21.15.45:0/1841781876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f2da30 0x55b1a2f45b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.057+0000 7f4869d9b640 1 --2- 172.21.15.45:0/1841781876 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f22850 0x55b1a2f29930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.057+0000 7f486a59c640 1 -- 172.21.15.45:0/1841781876 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f22850 msgr2=0x55b1a2f29930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.057+0000 7f486a59c640 1 --2- 172.21.15.45:0/1841781876 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f22850 0x55b1a2f29930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.057+0000 7f486a59c640 1 -- 172.21.15.45:0/1841781876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f2da30 msgr2=0x55b1a2f45b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.057+0000 7f486a59c640 1 --2- 172.21.15.45:0/1841781876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f2da30 0x55b1a2f45b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.057+0000 7f486a59c640 1 -- 172.21.15.45:0/1841781876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1a2f1a3f0 con 0x55b1a2f23170 2024-09-15T22:19:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.057+0000 7f486a59c640 1 --2- 172.21.15.45:0/1841781876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f23170 0x55b1a2f455e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f485c01c910 tx=0x7f485c0096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46003d795b87fe60 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:05.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.057+0000 7f4853fff640 1 -- 172.21.15.45:0/1841781876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c009ea0 con 0x55b1a2f23170 2024-09-15T22:19:05.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.057+0000 7f4853fff640 1 -- 172.21.15.45:0/1841781876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f485c012e50 con 0x55b1a2f23170 2024-09-15T22:19:05.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.057+0000 7f4853fff640 1 -- 172.21.15.45:0/1841781876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c005440 con 0x55b1a2f23170 2024-09-15T22:19:05.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 -- 172.21.15.45:0/1841781876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f23170 msgr2=0x55b1a2f455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:05.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 --2- 172.21.15.45:0/1841781876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f23170 0x55b1a2f455e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f485c01c910 tx=0x7f485c0096f0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 -- 172.21.15.45:0/1841781876 shutdown_connections 2024-09-15T22:19:05.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 --2- 172.21.15.45:0/1841781876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f2da30 0x55b1a2f45b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 --2- 172.21.15.45:0/1841781876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f23170 0x55b1a2f455e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 --2- 172.21.15.45:0/1841781876 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f22850 0x55b1a2f29930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 -- 172.21.15.45:0/1841781876 >> 172.21.15.45:0/1841781876 conn(0x55b1a2f1ede0 msgr2=0x55b1a2f2ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:05.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 -- 172.21.15.45:0/1841781876 shutdown_connections 2024-09-15T22:19:05.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 -- 172.21.15.45:0/1841781876 wait complete. 2024-09-15T22:19:05.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 -- start start 2024-09-15T22:19:05.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 Processor -- start 2024-09-15T22:19:05.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f22850 0x55b1a2f35c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f23170 0x55b1a2f361a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f2da30 0x55b1a2f329e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f486c1ade40 con 0x55b1a2f22850 2024-09-15T22:19:05.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f486c1af2b0 con 0x55b1a2f23170 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.058+0000 7f48733b6740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f486c1ae510 con 0x55b1a2f2da30 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f48733b6740 10 client.0 _ll_register_callbacks cb 0x7f485c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f4869d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f22850 0x55b1a2f35c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f4869d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f22850 0x55b1a2f35c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35448/0 (socket says 172.21.15.45:35448) 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f486a59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f23170 0x55b1a2f361a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f4869d9b640 1 -- 172.21.15.45:0/283216168 learned_addr learned my addr 172.21.15.45:0/283216168 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f4869d9b640 1 --2- 172.21.15.45:0/283216168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f2da30 0x55b1a2f329e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f4869d9b640 1 -- 172.21.15.45:0/283216168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f2da30 msgr2=0x55b1a2f329e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f4869d9b640 1 --2- 172.21.15.45:0/283216168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f2da30 0x55b1a2f329e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f4869d9b640 1 -- 172.21.15.45:0/283216168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f23170 msgr2=0x55b1a2f361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f4869d9b640 1 --2- 172.21.15.45:0/283216168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f23170 0x55b1a2f361a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f4869d9b640 1 -- 172.21.15.45:0/283216168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1a2f33210 con 0x55b1a2f22850 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f486a59c640 1 --2- 172.21.15.45:0/283216168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f23170 0x55b1a2f361a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:05.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f4869d9b640 1 --2- 172.21.15.45:0/283216168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f22850 0x55b1a2f35c60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4860004950 tx=0x7f4860016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f0043ff78fb697 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f4851ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f4851ffb640 1 -- 172.21.15.45:0/283216168 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486003d060 con 0x55b1a2f22850 2024-09-15T22:19:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f4851ffb640 1 -- 172.21.15.45:0/283216168 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f4860011040 con 0x55b1a2f22850 2024-09-15T22:19:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.059+0000 7f48733b6740 1 -- 172.21.15.45:0/283216168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f485c012e50 con 0x55b1a2f22850 2024-09-15T22:19:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.060+0000 7f4851ffb640 1 -- 172.21.15.45:0/283216168 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4860027040 con 0x55b1a2f22850 2024-09-15T22:19:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.060+0000 7f48733b6740 10 client.15987 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.060+0000 7f48733b6740 1 -- 172.21.15.45:0/283216168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b1a2fa9100 con 0x55b1a2f22850 2024-09-15T22:19:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.060+0000 7f4851ffb640 1 -- 172.21.15.45:0/283216168 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f485c012e50 con 0x55b1a2f22850 2024-09-15T22:19:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.060+0000 7f4851ffb640 1 -- 172.21.15.45:0/283216168 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f486002d040 con 0x55b1a2f22850 2024-09-15T22:19:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.060+0000 7f48733b6740 10 client.15987 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.060+0000 7f48733b6740 10 client.15987 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:19:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.060+0000 7f48733b6740 20 client.15987 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:05.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.060+0000 7f48733b6740 1 --2- 172.21.15.45:0/283216168 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b1a2fa95f0 0x55b1a2fab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:05.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.060+0000 7f48733b6740 4 client.15987 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}] 2024-09-15T22:19:05.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.060+0000 7f48733b6740 1 -- 172.21.15.45:0/283216168 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}) -- 0x55b1a2e8ebe0 con 0x55b1a2fa95f0 2024-09-15T22:19:05.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.060+0000 7f486a59c640 1 --2- 172.21.15.45:0/283216168 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b1a2fa95f0 0x55b1a2fab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:05.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.061+0000 7f4851ffb640 10 client.15987 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:05.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:05.061+0000 7f486a59c640 1 --2- 172.21.15.45:0/283216168 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b1a2fa95f0 0x55b1a2fab9e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58c09330b2fe00cd server_cookie=73c584a689fb4aa0 in_seq=0 out_seq=0 2024-09-15T22:19:05.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:05 smithi045 ceph-mon[31180]: pgmap v88: 129 pgs: 129 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 1.8 MiB/s wr, 164 op/s 2024-09-15T22:19:05.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:05 smithi165 ceph-mon[35551]: pgmap v88: 129 pgs: 129 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 1.8 MiB/s wr, 164 op/s 2024-09-15T22:19:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:05 smithi100 ceph-mon[35319]: pgmap v88: 129 pgs: 129 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 1.8 MiB/s wr, 164 op/s 2024-09-15T22:19:06.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f4851ffb640 1 -- 172.21.15.45:0/283216168 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b1a2e8ebe0 con 0x55b1a2fa95f0 2024-09-15T22:19:06.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f4851ffb640 10 client.15987 handle_command_reply: tid=0 2024-09-15T22:19:06.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f48733b6740 1 client.15987 shutdown 2024-09-15T22:19:06.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f48733b6740 1 -- 172.21.15.45:0/283216168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f22850 msgr2=0x55b1a2f35c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:06.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f48733b6740 1 --2- 172.21.15.45:0/283216168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f22850 0x55b1a2f35c60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4860004950 tx=0x7f4860016040 comp rx=0 tx=0).stop 2024-09-15T22:19:06.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f48733b6740 1 -- 172.21.15.45:0/283216168 shutdown_connections 2024-09-15T22:19:06.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f48733b6740 1 --2- 172.21.15.45:0/283216168 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b1a2fa95f0 0x55b1a2fab9e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:06.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f48733b6740 1 --2- 172.21.15.45:0/283216168 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b1a2f2da30 0x55b1a2f329e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:06.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f48733b6740 1 --2- 172.21.15.45:0/283216168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b1a2f23170 0x55b1a2f361a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:06.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f4851ffb640 0 client.15987 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:06.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f48733b6740 1 --2- 172.21.15.45:0/283216168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b1a2f22850 0x55b1a2f35c60 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:06.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f48733b6740 1 -- 172.21.15.45:0/283216168 >> 172.21.15.45:0/283216168 conn(0x55b1a2f1ede0 msgr2=0x55b1a2f1d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:06.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f48733b6740 1 -- 172.21.15.45:0/283216168 shutdown_connections 2024-09-15T22:19:06.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f48733b6740 1 -- 172.21.15.45:0/283216168 wait complete. 2024-09-15T22:19:06.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.747+0000 7f48733b6740 20 client.15987 trim_cache size 0 max 16384 2024-09-15T22:19:06.751 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:19:06.751 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 21, 2024-09-15T22:19:06.751 INFO:teuthology.orchestra.run.smithi045.stdout: "leader": 24476, 2024-09-15T22:19:06.751 INFO:teuthology.orchestra.run.smithi045.stdout: "set_version": 10, 2024-09-15T22:19:06.751 INFO:teuthology.orchestra.run.smithi045.stdout: "sets": { 2024-09-15T22:19:06.751 INFO:teuthology.orchestra.run.smithi045.stdout: "51ff3c14": { 2024-09-15T22:19:06.752 INFO:teuthology.orchestra.run.smithi045.stdout: "version": 10, 2024-09-15T22:19:06.752 INFO:teuthology.orchestra.run.smithi045.stdout: "age_ref": 0.0, 2024-09-15T22:19:06.752 INFO:teuthology.orchestra.run.smithi045.stdout: "state": { 2024-09-15T22:19:06.752 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "QUIESCED", 2024-09-15T22:19:06.752 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.0 2024-09-15T22:19:06.752 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:19:06.752 INFO:teuthology.orchestra.run.smithi045.stdout: "timeout": 90.0, 2024-09-15T22:19:06.752 INFO:teuthology.orchestra.run.smithi045.stdout: "expiration": 139.6, 2024-09-15T22:19:06.752 INFO:teuthology.orchestra.run.smithi045.stdout: "members": { 2024-09-15T22:19:06.752 INFO:teuthology.orchestra.run.smithi045.stdout: "file:/": { 2024-09-15T22:19:06.752 INFO:teuthology.orchestra.run.smithi045.stdout: "excluded": false, 2024-09-15T22:19:06.752 INFO:teuthology.orchestra.run.smithi045.stdout: "state": { 2024-09-15T22:19:06.752 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "QUIESCED", 2024-09-15T22:19:06.753 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.0 2024-09-15T22:19:06.753 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:06.753 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:06.753 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:06.753 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:06.753 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:06.753 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:19:06.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.748+0000 7f4870fdd640 1 -- 172.21.15.45:0/595745428 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f48540a33b0 msgr2=0x7f48540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:06.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.748+0000 7f4870fdd640 1 --2- 172.21.15.45:0/595745428 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f48540a33b0 0x7f48540a5870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f48640ee630 tx=0x7f4864049000 comp rx=0 tx=0).stop 2024-09-15T22:19:06.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.748+0000 7f4870fdd640 1 -- 172.21.15.45:0/595745428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f486c106f10 msgr2=0x7f486c19cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:06.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.748+0000 7f4870fdd640 1 --2- 172.21.15.45:0/595745428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f486c106f10 0x7f486c19cd70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f486402ade0 tx=0x7f48640319f0 comp rx=0 tx=0).stop 2024-09-15T22:19:06.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.748+0000 7f4870fdd640 1 -- 172.21.15.45:0/595745428 shutdown_connections 2024-09-15T22:19:06.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.748+0000 7f4870fdd640 1 --2- 172.21.15.45:0/595745428 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f48540a33b0 0x7f48540a5870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:06.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.748+0000 7f4870fdd640 1 --2- 172.21.15.45:0/595745428 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f486c106f10 0x7f486c19cd70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:06.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.748+0000 7f4870fdd640 1 --2- 172.21.15.45:0/595745428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f486c102790 0x7f486c1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:06.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.748+0000 7f4870fdd640 1 --2- 172.21.15.45:0/595745428 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f486c101de0 0x7f486c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:06.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.748+0000 7f4870fdd640 1 -- 172.21.15.45:0/595745428 >> 172.21.15.45:0/595745428 conn(0x7f486c0fd8c0 msgr2=0x7f486c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:06.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.748+0000 7f4870fdd640 1 -- 172.21.15.45:0/595745428 shutdown_connections 2024-09-15T22:19:06.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:06.748+0000 7f4870fdd640 1 -- 172.21.15.45:0/595745428 wait complete. 2024-09-15T22:19:06.955 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:19:07.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:07 smithi165 ceph-mon[35551]: pgmap v89: 129 pgs: 129 active+clean; 262 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 2.1 MiB/s wr, 202 op/s 2024-09-15T22:19:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:07 smithi100 ceph-mon[35319]: pgmap v89: 129 pgs: 129 active+clean; 262 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 2.1 MiB/s wr, 202 op/s 2024-09-15T22:19:07.534 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:07 smithi045 ceph-mon[31180]: pgmap v89: 129 pgs: 129 active+clean; 262 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 2.1 MiB/s wr, 202 op/s 2024-09-15T22:19:07.561 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '51ff3c14', quiesce took 5.6 seconds. Will release after: 13.950000000000001 2024-09-15T22:19:07.646 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:08.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.153+0000 7fb92d59a640 1 -- 172.21.15.45:0/2513275107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb928102790 msgr2=0x7fb9281067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:08.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.153+0000 7fb92d59a640 1 --2- 172.21.15.45:0/2513275107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb928102790 0x7fb9281067e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb910009900 tx=0x7fb91002a410 comp rx=0 tx=0).stop 2024-09-15T22:19:08.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.153+0000 7fb92d59a640 1 -- 172.21.15.45:0/2513275107 shutdown_connections 2024-09-15T22:19:08.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.153+0000 7fb92d59a640 1 --2- 172.21.15.45:0/2513275107 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb928106f10 0x7fb92810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.153+0000 7fb92d59a640 1 --2- 172.21.15.45:0/2513275107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb928102790 0x7fb9281067e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.153+0000 7fb92d59a640 1 --2- 172.21.15.45:0/2513275107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb928101de0 0x7fb9281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.153+0000 7fb92d59a640 1 -- 172.21.15.45:0/2513275107 >> 172.21.15.45:0/2513275107 conn(0x7fb9280fd8c0 msgr2=0x7fb9280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:08.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.153+0000 7fb92d59a640 1 -- 172.21.15.45:0/2513275107 shutdown_connections 2024-09-15T22:19:08.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.153+0000 7fb92d59a640 1 -- 172.21.15.45:0/2513275107 wait complete. 2024-09-15T22:19:08.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.153+0000 7fb92d59a640 1 Processor -- start 2024-09-15T22:19:08.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb92d59a640 1 -- start start 2024-09-15T22:19:08.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb92d59a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb928101de0 0x7fb9280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb92d59a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb928102790 0x7fb928074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb92d59a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb928106f10 0x7fb928074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb92d59a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281120d0 con 0x7fb928101de0 2024-09-15T22:19:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb92d59a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb928111f50 con 0x7fb928102790 2024-09-15T22:19:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb92d59a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb928112250 con 0x7fb928106f10 2024-09-15T22:19:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb926ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb928101de0 0x7fb9280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb926ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb928101de0 0x7fb9280744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35470/0 (socket says 172.21.15.45:35470) 2024-09-15T22:19:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb926ffd640 1 -- 172.21.15.45:0/1407486073 learned_addr learned my addr 172.21.15.45:0/1407486073 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb9277fe640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb928106f10 0x7fb928074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb91e7fc640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb928102790 0x7fb928074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb926ffd640 1 -- 172.21.15.45:0/1407486073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb928106f10 msgr2=0x7fb928074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:08.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb926ffd640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb928106f10 0x7fb928074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb926ffd640 1 -- 172.21.15.45:0/1407486073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb928102790 msgr2=0x7fb928074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb926ffd640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb928102790 0x7fb928074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb926ffd640 1 -- 172.21.15.45:0/1407486073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9281a69f0 con 0x7fb928101de0 2024-09-15T22:19:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.154+0000 7fb926ffd640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb928101de0 0x7fb9280744f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb91800d950 tx=0x7fb91800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.155+0000 7fb924ff9640 1 -- 172.21.15.45:0/1407486073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918017070 con 0x7fb928101de0 2024-09-15T22:19:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.155+0000 7fb924ff9640 1 -- 172.21.15.45:0/1407486073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb918009c30 con 0x7fb928101de0 2024-09-15T22:19:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.155+0000 7fb92d59a640 1 -- 172.21.15.45:0/1407486073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9281a6ce0 con 0x7fb928101de0 2024-09-15T22:19:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.155+0000 7fb924ff9640 1 -- 172.21.15.45:0/1407486073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91800f740 con 0x7fb928101de0 2024-09-15T22:19:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.155+0000 7fb92d59a640 1 -- 172.21.15.45:0/1407486073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9281a71a0 con 0x7fb928101de0 2024-09-15T22:19:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.157+0000 7fb924ff9640 1 -- 172.21.15.45:0/1407486073 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb918010a80 con 0x7fb928101de0 2024-09-15T22:19:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.157+0000 7fb92f973740 1 Processor -- start 2024-09-15T22:19:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.157+0000 7fb92f973740 1 -- start start 2024-09-15T22:19:08.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb92f973740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d37880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb92f973740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d42140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb92f973740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 0x55b498d44a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb92f973740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b498c9d2e0 con 0x55b498d37dc0 2024-09-15T22:19:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb92f973740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b498c44ce0 con 0x55b498d42680 2024-09-15T22:19:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb92f973740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b498c992a0 con 0x55b498d374a0 2024-09-15T22:19:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb926ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d42140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb926ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d42140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35476/0 (socket says 172.21.15.45:35476) 2024-09-15T22:19:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb926ffd640 1 -- 172.21.15.45:0/3677549054 learned_addr learned my addr 172.21.15.45:0/3677549054 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb9277fe640 1 --2- 172.21.15.45:0/3677549054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d37880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb924ff9640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb9140a33b0 0x7fb9140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb91e7fc640 1 --2- 172.21.15.45:0/3677549054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 0x55b498d44a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb9277fe640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb9140a33b0 0x7fb9140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb924ff9640 1 -- 172.21.15.45:0/1407486073 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fb9180cfd20 con 0x7fb928101de0 2024-09-15T22:19:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb926ffd640 1 -- 172.21.15.45:0/3677549054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 msgr2=0x55b498d37880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb926ffd640 1 --2- 172.21.15.45:0/3677549054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d37880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb926ffd640 1 -- 172.21.15.45:0/3677549054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 msgr2=0x55b498d44a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb926ffd640 1 --2- 172.21.15.45:0/3677549054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 0x55b498d44a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb926ffd640 1 -- 172.21.15.45:0/3677549054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b498c29440 con 0x55b498d37dc0 2024-09-15T22:19:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb9277fe640 1 --2- 172.21.15.45:0/3677549054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d37880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.158+0000 7fb91e7fc640 1 --2- 172.21.15.45:0/3677549054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 0x55b498d44a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.159+0000 7fb926ffd640 1 --2- 172.21.15.45:0/3677549054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d42140 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb9180ccf90 tx=0x7fb91800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6104336cb1890e9f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.159+0000 7fb91d7fa640 1 -- 172.21.15.45:0/3677549054 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb918020070 con 0x55b498d37dc0 2024-09-15T22:19:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.159+0000 7fb9277fe640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb9140a33b0 0x7fb9140a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb920009fd0 tx=0x7fb920004a40 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.159+0000 7fb91d7fa640 1 -- 172.21.15.45:0/3677549054 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb918009de0 con 0x55b498d37dc0 2024-09-15T22:19:08.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.159+0000 7fb91d7fa640 1 -- 172.21.15.45:0/3677549054 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91809b0e0 con 0x55b498d37dc0 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.159+0000 7fb92f973740 1 -- 172.21.15.45:0/3677549054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 msgr2=0x55b498d42140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.159+0000 7fb92f973740 1 --2- 172.21.15.45:0/3677549054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d42140 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb9180ccf90 tx=0x7fb91800bf60 comp rx=0 tx=0).stop 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 -- 172.21.15.45:0/3677549054 shutdown_connections 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 --2- 172.21.15.45:0/3677549054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 0x55b498d44a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 --2- 172.21.15.45:0/3677549054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d42140 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 --2- 172.21.15.45:0/3677549054 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d37880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 -- 172.21.15.45:0/3677549054 >> 172.21.15.45:0/3677549054 conn(0x55b498d33a30 msgr2=0x55b498d33e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 -- 172.21.15.45:0/3677549054 shutdown_connections 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 -- 172.21.15.45:0/3677549054 wait complete. 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 -- start start 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 Processor -- start 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d41fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d37dc0 0x55b498d3f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d42680 0x55b498d3f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b498d45250 con 0x55b498d42680 2024-09-15T22:19:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b498c58050 con 0x55b498d37dc0 2024-09-15T22:19:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55b498d453d0 con 0x55b498d374a0 2024-09-15T22:19:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb92f973740 10 client.0 _ll_register_callbacks cb 0x55b498c98160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb9277fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d42680 0x55b498d3f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb9277fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d42680 0x55b498d3f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35486/0 (socket says 172.21.15.45:35486) 2024-09-15T22:19:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.160+0000 7fb9277fe640 1 -- 172.21.15.45:0/3369173528 learned_addr learned my addr 172.21.15.45:0/3369173528 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb91e7fc640 1 --2- 172.21.15.45:0/3369173528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d37dc0 0x55b498d3f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb926ffd640 1 --2- 172.21.15.45:0/3369173528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d41fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb9277fe640 1 -- 172.21.15.45:0/3369173528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 msgr2=0x55b498d41fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb9277fe640 1 --2- 172.21.15.45:0/3369173528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d41fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb9277fe640 1 -- 172.21.15.45:0/3369173528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d37dc0 msgr2=0x55b498d3f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb9277fe640 1 --2- 172.21.15.45:0/3369173528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d37dc0 0x55b498d3f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb9277fe640 1 -- 172.21.15.45:0/3369173528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b498a0e3c0 con 0x55b498d42680 2024-09-15T22:19:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb9277fe640 1 --2- 172.21.15.45:0/3369173528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d42680 0x55b498d3f7e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb92000af30 tx=0x7fb920004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b3741192483b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb90e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb90e7fc640 1 -- 172.21.15.45:0/3369173528 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb920023610 con 0x55b498d42680 2024-09-15T22:19:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb90e7fc640 1 -- 172.21.15.45:0/3369173528 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fb9200237b0 con 0x55b498d42680 2024-09-15T22:19:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb92f973740 1 -- 172.21.15.45:0/3369173528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb918009de0 con 0x55b498d42680 2024-09-15T22:19:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb90e7fc640 1 -- 172.21.15.45:0/3369173528 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb920031050 con 0x55b498d42680 2024-09-15T22:19:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb92f973740 10 client.15999 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.161+0000 7fb92f973740 1 -- 172.21.15.45:0/3369173528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b498d50cd0 con 0x55b498d42680 2024-09-15T22:19:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.162+0000 7fb90e7fc640 1 -- 172.21.15.45:0/3369173528 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb918009de0 con 0x55b498d42680 2024-09-15T22:19:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.162+0000 7fb90e7fc640 1 -- 172.21.15.45:0/3369173528 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb92002c910 con 0x55b498d42680 2024-09-15T22:19:08.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.162+0000 7fb92f973740 10 client.15999 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.162+0000 7fb92f973740 10 client.15999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.162+0000 7fb92f973740 20 client.15999 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.162+0000 7fb92f973740 1 --2- 172.21.15.45:0/3369173528 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b498d52190 0x55b498d54610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.162+0000 7fb92f973740 4 client.15999 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.162+0000 7fb92f973740 1 -- 172.21.15.45:0/3369173528 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b498caa850 con 0x55b498d52190 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.162+0000 7fb926ffd640 1 --2- 172.21.15.45:0/3369173528 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b498d52190 0x55b498d54610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.162+0000 7fb926ffd640 1 --2- 172.21.15.45:0/3369173528 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b498d52190 0x55b498d54610 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cc58aaca7115ea5 server_cookie=23d84378870ad266 in_seq=0 out_seq=0 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.162+0000 7fb90e7fc640 10 client.15999 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb90e7fc640 1 -- 172.21.15.45:0/3369173528 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b498caa850 con 0x55b498d52190 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb90e7fc640 10 client.15999 handle_command_reply: tid=0 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb92f973740 1 client.15999 shutdown 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb92f973740 1 -- 172.21.15.45:0/3369173528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d42680 msgr2=0x55b498d3f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb92f973740 1 --2- 172.21.15.45:0/3369173528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d42680 0x55b498d3f7e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb92000af30 tx=0x7fb920004b50 comp rx=0 tx=0).stop 2024-09-15T22:19:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb92f973740 1 -- 172.21.15.45:0/3369173528 shutdown_connections 2024-09-15T22:19:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb92f973740 1 --2- 172.21.15.45:0/3369173528 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b498d52190 0x55b498d54610 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb92f973740 1 --2- 172.21.15.45:0/3369173528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d42680 0x55b498d3f7e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb92f973740 1 --2- 172.21.15.45:0/3369173528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d37dc0 0x55b498d3f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb90e7fc640 0 client.15999 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb92f973740 1 --2- 172.21.15.45:0/3369173528 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d41fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb92f973740 1 -- 172.21.15.45:0/3369173528 >> 172.21.15.45:0/3369173528 conn(0x55b498d33a30 msgr2=0x55b498d39710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb92f973740 1 -- 172.21.15.45:0/3369173528 shutdown_connections 2024-09-15T22:19:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb92f973740 1 -- 172.21.15.45:0/3369173528 wait complete. 2024-09-15T22:19:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.163+0000 7fb92f973740 20 client.15999 trim_cache size 0 max 16384 2024-09-15T22:19:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.181+0000 7fb92f973740 1 Processor -- start 2024-09-15T22:19:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.181+0000 7fb92f973740 1 -- start start 2024-09-15T22:19:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.181+0000 7fb92f973740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d411f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.181+0000 7fb92f973740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d59f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.181+0000 7fb92f973740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 0x55b498d5a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.181+0000 7fb92f973740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281af370 con 0x55b498d37dc0 2024-09-15T22:19:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.181+0000 7fb92f973740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b1bf0 con 0x55b498d42680 2024-09-15T22:19:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.181+0000 7fb92f973740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281af9e0 con 0x55b498d374a0 2024-09-15T22:19:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.181+0000 7fb91e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d59f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.181+0000 7fb91e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d59f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35490/0 (socket says 172.21.15.45:35490) 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.181+0000 7fb91e7fc640 1 -- 172.21.15.45:0/1908255778 learned_addr learned my addr 172.21.15.45:0/1908255778 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.181+0000 7fb9277fe640 1 --2- 172.21.15.45:0/1908255778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 0x55b498d5a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.182+0000 7fb926ffd640 1 --2- 172.21.15.45:0/1908255778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.182+0000 7fb91e7fc640 1 -- 172.21.15.45:0/1908255778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 msgr2=0x55b498d411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.182+0000 7fb91e7fc640 1 --2- 172.21.15.45:0/1908255778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d411f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.182+0000 7fb91e7fc640 1 -- 172.21.15.45:0/1908255778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 msgr2=0x55b498d5a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.182+0000 7fb91e7fc640 1 --2- 172.21.15.45:0/1908255778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 0x55b498d5a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.182+0000 7fb91e7fc640 1 -- 172.21.15.45:0/1908255778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b498d42340 con 0x55b498d37dc0 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.182+0000 7fb926ffd640 1 --2- 172.21.15.45:0/1908255778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.182+0000 7fb91e7fc640 1 --2- 172.21.15.45:0/1908255778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d59f30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb91002a930 tx=0x7fb910031780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519f05ce77f1b383 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.182+0000 7fb91cff9640 1 -- 172.21.15.45:0/1908255778 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb910035040 con 0x55b498d37dc0 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.182+0000 7fb91cff9640 1 -- 172.21.15.45:0/1908255778 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9100035f0 con 0x55b498d37dc0 2024-09-15T22:19:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.182+0000 7fb91cff9640 1 -- 172.21.15.45:0/1908255778 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9100466e0 con 0x55b498d37dc0 2024-09-15T22:19:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.183+0000 7fb92f973740 1 -- 172.21.15.45:0/1908255778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 msgr2=0x55b498d59f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.183+0000 7fb92f973740 1 --2- 172.21.15.45:0/1908255778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d59f30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb91002a930 tx=0x7fb910031780 comp rx=0 tx=0).stop 2024-09-15T22:19:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.183+0000 7fb92f973740 1 -- 172.21.15.45:0/1908255778 shutdown_connections 2024-09-15T22:19:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.183+0000 7fb92f973740 1 --2- 172.21.15.45:0/1908255778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 0x55b498d5a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.183+0000 7fb92f973740 1 --2- 172.21.15.45:0/1908255778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d59f30 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.183+0000 7fb92f973740 1 --2- 172.21.15.45:0/1908255778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.183+0000 7fb92f973740 1 -- 172.21.15.45:0/1908255778 >> 172.21.15.45:0/1908255778 conn(0x55b498d33a30 msgr2=0x55b498d40ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.183+0000 7fb92f973740 1 -- 172.21.15.45:0/1908255778 shutdown_connections 2024-09-15T22:19:08.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.183+0000 7fb92f973740 1 -- 172.21.15.45:0/1908255778 wait complete. 2024-09-15T22:19:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.183+0000 7fb92f973740 1 -- start start 2024-09-15T22:19:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.183+0000 7fb92f973740 1 Processor -- start 2024-09-15T22:19:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.183+0000 7fb92f973740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d4adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb92f973740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d48100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb92f973740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 0x55b498d48640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb92f973740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b00b0 con 0x55b498d37dc0 2024-09-15T22:19:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb92f973740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b1520 con 0x55b498d42680 2024-09-15T22:19:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb92f973740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb9281b0780 con 0x55b498d374a0 2024-09-15T22:19:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb92f973740 10 client.0 _ll_register_callbacks cb 0x7fb920015d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb91e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d48100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb91e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d48100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35504/0 (socket says 172.21.15.45:35504) 2024-09-15T22:19:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb91e7fc640 1 -- 172.21.15.45:0/3505002492 learned_addr learned my addr 172.21.15.45:0/3505002492 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb9277fe640 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 0x55b498d48640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb926ffd640 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d4adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb91e7fc640 1 -- 172.21.15.45:0/3505002492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 msgr2=0x55b498d4adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb91e7fc640 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d4adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb91e7fc640 1 -- 172.21.15.45:0/3505002492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 msgr2=0x55b498d48640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb91e7fc640 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 0x55b498d48640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb91e7fc640 1 -- 172.21.15.45:0/3505002492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b498d48e40 con 0x55b498d37dc0 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb926ffd640 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d4adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb91e7fc640 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d48100 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb910009900 tx=0x7fb910003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f2401ee6d71c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb90e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb90e7fc640 1 -- 172.21.15.45:0/3505002492 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91004e060 con 0x55b498d37dc0 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb90e7fc640 1 -- 172.21.15.45:0/3505002492 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fb910003fe0 con 0x55b498d37dc0 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.184+0000 7fb92f973740 1 -- 172.21.15.45:0/3505002492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9100035f0 con 0x55b498d37dc0 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.185+0000 7fb90e7fc640 1 -- 172.21.15.45:0/3505002492 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb910055050 con 0x55b498d37dc0 2024-09-15T22:19:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.185+0000 7fb92f973740 10 client.16005 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.185+0000 7fb92f973740 1 -- 172.21.15.45:0/3505002492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b498dbcec0 con 0x55b498d37dc0 2024-09-15T22:19:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.185+0000 7fb90e7fc640 1 -- 172.21.15.45:0/3505002492 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb9100035f0 con 0x55b498d37dc0 2024-09-15T22:19:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.185+0000 7fb90e7fc640 1 -- 172.21.15.45:0/3505002492 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb910004990 con 0x55b498d37dc0 2024-09-15T22:19:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.185+0000 7fb92f973740 10 client.16005 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.185+0000 7fb92f973740 10 client.16005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.185+0000 7fb92f973740 20 client.16005 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.185+0000 7fb92f973740 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b498dbd5e0 0x55b498dbfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.185+0000 7fb92f973740 4 client.16005 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:19:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.185+0000 7fb92f973740 1 -- 172.21.15.45:0/3505002492 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b498ca4d60 con 0x55b498dbd5e0 2024-09-15T22:19:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.185+0000 7fb926ffd640 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b498dbd5e0 0x55b498dbfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb926ffd640 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b498dbd5e0 0x55b498dbfa00 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cecd1faebe9790f server_cookie=1696f62fc79e12b3 in_seq=0 out_seq=0 2024-09-15T22:19:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb90e7fc640 10 client.16005 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb90e7fc640 1 -- 172.21.15.45:0/3505002492 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b498ca4d60 con 0x55b498dbd5e0 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb90e7fc640 10 client.16005 handle_command_reply: tid=0 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb92f973740 1 client.16005 shutdown 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb92f973740 1 -- 172.21.15.45:0/3505002492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 msgr2=0x55b498d48100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb92f973740 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d48100 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb910009900 tx=0x7fb910003e90 comp rx=0 tx=0).stop 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb92f973740 1 -- 172.21.15.45:0/3505002492 shutdown_connections 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb92f973740 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55b498dbd5e0 0x55b498dbfa00 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb92f973740 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b498d42680 0x55b498d48640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb92f973740 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b498d37dc0 0x55b498d48100 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb90e7fc640 0 client.16005 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb92f973740 1 --2- 172.21.15.45:0/3505002492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55b498d374a0 0x55b498d4adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb92f973740 1 -- 172.21.15.45:0/3505002492 >> 172.21.15.45:0/3505002492 conn(0x55b498d33a30 msgr2=0x55b498d3d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb92f973740 1 -- 172.21.15.45:0/3505002492 shutdown_connections 2024-09-15T22:19:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb92f973740 1 -- 172.21.15.45:0/3505002492 wait complete. 2024-09-15T22:19:08.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.186+0000 7fb92f973740 20 client.16005 trim_cache size 0 max 16384 2024-09-15T22:19:08.195 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:19:08.195 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:19:08.195 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:19:08.195 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:19:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.187+0000 7fb92d59a640 1 -- 172.21.15.45:0/1407486073 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb9140a33b0 msgr2=0x7fb9140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.187+0000 7fb92d59a640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb9140a33b0 0x7fb9140a5870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb920009fd0 tx=0x7fb920004a40 comp rx=0 tx=0).stop 2024-09-15T22:19:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.187+0000 7fb92d59a640 1 -- 172.21.15.45:0/1407486073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb928101de0 msgr2=0x7fb9280744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.187+0000 7fb92d59a640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb928101de0 0x7fb9280744f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb91800d950 tx=0x7fb91800de10 comp rx=0 tx=0).stop 2024-09-15T22:19:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.187+0000 7fb92d59a640 1 -- 172.21.15.45:0/1407486073 shutdown_connections 2024-09-15T22:19:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.187+0000 7fb92d59a640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb9140a33b0 0x7fb9140a5870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.187+0000 7fb92d59a640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb928106f10 0x7fb928074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.187+0000 7fb92d59a640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb928102790 0x7fb928074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.187+0000 7fb92d59a640 1 --2- 172.21.15.45:0/1407486073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb928101de0 0x7fb9280744f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.187+0000 7fb92d59a640 1 -- 172.21.15.45:0/1407486073 >> 172.21.15.45:0/1407486073 conn(0x7fb9280fd8c0 msgr2=0x7fb9280febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.187+0000 7fb92d59a640 1 -- 172.21.15.45:0/1407486073 shutdown_connections 2024-09-15T22:19:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:08.187+0000 7fb92d59a640 1 -- 172.21.15.45:0/1407486073 wait complete. 2024-09-15T22:19:08.983 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:19:08.983 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:19:09.243 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:09.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:09 smithi045 ceph-mon[31180]: pgmap v90: 129 pgs: 129 active+clean; 262 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 2.1 MiB/s wr, 202 op/s 2024-09-15T22:19:09.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:09 smithi165 ceph-mon[35551]: pgmap v90: 129 pgs: 129 active+clean; 262 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 2.1 MiB/s wr, 202 op/s 2024-09-15T22:19:09.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:09 smithi100 ceph-mon[35319]: pgmap v90: 129 pgs: 129 active+clean; 262 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 2.1 MiB/s wr, 202 op/s 2024-09-15T22:19:09.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.731+0000 7fcbdf525640 1 -- 172.21.15.45:0/3405775870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbd8101de0 msgr2=0x7fcbd81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:09.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.731+0000 7fcbdf525640 1 --2- 172.21.15.45:0/3405775870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbd8101de0 0x7fcbd81021c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009900 tx=0x7fcbd402a410 comp rx=0 tx=0).stop 2024-09-15T22:19:09.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.731+0000 7fcbdf525640 1 -- 172.21.15.45:0/3405775870 shutdown_connections 2024-09-15T22:19:09.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.731+0000 7fcbdf525640 1 --2- 172.21.15.45:0/3405775870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8106f10 0x7fcbd810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.731+0000 7fcbdf525640 1 --2- 172.21.15.45:0/3405775870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbd8102790 0x7fcbd81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.731+0000 7fcbdf525640 1 --2- 172.21.15.45:0/3405775870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbd8101de0 0x7fcbd81021c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.731+0000 7fcbdf525640 1 -- 172.21.15.45:0/3405775870 >> 172.21.15.45:0/3405775870 conn(0x7fcbd80fd8c0 msgr2=0x7fcbd80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.731+0000 7fcbdf525640 1 -- 172.21.15.45:0/3405775870 shutdown_connections 2024-09-15T22:19:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.731+0000 7fcbdf525640 1 -- 172.21.15.45:0/3405775870 wait complete. 2024-09-15T22:19:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.732+0000 7fcbdf525640 1 Processor -- start 2024-09-15T22:19:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.732+0000 7fcbdf525640 1 -- start start 2024-09-15T22:19:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdf525640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbd8101de0 0x7fcbd8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdf525640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbd8102790 0x7fcbd8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdf525640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8106f10 0x7fcbd819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdf525640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd8112090 con 0x7fcbd8101de0 2024-09-15T22:19:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdf525640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd8111f10 con 0x7fcbd8106f10 2024-09-15T22:19:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdf525640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd8112210 con 0x7fcbd8102790 2024-09-15T22:19:09.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdd2c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbd8101de0 0x7fcbd8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdd2c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbd8101de0 0x7fcbd8198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35514/0 (socket says 172.21.15.45:35514) 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdd2c1640 1 -- 172.21.15.45:0/662721268 learned_addr learned my addr 172.21.15.45:0/662721268 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdcac0640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbd8102790 0x7fcbd8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbddac2640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8106f10 0x7fcbd819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdd2c1640 1 -- 172.21.15.45:0/662721268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbd8102790 msgr2=0x7fcbd8198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdd2c1640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbd8102790 0x7fcbd8198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdd2c1640 1 -- 172.21.15.45:0/662721268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8106f10 msgr2=0x7fcbd819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdd2c1640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8106f10 0x7fcbd819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdd2c1640 1 -- 172.21.15.45:0/662721268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd819d4c0 con 0x7fcbd8101de0 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbddac2640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8106f10 0x7fcbd819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdd2c1640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbd8101de0 0x7fcbd8198510 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4006010 tx=0x7fcbd40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbca7fc640 1 -- 172.21.15.45:0/662721268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd403f030 con 0x7fcbd8101de0 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbca7fc640 1 -- 172.21.15.45:0/662721268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbd4003d00 con 0x7fcbd8101de0 2024-09-15T22:19:09.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdf525640 1 -- 172.21.15.45:0/662721268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd819d750 con 0x7fcbd8101de0 2024-09-15T22:19:09.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbca7fc640 1 -- 172.21.15.45:0/662721268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4035070 con 0x7fcbd8101de0 2024-09-15T22:19:09.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.733+0000 7fcbdf525640 1 -- 172.21.15.45:0/662721268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd81a5090 con 0x7fcbd8101de0 2024-09-15T22:19:09.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.734+0000 7fcbdf525640 1 -- 172.21.15.45:0/662721268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd81032c0 con 0x7fcbd8101de0 2024-09-15T22:19:09.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.736+0000 7fcbca7fc640 1 -- 172.21.15.45:0/662721268 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fcbd4042030 con 0x7fcbd8101de0 2024-09-15T22:19:09.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.736+0000 7fcbca7fc640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcbc40a33b0 0x7fcbc40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:09.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.736+0000 7fcbca7fc640 1 -- 172.21.15.45:0/662721268 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fcbd40f0a30 con 0x7fcbd8101de0 2024-09-15T22:19:09.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.736+0000 7fcbdcac0640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcbc40a33b0 0x7fcbc40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:09.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.737+0000 7fcbdcac0640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcbc40a33b0 0x7fcbc40a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc005fd0 tx=0x7fcbcc005850 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:09.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.739+0000 7fcbca7fc640 1 -- 172.21.15.45:0/662721268 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcbd40bd110 con 0x7fcbd8101de0 2024-09-15T22:19:09.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.952+0000 7fcbdf525640 1 -- 172.21.15.45:0/662721268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbd81021c0 con 0x7fcbd8101de0 2024-09-15T22:19:09.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.953+0000 7fcbca7fc640 1 -- 172.21.15.45:0/662721268 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fcbd81021c0 con 0x7fcbd8101de0 2024-09-15T22:19:09.955 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:19:09.955 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:19:09.955 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:19:09.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.955+0000 7fcbdf525640 1 -- 172.21.15.45:0/662721268 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcbc40a33b0 msgr2=0x7fcbc40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:09.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.955+0000 7fcbdf525640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcbc40a33b0 0x7fcbc40a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc005fd0 tx=0x7fcbcc005850 comp rx=0 tx=0).stop 2024-09-15T22:19:09.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.955+0000 7fcbdf525640 1 -- 172.21.15.45:0/662721268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbd8101de0 msgr2=0x7fcbd8198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:09.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.955+0000 7fcbdf525640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbd8101de0 0x7fcbd8198510 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4006010 tx=0x7fcbd40042f0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.955+0000 7fcbdf525640 1 -- 172.21.15.45:0/662721268 shutdown_connections 2024-09-15T22:19:09.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.955+0000 7fcbdf525640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcbc40a33b0 0x7fcbc40a5870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.955+0000 7fcbdf525640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbd8106f10 0x7fcbd819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.955+0000 7fcbdf525640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcbd8102790 0x7fcbd8198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.955+0000 7fcbdf525640 1 --2- 172.21.15.45:0/662721268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbd8101de0 0x7fcbd8198510 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:09.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.955+0000 7fcbdf525640 1 -- 172.21.15.45:0/662721268 >> 172.21.15.45:0/662721268 conn(0x7fcbd80fd8c0 msgr2=0x7fcbd80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:09.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.955+0000 7fcbdf525640 1 -- 172.21.15.45:0/662721268 shutdown_connections 2024-09-15T22:19:09.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:09.955+0000 7fcbdf525640 1 -- 172.21.15.45:0/662721268 wait complete. 2024-09-15T22:19:10.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:10 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/662721268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:10.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:10 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/662721268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:10.496 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:10 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/662721268' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:10.755 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:19:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:11.421 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:11 smithi045 ceph-mon[31180]: pgmap v91: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 2.5 MiB/s wr, 264 op/s 2024-09-15T22:19:11.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:11 smithi165 ceph-mon[35551]: pgmap v91: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 2.5 MiB/s wr, 264 op/s 2024-09-15T22:19:11.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:11 smithi100 ceph-mon[35319]: pgmap v91: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 2.5 MiB/s wr, 264 op/s 2024-09-15T22:19:11.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.503+0000 7fdab2470640 1 -- 172.21.15.45:0/1624182539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaac102570 msgr2=0x7fdaac1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:11.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.503+0000 7fdab2470640 1 --2- 172.21.15.45:0/1624182539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaac102570 0x7fdaac1029b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fda94009900 tx=0x7fda9402a480 comp rx=0 tx=0).stop 2024-09-15T22:19:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.503+0000 7fdab2470640 1 -- 172.21.15.45:0/1624182539 shutdown_connections 2024-09-15T22:19:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.503+0000 7fdab2470640 1 --2- 172.21.15.45:0/1624182539 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaac102ef0 0x7fdaac10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.503+0000 7fdab2470640 1 --2- 172.21.15.45:0/1624182539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaac102570 0x7fdaac1029b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.503+0000 7fdab2470640 1 --2- 172.21.15.45:0/1624182539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac100e20 0x7fdaac101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.503+0000 7fdab2470640 1 -- 172.21.15.45:0/1624182539 >> 172.21.15.45:0/1624182539 conn(0x7fdaac0fc7d0 msgr2=0x7fdaac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.503+0000 7fdab2470640 1 -- 172.21.15.45:0/1624182539 shutdown_connections 2024-09-15T22:19:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.503+0000 7fdab2470640 1 -- 172.21.15.45:0/1624182539 wait complete. 2024-09-15T22:19:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.504+0000 7fdab2470640 1 Processor -- start 2024-09-15T22:19:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.504+0000 7fdab2470640 1 -- start start 2024-09-15T22:19:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.504+0000 7fdab2470640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaac100e20 0x7fdaac1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.504+0000 7fdab2470640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaac102570 0x7fdaac1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.504+0000 7fdab2470640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac102ef0 0x7fdaac19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.504+0000 7fdab2470640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac1110a0 con 0x7fdaac102570 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.504+0000 7fdab2470640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac110f20 con 0x7fdaac102ef0 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.504+0000 7fdab2470640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac111220 con 0x7fdaac100e20 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.504+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaac102570 0x7fdaac1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.504+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaac102570 0x7fdaac1979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35536/0 (socket says 172.21.15.45:35536) 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.504+0000 7fdaa3fff640 1 -- 172.21.15.45:0/276142558 learned_addr learned my addr 172.21.15.45:0/276142558 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.504+0000 7fdaabfff640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaac100e20 0x7fdaac1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.504+0000 7fdab0a0d640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac102ef0 0x7fdaac19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.505+0000 7fdaa3fff640 1 -- 172.21.15.45:0/276142558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaac100e20 msgr2=0x7fdaac1974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.505+0000 7fdaa3fff640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaac100e20 0x7fdaac1974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.505+0000 7fdaa3fff640 1 -- 172.21.15.45:0/276142558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac102ef0 msgr2=0x7fdaac19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.505+0000 7fdaa3fff640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac102ef0 0x7fdaac19bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.505+0000 7fdaa3fff640 1 -- 172.21.15.45:0/276142558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaac19c450 con 0x7fdaac102570 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.505+0000 7fdab0a0d640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac102ef0 0x7fdaac19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:11.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.505+0000 7fdaa3fff640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaac102570 0x7fdaac1979e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fda94006010 tx=0x7fda94004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.505+0000 7fdaa9ffb640 1 -- 172.21.15.45:0/276142558 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9403f030 con 0x7fdaac102570 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.505+0000 7fdaa9ffb640 1 -- 172.21.15.45:0/276142558 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda94005500 con 0x7fdaac102570 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.505+0000 7fdab2470640 1 -- 172.21.15.45:0/276142558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaac19c6e0 con 0x7fdaac102570 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.505+0000 7fdaa9ffb640 1 -- 172.21.15.45:0/276142558 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94035070 con 0x7fdaac102570 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.505+0000 7fdab2470640 1 -- 172.21.15.45:0/276142558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaac1a4020 con 0x7fdaac102570 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.507+0000 7fdaa9ffb640 1 -- 172.21.15.45:0/276142558 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fda94042030 con 0x7fdaac102570 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdab4849740 1 Processor -- start 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdab4849740 1 -- start start 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdab4849740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 0x559933fa0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdab4849740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa05d0 0x559933fa0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdab4849740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fab370 0x559933fad760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdab4849740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559933f062f0 con 0x559933fa1b40 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdab4849740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559933eadcf0 con 0x559933fab370 2024-09-15T22:19:11.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdab4849740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559933f022b0 con 0x559933fa05d0 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdab0a0d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 0x559933fa0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdaa9ffb640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fda980a33b0 0x7fda980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdab0a0d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 0x559933fa0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35542/0 (socket says 172.21.15.45:35542) 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdab0a0d640 1 -- 172.21.15.45:0/4028490531 learned_addr learned my addr 172.21.15.45:0/4028490531 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdab0a0d640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fda980a33b0 0x7fda980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdaabfff640 1 --2- 172.21.15.45:0/4028490531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa05d0 0x559933fa0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdaa9ffb640 1 -- 172.21.15.45:0/276142558 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fda940f0610 con 0x7fdaac102570 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.508+0000 7fdaa3fff640 1 --2- 172.21.15.45:0/4028490531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fab370 0x559933fad760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.509+0000 7fdab0a0d640 1 -- 172.21.15.45:0/4028490531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa05d0 msgr2=0x559933fa0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.509+0000 7fdab0a0d640 1 --2- 172.21.15.45:0/4028490531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa05d0 0x559933fa0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.509+0000 7fdab0a0d640 1 -- 172.21.15.45:0/4028490531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fab370 msgr2=0x559933fad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.509+0000 7fdab0a0d640 1 --2- 172.21.15.45:0/4028490531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fab370 0x559933fad760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.509+0000 7fdab0a0d640 1 -- 172.21.15.45:0/4028490531 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559933e923a0 con 0x559933fa1b40 2024-09-15T22:19:11.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.509+0000 7fdaabfff640 1 --2- 172.21.15.45:0/4028490531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa05d0 0x559933fa0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.509+0000 7fdaa3fff640 1 --2- 172.21.15.45:0/4028490531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fab370 0x559933fad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.509+0000 7fdab0a0d640 1 --2- 172.21.15.45:0/4028490531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 0x559933fa0090 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4013e30 tx=0x7fdaa4010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b6e72a772a4814 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.509+0000 7fdab0a0d640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fda980a33b0 0x7fda980a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4007fd0 tx=0x7fdaa401b000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.509+0000 7fdaa27fc640 1 -- 172.21.15.45:0/4028490531 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa400add0 con 0x559933fa1b40 2024-09-15T22:19:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.509+0000 7fdaa27fc640 1 -- 172.21.15.45:0/4028490531 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdaa4007c00 con 0x559933fa1b40 2024-09-15T22:19:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.509+0000 7fdaa27fc640 1 -- 172.21.15.45:0/4028490531 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4004030 con 0x559933fa1b40 2024-09-15T22:19:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.510+0000 7fdab4849740 1 -- 172.21.15.45:0/4028490531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 msgr2=0x559933fa0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.510+0000 7fdab4849740 1 --2- 172.21.15.45:0/4028490531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 0x559933fa0090 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4013e30 tx=0x7fdaa4010740 comp rx=0 tx=0).stop 2024-09-15T22:19:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.510+0000 7fdab4849740 1 -- 172.21.15.45:0/4028490531 shutdown_connections 2024-09-15T22:19:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.510+0000 7fdab4849740 1 --2- 172.21.15.45:0/4028490531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fab370 0x559933fad760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.510+0000 7fdab4849740 1 --2- 172.21.15.45:0/4028490531 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa05d0 0x559933fa0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.510+0000 7fdab4849740 1 --2- 172.21.15.45:0/4028490531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 0x559933fa0090 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.510+0000 7fdab4849740 1 -- 172.21.15.45:0/4028490531 >> 172.21.15.45:0/4028490531 conn(0x559933f69310 msgr2=0x559933f9cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.510+0000 7fdab4849740 1 -- 172.21.15.45:0/4028490531 shutdown_connections 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.510+0000 7fdab4849740 1 -- 172.21.15.45:0/4028490531 wait complete. 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.510+0000 7fdab4849740 1 -- start start 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdab4849740 1 Processor -- start 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdab4849740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa05d0 0x559933faada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdab4849740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 0x559933fa8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdab4849740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fab370 0x559933fa87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdab4849740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559933fb0220 con 0x559933fa1b40 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdab4849740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559933ec1060 con 0x559933fab370 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdab4849740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559933fb03a0 con 0x559933fa05d0 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdab4849740 10 client.0 _ll_register_callbacks cb 0x559933c148c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 0x559933fa8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdaa3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 0x559933fa8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35544/0 (socket says 172.21.15.45:35544) 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdaa3fff640 1 -- 172.21.15.45:0/2891926546 learned_addr learned my addr 172.21.15.45:0/2891926546 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:11.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdaabfff640 1 --2- 172.21.15.45:0/2891926546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa05d0 0x559933faada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdaa3fff640 1 -- 172.21.15.45:0/2891926546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa05d0 msgr2=0x559933faada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdaa3fff640 1 --2- 172.21.15.45:0/2891926546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa05d0 0x559933faada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdaa3fff640 1 -- 172.21.15.45:0/2891926546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fab370 msgr2=0x559933fa87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdab0a0d640 1 --2- 172.21.15.45:0/2891926546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fab370 0x559933fa87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdaa3fff640 1 --2- 172.21.15.45:0/2891926546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fab370 0x559933fa87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdaa3fff640 1 -- 172.21.15.45:0/2891926546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559933c773c0 con 0x559933fa1b40 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fdaa3fff640 1 --2- 172.21.15.45:0/2891926546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 0x559933fa8050 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fda94000c00 tx=0x7fda940bc320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3299351586740fea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.511+0000 7fda8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fda8b7fe640 1 -- 172.21.15.45:0/2891926546 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94049040 con 0x559933fa1b40 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fda8b7fe640 1 -- 172.21.15.45:0/2891926546 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fda940b8b40 con 0x559933fa1b40 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fdab4849740 1 -- 172.21.15.45:0/2891926546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaa4007c00 con 0x559933fa1b40 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fda8b7fe640 1 -- 172.21.15.45:0/2891926546 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fda940bcbd0 con 0x559933fa1b40 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fdab4849740 10 client.16023 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:11.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fdab4849740 1 -- 172.21.15.45:0/2891926546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559933fbbd00 con 0x559933fa1b40 2024-09-15T22:19:11.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fda8b7fe640 1 -- 172.21.15.45:0/2891926546 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdaa4007c00 con 0x559933fa1b40 2024-09-15T22:19:11.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fda8b7fe640 1 -- 172.21.15.45:0/2891926546 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fda940edc50 con 0x559933fa1b40 2024-09-15T22:19:11.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fdab4849740 10 client.16023 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:11.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fdab4849740 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:11.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fdab4849740 20 client.16023 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:11.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fdab4849740 1 --2- 172.21.15.45:0/2891926546 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559933fbd160 0x559933fbf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fdab4849740 4 client.16023 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:11.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.512+0000 7fdab4849740 1 -- 172.21.15.45:0/2891926546 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559933f13860 con 0x559933fbd160 2024-09-15T22:19:11.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.513+0000 7fdaabfff640 1 --2- 172.21.15.45:0/2891926546 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559933fbd160 0x559933fbf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.513+0000 7fdaabfff640 1 --2- 172.21.15.45:0/2891926546 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559933fbd160 0x559933fbf570 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fe76898436afa05 server_cookie=511c68137b7969ef in_seq=0 out_seq=0 2024-09-15T22:19:11.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.513+0000 7fda8b7fe640 10 client.16023 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:11.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fda8b7fe640 1 -- 172.21.15.45:0/2891926546 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559933f13860 con 0x559933fbd160 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fda8b7fe640 10 client.16023 handle_command_reply: tid=0 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fdab4849740 1 client.16023 shutdown 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fdab4849740 1 -- 172.21.15.45:0/2891926546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 msgr2=0x559933fa8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fdab4849740 1 --2- 172.21.15.45:0/2891926546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 0x559933fa8050 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fda94000c00 tx=0x7fda940bc320 comp rx=0 tx=0).stop 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fdab4849740 1 -- 172.21.15.45:0/2891926546 shutdown_connections 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fdab4849740 1 --2- 172.21.15.45:0/2891926546 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559933fbd160 0x559933fbf570 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fdab4849740 1 --2- 172.21.15.45:0/2891926546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fab370 0x559933fa87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fdab4849740 1 --2- 172.21.15.45:0/2891926546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa1b40 0x559933fa8050 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fdab4849740 1 --2- 172.21.15.45:0/2891926546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa05d0 0x559933faada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fda8b7fe640 0 client.16023 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fdab4849740 1 -- 172.21.15.45:0/2891926546 >> 172.21.15.45:0/2891926546 conn(0x559933f69310 msgr2=0x559933fa2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fdab4849740 1 -- 172.21.15.45:0/2891926546 shutdown_connections 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fdab4849740 1 -- 172.21.15.45:0/2891926546 wait complete. 2024-09-15T22:19:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.514+0000 7fdab4849740 20 client.16023 trim_cache size 0 max 16384 2024-09-15T22:19:11.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.527+0000 7fdab4849740 1 Processor -- start 2024-09-15T22:19:11.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.527+0000 7fdab4849740 1 -- start start 2024-09-15T22:19:11.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.527+0000 7fdab4849740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa05d0 0x559933fa3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.527+0000 7fdab4849740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fa1b40 0x559933fa3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.527+0000 7fdab4849740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fab370 0x559933fc4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.527+0000 7fdab4849740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac1aadc0 con 0x559933fa05d0 2024-09-15T22:19:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.527+0000 7fdab4849740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac1ad640 con 0x559933fa1b40 2024-09-15T22:19:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.527+0000 7fdab4849740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac1ab430 con 0x559933fab370 2024-09-15T22:19:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdaabfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa05d0 0x559933fa3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdaabfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa05d0 0x559933fa3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35554/0 (socket says 172.21.15.45:35554) 2024-09-15T22:19:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdaabfff640 1 -- 172.21.15.45:0/2717559652 learned_addr learned my addr 172.21.15.45:0/2717559652 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdaa3fff640 1 --2- 172.21.15.45:0/2717559652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fa1b40 0x559933fa3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdab0a0d640 1 --2- 172.21.15.45:0/2717559652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fab370 0x559933fc4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdaabfff640 1 -- 172.21.15.45:0/2717559652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fab370 msgr2=0x559933fc4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdaabfff640 1 --2- 172.21.15.45:0/2717559652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fab370 0x559933fc4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdaabfff640 1 -- 172.21.15.45:0/2717559652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fa1b40 msgr2=0x559933fa3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdaabfff640 1 --2- 172.21.15.45:0/2717559652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fa1b40 0x559933fa3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdaabfff640 1 -- 172.21.15.45:0/2717559652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559933fadad0 con 0x559933fa05d0 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdab0a0d640 1 --2- 172.21.15.45:0/2717559652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fab370 0x559933fc4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdaabfff640 1 --2- 172.21.15.45:0/2717559652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa05d0 0x559933fa3120 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fda9c000c00 tx=0x7fda9c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f29e834b412dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdaa1ffb640 1 -- 172.21.15.45:0/2717559652 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c003ca0 con 0x559933fa05d0 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdaa1ffb640 1 -- 172.21.15.45:0/2717559652 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda9c003e40 con 0x559933fa05d0 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.528+0000 7fdaa1ffb640 1 -- 172.21.15.45:0/2717559652 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c01c980 con 0x559933fa05d0 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.529+0000 7fdab4849740 1 -- 172.21.15.45:0/2717559652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa05d0 msgr2=0x559933fa3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.529+0000 7fdab4849740 1 --2- 172.21.15.45:0/2717559652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa05d0 0x559933fa3120 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fda9c000c00 tx=0x7fda9c00bd30 comp rx=0 tx=0).stop 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.529+0000 7fdab4849740 1 -- 172.21.15.45:0/2717559652 shutdown_connections 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.529+0000 7fdab4849740 1 --2- 172.21.15.45:0/2717559652 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fab370 0x559933fc4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.529+0000 7fdab4849740 1 --2- 172.21.15.45:0/2717559652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fa1b40 0x559933fa3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.529+0000 7fdab4849740 1 --2- 172.21.15.45:0/2717559652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fa05d0 0x559933fa3120 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.529+0000 7fdab4849740 1 -- 172.21.15.45:0/2717559652 >> 172.21.15.45:0/2717559652 conn(0x559933f69310 msgr2=0x559933faa0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.529+0000 7fdab4849740 1 -- 172.21.15.45:0/2717559652 shutdown_connections 2024-09-15T22:19:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.529+0000 7fdab4849740 1 -- 172.21.15.45:0/2717559652 wait complete. 2024-09-15T22:19:11.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.529+0000 7fdab4849740 1 -- start start 2024-09-15T22:19:11.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab4849740 1 Processor -- start 2024-09-15T22:19:11.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab4849740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fa05d0 0x559933fb5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab4849740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa1b40 0x559933fb5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab4849740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fab370 0x559933fb2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab4849740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac1abb00 con 0x559933fab370 2024-09-15T22:19:11.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab4849740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac1acf70 con 0x559933fa05d0 2024-09-15T22:19:11.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab4849740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdaac1ac1d0 con 0x559933fa1b40 2024-09-15T22:19:11.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab4849740 10 client.0 _ll_register_callbacks cb 0x7fda94005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:11.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab0a0d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fab370 0x559933fb2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab0a0d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fab370 0x559933fb2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35570/0 (socket says 172.21.15.45:35570) 2024-09-15T22:19:11.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab0a0d640 1 -- 172.21.15.45:0/4080327255 learned_addr learned my addr 172.21.15.45:0/4080327255 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:11.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdaabfff640 1 --2- 172.21.15.45:0/4080327255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fa05d0 0x559933fb5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdaa3fff640 1 --2- 172.21.15.45:0/4080327255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa1b40 0x559933fb5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab0a0d640 1 -- 172.21.15.45:0/4080327255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa1b40 msgr2=0x559933fb5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab0a0d640 1 --2- 172.21.15.45:0/4080327255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa1b40 0x559933fb5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab0a0d640 1 -- 172.21.15.45:0/4080327255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fa05d0 msgr2=0x559933fb5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.530+0000 7fdab0a0d640 1 --2- 172.21.15.45:0/4080327255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fa05d0 0x559933fb5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.531+0000 7fdab0a0d640 1 -- 172.21.15.45:0/4080327255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559933fb2b40 con 0x559933fab370 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.531+0000 7fdab0a0d640 1 --2- 172.21.15.45:0/4080327255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fab370 0x559933fb2600 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4013e30 tx=0x7fdaa400ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca433d0edfb1b34c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.531+0000 7fda8b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.531+0000 7fda8b7fe640 1 -- 172.21.15.45:0/4080327255 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4003970 con 0x559933fab370 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.531+0000 7fda8b7fe640 1 -- 172.21.15.45:0/4080327255 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fdaa4003b10 con 0x559933fab370 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.531+0000 7fdab4849740 1 -- 172.21.15.45:0/4080327255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda9c003e40 con 0x559933fab370 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.531+0000 7fda8b7fe640 1 -- 172.21.15.45:0/4080327255 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdaa4039050 con 0x559933fab370 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.531+0000 7fdab4849740 10 client.16029 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:11.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.531+0000 7fdab4849740 1 -- 172.21.15.45:0/4080327255 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559933fae1a0 con 0x559933fab370 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.531+0000 7fda8b7fe640 1 -- 172.21.15.45:0/4080327255 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda9c003e40 con 0x559933fab370 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.531+0000 7fda8b7fe640 1 -- 172.21.15.45:0/4080327255 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fdaa401c070 con 0x559933fab370 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.532+0000 7fdab4849740 10 client.16029 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.532+0000 7fdab4849740 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.532+0000 7fdab4849740 20 client.16029 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.532+0000 7fdab4849740 1 --2- 172.21.15.45:0/4080327255 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559933fae6f0 0x559933faeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.532+0000 7fdab4849740 4 client.16029 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.532+0000 7fdab4849740 1 -- 172.21.15.45:0/4080327255 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559933f0dd70 con 0x559933fae6f0 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.532+0000 7fdaabfff640 1 --2- 172.21.15.45:0/4080327255 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559933fae6f0 0x559933faeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.532+0000 7fdaabfff640 1 --2- 172.21.15.45:0/4080327255 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559933fae6f0 0x559933faeb00 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a9585a6f29dd6aa server_cookie=cbaade684f36e376 in_seq=0 out_seq=0 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.532+0000 7fda8b7fe640 10 client.16029 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.532+0000 7fda8b7fe640 1 -- 172.21.15.45:0/4080327255 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559933f0dd70 con 0x559933fae6f0 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.532+0000 7fda8b7fe640 10 client.16029 handle_command_reply: tid=0 2024-09-15T22:19:11.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.532+0000 7fdab4849740 1 client.16029 shutdown 2024-09-15T22:19:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab4849740 1 -- 172.21.15.45:0/4080327255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fab370 msgr2=0x559933fb2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab4849740 1 --2- 172.21.15.45:0/4080327255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fab370 0x559933fb2600 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4013e30 tx=0x7fdaa400ae00 comp rx=0 tx=0).stop 2024-09-15T22:19:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab4849740 1 -- 172.21.15.45:0/4080327255 shutdown_connections 2024-09-15T22:19:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab4849740 1 --2- 172.21.15.45:0/4080327255 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559933fae6f0 0x559933faeb00 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab4849740 1 --2- 172.21.15.45:0/4080327255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559933fab370 0x559933fb2600 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab4849740 1 --2- 172.21.15.45:0/4080327255 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559933fa1b40 0x559933fb5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab4849740 1 --2- 172.21.15.45:0/4080327255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559933fa05d0 0x559933fb5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab4849740 1 -- 172.21.15.45:0/4080327255 >> 172.21.15.45:0/4080327255 conn(0x559933f69310 msgr2=0x559933fa98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fda8b7fe640 0 client.16029 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab4849740 1 -- 172.21.15.45:0/4080327255 shutdown_connections 2024-09-15T22:19:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab4849740 1 -- 172.21.15.45:0/4080327255 wait complete. 2024-09-15T22:19:11.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab4849740 20 client.16029 trim_cache size 0 max 16384 2024-09-15T22:19:11.542 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:19:11.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab2470640 1 -- 172.21.15.45:0/276142558 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fda980a33b0 msgr2=0x7fda980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab2470640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fda980a33b0 0x7fda980a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4007fd0 tx=0x7fdaa401b000 comp rx=0 tx=0).stop 2024-09-15T22:19:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab2470640 1 -- 172.21.15.45:0/276142558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaac102570 msgr2=0x7fdaac1979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab2470640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaac102570 0x7fdaac1979e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fda94006010 tx=0x7fda94004c00 comp rx=0 tx=0).stop 2024-09-15T22:19:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab2470640 1 -- 172.21.15.45:0/276142558 shutdown_connections 2024-09-15T22:19:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab2470640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fda980a33b0 0x7fda980a5870 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab2470640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdaac102ef0 0x7fdaac19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab2470640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdaac102570 0x7fdaac1979e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab2470640 1 --2- 172.21.15.45:0/276142558 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdaac100e20 0x7fdaac1974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.533+0000 7fdab2470640 1 -- 172.21.15.45:0/276142558 >> 172.21.15.45:0/276142558 conn(0x7fdaac0fc7d0 msgr2=0x7fdaac106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.534+0000 7fdab2470640 1 -- 172.21.15.45:0/276142558 shutdown_connections 2024-09-15T22:19:11.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:11.534+0000 7fdab2470640 1 -- 172.21.15.45:0/276142558 wait complete. 2024-09-15T22:19:13.348 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:19:13.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:19:13.377 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:13 smithi045 ceph-mon[31180]: pgmap v92: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 1.3 MiB/s wr, 148 op/s 2024-09-15T22:19:13.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:13 smithi165 ceph-mon[35551]: pgmap v92: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 1.3 MiB/s wr, 148 op/s 2024-09-15T22:19:13.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:13 smithi100 ceph-mon[35319]: pgmap v92: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 1.3 MiB/s wr, 148 op/s 2024-09-15T22:19:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:14.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.091+0000 7f088c48f640 1 -- 172.21.15.45:0/3180219625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884100a60 msgr2=0x7f0884100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:14.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.091+0000 7f088c48f640 1 --2- 172.21.15.45:0/3180219625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884100a60 0x7f0884100ec0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0874009930 tx=0x7f087402a420 comp rx=0 tx=0).stop 2024-09-15T22:19:14.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.091+0000 7f088c48f640 1 -- 172.21.15.45:0/3180219625 shutdown_connections 2024-09-15T22:19:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.091+0000 7f088c48f640 1 --2- 172.21.15.45:0/3180219625 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0884101400 0x7f088410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.091+0000 7f088c48f640 1 --2- 172.21.15.45:0/3180219625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884100a60 0x7f0884100ec0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.091+0000 7f088c48f640 1 --2- 172.21.15.45:0/3180219625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0884106a60 0x7f0884106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.091+0000 7f088c48f640 1 -- 172.21.15.45:0/3180219625 >> 172.21.15.45:0/3180219625 conn(0x7f08840fc780 msgr2=0x7f08840feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.091+0000 7f088c48f640 1 -- 172.21.15.45:0/3180219625 shutdown_connections 2024-09-15T22:19:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.091+0000 7f088c48f640 1 -- 172.21.15.45:0/3180219625 wait complete. 2024-09-15T22:19:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088c48f640 1 Processor -- start 2024-09-15T22:19:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088c48f640 1 -- start start 2024-09-15T22:19:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088c48f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884100a60 0x7f0884198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088c48f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0884101400 0x7f0884198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088c48f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0884106a60 0x7f088419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088c48f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f08841120e0 con 0x7f0884100a60 2024-09-15T22:19:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088c48f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0884111f60 con 0x7f0884101400 2024-09-15T22:19:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088c48f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0884112260 con 0x7f0884106a60 2024-09-15T22:19:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088a22b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884100a60 0x7f0884198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088a22b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884100a60 0x7f0884198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35580/0 (socket says 172.21.15.45:35580) 2024-09-15T22:19:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088a22b640 1 -- 172.21.15.45:0/2811931398 learned_addr learned my addr 172.21.15.45:0/2811931398 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088aa2c640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0884106a60 0x7f088419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f0889a2a640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0884101400 0x7f0884198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088a22b640 1 -- 172.21.15.45:0/2811931398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0884106a60 msgr2=0x7f088419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088a22b640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0884106a60 0x7f088419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088a22b640 1 -- 172.21.15.45:0/2811931398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0884101400 msgr2=0x7f0884198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088a22b640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0884101400 0x7f0884198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.092+0000 7f088a22b640 1 -- 172.21.15.45:0/2811931398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088419d4f0 con 0x7f0884100a60 2024-09-15T22:19:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.093+0000 7f088a22b640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884100a60 0x7f0884198540 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f088000d950 tx=0x7f088000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.093+0000 7f087b7fe640 1 -- 172.21.15.45:0/2811931398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880017030 con 0x7f0884100a60 2024-09-15T22:19:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.093+0000 7f088c48f640 1 -- 172.21.15.45:0/2811931398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088419d7e0 con 0x7f0884100a60 2024-09-15T22:19:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.093+0000 7f087b7fe640 1 -- 172.21.15.45:0/2811931398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0880004020 con 0x7f0884100a60 2024-09-15T22:19:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.093+0000 7f087b7fe640 1 -- 172.21.15.45:0/2811931398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0880004a00 con 0x7f0884100a60 2024-09-15T22:19:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.093+0000 7f088c48f640 1 -- 172.21.15.45:0/2811931398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08841a50c0 con 0x7f0884100a60 2024-09-15T22:19:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.095+0000 7f088e868740 1 Processor -- start 2024-09-15T22:19:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088e868740 1 -- start start 2024-09-15T22:19:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f087b7fe640 1 -- 172.21.15.45:0/2811931398 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f08800041d0 con 0x7f0884100a60 2024-09-15T22:19:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088e868740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965d6b60 0x55c5965d6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088e868740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d7480 0x55c5965e1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088e868740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965e1d40 0x55c5965e4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088e868740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c59653c280 con 0x55c5965d7480 2024-09-15T22:19:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088e868740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c5964e3b10 con 0x55c5965d6b60 2024-09-15T22:19:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088e868740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c596538240 con 0x55c5965e1d40 2024-09-15T22:19:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088a22b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d7480 0x55c5965e1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088aa2c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965d6b60 0x55c5965d6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088a22b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d7480 0x55c5965e1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35594/0 (socket says 172.21.15.45:35594) 2024-09-15T22:19:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088a22b640 1 -- 172.21.15.45:0/1999543808 learned_addr learned my addr 172.21.15.45:0/1999543808 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f0889a2a640 1 --2- 172.21.15.45:0/1999543808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965e1d40 0x55c5965e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088aa2c640 1 -- 172.21.15.45:0/1999543808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965e1d40 msgr2=0x55c5965e4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088aa2c640 1 --2- 172.21.15.45:0/1999543808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965e1d40 0x55c5965e4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088aa2c640 1 -- 172.21.15.45:0/1999543808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d7480 msgr2=0x55c5965e1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:14.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088aa2c640 1 --2- 172.21.15.45:0/1999543808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d7480 0x55c5965e1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f088aa2c640 1 -- 172.21.15.45:0/1999543808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5964f01f0 con 0x55c5965d6b60 2024-09-15T22:19:14.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.096+0000 7f0889a2a640 1 --2- 172.21.15.45:0/1999543808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965e1d40 0x55c5965e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:14.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.097+0000 7f088aa2c640 1 --2- 172.21.15.45:0/1999543808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965d6b60 0x55c5965d6f40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f087c009f30 tx=0x7f087c010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7265cc80a9149c3b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:14.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.097+0000 7f087b7fe640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08700a33b0 0x7f08700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.097+0000 7f087b7fe640 1 -- 172.21.15.45:0/2811931398 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f08800cfa70 con 0x7f0884100a60 2024-09-15T22:19:14.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.097+0000 7f088a22b640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08700a33b0 0x7f08700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.097+0000 7f088a22b640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08700a33b0 0x7f08700a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f08800cce60 tx=0x7f08800d35c0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.099+0000 7f0878ff9640 1 -- 172.21.15.45:0/1999543808 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c016070 con 0x55c5965d6b60 2024-09-15T22:19:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.099+0000 7f0878ff9640 1 -- 172.21.15.45:0/1999543808 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f087c004d20 con 0x55c5965d6b60 2024-09-15T22:19:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.099+0000 7f0878ff9640 1 -- 172.21.15.45:0/1999543808 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c0128f0 con 0x55c5965d6b60 2024-09-15T22:19:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 -- 172.21.15.45:0/1999543808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965d6b60 msgr2=0x55c5965d6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 --2- 172.21.15.45:0/1999543808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965d6b60 0x55c5965d6f40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f087c009f30 tx=0x7f087c010800 comp rx=0 tx=0).stop 2024-09-15T22:19:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 -- 172.21.15.45:0/1999543808 shutdown_connections 2024-09-15T22:19:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 --2- 172.21.15.45:0/1999543808 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965e1d40 0x55c5965e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 --2- 172.21.15.45:0/1999543808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d7480 0x55c5965e1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 --2- 172.21.15.45:0/1999543808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965d6b60 0x55c5965d6f40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 -- 172.21.15.45:0/1999543808 >> 172.21.15.45:0/1999543808 conn(0x55c5965d30f0 msgr2=0x55c5965d34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 -- 172.21.15.45:0/1999543808 shutdown_connections 2024-09-15T22:19:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 -- 172.21.15.45:0/1999543808 wait complete. 2024-09-15T22:19:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 -- start start 2024-09-15T22:19:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 Processor -- start 2024-09-15T22:19:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 0x55c5965dec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 0x55c5965df160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965e1d40 0x55c5965df6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c5965e4910 con 0x55c5965d6b60 2024-09-15T22:19:14.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c5964f6f10 con 0x55c5965e1d40 2024-09-15T22:19:14.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.100+0000 7f088e868740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c5965e4a90 con 0x55c5965d7480 2024-09-15T22:19:14.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088e868740 10 client.0 _ll_register_callbacks cb 0x55c5964bfa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:14.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088aa2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 0x55c5965dec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088aa2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 0x55c5965dec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35602/0 (socket says 172.21.15.45:35602) 2024-09-15T22:19:14.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088aa2c640 1 -- 172.21.15.45:0/2046216546 learned_addr learned my addr 172.21.15.45:0/2046216546 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:14.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f0889a2a640 1 --2- 172.21.15.45:0/2046216546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 0x55c5965df160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088aa2c640 1 --2- 172.21.15.45:0/2046216546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965e1d40 0x55c5965df6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088aa2c640 1 -- 172.21.15.45:0/2046216546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 msgr2=0x55c5965df160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:14.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088aa2c640 1 --2- 172.21.15.45:0/2046216546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 0x55c5965df160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088aa2c640 1 -- 172.21.15.45:0/2046216546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965e1d40 msgr2=0x55c5965df6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:14.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088aa2c640 1 --2- 172.21.15.45:0/2046216546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965e1d40 0x55c5965df6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088aa2c640 1 -- 172.21.15.45:0/2046216546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5962ad6a0 con 0x55c5965d6b60 2024-09-15T22:19:14.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088aa2c640 1 --2- 172.21.15.45:0/2046216546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 0x55c5965dec20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f087c010d00 tx=0x7f087c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56099d6dca582aa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:14.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f086dffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f086dffb640 1 -- 172.21.15.45:0/2046216546 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c016030 con 0x55c5965d6b60 2024-09-15T22:19:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f086dffb640 1 -- 172.21.15.45:0/2046216546 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f087c003d80 con 0x55c5965d6b60 2024-09-15T22:19:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088e868740 1 -- 172.21.15.45:0/2046216546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f087c004d20 con 0x55c5965d6b60 2024-09-15T22:19:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f086dffb640 1 -- 172.21.15.45:0/2046216546 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f087c031050 con 0x55c5965d6b60 2024-09-15T22:19:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088e868740 10 client.16041 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.101+0000 7f088e868740 1 -- 172.21.15.45:0/2046216546 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c5965f0510 con 0x55c5965d6b60 2024-09-15T22:19:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.102+0000 7f086dffb640 1 -- 172.21.15.45:0/2046216546 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f087c004d20 con 0x55c5965d6b60 2024-09-15T22:19:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.102+0000 7f086dffb640 1 -- 172.21.15.45:0/2046216546 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f087c00f040 con 0x55c5965d6b60 2024-09-15T22:19:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.102+0000 7f088e868740 10 client.16041 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.102+0000 7f088e868740 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.102+0000 7f088e868740 20 client.16041 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.102+0000 7f088e868740 1 --2- 172.21.15.45:0/2046216546 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c5965f1920 0x55c5965f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.102+0000 7f088e868740 4 client.16041 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:14.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.102+0000 7f088e868740 1 -- 172.21.15.45:0/2046216546 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5965497f0 con 0x55c5965f1920 2024-09-15T22:19:14.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.102+0000 7f0889a2a640 1 --2- 172.21.15.45:0/2046216546 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c5965f1920 0x55c5965f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f0889a2a640 1 --2- 172.21.15.45:0/2046216546 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c5965f1920 0x55c5965f3d10 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cfafb916f48ddff server_cookie=2b172e87d183792a in_seq=0 out_seq=0 2024-09-15T22:19:14.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f086dffb640 10 client.16041 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:14.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f086dffb640 1 -- 172.21.15.45:0/2046216546 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5965497f0 con 0x55c5965f1920 2024-09-15T22:19:14.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f086dffb640 10 client.16041 handle_command_reply: tid=0 2024-09-15T22:19:14.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f088e868740 1 client.16041 shutdown 2024-09-15T22:19:14.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f088e868740 1 -- 172.21.15.45:0/2046216546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 msgr2=0x55c5965dec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:14.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f088e868740 1 --2- 172.21.15.45:0/2046216546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 0x55c5965dec20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f087c010d00 tx=0x7f087c009840 comp rx=0 tx=0).stop 2024-09-15T22:19:14.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f088e868740 1 -- 172.21.15.45:0/2046216546 shutdown_connections 2024-09-15T22:19:14.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f088e868740 1 --2- 172.21.15.45:0/2046216546 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c5965f1920 0x55c5965f3d10 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f088e868740 1 --2- 172.21.15.45:0/2046216546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965e1d40 0x55c5965df6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f088e868740 1 --2- 172.21.15.45:0/2046216546 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 0x55c5965df160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f088e868740 1 --2- 172.21.15.45:0/2046216546 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 0x55c5965dec20 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f086dffb640 0 client.16041 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:14.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.103+0000 7f088e868740 1 -- 172.21.15.45:0/2046216546 >> 172.21.15.45:0/2046216546 conn(0x55c5965d30f0 msgr2=0x55c5965d8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:14.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.104+0000 7f088e868740 1 -- 172.21.15.45:0/2046216546 shutdown_connections 2024-09-15T22:19:14.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.104+0000 7f088e868740 1 -- 172.21.15.45:0/2046216546 wait complete. 2024-09-15T22:19:14.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.104+0000 7f088e868740 20 client.16041 trim_cache size 0 max 16384 2024-09-15T22:19:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.121+0000 7f088e868740 1 Processor -- start 2024-09-15T22:19:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.121+0000 7f088e868740 1 -- start start 2024-09-15T22:19:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.121+0000 7f088e868740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965d6b60 0x55c5965d95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088e868740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 0x55c5965f6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088e868740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965e1d40 0x55c5965f7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088e868740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f08841ad220 con 0x55c5965e1d40 2024-09-15T22:19:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088e868740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f08841afaa0 con 0x55c5965d6b60 2024-09-15T22:19:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088e868740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f08841ad890 con 0x55c5965d7480 2024-09-15T22:19:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088aa2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965e1d40 0x55c5965f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088aa2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965e1d40 0x55c5965f7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35612/0 (socket says 172.21.15.45:35612) 2024-09-15T22:19:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088aa2c640 1 -- 172.21.15.45:0/4171838143 learned_addr learned my addr 172.21.15.45:0/4171838143 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088aa2c640 1 --2- 172.21.15.45:0/4171838143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965d6b60 0x55c5965d95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f0889a2a640 1 --2- 172.21.15.45:0/4171838143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 0x55c5965f6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088aa2c640 1 -- 172.21.15.45:0/4171838143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 msgr2=0x55c5965f6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088aa2c640 1 --2- 172.21.15.45:0/4171838143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 0x55c5965f6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088aa2c640 1 -- 172.21.15.45:0/4171838143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965d6b60 msgr2=0x55c5965d95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:14.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088aa2c640 1 --2- 172.21.15.45:0/4171838143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965d6b60 0x55c5965d95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088aa2c640 1 -- 172.21.15.45:0/4171838143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5965d41a0 con 0x55c5965e1d40 2024-09-15T22:19:14.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f088aa2c640 1 --2- 172.21.15.45:0/4171838143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965e1d40 0x55c5965f7270 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f087c009770 tx=0x7f087c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942db0183653d41f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:14.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f086ffff640 1 -- 172.21.15.45:0/4171838143 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c016070 con 0x55c5965e1d40 2024-09-15T22:19:14.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f086ffff640 1 -- 172.21.15.45:0/4171838143 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f087c025040 con 0x55c5965e1d40 2024-09-15T22:19:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.122+0000 7f086ffff640 1 -- 172.21.15.45:0/4171838143 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c004230 con 0x55c5965e1d40 2024-09-15T22:19:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.123+0000 7f088e868740 1 -- 172.21.15.45:0/4171838143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965e1d40 msgr2=0x55c5965f7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.123+0000 7f088e868740 1 --2- 172.21.15.45:0/4171838143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965e1d40 0x55c5965f7270 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f087c009770 tx=0x7f087c010800 comp rx=0 tx=0).stop 2024-09-15T22:19:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.123+0000 7f088e868740 1 -- 172.21.15.45:0/4171838143 shutdown_connections 2024-09-15T22:19:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.123+0000 7f088e868740 1 --2- 172.21.15.45:0/4171838143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965e1d40 0x55c5965f7270 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.123+0000 7f088e868740 1 --2- 172.21.15.45:0/4171838143 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 0x55c5965f6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.123+0000 7f088e868740 1 --2- 172.21.15.45:0/4171838143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965d6b60 0x55c5965d95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.123+0000 7f088e868740 1 -- 172.21.15.45:0/4171838143 >> 172.21.15.45:0/4171838143 conn(0x55c5965d30f0 msgr2=0x55c5965ddc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.123+0000 7f088e868740 1 -- 172.21.15.45:0/4171838143 shutdown_connections 2024-09-15T22:19:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.123+0000 7f088e868740 1 -- 172.21.15.45:0/4171838143 wait complete. 2024-09-15T22:19:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.123+0000 7f088e868740 1 -- start start 2024-09-15T22:19:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.123+0000 7f088e868740 1 Processor -- start 2024-09-15T22:19:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088e868740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 0x55c5965f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088e868740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 0x55c5965f5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088e868740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965e1d40 0x55c5965f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088e868740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f08841adf60 con 0x55c5965d6b60 2024-09-15T22:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088e868740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f08841af3d0 con 0x55c5965e1d40 2024-09-15T22:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088e868740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f08841ae630 con 0x55c5965d7480 2024-09-15T22:19:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088e868740 10 client.0 _ll_register_callbacks cb 0x7f08800d3490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088aa2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 0x55c5965f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088aa2c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 0x55c5965f4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35616/0 (socket says 172.21.15.45:35616) 2024-09-15T22:19:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088aa2c640 1 -- 172.21.15.45:0/1390395817 learned_addr learned my addr 172.21.15.45:0/1390395817 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f0889a2a640 1 --2- 172.21.15.45:0/1390395817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 0x55c5965f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088aa2c640 1 -- 172.21.15.45:0/1390395817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 msgr2=0x55c5965f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088aa2c640 1 --2- 172.21.15.45:0/1390395817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 0x55c5965f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088aa2c640 1 -- 172.21.15.45:0/1390395817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965e1d40 msgr2=0x55c5965f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088aa2c640 1 --2- 172.21.15.45:0/1390395817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965e1d40 0x55c5965f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088aa2c640 1 -- 172.21.15.45:0/1390395817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c59665b2b0 con 0x55c5965d6b60 2024-09-15T22:19:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f088aa2c640 1 --2- 172.21.15.45:0/1390395817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 0x55c5965f4b40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f087c009890 tx=0x7f087c009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc35bca8873f6d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.124+0000 7f086dffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f086dffb640 1 -- 172.21.15.45:0/1390395817 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c016030 con 0x55c5965d6b60 2024-09-15T22:19:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f088e868740 1 -- 172.21.15.45:0/1390395817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f087c025040 con 0x55c5965d6b60 2024-09-15T22:19:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f086dffb640 1 -- 172.21.15.45:0/1390395817 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f087c0127d0 con 0x55c5965d6b60 2024-09-15T22:19:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f086dffb640 1 -- 172.21.15.45:0/1390395817 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f087c0129d0 con 0x55c5965d6b60 2024-09-15T22:19:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f088e868740 10 client.16047 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f088e868740 1 -- 172.21.15.45:0/1390395817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c59665c5b0 con 0x55c5965d6b60 2024-09-15T22:19:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f086dffb640 1 -- 172.21.15.45:0/1390395817 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f087c025040 con 0x55c5965d6b60 2024-09-15T22:19:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f086dffb640 1 -- 172.21.15.45:0/1390395817 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f087c004f00 con 0x55c5965d6b60 2024-09-15T22:19:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f088e868740 10 client.16047 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f088e868740 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f088e868740 20 client.16047 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f088e868740 1 --2- 172.21.15.45:0/1390395817 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c59665cd00 0x55c59665f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f088e868740 4 client.16047 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:19:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.125+0000 7f088e868740 1 -- 172.21.15.45:0/1390395817 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c596543d00 con 0x55c59665cd00 2024-09-15T22:19:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.126+0000 7f0889a2a640 1 --2- 172.21.15.45:0/1390395817 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c59665cd00 0x55c59665f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.126+0000 7f0889a2a640 1 --2- 172.21.15.45:0/1390395817 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c59665cd00 0x55c59665f120 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3979b1abe351056 server_cookie=2e0cdfee665078fa in_seq=0 out_seq=0 2024-09-15T22:19:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.126+0000 7f086dffb640 10 client.16047 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:14.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.127+0000 7f086dffb640 1 -- 172.21.15.45:0/1390395817 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c596543d00 con 0x55c59665cd00 2024-09-15T22:19:14.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.127+0000 7f086dffb640 10 client.16047 handle_command_reply: tid=0 2024-09-15T22:19:14.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.127+0000 7f088e868740 1 client.16047 shutdown 2024-09-15T22:19:14.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.127+0000 7f088e868740 1 -- 172.21.15.45:0/1390395817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 msgr2=0x55c5965f4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:14.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.127+0000 7f088e868740 1 --2- 172.21.15.45:0/1390395817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 0x55c5965f4b40 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f087c009890 tx=0x7f087c009c80 comp rx=0 tx=0).stop 2024-09-15T22:19:14.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.127+0000 7f088e868740 1 -- 172.21.15.45:0/1390395817 shutdown_connections 2024-09-15T22:19:14.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.127+0000 7f088e868740 1 --2- 172.21.15.45:0/1390395817 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c59665cd00 0x55c59665f120 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.127+0000 7f088e868740 1 --2- 172.21.15.45:0/1390395817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c5965e1d40 0x55c5965f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.127+0000 7f088e868740 1 --2- 172.21.15.45:0/1390395817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c5965d7480 0x55c5965f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.127+0000 7f086dffb640 0 client.16047 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.127+0000 7f088e868740 1 --2- 172.21.15.45:0/1390395817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c5965d6b60 0x55c5965f4b40 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.127+0000 7f088e868740 1 -- 172.21.15.45:0/1390395817 >> 172.21.15.45:0/1390395817 conn(0x55c5965d30f0 msgr2=0x55c5965d1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.127+0000 7f088e868740 1 -- 172.21.15.45:0/1390395817 shutdown_connections 2024-09-15T22:19:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088e868740 1 -- 172.21.15.45:0/1390395817 wait complete. 2024-09-15T22:19:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088e868740 20 client.16047 trim_cache size 0 max 16384 2024-09-15T22:19:14.149 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:19:14.149 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:19:14.149 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "c38d4ee3-a4ae-4911-af6b-ff043e10c54d", 2024-09-15T22:19:14.149 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:19:14.149 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:19:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088c48f640 1 -- 172.21.15.45:0/2811931398 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08700a33b0 msgr2=0x7f08700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088c48f640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08700a33b0 0x7f08700a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f08800cce60 tx=0x7f08800d35c0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088c48f640 1 -- 172.21.15.45:0/2811931398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884100a60 msgr2=0x7f0884198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088c48f640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884100a60 0x7f0884198540 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f088000d950 tx=0x7f088000de10 comp rx=0 tx=0).stop 2024-09-15T22:19:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088c48f640 1 -- 172.21.15.45:0/2811931398 shutdown_connections 2024-09-15T22:19:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088c48f640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08700a33b0 0x7f08700a5870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088c48f640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0884106a60 0x7f088419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088c48f640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0884101400 0x7f0884198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088c48f640 1 --2- 172.21.15.45:0/2811931398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0884100a60 0x7f0884198540 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088c48f640 1 -- 172.21.15.45:0/2811931398 >> 172.21.15.45:0/2811931398 conn(0x7f08840fc780 msgr2=0x7f08840fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:14.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088c48f640 1 -- 172.21.15.45:0/2811931398 shutdown_connections 2024-09-15T22:19:14.151 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:14.128+0000 7f088c48f640 1 -- 172.21.15.45:0/2811931398 wait complete. 2024-09-15T22:19:14.951 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:19:15.251 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:15.373 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:15 smithi045 ceph-mon[31180]: pgmap v93: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-09-15T22:19:15.373 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:15 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:19:15.373 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:15 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:19:15.373 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:15 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:19:15.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:15 smithi165 ceph-mon[35551]: pgmap v93: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-09-15T22:19:15.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:15 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:19:15.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:15 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:19:15.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:15 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:19:15.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:15 smithi100 ceph-mon[35319]: pgmap v93: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-09-15T22:19:15.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:15 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:19:15.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:15 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:19:15.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:15 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:19:15.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.734+0000 7f8f6d643640 1 -- 172.21.15.45:0/3998369147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f68101de0 msgr2=0x7f8f681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.734+0000 7f8f6d643640 1 --2- 172.21.15.45:0/3998369147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f68101de0 0x7f8f681021c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009900 tx=0x7f8f5802a410 comp rx=0 tx=0).stop 2024-09-15T22:19:15.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.734+0000 7f8f6d643640 1 -- 172.21.15.45:0/3998369147 shutdown_connections 2024-09-15T22:19:15.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.734+0000 7f8f6d643640 1 --2- 172.21.15.45:0/3998369147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f68106f10 0x7f8f6810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.734+0000 7f8f6d643640 1 --2- 172.21.15.45:0/3998369147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f68102790 0x7f8f681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.734+0000 7f8f6d643640 1 --2- 172.21.15.45:0/3998369147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f68101de0 0x7f8f681021c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.734+0000 7f8f6d643640 1 -- 172.21.15.45:0/3998369147 >> 172.21.15.45:0/3998369147 conn(0x7f8f680fd8c0 msgr2=0x7f8f680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:15.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.734+0000 7f8f6d643640 1 -- 172.21.15.45:0/3998369147 shutdown_connections 2024-09-15T22:19:15.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.734+0000 7f8f6d643640 1 -- 172.21.15.45:0/3998369147 wait complete. 2024-09-15T22:19:15.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.734+0000 7f8f6d643640 1 Processor -- start 2024-09-15T22:19:15.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f6d643640 1 -- start start 2024-09-15T22:19:15.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f6d643640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f68101de0 0x7f8f680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f6d643640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f68102790 0x7f8f68074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f6d643640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f68106f10 0x7f8f68074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f6d643640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8f68112050 con 0x7f8f68101de0 2024-09-15T22:19:15.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f6d643640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8f68111ed0 con 0x7f8f68106f10 2024-09-15T22:19:15.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f6d643640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8f681121d0 con 0x7f8f68102790 2024-09-15T22:19:15.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f66ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f68101de0 0x7f8f680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f66ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f68101de0 0x7f8f680744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56380/0 (socket says 172.21.15.45:56380) 2024-09-15T22:19:15.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f66ffd640 1 -- 172.21.15.45:0/3234864799 learned_addr learned my addr 172.21.15.45:0/3234864799 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:15.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f667fc640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f68102790 0x7f8f68074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f677fe640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f68106f10 0x7f8f68074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f66ffd640 1 -- 172.21.15.45:0/3234864799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f68102790 msgr2=0x7f8f68074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f66ffd640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f68102790 0x7f8f68074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f66ffd640 1 -- 172.21.15.45:0/3234864799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f68106f10 msgr2=0x7f8f68074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f66ffd640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f68106f10 0x7f8f68074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.735+0000 7f8f66ffd640 1 -- 172.21.15.45:0/3234864799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f681a69b0 con 0x7f8f68101de0 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.736+0000 7f8f66ffd640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f68101de0 0x7f8f680744f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8f58006010 tx=0x7f8f580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.736+0000 7f8f4ffff640 1 -- 172.21.15.45:0/3234864799 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5803f030 con 0x7f8f68101de0 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.736+0000 7f8f6d643640 1 -- 172.21.15.45:0/3234864799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f681a6c40 con 0x7f8f68101de0 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.736+0000 7f8f4ffff640 1 -- 172.21.15.45:0/3234864799 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f58003d00 con 0x7f8f68101de0 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.736+0000 7f8f4ffff640 1 -- 172.21.15.45:0/3234864799 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f58035070 con 0x7f8f68101de0 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.736+0000 7f8f6d643640 1 -- 172.21.15.45:0/3234864799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f681a7170 con 0x7f8f68101de0 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.738+0000 7f8f4ffff640 1 -- 172.21.15.45:0/3234864799 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8f58042030 con 0x7f8f68101de0 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.738+0000 7f8f6fa1c740 1 Processor -- start 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.738+0000 7f8f6fa1c740 1 -- start start 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f6fa1c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd374a0 0x55f6fcd37880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f6fa1c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd42140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f4ffff640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8f500a33b0 0x7f8f500a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f6fa1c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd42680 0x55f6fcd44a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f6fa1c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f6fcc9d2e0 con 0x55f6fcd37dc0 2024-09-15T22:19:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f6fa1c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f6fcc44ce0 con 0x55f6fcd374a0 2024-09-15T22:19:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f6fa1c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f6fcc992a0 con 0x55f6fcd42680 2024-09-15T22:19:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f66ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd42140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f66ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd42140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56388/0 (socket says 172.21.15.45:56388) 2024-09-15T22:19:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f66ffd640 1 -- 172.21.15.45:0/838970816 learned_addr learned my addr 172.21.15.45:0/838970816 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f667fc640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8f500a33b0 0x7f8f500a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f4ffff640 1 -- 172.21.15.45:0/3234864799 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f8f580f0980 con 0x7f8f68101de0 2024-09-15T22:19:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f677fe640 1 --2- 172.21.15.45:0/838970816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd42680 0x55f6fcd44a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f677fe640 1 --2- 172.21.15.45:0/838970816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd374a0 0x55f6fcd37880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f66ffd640 1 -- 172.21.15.45:0/838970816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd42680 msgr2=0x55f6fcd44a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f66ffd640 1 --2- 172.21.15.45:0/838970816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd42680 0x55f6fcd44a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f66ffd640 1 -- 172.21.15.45:0/838970816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd374a0 msgr2=0x55f6fcd37880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f66ffd640 1 --2- 172.21.15.45:0/838970816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd374a0 0x55f6fcd37880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f66ffd640 1 -- 172.21.15.45:0/838970816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6fcc29440 con 0x55f6fcd37dc0 2024-09-15T22:19:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f677fe640 1 --2- 172.21.15.45:0/838970816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd42680 0x55f6fcd44a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.739+0000 7f8f66ffd640 1 --2- 172.21.15.45:0/838970816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd42140 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8f58005940 tx=0x7f8f58005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09d962f716b1eb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.740+0000 7f8f667fc640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8f500a33b0 0x7f8f500a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f68075f80 tx=0x7f8f5c00a2d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.740+0000 7f8f4d7fa640 1 -- 172.21.15.45:0/838970816 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f58049070 con 0x55f6fcd37dc0 2024-09-15T22:19:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.740+0000 7f8f4d7fa640 1 -- 172.21.15.45:0/838970816 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f5809ee50 con 0x55f6fcd37dc0 2024-09-15T22:19:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.740+0000 7f8f4d7fa640 1 -- 172.21.15.45:0/838970816 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5808ea60 con 0x55f6fcd37dc0 2024-09-15T22:19:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.740+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/838970816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 msgr2=0x55f6fcd42140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.740+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/838970816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd42140 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8f58005940 tx=0x7f8f58005e00 comp rx=0 tx=0).stop 2024-09-15T22:19:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.740+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/838970816 shutdown_connections 2024-09-15T22:19:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.740+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/838970816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd42680 0x55f6fcd44a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.740+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/838970816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd42140 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.740+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/838970816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd374a0 0x55f6fcd37880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.740+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/838970816 >> 172.21.15.45:0/838970816 conn(0x55f6fcd33a30 msgr2=0x55f6fcd33e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.740+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/838970816 shutdown_connections 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.740+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/838970816 wait complete. 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.741+0000 7f8f6fa1c740 1 -- start start 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.741+0000 7f8f6fa1c740 1 Processor -- start 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.741+0000 7f8f6fa1c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd374a0 0x55f6fcd41fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.741+0000 7f8f6fa1c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd3f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.741+0000 7f8f6fa1c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd42680 0x55f6fcd3f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.741+0000 7f8f6fa1c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f6fcd45010 con 0x55f6fcd374a0 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.741+0000 7f8f6fa1c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f6fcc58050 con 0x55f6fcd37dc0 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.741+0000 7f8f6fa1c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55f6fcd45190 con 0x55f6fcd42680 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.741+0000 7f8f6fa1c740 10 client.0 _ll_register_callbacks cb 0x55f6fcc98160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.741+0000 7f8f66ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd374a0 0x55f6fcd41fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.741+0000 7f8f66ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd374a0 0x55f6fcd41fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56398/0 (socket says 172.21.15.45:56398) 2024-09-15T22:19:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.741+0000 7f8f66ffd640 1 -- 172.21.15.45:0/2581872368 learned_addr learned my addr 172.21.15.45:0/2581872368 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f667fc640 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd3f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f677fe640 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd42680 0x55f6fcd3f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f66ffd640 1 -- 172.21.15.45:0/2581872368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd42680 msgr2=0x55f6fcd3f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f66ffd640 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd42680 0x55f6fcd3f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f66ffd640 1 -- 172.21.15.45:0/2581872368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd37dc0 msgr2=0x55f6fcd3f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f66ffd640 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd3f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f66ffd640 1 -- 172.21.15.45:0/2581872368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6fca0e3c0 con 0x55f6fcd374a0 2024-09-15T22:19:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f677fe640 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd42680 0x55f6fcd3f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f66ffd640 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd374a0 0x55f6fcd41fa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8f580c4f80 tx=0x7f8f5803b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94388bb647d929d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f4aff5640 1 -- 172.21.15.45:0/2581872368 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f58049070 con 0x55f6fcd374a0 2024-09-15T22:19:15.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f4aff5640 1 -- 172.21.15.45:0/2581872368 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f8f580b8eb0 con 0x55f6fcd374a0 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/2581872368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f5809ee50 con 0x55f6fcd374a0 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f4aff5640 1 -- 172.21.15.45:0/2581872368 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8f580bc1a0 con 0x55f6fcd374a0 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f6fa1c740 10 client.16059 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/2581872368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f6fcd45010 con 0x55f6fcd374a0 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.742+0000 7f8f4aff5640 1 -- 172.21.15.45:0/2581872368 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f5809ee50 con 0x55f6fcd374a0 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.743+0000 7f8f4aff5640 1 -- 172.21.15.45:0/2581872368 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8f580edf30 con 0x55f6fcd374a0 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.743+0000 7f8f6fa1c740 10 client.16059 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.743+0000 7f8f6fa1c740 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.743+0000 7f8f6fa1c740 20 client.16059 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.743+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f6fcd51b90 0x55f6fcd53f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.743+0000 7f8f6fa1c740 4 client.16059 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.743+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/2581872368 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6fccaa850 con 0x55f6fcd51b90 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.743+0000 7f8f667fc640 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f6fcd51b90 0x55f6fcd53f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f4aff5640 10 client.16059 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f667fc640 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f6fcd51b90 0x55f6fcd53f80 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8425fe56a4241b99 server_cookie=69fe260630edc4b3 in_seq=0 out_seq=0 2024-09-15T22:19:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f4aff5640 1 -- 172.21.15.45:0/2581872368 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6fccaa850 con 0x55f6fcd51b90 2024-09-15T22:19:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f4aff5640 10 client.16059 handle_command_reply: tid=0 2024-09-15T22:19:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f6fa1c740 1 client.16059 shutdown 2024-09-15T22:19:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/2581872368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd374a0 msgr2=0x55f6fcd41fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd374a0 0x55f6fcd41fa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8f580c4f80 tx=0x7f8f5803b690 comp rx=0 tx=0).stop 2024-09-15T22:19:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/2581872368 shutdown_connections 2024-09-15T22:19:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f6fcd51b90 0x55f6fcd53f80 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd42680 0x55f6fcd3f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd3f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/2581872368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd374a0 0x55f6fcd41fa0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f4aff5640 0 client.16059 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:15.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.744+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/2581872368 >> 172.21.15.45:0/2581872368 conn(0x55f6fcd33a30 msgr2=0x55f6fcd32b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.745+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/2581872368 shutdown_connections 2024-09-15T22:19:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.745+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/2581872368 wait complete. 2024-09-15T22:19:15.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.745+0000 7f8f6fa1c740 20 client.16059 trim_cache size 0 max 16384 2024-09-15T22:19:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f6fa1c740 1 Processor -- start 2024-09-15T22:19:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f6fa1c740 1 -- start start 2024-09-15T22:19:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f6fa1c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd374a0 0x55f6fcd4e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f6fa1c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd59830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f6fa1c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd42680 0x55f6fcd59d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f6fa1c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8f681af300 con 0x55f6fcd37dc0 2024-09-15T22:19:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f6fa1c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8f681b1b80 con 0x55f6fcd42680 2024-09-15T22:19:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f6fa1c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8f681af970 con 0x55f6fcd374a0 2024-09-15T22:19:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f667fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd59830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f667fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd59830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56406/0 (socket says 172.21.15.45:56406) 2024-09-15T22:19:15.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f667fc640 1 -- 172.21.15.45:0/1955539176 learned_addr learned my addr 172.21.15.45:0/1955539176 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:15.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f667fc640 1 -- 172.21.15.45:0/1955539176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd374a0 msgr2=0x55f6fcd4e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f66ffd640 1 --2- 172.21.15.45:0/1955539176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd374a0 0x55f6fcd4e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f677fe640 1 --2- 172.21.15.45:0/1955539176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd42680 0x55f6fcd59d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f667fc640 1 --2- 172.21.15.45:0/1955539176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd374a0 0x55f6fcd4e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f667fc640 1 -- 172.21.15.45:0/1955539176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd42680 msgr2=0x55f6fcd59d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f667fc640 1 --2- 172.21.15.45:0/1955539176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd42680 0x55f6fcd59d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.762+0000 7f8f667fc640 1 -- 172.21.15.45:0/1955539176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6fcd38330 con 0x55f6fcd37dc0 2024-09-15T22:19:15.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.763+0000 7f8f667fc640 1 --2- 172.21.15.45:0/1955539176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd59830 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00ff20 tx=0x7f8f5c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8352bd96ccf12340 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:15.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.763+0000 7f8f4cff9640 1 -- 172.21.15.45:0/1955539176 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c016070 con 0x55f6fcd37dc0 2024-09-15T22:19:15.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.763+0000 7f8f4cff9640 1 -- 172.21.15.45:0/1955539176 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f5c02b070 con 0x55f6fcd37dc0 2024-09-15T22:19:15.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.763+0000 7f8f4cff9640 1 -- 172.21.15.45:0/1955539176 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c01c8e0 con 0x55f6fcd37dc0 2024-09-15T22:19:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.763+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/1955539176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 msgr2=0x55f6fcd59830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.763+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/1955539176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd59830 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c00ff20 tx=0x7f8f5c012000 comp rx=0 tx=0).stop 2024-09-15T22:19:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.763+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/1955539176 shutdown_connections 2024-09-15T22:19:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.763+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/1955539176 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd42680 0x55f6fcd59d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.763+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/1955539176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd59830 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.763+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/1955539176 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd374a0 0x55f6fcd4e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.763+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/1955539176 >> 172.21.15.45:0/1955539176 conn(0x55f6fcd33a30 msgr2=0x55f6fcd412d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/1955539176 shutdown_connections 2024-09-15T22:19:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/1955539176 wait complete. 2024-09-15T22:19:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f6fa1c740 1 -- start start 2024-09-15T22:19:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f6fa1c740 1 Processor -- start 2024-09-15T22:19:15.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f6fa1c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd374a0 0x55f6fcd464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f6fa1c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd46a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f6fa1c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd42680 0x55f6fcdbb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f6fa1c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8f681b0040 con 0x55f6fcd42680 2024-09-15T22:19:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f6fa1c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8f681b14b0 con 0x55f6fcd374a0 2024-09-15T22:19:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f6fa1c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8f681b0710 con 0x55f6fcd37dc0 2024-09-15T22:19:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f6fa1c740 10 client.0 _ll_register_callbacks cb 0x7f8f580044e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd42680 0x55f6fcdbb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd42680 0x55f6fcdbb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56420/0 (socket says 172.21.15.45:56420) 2024-09-15T22:19:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.764+0000 7f8f677fe640 1 -- 172.21.15.45:0/1263472350 learned_addr learned my addr 172.21.15.45:0/1263472350 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f66ffd640 1 --2- 172.21.15.45:0/1263472350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd374a0 0x55f6fcd464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f667fc640 1 --2- 172.21.15.45:0/1263472350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd46a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f677fe640 1 -- 172.21.15.45:0/1263472350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd37dc0 msgr2=0x55f6fcd46a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f677fe640 1 --2- 172.21.15.45:0/1263472350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd46a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f677fe640 1 -- 172.21.15.45:0/1263472350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd374a0 msgr2=0x55f6fcd464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f677fe640 1 --2- 172.21.15.45:0/1263472350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd374a0 0x55f6fcd464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f677fe640 1 -- 172.21.15.45:0/1263472350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6fcdbbd40 con 0x55f6fcd42680 2024-09-15T22:19:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f677fe640 1 --2- 172.21.15.45:0/1263472350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd42680 0x55f6fcdbb800 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009f80 tx=0x7f8f60012880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c1e91af2573a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f4aff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f4aff5640 1 -- 172.21.15.45:0/1263472350 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f600115f0 con 0x55f6fcd42680 2024-09-15T22:19:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f4aff5640 1 -- 172.21.15.45:0/1263472350 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f8f60011790 con 0x55f6fcd42680 2024-09-15T22:19:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/1263472350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f5c02b070 con 0x55f6fcd42680 2024-09-15T22:19:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f4aff5640 1 -- 172.21.15.45:0/1263472350 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8f60011990 con 0x55f6fcd42680 2024-09-15T22:19:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f6fa1c740 10 client.16065 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/1263472350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f6fcdbcf90 con 0x55f6fcd42680 2024-09-15T22:19:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.765+0000 7f8f4aff5640 1 -- 172.21.15.45:0/1263472350 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8f5c02b070 con 0x55f6fcd42680 2024-09-15T22:19:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.766+0000 7f8f4aff5640 1 -- 172.21.15.45:0/1263472350 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8f6001b3c0 con 0x55f6fcd42680 2024-09-15T22:19:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.766+0000 7f8f6fa1c740 10 client.16065 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.766+0000 7f8f6fa1c740 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.766+0000 7f8f6fa1c740 20 client.16065 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.766+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/1263472350 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f6fcdbd730 0x55f6fcdbfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.766+0000 7f8f6fa1c740 4 client.16065 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:19:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.766+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/1263472350 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f6fcca4d60 con 0x55f6fcdbd730 2024-09-15T22:19:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.766+0000 7f8f66ffd640 1 --2- 172.21.15.45:0/1263472350 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f6fcdbd730 0x55f6fcdbfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.766+0000 7f8f66ffd640 1 --2- 172.21.15.45:0/1263472350 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f6fcdbd730 0x55f6fcdbfb50 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3c48270058fc9f6 server_cookie=425813433f522504 in_seq=0 out_seq=0 2024-09-15T22:19:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.766+0000 7f8f4aff5640 10 client.16065 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f4aff5640 1 -- 172.21.15.45:0/1263472350 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f6fcca4d60 con 0x55f6fcdbd730 2024-09-15T22:19:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f4aff5640 10 client.16065 handle_command_reply: tid=0 2024-09-15T22:19:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6fa1c740 1 client.16065 shutdown 2024-09-15T22:19:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/1263472350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd42680 msgr2=0x55f6fcdbb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/1263472350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd42680 0x55f6fcdbb800 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8f60009f80 tx=0x7f8f60012880 comp rx=0 tx=0).stop 2024-09-15T22:19:15.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/1263472350 shutdown_connections 2024-09-15T22:19:15.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/1263472350 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55f6fcdbd730 0x55f6fcdbfb50 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/1263472350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f6fcd42680 0x55f6fcdbb800 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/1263472350 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55f6fcd37dc0 0x55f6fcd46a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f4aff5640 0 client.16065 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:15.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6fa1c740 1 --2- 172.21.15.45:0/1263472350 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f6fcd374a0 0x55f6fcd464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/1263472350 >> 172.21.15.45:0/1263472350 conn(0x55f6fcd33a30 msgr2=0x55f6fcd3eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:15.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/1263472350 shutdown_connections 2024-09-15T22:19:15.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6fa1c740 1 -- 172.21.15.45:0/1263472350 wait complete. 2024-09-15T22:19:15.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6fa1c740 20 client.16065 trim_cache size 0 max 16384 2024-09-15T22:19:15.774 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:19:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:19:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:19:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: "c38d4ee3-a4ae-4911-af6b-ff043e10c54d": { 2024-09-15T22:19:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:19:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "c38d4ee3-a4ae-4911-af6b-ff043e10c54d", 2024-09-15T22:19:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:19:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:15.775 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:15.775 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:19:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6d643640 1 -- 172.21.15.45:0/3234864799 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8f500a33b0 msgr2=0x7f8f500a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6d643640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8f500a33b0 0x7f8f500a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f68075f80 tx=0x7f8f5c00a2d0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6d643640 1 -- 172.21.15.45:0/3234864799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f68101de0 msgr2=0x7f8f680744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6d643640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f68101de0 0x7f8f680744f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8f58006010 tx=0x7f8f580042f0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6d643640 1 -- 172.21.15.45:0/3234864799 shutdown_connections 2024-09-15T22:19:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6d643640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8f500a33b0 0x7f8f500a5870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6d643640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8f68106f10 0x7f8f68074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6d643640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8f68102790 0x7f8f68074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6d643640 1 --2- 172.21.15.45:0/3234864799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f68101de0 0x7f8f680744f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.767+0000 7f8f6d643640 1 -- 172.21.15.45:0/3234864799 >> 172.21.15.45:0/3234864799 conn(0x7f8f680fd8c0 msgr2=0x7f8f680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:15.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.768+0000 7f8f6d643640 1 -- 172.21.15.45:0/3234864799 shutdown_connections 2024-09-15T22:19:15.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:15.768+0000 7f8f6d643640 1 -- 172.21.15.45:0/3234864799 wait complete. 2024-09-15T22:19:16.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:16 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:19:16.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:16 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:19:16.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:16 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:19:16.646 INFO:tasks.cephfs.filesystem:scrub status for tag:c38d4ee3-a4ae-4911-af6b-ff043e10c54d - {'path': '/', 'tag': 'c38d4ee3-a4ae-4911-af6b-ff043e10c54d', 'options': 'recursive,force'} 2024-09-15T22:19:17.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:17 smithi165 ceph-mon[35551]: pgmap v94: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 709 KiB/s wr, 106 op/s 2024-09-15T22:19:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:17 smithi100 ceph-mon[35319]: pgmap v94: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 709 KiB/s wr, 106 op/s 2024-09-15T22:19:17.552 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:17 smithi045 ceph-mon[31180]: pgmap v94: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 709 KiB/s wr, 106 op/s 2024-09-15T22:19:19.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:19 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:19:19.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:19 smithi165 ceph-mon[35551]: pgmap v95: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 490 KiB/s wr, 65 op/s 2024-09-15T22:19:19.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:19 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:19:19.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:19 smithi100 ceph-mon[35319]: pgmap v95: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 490 KiB/s wr, 65 op/s 2024-09-15T22:19:19.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:19 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:19:19.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:19 smithi045 ceph-mon[31180]: pgmap v95: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 490 KiB/s wr, 65 op/s 2024-09-15T22:19:21.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:21 smithi165 ceph-mon[35551]: pgmap v96: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 490 KiB/s wr, 66 op/s 2024-09-15T22:19:21.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:21 smithi100 ceph-mon[35319]: pgmap v96: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 490 KiB/s wr, 66 op/s 2024-09-15T22:19:21.512 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:19:21.542 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:21 smithi045 ceph-mon[31180]: pgmap v96: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 490 KiB/s wr, 66 op/s 2024-09-15T22:19:21.783 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.279+0000 7fc2feaa8640 1 -- 172.21.15.45:0/2940540286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8106a80 msgr2=0x7fc2f8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.279+0000 7fc2feaa8640 1 --2- 172.21.15.45:0/2940540286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8106a80 0x7fc2f8106e60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009930 tx=0x7fc2e802a420 comp rx=0 tx=0).stop 2024-09-15T22:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.279+0000 7fc2feaa8640 1 -- 172.21.15.45:0/2940540286 shutdown_connections 2024-09-15T22:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.279+0000 7fc2feaa8640 1 --2- 172.21.15.45:0/2940540286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f8101420 0x7fc2f810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.279+0000 7fc2feaa8640 1 --2- 172.21.15.45:0/2940540286 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2f8100a80 0x7fc2f8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.279+0000 7fc2feaa8640 1 --2- 172.21.15.45:0/2940540286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8106a80 0x7fc2f8106e60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.279+0000 7fc2feaa8640 1 -- 172.21.15.45:0/2940540286 >> 172.21.15.45:0/2940540286 conn(0x7fc2f80fc7a0 msgr2=0x7fc2f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.279+0000 7fc2feaa8640 1 -- 172.21.15.45:0/2940540286 shutdown_connections 2024-09-15T22:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.279+0000 7fc2feaa8640 1 -- 172.21.15.45:0/2940540286 wait complete. 2024-09-15T22:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.280+0000 7fc2feaa8640 1 Processor -- start 2024-09-15T22:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.280+0000 7fc2feaa8640 1 -- start start 2024-09-15T22:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.280+0000 7fc2feaa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a80 0x7fc2f8198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.280+0000 7fc2feaa8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f8101420 0x7fc2f8198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.280+0000 7fc2feaa8640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2f8106a80 0x7fc2f819cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.280+0000 7fc2feaa8640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f8111060 con 0x7fc2f8100a80 2024-09-15T22:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.280+0000 7fc2feaa8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f8110ee0 con 0x7fc2f8101420 2024-09-15T22:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.280+0000 7fc2feaa8640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f81111e0 con 0x7fc2f8106a80 2024-09-15T22:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.280+0000 7fc2fc844640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a80 0x7fc2f8198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.280+0000 7fc2fc844640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a80 0x7fc2f8198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56436/0 (socket says 172.21.15.45:56436) 2024-09-15T22:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.280+0000 7fc2fc844640 1 -- 172.21.15.45:0/4216990432 learned_addr learned my addr 172.21.15.45:0/4216990432 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.281+0000 7fc2f7fff640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f8101420 0x7fc2f8198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:22.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.281+0000 7fc2fc844640 1 -- 172.21.15.45:0/4216990432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2f8106a80 msgr2=0x7fc2f819cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:22.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.281+0000 7fc2fc844640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2f8106a80 0x7fc2f819cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:22.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.281+0000 7fc2fc844640 1 -- 172.21.15.45:0/4216990432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f8101420 msgr2=0x7fc2f8198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:22.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.281+0000 7fc2fc844640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f8101420 0x7fc2f8198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:22.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.281+0000 7fc2fc844640 1 -- 172.21.15.45:0/4216990432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f819d600 con 0x7fc2f8100a80 2024-09-15T22:19:22.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.281+0000 7fc2f7fff640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f8101420 0x7fc2f8198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:22.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.281+0000 7fc2fc844640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a80 0x7fc2f8198650 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009a50 tx=0x7fc2e8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:22.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.281+0000 7fc2f5ffb640 1 -- 172.21.15.45:0/4216990432 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e803f030 con 0x7fc2f8100a80 2024-09-15T22:19:22.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.281+0000 7fc2feaa8640 1 -- 172.21.15.45:0/4216990432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f819d890 con 0x7fc2f8100a80 2024-09-15T22:19:22.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.281+0000 7fc2f5ffb640 1 -- 172.21.15.45:0/4216990432 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2e8003af0 con 0x7fc2f8100a80 2024-09-15T22:19:22.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.281+0000 7fc2f5ffb640 1 -- 172.21.15.45:0/4216990432 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8035070 con 0x7fc2f8100a80 2024-09-15T22:19:22.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.281+0000 7fc2feaa8640 1 -- 172.21.15.45:0/4216990432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f81a51d0 con 0x7fc2f8100a80 2024-09-15T22:19:22.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.282+0000 7fc2feaa8640 1 -- 172.21.15.45:0/4216990432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f8100f60 con 0x7fc2f8100a80 2024-09-15T22:19:22.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.284+0000 7fc2f5ffb640 1 -- 172.21.15.45:0/4216990432 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc2e8042030 con 0x7fc2f8100a80 2024-09-15T22:19:22.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.284+0000 7fc2f5ffb640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2e00a33b0 0x7fc2e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:22.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.284+0000 7fc2f5ffb640 1 -- 172.21.15.45:0/4216990432 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fc2e80f0ec0 con 0x7fc2f8100a80 2024-09-15T22:19:22.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.284+0000 7fc2f7fff640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2e00a33b0 0x7fc2e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:22.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.285+0000 7fc2f7fff640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2e00a33b0 0x7fc2e00a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec006fd0 tx=0x7fc2ec008040 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:22.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.288+0000 7fc2f5ffb640 1 -- 172.21.15.45:0/4216990432 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc2e80bd4e0 con 0x7fc2f8100a80 2024-09-15T22:19:22.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.497+0000 7fc2feaa8640 1 -- 172.21.15.45:0/4216990432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2f81999b0 con 0x7fc2f8100a80 2024-09-15T22:19:22.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.498+0000 7fc2f5ffb640 1 -- 172.21.15.45:0/4216990432 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fc2e80bcde0 con 0x7fc2f8100a80 2024-09-15T22:19:22.501 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:19:22.501 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:19:22.501 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:19:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.501+0000 7fc2feaa8640 1 -- 172.21.15.45:0/4216990432 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2e00a33b0 msgr2=0x7fc2e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.501+0000 7fc2feaa8640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2e00a33b0 0x7fc2e00a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec006fd0 tx=0x7fc2ec008040 comp rx=0 tx=0).stop 2024-09-15T22:19:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.501+0000 7fc2feaa8640 1 -- 172.21.15.45:0/4216990432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a80 msgr2=0x7fc2f8198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.501+0000 7fc2feaa8640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a80 0x7fc2f8198650 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009a50 tx=0x7fc2e8004270 comp rx=0 tx=0).stop 2024-09-15T22:19:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.501+0000 7fc2feaa8640 1 -- 172.21.15.45:0/4216990432 shutdown_connections 2024-09-15T22:19:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.501+0000 7fc2feaa8640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2e00a33b0 0x7fc2e00a5870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.501+0000 7fc2feaa8640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc2f8106a80 0x7fc2f819cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.501+0000 7fc2feaa8640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2f8101420 0x7fc2f8198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.501+0000 7fc2feaa8640 1 --2- 172.21.15.45:0/4216990432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f8100a80 0x7fc2f8198650 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.501+0000 7fc2feaa8640 1 -- 172.21.15.45:0/4216990432 >> 172.21.15.45:0/4216990432 conn(0x7fc2f80fc7a0 msgr2=0x7fc2f806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.501+0000 7fc2feaa8640 1 -- 172.21.15.45:0/4216990432 shutdown_connections 2024-09-15T22:19:22.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:22.501+0000 7fc2feaa8640 1 -- 172.21.15.45:0/4216990432 wait complete. 2024-09-15T22:19:23.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:23 smithi045 ceph-mon[31180]: pgmap v97: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 4 op/s 2024-09-15T22:19:23.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:23 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/4216990432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:23.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:23 smithi165 ceph-mon[35551]: pgmap v97: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 4 op/s 2024-09-15T22:19:23.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:23 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/4216990432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:23 smithi100 ceph-mon[35319]: pgmap v97: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 4 op/s 2024-09-15T22:19:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:23 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/4216990432' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:23.601 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db --set-id 51ff3c14 --release --await' 2024-09-15T22:19:23.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db --set-id 51ff3c14 --release --await 2024-09-15T22:19:23.902 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:24.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.373+0000 7f79ea779640 1 -- 172.21.15.45:0/1022913651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e4101de0 msgr2=0x7f79e41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.373+0000 7f79ea779640 1 --2- 172.21.15.45:0/1022913651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e4101de0 0x7f79e41021c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009900 tx=0x7f79d402a410 comp rx=0 tx=0).stop 2024-09-15T22:19:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.373+0000 7f79ea779640 1 -- 172.21.15.45:0/1022913651 shutdown_connections 2024-09-15T22:19:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.373+0000 7f79ea779640 1 --2- 172.21.15.45:0/1022913651 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79e4106f10 0x7f79e410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.373+0000 7f79ea779640 1 --2- 172.21.15.45:0/1022913651 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79e4102790 0x7f79e41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.373+0000 7f79ea779640 1 --2- 172.21.15.45:0/1022913651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e4101de0 0x7f79e41021c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.373+0000 7f79ea779640 1 -- 172.21.15.45:0/1022913651 >> 172.21.15.45:0/1022913651 conn(0x7f79e40fd8c0 msgr2=0x7f79e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.373+0000 7f79ea779640 1 -- 172.21.15.45:0/1022913651 shutdown_connections 2024-09-15T22:19:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.373+0000 7f79ea779640 1 -- 172.21.15.45:0/1022913651 wait complete. 2024-09-15T22:19:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.374+0000 7f79ea779640 1 Processor -- start 2024-09-15T22:19:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.374+0000 7f79ea779640 1 -- start start 2024-09-15T22:19:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.374+0000 7f79ea779640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79e4101de0 0x7f79e40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.374+0000 7f79ea779640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79e4102790 0x7f79e4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.374+0000 7f79ea779640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e4106f10 0x7f79e4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.374+0000 7f79ea779640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f79e4112090 con 0x7f79e4106f10 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.374+0000 7f79ea779640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f79e4111f10 con 0x7f79e4101de0 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.374+0000 7f79ea779640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f79e4112210 con 0x7f79e4102790 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.374+0000 7f79e8d16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e4106f10 0x7f79e4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.374+0000 7f79e8d16640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e4106f10 0x7f79e4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55598/0 (socket says 172.21.15.45:55598) 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.374+0000 7f79e8d16640 1 -- 172.21.15.45:0/1137939196 learned_addr learned my addr 172.21.15.45:0/1137939196 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.374+0000 7f79e3fff640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79e4101de0 0x7f79e40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.375+0000 7f79e37fe640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79e4102790 0x7f79e4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.375+0000 7f79e8d16640 1 -- 172.21.15.45:0/1137939196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79e4102790 msgr2=0x7f79e4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.375+0000 7f79e8d16640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79e4102790 0x7f79e4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.375+0000 7f79e8d16640 1 -- 172.21.15.45:0/1137939196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79e4101de0 msgr2=0x7f79e40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.375+0000 7f79e8d16640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79e4101de0 0x7f79e40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.375+0000 7f79e8d16640 1 -- 172.21.15.45:0/1137939196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e41a69e0 con 0x7f79e4106f10 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.375+0000 7f79e8d16640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e4106f10 0x7f79e4074f70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00cad0 tx=0x7f79dc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.375+0000 7f79e17fa640 1 -- 172.21.15.45:0/1137939196 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc00ae20 con 0x7f79e4106f10 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.375+0000 7f79ea779640 1 -- 172.21.15.45:0/1137939196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e41a6cd0 con 0x7f79e4106f10 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.375+0000 7f79e17fa640 1 -- 172.21.15.45:0/1137939196 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f79dc004b20 con 0x7f79e4106f10 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.375+0000 7f79e17fa640 1 -- 172.21.15.45:0/1137939196 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc00f780 con 0x7f79e4106f10 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.375+0000 7f79ea779640 1 -- 172.21.15.45:0/1137939196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e41a7260 con 0x7f79e4106f10 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.378+0000 7f79e17fa640 1 -- 172.21.15.45:0/1137939196 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f79dc004cd0 con 0x7f79e4106f10 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.378+0000 7f79ecb52740 1 Processor -- start 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.378+0000 7f79ecb52740 1 -- start start 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.378+0000 7f79ecb52740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 0x5631c79bd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.378+0000 7f79ecb52740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79bd980 0x5631c79c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.378+0000 7f79ecb52740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79c8240 0x5631c79ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.378+0000 7f79ecb52740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5631c7922620 con 0x5631c79c8240 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.378+0000 7f79ecb52740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5631c78c9e50 con 0x5631c79bd060 2024-09-15T22:19:24.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.378+0000 7f79ecb52740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5631c791e5e0 con 0x5631c79bd980 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79c8240 0x5631c79ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79c8240 0x5631c79ca630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55612/0 (socket says 172.21.15.45:55612) 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e37fe640 1 -- 172.21.15.45:0/2947695495 learned_addr learned my addr 172.21.15.45:0/2947695495 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e37fe640 1 --2- 172.21.15.45:0/2947695495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 0x5631c79bd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e3fff640 1 --2- 172.21.15.45:0/2947695495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79bd980 0x5631c79c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e37fe640 1 -- 172.21.15.45:0/2947695495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79bd980 msgr2=0x5631c79c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e37fe640 1 --2- 172.21.15.45:0/2947695495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79bd980 0x5631c79c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e37fe640 1 -- 172.21.15.45:0/2947695495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 msgr2=0x5631c79bd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e37fe640 1 --2- 172.21.15.45:0/2947695495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 0x5631c79bd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e37fe640 1 -- 172.21.15.45:0/2947695495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c78bad40 con 0x5631c79c8240 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e37fe640 1 --2- 172.21.15.45:0/2947695495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79c8240 0x5631c79ca630 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f79d8012780 tx=0x7f79d80096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27738c06080e3780 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e17fa640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f79cc0a33b0 0x7f79cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e3fff640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f79cc0a33b0 0x7f79cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79ca7fc640 1 -- 172.21.15.45:0/2947695495 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8012d00 con 0x5631c79c8240 2024-09-15T22:19:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79ca7fc640 1 -- 172.21.15.45:0/2947695495 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f79d80107d0 con 0x5631c79c8240 2024-09-15T22:19:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79ca7fc640 1 -- 172.21.15.45:0/2947695495 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d80038e0 con 0x5631c79c8240 2024-09-15T22:19:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.379+0000 7f79e17fa640 1 -- 172.21.15.45:0/1137939196 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f79dc0d0070 con 0x7f79e4106f10 2024-09-15T22:19:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.380+0000 7f79ecb52740 1 -- 172.21.15.45:0/2947695495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79c8240 msgr2=0x5631c79ca630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.380+0000 7f79e3fff640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f79cc0a33b0 0x7f79cc0a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009230 tx=0x7f79d40058d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.380+0000 7f79ecb52740 1 --2- 172.21.15.45:0/2947695495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79c8240 0x5631c79ca630 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f79d8012780 tx=0x7f79d80096e0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.380+0000 7f79ecb52740 1 -- 172.21.15.45:0/2947695495 shutdown_connections 2024-09-15T22:19:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.380+0000 7f79ecb52740 1 --2- 172.21.15.45:0/2947695495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79c8240 0x5631c79ca630 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.380+0000 7f79ecb52740 1 --2- 172.21.15.45:0/2947695495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79bd980 0x5631c79c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.380+0000 7f79ecb52740 1 --2- 172.21.15.45:0/2947695495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 0x5631c79bd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.380+0000 7f79ecb52740 1 -- 172.21.15.45:0/2947695495 >> 172.21.15.45:0/2947695495 conn(0x5631c79b95f0 msgr2=0x5631c79b99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.380+0000 7f79ecb52740 1 -- 172.21.15.45:0/2947695495 shutdown_connections 2024-09-15T22:19:24.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.380+0000 7f79ecb52740 1 -- 172.21.15.45:0/2947695495 wait complete. 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.380+0000 7f79ecb52740 1 -- start start 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.381+0000 7f79ecb52740 1 Processor -- start 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.381+0000 7f79ecb52740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79bd060 0x5631c79c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.381+0000 7f79ecb52740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.381+0000 7f79ecb52740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79c8240 0x5631c79c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.381+0000 7f79ecb52740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5631c79cae10 con 0x5631c79bd980 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.381+0000 7f79ecb52740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5631c78aaf10 con 0x5631c79c8240 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.381+0000 7f79ecb52740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5631c79caf90 con 0x5631c79bd060 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.381+0000 7f79ecb52740 10 client.0 _ll_register_callbacks cb 0x5631c78cedb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.381+0000 7f79e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.381+0000 7f79e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55622/0 (socket says 172.21.15.45:55622) 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.381+0000 7f79e37fe640 1 -- 172.21.15.45:0/3551612503 learned_addr learned my addr 172.21.15.45:0/3551612503 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.381+0000 7f79e3fff640 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79bd060 0x5631c79c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.381+0000 7f79e8d16640 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79c8240 0x5631c79c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79e37fe640 1 -- 172.21.15.45:0/3551612503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79bd060 msgr2=0x5631c79c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79e37fe640 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79bd060 0x5631c79c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79e37fe640 1 -- 172.21.15.45:0/3551612503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79c8240 msgr2=0x5631c79c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79e37fe640 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79c8240 0x5631c79c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79e37fe640 1 -- 172.21.15.45:0/3551612503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c7631580 con 0x5631c79bd980 2024-09-15T22:19:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79e8d16640 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79c8240 0x5631c79c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79e37fe640 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79c5730 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f79d8001eb0 tx=0x7f79d8010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c50beede10d5645 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79c37fe640 1 -- 172.21.15.45:0/3551612503 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8005250 con 0x5631c79bd980 2024-09-15T22:19:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79c37fe640 1 -- 172.21.15.45:0/3551612503 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f79d80053f0 con 0x5631c79bd980 2024-09-15T22:19:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79ecb52740 1 -- 172.21.15.45:0/3551612503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79d80107d0 con 0x5631c79bd980 2024-09-15T22:19:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79c37fe640 1 -- 172.21.15.45:0/3551612503 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f79d80055f0 con 0x5631c79bd980 2024-09-15T22:19:24.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79ecb52740 10 client.16083 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79ecb52740 1 -- 172.21.15.45:0/3551612503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5631c76fb960 con 0x5631c79bd980 2024-09-15T22:19:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.382+0000 7f79c37fe640 1 -- 172.21.15.45:0/3551612503 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f79d80107d0 con 0x5631c79bd980 2024-09-15T22:19:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.383+0000 7f79c37fe640 1 -- 172.21.15.45:0/3551612503 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f79d801f940 con 0x5631c79bd980 2024-09-15T22:19:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.383+0000 7f79ecb52740 10 client.16083 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.383+0000 7f79ecb52740 10 client.16083 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:19:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.383+0000 7f79ecb52740 20 client.16083 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.383+0000 7f79ecb52740 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5631c79d7db0 0x5631c79da1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.383+0000 7f79ecb52740 4 client.16083 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.383+0000 7f79ecb52740 1 -- 172.21.15.45:0/3551612503 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631c792fb90 con 0x5631c79d7db0 2024-09-15T22:19:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.383+0000 7f79e3fff640 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5631c79d7db0 0x5631c79da1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.384+0000 7f79c37fe640 10 client.16083 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.384+0000 7f79e3fff640 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5631c79d7db0 0x5631c79da1a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a08c1b4a1a797343 server_cookie=820ef36f3ee67c09 in_seq=0 out_seq=0 2024-09-15T22:19:24.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79c37fe640 1 -- 172.21.15.45:0/3551612503 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631c792fb90 con 0x5631c79d7db0 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79c37fe640 10 client.16083 handle_command_reply: tid=0 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79ecb52740 1 client.16083 shutdown 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79ecb52740 1 -- 172.21.15.45:0/3551612503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 msgr2=0x5631c79c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79ecb52740 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79c5730 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f79d8001eb0 tx=0x7f79d8010e50 comp rx=0 tx=0).stop 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79ecb52740 1 -- 172.21.15.45:0/3551612503 shutdown_connections 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79ecb52740 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5631c79d7db0 0x5631c79da1a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79ecb52740 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79c8240 0x5631c79c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79ecb52740 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79c5730 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79c37fe640 0 client.16083 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79ecb52740 1 --2- 172.21.15.45:0/3551612503 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79bd060 0x5631c79c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79ecb52740 1 -- 172.21.15.45:0/3551612503 >> 172.21.15.45:0/3551612503 conn(0x5631c79b95f0 msgr2=0x5631c79bf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79ecb52740 1 -- 172.21.15.45:0/3551612503 shutdown_connections 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79ecb52740 1 -- 172.21.15.45:0/3551612503 wait complete. 2024-09-15T22:19:24.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.385+0000 7f79ecb52740 20 client.16083 trim_cache size 0 max 16384 2024-09-15T22:19:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.402+0000 7f79ecb52740 1 Processor -- start 2024-09-15T22:19:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.402+0000 7f79ecb52740 1 -- start start 2024-09-15T22:19:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79ecb52740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 0x5631c79c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79ecb52740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79df890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79ecb52740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79c8240 0x5631c79dfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79ecb52740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f79e41af3d0 con 0x5631c79bd980 2024-09-15T22:19:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79ecb52740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f79e41b1c50 con 0x5631c79bd060 2024-09-15T22:19:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79ecb52740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f79e41afa40 con 0x5631c79c8240 2024-09-15T22:19:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79df890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79df890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55624/0 (socket says 172.21.15.45:55624) 2024-09-15T22:19:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79e37fe640 1 -- 172.21.15.45:0/2282235906 learned_addr learned my addr 172.21.15.45:0/2282235906 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79e8d16640 1 --2- 172.21.15.45:0/2282235906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79c8240 0x5631c79dfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79e3fff640 1 --2- 172.21.15.45:0/2282235906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 0x5631c79c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79e37fe640 1 -- 172.21.15.45:0/2282235906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79c8240 msgr2=0x5631c79dfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79e37fe640 1 --2- 172.21.15.45:0/2282235906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79c8240 0x5631c79dfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79e37fe640 1 -- 172.21.15.45:0/2282235906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 msgr2=0x5631c79c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79e37fe640 1 --2- 172.21.15.45:0/2282235906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 0x5631c79c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79e37fe640 1 -- 172.21.15.45:0/2282235906 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c79bd7b0 con 0x5631c79bd980 2024-09-15T22:19:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79e8d16640 1 --2- 172.21.15.45:0/2282235906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79c8240 0x5631c79dfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.403+0000 7f79e37fe640 1 --2- 172.21.15.45:0/2282235906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79df890 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f79d8012f10 tx=0x7f79d80058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1cc4cea30836f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.404+0000 7f79c9ffb640 1 -- 172.21.15.45:0/2282235906 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8039070 con 0x5631c79bd980 2024-09-15T22:19:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.404+0000 7f79c9ffb640 1 -- 172.21.15.45:0/2282235906 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f79d8009a30 con 0x5631c79bd980 2024-09-15T22:19:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.404+0000 7f79c9ffb640 1 -- 172.21.15.45:0/2282235906 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8004640 con 0x5631c79bd980 2024-09-15T22:19:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.404+0000 7f79ecb52740 1 -- 172.21.15.45:0/2282235906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 msgr2=0x5631c79df890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.404+0000 7f79ecb52740 1 --2- 172.21.15.45:0/2282235906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79df890 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f79d8012f10 tx=0x7f79d80058d0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.404+0000 7f79ecb52740 1 -- 172.21.15.45:0/2282235906 shutdown_connections 2024-09-15T22:19:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.404+0000 7f79ecb52740 1 --2- 172.21.15.45:0/2282235906 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79c8240 0x5631c79dfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.404+0000 7f79ecb52740 1 --2- 172.21.15.45:0/2282235906 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79df890 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.404+0000 7f79ecb52740 1 --2- 172.21.15.45:0/2282235906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 0x5631c79c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.404+0000 7f79ecb52740 1 -- 172.21.15.45:0/2282235906 >> 172.21.15.45:0/2282235906 conn(0x5631c79b95f0 msgr2=0x5631c79bf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.404+0000 7f79ecb52740 1 -- 172.21.15.45:0/2282235906 shutdown_connections 2024-09-15T22:19:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.404+0000 7f79ecb52740 1 -- 172.21.15.45:0/2282235906 wait complete. 2024-09-15T22:19:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.405+0000 7f79ecb52740 1 -- start start 2024-09-15T22:19:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.405+0000 7f79ecb52740 1 Processor -- start 2024-09-15T22:19:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.405+0000 7f79ecb52740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 0x5631c79cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.405+0000 7f79ecb52740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.405+0000 7f79ecb52740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79c8240 0x5631c79cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.405+0000 7f79ecb52740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f79e41b0110 con 0x5631c79bd980 2024-09-15T22:19:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.405+0000 7f79ecb52740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f79e41b1580 con 0x5631c79bd060 2024-09-15T22:19:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.405+0000 7f79ecb52740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f79e41b07e0 con 0x5631c79c8240 2024-09-15T22:19:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.405+0000 7f79ecb52740 10 client.0 _ll_register_callbacks cb 0x7f79d8012650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.405+0000 7f79e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.405+0000 7f79e37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55630/0 (socket says 172.21.15.45:55630) 2024-09-15T22:19:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79e37fe640 1 -- 172.21.15.45:0/3745477203 learned_addr learned my addr 172.21.15.45:0/3745477203 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79e3fff640 1 --2- 172.21.15.45:0/3745477203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 0x5631c79cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79e8d16640 1 --2- 172.21.15.45:0/3745477203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79c8240 0x5631c79cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79e37fe640 1 -- 172.21.15.45:0/3745477203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79c8240 msgr2=0x5631c79cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79e37fe640 1 --2- 172.21.15.45:0/3745477203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79c8240 0x5631c79cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79e37fe640 1 -- 172.21.15.45:0/3745477203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 msgr2=0x5631c79cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79e37fe640 1 --2- 172.21.15.45:0/3745477203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 0x5631c79cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79e37fe640 1 -- 172.21.15.45:0/3745477203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c7a41860 con 0x5631c79bd980 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79e37fe640 1 --2- 172.21.15.45:0/3745477203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79cc440 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f79d8014010 tx=0x7f79d8010820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a19156b613f481 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79c37fe640 1 -- 172.21.15.45:0/3745477203 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79d8039020 con 0x5631c79bd980 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79c37fe640 1 -- 172.21.15.45:0/3745477203 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f79d801f8b0 con 0x5631c79bd980 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79ecb52740 1 -- 172.21.15.45:0/3745477203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79d8009a30 con 0x5631c79bd980 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79c37fe640 1 -- 172.21.15.45:0/3745477203 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f79d801fad0 con 0x5631c79bd980 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79ecb52740 10 client.16089 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.406+0000 7f79ecb52740 1 -- 172.21.15.45:0/3745477203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5631c7a42b50 con 0x5631c79bd980 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.407+0000 7f79c37fe640 1 -- 172.21.15.45:0/3745477203 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f79d8009a30 con 0x5631c79bd980 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.407+0000 7f79c37fe640 1 -- 172.21.15.45:0/3745477203 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f79d8034840 con 0x5631c79bd980 2024-09-15T22:19:24.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.407+0000 7f79ecb52740 10 client.16089 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.407+0000 7f79ecb52740 10 client.16089 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:19:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.407+0000 7f79ecb52740 20 client.16089 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.407+0000 7f79ecb52740 1 --2- 172.21.15.45:0/3745477203 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5631c7a43070 0x5631c7a45460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.407+0000 7f79ecb52740 4 client.16089 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "51ff3c14", "release": true, "await": true}] 2024-09-15T22:19:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.407+0000 7f79ecb52740 1 -- 172.21.15.45:0/3745477203 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "quiesce db", "set_id": "51ff3c14", "release": true, "await": true}) -- 0x5631c792a0a0 con 0x5631c7a43070 2024-09-15T22:19:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.407+0000 7f79e3fff640 1 --2- 172.21.15.45:0/3745477203 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5631c7a43070 0x5631c7a45460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.407+0000 7f79c37fe640 10 client.16089 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:24.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.407+0000 7f79e3fff640 1 --2- 172.21.15.45:0/3745477203 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5631c7a43070 0x5631c7a45460 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45bc3eebfc9e4259 server_cookie=635ca1a29f7e8ea3 in_seq=0 out_seq=0 2024-09-15T22:19:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79c37fe640 1 -- 172.21.15.45:0/3745477203 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5631c792a0a0 con 0x5631c7a43070 2024-09-15T22:19:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79c37fe640 10 client.16089 handle_command_reply: tid=0 2024-09-15T22:19:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79ecb52740 1 client.16089 shutdown 2024-09-15T22:19:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79ecb52740 1 -- 172.21.15.45:0/3745477203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 msgr2=0x5631c79cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79ecb52740 1 --2- 172.21.15.45:0/3745477203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79cc440 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f79d8014010 tx=0x7f79d8010820 comp rx=0 tx=0).stop 2024-09-15T22:19:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79ecb52740 1 -- 172.21.15.45:0/3745477203 shutdown_connections 2024-09-15T22:19:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79ecb52740 1 --2- 172.21.15.45:0/3745477203 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5631c7a43070 0x5631c7a45460 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79ecb52740 1 --2- 172.21.15.45:0/3745477203 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5631c79c8240 0x5631c79cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79ecb52740 1 --2- 172.21.15.45:0/3745477203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5631c79bd980 0x5631c79cc440 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79ecb52740 1 --2- 172.21.15.45:0/3745477203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5631c79bd060 0x5631c79cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79ecb52740 1 -- 172.21.15.45:0/3745477203 >> 172.21.15.45:0/3745477203 conn(0x5631c79b95f0 msgr2=0x5631c79b7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:24.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79c37fe640 0 client.16089 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:24.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79ecb52740 1 -- 172.21.15.45:0/3745477203 shutdown_connections 2024-09-15T22:19:24.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.551+0000 7f79ecb52740 1 -- 172.21.15.45:0/3745477203 wait complete. 2024-09-15T22:19:24.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.552+0000 7f79ecb52740 20 client.16089 trim_cache size 0 max 16384 2024-09-15T22:19:24.556 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:19:24.556 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 21, 2024-09-15T22:19:24.556 INFO:teuthology.orchestra.run.smithi045.stdout: "leader": 24476, 2024-09-15T22:19:24.556 INFO:teuthology.orchestra.run.smithi045.stdout: "set_version": 12, 2024-09-15T22:19:24.556 INFO:teuthology.orchestra.run.smithi045.stdout: "sets": { 2024-09-15T22:19:24.556 INFO:teuthology.orchestra.run.smithi045.stdout: "51ff3c14": { 2024-09-15T22:19:24.556 INFO:teuthology.orchestra.run.smithi045.stdout: "version": 12, 2024-09-15T22:19:24.556 INFO:teuthology.orchestra.run.smithi045.stdout: "age_ref": 0.0, 2024-09-15T22:19:24.556 INFO:teuthology.orchestra.run.smithi045.stdout: "state": { 2024-09-15T22:19:24.556 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RELEASED", 2024-09-15T22:19:24.556 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.0 2024-09-15T22:19:24.556 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:19:24.556 INFO:teuthology.orchestra.run.smithi045.stdout: "timeout": 90.0, 2024-09-15T22:19:24.557 INFO:teuthology.orchestra.run.smithi045.stdout: "expiration": 139.6, 2024-09-15T22:19:24.557 INFO:teuthology.orchestra.run.smithi045.stdout: "members": { 2024-09-15T22:19:24.557 INFO:teuthology.orchestra.run.smithi045.stdout: "file:/": { 2024-09-15T22:19:24.557 INFO:teuthology.orchestra.run.smithi045.stdout: "excluded": false, 2024-09-15T22:19:24.557 INFO:teuthology.orchestra.run.smithi045.stdout: "state": { 2024-09-15T22:19:24.557 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RELEASED", 2024-09-15T22:19:24.557 INFO:teuthology.orchestra.run.smithi045.stdout: "age": 0.0 2024-09-15T22:19:24.557 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:24.557 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:24.557 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:24.557 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:24.557 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:24.558 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:19:24.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.552+0000 7f79ea779640 1 -- 172.21.15.45:0/1137939196 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f79cc0a33b0 msgr2=0x7f79cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:24.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.552+0000 7f79ea779640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f79cc0a33b0 0x7f79cc0a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009230 tx=0x7f79d40058d0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.552+0000 7f79ea779640 1 -- 172.21.15.45:0/1137939196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e4106f10 msgr2=0x7f79e4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:24.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.552+0000 7f79ea779640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e4106f10 0x7f79e4074f70 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00cad0 tx=0x7f79dc00cf90 comp rx=0 tx=0).stop 2024-09-15T22:19:24.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.552+0000 7f79ea779640 1 -- 172.21.15.45:0/1137939196 shutdown_connections 2024-09-15T22:19:24.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.552+0000 7f79ea779640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f79cc0a33b0 0x7f79cc0a5870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.552+0000 7f79ea779640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79e4106f10 0x7f79e4074f70 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.552+0000 7f79ea779640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f79e4102790 0x7f79e4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.552+0000 7f79ea779640 1 --2- 172.21.15.45:0/1137939196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79e4101de0 0x7f79e40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:24.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.552+0000 7f79ea779640 1 -- 172.21.15.45:0/1137939196 >> 172.21.15.45:0/1137939196 conn(0x7f79e40fd8c0 msgr2=0x7f79e40feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:24.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.552+0000 7f79ea779640 1 -- 172.21.15.45:0/1137939196 shutdown_connections 2024-09-15T22:19:24.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:24.552+0000 7f79ea779640 1 -- 172.21.15.45:0/1137939196 wait complete. 2024-09-15T22:19:25.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:25 smithi045 ceph-mon[31180]: pgmap v98: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 6 op/s 2024-09-15T22:19:25.389 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '51ff3c14', total seconds elapsed: 23.5 2024-09-15T22:19:25.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:25 smithi165 ceph-mon[35551]: pgmap v98: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 6 op/s 2024-09-15T22:19:25.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:25 smithi100 ceph-mon[35319]: pgmap v98: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 6 op/s 2024-09-15T22:19:27.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:27 smithi165 ceph-mon[35551]: pgmap v99: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.7 KiB/s wr, 3 op/s 2024-09-15T22:19:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:27 smithi100 ceph-mon[35319]: pgmap v99: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.7 KiB/s wr, 3 op/s 2024-09-15T22:19:27.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:27 smithi045 ceph-mon[31180]: pgmap v99: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.7 KiB/s wr, 3 op/s 2024-09-15T22:19:29.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:29 smithi165 ceph-mon[35551]: pgmap v100: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.7 KiB/s wr, 3 op/s 2024-09-15T22:19:29.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:29 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:29 smithi100 ceph-mon[35319]: pgmap v100: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.7 KiB/s wr, 3 op/s 2024-09-15T22:19:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:29 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:29.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:29 smithi045 ceph-mon[31180]: pgmap v100: 129 pgs: 129 active+clean; 268 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 5.7 KiB/s wr, 3 op/s 2024-09-15T22:19:29.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:29 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:19:30.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:30 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:30.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:30 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:30.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:30 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:19:30.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:30 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:30.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:30 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:30.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:30 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:19:30.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:30 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:19:30.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:30 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:19:30.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:30 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:19:31.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:31 smithi165 ceph-mon[35551]: pgmap v101: 129 pgs: 129 active+clean; 276 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 684 KiB/s wr, 108 op/s 2024-09-15T22:19:31.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:31 smithi100 ceph-mon[35319]: pgmap v101: 129 pgs: 129 active+clean; 276 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 684 KiB/s wr, 108 op/s 2024-09-15T22:19:31.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:31 smithi045 ceph-mon[31180]: pgmap v101: 129 pgs: 129 active+clean; 276 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 684 KiB/s wr, 108 op/s 2024-09-15T22:19:33.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:33 smithi165 ceph-mon[35551]: pgmap v102: 129 pgs: 129 active+clean; 276 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 683 KiB/s wr, 107 op/s 2024-09-15T22:19:33.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:33 smithi100 ceph-mon[35319]: pgmap v102: 129 pgs: 129 active+clean; 276 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 683 KiB/s wr, 107 op/s 2024-09-15T22:19:33.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:33 smithi045 ceph-mon[31180]: pgmap v102: 129 pgs: 129 active+clean; 276 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 683 KiB/s wr, 107 op/s 2024-09-15T22:19:34.737 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-15T22:19:34.737 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-15T22:19:35.052 DEBUG:teuthology.parallel:result is None 2024-09-15T22:19:35.052 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T22:19:35.083 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T22:19:35.084 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-15T22:19:35.094 INFO:tasks.quiescer:joining Quiescers 2024-09-15T22:19:35.094 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-15T22:19:35.094 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:19:35.384 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:35.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:35 smithi165 ceph-mon[35551]: pgmap v103: 129 pgs: 129 active+clean; 282 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 198 op/s 2024-09-15T22:19:35.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:35 smithi100 ceph-mon[35319]: pgmap v103: 129 pgs: 129 active+clean; 282 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 198 op/s 2024-09-15T22:19:35.523 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:35 smithi045 ceph-mon[31180]: pgmap v103: 129 pgs: 129 active+clean; 282 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 198 op/s 2024-09-15T22:19:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.017+0000 7f89a931e640 1 -- 172.21.15.45:0/873418502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a4100480 msgr2=0x7f89a4100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.017+0000 7f89a931e640 1 --2- 172.21.15.45:0/873418502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a4100480 0x7f89a4100860 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f8994009900 tx=0x7f899402a410 comp rx=0 tx=0).stop 2024-09-15T22:19:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.017+0000 7f89a931e640 1 -- 172.21.15.45:0/873418502 shutdown_connections 2024-09-15T22:19:36.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.017+0000 7f89a931e640 1 --2- 172.21.15.45:0/873418502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a41055b0 0x7f89a410d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.017+0000 7f89a931e640 1 --2- 172.21.15.45:0/873418502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89a4100e30 0x7f89a4104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.017+0000 7f89a931e640 1 --2- 172.21.15.45:0/873418502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a4100480 0x7f89a4100860 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.017+0000 7f89a931e640 1 -- 172.21.15.45:0/873418502 >> 172.21.15.45:0/873418502 conn(0x7f89a4077210 msgr2=0x7f89a40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.017+0000 7f89a931e640 1 -- 172.21.15.45:0/873418502 shutdown_connections 2024-09-15T22:19:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.017+0000 7f89a931e640 1 -- 172.21.15.45:0/873418502 wait complete. 2024-09-15T22:19:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.018+0000 7f89a931e640 1 Processor -- start 2024-09-15T22:19:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.018+0000 7f89a931e640 1 -- start start 2024-09-15T22:19:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.018+0000 7f89a931e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a4100480 0x7f89a4198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.018+0000 7f89a931e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a4100e30 0x7f89a4198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.018+0000 7f89a931e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89a41055b0 0x7f89a419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.018+0000 7f89a931e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f89a41120d0 con 0x7f89a4100480 2024-09-15T22:19:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.018+0000 7f89a931e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f89a4111f50 con 0x7f89a4100e30 2024-09-15T22:19:36.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.018+0000 7f89a931e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f89a4112250 con 0x7f89a41055b0 2024-09-15T22:19:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.018+0000 7f89a2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a4100480 0x7f89a4198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.018+0000 7f89a2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a4100480 0x7f89a4198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59898/0 (socket says 172.21.15.45:59898) 2024-09-15T22:19:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.018+0000 7f89a2ffd640 1 -- 172.21.15.45:0/3901792012 learned_addr learned my addr 172.21.15.45:0/3901792012 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f89a37fe640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89a41055b0 0x7f89a419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f89a27fc640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a4100e30 0x7f89a4198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f89a2ffd640 1 -- 172.21.15.45:0/3901792012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89a41055b0 msgr2=0x7f89a419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f89a2ffd640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89a41055b0 0x7f89a419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f89a2ffd640 1 -- 172.21.15.45:0/3901792012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a4100e30 msgr2=0x7f89a4198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f89a2ffd640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a4100e30 0x7f89a4198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:36.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f89a2ffd640 1 -- 172.21.15.45:0/3901792012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a419d4e0 con 0x7f89a4100480 2024-09-15T22:19:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f89a27fc640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a4100e30 0x7f89a4198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f89a2ffd640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a4100480 0x7f89a4198530 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8994006010 tx=0x7f89940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f898bfff640 1 -- 172.21.15.45:0/3901792012 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899403f030 con 0x7f89a4100480 2024-09-15T22:19:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f89a931e640 1 -- 172.21.15.45:0/3901792012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a419d770 con 0x7f89a4100480 2024-09-15T22:19:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f898bfff640 1 -- 172.21.15.45:0/3901792012 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8994003d00 con 0x7f89a4100480 2024-09-15T22:19:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f898bfff640 1 -- 172.21.15.45:0/3901792012 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994035070 con 0x7f89a4100480 2024-09-15T22:19:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.019+0000 7f89a931e640 1 -- 172.21.15.45:0/3901792012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a41a50b0 con 0x7f89a4100480 2024-09-15T22:19:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.020+0000 7f89a931e640 1 -- 172.21.15.45:0/3901792012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a4100860 con 0x7f89a4100480 2024-09-15T22:19:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.021+0000 7f898bfff640 1 -- 172.21.15.45:0/3901792012 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8994042030 con 0x7f89a4100480 2024-09-15T22:19:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.022+0000 7f898bfff640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f898c0a33b0 0x7f898c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:36.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.022+0000 7f89a27fc640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f898c0a33b0 0x7f898c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:36.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.022+0000 7f898bfff640 1 -- 172.21.15.45:0/3901792012 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f89940f0b10 con 0x7f89a4100480 2024-09-15T22:19:36.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.023+0000 7f89a27fc640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f898c0a33b0 0x7f898c0a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f89a4102e00 tx=0x7f8998005d30 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:36.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.027+0000 7f898bfff640 1 -- 172.21.15.45:0/3901792012 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f89940bd0d0 con 0x7f89a4100480 2024-09-15T22:19:36.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.244+0000 7f89a931e640 1 -- 172.21.15.45:0/3901792012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89a4108790 con 0x7f89a4100480 2024-09-15T22:19:36.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.245+0000 7f898bfff640 1 -- 172.21.15.45:0/3901792012 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f89940bc9d0 con 0x7f89a4100480 2024-09-15T22:19:36.247 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:19:36.247 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:19:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:19:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.247+0000 7f89a931e640 1 -- 172.21.15.45:0/3901792012 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f898c0a33b0 msgr2=0x7f898c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.247+0000 7f89a931e640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f898c0a33b0 0x7f898c0a5870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f89a4102e00 tx=0x7f8998005d30 comp rx=0 tx=0).stop 2024-09-15T22:19:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.248+0000 7f89a931e640 1 -- 172.21.15.45:0/3901792012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a4100480 msgr2=0x7f89a4198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.248+0000 7f89a931e640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a4100480 0x7f89a4198530 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8994006010 tx=0x7f89940042f0 comp rx=0 tx=0).stop 2024-09-15T22:19:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.248+0000 7f89a931e640 1 -- 172.21.15.45:0/3901792012 shutdown_connections 2024-09-15T22:19:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.248+0000 7f89a931e640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f898c0a33b0 0x7f898c0a5870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.248+0000 7f89a931e640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f89a41055b0 0x7f89a419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.248+0000 7f89a931e640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89a4100e30 0x7f89a4198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.248+0000 7f89a931e640 1 --2- 172.21.15.45:0/3901792012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89a4100480 0x7f89a4198530 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.248+0000 7f89a931e640 1 -- 172.21.15.45:0/3901792012 >> 172.21.15.45:0/3901792012 conn(0x7f89a4077210 msgr2=0x7f89a4103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.248+0000 7f89a931e640 1 -- 172.21.15.45:0/3901792012 shutdown_connections 2024-09-15T22:19:36.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:36.248+0000 7f89a931e640 1 -- 172.21.15.45:0/3901792012 wait complete. 2024-09-15T22:19:37.059 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24476 quiesce db --cancel --all' 2024-09-15T22:19:37.059 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24476 quiesce db --cancel --all 2024-09-15T22:19:37.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:37 smithi045 ceph-mon[31180]: pgmap v104: 129 pgs: 129 active+clean; 285 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-15T22:19:37.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:37 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3901792012' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:37.322 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:37.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:37 smithi165 ceph-mon[35551]: pgmap v104: 129 pgs: 129 active+clean; 285 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-15T22:19:37.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:37 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3901792012' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:37.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:37 smithi100 ceph-mon[35319]: pgmap v104: 129 pgs: 129 active+clean; 285 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-15T22:19:37.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:37 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3901792012' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:37.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.824+0000 7f43c0031640 1 -- 172.21.15.45:0/2858471237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8102790 msgr2=0x7f43b81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:37.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.824+0000 7f43c0031640 1 --2- 172.21.15.45:0/2858471237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8102790 0x7f43b81067e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009900 tx=0x7f43a802a410 comp rx=0 tx=0).stop 2024-09-15T22:19:37.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.824+0000 7f43c0031640 1 -- 172.21.15.45:0/2858471237 shutdown_connections 2024-09-15T22:19:37.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.824+0000 7f43c0031640 1 --2- 172.21.15.45:0/2858471237 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43b8106f10 0x7f43b810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.824+0000 7f43c0031640 1 --2- 172.21.15.45:0/2858471237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8102790 0x7f43b81067e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.824+0000 7f43c0031640 1 --2- 172.21.15.45:0/2858471237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b8101de0 0x7f43b81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.824+0000 7f43c0031640 1 -- 172.21.15.45:0/2858471237 >> 172.21.15.45:0/2858471237 conn(0x7f43b80fd8c0 msgr2=0x7f43b80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:37.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.824+0000 7f43c0031640 1 -- 172.21.15.45:0/2858471237 shutdown_connections 2024-09-15T22:19:37.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.824+0000 7f43c0031640 1 -- 172.21.15.45:0/2858471237 wait complete. 2024-09-15T22:19:37.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.825+0000 7f43c0031640 1 Processor -- start 2024-09-15T22:19:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.825+0000 7f43c0031640 1 -- start start 2024-09-15T22:19:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.825+0000 7f43c0031640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8101de0 0x7f43b81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.825+0000 7f43c0031640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43b8102790 0x7f43b8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.825+0000 7f43c0031640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b8106f10 0x7f43b819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.825+0000 7f43c0031640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8112090 con 0x7f43b8101de0 2024-09-15T22:19:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.825+0000 7f43c0031640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8111f10 con 0x7f43b8106f10 2024-09-15T22:19:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.825+0000 7f43c0031640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8112210 con 0x7f43b8102790 2024-09-15T22:19:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.825+0000 7f43bddcd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8101de0 0x7f43b81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.825+0000 7f43bddcd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8101de0 0x7f43b81984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59924/0 (socket says 172.21.15.45:59924) 2024-09-15T22:19:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.825+0000 7f43bddcd640 1 -- 172.21.15.45:0/1566337926 learned_addr learned my addr 172.21.15.45:0/1566337926 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.825+0000 7f43bd5cc640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43b8102790 0x7f43b8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.826+0000 7f43be5ce640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b8106f10 0x7f43b819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.826+0000 7f43bddcd640 1 -- 172.21.15.45:0/1566337926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43b8102790 msgr2=0x7f43b8198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.826+0000 7f43bddcd640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43b8102790 0x7f43b8198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.826+0000 7f43bddcd640 1 -- 172.21.15.45:0/1566337926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b8106f10 msgr2=0x7f43b819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.826+0000 7f43bddcd640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b8106f10 0x7f43b819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.826+0000 7f43bddcd640 1 -- 172.21.15.45:0/1566337926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b819d480 con 0x7f43b8101de0 2024-09-15T22:19:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.826+0000 7f43bd5cc640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43b8102790 0x7f43b8198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.826+0000 7f43bddcd640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8101de0 0x7f43b81984d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f43b400c890 tx=0x7f43b400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.826+0000 7f43aeffd640 1 -- 172.21.15.45:0/1566337926 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b4004220 con 0x7f43b8101de0 2024-09-15T22:19:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.826+0000 7f43c0031640 1 -- 172.21.15.45:0/1566337926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b819d770 con 0x7f43b8101de0 2024-09-15T22:19:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.826+0000 7f43aeffd640 1 -- 172.21.15.45:0/1566337926 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f43b40043c0 con 0x7f43b8101de0 2024-09-15T22:19:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.826+0000 7f43aeffd640 1 -- 172.21.15.45:0/1566337926 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b4004b10 con 0x7f43b8101de0 2024-09-15T22:19:37.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.826+0000 7f43c0031640 1 -- 172.21.15.45:0/1566337926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b81a5050 con 0x7f43b8101de0 2024-09-15T22:19:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.828+0000 7f43aeffd640 1 -- 172.21.15.45:0/1566337926 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f43b40051b0 con 0x7f43b8101de0 2024-09-15T22:19:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.829+0000 7f43c240a740 1 Processor -- start 2024-09-15T22:19:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.829+0000 7f43c240a740 1 -- start start 2024-09-15T22:19:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.829+0000 7f43c240a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871a68e0 0x561f871a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.829+0000 7f43c240a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.829+0000 7f43c240a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871b5ff0 0x561f871b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.829+0000 7f43aeffd640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f43a40a33b0 0x7f43a40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.829+0000 7f43be5ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871a68e0 0x561f871a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.829+0000 7f43c240a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561f8710b200 con 0x561f871a68e0 2024-09-15T22:19:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.829+0000 7f43c240a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561f870b1dc0 con 0x561f871a7200 2024-09-15T22:19:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.829+0000 7f43c240a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561f871071c0 con 0x561f871b5ff0 2024-09-15T22:19:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43be5ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871a68e0 0x561f871a6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59934/0 (socket says 172.21.15.45:59934) 2024-09-15T22:19:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43be5ce640 1 -- 172.21.15.45:0/2803210254 learned_addr learned my addr 172.21.15.45:0/2803210254 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43bddcd640 1 --2- 172.21.15.45:0/2803210254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43be5ce640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f43a40a33b0 0x7f43a40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43bd5cc640 1 --2- 172.21.15.45:0/2803210254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871b5ff0 0x561f871b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43aeffd640 1 -- 172.21.15.45:0/1566337926 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f43b40d0270 con 0x7f43b8101de0 2024-09-15T22:19:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43bddcd640 1 -- 172.21.15.45:0/2803210254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871b5ff0 msgr2=0x561f871b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43bddcd640 1 --2- 172.21.15.45:0/2803210254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871b5ff0 0x561f871b83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43bddcd640 1 -- 172.21.15.45:0/2803210254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871a68e0 msgr2=0x561f871a6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43bddcd640 1 --2- 172.21.15.45:0/2803210254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871a68e0 0x561f871a6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43bddcd640 1 -- 172.21.15.45:0/2803210254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f86e7c620 con 0x561f871a7200 2024-09-15T22:19:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43be5ce640 1 --2- 172.21.15.45:0/2803210254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871a68e0 0x561f871a6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43bddcd640 1 --2- 172.21.15.45:0/2803210254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871b5ab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f43b40cd5a0 tx=0x7f43b406ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88be7acdffe9415b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43be5ce640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f43a40a33b0 0x7f43a40a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009fd0 tx=0x7f43b0009990 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.830+0000 7f43a3fff640 1 -- 172.21.15.45:0/2803210254 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b401d030 con 0x561f871a7200 2024-09-15T22:19:37.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.831+0000 7f43a3fff640 1 -- 172.21.15.45:0/2803210254 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f43b409c830 con 0x561f871a7200 2024-09-15T22:19:37.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.831+0000 7f43a3fff640 1 -- 172.21.15.45:0/2803210254 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b40987a0 con 0x561f871a7200 2024-09-15T22:19:37.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.831+0000 7f43c240a740 1 -- 172.21.15.45:0/2803210254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 msgr2=0x561f871b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:37.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.831+0000 7f43c240a740 1 --2- 172.21.15.45:0/2803210254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871b5ab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f43b40cd5a0 tx=0x7f43b406ef60 comp rx=0 tx=0).stop 2024-09-15T22:19:37.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.831+0000 7f43c240a740 1 -- 172.21.15.45:0/2803210254 shutdown_connections 2024-09-15T22:19:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.831+0000 7f43c240a740 1 --2- 172.21.15.45:0/2803210254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871b5ff0 0x561f871b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.831+0000 7f43c240a740 1 --2- 172.21.15.45:0/2803210254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871b5ab0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.831+0000 7f43c240a740 1 --2- 172.21.15.45:0/2803210254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871a68e0 0x561f871a6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.831+0000 7f43c240a740 1 -- 172.21.15.45:0/2803210254 >> 172.21.15.45:0/2803210254 conn(0x561f871a2f90 msgr2=0x561f871a3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.832+0000 7f43c240a740 1 -- 172.21.15.45:0/2803210254 shutdown_connections 2024-09-15T22:19:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.832+0000 7f43c240a740 1 -- 172.21.15.45:0/2803210254 wait complete. 2024-09-15T22:19:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.832+0000 7f43c240a740 1 -- start start 2024-09-15T22:19:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.832+0000 7f43c240a740 1 Processor -- start 2024-09-15T22:19:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.832+0000 7f43c240a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a68e0 0x561f871b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.832+0000 7f43c240a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.832+0000 7f43c240a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.832+0000 7f43c240a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561f871b8bc0 con 0x561f871b5ff0 2024-09-15T22:19:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43c240a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561f870a5c50 con 0x561f871a7200 2024-09-15T22:19:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43c240a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561f871b8d40 con 0x561f871a68e0 2024-09-15T22:19:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43c240a740 10 client.0 _ll_register_callbacks cb 0x561f870b7ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43be5ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43be5ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871b3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59940/0 (socket says 172.21.15.45:59940) 2024-09-15T22:19:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43be5ce640 1 -- 172.21.15.45:0/1809109779 learned_addr learned my addr 172.21.15.45:0/1809109779 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43bddcd640 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a68e0 0x561f871b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43bd5cc640 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43be5ce640 1 -- 172.21.15.45:0/1809109779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a68e0 msgr2=0x561f871b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43be5ce640 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a68e0 0x561f871b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43be5ce640 1 -- 172.21.15.45:0/1809109779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 msgr2=0x561f871b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43be5ce640 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43be5ce640 1 -- 172.21.15.45:0/1809109779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f871b3a80 con 0x561f871b5ff0 2024-09-15T22:19:37.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43bddcd640 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a68e0 0x561f871b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:37.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43bd5cc640 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:37.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43be5ce640 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871b3250 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f43b0015ad0 tx=0x7f43b0009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44fd7b83a7b2f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:37.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:37.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43a17fa640 1 -- 172.21.15.45:0/1809109779 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0028070 con 0x561f871b5ff0 2024-09-15T22:19:37.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43a17fa640 1 -- 172.21.15.45:0/1809109779 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f43b0004d20 con 0x561f871b5ff0 2024-09-15T22:19:37.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.833+0000 7f43c240a740 1 -- 172.21.15.45:0/1809109779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43b409c830 con 0x561f871b5ff0 2024-09-15T22:19:37.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.834+0000 7f43a17fa640 1 -- 172.21.15.45:0/1809109779 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f43b0033050 con 0x561f871b5ff0 2024-09-15T22:19:37.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.834+0000 7f43c240a740 10 client.16107 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:37.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.834+0000 7f43c240a740 1 -- 172.21.15.45:0/1809109779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561f871c4820 con 0x561f871b5ff0 2024-09-15T22:19:37.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.834+0000 7f43a17fa640 1 -- 172.21.15.45:0/1809109779 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f43b409c830 con 0x561f871b5ff0 2024-09-15T22:19:37.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.834+0000 7f43a17fa640 1 -- 172.21.15.45:0/1809109779 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f43b001e070 con 0x561f871b5ff0 2024-09-15T22:19:37.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.834+0000 7f43c240a740 10 client.16107 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:37.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.834+0000 7f43c240a740 10 client.16107 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:19:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.834+0000 7f43c240a740 20 client.16107 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.834+0000 7f43c240a740 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f871c5c30 0x561f871c8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.834+0000 7f43c240a740 4 client.16107 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.834+0000 7f43c240a740 1 -- 172.21.15.45:0/1809109779 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f87118770 con 0x561f871c5c30 2024-09-15T22:19:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.835+0000 7f43bddcd640 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f871c5c30 0x561f871c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.835+0000 7f43bddcd640 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f871c5c30 0x561f871c8080 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb79ef12b698f40d server_cookie=2e26eeb44367ceab in_seq=0 out_seq=0 2024-09-15T22:19:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.835+0000 7f43a17fa640 10 client.16107 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43a17fa640 1 -- 172.21.15.45:0/1809109779 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f87118770 con 0x561f871c5c30 2024-09-15T22:19:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43a17fa640 10 client.16107 handle_command_reply: tid=0 2024-09-15T22:19:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43c240a740 1 client.16107 shutdown 2024-09-15T22:19:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43c240a740 1 -- 172.21.15.45:0/1809109779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 msgr2=0x561f871b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43c240a740 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871b3250 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f43b0015ad0 tx=0x7f43b0009710 comp rx=0 tx=0).stop 2024-09-15T22:19:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43c240a740 1 -- 172.21.15.45:0/1809109779 shutdown_connections 2024-09-15T22:19:37.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43c240a740 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f871c5c30 0x561f871c8080 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43c240a740 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871b3250 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43a17fa640 0 client.16107 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:37.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43c240a740 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43c240a740 1 --2- 172.21.15.45:0/1809109779 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a68e0 0x561f871b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43c240a740 1 -- 172.21.15.45:0/1809109779 >> 172.21.15.45:0/1809109779 conn(0x561f871a2f90 msgr2=0x561f871a8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:37.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43c240a740 1 -- 172.21.15.45:0/1809109779 shutdown_connections 2024-09-15T22:19:37.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43c240a740 1 -- 172.21.15.45:0/1809109779 wait complete. 2024-09-15T22:19:37.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.836+0000 7f43c240a740 20 client.16107 trim_cache size 0 max 16384 2024-09-15T22:19:37.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.853+0000 7f43c240a740 1 Processor -- start 2024-09-15T22:19:37.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.853+0000 7f43c240a740 1 -- start start 2024-09-15T22:19:37.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.853+0000 7f43c240a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a68e0 0x561f871b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.853+0000 7f43c240a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.853+0000 7f43c240a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.853+0000 7f43c240a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f43b81ab000 con 0x561f871b5ff0 2024-09-15T22:19:37.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.853+0000 7f43c240a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f43b81ad880 con 0x561f871a7200 2024-09-15T22:19:37.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.853+0000 7f43c240a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f43b81ab670 con 0x561f871a68e0 2024-09-15T22:19:37.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43be5ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43be5ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59952/0 (socket says 172.21.15.45:59952) 2024-09-15T22:19:37.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43be5ce640 1 -- 172.21.15.45:0/1962474559 learned_addr learned my addr 172.21.15.45:0/1962474559 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:37.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43bddcd640 1 --2- 172.21.15.45:0/1962474559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a68e0 0x561f871b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43bd5cc640 1 --2- 172.21.15.45:0/1962474559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43be5ce640 1 -- 172.21.15.45:0/1962474559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a68e0 msgr2=0x561f871b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:37.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43be5ce640 1 --2- 172.21.15.45:0/1962474559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a68e0 0x561f871b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43be5ce640 1 -- 172.21.15.45:0/1962474559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 msgr2=0x561f871cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:37.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43be5ce640 1 --2- 172.21.15.45:0/1962474559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43be5ce640 1 -- 172.21.15.45:0/1962474559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f871a9400 con 0x561f871b5ff0 2024-09-15T22:19:37.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43bd5cc640 1 --2- 172.21.15.45:0/1962474559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:37.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43bddcd640 1 --2- 172.21.15.45:0/1962474559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a68e0 0x561f871b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:37.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43be5ce640 1 --2- 172.21.15.45:0/1962474559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871cdee0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f43b00215c0 tx=0x7f43b00092a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab72c3df496a7883 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:37.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43a37fe640 1 -- 172.21.15.45:0/1962474559 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0025070 con 0x561f871b5ff0 2024-09-15T22:19:37.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43a37fe640 1 -- 172.21.15.45:0/1962474559 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f43b0010bd0 con 0x561f871b5ff0 2024-09-15T22:19:37.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.854+0000 7f43a37fe640 1 -- 172.21.15.45:0/1962474559 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0028040 con 0x561f871b5ff0 2024-09-15T22:19:37.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.855+0000 7f43c240a740 1 -- 172.21.15.45:0/1962474559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 msgr2=0x561f871cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:37.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.855+0000 7f43c240a740 1 --2- 172.21.15.45:0/1962474559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871cdee0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f43b00215c0 tx=0x7f43b00092a0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.855+0000 7f43c240a740 1 -- 172.21.15.45:0/1962474559 shutdown_connections 2024-09-15T22:19:37.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.855+0000 7f43c240a740 1 --2- 172.21.15.45:0/1962474559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871cdee0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.855+0000 7f43c240a740 1 --2- 172.21.15.45:0/1962474559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a7200 0x561f871cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.855+0000 7f43c240a740 1 --2- 172.21.15.45:0/1962474559 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a68e0 0x561f871b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.855+0000 7f43c240a740 1 -- 172.21.15.45:0/1962474559 >> 172.21.15.45:0/1962474559 conn(0x561f871a2f90 msgr2=0x561f871ae270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:37.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.855+0000 7f43c240a740 1 -- 172.21.15.45:0/1962474559 shutdown_connections 2024-09-15T22:19:37.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.855+0000 7f43c240a740 1 -- 172.21.15.45:0/1962474559 wait complete. 2024-09-15T22:19:37.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.855+0000 7f43c240a740 1 -- start start 2024-09-15T22:19:37.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.855+0000 7f43c240a740 1 Processor -- start 2024-09-15T22:19:37.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43c240a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a68e0 0x561f871b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43c240a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a7200 0x561f871ba250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43c240a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871ba790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43c240a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f43b81abd40 con 0x561f871b5ff0 2024-09-15T22:19:37.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43be5ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871ba790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43c240a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f43b81ad1b0 con 0x561f871a68e0 2024-09-15T22:19:37.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43c240a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f43b81ac410 con 0x561f871a7200 2024-09-15T22:19:37.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43be5ce640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871ba790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59964/0 (socket says 172.21.15.45:59964) 2024-09-15T22:19:37.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43be5ce640 1 -- 172.21.15.45:0/1877493917 learned_addr learned my addr 172.21.15.45:0/1877493917 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:37.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43c240a740 10 client.0 _ll_register_callbacks cb 0x7f43b0015d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:37.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43bd5cc640 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a7200 0x561f871ba250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43bddcd640 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a68e0 0x561f871b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43be5ce640 1 -- 172.21.15.45:0/1877493917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a7200 msgr2=0x561f871ba250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:37.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43be5ce640 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a7200 0x561f871ba250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43be5ce640 1 -- 172.21.15.45:0/1877493917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a68e0 msgr2=0x561f871b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:37.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43be5ce640 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a68e0 0x561f871b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43be5ce640 1 -- 172.21.15.45:0/1877493917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f8722f970 con 0x561f871b5ff0 2024-09-15T22:19:37.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43bddcd640 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a68e0 0x561f871b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:37.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43be5ce640 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871ba790 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f43b00094c0 tx=0x7f43b0021a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d54a09d08a78697 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:37.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.856+0000 7f43a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:37.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43a17fa640 1 -- 172.21.15.45:0/1877493917 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0025040 con 0x561f871b5ff0 2024-09-15T22:19:37.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43a17fa640 1 -- 172.21.15.45:0/1877493917 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f43b0037430 con 0x561f871b5ff0 2024-09-15T22:19:37.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43c240a740 1 -- 172.21.15.45:0/1877493917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43b0010bd0 con 0x561f871b5ff0 2024-09-15T22:19:37.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43a17fa640 1 -- 172.21.15.45:0/1877493917 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f43b0015ab0 con 0x561f871b5ff0 2024-09-15T22:19:37.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43c240a740 10 client.16113 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:37.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43c240a740 1 -- 172.21.15.45:0/1877493917 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561f87230ae0 con 0x561f871b5ff0 2024-09-15T22:19:37.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43a17fa640 1 -- 172.21.15.45:0/1877493917 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f43b0010bd0 con 0x561f871b5ff0 2024-09-15T22:19:37.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43a17fa640 1 -- 172.21.15.45:0/1877493917 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f43b0040030 con 0x561f871b5ff0 2024-09-15T22:19:37.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43c240a740 10 client.16113 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:37.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43c240a740 10 client.16113 resolve_mds: validated gid 24476 aka daemon mds.b 2024-09-15T22:19:37.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43c240a740 20 client.16113 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:37.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43c240a740 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f87231150 0x561f87233570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:37.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43c240a740 4 client.16113 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-15T22:19:37.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.857+0000 7f43c240a740 1 -- 172.21.15.45:0/1877493917 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x561f87112c80 con 0x561f87231150 2024-09-15T22:19:37.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.858+0000 7f43bddcd640 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f87231150 0x561f87233570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:37.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.858+0000 7f43a17fa640 10 client.16113 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:37.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.858+0000 7f43bddcd640 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f87231150 0x561f87233570 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba8b635140203699 server_cookie=ada4606b4edda0e1 in_seq=0 out_seq=0 2024-09-15T22:19:37.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.858+0000 7f43a17fa640 1 -- 172.21.15.45:0/1877493917 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x561f87112c80 con 0x561f87231150 2024-09-15T22:19:37.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.858+0000 7f43a17fa640 10 client.16113 handle_command_reply: tid=0 2024-09-15T22:19:37.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.858+0000 7f43c240a740 1 client.16113 shutdown 2024-09-15T22:19:37.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c240a740 1 -- 172.21.15.45:0/1877493917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 msgr2=0x561f871ba790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:37.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c240a740 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871ba790 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f43b00094c0 tx=0x7f43b0021a60 comp rx=0 tx=0).stop 2024-09-15T22:19:37.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c240a740 1 -- 172.21.15.45:0/1877493917 shutdown_connections 2024-09-15T22:19:37.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c240a740 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561f87231150 0x561f87233570 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c240a740 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561f871b5ff0 0x561f871ba790 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c240a740 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561f871a7200 0x561f871ba250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43a17fa640 0 client.16113 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:37.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c240a740 1 --2- 172.21.15.45:0/1877493917 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561f871a68e0 0x561f871b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c240a740 1 -- 172.21.15.45:0/1877493917 >> 172.21.15.45:0/1877493917 conn(0x561f871a2f90 msgr2=0x561f871b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:37.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c240a740 1 -- 172.21.15.45:0/1877493917 shutdown_connections 2024-09-15T22:19:37.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c240a740 1 -- 172.21.15.45:0/1877493917 wait complete. 2024-09-15T22:19:37.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c240a740 20 client.16113 trim_cache size 0 max 16384 2024-09-15T22:19:37.868 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:19:37.868 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 21, 2024-09-15T22:19:37.868 INFO:teuthology.orchestra.run.smithi045.stdout: "leader": 24476, 2024-09-15T22:19:37.868 INFO:teuthology.orchestra.run.smithi045.stdout: "set_version": 12, 2024-09-15T22:19:37.869 INFO:teuthology.orchestra.run.smithi045.stdout: "sets": {} 2024-09-15T22:19:37.869 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:19:37.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c0031640 1 -- 172.21.15.45:0/1566337926 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f43a40a33b0 msgr2=0x7f43a40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:37.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c0031640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f43a40a33b0 0x7f43a40a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009fd0 tx=0x7f43b0009990 comp rx=0 tx=0).stop 2024-09-15T22:19:37.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c0031640 1 -- 172.21.15.45:0/1566337926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8101de0 msgr2=0x7f43b81984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:37.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c0031640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8101de0 0x7f43b81984d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f43b400c890 tx=0x7f43b400cd50 comp rx=0 tx=0).stop 2024-09-15T22:19:37.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c0031640 1 -- 172.21.15.45:0/1566337926 shutdown_connections 2024-09-15T22:19:37.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c0031640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f43a40a33b0 0x7f43a40a5870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c0031640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43b8106f10 0x7f43b819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c0031640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f43b8102790 0x7f43b8198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c0031640 1 --2- 172.21.15.45:0/1566337926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43b8101de0 0x7f43b81984d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:37.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.859+0000 7f43c0031640 1 -- 172.21.15.45:0/1566337926 >> 172.21.15.45:0/1566337926 conn(0x7f43b80fd8c0 msgr2=0x7f43b80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:37.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.860+0000 7f43c0031640 1 -- 172.21.15.45:0/1566337926 shutdown_connections 2024-09-15T22:19:37.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:37.860+0000 7f43c0031640 1 -- 172.21.15.45:0/1566337926 wait complete. 2024-09-15T22:19:38.677 INFO:tasks.quiescer:done joining Quiescers 2024-09-15T22:19:38.677 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-15T22:19:38.688 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-15T22:19:38.688 INFO:teuthology.task.exec:Executing custom commands... 2024-09-15T22:19:38.689 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi045.front.sepia.ceph.com 2024-09-15T22:19:38.689 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-15T22:19:38.720 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-15T22:19:39.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:39 smithi165 ceph-mon[35551]: pgmap v105: 129 pgs: 129 active+clean; 285 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-15T22:19:39.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:39 smithi100 ceph-mon[35319]: pgmap v105: 129 pgs: 129 active+clean; 285 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-15T22:19:39.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:39 smithi045 ceph-mon[31180]: pgmap v105: 129 pgs: 129 active+clean; 285 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-15T22:19:41.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:41 smithi165 ceph-mon[35551]: pgmap v106: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 301 op/s 2024-09-15T22:19:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:41 smithi100 ceph-mon[35319]: pgmap v106: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 301 op/s 2024-09-15T22:19:41.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:41 smithi045 ceph-mon[31180]: pgmap v106: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 301 op/s 2024-09-15T22:19:43.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:43 smithi165 ceph-mon[35551]: pgmap v107: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 195 op/s 2024-09-15T22:19:43.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:43 smithi100 ceph-mon[35319]: pgmap v107: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 195 op/s 2024-09-15T22:19:43.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:43 smithi045 ceph-mon[31180]: pgmap v107: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 195 op/s 2024-09-15T22:19:45.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:45 smithi165 ceph-mon[35551]: pgmap v108: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 200 op/s 2024-09-15T22:19:45.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:45 smithi100 ceph-mon[35319]: pgmap v108: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 200 op/s 2024-09-15T22:19:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:45 smithi045 ceph-mon[31180]: pgmap v108: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.0 MiB/s wr, 200 op/s 2024-09-15T22:19:46.647 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:19:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:47.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:47 smithi045 ceph-mon[31180]: pgmap v109: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 529 KiB/s wr, 111 op/s 2024-09-15T22:19:47.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.420+0000 7f134c5c0640 1 -- 172.21.15.45:0/3952560938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1344106f10 msgr2=0x7f134410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.420+0000 7f134c5c0640 1 --2- 172.21.15.45:0/3952560938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1344106f10 0x7f134410ea90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f133c009ca0 tx=0x7f133c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.420+0000 7f134c5c0640 1 -- 172.21.15.45:0/3952560938 shutdown_connections 2024-09-15T22:19:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.420+0000 7f134c5c0640 1 --2- 172.21.15.45:0/3952560938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1344106f10 0x7f134410ea90 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.420+0000 7f134c5c0640 1 --2- 172.21.15.45:0/3952560938 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344102790 0x7f13441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.420+0000 7f134c5c0640 1 --2- 172.21.15.45:0/3952560938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1344101de0 0x7f13441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.420+0000 7f134c5c0640 1 -- 172.21.15.45:0/3952560938 >> 172.21.15.45:0/3952560938 conn(0x7f13440fd8c0 msgr2=0x7f13440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.420+0000 7f134c5c0640 1 -- 172.21.15.45:0/3952560938 shutdown_connections 2024-09-15T22:19:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.420+0000 7f134c5c0640 1 -- 172.21.15.45:0/3952560938 wait complete. 2024-09-15T22:19:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f134c5c0640 1 Processor -- start 2024-09-15T22:19:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f134c5c0640 1 -- start start 2024-09-15T22:19:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f134c5c0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344101de0 0x7f1344198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f134c5c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1344102790 0x7f1344198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f134c5c0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1344106f10 0x7f134419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f134c5c0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1344112090 con 0x7f1344102790 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f134c5c0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1344111f10 con 0x7f1344106f10 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f134c5c0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1344112210 con 0x7f1344101de0 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f1349b5b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1344102790 0x7f1344198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f1349b5b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1344102790 0x7f1344198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53860/0 (socket says 172.21.15.45:53860) 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f1349b5b640 1 -- 172.21.15.45:0/2116836667 learned_addr learned my addr 172.21.15.45:0/2116836667 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f134a35c640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344101de0 0x7f1344198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f134ab5d640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1344106f10 0x7f134419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f1349b5b640 1 -- 172.21.15.45:0/2116836667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344101de0 msgr2=0x7f1344198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f1349b5b640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344101de0 0x7f1344198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f1349b5b640 1 -- 172.21.15.45:0/2116836667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1344106f10 msgr2=0x7f134419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.421+0000 7f1349b5b640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1344106f10 0x7f134419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.422+0000 7f1349b5b640 1 -- 172.21.15.45:0/2116836667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134419d410 con 0x7f1344102790 2024-09-15T22:19:47.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.422+0000 7f134a35c640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344101de0 0x7f1344198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:47.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.422+0000 7f1349b5b640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1344102790 0x7f1344198a40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f133400d950 tx=0x7f133400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:47.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.422+0000 7f133b7fe640 1 -- 172.21.15.45:0/2116836667 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1334017070 con 0x7f1344102790 2024-09-15T22:19:47.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.422+0000 7f134c5c0640 1 -- 172.21.15.45:0/2116836667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f134419d700 con 0x7f1344102790 2024-09-15T22:19:47.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.422+0000 7f133b7fe640 1 -- 172.21.15.45:0/2116836667 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1334009c30 con 0x7f1344102790 2024-09-15T22:19:47.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.422+0000 7f133b7fe640 1 -- 172.21.15.45:0/2116836667 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133400f740 con 0x7f1344102790 2024-09-15T22:19:47.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.422+0000 7f134c5c0640 1 -- 172.21.15.45:0/2116836667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13441a4fe0 con 0x7f1344102790 2024-09-15T22:19:47.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.425+0000 7f133b7fe640 1 -- 172.21.15.45:0/2116836667 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1334010a80 con 0x7f1344102790 2024-09-15T22:19:47.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.425+0000 7f134e999740 1 Processor -- start 2024-09-15T22:19:47.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.425+0000 7f134e999740 1 -- start start 2024-09-15T22:19:47.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134e999740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5380 0x5564522d5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134e999740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 0x5564522e4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134e999740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522e4a90 0x5564522e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134e999740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55645223b2e0 con 0x5564522d5ca0 2024-09-15T22:19:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134e999740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5564521e2ce0 con 0x5564522e4a90 2024-09-15T22:19:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134e999740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5564522372a0 con 0x5564522d5380 2024-09-15T22:19:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134a35c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 0x5564522e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134a35c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 0x5564522e4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53862/0 (socket says 172.21.15.45:53862) 2024-09-15T22:19:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134a35c640 1 -- 172.21.15.45:0/1621697281 learned_addr learned my addr 172.21.15.45:0/1621697281 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134ab5d640 1 --2- 172.21.15.45:0/1621697281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5380 0x5564522d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f1349b5b640 1 --2- 172.21.15.45:0/1621697281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522e4a90 0x5564522e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f133b7fe640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f13300a33b0 0x7f13300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134a35c640 1 -- 172.21.15.45:0/1621697281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5380 msgr2=0x5564522d5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134a35c640 1 --2- 172.21.15.45:0/1621697281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5380 0x5564522d5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134a35c640 1 -- 172.21.15.45:0/1621697281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522e4a90 msgr2=0x5564522e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:47.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134a35c640 1 --2- 172.21.15.45:0/1621697281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522e4a90 0x5564522e6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134ab5d640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f13300a33b0 0x7f13300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134a35c640 1 -- 172.21.15.45:0/1621697281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564521c7440 con 0x5564522d5ca0 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f1349b5b640 1 --2- 172.21.15.45:0/1621697281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522e4a90 0x5564522e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f133b7fe640 1 -- 172.21.15.45:0/2116836667 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f13340d00e0 con 0x7f1344102790 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.426+0000 7f134a35c640 1 --2- 172.21.15.45:0/1621697281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 0x5564522e4550 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f134000cca0 tx=0x7f134000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fb3d2bacf0ac09 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.427+0000 7f1338ff9640 1 -- 172.21.15.45:0/1621697281 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340005220 con 0x5564522d5ca0 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.427+0000 7f134ab5d640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f13300a33b0 0x7f13300a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f133c005fe0 tx=0x7f133c02a8c0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.427+0000 7f1338ff9640 1 -- 172.21.15.45:0/1621697281 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1340004ca0 con 0x5564522d5ca0 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.427+0000 7f1338ff9640 1 -- 172.21.15.45:0/1621697281 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340010960 con 0x5564522d5ca0 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.427+0000 7f134e999740 1 -- 172.21.15.45:0/1621697281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 msgr2=0x5564522e4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.427+0000 7f134e999740 1 --2- 172.21.15.45:0/1621697281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 0x5564522e4550 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f134000cca0 tx=0x7f134000e720 comp rx=0 tx=0).stop 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.427+0000 7f134e999740 1 -- 172.21.15.45:0/1621697281 shutdown_connections 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.427+0000 7f134e999740 1 --2- 172.21.15.45:0/1621697281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522e4a90 0x5564522e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.427+0000 7f134e999740 1 --2- 172.21.15.45:0/1621697281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 0x5564522e4550 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.427+0000 7f134e999740 1 --2- 172.21.15.45:0/1621697281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5380 0x5564522d5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.427+0000 7f134e999740 1 -- 172.21.15.45:0/1621697281 >> 172.21.15.45:0/1621697281 conn(0x5564522d1a30 msgr2=0x5564522d1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f134e999740 1 -- 172.21.15.45:0/1621697281 shutdown_connections 2024-09-15T22:19:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f134e999740 1 -- 172.21.15.45:0/1621697281 wait complete. 2024-09-15T22:19:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f134e999740 1 -- start start 2024-09-15T22:19:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f134e999740 1 Processor -- start 2024-09-15T22:19:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f134e999740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522d5380 0x5564522e4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f134e999740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 0x5564522e1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f134e999740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522e4a90 0x5564522e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f134e999740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5564522e7660 con 0x5564522d5ca0 2024-09-15T22:19:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f134e999740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5564521f6050 con 0x5564522d5380 2024-09-15T22:19:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f134e999740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5564522e77e0 con 0x5564522e4a90 2024-09-15T22:19:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f134e999740 10 client.0 _ll_register_callbacks cb 0x556452236160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:47.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f1349b5b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 0x5564522e1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f1349b5b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 0x5564522e1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53872/0 (socket says 172.21.15.45:53872) 2024-09-15T22:19:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.428+0000 7f1349b5b640 1 -- 172.21.15.45:0/3773577638 learned_addr learned my addr 172.21.15.45:0/3773577638 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f134a35c640 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522d5380 0x5564522e4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f134ab5d640 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522e4a90 0x5564522e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f1349b5b640 1 -- 172.21.15.45:0/3773577638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522e4a90 msgr2=0x5564522e1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f1349b5b640 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522e4a90 0x5564522e1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f1349b5b640 1 -- 172.21.15.45:0/3773577638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522d5380 msgr2=0x5564522e4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f1349b5b640 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522d5380 0x5564522e4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f1349b5b640 1 -- 172.21.15.45:0/3773577638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556451fac3c0 con 0x5564522d5ca0 2024-09-15T22:19:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f134a35c640 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522d5380 0x5564522e4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f134ab5d640 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522e4a90 0x5564522e1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f132dffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:47.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f1349b5b640 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 0x5564522e1660 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f13340989d0 tx=0x7f133409c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5defccc8dd1d740e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f132dffb640 1 -- 172.21.15.45:0/3773577638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1334020070 con 0x5564522d5ca0 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f134e999740 1 -- 172.21.15.45:0/3773577638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1340004ca0 con 0x5564522d5ca0 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f132dffb640 1 -- 172.21.15.45:0/3773577638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f133409a300 con 0x5564522d5ca0 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f132dffb640 1 -- 172.21.15.45:0/3773577638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1334009de0 con 0x5564522d5ca0 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f134e999740 10 client.16125 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f134e999740 1 -- 172.21.15.45:0/3773577638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5564522f30d0 con 0x5564522d5ca0 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.429+0000 7f132dffb640 1 -- 172.21.15.45:0/3773577638 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1340004ca0 con 0x5564522d5ca0 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.430+0000 7f132dffb640 1 -- 172.21.15.45:0/3773577638 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1334098670 con 0x5564522d5ca0 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.430+0000 7f134e999740 10 client.16125 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.430+0000 7f134e999740 10 client.16125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.430+0000 7f134e999740 20 client.16125 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.430+0000 7f134e999740 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5564522f4590 0x5564522f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.430+0000 7f134e999740 4 client.16125 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.430+0000 7f134e999740 1 -- 172.21.15.45:0/3773577638 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556452248850 con 0x5564522f4590 2024-09-15T22:19:47.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.430+0000 7f134a35c640 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5564522f4590 0x5564522f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f132dffb640 10 client.16125 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f134a35c640 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5564522f4590 0x5564522f69a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd9cee1b1d38bcbb server_cookie=a4099c5055c6d493 in_seq=0 out_seq=0 2024-09-15T22:19:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f132dffb640 1 -- 172.21.15.45:0/3773577638 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556452248850 con 0x5564522f4590 2024-09-15T22:19:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f132dffb640 10 client.16125 handle_command_reply: tid=0 2024-09-15T22:19:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f134e999740 1 client.16125 shutdown 2024-09-15T22:19:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f134e999740 1 -- 172.21.15.45:0/3773577638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 msgr2=0x5564522e1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f134e999740 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 0x5564522e1660 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f13340989d0 tx=0x7f133409c320 comp rx=0 tx=0).stop 2024-09-15T22:19:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f134e999740 1 -- 172.21.15.45:0/3773577638 shutdown_connections 2024-09-15T22:19:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f134e999740 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5564522f4590 0x5564522f69a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f134e999740 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522e4a90 0x5564522e1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f134e999740 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5ca0 0x5564522e1660 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f134e999740 1 --2- 172.21.15.45:0/3773577638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522d5380 0x5564522e4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f132dffb640 0 client.16125 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:47.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.431+0000 7f134e999740 1 -- 172.21.15.45:0/3773577638 >> 172.21.15.45:0/3773577638 conn(0x5564522d1a30 msgr2=0x5564522d7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:47.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.432+0000 7f134e999740 1 -- 172.21.15.45:0/3773577638 shutdown_connections 2024-09-15T22:19:47.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.432+0000 7f134e999740 1 -- 172.21.15.45:0/3773577638 wait complete. 2024-09-15T22:19:47.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.432+0000 7f134e999740 20 client.16125 trim_cache size 0 max 16384 2024-09-15T22:19:47.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134e999740 1 Processor -- start 2024-09-15T22:19:47.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134e999740 1 -- start start 2024-09-15T22:19:47.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134e999740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5380 0x5564522f0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134e999740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5ca0 0x5564522fc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134e999740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522e4a90 0x5564522fc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134e999740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f13441aaf10 con 0x5564522d5380 2024-09-15T22:19:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134e999740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13441ad790 con 0x5564522e4a90 2024-09-15T22:19:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134e999740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13441ab580 con 0x5564522d5ca0 2024-09-15T22:19:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134a35c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5380 0x5564522f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134a35c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5380 0x5564522f0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53880/0 (socket says 172.21.15.45:53880) 2024-09-15T22:19:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134a35c640 1 -- 172.21.15.45:0/4078666967 learned_addr learned my addr 172.21.15.45:0/4078666967 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f1349b5b640 1 --2- 172.21.15.45:0/4078666967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5ca0 0x5564522fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134a35c640 1 -- 172.21.15.45:0/4078666967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5ca0 msgr2=0x5564522fc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134a35c640 1 --2- 172.21.15.45:0/4078666967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5ca0 0x5564522fc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134a35c640 1 -- 172.21.15.45:0/4078666967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522e4a90 msgr2=0x5564522fc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134a35c640 1 --2- 172.21.15.45:0/4078666967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522e4a90 0x5564522fc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.449+0000 7f134a35c640 1 -- 172.21.15.45:0/4078666967 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564522e46d0 con 0x5564522d5380 2024-09-15T22:19:47.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.450+0000 7f134a35c640 1 --2- 172.21.15.45:0/4078666967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5380 0x5564522f0900 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x5564522d8090 tx=0x7f134000c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db00cb2cb64fd80 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:47.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.450+0000 7f132ffff640 1 -- 172.21.15.45:0/4078666967 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340004220 con 0x5564522d5380 2024-09-15T22:19:47.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.450+0000 7f132ffff640 1 -- 172.21.15.45:0/4078666967 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13400043c0 con 0x5564522d5380 2024-09-15T22:19:47.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.450+0000 7f132ffff640 1 -- 172.21.15.45:0/4078666967 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340004de0 con 0x5564522d5380 2024-09-15T22:19:47.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.450+0000 7f134e999740 1 -- 172.21.15.45:0/4078666967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5380 msgr2=0x5564522f0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:47.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.450+0000 7f134e999740 1 --2- 172.21.15.45:0/4078666967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5380 0x5564522f0900 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x5564522d8090 tx=0x7f134000c590 comp rx=0 tx=0).stop 2024-09-15T22:19:47.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.450+0000 7f134e999740 1 -- 172.21.15.45:0/4078666967 shutdown_connections 2024-09-15T22:19:47.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.450+0000 7f134e999740 1 --2- 172.21.15.45:0/4078666967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522e4a90 0x5564522fc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.450+0000 7f134e999740 1 --2- 172.21.15.45:0/4078666967 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5ca0 0x5564522fc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.450+0000 7f134e999740 1 --2- 172.21.15.45:0/4078666967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522d5380 0x5564522f0900 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.450+0000 7f134e999740 1 -- 172.21.15.45:0/4078666967 >> 172.21.15.45:0/4078666967 conn(0x5564522d1a30 msgr2=0x5564522dcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.450+0000 7f134e999740 1 -- 172.21.15.45:0/4078666967 shutdown_connections 2024-09-15T22:19:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.450+0000 7f134e999740 1 -- 172.21.15.45:0/4078666967 wait complete. 2024-09-15T22:19:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.451+0000 7f134e999740 1 -- start start 2024-09-15T22:19:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.451+0000 7f134e999740 1 Processor -- start 2024-09-15T22:19:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.451+0000 7f134e999740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522d5380 0x5564522e8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.451+0000 7f134e999740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5ca0 0x5564522e9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.451+0000 7f134e999740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522e4a90 0x55645235e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.451+0000 7f134e999740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f13441abc50 con 0x5564522e4a90 2024-09-15T22:19:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.451+0000 7f134e999740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13441ad0c0 con 0x5564522d5380 2024-09-15T22:19:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.451+0000 7f134e999740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f13441ac320 con 0x5564522d5ca0 2024-09-15T22:19:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.451+0000 7f134e999740 10 client.0 _ll_register_callbacks cb 0x7f133409bbf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.451+0000 7f134ab5d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522e4a90 0x55645235e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.451+0000 7f134ab5d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522e4a90 0x55645235e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53892/0 (socket says 172.21.15.45:53892) 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.451+0000 7f134ab5d640 1 -- 172.21.15.45:0/1415213400 learned_addr learned my addr 172.21.15.45:0/1415213400 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f1349b5b640 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5ca0 0x5564522e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f134a35c640 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522d5380 0x5564522e8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f134ab5d640 1 -- 172.21.15.45:0/1415213400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5ca0 msgr2=0x5564522e9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f134ab5d640 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5ca0 0x5564522e9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f134ab5d640 1 -- 172.21.15.45:0/1415213400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522d5380 msgr2=0x5564522e8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f134ab5d640 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522d5380 0x5564522e8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f134ab5d640 1 -- 172.21.15.45:0/1415213400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55645235e780 con 0x5564522e4a90 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f1349b5b640 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5ca0 0x5564522e9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f134ab5d640 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522e4a90 0x55645235e240 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f133c02ade0 tx=0x7f133c02f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5187a4c2fa86c398 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f132dffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f132dffb640 1 -- 172.21.15.45:0/1415213400 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f133c04e030 con 0x5564522e4a90 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f134e999740 1 -- 172.21.15.45:0/1415213400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13400043c0 con 0x5564522e4a90 2024-09-15T22:19:47.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f132dffb640 1 -- 172.21.15.45:0/1415213400 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f133c004620 con 0x5564522e4a90 2024-09-15T22:19:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f132dffb640 1 -- 172.21.15.45:0/1415213400 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f133c0098a0 con 0x5564522e4a90 2024-09-15T22:19:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f134e999740 10 client.16131 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.452+0000 7f134e999740 1 -- 172.21.15.45:0/1415213400 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55645235f950 con 0x5564522e4a90 2024-09-15T22:19:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.453+0000 7f132dffb640 1 -- 172.21.15.45:0/1415213400 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f13400043c0 con 0x5564522e4a90 2024-09-15T22:19:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.453+0000 7f132dffb640 1 -- 172.21.15.45:0/1415213400 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f133c049040 con 0x5564522e4a90 2024-09-15T22:19:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.453+0000 7f134e999740 10 client.16131 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.453+0000 7f134e999740 10 client.16131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.453+0000 7f134e999740 20 client.16131 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.453+0000 7f134e999740 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5564523600f0 0x556452362510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.453+0000 7f134e999740 4 client.16131 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:19:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.453+0000 7f134e999740 1 -- 172.21.15.45:0/1415213400 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556452242d60 con 0x5564523600f0 2024-09-15T22:19:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.453+0000 7f134a35c640 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5564523600f0 0x556452362510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:47.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f134a35c640 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5564523600f0 0x556452362510 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daa1df49081056da server_cookie=bd2c8baefa5dbcd2 in_seq=0 out_seq=0 2024-09-15T22:19:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f132dffb640 10 client.16131 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f132dffb640 1 -- 172.21.15.45:0/1415213400 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556452242d60 con 0x5564523600f0 2024-09-15T22:19:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f132dffb640 10 client.16131 handle_command_reply: tid=0 2024-09-15T22:19:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f134e999740 1 client.16131 shutdown 2024-09-15T22:19:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f134e999740 1 -- 172.21.15.45:0/1415213400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522e4a90 msgr2=0x55645235e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f134e999740 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522e4a90 0x55645235e240 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f133c02ade0 tx=0x7f133c02f4c0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f134e999740 1 -- 172.21.15.45:0/1415213400 shutdown_connections 2024-09-15T22:19:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f134e999740 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5564523600f0 0x556452362510 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f134e999740 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5564522e4a90 0x55645235e240 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f134e999740 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5564522d5ca0 0x5564522e9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f134e999740 1 --2- 172.21.15.45:0/1415213400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5564522d5380 0x5564522e8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f132dffb640 0 client.16131 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f134e999740 1 -- 172.21.15.45:0/1415213400 >> 172.21.15.45:0/1415213400 conn(0x5564522d1a30 msgr2=0x5564522e2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:47.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f134e999740 1 -- 172.21.15.45:0/1415213400 shutdown_connections 2024-09-15T22:19:47.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f134e999740 1 -- 172.21.15.45:0/1415213400 wait complete. 2024-09-15T22:19:47.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.454+0000 7f134e999740 20 client.16131 trim_cache size 0 max 16384 2024-09-15T22:19:47.461 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:19:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:19:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:19:47.461 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:19:47.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.455+0000 7f134c5c0640 1 -- 172.21.15.45:0/2116836667 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f13300a33b0 msgr2=0x7f13300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:47.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.455+0000 7f134c5c0640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f13300a33b0 0x7f13300a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f133c005fe0 tx=0x7f133c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.455+0000 7f134c5c0640 1 -- 172.21.15.45:0/2116836667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1344102790 msgr2=0x7f1344198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:47.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.455+0000 7f134c5c0640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1344102790 0x7f1344198a40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f133400d950 tx=0x7f133400de10 comp rx=0 tx=0).stop 2024-09-15T22:19:47.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.455+0000 7f134c5c0640 1 -- 172.21.15.45:0/2116836667 shutdown_connections 2024-09-15T22:19:47.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.455+0000 7f134c5c0640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f13300a33b0 0x7f13300a5870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.455+0000 7f134c5c0640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1344106f10 0x7f134419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.455+0000 7f134c5c0640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1344102790 0x7f1344198a40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.455+0000 7f134c5c0640 1 --2- 172.21.15.45:0/2116836667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1344101de0 0x7f1344198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:47.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.455+0000 7f134c5c0640 1 -- 172.21.15.45:0/2116836667 >> 172.21.15.45:0/2116836667 conn(0x7f13440fd8c0 msgr2=0x7f13440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:47.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.455+0000 7f134c5c0640 1 -- 172.21.15.45:0/2116836667 shutdown_connections 2024-09-15T22:19:47.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:47.455+0000 7f134c5c0640 1 -- 172.21.15.45:0/2116836667 wait complete. 2024-09-15T22:19:47.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:47 smithi165 ceph-mon[35551]: pgmap v109: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 529 KiB/s wr, 111 op/s 2024-09-15T22:19:47.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:47 smithi100 ceph-mon[35319]: pgmap v109: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 529 KiB/s wr, 111 op/s 2024-09-15T22:19:48.301 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:19:48.302 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:19:48.569 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:49.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.050+0000 7f470ec13640 1 -- 172.21.15.45:0/2027230859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4708106a80 msgr2=0x7f4708106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:49.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.050+0000 7f470ec13640 1 --2- 172.21.15.45:0/2027230859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4708106a80 0x7f4708106e60 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4704009930 tx=0x7f470402a420 comp rx=0 tx=0).stop 2024-09-15T22:19:49.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.050+0000 7f470ec13640 1 -- 172.21.15.45:0/2027230859 shutdown_connections 2024-09-15T22:19:49.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.050+0000 7f470ec13640 1 --2- 172.21.15.45:0/2027230859 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4708101420 0x7f470810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:49.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.050+0000 7f470ec13640 1 --2- 172.21.15.45:0/2027230859 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4708100a80 0x7f4708100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:49.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.050+0000 7f470ec13640 1 --2- 172.21.15.45:0/2027230859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4708106a80 0x7f4708106e60 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.050+0000 7f470ec13640 1 -- 172.21.15.45:0/2027230859 >> 172.21.15.45:0/2027230859 conn(0x7f47080fc7a0 msgr2=0x7f47080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.050+0000 7f470ec13640 1 -- 172.21.15.45:0/2027230859 shutdown_connections 2024-09-15T22:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.050+0000 7f470ec13640 1 -- 172.21.15.45:0/2027230859 wait complete. 2024-09-15T22:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.051+0000 7f470ec13640 1 Processor -- start 2024-09-15T22:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.051+0000 7f470ec13640 1 -- start start 2024-09-15T22:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.051+0000 7f470ec13640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4708100a80 0x7f4708198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.051+0000 7f470ec13640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4708101420 0x7f4708198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.051+0000 7f470ec13640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4708106a80 0x7f470819cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.051+0000 7f470ec13640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4708110fa0 con 0x7f4708100a80 2024-09-15T22:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.051+0000 7f470ec13640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4708110e20 con 0x7f4708106a80 2024-09-15T22:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.051+0000 7f470ec13640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4708111120 con 0x7f4708101420 2024-09-15T22:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.051+0000 7f470c9af640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4708100a80 0x7f4708198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:49.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.051+0000 7f470c9af640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4708100a80 0x7f4708198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53914/0 (socket says 172.21.15.45:53914) 2024-09-15T22:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.051+0000 7f470c9af640 1 -- 172.21.15.45:0/602571622 learned_addr learned my addr 172.21.15.45:0/602571622 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.052+0000 7f46fffff640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4708101420 0x7f4708198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.052+0000 7f470d1b0640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4708106a80 0x7f470819cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.052+0000 7f470c9af640 1 -- 172.21.15.45:0/602571622 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4708101420 msgr2=0x7f4708198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.052+0000 7f470c9af640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4708101420 0x7f4708198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.052+0000 7f470c9af640 1 -- 172.21.15.45:0/602571622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4708106a80 msgr2=0x7f470819cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.052+0000 7f470c9af640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4708106a80 0x7f470819cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.052+0000 7f470c9af640 1 -- 172.21.15.45:0/602571622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470819d4c0 con 0x7f4708100a80 2024-09-15T22:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.052+0000 7f470c9af640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4708100a80 0x7f4708198510 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4704009230 tx=0x7f4704004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.052+0000 7f46fdffb640 1 -- 172.21.15.45:0/602571622 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f470403f030 con 0x7f4708100a80 2024-09-15T22:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.052+0000 7f46fdffb640 1 -- 172.21.15.45:0/602571622 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4704003af0 con 0x7f4708100a80 2024-09-15T22:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.052+0000 7f470ec13640 1 -- 172.21.15.45:0/602571622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470819d750 con 0x7f4708100a80 2024-09-15T22:19:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.052+0000 7f46fdffb640 1 -- 172.21.15.45:0/602571622 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4704035070 con 0x7f4708100a80 2024-09-15T22:19:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.053+0000 7f470ec13640 1 -- 172.21.15.45:0/602571622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47081a5090 con 0x7f4708100a80 2024-09-15T22:19:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.054+0000 7f470ec13640 1 -- 172.21.15.45:0/602571622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4708100ee0 con 0x7f4708100a80 2024-09-15T22:19:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.055+0000 7f46fdffb640 1 -- 172.21.15.45:0/602571622 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4704042030 con 0x7f4708100a80 2024-09-15T22:19:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.056+0000 7f46fdffb640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f46f00a3430 0x7f46f00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.056+0000 7f46fffff640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f46f00a3430 0x7f46f00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.056+0000 7f46fdffb640 1 -- 172.21.15.45:0/602571622 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f47040f0bb0 con 0x7f4708100a80 2024-09-15T22:19:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.056+0000 7f46fffff640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f46f00a3430 0x7f46f00a58f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4708105140 tx=0x7f46f800b390 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.059+0000 7f46fdffb640 1 -- 172.21.15.45:0/602571622 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f47040bcc40 con 0x7f4708100a80 2024-09-15T22:19:49.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.274+0000 7f470ec13640 1 -- 172.21.15.45:0/602571622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f470810a000 con 0x7f4708100a80 2024-09-15T22:19:49.275 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:49 smithi045 ceph-mon[31180]: pgmap v110: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 186 KiB/s wr, 63 op/s 2024-09-15T22:19:49.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.275+0000 7f46fdffb640 1 -- 172.21.15.45:0/602571622 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f47040c0f40 con 0x7f4708100a80 2024-09-15T22:19:49.276 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:19:49.276 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:19:49.276 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:19:49.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.277+0000 7f470ec13640 1 -- 172.21.15.45:0/602571622 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f46f00a3430 msgr2=0x7f46f00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:49.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.277+0000 7f470ec13640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f46f00a3430 0x7f46f00a58f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4708105140 tx=0x7f46f800b390 comp rx=0 tx=0).stop 2024-09-15T22:19:49.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.277+0000 7f470ec13640 1 -- 172.21.15.45:0/602571622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4708100a80 msgr2=0x7f4708198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:49.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.277+0000 7f470ec13640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4708100a80 0x7f4708198510 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4704009230 tx=0x7f4704004270 comp rx=0 tx=0).stop 2024-09-15T22:19:49.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.277+0000 7f470ec13640 1 -- 172.21.15.45:0/602571622 shutdown_connections 2024-09-15T22:19:49.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.277+0000 7f470ec13640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f46f00a3430 0x7f46f00a58f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:49.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.277+0000 7f470ec13640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4708106a80 0x7f470819cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:49.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.277+0000 7f470ec13640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4708101420 0x7f4708198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:49.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.277+0000 7f470ec13640 1 --2- 172.21.15.45:0/602571622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4708100a80 0x7f4708198510 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:49.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.277+0000 7f470ec13640 1 -- 172.21.15.45:0/602571622 >> 172.21.15.45:0/602571622 conn(0x7f47080fc7a0 msgr2=0x7f470806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:49.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.277+0000 7f470ec13640 1 -- 172.21.15.45:0/602571622 shutdown_connections 2024-09-15T22:19:49.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:49.277+0000 7f470ec13640 1 -- 172.21.15.45:0/602571622 wait complete. 2024-09-15T22:19:49.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:49 smithi165 ceph-mon[35551]: pgmap v110: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 186 KiB/s wr, 63 op/s 2024-09-15T22:19:49.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:49 smithi100 ceph-mon[35319]: pgmap v110: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 186 KiB/s wr, 63 op/s 2024-09-15T22:19:50.110 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:19:50.372 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:50.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:50 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/602571622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:50.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:50 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/602571622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:50.494 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:50 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/602571622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:19:50.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.909+0000 7f86cfdb1640 1 -- 172.21.15.45:0/3986684158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c810c2f0 msgr2=0x7f86c810e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:50.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.909+0000 7f86cfdb1640 1 --2- 172.21.15.45:0/3986684158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c810c2f0 0x7f86c810e790 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009ca0 tx=0x7f86b802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.909+0000 7f86cfdb1640 1 -- 172.21.15.45:0/3986684158 shutdown_connections 2024-09-15T22:19:50.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.909+0000 7f86cfdb1640 1 --2- 172.21.15.45:0/3986684158 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c810c2f0 0x7f86c810e790 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.909+0000 7f86cfdb1640 1 --2- 172.21.15.45:0/3986684158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c81037a0 0x7f86c810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.909+0000 7f86cfdb1640 1 --2- 172.21.15.45:0/3986684158 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c8102df0 0x7f86c81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.909+0000 7f86cfdb1640 1 -- 172.21.15.45:0/3986684158 >> 172.21.15.45:0/3986684158 conn(0x7f86c80fc7d0 msgr2=0x7f86c80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.909+0000 7f86cfdb1640 1 -- 172.21.15.45:0/3986684158 shutdown_connections 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.909+0000 7f86cfdb1640 1 -- 172.21.15.45:0/3986684158 wait complete. 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.909+0000 7f86cfdb1640 1 Processor -- start 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.909+0000 7f86cfdb1640 1 -- start start 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cfdb1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c8102df0 0x7f86c8198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cfdb1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c81037a0 0x7f86c8198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cfdb1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c810c2f0 0x7f86c819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cfdb1640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f86c8112230 con 0x7f86c8102df0 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cfdb1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81120b0 con 0x7f86c810c2f0 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cfdb1640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81123b0 con 0x7f86c81037a0 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cdb4d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c8102df0 0x7f86c8198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cdb4d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c8102df0 0x7f86c8198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53936/0 (socket says 172.21.15.45:53936) 2024-09-15T22:19:50.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cdb4d640 1 -- 172.21.15.45:0/3019764664 learned_addr learned my addr 172.21.15.45:0/3019764664 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:50.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86ce34e640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c810c2f0 0x7f86c819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cd34c640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c81037a0 0x7f86c8198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cdb4d640 1 -- 172.21.15.45:0/3019764664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c81037a0 msgr2=0x7f86c8198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:50.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c81037a0 0x7f86c8198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cdb4d640 1 -- 172.21.15.45:0/3019764664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c810c2f0 msgr2=0x7f86c819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:50.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c810c2f0 0x7f86c819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cdb4d640 1 -- 172.21.15.45:0/3019764664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c819d620 con 0x7f86c8102df0 2024-09-15T22:19:50.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cd34c640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c81037a0 0x7f86c8198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:50.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c8102df0 0x7f86c8198670 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f86c000d950 tx=0x7f86c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:50.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.910+0000 7f86c6ffd640 1 -- 172.21.15.45:0/3019764664 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0017070 con 0x7f86c8102df0 2024-09-15T22:19:50.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.911+0000 7f86c6ffd640 1 -- 172.21.15.45:0/3019764664 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86c0009c30 con 0x7f86c8102df0 2024-09-15T22:19:50.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.911+0000 7f86cfdb1640 1 -- 172.21.15.45:0/3019764664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c819d910 con 0x7f86c8102df0 2024-09-15T22:19:50.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.911+0000 7f86c6ffd640 1 -- 172.21.15.45:0/3019764664 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c000f740 con 0x7f86c8102df0 2024-09-15T22:19:50.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.911+0000 7f86cfdb1640 1 -- 172.21.15.45:0/3019764664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c81a51f0 con 0x7f86c8102df0 2024-09-15T22:19:50.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.913+0000 7f86c6ffd640 1 -- 172.21.15.45:0/3019764664 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f86c0010a80 con 0x7f86c8102df0 2024-09-15T22:19:50.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.913+0000 7f86d218a740 1 Processor -- start 2024-09-15T22:19:50.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.913+0000 7f86d218a740 1 -- start start 2024-09-15T22:19:50.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86d218a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa3417e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86d218a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa3417ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86d218a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa3418b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86d218a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aa340e42f0 con 0x55aa34189370 2024-09-15T22:19:50.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86d218a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aa3408bcf0 con 0x55aa3417e5d0 2024-09-15T22:19:50.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86d218a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55aa340e02b0 con 0x55aa3417fb40 2024-09-15T22:19:50.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86cd34c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa3418b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86cdb4d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa3417ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86cd34c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa3418b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53952/0 (socket says 172.21.15.45:53952) 2024-09-15T22:19:50.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86cd34c640 1 -- 172.21.15.45:0/2369571124 learned_addr learned my addr 172.21.15.45:0/2369571124 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:50.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86c6ffd640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f86b00a3430 0x7f86b00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86ce34e640 1 --2- 172.21.15.45:0/2369571124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa3417e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86ce34e640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f86b00a3430 0x7f86b00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86c6ffd640 1 -- 172.21.15.45:0/3019764664 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f86c00cfdd0 con 0x7f86c8102df0 2024-09-15T22:19:50.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86cdb4d640 1 -- 172.21.15.45:0/2369571124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 msgr2=0x55aa3417e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:50.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/2369571124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa3417e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86cdb4d640 1 -- 172.21.15.45:0/2369571124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 msgr2=0x55aa3418b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:50.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/2369571124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa3418b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86cdb4d640 1 -- 172.21.15.45:0/2369571124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa340703a0 con 0x55aa3417e5d0 2024-09-15T22:19:50.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86cd34c640 1 --2- 172.21.15.45:0/2369571124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa3418b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:19:50.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.914+0000 7f86ce34e640 1 --2- 172.21.15.45:0/2369571124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa3417e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:50.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.915+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/2369571124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa3417ea10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f86c00cd100 tx=0x7f86c0010e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e64573841a39112 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:50.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.915+0000 7f86affff640 1 -- 172.21.15.45:0/2369571124 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c0020030 con 0x55aa3417e5d0 2024-09-15T22:19:50.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.915+0000 7f86ce34e640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f86b00a3430 0x7f86b00a58f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86b8005fe0 tx=0x7f86b80095c0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:50.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.915+0000 7f86affff640 1 -- 172.21.15.45:0/2369571124 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86c00a4900 con 0x55aa3417e5d0 2024-09-15T22:19:50.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.915+0000 7f86affff640 1 -- 172.21.15.45:0/2369571124 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c009b0e0 con 0x55aa3417e5d0 2024-09-15T22:19:50.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.915+0000 7f86d218a740 1 -- 172.21.15.45:0/2369571124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 msgr2=0x55aa3417ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:50.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.915+0000 7f86d218a740 1 --2- 172.21.15.45:0/2369571124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa3417ea10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f86c00cd100 tx=0x7f86c0010e20 comp rx=0 tx=0).stop 2024-09-15T22:19:50.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.916+0000 7f86d218a740 1 -- 172.21.15.45:0/2369571124 shutdown_connections 2024-09-15T22:19:50.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.916+0000 7f86d218a740 1 --2- 172.21.15.45:0/2369571124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa3418b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.916+0000 7f86d218a740 1 --2- 172.21.15.45:0/2369571124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa3417ea10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.916+0000 7f86d218a740 1 --2- 172.21.15.45:0/2369571124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa3417e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.916+0000 7f86d218a740 1 -- 172.21.15.45:0/2369571124 >> 172.21.15.45:0/2369571124 conn(0x55aa34147310 msgr2=0x55aa3417ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:50.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.916+0000 7f86d218a740 1 -- 172.21.15.45:0/2369571124 shutdown_connections 2024-09-15T22:19:50.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.916+0000 7f86d218a740 1 -- 172.21.15.45:0/2369571124 wait complete. 2024-09-15T22:19:50.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.916+0000 7f86d218a740 1 -- start start 2024-09-15T22:19:50.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.916+0000 7f86d218a740 1 Processor -- start 2024-09-15T22:19:50.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.916+0000 7f86d218a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417e5d0 0x55aa34188e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.916+0000 7f86d218a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417fb40 0x55aa341860b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86d218a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa34186840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86d218a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aa341903c0 con 0x55aa34189370 2024-09-15T22:19:50.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86d218a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55aa3409f060 con 0x55aa3417fb40 2024-09-15T22:19:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86d218a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55aa34190540 con 0x55aa3417e5d0 2024-09-15T22:19:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86d218a740 10 client.0 _ll_register_callbacks cb 0x55aa33df28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86ce34e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa34186840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86ce34e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa34186840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53960/0 (socket says 172.21.15.45:53960) 2024-09-15T22:19:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86ce34e640 1 -- 172.21.15.45:0/2893199637 learned_addr learned my addr 172.21.15.45:0/2893199637 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86cd34c640 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417fb40 0x55aa341860b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417e5d0 0x55aa34188e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86ce34e640 1 -- 172.21.15.45:0/2893199637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417e5d0 msgr2=0x55aa34188e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86ce34e640 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417e5d0 0x55aa34188e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86ce34e640 1 -- 172.21.15.45:0/2893199637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417fb40 msgr2=0x55aa341860b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86ce34e640 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417fb40 0x55aa341860b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86ce34e640 1 -- 172.21.15.45:0/2893199637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa33e553c0 con 0x55aa34189370 2024-09-15T22:19:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417e5d0 0x55aa34188e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86ce34e640 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa34186840 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f86b802f3e0 tx=0x7f86b802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e2d4221c1f0ee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86ad7fa640 1 -- 172.21.15.45:0/2893199637 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b804c070 con 0x55aa34189370 2024-09-15T22:19:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86d218a740 1 -- 172.21.15.45:0/2893199637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86c00a4900 con 0x55aa34189370 2024-09-15T22:19:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.917+0000 7f86ad7fa640 1 -- 172.21.15.45:0/2893199637 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f86b8003970 con 0x55aa34189370 2024-09-15T22:19:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.918+0000 7f86ad7fa640 1 -- 172.21.15.45:0/2893199637 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f86b8043070 con 0x55aa34189370 2024-09-15T22:19:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.918+0000 7f86d218a740 10 client.16149 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.918+0000 7f86d218a740 1 -- 172.21.15.45:0/2893199637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55aa3419bf60 con 0x55aa34189370 2024-09-15T22:19:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.918+0000 7f86ad7fa640 1 -- 172.21.15.45:0/2893199637 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86c00a4900 con 0x55aa34189370 2024-09-15T22:19:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.918+0000 7f86ad7fa640 1 -- 172.21.15.45:0/2893199637 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f86b80305c0 con 0x55aa34189370 2024-09-15T22:19:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.918+0000 7f86d218a740 10 client.16149 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.918+0000 7f86d218a740 10 client.16149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.918+0000 7f86d218a740 20 client.16149 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.918+0000 7f86d218a740 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aa3419d470 0x55aa3419f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.918+0000 7f86d218a740 4 client.16149 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.918+0000 7f86d218a740 1 -- 172.21.15.45:0/2893199637 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa340f1860 con 0x55aa3419d470 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.918+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aa3419d470 0x55aa3419f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.919+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aa3419d470 0x55aa3419f8d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da750ecf8c6de70d server_cookie=16880a60a0a2ba28 in_seq=0 out_seq=0 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.919+0000 7f86ad7fa640 10 client.16149 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.919+0000 7f86ad7fa640 1 -- 172.21.15.45:0/2893199637 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aa340f1860 con 0x55aa3419d470 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.919+0000 7f86ad7fa640 10 client.16149 handle_command_reply: tid=0 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.919+0000 7f86d218a740 1 client.16149 shutdown 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.920+0000 7f86d218a740 1 -- 172.21.15.45:0/2893199637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 msgr2=0x55aa34186840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.920+0000 7f86d218a740 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa34186840 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f86b802f3e0 tx=0x7f86b802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.920+0000 7f86d218a740 1 -- 172.21.15.45:0/2893199637 shutdown_connections 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.920+0000 7f86d218a740 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aa3419d470 0x55aa3419f8d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.920+0000 7f86d218a740 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa34186840 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.920+0000 7f86d218a740 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417fb40 0x55aa341860b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.920+0000 7f86ad7fa640 0 client.16149 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.920+0000 7f86d218a740 1 --2- 172.21.15.45:0/2893199637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417e5d0 0x55aa34188e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.920+0000 7f86d218a740 1 -- 172.21.15.45:0/2893199637 >> 172.21.15.45:0/2893199637 conn(0x55aa34147310 msgr2=0x55aa341809c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.920+0000 7f86d218a740 1 -- 172.21.15.45:0/2893199637 shutdown_connections 2024-09-15T22:19:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.920+0000 7f86d218a740 1 -- 172.21.15.45:0/2893199637 wait complete. 2024-09-15T22:19:50.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.920+0000 7f86d218a740 20 client.16149 trim_cache size 0 max 16384 2024-09-15T22:19:50.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.933+0000 7f86d218a740 1 Processor -- start 2024-09-15T22:19:50.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.933+0000 7f86d218a740 1 -- start start 2024-09-15T22:19:50.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.933+0000 7f86d218a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa34185970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.933+0000 7f86d218a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa341811b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.933+0000 7f86d218a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa341816f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.933+0000 7f86d218a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81aaee0 con 0x55aa34189370 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.933+0000 7f86d218a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81ad760 con 0x55aa3417e5d0 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.933+0000 7f86d218a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81ab550 con 0x55aa3417fb40 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.933+0000 7f86ce34e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa341816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.933+0000 7f86ce34e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa341816f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53970/0 (socket says 172.21.15.45:53970) 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.933+0000 7f86ce34e640 1 -- 172.21.15.45:0/1289995406 learned_addr learned my addr 172.21.15.45:0/1289995406 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.934+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/1289995406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa34185970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.934+0000 7f86cd34c640 1 --2- 172.21.15.45:0/1289995406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa341811b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.934+0000 7f86ce34e640 1 -- 172.21.15.45:0/1289995406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 msgr2=0x55aa341811b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.934+0000 7f86ce34e640 1 --2- 172.21.15.45:0/1289995406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa341811b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.934+0000 7f86ce34e640 1 -- 172.21.15.45:0/1289995406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 msgr2=0x55aa34185970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.934+0000 7f86ce34e640 1 --2- 172.21.15.45:0/1289995406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa34185970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.934+0000 7f86ce34e640 1 -- 172.21.15.45:0/1289995406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa34184600 con 0x55aa34189370 2024-09-15T22:19:50.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.934+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/1289995406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa34185970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:50.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.934+0000 7f86cd34c640 1 --2- 172.21.15.45:0/1289995406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa341811b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:50.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.934+0000 7f86ce34e640 1 --2- 172.21.15.45:0/1289995406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa341816f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009bf0 tx=0x7f86b8031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3cd8acd678f1b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:50.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.934+0000 7f86af7fe640 1 -- 172.21.15.45:0/1289995406 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b804c070 con 0x55aa34189370 2024-09-15T22:19:50.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.934+0000 7f86af7fe640 1 -- 172.21.15.45:0/1289995406 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86b8036040 con 0x55aa34189370 2024-09-15T22:19:50.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.934+0000 7f86af7fe640 1 -- 172.21.15.45:0/1289995406 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8004da0 con 0x55aa34189370 2024-09-15T22:19:50.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.935+0000 7f86d218a740 1 -- 172.21.15.45:0/1289995406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 msgr2=0x55aa341816f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:50.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.935+0000 7f86d218a740 1 --2- 172.21.15.45:0/1289995406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa341816f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009bf0 tx=0x7f86b8031760 comp rx=0 tx=0).stop 2024-09-15T22:19:50.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.935+0000 7f86d218a740 1 -- 172.21.15.45:0/1289995406 shutdown_connections 2024-09-15T22:19:50.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.935+0000 7f86d218a740 1 --2- 172.21.15.45:0/1289995406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa341816f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.935+0000 7f86d218a740 1 --2- 172.21.15.45:0/1289995406 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa341811b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.935+0000 7f86d218a740 1 --2- 172.21.15.45:0/1289995406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa34185970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.935+0000 7f86d218a740 1 -- 172.21.15.45:0/1289995406 >> 172.21.15.45:0/1289995406 conn(0x55aa34147310 msgr2=0x55aa341851a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:50.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.935+0000 7f86d218a740 1 -- 172.21.15.45:0/1289995406 shutdown_connections 2024-09-15T22:19:50.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.935+0000 7f86d218a740 1 -- 172.21.15.45:0/1289995406 wait complete. 2024-09-15T22:19:50.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.935+0000 7f86d218a740 1 -- start start 2024-09-15T22:19:50.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.935+0000 7f86d218a740 1 Processor -- start 2024-09-15T22:19:50.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86d218a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa34196090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86d218a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa34182f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86d218a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa34183680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86d218a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81abc20 con 0x55aa34189370 2024-09-15T22:19:50.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86d218a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81ad090 con 0x55aa3417e5d0 2024-09-15T22:19:50.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86d218a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f86c81ac2f0 con 0x55aa3417fb40 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86d218a740 10 client.0 _ll_register_callbacks cb 0x7f86b8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86ce34e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa34183680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86ce34e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa34183680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53972/0 (socket says 172.21.15.45:53972) 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86ce34e640 1 -- 172.21.15.45:0/4014789523 learned_addr learned my addr 172.21.15.45:0/4014789523 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86cd34c640 1 --2- 172.21.15.45:0/4014789523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa34182f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/4014789523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa34196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86ce34e640 1 -- 172.21.15.45:0/4014789523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 msgr2=0x55aa34182f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86ce34e640 1 --2- 172.21.15.45:0/4014789523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa34182f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86ce34e640 1 -- 172.21.15.45:0/4014789523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 msgr2=0x55aa34196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86ce34e640 1 --2- 172.21.15.45:0/4014789523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa34196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86ce34e640 1 -- 172.21.15.45:0/4014789523 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa34207170 con 0x55aa34189370 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86ce34e640 1 --2- 172.21.15.45:0/4014789523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa34183680 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f86b8005fb0 tx=0x7f86b802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c997c0656d54ed1d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.936+0000 7f86ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86ad7fa640 1 -- 172.21.15.45:0/4014789523 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b804c040 con 0x55aa34189370 2024-09-15T22:19:50.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86ad7fa640 1 -- 172.21.15.45:0/4014789523 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f86b8004d50 con 0x55aa34189370 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86d218a740 1 -- 172.21.15.45:0/4014789523 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86b8036040 con 0x55aa34189370 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86ad7fa640 1 -- 172.21.15.45:0/4014789523 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f86b8051460 con 0x55aa34189370 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86d218a740 10 client.16155 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86d218a740 1 -- 172.21.15.45:0/4014789523 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55aa34208220 con 0x55aa34189370 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86ad7fa640 1 -- 172.21.15.45:0/4014789523 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f86b8036040 con 0x55aa34189370 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86ad7fa640 1 -- 172.21.15.45:0/4014789523 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f86b805e830 con 0x55aa34189370 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86d218a740 10 client.16155 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86d218a740 10 client.16155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86d218a740 20 client.16155 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86d218a740 1 --2- 172.21.15.45:0/4014789523 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aa342086f0 0x55aa3420aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86d218a740 4 client.16155 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.937+0000 7f86d218a740 1 -- 172.21.15.45:0/4014789523 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aa340ebd70 con 0x55aa342086f0 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/4014789523 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aa342086f0 0x55aa3420aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:50.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86cdb4d640 1 --2- 172.21.15.45:0/4014789523 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aa342086f0 0x55aa3420aae0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a1af948d95dcd20 server_cookie=1ca754ece8d4328d in_seq=0 out_seq=0 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86ad7fa640 10 client.16155 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86ad7fa640 1 -- 172.21.15.45:0/4014789523 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aa340ebd70 con 0x55aa342086f0 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86ad7fa640 10 client.16155 handle_command_reply: tid=0 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86d218a740 1 client.16155 shutdown 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86d218a740 1 -- 172.21.15.45:0/4014789523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 msgr2=0x55aa34183680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86d218a740 1 --2- 172.21.15.45:0/4014789523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa34183680 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f86b8005fb0 tx=0x7f86b802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86d218a740 1 -- 172.21.15.45:0/4014789523 shutdown_connections 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86d218a740 1 --2- 172.21.15.45:0/4014789523 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55aa342086f0 0x55aa3420aae0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86d218a740 1 --2- 172.21.15.45:0/4014789523 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa34189370 0x55aa34183680 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86d218a740 1 --2- 172.21.15.45:0/4014789523 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55aa3417fb40 0x55aa34182f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86d218a740 1 --2- 172.21.15.45:0/4014789523 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55aa3417e5d0 0x55aa34196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86ad7fa640 0 client.16155 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.938+0000 7f86d218a740 1 -- 172.21.15.45:0/4014789523 >> 172.21.15.45:0/4014789523 conn(0x55aa34147310 msgr2=0x55aa34187910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86d218a740 1 -- 172.21.15.45:0/4014789523 shutdown_connections 2024-09-15T22:19:50.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86d218a740 1 -- 172.21.15.45:0/4014789523 wait complete. 2024-09-15T22:19:50.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86d218a740 20 client.16155 trim_cache size 0 max 16384 2024-09-15T22:19:50.953 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:19:50.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86cfdb1640 1 -- 172.21.15.45:0/3019764664 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f86b00a3430 msgr2=0x7f86b00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:50.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86cfdb1640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f86b00a3430 0x7f86b00a58f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86b8005fe0 tx=0x7f86b80095c0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86cfdb1640 1 -- 172.21.15.45:0/3019764664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c8102df0 msgr2=0x7f86c8198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:50.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86cfdb1640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c8102df0 0x7f86c8198670 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f86c000d950 tx=0x7f86c000de10 comp rx=0 tx=0).stop 2024-09-15T22:19:50.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86cfdb1640 1 -- 172.21.15.45:0/3019764664 shutdown_connections 2024-09-15T22:19:50.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86cfdb1640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f86b00a3430 0x7f86b00a58f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86cfdb1640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86c810c2f0 0x7f86c819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86cfdb1640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f86c81037a0 0x7f86c8198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86cfdb1640 1 --2- 172.21.15.45:0/3019764664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86c8102df0 0x7f86c8198670 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:50.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86cfdb1640 1 -- 172.21.15.45:0/3019764664 >> 172.21.15.45:0/3019764664 conn(0x7f86c80fc7d0 msgr2=0x7f86c80fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:50.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86cfdb1640 1 -- 172.21.15.45:0/3019764664 shutdown_connections 2024-09-15T22:19:50.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:50.939+0000 7f86cfdb1640 1 -- 172.21.15.45:0/3019764664 wait complete. 2024-09-15T22:19:51.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:51 smithi165 ceph-mon[35551]: pgmap v111: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 186 KiB/s wr, 64 op/s 2024-09-15T22:19:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:51 smithi100 ceph-mon[35319]: pgmap v111: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 186 KiB/s wr, 64 op/s 2024-09-15T22:19:51.521 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:51 smithi045 ceph-mon[31180]: pgmap v111: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 186 KiB/s wr, 64 op/s 2024-09-15T22:19:52.779 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:19:52.779 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:19:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:53.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:53 smithi165 ceph-mon[35551]: pgmap v112: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.1 KiB/s wr, 7 op/s 2024-09-15T22:19:53.475 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:53 smithi045 ceph-mon[31180]: pgmap v112: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.1 KiB/s wr, 7 op/s 2024-09-15T22:19:53.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:53 smithi100 ceph-mon[35319]: pgmap v112: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.1 KiB/s wr, 7 op/s 2024-09-15T22:19:53.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.559+0000 7f0863934640 1 -- 172.21.15.45:0/3122932209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085c100a80 msgr2=0x7f085c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:53.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.559+0000 7f0863934640 1 --2- 172.21.15.45:0/3122932209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085c100a80 0x7f085c100ee0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f084c009930 tx=0x7f084c02a420 comp rx=0 tx=0).stop 2024-09-15T22:19:53.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 -- 172.21.15.45:0/3122932209 shutdown_connections 2024-09-15T22:19:53.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 --2- 172.21.15.45:0/3122932209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f085c101420 0x7f085c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 --2- 172.21.15.45:0/3122932209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085c100a80 0x7f085c100ee0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 --2- 172.21.15.45:0/3122932209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f085c106a80 0x7f085c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 -- 172.21.15.45:0/3122932209 >> 172.21.15.45:0/3122932209 conn(0x7f085c0fc7a0 msgr2=0x7f085c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 -- 172.21.15.45:0/3122932209 shutdown_connections 2024-09-15T22:19:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 -- 172.21.15.45:0/3122932209 wait complete. 2024-09-15T22:19:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 Processor -- start 2024-09-15T22:19:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 -- start start 2024-09-15T22:19:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f085c100a80 0x7f085c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f085c101420 0x7f085c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085c106a80 0x7f085c1a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f085c110fa0 con 0x7f085c106a80 2024-09-15T22:19:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f085c110e20 con 0x7f085c101420 2024-09-15T22:19:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.560+0000 7f0863934640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f085c111120 con 0x7f085c100a80 2024-09-15T22:19:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f0861ed1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085c106a80 0x7f085c1a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f0860ecf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f085c101420 0x7f085c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f0861ed1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085c106a80 0x7f085c1a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53978/0 (socket says 172.21.15.45:53978) 2024-09-15T22:19:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f0861ed1640 1 -- 172.21.15.45:0/3523187473 learned_addr learned my addr 172.21.15.45:0/3523187473 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f08616d0640 1 --2- 172.21.15.45:0/3523187473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f085c100a80 0x7f085c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f0861ed1640 1 -- 172.21.15.45:0/3523187473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f085c100a80 msgr2=0x7f085c1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f0861ed1640 1 --2- 172.21.15.45:0/3523187473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f085c100a80 0x7f085c1993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f0861ed1640 1 -- 172.21.15.45:0/3523187473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f085c101420 msgr2=0x7f085c199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f0861ed1640 1 --2- 172.21.15.45:0/3523187473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f085c101420 0x7f085c199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f0861ed1640 1 -- 172.21.15.45:0/3523187473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085c1a4990 con 0x7f085c106a80 2024-09-15T22:19:53.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f0861ed1640 1 --2- 172.21.15.45:0/3523187473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085c106a80 0x7f085c1a4450 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f085400cad0 tx=0x7f085400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:53.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f08527fc640 1 -- 172.21.15.45:0/3523187473 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085400ae20 con 0x7f085c106a80 2024-09-15T22:19:53.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f08527fc640 1 -- 172.21.15.45:0/3523187473 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0854004b20 con 0x7f085c106a80 2024-09-15T22:19:53.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f0863934640 1 -- 172.21.15.45:0/3523187473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f085c1a4b60 con 0x7f085c106a80 2024-09-15T22:19:53.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f08527fc640 1 -- 172.21.15.45:0/3523187473 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085400f780 con 0x7f085c106a80 2024-09-15T22:19:53.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.561+0000 7f0863934640 1 -- 172.21.15.45:0/3523187473 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f085c1a5020 con 0x7f085c106a80 2024-09-15T22:19:53.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.564+0000 7f08527fc640 1 -- 172.21.15.45:0/3523187473 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0854004cd0 con 0x7f085c106a80 2024-09-15T22:19:53.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.564+0000 7f0865d0d740 1 Processor -- start 2024-09-15T22:19:53.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.564+0000 7f0865d0d740 1 -- start start 2024-09-15T22:19:53.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0865d0d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556719484b60 0x556719484f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0865d0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719485480 0x55671948f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0865d0d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 0x556719492130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0865d0d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5567193ea280 con 0x55671948fd40 2024-09-15T22:19:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0865d0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556719391b10 con 0x556719485480 2024-09-15T22:19:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0865d0d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5567193e6240 con 0x556719484b60 2024-09-15T22:19:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f08527fc640 1 --2- 172.21.15.45:0/3523187473 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08480a33b0 0x7f08480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0860ecf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 0x556719492130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0860ecf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 0x556719492130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53980/0 (socket says 172.21.15.45:53980) 2024-09-15T22:19:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0860ecf640 1 -- 172.21.15.45:0/1963344293 learned_addr learned my addr 172.21.15.45:0/1963344293 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0861ed1640 1 --2- 172.21.15.45:0/3523187473 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08480a33b0 0x7f08480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f08616d0640 1 --2- 172.21.15.45:0/1963344293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719485480 0x55671948f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0860ecf640 1 --2- 172.21.15.45:0/1963344293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556719484b60 0x556719484f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f08527fc640 1 -- 172.21.15.45:0/3523187473 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f08540d00d0 con 0x7f085c106a80 2024-09-15T22:19:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0860ecf640 1 -- 172.21.15.45:0/1963344293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556719484b60 msgr2=0x556719484f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0860ecf640 1 --2- 172.21.15.45:0/1963344293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556719484b60 0x556719484f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0860ecf640 1 -- 172.21.15.45:0/1963344293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719485480 msgr2=0x55671948f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0860ecf640 1 --2- 172.21.15.45:0/1963344293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719485480 0x55671948f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0860ecf640 1 -- 172.21.15.45:0/1963344293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55671939e1f0 con 0x55671948fd40 2024-09-15T22:19:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0860ecf640 1 --2- 172.21.15.45:0/1963344293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 0x556719492130 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f084c009930 tx=0x7f084c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6af820d9e4c4f93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.565+0000 7f0861ed1640 1 --2- 172.21.15.45:0/3523187473 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08480a33b0 0x7f08480a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0854098a70 tx=0x7f0854066f30 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:53.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.566+0000 7f08477fe640 1 -- 172.21.15.45:0/1963344293 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c035070 con 0x55671948fd40 2024-09-15T22:19:53.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.566+0000 7f08477fe640 1 -- 172.21.15.45:0/1963344293 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f084c031740 con 0x55671948fd40 2024-09-15T22:19:53.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.566+0000 7f08477fe640 1 -- 172.21.15.45:0/1963344293 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c0047a0 con 0x55671948fd40 2024-09-15T22:19:53.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.566+0000 7f0865d0d740 1 -- 172.21.15.45:0/1963344293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 msgr2=0x556719492130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:53.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.566+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1963344293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 0x556719492130 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f084c009930 tx=0x7f084c005fd0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.566+0000 7f0865d0d740 1 -- 172.21.15.45:0/1963344293 shutdown_connections 2024-09-15T22:19:53.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.566+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1963344293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 0x556719492130 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.566+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1963344293 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719485480 0x55671948f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.566+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1963344293 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556719484b60 0x556719484f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.566+0000 7f0865d0d740 1 -- 172.21.15.45:0/1963344293 >> 172.21.15.45:0/1963344293 conn(0x5567194810f0 msgr2=0x5567194814d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:53.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.566+0000 7f0865d0d740 1 -- 172.21.15.45:0/1963344293 shutdown_connections 2024-09-15T22:19:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.566+0000 7f0865d0d740 1 -- 172.21.15.45:0/1963344293 wait complete. 2024-09-15T22:19:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.567+0000 7f0865d0d740 1 -- start start 2024-09-15T22:19:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.567+0000 7f0865d0d740 1 Processor -- start 2024-09-15T22:19:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.567+0000 7f0865d0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719484b60 0x55671948cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.567+0000 7f0865d0d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 0x55671948d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.567+0000 7f0865d0d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55671948fd40 0x55671948d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.567+0000 7f0865d0d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556719492910 con 0x556719485480 2024-09-15T22:19:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.567+0000 7f0865d0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5567193a4f10 con 0x556719484b60 2024-09-15T22:19:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.567+0000 7f0865d0d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556719492a90 con 0x55671948fd40 2024-09-15T22:19:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.567+0000 7f0865d0d740 10 client.0 _ll_register_callbacks cb 0x55671936da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.567+0000 7f08616d0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 0x55671948d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.567+0000 7f08616d0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 0x55671948d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53986/0 (socket says 172.21.15.45:53986) 2024-09-15T22:19:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.567+0000 7f08616d0640 1 -- 172.21.15.45:0/3346665989 learned_addr learned my addr 172.21.15.45:0/3346665989 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f0860ecf640 1 --2- 172.21.15.45:0/3346665989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719484b60 0x55671948cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f08616d0640 1 -- 172.21.15.45:0/3346665989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55671948fd40 msgr2=0x55671948d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f08616d0640 1 --2- 172.21.15.45:0/3346665989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55671948fd40 0x55671948d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f08616d0640 1 -- 172.21.15.45:0/3346665989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719484b60 msgr2=0x55671948cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f08616d0640 1 --2- 172.21.15.45:0/3346665989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719484b60 0x55671948cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f08616d0640 1 -- 172.21.15.45:0/3346665989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55671915b6a0 con 0x556719485480 2024-09-15T22:19:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f0860ecf640 1 --2- 172.21.15.45:0/3346665989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719484b60 0x55671948cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f08616d0640 1 --2- 172.21.15.45:0/3346665989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 0x55671948d1a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f085800b950 tx=0x7f085800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdbefa37937515c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f0844ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f0844ff9640 1 -- 172.21.15.45:0/3346665989 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085801b440 con 0x556719485480 2024-09-15T22:19:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f0844ff9640 1 -- 172.21.15.45:0/3346665989 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f0858011440 con 0x556719485480 2024-09-15T22:19:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f0865d0d740 1 -- 172.21.15.45:0/3346665989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f084c031740 con 0x556719485480 2024-09-15T22:19:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f0844ff9640 1 -- 172.21.15.45:0/3346665989 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0858011680 con 0x556719485480 2024-09-15T22:19:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f0865d0d740 10 client.16167 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f0865d0d740 1 -- 172.21.15.45:0/3346665989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55671949e5e0 con 0x556719485480 2024-09-15T22:19:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.568+0000 7f0844ff9640 1 -- 172.21.15.45:0/3346665989 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f084c031740 con 0x556719485480 2024-09-15T22:19:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.569+0000 7f0844ff9640 1 -- 172.21.15.45:0/3346665989 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0858019020 con 0x556719485480 2024-09-15T22:19:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.569+0000 7f0865d0d740 10 client.16167 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.569+0000 7f0865d0d740 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.569+0000 7f0865d0d740 20 client.16167 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.569+0000 7f0865d0d740 1 --2- 172.21.15.45:0/3346665989 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55671949faf0 0x5567194a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.569+0000 7f0865d0d740 4 client.16167 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.569+0000 7f0865d0d740 1 -- 172.21.15.45:0/3346665989 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567193f77f0 con 0x55671949faf0 2024-09-15T22:19:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.569+0000 7f0860ecf640 1 --2- 172.21.15.45:0/3346665989 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55671949faf0 0x5567194a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.569+0000 7f0860ecf640 1 --2- 172.21.15.45:0/3346665989 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55671949faf0 0x5567194a1f90 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c24a3b3e25ccc8d server_cookie=b947fbdce4b3b020 in_seq=0 out_seq=0 2024-09-15T22:19:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.569+0000 7f0844ff9640 10 client.16167 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.570+0000 7f0844ff9640 1 -- 172.21.15.45:0/3346665989 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5567193f77f0 con 0x55671949faf0 2024-09-15T22:19:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.570+0000 7f0844ff9640 10 client.16167 handle_command_reply: tid=0 2024-09-15T22:19:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.570+0000 7f0865d0d740 1 client.16167 shutdown 2024-09-15T22:19:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.570+0000 7f0865d0d740 1 -- 172.21.15.45:0/3346665989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 msgr2=0x55671948d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.570+0000 7f0865d0d740 1 --2- 172.21.15.45:0/3346665989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 0x55671948d1a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f085800b950 tx=0x7f085800bd50 comp rx=0 tx=0).stop 2024-09-15T22:19:53.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.570+0000 7f0865d0d740 1 -- 172.21.15.45:0/3346665989 shutdown_connections 2024-09-15T22:19:53.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.570+0000 7f0865d0d740 1 --2- 172.21.15.45:0/3346665989 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55671949faf0 0x5567194a1f90 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.570+0000 7f0865d0d740 1 --2- 172.21.15.45:0/3346665989 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55671948fd40 0x55671948d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.570+0000 7f0865d0d740 1 --2- 172.21.15.45:0/3346665989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 0x55671948d1a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.570+0000 7f0844ff9640 0 client.16167 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:53.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.570+0000 7f0865d0d740 1 --2- 172.21.15.45:0/3346665989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719484b60 0x55671948cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.570+0000 7f0865d0d740 1 -- 172.21.15.45:0/3346665989 >> 172.21.15.45:0/3346665989 conn(0x5567194810f0 msgr2=0x556719486dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:53.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.571+0000 7f0865d0d740 1 -- 172.21.15.45:0/3346665989 shutdown_connections 2024-09-15T22:19:53.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.571+0000 7f0865d0d740 1 -- 172.21.15.45:0/3346665989 wait complete. 2024-09-15T22:19:53.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.571+0000 7f0865d0d740 20 client.16167 trim_cache size 0 max 16384 2024-09-15T22:19:53.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.589+0000 7f0865d0d740 1 Processor -- start 2024-09-15T22:19:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.589+0000 7f0865d0d740 1 -- start start 2024-09-15T22:19:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.589+0000 7f0865d0d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556719484b60 0x556719486cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.589+0000 7f0865d0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719485480 0x5567194a7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.589+0000 7f0865d0d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 0x5567194a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.589+0000 7f0865d0d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f085c1ad190 con 0x55671948fd40 2024-09-15T22:19:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.589+0000 7f0865d0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f085c1afa10 con 0x556719485480 2024-09-15T22:19:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.589+0000 7f0865d0d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f085c1ad800 con 0x556719484b60 2024-09-15T22:19:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.589+0000 7f0860ecf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 0x5567194a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.589+0000 7f0860ecf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 0x5567194a7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53998/0 (socket says 172.21.15.45:53998) 2024-09-15T22:19:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.589+0000 7f0860ecf640 1 -- 172.21.15.45:0/1209945317 learned_addr learned my addr 172.21.15.45:0/1209945317 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.590+0000 7f0860ecf640 1 --2- 172.21.15.45:0/1209945317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556719484b60 0x556719486cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.590+0000 7f08616d0640 1 --2- 172.21.15.45:0/1209945317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719485480 0x5567194a7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.590+0000 7f0860ecf640 1 -- 172.21.15.45:0/1209945317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556719484b60 msgr2=0x556719486cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.590+0000 7f0860ecf640 1 --2- 172.21.15.45:0/1209945317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556719484b60 0x556719486cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.590+0000 7f0860ecf640 1 -- 172.21.15.45:0/1209945317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719485480 msgr2=0x5567194a7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.590+0000 7f0860ecf640 1 --2- 172.21.15.45:0/1209945317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719485480 0x5567194a7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.590+0000 7f0860ecf640 1 -- 172.21.15.45:0/1209945317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567194a2610 con 0x55671948fd40 2024-09-15T22:19:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.590+0000 7f0860ecf640 1 --2- 172.21.15.45:0/1209945317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 0x5567194a7da0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x556719482470 tx=0x7f084c040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6c1fa2d772e10e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.590+0000 7f0846ffd640 1 -- 172.21.15.45:0/1209945317 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c057020 con 0x55671948fd40 2024-09-15T22:19:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.590+0000 7f0846ffd640 1 -- 172.21.15.45:0/1209945317 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f084c005090 con 0x55671948fd40 2024-09-15T22:19:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.590+0000 7f0846ffd640 1 -- 172.21.15.45:0/1209945317 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084c035040 con 0x55671948fd40 2024-09-15T22:19:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.591+0000 7f0865d0d740 1 -- 172.21.15.45:0/1209945317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 msgr2=0x5567194a7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.591+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1209945317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 0x5567194a7da0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x556719482470 tx=0x7f084c040040 comp rx=0 tx=0).stop 2024-09-15T22:19:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.591+0000 7f0865d0d740 1 -- 172.21.15.45:0/1209945317 shutdown_connections 2024-09-15T22:19:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.591+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1209945317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55671948fd40 0x5567194a7da0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.591+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1209945317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719485480 0x5567194a7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.591+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1209945317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556719484b60 0x556719486cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.591+0000 7f0865d0d740 1 -- 172.21.15.45:0/1209945317 >> 172.21.15.45:0/1209945317 conn(0x5567194810f0 msgr2=0x5567194865b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.591+0000 7f0865d0d740 1 -- 172.21.15.45:0/1209945317 shutdown_connections 2024-09-15T22:19:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.591+0000 7f0865d0d740 1 -- 172.21.15.45:0/1209945317 wait complete. 2024-09-15T22:19:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.591+0000 7f0865d0d740 1 -- start start 2024-09-15T22:19:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.591+0000 7f0865d0d740 1 Processor -- start 2024-09-15T22:19:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f0865d0d740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719484b60 0x556719494cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f0865d0d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 0x556719495210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f0865d0d740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55671948fd40 0x556719503800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f0865d0d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f085c1aded0 con 0x556719485480 2024-09-15T22:19:53.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f0865d0d740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f085c1af340 con 0x556719484b60 2024-09-15T22:19:53.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f0865d0d740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f085c1ae5a0 con 0x55671948fd40 2024-09-15T22:19:53.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f0865d0d740 10 client.0 _ll_register_callbacks cb 0x7f0858004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:53.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f08616d0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 0x556719495210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f08616d0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 0x556719495210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54000/0 (socket says 172.21.15.45:54000) 2024-09-15T22:19:53.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f08616d0640 1 -- 172.21.15.45:0/1243277012 learned_addr learned my addr 172.21.15.45:0/1243277012 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:53.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f0860ecf640 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55671948fd40 0x556719503800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f0860ecf640 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719484b60 0x556719494cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f08616d0640 1 -- 172.21.15.45:0/1243277012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55671948fd40 msgr2=0x556719503800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f08616d0640 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55671948fd40 0x556719503800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f08616d0640 1 -- 172.21.15.45:0/1243277012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719484b60 msgr2=0x556719494cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f08616d0640 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719484b60 0x556719494cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f08616d0640 1 -- 172.21.15.45:0/1243277012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556719503e40 con 0x556719485480 2024-09-15T22:19:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.592+0000 7f0860ecf640 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719484b60 0x556719494cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f08616d0640 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 0x556719495210 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f085800b620 tx=0x7f0858003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae3691e248968bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0844ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0844ff9640 1 -- 172.21.15.45:0/1243277012 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0858005240 con 0x556719485480 2024-09-15T22:19:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0844ff9640 1 -- 172.21.15.45:0/1243277012 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f08580053e0 con 0x556719485480 2024-09-15T22:19:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0865d0d740 1 -- 172.21.15.45:0/1243277012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f084c005090 con 0x556719485480 2024-09-15T22:19:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0844ff9640 1 -- 172.21.15.45:0/1243277012 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0858039050 con 0x556719485480 2024-09-15T22:19:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0865d0d740 10 client.16173 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0865d0d740 1 -- 172.21.15.45:0/1243277012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55671950b230 con 0x556719485480 2024-09-15T22:19:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0844ff9640 1 -- 172.21.15.45:0/1243277012 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f084c005090 con 0x556719485480 2024-09-15T22:19:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0844ff9640 1 -- 172.21.15.45:0/1243277012 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0858019050 con 0x556719485480 2024-09-15T22:19:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0865d0d740 10 client.16173 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0865d0d740 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0865d0d740 20 client.16173 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55671950b950 0x55671950dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0865d0d740 4 client.16173 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:19:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.593+0000 7f0865d0d740 1 -- 172.21.15.45:0/1243277012 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5567193f1d00 con 0x55671950b950 2024-09-15T22:19:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.594+0000 7f0860ecf640 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55671950b950 0x55671950dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.594+0000 7f0860ecf640 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55671950b950 0x55671950dd70 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9194de1542af9397 server_cookie=e51689b8c100f5f4 in_seq=0 out_seq=0 2024-09-15T22:19:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.594+0000 7f0844ff9640 10 client.16173 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.595+0000 7f0844ff9640 1 -- 172.21.15.45:0/1243277012 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5567193f1d00 con 0x55671950b950 2024-09-15T22:19:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.595+0000 7f0844ff9640 10 client.16173 handle_command_reply: tid=0 2024-09-15T22:19:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.595+0000 7f0865d0d740 1 client.16173 shutdown 2024-09-15T22:19:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.595+0000 7f0865d0d740 1 -- 172.21.15.45:0/1243277012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 msgr2=0x556719495210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.595+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 0x556719495210 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f085800b620 tx=0x7f0858003b00 comp rx=0 tx=0).stop 2024-09-15T22:19:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.595+0000 7f0865d0d740 1 -- 172.21.15.45:0/1243277012 shutdown_connections 2024-09-15T22:19:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.595+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55671950b950 0x55671950dd70 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55671948fd40 0x556719503800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556719485480 0x556719495210 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0865d0d740 1 --2- 172.21.15.45:0/1243277012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556719484b60 0x556719494cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0865d0d740 1 -- 172.21.15.45:0/1243277012 >> 172.21.15.45:0/1243277012 conn(0x5567194810f0 msgr2=0x556719480270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0844ff9640 0 client.16173 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0865d0d740 1 -- 172.21.15.45:0/1243277012 shutdown_connections 2024-09-15T22:19:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0865d0d740 1 -- 172.21.15.45:0/1243277012 wait complete. 2024-09-15T22:19:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0865d0d740 20 client.16173 trim_cache size 0 max 16384 2024-09-15T22:19:53.609 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:19:53.610 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:19:53.610 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "69fcedd2-630d-4e8d-a361-730f8af05015", 2024-09-15T22:19:53.610 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:19:53.610 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:19:53.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0863934640 1 -- 172.21.15.45:0/3523187473 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08480a33b0 msgr2=0x7f08480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:53.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0863934640 1 --2- 172.21.15.45:0/3523187473 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08480a33b0 0x7f08480a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0854098a70 tx=0x7f0854066f30 comp rx=0 tx=0).stop 2024-09-15T22:19:53.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0863934640 1 -- 172.21.15.45:0/3523187473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085c106a80 msgr2=0x7f085c1a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:53.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0863934640 1 --2- 172.21.15.45:0/3523187473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085c106a80 0x7f085c1a4450 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f085400cad0 tx=0x7f085400cf90 comp rx=0 tx=0).stop 2024-09-15T22:19:53.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0863934640 1 -- 172.21.15.45:0/3523187473 shutdown_connections 2024-09-15T22:19:53.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0863934640 1 --2- 172.21.15.45:0/3523187473 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08480a33b0 0x7f08480a5870 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0863934640 1 --2- 172.21.15.45:0/3523187473 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f085c106a80 0x7f085c1a4450 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0863934640 1 --2- 172.21.15.45:0/3523187473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f085c101420 0x7f085c199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0863934640 1 --2- 172.21.15.45:0/3523187473 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f085c100a80 0x7f085c1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:53.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.596+0000 7f0863934640 1 -- 172.21.15.45:0/3523187473 >> 172.21.15.45:0/3523187473 conn(0x7f085c0fc7a0 msgr2=0x7f085c0fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:53.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.597+0000 7f0863934640 1 -- 172.21.15.45:0/3523187473 shutdown_connections 2024-09-15T22:19:53.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:53.597+0000 7f0863934640 1 -- 172.21.15.45:0/3523187473 wait complete. 2024-09-15T22:19:54.459 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:19:54.723 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:19:55.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.207+0000 7f549780f640 1 -- 172.21.15.45:0/2520899806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5490100b20 msgr2=0x7f5490100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.207+0000 7f549780f640 1 --2- 172.21.15.45:0/2520899806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5490100b20 0x7f5490100f00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f548c009900 tx=0x7f548c02a410 comp rx=0 tx=0).stop 2024-09-15T22:19:55.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.207+0000 7f549780f640 1 -- 172.21.15.45:0/2520899806 shutdown_connections 2024-09-15T22:19:55.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.207+0000 7f549780f640 1 --2- 172.21.15.45:0/2520899806 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f549010e500 0x7f5490110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.207+0000 7f549780f640 1 --2- 172.21.15.45:0/2520899806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5490101440 0x7f549010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.207+0000 7f549780f640 1 --2- 172.21.15.45:0/2520899806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5490100b20 0x7f5490100f00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.207+0000 7f549780f640 1 -- 172.21.15.45:0/2520899806 >> 172.21.15.45:0/2520899806 conn(0x7f54900fc7d0 msgr2=0x7f54900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:55.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.207+0000 7f549780f640 1 -- 172.21.15.45:0/2520899806 shutdown_connections 2024-09-15T22:19:55.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.207+0000 7f549780f640 1 -- 172.21.15.45:0/2520899806 wait complete. 2024-09-15T22:19:55.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.208+0000 7f549780f640 1 Processor -- start 2024-09-15T22:19:55.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.208+0000 7f549780f640 1 -- start start 2024-09-15T22:19:55.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.208+0000 7f549780f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5490100b20 0x7f54901a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.208+0000 7f549780f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5490101440 0x7f54901a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.208+0000 7f549780f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f549010e500 0x7f549019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.208+0000 7f549780f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5490114390 con 0x7f5490101440 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.208+0000 7f549780f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5490114210 con 0x7f5490100b20 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.208+0000 7f549780f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5490114510 con 0x7f549010e500 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.208+0000 7f5494daa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5490101440 0x7f54901a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.208+0000 7f5494daa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5490101440 0x7f54901a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36260/0 (socket says 172.21.15.45:36260) 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f5494daa640 1 -- 172.21.15.45:0/1241188724 learned_addr learned my addr 172.21.15.45:0/1241188724 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f54955ab640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5490100b20 0x7f54901a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f5495dac640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f549010e500 0x7f549019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f5494daa640 1 -- 172.21.15.45:0/1241188724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f549010e500 msgr2=0x7f549019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f5494daa640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f549010e500 0x7f549019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f5494daa640 1 -- 172.21.15.45:0/1241188724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5490100b20 msgr2=0x7f54901a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f5494daa640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5490100b20 0x7f54901a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f5494daa640 1 -- 172.21.15.45:0/1241188724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f549019ad10 con 0x7f5490101440 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f5495dac640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f549010e500 0x7f549019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f54955ab640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5490100b20 0x7f54901a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f5494daa640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5490101440 0x7f54901a0960 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f548000c970 tx=0x7f548000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f54867fc640 1 -- 172.21.15.45:0/1241188724 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5480007c10 con 0x7f5490101440 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f549780f640 1 -- 172.21.15.45:0/1241188724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f549019b000 con 0x7f5490101440 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f54867fc640 1 -- 172.21.15.45:0/1241188724 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5480007db0 con 0x7f5490101440 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f54867fc640 1 -- 172.21.15.45:0/1241188724 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548000f9b0 con 0x7f5490101440 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.209+0000 7f549780f640 1 -- 172.21.15.45:0/1241188724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54901a72f0 con 0x7f5490101440 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.212+0000 7f54867fc640 1 -- 172.21.15.45:0/1241188724 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f548000fb50 con 0x7f5490101440 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.212+0000 7f5499be8740 1 Processor -- start 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.212+0000 7f5499be8740 1 -- start start 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5499be8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 0x56078ee3d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5499be8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee3ddc0 0x56078ee48140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5499be8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee48680 0x56078ee4aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5499be8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56078eda32e0 con 0x56078ee3d4a0 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5499be8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56078ed4ace0 con 0x56078ee48680 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5499be8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56078ed9f2a0 con 0x56078ee3ddc0 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f54867fc640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f547c0a33b0 0x7f547c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5495dac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 0x56078ee3d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5495dac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 0x56078ee3d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36276/0 (socket says 172.21.15.45:36276) 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5495dac640 1 -- 172.21.15.45:0/2298595736 learned_addr learned my addr 172.21.15.45:0/2298595736 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f54955ab640 1 --2- 172.21.15.45:0/2298595736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee3ddc0 0x56078ee48140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5495dac640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f547c0a33b0 0x7f547c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f54867fc640 1 -- 172.21.15.45:0/1241188724 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f54800d0490 con 0x7f5490101440 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5494daa640 1 --2- 172.21.15.45:0/2298595736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee48680 0x56078ee4aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5495dac640 1 -- 172.21.15.45:0/2298595736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee3ddc0 msgr2=0x56078ee48140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5495dac640 1 --2- 172.21.15.45:0/2298595736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee3ddc0 0x56078ee48140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5495dac640 1 -- 172.21.15.45:0/2298595736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee48680 msgr2=0x56078ee4aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5495dac640 1 --2- 172.21.15.45:0/2298595736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee48680 0x56078ee4aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5495dac640 1 -- 172.21.15.45:0/2298595736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078ed2f440 con 0x56078ee3d4a0 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.213+0000 7f5494daa640 1 --2- 172.21.15.45:0/2298595736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee48680 0x56078ee4aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.214+0000 7f5495dac640 1 --2- 172.21.15.45:0/2298595736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 0x56078ee3d880 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f54880139b0 tx=0x7f5488013e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebfc55e85701240 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.214+0000 7f547b7fe640 1 -- 172.21.15.45:0/2298595736 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5488023020 con 0x56078ee3d4a0 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.214+0000 7f547b7fe640 1 -- 172.21.15.45:0/2298595736 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5488013050 con 0x56078ee3d4a0 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.214+0000 7f547b7fe640 1 -- 172.21.15.45:0/2298595736 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548801f830 con 0x56078ee3d4a0 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.215+0000 7f5499be8740 1 -- 172.21.15.45:0/2298595736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 msgr2=0x56078ee3d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.215+0000 7f5499be8740 1 --2- 172.21.15.45:0/2298595736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 0x56078ee3d880 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f54880139b0 tx=0x7f5488013e70 comp rx=0 tx=0).stop 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.215+0000 7f5495dac640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f547c0a33b0 0x7f547c0a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5488021000 tx=0x7f5488020000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.215+0000 7f5499be8740 1 -- 172.21.15.45:0/2298595736 shutdown_connections 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.215+0000 7f5499be8740 1 --2- 172.21.15.45:0/2298595736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee48680 0x56078ee4aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.215+0000 7f5499be8740 1 --2- 172.21.15.45:0/2298595736 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee3ddc0 0x56078ee48140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.215+0000 7f5499be8740 1 --2- 172.21.15.45:0/2298595736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 0x56078ee3d880 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.215+0000 7f5499be8740 1 -- 172.21.15.45:0/2298595736 >> 172.21.15.45:0/2298595736 conn(0x56078ee39a30 msgr2=0x56078ee39e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.215+0000 7f5499be8740 1 -- 172.21.15.45:0/2298595736 shutdown_connections 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.215+0000 7f5499be8740 1 -- 172.21.15.45:0/2298595736 wait complete. 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.215+0000 7f5499be8740 1 -- start start 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.215+0000 7f5499be8740 1 Processor -- start 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5499be8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3d4a0 0x56078ee47fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5499be8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 0x56078ee45290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5499be8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 0x56078ee457f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5499be8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56078ee4b250 con 0x56078ee3ddc0 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5499be8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56078ed5e050 con 0x56078ee3d4a0 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5499be8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56078ee4b3d0 con 0x56078ee48680 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5499be8740 10 client.0 _ll_register_callbacks cb 0x56078ed9e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5494daa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 0x56078ee45290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5494daa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 0x56078ee45290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36280/0 (socket says 172.21.15.45:36280) 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5494daa640 1 -- 172.21.15.45:0/3149802713 learned_addr learned my addr 172.21.15.45:0/3149802713 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:55.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f54955ab640 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3d4a0 0x56078ee47fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5495dac640 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 0x56078ee457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5494daa640 1 -- 172.21.15.45:0/3149802713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 msgr2=0x56078ee457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5494daa640 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 0x56078ee457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5494daa640 1 -- 172.21.15.45:0/3149802713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3d4a0 msgr2=0x56078ee47fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5494daa640 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3d4a0 0x56078ee47fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5494daa640 1 -- 172.21.15.45:0/3149802713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56078eb143c0 con 0x56078ee3ddc0 2024-09-15T22:19:55.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f54955ab640 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3d4a0 0x56078ee47fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:55.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5494daa640 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 0x56078ee45290 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f54800cd880 tx=0x7f548009bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aff6c01821a5a47 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:55.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5478ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:55.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5478ff9640 1 -- 172.21.15.45:0/3149802713 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548006e020 con 0x56078ee3ddc0 2024-09-15T22:19:55.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5499be8740 1 -- 172.21.15.45:0/3149802713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5488013050 con 0x56078ee3ddc0 2024-09-15T22:19:55.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.216+0000 7f5478ff9640 1 -- 172.21.15.45:0/3149802713 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f5480098ab0 con 0x56078ee3ddc0 2024-09-15T22:19:55.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.217+0000 7f5478ff9640 1 -- 172.21.15.45:0/3149802713 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f548009c440 con 0x56078ee3ddc0 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.217+0000 7f5499be8740 10 client.16185 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.217+0000 7f5499be8740 1 -- 172.21.15.45:0/3149802713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56078ee56bc0 con 0x56078ee3ddc0 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.217+0000 7f5478ff9640 1 -- 172.21.15.45:0/3149802713 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5488013050 con 0x56078ee3ddc0 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.217+0000 7f5478ff9640 1 -- 172.21.15.45:0/3149802713 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5480020030 con 0x56078ee3ddc0 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.217+0000 7f5499be8740 10 client.16185 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.217+0000 7f5499be8740 10 client.16185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.217+0000 7f5499be8740 20 client.16185 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.217+0000 7f5499be8740 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56078ee58080 0x56078ee5a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.217+0000 7f5499be8740 4 client.16185 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.217+0000 7f5499be8740 1 -- 172.21.15.45:0/3149802713 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56078edb0850 con 0x56078ee58080 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.217+0000 7f54955ab640 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56078ee58080 0x56078ee5a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.218+0000 7f54955ab640 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56078ee58080 0x56078ee5a4b0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c699f552b10d7d8d server_cookie=f8920cea16d74abf in_seq=0 out_seq=0 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.218+0000 7f5478ff9640 10 client.16185 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:55.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.218+0000 7f5478ff9640 1 -- 172.21.15.45:0/3149802713 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56078edb0850 con 0x56078ee58080 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.218+0000 7f5478ff9640 10 client.16185 handle_command_reply: tid=0 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.219+0000 7f5499be8740 1 client.16185 shutdown 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.219+0000 7f5499be8740 1 -- 172.21.15.45:0/3149802713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 msgr2=0x56078ee45290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.219+0000 7f5499be8740 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 0x56078ee45290 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f54800cd880 tx=0x7f548009bf80 comp rx=0 tx=0).stop 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.219+0000 7f5499be8740 1 -- 172.21.15.45:0/3149802713 shutdown_connections 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.219+0000 7f5499be8740 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56078ee58080 0x56078ee5a4b0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.219+0000 7f5478ff9640 0 client.16185 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.219+0000 7f5499be8740 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 0x56078ee457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.219+0000 7f5499be8740 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 0x56078ee45290 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.219+0000 7f5499be8740 1 --2- 172.21.15.45:0/3149802713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3d4a0 0x56078ee47fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.219+0000 7f5499be8740 1 -- 172.21.15.45:0/3149802713 >> 172.21.15.45:0/3149802713 conn(0x56078ee39a30 msgr2=0x56078ee3f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.219+0000 7f5499be8740 1 -- 172.21.15.45:0/3149802713 shutdown_connections 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.219+0000 7f5499be8740 1 -- 172.21.15.45:0/3149802713 wait complete. 2024-09-15T22:19:55.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.219+0000 7f5499be8740 20 client.16185 trim_cache size 0 max 16384 2024-09-15T22:19:55.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f5499be8740 1 Processor -- start 2024-09-15T22:19:55.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f5499be8740 1 -- start start 2024-09-15T22:19:55.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f5499be8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 0x56078ee5fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f5499be8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3ddc0 0x56078ee60270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f5499be8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 0x56078ee42510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f5499be8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f54901af390 con 0x56078ee3d4a0 2024-09-15T22:19:55.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f5499be8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f54901b1c10 con 0x56078ee3ddc0 2024-09-15T22:19:55.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f5499be8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f54901afa00 con 0x56078ee48680 2024-09-15T22:19:55.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f54955ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 0x56078ee5fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f54955ab640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 0x56078ee5fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36294/0 (socket says 172.21.15.45:36294) 2024-09-15T22:19:55.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f54955ab640 1 -- 172.21.15.45:0/1151540457 learned_addr learned my addr 172.21.15.45:0/1151540457 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:55.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f5494daa640 1 --2- 172.21.15.45:0/1151540457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3ddc0 0x56078ee60270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f5495dac640 1 --2- 172.21.15.45:0/1151540457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 0x56078ee42510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f54955ab640 1 -- 172.21.15.45:0/1151540457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 msgr2=0x56078ee42510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f54955ab640 1 --2- 172.21.15.45:0/1151540457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 0x56078ee42510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f54955ab640 1 -- 172.21.15.45:0/1151540457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3ddc0 msgr2=0x56078ee60270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f54955ab640 1 --2- 172.21.15.45:0/1151540457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3ddc0 0x56078ee60270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f54955ab640 1 -- 172.21.15.45:0/1151540457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078ee3d2d0 con 0x56078ee3d4a0 2024-09-15T22:19:55.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.237+0000 7f5494daa640 1 --2- 172.21.15.45:0/1151540457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3ddc0 0x56078ee60270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:19:55.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.238+0000 7f54955ab640 1 --2- 172.21.15.45:0/1151540457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 0x56078ee5fd30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f548c009900 tx=0x7f548c005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7fb32f1fc527 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:55.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.238+0000 7f547affd640 1 -- 172.21.15.45:0/1151540457 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c035040 con 0x56078ee3d4a0 2024-09-15T22:19:55.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.238+0000 7f547affd640 1 -- 172.21.15.45:0/1151540457 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f548c047070 con 0x56078ee3d4a0 2024-09-15T22:19:55.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.238+0000 7f547affd640 1 -- 172.21.15.45:0/1151540457 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548c0046c0 con 0x56078ee3d4a0 2024-09-15T22:19:55.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.239+0000 7f5499be8740 1 -- 172.21.15.45:0/1151540457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 msgr2=0x56078ee5fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.239+0000 7f5499be8740 1 --2- 172.21.15.45:0/1151540457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 0x56078ee5fd30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f548c009900 tx=0x7f548c005e60 comp rx=0 tx=0).stop 2024-09-15T22:19:55.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.239+0000 7f5499be8740 1 -- 172.21.15.45:0/1151540457 shutdown_connections 2024-09-15T22:19:55.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.239+0000 7f5499be8740 1 --2- 172.21.15.45:0/1151540457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 0x56078ee42510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.239+0000 7f5499be8740 1 --2- 172.21.15.45:0/1151540457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3ddc0 0x56078ee60270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.239+0000 7f5499be8740 1 --2- 172.21.15.45:0/1151540457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3d4a0 0x56078ee5fd30 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.239+0000 7f5499be8740 1 -- 172.21.15.45:0/1151540457 >> 172.21.15.45:0/1151540457 conn(0x56078ee39a30 msgr2=0x56078ee47310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.239+0000 7f5499be8740 1 -- 172.21.15.45:0/1151540457 shutdown_connections 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.239+0000 7f5499be8740 1 -- 172.21.15.45:0/1151540457 wait complete. 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.239+0000 7f5499be8740 1 -- start start 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.239+0000 7f5499be8740 1 Processor -- start 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5499be8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3d4a0 0x56078ee50cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5499be8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 0x56078ee4e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5499be8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 0x56078ee4e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5499be8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f54901b00d0 con 0x56078ee3ddc0 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5499be8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f54901b1540 con 0x56078ee3d4a0 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5499be8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f54901b07a0 con 0x56078ee48680 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5499be8740 10 client.0 _ll_register_callbacks cb 0x7f548000c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5494daa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 0x56078ee4e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5494daa640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 0x56078ee4e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36304/0 (socket says 172.21.15.45:36304) 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5494daa640 1 -- 172.21.15.45:0/1118603106 learned_addr learned my addr 172.21.15.45:0/1118603106 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5495dac640 1 --2- 172.21.15.45:0/1118603106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 0x56078ee4e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f54955ab640 1 --2- 172.21.15.45:0/1118603106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3d4a0 0x56078ee50cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5494daa640 1 -- 172.21.15.45:0/1118603106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 msgr2=0x56078ee4e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5494daa640 1 --2- 172.21.15.45:0/1118603106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 0x56078ee4e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5494daa640 1 -- 172.21.15.45:0/1118603106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3d4a0 msgr2=0x56078ee50cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5494daa640 1 --2- 172.21.15.45:0/1118603106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3d4a0 0x56078ee50cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.240+0000 7f5494daa640 1 -- 172.21.15.45:0/1118603106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56078ee4ed90 con 0x56078ee3ddc0 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.241+0000 7f5494daa640 1 --2- 172.21.15.45:0/1118603106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 0x56078ee4e020 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f54800988a0 tx=0x7f548009c0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a057279b72787576 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.241+0000 7f5478ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.241+0000 7f5478ff9640 1 -- 172.21.15.45:0/1118603106 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f548006e020 con 0x56078ee3ddc0 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.241+0000 7f5478ff9640 1 -- 172.21.15.45:0/1118603106 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f548009fc90 con 0x56078ee3ddc0 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.241+0000 7f5499be8740 1 -- 172.21.15.45:0/1118603106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f548c047070 con 0x56078ee3ddc0 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.241+0000 7f5478ff9640 1 -- 172.21.15.45:0/1118603106 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f548009fe90 con 0x56078ee3ddc0 2024-09-15T22:19:55.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.241+0000 7f5499be8740 10 client.16191 fetch_fsmap learned FSMap version 21 2024-09-15T22:19:55.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.241+0000 7f5499be8740 1 -- 172.21.15.45:0/1118603106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56078eec2c60 con 0x56078ee3ddc0 2024-09-15T22:19:55.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.241+0000 7f5478ff9640 1 -- 172.21.15.45:0/1118603106 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f54800a5020 con 0x56078ee3ddc0 2024-09-15T22:19:55.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.241+0000 7f5478ff9640 1 -- 172.21.15.45:0/1118603106 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5480020070 con 0x56078ee3ddc0 2024-09-15T22:19:55.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.241+0000 7f5499be8740 10 client.16191 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:19:55.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.242+0000 7f5499be8740 10 client.16191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:19:55.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.242+0000 7f5499be8740 20 client.16191 populate_metadata read hostname 'smithi045' 2024-09-15T22:19:55.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.242+0000 7f5499be8740 1 --2- 172.21.15.45:0/1118603106 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56078ee58080 0x56078eec51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:19:55.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.242+0000 7f5499be8740 4 client.16191 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:19:55.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.242+0000 7f5499be8740 1 -- 172.21.15.45:0/1118603106 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f548c047070 con 0x56078ee58080 2024-09-15T22:19:55.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.242+0000 7f54955ab640 1 --2- 172.21.15.45:0/1118603106 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56078ee58080 0x56078eec51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:19:55.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.242+0000 7f54955ab640 1 --2- 172.21.15.45:0/1118603106 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56078ee58080 0x56078eec51e0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee942873478a92bf server_cookie=1f849b2ff7becddb in_seq=0 out_seq=0 2024-09-15T22:19:55.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.242+0000 7f5478ff9640 10 client.16191 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5478ff9640 1 -- 172.21.15.45:0/1118603106 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f548c047070 con 0x56078ee58080 2024-09-15T22:19:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5478ff9640 10 client.16191 handle_command_reply: tid=0 2024-09-15T22:19:55.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5499be8740 1 client.16191 shutdown 2024-09-15T22:19:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5499be8740 1 -- 172.21.15.45:0/1118603106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 msgr2=0x56078ee4e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5499be8740 1 --2- 172.21.15.45:0/1118603106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 0x56078ee4e020 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f54800988a0 tx=0x7f548009c0b0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5499be8740 1 -- 172.21.15.45:0/1118603106 shutdown_connections 2024-09-15T22:19:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5499be8740 1 --2- 172.21.15.45:0/1118603106 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56078ee58080 0x56078eec51e0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5499be8740 1 --2- 172.21.15.45:0/1118603106 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56078ee48680 0x56078ee4e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5499be8740 1 --2- 172.21.15.45:0/1118603106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56078ee3ddc0 0x56078ee4e020 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5499be8740 1 --2- 172.21.15.45:0/1118603106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56078ee3d4a0 0x56078ee50cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5499be8740 1 -- 172.21.15.45:0/1118603106 >> 172.21.15.45:0/1118603106 conn(0x56078ee39a30 msgr2=0x56078ee46af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5478ff9640 0 client.16191 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:19:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5499be8740 1 -- 172.21.15.45:0/1118603106 shutdown_connections 2024-09-15T22:19:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5499be8740 1 -- 172.21.15.45:0/1118603106 wait complete. 2024-09-15T22:19:55.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.243+0000 7f5499be8740 20 client.16191 trim_cache size 0 max 16384 2024-09-15T22:19:55.250 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:19:55.250 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:19:55.250 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:19:55.250 INFO:teuthology.orchestra.run.smithi045.stdout: "69fcedd2-630d-4e8d-a361-730f8af05015": { 2024-09-15T22:19:55.250 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:19:55.250 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "69fcedd2-630d-4e8d-a361-730f8af05015", 2024-09-15T22:19:55.250 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:19:55.250 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:55.250 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:19:55.250 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:19:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.244+0000 7f549780f640 1 -- 172.21.15.45:0/1241188724 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f547c0a33b0 msgr2=0x7f547c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.244+0000 7f549780f640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f547c0a33b0 0x7f547c0a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5488021000 tx=0x7f5488020000 comp rx=0 tx=0).stop 2024-09-15T22:19:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.244+0000 7f549780f640 1 -- 172.21.15.45:0/1241188724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5490101440 msgr2=0x7f54901a0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:19:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.244+0000 7f549780f640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5490101440 0x7f54901a0960 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f548000c970 tx=0x7f548000ce30 comp rx=0 tx=0).stop 2024-09-15T22:19:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.244+0000 7f549780f640 1 -- 172.21.15.45:0/1241188724 shutdown_connections 2024-09-15T22:19:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.244+0000 7f549780f640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f547c0a33b0 0x7f547c0a5870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.244+0000 7f549780f640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f549010e500 0x7f549019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.244+0000 7f549780f640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5490101440 0x7f54901a0960 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.244+0000 7f549780f640 1 --2- 172.21.15.45:0/1241188724 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5490100b20 0x7f54901a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:19:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.244+0000 7f549780f640 1 -- 172.21.15.45:0/1241188724 >> 172.21.15.45:0/1241188724 conn(0x7f54900fc7d0 msgr2=0x7f54900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:19:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.244+0000 7f549780f640 1 -- 172.21.15.45:0/1241188724 shutdown_connections 2024-09-15T22:19:55.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:19:55.244+0000 7f549780f640 1 -- 172.21.15.45:0/1241188724 wait complete. 2024-09-15T22:19:55.405 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:55 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:19:55.405 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:55 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:19:55.405 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:55 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:19:55.405 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:55 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:19:55.405 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:55 smithi045 ceph-mon[31180]: pgmap v113: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-09-15T22:19:55.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:55 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:19:55.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:55 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:19:55.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:55 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:19:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:55 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:19:55.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:55 smithi165 ceph-mon[35551]: pgmap v113: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-09-15T22:19:55.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:55 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:19:55.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:55 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:19:55.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:55 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:19:55.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:55 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:19:55.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:55 smithi100 ceph-mon[35319]: pgmap v113: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-09-15T22:19:55.953 INFO:tasks.cephfs.filesystem:scrub status for tag:69fcedd2-630d-4e8d-a361-730f8af05015 - {'path': '/', 'tag': '69fcedd2-630d-4e8d-a361-730f8af05015', 'options': 'recursive,force'} 2024-09-15T22:19:57.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:57 smithi165 ceph-mon[35551]: pgmap v114: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-15T22:19:57.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:57 smithi100 ceph-mon[35319]: pgmap v114: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-15T22:19:57.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:57 smithi045 ceph-mon[31180]: pgmap v114: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-15T22:19:59.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:59 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:19:59.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:19:59 smithi165 ceph-mon[35551]: pgmap v115: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-15T22:19:59.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:59 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:19:59.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:19:59 smithi100 ceph-mon[35319]: pgmap v115: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-15T22:19:59.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:59 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:19:59.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:19:59 smithi045 ceph-mon[31180]: pgmap v115: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-15T22:20:00.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:00 smithi165 ceph-mon[35551]: overall HEALTH_OK 2024-09-15T22:20:00.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:00 smithi100 ceph-mon[35319]: overall HEALTH_OK 2024-09-15T22:20:00.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:00 smithi045 ceph-mon[31180]: overall HEALTH_OK 2024-09-15T22:20:01.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:01 smithi165 ceph-mon[35551]: pgmap v116: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-15T22:20:01.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:01 smithi100 ceph-mon[35319]: pgmap v116: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-15T22:20:01.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:01 smithi045 ceph-mon[31180]: pgmap v116: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 1.6 KiB/s wr, 3 op/s 2024-09-15T22:20:03.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:03 smithi165 ceph-mon[35551]: pgmap v117: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-15T22:20:03.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:03 smithi100 ceph-mon[35319]: pgmap v117: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-15T22:20:03.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:03 smithi045 ceph-mon[31180]: pgmap v117: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-09-15T22:20:05.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:05 smithi165 ceph-mon[35551]: pgmap v118: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-09-15T22:20:05.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:05 smithi100 ceph-mon[35319]: pgmap v118: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-09-15T22:20:05.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:05 smithi045 ceph-mon[31180]: pgmap v118: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-09-15T22:20:07.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:07 smithi165 ceph-mon[35551]: pgmap v119: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:20:07.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:07 smithi100 ceph-mon[35319]: pgmap v119: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:20:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:07 smithi045 ceph-mon[31180]: pgmap v119: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:20:09.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:09 smithi165 ceph-mon[35551]: pgmap v120: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:20:09.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:09 smithi100 ceph-mon[35319]: pgmap v120: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:20:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:09 smithi045 ceph-mon[31180]: pgmap v120: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:20:11.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:11 smithi165 ceph-mon[35551]: pgmap v121: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:20:11.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:11 smithi100 ceph-mon[35319]: pgmap v121: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:20:11.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:11 smithi045 ceph-mon[31180]: pgmap v121: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:20:13.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:13 smithi165 ceph-mon[35551]: pgmap v122: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:20:13.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:13 smithi100 ceph-mon[35319]: pgmap v122: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:20:13.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:13 smithi045 ceph-mon[31180]: pgmap v122: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:20:15.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:15 smithi165 ceph-mon[35551]: pgmap v123: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:20:15.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:15 smithi100 ceph-mon[35319]: pgmap v123: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:20:15.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:15 smithi045 ceph-mon[31180]: pgmap v123: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:20:17.465 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:17 smithi165 ceph-mon[35551]: pgmap v124: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:20:17.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:17 smithi100 ceph-mon[35319]: pgmap v124: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:20:17.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:17 smithi045 ceph-mon[31180]: pgmap v124: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:20:19.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:19 smithi100 ceph-mon[35319]: pgmap v125: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:20:19.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:19 smithi045 ceph-mon[31180]: pgmap v125: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:20:19.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:19 smithi165 ceph-mon[35551]: pgmap v125: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:20:21.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:21 smithi100 ceph-mon[35319]: pgmap v126: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T22:20:21.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:21 smithi045 ceph-mon[31180]: pgmap v126: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T22:20:21.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:21 smithi165 ceph-mon[35551]: pgmap v126: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T22:20:23.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:23 smithi100 ceph-mon[35319]: pgmap v127: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:23.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:23 smithi045 ceph-mon[31180]: pgmap v127: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:23.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:23 smithi165 ceph-mon[35551]: pgmap v127: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:25.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:25 smithi100 ceph-mon[35319]: pgmap v128: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:20:25.517 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:25 smithi165 ceph-mon[35551]: pgmap v128: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:20:25.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:25 smithi045 ceph-mon[31180]: pgmap v128: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:20:25.955 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:20:26.232 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:20:26.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.806+0000 7f7c63392640 1 -- 172.21.15.45:0/96118515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c5c102d30 msgr2=0x7f7c5c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:26.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.806+0000 7f7c63392640 1 --2- 172.21.15.45:0/96118515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c5c102d30 0x7f7c5c103110 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009930 tx=0x7f7c5802a420 comp rx=0 tx=0).stop 2024-09-15T22:20:26.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.806+0000 7f7c63392640 1 -- 172.21.15.45:0/96118515 shutdown_connections 2024-09-15T22:20:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.806+0000 7f7c63392640 1 --2- 172.21.15.45:0/96118515 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c5c1082a0 0x7f7c5c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.806+0000 7f7c63392640 1 --2- 172.21.15.45:0/96118515 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c5c1036e0 0x7f7c5c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.806+0000 7f7c63392640 1 --2- 172.21.15.45:0/96118515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c5c102d30 0x7f7c5c103110 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.806+0000 7f7c63392640 1 -- 172.21.15.45:0/96118515 >> 172.21.15.45:0/96118515 conn(0x7f7c5c0fc7d0 msgr2=0x7f7c5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.806+0000 7f7c63392640 1 -- 172.21.15.45:0/96118515 shutdown_connections 2024-09-15T22:20:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.806+0000 7f7c63392640 1 -- 172.21.15.45:0/96118515 wait complete. 2024-09-15T22:20:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c63392640 1 Processor -- start 2024-09-15T22:20:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c63392640 1 -- start start 2024-09-15T22:20:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c63392640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c5c102d30 0x7f7c5c1986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c63392640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c5c1036e0 0x7f7c5c198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c63392640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c5c1082a0 0x7f7c5c19cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c63392640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c1121e0 con 0x7f7c5c102d30 2024-09-15T22:20:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c63392640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c112060 con 0x7f7c5c1082a0 2024-09-15T22:20:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c63392640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c112360 con 0x7f7c5c1036e0 2024-09-15T22:20:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c6112e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c5c102d30 0x7f7c5c1986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c6112e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c5c102d30 0x7f7c5c1986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52298/0 (socket says 172.21.15.45:52298) 2024-09-15T22:20:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c6112e640 1 -- 172.21.15.45:0/1969261025 learned_addr learned my addr 172.21.15.45:0/1969261025 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c6092d640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c5c1036e0 0x7f7c5c198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c6192f640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c5c1082a0 0x7f7c5c19cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c6112e640 1 -- 172.21.15.45:0/1969261025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c5c1036e0 msgr2=0x7f7c5c198be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:26.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c6112e640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c5c1036e0 0x7f7c5c198be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c6112e640 1 -- 172.21.15.45:0/1969261025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c5c1082a0 msgr2=0x7f7c5c19cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c6112e640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c5c1082a0 0x7f7c5c19cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c6112e640 1 -- 172.21.15.45:0/1969261025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5c19d650 con 0x7f7c5c102d30 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.807+0000 7f7c6112e640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c5c102d30 0x7f7c5c1986a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009230 tx=0x7f7c58004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.808+0000 7f7c527fc640 1 -- 172.21.15.45:0/1969261025 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5803f030 con 0x7f7c5c102d30 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.808+0000 7f7c527fc640 1 -- 172.21.15.45:0/1969261025 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c58004440 con 0x7f7c5c102d30 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.808+0000 7f7c63392640 1 -- 172.21.15.45:0/1969261025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5c19d8e0 con 0x7f7c5c102d30 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.808+0000 7f7c527fc640 1 -- 172.21.15.45:0/1969261025 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c58035070 con 0x7f7c5c102d30 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.808+0000 7f7c63392640 1 -- 172.21.15.45:0/1969261025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c5c1a5220 con 0x7f7c5c102d30 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.810+0000 7f7c527fc640 1 -- 172.21.15.45:0/1969261025 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7c58042030 con 0x7f7c5c102d30 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.811+0000 7f7c6576b740 1 Processor -- start 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.811+0000 7f7c6576b740 1 -- start start 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.811+0000 7f7c6576b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e78880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.811+0000 7f7c6576b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e83140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.811+0000 7f7c6576b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e85a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.811+0000 7f7c6576b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5594d8dde2e0 con 0x5594d8e784a0 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.811+0000 7f7c6576b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5594d8d85ce0 con 0x5594d8e78dc0 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.811+0000 7f7c6576b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5594d8dda2a0 con 0x5594d8e83680 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.811+0000 7f7c6192f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e78880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.811+0000 7f7c527fc640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7c480a3430 0x7f7c480a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.811+0000 7f7c6192f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e78880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52302/0 (socket says 172.21.15.45:52302) 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.811+0000 7f7c6112e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e83140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.811+0000 7f7c6192f640 1 -- 172.21.15.45:0/3646776199 learned_addr learned my addr 172.21.15.45:0/3646776199 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.812+0000 7f7c6192f640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7c480a3430 0x7f7c480a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.812+0000 7f7c6092d640 1 --2- 172.21.15.45:0/3646776199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e85a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.812+0000 7f7c527fc640 1 -- 172.21.15.45:0/1969261025 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f7c580f0470 con 0x7f7c5c102d30 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.812+0000 7f7c6192f640 1 -- 172.21.15.45:0/3646776199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 msgr2=0x5594d8e85a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:26.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.812+0000 7f7c6192f640 1 --2- 172.21.15.45:0/3646776199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e85a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.812+0000 7f7c6192f640 1 -- 172.21.15.45:0/3646776199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 msgr2=0x5594d8e83140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.812+0000 7f7c6192f640 1 --2- 172.21.15.45:0/3646776199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e83140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.812+0000 7f7c6192f640 1 -- 172.21.15.45:0/3646776199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594d8d6a440 con 0x5594d8e784a0 2024-09-15T22:20:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.812+0000 7f7c6092d640 1 --2- 172.21.15.45:0/3646776199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e85a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:20:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.812+0000 7f7c6192f640 1 --2- 172.21.15.45:0/3646776199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e78880 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7c540129f0 tx=0x7f7c54012eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46957085dfc82616 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.812+0000 7f7c477fe640 1 -- 172.21.15.45:0/3646776199 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54023070 con 0x5594d8e784a0 2024-09-15T22:20:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.812+0000 7f7c477fe640 1 -- 172.21.15.45:0/3646776199 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c54004730 con 0x5594d8e784a0 2024-09-15T22:20:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.812+0000 7f7c477fe640 1 -- 172.21.15.45:0/3646776199 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5401fac0 con 0x5594d8e784a0 2024-09-15T22:20:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.813+0000 7f7c6576b740 1 -- 172.21.15.45:0/3646776199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 msgr2=0x5594d8e78880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.813+0000 7f7c6192f640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7c480a3430 0x7f7c480a58f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7c54022000 tx=0x7f7c54021000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:26.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.813+0000 7f7c6576b740 1 --2- 172.21.15.45:0/3646776199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e78880 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7c540129f0 tx=0x7f7c54012eb0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.813+0000 7f7c6576b740 1 -- 172.21.15.45:0/3646776199 shutdown_connections 2024-09-15T22:20:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.813+0000 7f7c6576b740 1 --2- 172.21.15.45:0/3646776199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e85a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.813+0000 7f7c6576b740 1 --2- 172.21.15.45:0/3646776199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e83140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.813+0000 7f7c6576b740 1 --2- 172.21.15.45:0/3646776199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e78880 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.813+0000 7f7c6576b740 1 -- 172.21.15.45:0/3646776199 >> 172.21.15.45:0/3646776199 conn(0x5594d8e74a30 msgr2=0x5594d8e74e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.813+0000 7f7c6576b740 1 -- 172.21.15.45:0/3646776199 shutdown_connections 2024-09-15T22:20:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.813+0000 7f7c6576b740 1 -- 172.21.15.45:0/3646776199 wait complete. 2024-09-15T22:20:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.813+0000 7f7c6576b740 1 -- start start 2024-09-15T22:20:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6576b740 1 Processor -- start 2024-09-15T22:20:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6576b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e82f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6576b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e80220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6576b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e80760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6576b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5594d8e86250 con 0x5594d8e784a0 2024-09-15T22:20:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6576b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5594d8d99050 con 0x5594d8e78dc0 2024-09-15T22:20:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6576b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5594d8e863d0 con 0x5594d8e83680 2024-09-15T22:20:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6576b740 10 client.0 _ll_register_callbacks cb 0x5594d8dd9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6112e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e82f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6112e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e82f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52314/0 (socket says 172.21.15.45:52314) 2024-09-15T22:20:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6112e640 1 -- 172.21.15.45:0/1588156865 learned_addr learned my addr 172.21.15.45:0/1588156865 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6192f640 1 --2- 172.21.15.45:0/1588156865 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e80760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6092d640 1 --2- 172.21.15.45:0/1588156865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e80220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6112e640 1 -- 172.21.15.45:0/1588156865 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 msgr2=0x5594d8e80760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6112e640 1 --2- 172.21.15.45:0/1588156865 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e80760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6112e640 1 -- 172.21.15.45:0/1588156865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 msgr2=0x5594d8e80220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6112e640 1 --2- 172.21.15.45:0/1588156865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e80220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.814+0000 7f7c6112e640 1 -- 172.21.15.45:0/1588156865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594d8b4f3c0 con 0x5594d8e784a0 2024-09-15T22:20:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c6112e640 1 --2- 172.21.15.45:0/1588156865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e82f70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7c580b8d00 tx=0x7f7c5802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7002f66a64f5756d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:20:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c44ff9640 1 -- 172.21.15.45:0/1588156865 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c580d6e60 con 0x5594d8e784a0 2024-09-15T22:20:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c44ff9640 1 -- 172.21.15.45:0/1588156865 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f7c580b89a0 con 0x5594d8e784a0 2024-09-15T22:20:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c6576b740 1 -- 172.21.15.45:0/1588156865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c54004730 con 0x5594d8e784a0 2024-09-15T22:20:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c44ff9640 1 -- 172.21.15.45:0/1588156865 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7c58049040 con 0x5594d8e784a0 2024-09-15T22:20:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c6576b740 10 client.16203 fetch_fsmap learned FSMap version 21 2024-09-15T22:20:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c6576b740 1 -- 172.21.15.45:0/1588156865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5594d8e91b30 con 0x5594d8e784a0 2024-09-15T22:20:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c44ff9640 1 -- 172.21.15.45:0/1588156865 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c54004730 con 0x5594d8e784a0 2024-09-15T22:20:26.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c44ff9640 1 -- 172.21.15.45:0/1588156865 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7c580edab0 con 0x5594d8e784a0 2024-09-15T22:20:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c6576b740 10 client.16203 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:20:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c6576b740 10 client.16203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c6576b740 20 client.16203 populate_metadata read hostname 'smithi045' 2024-09-15T22:20:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c6576b740 1 --2- 172.21.15.45:0/1588156865 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5594d8e92ed0 0x5594d8e95340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c6576b740 4 client.16203 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:20:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.815+0000 7f7c6576b740 1 -- 172.21.15.45:0/1588156865 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594d8deb850 con 0x5594d8e92ed0 2024-09-15T22:20:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.816+0000 7f7c6092d640 1 --2- 172.21.15.45:0/1588156865 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5594d8e92ed0 0x5594d8e95340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.816+0000 7f7c6092d640 1 --2- 172.21.15.45:0/1588156865 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5594d8e92ed0 0x5594d8e95340 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa8b9ea0de8c10ac server_cookie=f359aa7e3a2dcfd2 in_seq=0 out_seq=0 2024-09-15T22:20:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.816+0000 7f7c44ff9640 10 client.16203 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c44ff9640 1 -- 172.21.15.45:0/1588156865 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594d8deb850 con 0x5594d8e92ed0 2024-09-15T22:20:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c44ff9640 10 client.16203 handle_command_reply: tid=0 2024-09-15T22:20:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c6576b740 1 client.16203 shutdown 2024-09-15T22:20:26.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c6576b740 1 -- 172.21.15.45:0/1588156865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 msgr2=0x5594d8e82f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c6576b740 1 --2- 172.21.15.45:0/1588156865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e82f70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7c580b8d00 tx=0x7f7c5802a420 comp rx=0 tx=0).stop 2024-09-15T22:20:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c6576b740 1 -- 172.21.15.45:0/1588156865 shutdown_connections 2024-09-15T22:20:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c6576b740 1 --2- 172.21.15.45:0/1588156865 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5594d8e92ed0 0x5594d8e95340 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c6576b740 1 --2- 172.21.15.45:0/1588156865 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e80760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c6576b740 1 --2- 172.21.15.45:0/1588156865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e80220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c6576b740 1 --2- 172.21.15.45:0/1588156865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e82f70 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c44ff9640 0 client.16203 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c6576b740 1 -- 172.21.15.45:0/1588156865 >> 172.21.15.45:0/1588156865 conn(0x5594d8e74a30 msgr2=0x5594d8e7a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c6576b740 1 -- 172.21.15.45:0/1588156865 shutdown_connections 2024-09-15T22:20:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c6576b740 1 -- 172.21.15.45:0/1588156865 wait complete. 2024-09-15T22:20:26.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.817+0000 7f7c6576b740 20 client.16203 trim_cache size 0 max 16384 2024-09-15T22:20:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.835+0000 7f7c6576b740 1 Processor -- start 2024-09-15T22:20:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.835+0000 7f7c6576b740 1 -- start start 2024-09-15T22:20:26.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.835+0000 7f7c6576b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e9ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.835+0000 7f7c6576b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e9b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.835+0000 7f7c6576b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e7d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.835+0000 7f7c6576b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c1ad1e0 con 0x5594d8e784a0 2024-09-15T22:20:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.835+0000 7f7c6576b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c1afa60 con 0x5594d8e78dc0 2024-09-15T22:20:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.835+0000 7f7c6576b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c1ad850 con 0x5594d8e83680 2024-09-15T22:20:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.835+0000 7f7c6112e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e9ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.835+0000 7f7c6112e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e9ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52322/0 (socket says 172.21.15.45:52322) 2024-09-15T22:20:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.835+0000 7f7c6112e640 1 -- 172.21.15.45:0/827514858 learned_addr learned my addr 172.21.15.45:0/827514858 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.836+0000 7f7c6092d640 1 --2- 172.21.15.45:0/827514858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e9b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.836+0000 7f7c6192f640 1 --2- 172.21.15.45:0/827514858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e7d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.836+0000 7f7c6112e640 1 -- 172.21.15.45:0/827514858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 msgr2=0x5594d8e7d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.836+0000 7f7c6112e640 1 --2- 172.21.15.45:0/827514858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e7d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.836+0000 7f7c6112e640 1 -- 172.21.15.45:0/827514858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 msgr2=0x5594d8e9b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.836+0000 7f7c6112e640 1 --2- 172.21.15.45:0/827514858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e9b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.836+0000 7f7c6112e640 1 -- 172.21.15.45:0/827514858 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594d8e80ab0 con 0x5594d8e784a0 2024-09-15T22:20:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.836+0000 7f7c6112e640 1 --2- 172.21.15.45:0/827514858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e9ac20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7c580c4a70 tx=0x7f7c580f0750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1725c0c2828d991e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.836+0000 7f7c46ffd640 1 -- 172.21.15.45:0/827514858 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c580c06e0 con 0x5594d8e784a0 2024-09-15T22:20:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.836+0000 7f7c46ffd640 1 -- 172.21.15.45:0/827514858 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c580c4fa0 con 0x5594d8e784a0 2024-09-15T22:20:26.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.836+0000 7f7c46ffd640 1 -- 172.21.15.45:0/827514858 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c580bb780 con 0x5594d8e784a0 2024-09-15T22:20:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.837+0000 7f7c6576b740 1 -- 172.21.15.45:0/827514858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 msgr2=0x5594d8e9ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.837+0000 7f7c6576b740 1 --2- 172.21.15.45:0/827514858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e9ac20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7c580c4a70 tx=0x7f7c580f0750 comp rx=0 tx=0).stop 2024-09-15T22:20:26.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.837+0000 7f7c6576b740 1 -- 172.21.15.45:0/827514858 shutdown_connections 2024-09-15T22:20:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.837+0000 7f7c6576b740 1 --2- 172.21.15.45:0/827514858 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e7d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.837+0000 7f7c6576b740 1 --2- 172.21.15.45:0/827514858 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e9b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.837+0000 7f7c6576b740 1 --2- 172.21.15.45:0/827514858 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e9ac20 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.837+0000 7f7c6576b740 1 -- 172.21.15.45:0/827514858 >> 172.21.15.45:0/827514858 conn(0x5594d8e74a30 msgr2=0x5594d8e73b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.837+0000 7f7c6576b740 1 -- 172.21.15.45:0/827514858 shutdown_connections 2024-09-15T22:20:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.837+0000 7f7c6576b740 1 -- 172.21.15.45:0/827514858 wait complete. 2024-09-15T22:20:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.837+0000 7f7c6576b740 1 -- start start 2024-09-15T22:20:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6576b740 1 Processor -- start 2024-09-15T22:20:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6576b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e8bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6576b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e88f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6576b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e89480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6576b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c1adf20 con 0x5594d8e784a0 2024-09-15T22:20:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6576b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c1af390 con 0x5594d8e78dc0 2024-09-15T22:20:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6576b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c1ae5f0 con 0x5594d8e83680 2024-09-15T22:20:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6112e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e8bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6112e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e8bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52328/0 (socket says 172.21.15.45:52328) 2024-09-15T22:20:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6112e640 1 -- 172.21.15.45:0/1744413328 learned_addr learned my addr 172.21.15.45:0/1744413328 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6576b740 10 client.0 _ll_register_callbacks cb 0x7f7c58009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6192f640 1 --2- 172.21.15.45:0/1744413328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e89480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6092d640 1 --2- 172.21.15.45:0/1744413328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e88f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6112e640 1 -- 172.21.15.45:0/1744413328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 msgr2=0x5594d8e89480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6112e640 1 --2- 172.21.15.45:0/1744413328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e89480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6112e640 1 -- 172.21.15.45:0/1744413328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 msgr2=0x5594d8e88f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6112e640 1 --2- 172.21.15.45:0/1744413328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e88f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.838+0000 7f7c6112e640 1 -- 172.21.15.45:0/1744413328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594d8e89ac0 con 0x5594d8e784a0 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.839+0000 7f7c6112e640 1 --2- 172.21.15.45:0/1744413328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e8bba0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7c58000c00 tx=0x7f7c580ba840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b61e553e2a79a34 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.839+0000 7f7c44ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.839+0000 7f7c44ff9640 1 -- 172.21.15.45:0/1744413328 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5809f020 con 0x5594d8e784a0 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.839+0000 7f7c44ff9640 1 -- 172.21.15.45:0/1744413328 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f7c580bb780 con 0x5594d8e784a0 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.839+0000 7f7c6576b740 1 -- 172.21.15.45:0/1744413328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c580c4fa0 con 0x5594d8e784a0 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.839+0000 7f7c44ff9640 1 -- 172.21.15.45:0/1744413328 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7c580c06e0 con 0x5594d8e784a0 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.839+0000 7f7c6576b740 10 client.16209 fetch_fsmap learned FSMap version 21 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.839+0000 7f7c6576b740 1 -- 172.21.15.45:0/1744413328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5594d8e89ac0 con 0x5594d8e784a0 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.839+0000 7f7c44ff9640 1 -- 172.21.15.45:0/1744413328 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7c580c4fa0 con 0x5594d8e784a0 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.839+0000 7f7c44ff9640 1 -- 172.21.15.45:0/1744413328 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7c5803bc50 con 0x5594d8e784a0 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.839+0000 7f7c6576b740 10 client.16209 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.840+0000 7f7c6576b740 10 client.16209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.840+0000 7f7c6576b740 20 client.16209 populate_metadata read hostname 'smithi045' 2024-09-15T22:20:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.840+0000 7f7c6576b740 1 --2- 172.21.15.45:0/1744413328 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5594d8efdd50 0x5594d8f00140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.840+0000 7f7c6576b740 4 client.16209 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.840+0000 7f7c6576b740 1 -- 172.21.15.45:0/1744413328 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5594d8de5d60 con 0x5594d8efdd50 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.840+0000 7f7c6092d640 1 --2- 172.21.15.45:0/1744413328 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5594d8efdd50 0x5594d8f00140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.840+0000 7f7c44ff9640 10 client.16209 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.840+0000 7f7c6092d640 1 --2- 172.21.15.45:0/1744413328 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5594d8efdd50 0x5594d8f00140 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25e8673d6202b8d0 server_cookie=61ceac94080f4b5a in_seq=0 out_seq=0 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.840+0000 7f7c44ff9640 1 -- 172.21.15.45:0/1744413328 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5594d8de5d60 con 0x5594d8efdd50 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.840+0000 7f7c44ff9640 10 client.16209 handle_command_reply: tid=0 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.840+0000 7f7c6576b740 1 client.16209 shutdown 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c6576b740 1 -- 172.21.15.45:0/1744413328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 msgr2=0x5594d8e8bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c6576b740 1 --2- 172.21.15.45:0/1744413328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e8bba0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7c58000c00 tx=0x7f7c580ba840 comp rx=0 tx=0).stop 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c6576b740 1 -- 172.21.15.45:0/1744413328 shutdown_connections 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c6576b740 1 --2- 172.21.15.45:0/1744413328 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5594d8efdd50 0x5594d8f00140 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c6576b740 1 --2- 172.21.15.45:0/1744413328 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5594d8e83680 0x5594d8e89480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c6576b740 1 --2- 172.21.15.45:0/1744413328 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5594d8e78dc0 0x5594d8e88f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c6576b740 1 --2- 172.21.15.45:0/1744413328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5594d8e784a0 0x5594d8e8bba0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c6576b740 1 -- 172.21.15.45:0/1744413328 >> 172.21.15.45:0/1744413328 conn(0x5594d8e74a30 msgr2=0x5594d8e73b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:26.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c44ff9640 0 client.16209 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:26.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c6576b740 1 -- 172.21.15.45:0/1744413328 shutdown_connections 2024-09-15T22:20:26.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c6576b740 1 -- 172.21.15.45:0/1744413328 wait complete. 2024-09-15T22:20:26.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c6576b740 20 client.16209 trim_cache size 0 max 16384 2024-09-15T22:20:26.849 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:20:26.849 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:20:26.849 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:20:26.850 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:20:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c63392640 1 -- 172.21.15.45:0/1969261025 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7c480a3430 msgr2=0x7f7c480a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c63392640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7c480a3430 0x7f7c480a58f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7c54022000 tx=0x7f7c54021000 comp rx=0 tx=0).stop 2024-09-15T22:20:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c63392640 1 -- 172.21.15.45:0/1969261025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c5c102d30 msgr2=0x7f7c5c1986a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:26.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.841+0000 7f7c63392640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c5c102d30 0x7f7c5c1986a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f7c58009230 tx=0x7f7c58004040 comp rx=0 tx=0).stop 2024-09-15T22:20:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.842+0000 7f7c63392640 1 -- 172.21.15.45:0/1969261025 shutdown_connections 2024-09-15T22:20:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.842+0000 7f7c63392640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f7c480a3430 0x7f7c480a58f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.842+0000 7f7c63392640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c5c1082a0 0x7f7c5c19cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.842+0000 7f7c63392640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7c5c1036e0 0x7f7c5c198be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.842+0000 7f7c63392640 1 --2- 172.21.15.45:0/1969261025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c5c102d30 0x7f7c5c1986a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.842+0000 7f7c63392640 1 -- 172.21.15.45:0/1969261025 >> 172.21.15.45:0/1969261025 conn(0x7f7c5c0fc7d0 msgr2=0x7f7c5c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.842+0000 7f7c63392640 1 -- 172.21.15.45:0/1969261025 shutdown_connections 2024-09-15T22:20:26.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:26.842+0000 7f7c63392640 1 -- 172.21.15.45:0/1969261025 wait complete. 2024-09-15T22:20:27.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:27 smithi045 ceph-mon[31180]: pgmap v129: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:27.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:27 smithi100 ceph-mon[35319]: pgmap v129: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:27.617 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:20:27.618 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:20:27.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:27 smithi165 ceph-mon[35551]: pgmap v129: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:27.880 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:20:28.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.409+0000 7fb40b4f7640 1 -- 172.21.15.45:0/2737479666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404101450 msgr2=0x7fb404105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:28.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.409+0000 7fb40b4f7640 1 --2- 172.21.15.45:0/2737479666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404101450 0x7fb404105920 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb400009900 tx=0x7fb40002a470 comp rx=0 tx=0).stop 2024-09-15T22:20:28.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 -- 172.21.15.45:0/2737479666 shutdown_connections 2024-09-15T22:20:28.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 --2- 172.21.15.45:0/2737479666 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb404105f40 0x7fb4041063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 --2- 172.21.15.45:0/2737479666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404101450 0x7fb404105920 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 --2- 172.21.15.45:0/2737479666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb404100b30 0x7fb404100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 -- 172.21.15.45:0/2737479666 >> 172.21.15.45:0/2737479666 conn(0x7fb4040fc7a0 msgr2=0x7fb4040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 -- 172.21.15.45:0/2737479666 shutdown_connections 2024-09-15T22:20:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 -- 172.21.15.45:0/2737479666 wait complete. 2024-09-15T22:20:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 Processor -- start 2024-09-15T22:20:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 -- start start 2024-09-15T22:20:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb404100b30 0x7fb4041a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb404101450 0x7fb4041a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404105f40 0x7fb40419e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb4041186a0 con 0x7fb404105f40 2024-09-15T22:20:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.410+0000 7fb40b4f7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb404118520 con 0x7fb404100b30 2024-09-15T22:20:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb40b4f7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb404118820 con 0x7fb404101450 2024-09-15T22:20:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb409a94640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404105f40 0x7fb40419e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb409a94640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404105f40 0x7fb40419e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52360/0 (socket says 172.21.15.45:52360) 2024-09-15T22:20:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb409a94640 1 -- 172.21.15.45:0/970249080 learned_addr learned my addr 172.21.15.45:0/970249080 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb409293640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb404100b30 0x7fb4041a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb408a92640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb404101450 0x7fb4041a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb409a94640 1 -- 172.21.15.45:0/970249080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb404101450 msgr2=0x7fb4041a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb409a94640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb404101450 0x7fb4041a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb409a94640 1 -- 172.21.15.45:0/970249080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb404100b30 msgr2=0x7fb4041a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb409a94640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb404100b30 0x7fb4041a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb409a94640 1 -- 172.21.15.45:0/970249080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40419f020 con 0x7fb404105f40 2024-09-15T22:20:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb408a92640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb404101450 0x7fb4041a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:20:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb409a94640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404105f40 0x7fb40419e8f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00cce0 tx=0x7fb3fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:28.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb3fa7fc640 1 -- 172.21.15.45:0/970249080 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc00f450 con 0x7fb404105f40 2024-09-15T22:20:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb3fa7fc640 1 -- 172.21.15.45:0/970249080 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb3fc00faf0 con 0x7fb404105f40 2024-09-15T22:20:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb40b4f7640 1 -- 172.21.15.45:0/970249080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40419f310 con 0x7fb404105f40 2024-09-15T22:20:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb3fa7fc640 1 -- 172.21.15.45:0/970249080 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc018cc0 con 0x7fb404105f40 2024-09-15T22:20:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.411+0000 7fb40b4f7640 1 -- 172.21.15.45:0/970249080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4041ab600 con 0x7fb404105f40 2024-09-15T22:20:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.412+0000 7fb40b4f7640 1 -- 172.21.15.45:0/970249080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb404105920 con 0x7fb404105f40 2024-09-15T22:20:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.413+0000 7fb3fa7fc640 1 -- 172.21.15.45:0/970249080 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb3fc00f5f0 con 0x7fb404105f40 2024-09-15T22:20:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.414+0000 7fb3fa7fc640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb3f00a3430 0x7fb3f00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.414+0000 7fb409293640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb3f00a3430 0x7fb3f00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.414+0000 7fb3fa7fc640 1 -- 172.21.15.45:0/970249080 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fb3fc0d0530 con 0x7fb404105f40 2024-09-15T22:20:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.415+0000 7fb409293640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb3f00a3430 0x7fb3f00a58f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb40419fa30 tx=0x7fb3f400b390 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:28.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.418+0000 7fb3fa7fc640 1 -- 172.21.15.45:0/970249080 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3fc014030 con 0x7fb404105f40 2024-09-15T22:20:28.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.631+0000 7fb40b4f7640 1 -- 172.21.15.45:0/970249080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4041ab950 con 0x7fb404105f40 2024-09-15T22:20:28.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.632+0000 7fb3fa7fc640 1 -- 172.21.15.45:0/970249080 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fb3fc09caf0 con 0x7fb404105f40 2024-09-15T22:20:28.635 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:20:28.635 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:20:28.635 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:20:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.635+0000 7fb40b4f7640 1 -- 172.21.15.45:0/970249080 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb3f00a3430 msgr2=0x7fb3f00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.635+0000 7fb40b4f7640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb3f00a3430 0x7fb3f00a58f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb40419fa30 tx=0x7fb3f400b390 comp rx=0 tx=0).stop 2024-09-15T22:20:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.635+0000 7fb40b4f7640 1 -- 172.21.15.45:0/970249080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404105f40 msgr2=0x7fb40419e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.635+0000 7fb40b4f7640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404105f40 0x7fb40419e8f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00cce0 tx=0x7fb3fc00a620 comp rx=0 tx=0).stop 2024-09-15T22:20:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.635+0000 7fb40b4f7640 1 -- 172.21.15.45:0/970249080 shutdown_connections 2024-09-15T22:20:28.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.635+0000 7fb40b4f7640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb3f00a3430 0x7fb3f00a58f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.635+0000 7fb40b4f7640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404105f40 0x7fb40419e8f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.635+0000 7fb40b4f7640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb404101450 0x7fb4041a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.635+0000 7fb40b4f7640 1 --2- 172.21.15.45:0/970249080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb404100b30 0x7fb4041a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.635+0000 7fb40b4f7640 1 -- 172.21.15.45:0/970249080 >> 172.21.15.45:0/970249080 conn(0x7fb4040fc7a0 msgr2=0x7fb4041038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.635+0000 7fb40b4f7640 1 -- 172.21.15.45:0/970249080 shutdown_connections 2024-09-15T22:20:28.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:28.635+0000 7fb40b4f7640 1 -- 172.21.15.45:0/970249080 wait complete. 2024-09-15T22:20:29.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:29 smithi045 ceph-mon[31180]: pgmap v130: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:29.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:29 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/970249080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:20:29.407 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:20:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:29 smithi100 ceph-mon[35319]: pgmap v130: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:29.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:29 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/970249080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:20:29.671 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:20:29.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:29 smithi165 ceph-mon[35551]: pgmap v130: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:29.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:29 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/970249080' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:20:30.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.168+0000 7f05015ea640 1 -- 172.21.15.45:0/3244783194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04fc10c180 msgr2=0x7f04fc10e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:30.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.168+0000 7f05015ea640 1 --2- 172.21.15.45:0/3244783194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04fc10c180 0x7f04fc10e620 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009ca0 tx=0x7f04f402a950 comp rx=0 tx=0).stop 2024-09-15T22:20:30.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.168+0000 7f05015ea640 1 -- 172.21.15.45:0/3244783194 shutdown_connections 2024-09-15T22:20:30.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.168+0000 7f05015ea640 1 --2- 172.21.15.45:0/3244783194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04fc10c180 0x7f04fc10e620 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.168+0000 7f05015ea640 1 --2- 172.21.15.45:0/3244783194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04fc103670 0x7f04fc10bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.168+0000 7f05015ea640 1 --2- 172.21.15.45:0/3244783194 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04fc102d50 0x7f04fc103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.168+0000 7f05015ea640 1 -- 172.21.15.45:0/3244783194 >> 172.21.15.45:0/3244783194 conn(0x7f04fc0fc7d0 msgr2=0x7f04fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.168+0000 7f05015ea640 1 -- 172.21.15.45:0/3244783194 shutdown_connections 2024-09-15T22:20:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.168+0000 7f05015ea640 1 -- 172.21.15.45:0/3244783194 wait complete. 2024-09-15T22:20:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.169+0000 7f05015ea640 1 Processor -- start 2024-09-15T22:20:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.169+0000 7f05015ea640 1 -- start start 2024-09-15T22:20:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f05015ea640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04fc102d50 0x7f04fc198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f05015ea640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04fc103670 0x7f04fc198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f05015ea640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04fc10c180 0x7f04fc19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f05015ea640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc112080 con 0x7f04fc10c180 2024-09-15T22:20:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f05015ea640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc111f00 con 0x7f04fc103670 2024-09-15T22:20:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f05015ea640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc112200 con 0x7f04fc102d50 2024-09-15T22:20:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f04fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04fc10c180 0x7f04fc19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f04fb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04fc10c180 0x7f04fc19cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52370/0 (socket says 172.21.15.45:52370) 2024-09-15T22:20:30.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f04fb7fe640 1 -- 172.21.15.45:0/2575575468 learned_addr learned my addr 172.21.15.45:0/2575575468 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:30.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f04faffd640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04fc102d50 0x7f04fc198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04fc103670 0x7f04fc198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f04fb7fe640 1 -- 172.21.15.45:0/2575575468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04fc102d50 msgr2=0x7f04fc198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:30.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f04fb7fe640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04fc102d50 0x7f04fc198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f04fb7fe640 1 -- 172.21.15.45:0/2575575468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04fc103670 msgr2=0x7f04fc198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:30.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f04fb7fe640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04fc103670 0x7f04fc198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.170+0000 7f04fb7fe640 1 -- 172.21.15.45:0/2575575468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc19d4b0 con 0x7f04fc10c180 2024-09-15T22:20:30.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.171+0000 7f04faffd640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04fc102d50 0x7f04fc198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:20:30.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.171+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04fc103670 0x7f04fc198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:20:30.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.171+0000 7f04fb7fe640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04fc10c180 0x7f04fc19cdd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f04f4005cc0 tx=0x7f04f402f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:30.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.171+0000 7f04e3fff640 1 -- 172.21.15.45:0/2575575468 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4034040 con 0x7f04fc10c180 2024-09-15T22:20:30.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.171+0000 7f05015ea640 1 -- 172.21.15.45:0/2575575468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc19d740 con 0x7f04fc10c180 2024-09-15T22:20:30.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.171+0000 7f04e3fff640 1 -- 172.21.15.45:0/2575575468 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04f4030940 con 0x7f04fc10c180 2024-09-15T22:20:30.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.171+0000 7f04e3fff640 1 -- 172.21.15.45:0/2575575468 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f4045480 con 0x7f04fc10c180 2024-09-15T22:20:30.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.171+0000 7f05015ea640 1 -- 172.21.15.45:0/2575575468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04fc19dbb0 con 0x7f04fc10c180 2024-09-15T22:20:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.174+0000 7f04e3fff640 1 -- 172.21.15.45:0/2575575468 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f04f4037020 con 0x7f04fc10c180 2024-09-15T22:20:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.174+0000 7f05039c3740 1 Processor -- start 2024-09-15T22:20:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.174+0000 7f05039c3740 1 -- start start 2024-09-15T22:20:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.174+0000 7f05039c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7cb40 0x557b8db7b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.174+0000 7f05039c3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7b5d0 0x557b8db7ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.174+0000 7f05039c3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 0x557b8db88760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.174+0000 7f05039c3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557b8dae12f0 con 0x557b8db7b5d0 2024-09-15T22:20:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.174+0000 7f05039c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557b8da88cf0 con 0x557b8db7cb40 2024-09-15T22:20:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.174+0000 7f05039c3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557b8dadd2b0 con 0x557b8db86370 2024-09-15T22:20:30.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04fa7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7cb40 0x557b8db7b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04fa7fc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 0x557b8db88760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04fa7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7cb40 0x557b8db7b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:54450/0 (socket says 172.21.15.45:54450) 2024-09-15T22:20:30.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04fa7fc640 1 -- 172.21.15.45:0/1870810715 learned_addr learned my addr 172.21.15.45:0/1870810715 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:30.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04e3fff640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f04e40a3430 0x7f04e40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04fb7fe640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f04e40a3430 0x7f04e40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04faffd640 1 --2- 172.21.15.45:0/1870810715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7b5d0 0x557b8db7ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04fa7fc640 1 -- 172.21.15.45:0/1870810715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 msgr2=0x557b8db88760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:30.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/1870810715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 0x557b8db88760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04fa7fc640 1 -- 172.21.15.45:0/1870810715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7b5d0 msgr2=0x557b8db7ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:30.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/1870810715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7b5d0 0x557b8db7ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04e3fff640 1 -- 172.21.15.45:0/2575575468 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f04f40f0dd0 con 0x7f04fc10c180 2024-09-15T22:20:30.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04fa7fc640 1 -- 172.21.15.45:0/1870810715 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8da6d3a0 con 0x557b8db7cb40 2024-09-15T22:20:30.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.175+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/1870810715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7cb40 0x557b8db7b090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009fd0 tx=0x7f04f0005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3bc5f84d9587798 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:30.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.176+0000 7f04fb7fe640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f04e40a3430 0x7f04e40a58f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f04f40bcd90 tx=0x7f04f4038000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:30.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.176+0000 7f04e17fa640 1 -- 172.21.15.45:0/1870810715 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f00239e0 con 0x557b8db7cb40 2024-09-15T22:20:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.176+0000 7f04e17fa640 1 -- 172.21.15.45:0/1870810715 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04f000ee30 con 0x557b8db7cb40 2024-09-15T22:20:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.176+0000 7f04e17fa640 1 -- 172.21.15.45:0/1870810715 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0005550 con 0x557b8db7cb40 2024-09-15T22:20:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.176+0000 7f05039c3740 1 -- 172.21.15.45:0/1870810715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7cb40 msgr2=0x557b8db7b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.176+0000 7f05039c3740 1 --2- 172.21.15.45:0/1870810715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7cb40 0x557b8db7b090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009fd0 tx=0x7f04f0005f90 comp rx=0 tx=0).stop 2024-09-15T22:20:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.177+0000 7f05039c3740 1 -- 172.21.15.45:0/1870810715 shutdown_connections 2024-09-15T22:20:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.177+0000 7f05039c3740 1 --2- 172.21.15.45:0/1870810715 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 0x557b8db88760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.177+0000 7f05039c3740 1 --2- 172.21.15.45:0/1870810715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7b5d0 0x557b8db7ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.177+0000 7f05039c3740 1 --2- 172.21.15.45:0/1870810715 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7cb40 0x557b8db7b090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.177+0000 7f05039c3740 1 -- 172.21.15.45:0/1870810715 >> 172.21.15.45:0/1870810715 conn(0x557b8db44310 msgr2=0x557b8db77c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.177+0000 7f05039c3740 1 -- 172.21.15.45:0/1870810715 shutdown_connections 2024-09-15T22:20:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.177+0000 7f05039c3740 1 -- 172.21.15.45:0/1870810715 wait complete. 2024-09-15T22:20:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.177+0000 7f05039c3740 1 -- start start 2024-09-15T22:20:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.177+0000 7f05039c3740 1 Processor -- start 2024-09-15T22:20:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f05039c3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db7b5d0 0x557b8db85db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f05039c3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 0x557b8db83060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f05039c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db86370 0x557b8db837f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f05039c3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557b8db99fc0 con 0x557b8db7cb40 2024-09-15T22:20:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f05039c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x557b8da9c060 con 0x557b8db86370 2024-09-15T22:20:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f05039c3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x557b8db9a140 con 0x557b8db7b5d0 2024-09-15T22:20:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f05039c3740 10 client.0 _ll_register_callbacks cb 0x557b8d7ef8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f04faffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 0x557b8db83060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f04faffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 0x557b8db83060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52396/0 (socket says 172.21.15.45:52396) 2024-09-15T22:20:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f04faffd640 1 -- 172.21.15.45:0/1159348154 learned_addr learned my addr 172.21.15.45:0/1159348154 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/1159348154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db7b5d0 0x557b8db85db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/1159348154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db86370 0x557b8db837f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f04faffd640 1 -- 172.21.15.45:0/1159348154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db7b5d0 msgr2=0x557b8db85db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f04faffd640 1 --2- 172.21.15.45:0/1159348154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db7b5d0 0x557b8db85db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f04faffd640 1 -- 172.21.15.45:0/1159348154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db86370 msgr2=0x557b8db837f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f04faffd640 1 --2- 172.21.15.45:0/1159348154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db86370 0x557b8db837f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f04faffd640 1 -- 172.21.15.45:0/1159348154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b8d8523c0 con 0x557b8db7cb40 2024-09-15T22:20:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f04faffd640 1 --2- 172.21.15.45:0/1159348154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 0x557b8db83060 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f04ec012720 tx=0x7f04ec012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec2267c9dd22cdf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.178+0000 7f04deff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:20:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.179+0000 7f04deff5640 1 -- 172.21.15.45:0/1159348154 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec011dd0 con 0x557b8db7cb40 2024-09-15T22:20:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.179+0000 7f04deff5640 1 -- 172.21.15.45:0/1159348154 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f04ec004020 con 0x557b8db7cb40 2024-09-15T22:20:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.179+0000 7f05039c3740 1 -- 172.21.15.45:0/1159348154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04f000ee30 con 0x557b8db7cb40 2024-09-15T22:20:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.179+0000 7f04deff5640 1 -- 172.21.15.45:0/1159348154 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f04ec035050 con 0x557b8db7cb40 2024-09-15T22:20:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.179+0000 7f05039c3740 10 client.16227 fetch_fsmap learned FSMap version 21 2024-09-15T22:20:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.179+0000 7f05039c3740 1 -- 172.21.15.45:0/1159348154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557b8dba5b10 con 0x557b8db7cb40 2024-09-15T22:20:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.179+0000 7f04deff5640 1 -- 172.21.15.45:0/1159348154 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04f000ee30 con 0x557b8db7cb40 2024-09-15T22:20:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.179+0000 7f04deff5640 1 -- 172.21.15.45:0/1159348154 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f04ec02b400 con 0x557b8db7cb40 2024-09-15T22:20:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.180+0000 7f05039c3740 10 client.16227 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:20:30.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.180+0000 7f05039c3740 10 client.16227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.180+0000 7f05039c3740 20 client.16227 populate_metadata read hostname 'smithi045' 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.180+0000 7f05039c3740 1 --2- 172.21.15.45:0/1159348154 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557b8dba7490 0x557b8dba98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.180+0000 7f05039c3740 4 client.16227 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.180+0000 7f05039c3740 1 -- 172.21.15.45:0/1159348154 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b8daee860 con 0x557b8dba7490 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.180+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/1159348154 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557b8dba7490 0x557b8dba98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.180+0000 7f04deff5640 10 client.16227 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.180+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/1159348154 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557b8dba7490 0x557b8dba98b0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f0a9281e2074112 server_cookie=9da2448d19fea6a4 in_seq=0 out_seq=0 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f04deff5640 1 -- 172.21.15.45:0/1159348154 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b8daee860 con 0x557b8dba7490 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f04deff5640 10 client.16227 handle_command_reply: tid=0 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f05039c3740 1 client.16227 shutdown 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f05039c3740 1 -- 172.21.15.45:0/1159348154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 msgr2=0x557b8db83060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f05039c3740 1 --2- 172.21.15.45:0/1159348154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 0x557b8db83060 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f04ec012720 tx=0x7f04ec012be0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f05039c3740 1 -- 172.21.15.45:0/1159348154 shutdown_connections 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f05039c3740 1 --2- 172.21.15.45:0/1159348154 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557b8dba7490 0x557b8dba98b0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f05039c3740 1 --2- 172.21.15.45:0/1159348154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db86370 0x557b8db837f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f05039c3740 1 --2- 172.21.15.45:0/1159348154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 0x557b8db83060 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f05039c3740 1 --2- 172.21.15.45:0/1159348154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db7b5d0 0x557b8db85db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f05039c3740 1 -- 172.21.15.45:0/1159348154 >> 172.21.15.45:0/1159348154 conn(0x557b8db44310 msgr2=0x557b8db7d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:30.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f04deff5640 0 client.16227 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:30.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f05039c3740 1 -- 172.21.15.45:0/1159348154 shutdown_connections 2024-09-15T22:20:30.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.181+0000 7f05039c3740 1 -- 172.21.15.45:0/1159348154 wait complete. 2024-09-15T22:20:30.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.182+0000 7f05039c3740 20 client.16227 trim_cache size 0 max 16384 2024-09-15T22:20:30.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.207+0000 7f05039c3740 1 Processor -- start 2024-09-15T22:20:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.207+0000 7f05039c3740 1 -- start start 2024-09-15T22:20:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f05039c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7b5d0 0x557b8db82920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f05039c3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 0x557b8db82e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f05039c3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 0x557b8dbaf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f05039c3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc071970 con 0x557b8db7cb40 2024-09-15T22:20:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f05039c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc0741f0 con 0x557b8db7b5d0 2024-09-15T22:20:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f05039c3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc071fe0 con 0x557b8db86370 2024-09-15T22:20:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f04faffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 0x557b8db82e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f04faffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 0x557b8db82e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52400/0 (socket says 172.21.15.45:52400) 2024-09-15T22:20:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f04faffd640 1 -- 172.21.15.45:0/1323961925 learned_addr learned my addr 172.21.15.45:0/1323961925 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/1323961925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7b5d0 0x557b8db82920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/1323961925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 0x557b8dbaf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f04faffd640 1 -- 172.21.15.45:0/1323961925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 msgr2=0x557b8dbaf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f04faffd640 1 --2- 172.21.15.45:0/1323961925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 0x557b8dbaf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f04faffd640 1 -- 172.21.15.45:0/1323961925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7b5d0 msgr2=0x557b8db82920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f04faffd640 1 --2- 172.21.15.45:0/1323961925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7b5d0 0x557b8db82920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f04faffd640 1 -- 172.21.15.45:0/1323961925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8db77510 con 0x557b8db7cb40 2024-09-15T22:20:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.208+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/1323961925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7b5d0 0x557b8db82920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:20:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.209+0000 7f04faffd640 1 --2- 172.21.15.45:0/1323961925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 0x557b8db82e60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0126f0 tx=0x7f04ec00bae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaab7bf016016639 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:30.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.209+0000 7f04e0ff9640 1 -- 172.21.15.45:0/1323961925 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec02b600 con 0x557b8db7cb40 2024-09-15T22:20:30.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.209+0000 7f04e0ff9640 1 -- 172.21.15.45:0/1323961925 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04ec03d070 con 0x557b8db7cb40 2024-09-15T22:20:30.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.209+0000 7f04e0ff9640 1 -- 172.21.15.45:0/1323961925 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec004280 con 0x557b8db7cb40 2024-09-15T22:20:30.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.210+0000 7f05039c3740 1 -- 172.21.15.45:0/1323961925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 msgr2=0x557b8db82e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:30.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.210+0000 7f05039c3740 1 --2- 172.21.15.45:0/1323961925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 0x557b8db82e60 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f04ec0126f0 tx=0x7f04ec00bae0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.210+0000 7f05039c3740 1 -- 172.21.15.45:0/1323961925 shutdown_connections 2024-09-15T22:20:30.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.210+0000 7f05039c3740 1 --2- 172.21.15.45:0/1323961925 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 0x557b8dbaf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.210+0000 7f05039c3740 1 --2- 172.21.15.45:0/1323961925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7cb40 0x557b8db82e60 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.210+0000 7f05039c3740 1 --2- 172.21.15.45:0/1323961925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7b5d0 0x557b8db82920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.210+0000 7f05039c3740 1 -- 172.21.15.45:0/1323961925 >> 172.21.15.45:0/1323961925 conn(0x557b8db44310 msgr2=0x557b8db7e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.210+0000 7f05039c3740 1 -- 172.21.15.45:0/1323961925 shutdown_connections 2024-09-15T22:20:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.210+0000 7f05039c3740 1 -- 172.21.15.45:0/1323961925 wait complete. 2024-09-15T22:20:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.210+0000 7f05039c3740 1 -- start start 2024-09-15T22:20:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.210+0000 7f05039c3740 1 Processor -- start 2024-09-15T22:20:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f05039c3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7b5d0 0x557b8db9fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f05039c3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7cb40 0x557b8db9b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f05039c3740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 0x557b8db9b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f05039c3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc0726b0 con 0x557b8db7b5d0 2024-09-15T22:20:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f05039c3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc073b20 con 0x557b8db7cb40 2024-09-15T22:20:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f05039c3740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04fc072d80 con 0x557b8db86370 2024-09-15T22:20:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f05039c3740 10 client.0 _ll_register_callbacks cb 0x7f04ec00bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f04fa7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7b5d0 0x557b8db9fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f04fa7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7b5d0 0x557b8db9fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52412/0 (socket says 172.21.15.45:52412) 2024-09-15T22:20:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f04fa7fc640 1 -- 172.21.15.45:0/3488252532 learned_addr learned my addr 172.21.15.45:0/3488252532 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f04faffd640 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7cb40 0x557b8db9b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 0x557b8db9b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f04faffd640 1 -- 172.21.15.45:0/3488252532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 msgr2=0x557b8db9b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f04faffd640 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 0x557b8db9b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f04faffd640 1 -- 172.21.15.45:0/3488252532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7b5d0 msgr2=0x557b8db9fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f04faffd640 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7b5d0 0x557b8db9fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f04faffd640 1 -- 172.21.15.45:0/3488252532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b8dc11170 con 0x557b8db7cb40 2024-09-15T22:20:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7b5d0 0x557b8db9fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:20:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f04faffd640 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7cb40 0x557b8db9b020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x557b8db7c0f0 tx=0x7f04ec02b6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2aafb07e3e510e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.211+0000 7f04deff5640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-09-15T22:20:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.212+0000 7f04deff5640 1 -- 172.21.15.45:0/3488252532 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ec0117b0 con 0x557b8db7cb40 2024-09-15T22:20:30.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.212+0000 7f05039c3740 1 -- 172.21.15.45:0/3488252532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04ec03d070 con 0x557b8db7cb40 2024-09-15T22:20:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.212+0000 7f04deff5640 1 -- 172.21.15.45:0/3488252532 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f04ec004020 con 0x557b8db7cb40 2024-09-15T22:20:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.212+0000 7f04deff5640 1 -- 172.21.15.45:0/3488252532 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f04ec02be20 con 0x557b8db7cb40 2024-09-15T22:20:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.212+0000 7f05039c3740 10 client.25778 fetch_fsmap learned FSMap version 21 2024-09-15T22:20:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.212+0000 7f05039c3740 1 -- 172.21.15.45:0/3488252532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x557b8dc12350 con 0x557b8db7cb40 2024-09-15T22:20:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.212+0000 7f04deff5640 1 -- 172.21.15.45:0/3488252532 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04ec03d070 con 0x557b8db7cb40 2024-09-15T22:20:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.212+0000 7f04deff5640 1 -- 172.21.15.45:0/3488252532 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f04ec003c10 con 0x557b8db7cb40 2024-09-15T22:20:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.212+0000 7f05039c3740 10 client.25778 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:20:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.212+0000 7f05039c3740 10 client.25778 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.212+0000 7f05039c3740 20 client.25778 populate_metadata read hostname 'smithi045' 2024-09-15T22:20:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.212+0000 7f05039c3740 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557b8dc129b0 0x557b8dc14dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.213+0000 7f05039c3740 4 client.25778 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:20:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.213+0000 7f05039c3740 1 -- 172.21.15.45:0/3488252532 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557b8dae8d70 con 0x557b8dc129b0 2024-09-15T22:20:30.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.213+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557b8dc129b0 0x557b8dc14dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.213+0000 7f04deff5640 10 client.25778 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.213+0000 7f04fa7fc640 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557b8dc129b0 0x557b8dc14dd0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=752ecfbbd3d700ca server_cookie=bf60712c2bcd4ddc in_seq=0 out_seq=0 2024-09-15T22:20:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.213+0000 7f04deff5640 1 -- 172.21.15.45:0/3488252532 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557b8dae8d70 con 0x557b8dc129b0 2024-09-15T22:20:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.213+0000 7f04deff5640 10 client.25778 handle_command_reply: tid=0 2024-09-15T22:20:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.213+0000 7f05039c3740 1 client.25778 shutdown 2024-09-15T22:20:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.214+0000 7f05039c3740 1 -- 172.21.15.45:0/3488252532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7cb40 msgr2=0x557b8db9b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.214+0000 7f05039c3740 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7cb40 0x557b8db9b020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x557b8db7c0f0 tx=0x7f04ec02b6b0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.214+0000 7f05039c3740 1 -- 172.21.15.45:0/3488252532 shutdown_connections 2024-09-15T22:20:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.214+0000 7f05039c3740 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x557b8dc129b0 0x557b8dc14dd0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.214+0000 7f05039c3740 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x557b8db86370 0x557b8db9b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.214+0000 7f05039c3740 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557b8db7cb40 0x557b8db9b020 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.214+0000 7f05039c3740 1 --2- 172.21.15.45:0/3488252532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557b8db7b5d0 0x557b8db9fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.214+0000 7f05039c3740 1 -- 172.21.15.45:0/3488252532 >> 172.21.15.45:0/3488252532 conn(0x557b8db44310 msgr2=0x557b8db82810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.214+0000 7f04deff5640 0 client.25778 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.214+0000 7f05039c3740 1 -- 172.21.15.45:0/3488252532 shutdown_connections 2024-09-15T22:20:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.214+0000 7f05039c3740 1 -- 172.21.15.45:0/3488252532 wait complete. 2024-09-15T22:20:30.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.214+0000 7f05039c3740 20 client.25778 trim_cache size 0 max 16384 2024-09-15T22:20:30.221 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:20:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.215+0000 7f05015ea640 1 -- 172.21.15.45:0/2575575468 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f04e40a3430 msgr2=0x7f04e40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.215+0000 7f05015ea640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f04e40a3430 0x7f04e40a58f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f04f40bcd90 tx=0x7f04f4038000 comp rx=0 tx=0).stop 2024-09-15T22:20:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.215+0000 7f05015ea640 1 -- 172.21.15.45:0/2575575468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04fc10c180 msgr2=0x7f04fc19cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.215+0000 7f05015ea640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04fc10c180 0x7f04fc19cdd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f04f4005cc0 tx=0x7f04f402f790 comp rx=0 tx=0).stop 2024-09-15T22:20:30.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.215+0000 7f05015ea640 1 -- 172.21.15.45:0/2575575468 shutdown_connections 2024-09-15T22:20:30.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.215+0000 7f05015ea640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f04e40a3430 0x7f04e40a58f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.215+0000 7f05015ea640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04fc10c180 0x7f04fc19cdd0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.215+0000 7f05015ea640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04fc103670 0x7f04fc198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.215+0000 7f05015ea640 1 --2- 172.21.15.45:0/2575575468 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04fc102d50 0x7f04fc198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:30.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.215+0000 7f05015ea640 1 -- 172.21.15.45:0/2575575468 >> 172.21.15.45:0/2575575468 conn(0x7f04fc0fc7d0 msgr2=0x7f04fc0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:30.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.215+0000 7f05015ea640 1 -- 172.21.15.45:0/2575575468 shutdown_connections 2024-09-15T22:20:30.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:30.215+0000 7f05015ea640 1 -- 172.21.15.45:0/2575575468 wait complete. 2024-09-15T22:20:30.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:30 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:30.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:30 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:30.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:30 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:20:31.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:31 smithi045 ceph-mon[31180]: pgmap v131: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:20:31.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:31 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:31.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:31 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:31.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:31 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:20:31.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:31 smithi100 ceph-mon[35319]: pgmap v131: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:20:31.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:31 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:31.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:31 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:31.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:31 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:20:31.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:31 smithi165 ceph-mon[35551]: pgmap v131: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:20:31.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:31 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:20:31.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:31 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:20:31.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:31 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:20:32.022 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:20:32.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:20:32.294 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:20:32.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.772+0000 7f2e9b579640 1 -- 172.21.15.45:0/4155622935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e94112b90 msgr2=0x7f2e94114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:32.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.772+0000 7f2e9b579640 1 --2- 172.21.15.45:0/4155622935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e94112b90 0x7f2e94114f80 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c009ca0 tx=0x7f2e8c02a950 comp rx=0 tx=0).stop 2024-09-15T22:20:32.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.772+0000 7f2e9b579640 1 -- 172.21.15.45:0/4155622935 shutdown_connections 2024-09-15T22:20:32.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.772+0000 7f2e9b579640 1 --2- 172.21.15.45:0/4155622935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e94112b90 0x7f2e94114f80 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.772+0000 7f2e9b579640 1 --2- 172.21.15.45:0/4155622935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e94074eb0 0x7f2e94112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.772+0000 7f2e9b579640 1 --2- 172.21.15.45:0/4155622935 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e94074590 0x7f2e94074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.772+0000 7f2e9b579640 1 -- 172.21.15.45:0/4155622935 >> 172.21.15.45:0/4155622935 conn(0x7f2e940fd8c0 msgr2=0x7f2e940ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.773+0000 7f2e9b579640 1 -- 172.21.15.45:0/4155622935 shutdown_connections 2024-09-15T22:20:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.773+0000 7f2e9b579640 1 -- 172.21.15.45:0/4155622935 wait complete. 2024-09-15T22:20:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.773+0000 7f2e9b579640 1 Processor -- start 2024-09-15T22:20:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.773+0000 7f2e9b579640 1 -- start start 2024-09-15T22:20:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e9b579640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e94074590 0x7f2e941a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e9b579640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e94074eb0 0x7f2e941a4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e9b579640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e94112b90 0x7f2e9419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e9b579640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2e941186b0 con 0x7f2e94074590 2024-09-15T22:20:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e9b579640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2e94118530 con 0x7f2e94112b90 2024-09-15T22:20:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e9b579640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2e94118830 con 0x7f2e94074eb0 2024-09-15T22:20:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e99315640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e94074590 0x7f2e941a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e99315640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e94074590 0x7f2e941a4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52420/0 (socket says 172.21.15.45:52420) 2024-09-15T22:20:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e99315640 1 -- 172.21.15.45:0/3601119721 learned_addr learned my addr 172.21.15.45:0/3601119721 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e98b14640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e94074eb0 0x7f2e941a4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e99b16640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e94112b90 0x7f2e9419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e99315640 1 -- 172.21.15.45:0/3601119721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e94074eb0 msgr2=0x7f2e941a4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e99315640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e94074eb0 0x7f2e941a4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e99315640 1 -- 172.21.15.45:0/3601119721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e94112b90 msgr2=0x7f2e9419e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e99315640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e94112b90 0x7f2e9419e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e99315640 1 -- 172.21.15.45:0/3601119721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9419f070 con 0x7f2e94074590 2024-09-15T22:20:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e99b16640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e94112b90 0x7f2e9419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:20:32.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.774+0000 7f2e99315640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e94074590 0x7f2e941a4780 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000d770 tx=0x7f2e9000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:32.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.775+0000 7f2e8a7fc640 1 -- 172.21.15.45:0/3601119721 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90017070 con 0x7f2e94074590 2024-09-15T22:20:32.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.775+0000 7f2e9b579640 1 -- 172.21.15.45:0/3601119721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9419f360 con 0x7f2e94074590 2024-09-15T22:20:32.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.775+0000 7f2e8a7fc640 1 -- 172.21.15.45:0/3601119721 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e90005520 con 0x7f2e94074590 2024-09-15T22:20:32.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.775+0000 7f2e8a7fc640 1 -- 172.21.15.45:0/3601119721 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90010460 con 0x7f2e94074590 2024-09-15T22:20:32.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.775+0000 7f2e9b579640 1 -- 172.21.15.45:0/3601119721 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e941ab650 con 0x7f2e94074590 2024-09-15T22:20:32.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.777+0000 7f2e8a7fc640 1 -- 172.21.15.45:0/3601119721 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2e90004ea0 con 0x7f2e94074590 2024-09-15T22:20:32.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.777+0000 7f2e9d952740 1 Processor -- start 2024-09-15T22:20:32.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e9d952740 1 -- start start 2024-09-15T22:20:32.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e9d952740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a4b60 0x560f864a4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e9d952740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 0x560f864af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e9d952740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864afd40 0x560f864b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e9d952740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560f8640a280 con 0x560f864a5480 2024-09-15T22:20:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e9d952740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560f863b1b10 con 0x560f864afd40 2024-09-15T22:20:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e9d952740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560f86406240 con 0x560f864a4b60 2024-09-15T22:20:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e8a7fc640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2e800a33b0 0x7f2e800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e99315640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 0x560f864af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e99315640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 0x560f864af800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52436/0 (socket says 172.21.15.45:52436) 2024-09-15T22:20:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e99315640 1 -- 172.21.15.45:0/1157441660 learned_addr learned my addr 172.21.15.45:0/1157441660 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e99b16640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2e800a33b0 0x7f2e800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e99b16640 1 --2- 172.21.15.45:0/1157441660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a4b60 0x560f864a4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e98b14640 1 --2- 172.21.15.45:0/1157441660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864afd40 0x560f864b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e8a7fc640 1 -- 172.21.15.45:0/3601119721 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f2e900cfc70 con 0x7f2e94074590 2024-09-15T22:20:32.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e99315640 1 -- 172.21.15.45:0/1157441660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a4b60 msgr2=0x560f864a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:32.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e99315640 1 --2- 172.21.15.45:0/1157441660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a4b60 0x560f864a4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e99315640 1 -- 172.21.15.45:0/1157441660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864afd40 msgr2=0x560f864b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:32.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e99315640 1 --2- 172.21.15.45:0/1157441660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864afd40 0x560f864b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e99315640 1 -- 172.21.15.45:0/1157441660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f863be1f0 con 0x560f864a5480 2024-09-15T22:20:32.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.778+0000 7f2e99b16640 1 --2- 172.21.15.45:0/1157441660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a4b60 0x560f864a4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:20:32.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.779+0000 7f2e99b16640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2e800a33b0 0x7f2e800a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c005e30 tx=0x7f2e8c005d80 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:32.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.779+0000 7f2e99315640 1 --2- 172.21.15.45:0/1157441660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 0x560f864af800 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2e9009bac0 tx=0x7f2e90004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d65858412f114 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:32.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.779+0000 7f2e7f7fe640 1 -- 172.21.15.45:0/1157441660 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9009ce60 con 0x560f864a5480 2024-09-15T22:20:32.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.779+0000 7f2e7f7fe640 1 -- 172.21.15.45:0/1157441660 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e9009c230 con 0x560f864a5480 2024-09-15T22:20:32.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.779+0000 7f2e7f7fe640 1 -- 172.21.15.45:0/1157441660 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90020070 con 0x560f864a5480 2024-09-15T22:20:32.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.779+0000 7f2e9d952740 1 -- 172.21.15.45:0/1157441660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 msgr2=0x560f864af800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:32.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.780+0000 7f2e9d952740 1 --2- 172.21.15.45:0/1157441660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 0x560f864af800 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2e9009bac0 tx=0x7f2e90004940 comp rx=0 tx=0).stop 2024-09-15T22:20:32.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.780+0000 7f2e9d952740 1 -- 172.21.15.45:0/1157441660 shutdown_connections 2024-09-15T22:20:32.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.780+0000 7f2e9d952740 1 --2- 172.21.15.45:0/1157441660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864afd40 0x560f864b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.780+0000 7f2e9d952740 1 --2- 172.21.15.45:0/1157441660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 0x560f864af800 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.780+0000 7f2e9d952740 1 --2- 172.21.15.45:0/1157441660 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a4b60 0x560f864a4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.780+0000 7f2e9d952740 1 -- 172.21.15.45:0/1157441660 >> 172.21.15.45:0/1157441660 conn(0x560f864a10f0 msgr2=0x560f864a14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:32.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.780+0000 7f2e9d952740 1 -- 172.21.15.45:0/1157441660 shutdown_connections 2024-09-15T22:20:32.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.780+0000 7f2e9d952740 1 -- 172.21.15.45:0/1157441660 wait complete. 2024-09-15T22:20:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.780+0000 7f2e9d952740 1 -- start start 2024-09-15T22:20:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.780+0000 7f2e9d952740 1 Processor -- start 2024-09-15T22:20:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.780+0000 7f2e9d952740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864a4b60 0x560f864acc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e9d952740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 0x560f864ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e9d952740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864afd40 0x560f864ad700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e9d952740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560f864b28b0 con 0x560f864a5480 2024-09-15T22:20:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e9d952740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560f863c4f10 con 0x560f864a4b60 2024-09-15T22:20:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e9d952740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x560f864b2a30 con 0x560f864afd40 2024-09-15T22:20:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e9d952740 10 client.0 _ll_register_callbacks cb 0x560f8638da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e98b14640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 0x560f864ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e98b14640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 0x560f864ad1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52442/0 (socket says 172.21.15.45:52442) 2024-09-15T22:20:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e98b14640 1 -- 172.21.15.45:0/3873020344 learned_addr learned my addr 172.21.15.45:0/3873020344 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e99315640 1 --2- 172.21.15.45:0/3873020344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864a4b60 0x560f864acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e99b16640 1 --2- 172.21.15.45:0/3873020344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864afd40 0x560f864ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e98b14640 1 -- 172.21.15.45:0/3873020344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864afd40 msgr2=0x560f864ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e98b14640 1 --2- 172.21.15.45:0/3873020344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864afd40 0x560f864ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e98b14640 1 -- 172.21.15.45:0/3873020344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864a4b60 msgr2=0x560f864acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e98b14640 1 --2- 172.21.15.45:0/3873020344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864a4b60 0x560f864acc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e98b14640 1 -- 172.21.15.45:0/3873020344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f8617b6a0 con 0x560f864a5480 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e98b14640 1 --2- 172.21.15.45:0/3873020344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 0x560f864ad1c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400b970 tx=0x7f2e8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce80929d7c5f31a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e7cff9640 1 -- 172.21.15.45:0/3873020344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8401b440 con 0x560f864a5480 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e7cff9640 1 -- 172.21.15.45:0/3873020344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f2e8401b5e0 con 0x560f864a5480 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.781+0000 7f2e9d952740 1 -- 172.21.15.45:0/3873020344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e9009c230 con 0x560f864a5480 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.782+0000 7f2e7cff9640 1 -- 172.21.15.45:0/3873020344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2e84024050 con 0x560f864a5480 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.782+0000 7f2e9d952740 10 client.16245 fetch_fsmap learned FSMap version 21 2024-09-15T22:20:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.782+0000 7f2e9d952740 1 -- 172.21.15.45:0/3873020344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560f864be5c0 con 0x560f864a5480 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.782+0000 7f2e7cff9640 1 -- 172.21.15.45:0/3873020344 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e9009c230 con 0x560f864a5480 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.782+0000 7f2e7cff9640 1 -- 172.21.15.45:0/3873020344 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2e84019020 con 0x560f864a5480 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.782+0000 7f2e9d952740 10 client.16245 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.782+0000 7f2e9d952740 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.782+0000 7f2e9d952740 20 client.16245 populate_metadata read hostname 'smithi045' 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.782+0000 7f2e9d952740 1 --2- 172.21.15.45:0/3873020344 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560f864bfa80 0x560f864c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.782+0000 7f2e9d952740 4 client.16245 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.782+0000 7f2e9d952740 1 -- 172.21.15.45:0/3873020344 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f864177f0 con 0x560f864bfa80 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.782+0000 7f2e99315640 1 --2- 172.21.15.45:0/3873020344 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560f864bfa80 0x560f864c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.783+0000 7f2e99315640 1 --2- 172.21.15.45:0/3873020344 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560f864bfa80 0x560f864c1eb0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8669af906f6606b0 server_cookie=2f12fb5052178a5b in_seq=0 out_seq=0 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.783+0000 7f2e7cff9640 10 client.16245 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.783+0000 7f2e7cff9640 1 -- 172.21.15.45:0/3873020344 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f864177f0 con 0x560f864bfa80 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.783+0000 7f2e7cff9640 10 client.16245 handle_command_reply: tid=0 2024-09-15T22:20:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.783+0000 7f2e9d952740 1 client.16245 shutdown 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.784+0000 7f2e9d952740 1 -- 172.21.15.45:0/3873020344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 msgr2=0x560f864ad1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.784+0000 7f2e9d952740 1 --2- 172.21.15.45:0/3873020344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 0x560f864ad1c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400b970 tx=0x7f2e8400be30 comp rx=0 tx=0).stop 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.784+0000 7f2e9d952740 1 -- 172.21.15.45:0/3873020344 shutdown_connections 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.784+0000 7f2e9d952740 1 --2- 172.21.15.45:0/3873020344 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560f864bfa80 0x560f864c1eb0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.784+0000 7f2e9d952740 1 --2- 172.21.15.45:0/3873020344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864afd40 0x560f864ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.784+0000 7f2e9d952740 1 --2- 172.21.15.45:0/3873020344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a5480 0x560f864ad1c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.784+0000 7f2e7cff9640 0 client.16245 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.784+0000 7f2e9d952740 1 --2- 172.21.15.45:0/3873020344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864a4b60 0x560f864acc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.784+0000 7f2e9d952740 1 -- 172.21.15.45:0/3873020344 >> 172.21.15.45:0/3873020344 conn(0x560f864a10f0 msgr2=0x560f864a0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.784+0000 7f2e9d952740 1 -- 172.21.15.45:0/3873020344 shutdown_connections 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.784+0000 7f2e9d952740 1 -- 172.21.15.45:0/3873020344 wait complete. 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.784+0000 7f2e9d952740 20 client.16245 trim_cache size 0 max 16384 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.801+0000 7f2e9d952740 1 Processor -- start 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.801+0000 7f2e9d952740 1 -- start start 2024-09-15T22:20:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.801+0000 7f2e9d952740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a4b60 0x560f864aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.801+0000 7f2e9d952740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a5480 0x560f864c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.801+0000 7f2e9d952740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864afd40 0x560f864c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e9d952740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2e941b37a0 con 0x560f864a4b60 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e9d952740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2e941b6020 con 0x560f864afd40 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e9d952740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2e941b3e10 con 0x560f864a5480 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e99315640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a4b60 0x560f864aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e99315640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a4b60 0x560f864aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52446/0 (socket says 172.21.15.45:52446) 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e99315640 1 -- 172.21.15.45:0/730112672 learned_addr learned my addr 172.21.15.45:0/730112672 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e98b14640 1 --2- 172.21.15.45:0/730112672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a5480 0x560f864c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e99b16640 1 --2- 172.21.15.45:0/730112672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864afd40 0x560f864c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e99315640 1 -- 172.21.15.45:0/730112672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a5480 msgr2=0x560f864c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e99315640 1 --2- 172.21.15.45:0/730112672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a5480 0x560f864c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e99315640 1 -- 172.21.15.45:0/730112672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864afd40 msgr2=0x560f864c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e99315640 1 --2- 172.21.15.45:0/730112672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864afd40 0x560f864c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e99315640 1 -- 172.21.15.45:0/730112672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f864abc30 con 0x560f864a4b60 2024-09-15T22:20:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e99b16640 1 --2- 172.21.15.45:0/730112672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864afd40 0x560f864c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:20:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e98b14640 1 --2- 172.21.15.45:0/730112672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a5480 0x560f864c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:20:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e99315640 1 --2- 172.21.15.45:0/730112672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a4b60 0x560f864aeae0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009fd0 tx=0x7f2e9009ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfb84b9b59ffb8f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e7effd640 1 -- 172.21.15.45:0/730112672 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9009ce60 con 0x560f864a4b60 2024-09-15T22:20:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e7effd640 1 -- 172.21.15.45:0/730112672 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e9009bb30 con 0x560f864a4b60 2024-09-15T22:20:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.802+0000 7f2e7effd640 1 -- 172.21.15.45:0/730112672 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90020040 con 0x560f864a4b60 2024-09-15T22:20:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.803+0000 7f2e9d952740 1 -- 172.21.15.45:0/730112672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a4b60 msgr2=0x560f864aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.803+0000 7f2e9d952740 1 --2- 172.21.15.45:0/730112672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a4b60 0x560f864aeae0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009fd0 tx=0x7f2e9009ba30 comp rx=0 tx=0).stop 2024-09-15T22:20:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.803+0000 7f2e9d952740 1 -- 172.21.15.45:0/730112672 shutdown_connections 2024-09-15T22:20:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.803+0000 7f2e9d952740 1 --2- 172.21.15.45:0/730112672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864afd40 0x560f864c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.803+0000 7f2e9d952740 1 --2- 172.21.15.45:0/730112672 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a5480 0x560f864c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.803+0000 7f2e9d952740 1 --2- 172.21.15.45:0/730112672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864a4b60 0x560f864aeae0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.803+0000 7f2e9d952740 1 -- 172.21.15.45:0/730112672 >> 172.21.15.45:0/730112672 conn(0x560f864a10f0 msgr2=0x560f864ae3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.803+0000 7f2e9d952740 1 -- 172.21.15.45:0/730112672 shutdown_connections 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.803+0000 7f2e9d952740 1 -- 172.21.15.45:0/730112672 wait complete. 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.803+0000 7f2e9d952740 1 -- start start 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.803+0000 7f2e9d952740 1 Processor -- start 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e9d952740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a5480 0x560f86523ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e9d952740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864afd40 0x560f86523ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e9d952740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864b4110 0x560f864b4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e9d952740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2e941b44e0 con 0x560f864afd40 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e9d952740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2e941b5950 con 0x560f864b4110 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e9d952740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2e941b4bb0 con 0x560f864a5480 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e9d952740 10 client.0 _ll_register_callbacks cb 0x7f2e84004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e98b14640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864afd40 0x560f86523ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e98b14640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864afd40 0x560f86523ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52448/0 (socket says 172.21.15.45:52448) 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e98b14640 1 -- 172.21.15.45:0/3148537658 learned_addr learned my addr 172.21.15.45:0/3148537658 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e99315640 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a5480 0x560f86523ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e99b16640 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864b4110 0x560f864b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e98b14640 1 -- 172.21.15.45:0/3148537658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a5480 msgr2=0x560f86523ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e98b14640 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a5480 0x560f86523ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e98b14640 1 -- 172.21.15.45:0/3148537658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864b4110 msgr2=0x560f864b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e98b14640 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864b4110 0x560f864b4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e98b14640 1 -- 172.21.15.45:0/3148537658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f864b4c50 con 0x560f864afd40 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.804+0000 7f2e99b16640 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864b4110 0x560f864b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e98b14640 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864afd40 0x560f86523ff0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x560f864ac510 tx=0x7f2e84003a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58937ae712bcf77 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e7cff9640 1 -- 172.21.15.45:0/3148537658 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84021040 con 0x560f864afd40 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e7cff9640 1 -- 172.21.15.45:0/3148537658 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f2e84011440 con 0x560f864afd40 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e9d952740 1 -- 172.21.15.45:0/3148537658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e9009bb30 con 0x560f864afd40 2024-09-15T22:20:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e7cff9640 1 -- 172.21.15.45:0/3148537658 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2e84037050 con 0x560f864afd40 2024-09-15T22:20:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e9d952740 10 client.16251 fetch_fsmap learned FSMap version 21 2024-09-15T22:20:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e9d952740 1 -- 172.21.15.45:0/3148537658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560f8652b5d0 con 0x560f864afd40 2024-09-15T22:20:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e7cff9640 1 -- 172.21.15.45:0/3148537658 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e9009bb30 con 0x560f864afd40 2024-09-15T22:20:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e7cff9640 1 -- 172.21.15.45:0/3148537658 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2e84019050 con 0x560f864afd40 2024-09-15T22:20:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e9d952740 10 client.16251 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:20:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e9d952740 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e9d952740 20 client.16251 populate_metadata read hostname 'smithi045' 2024-09-15T22:20:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e9d952740 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560f8652bd70 0x560f8652e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e9d952740 4 client.16251 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:20:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.805+0000 7f2e9d952740 1 -- 172.21.15.45:0/3148537658 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560f86411d00 con 0x560f8652bd70 2024-09-15T22:20:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.806+0000 7f2e99315640 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560f8652bd70 0x560f8652e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.806+0000 7f2e99315640 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560f8652bd70 0x560f8652e190 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9963a2f8536f261 server_cookie=42c61345291f2c09 in_seq=0 out_seq=0 2024-09-15T22:20:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.806+0000 7f2e7cff9640 10 client.16251 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:32.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.807+0000 7f2e7cff9640 1 -- 172.21.15.45:0/3148537658 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560f86411d00 con 0x560f8652bd70 2024-09-15T22:20:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.807+0000 7f2e7cff9640 10 client.16251 handle_command_reply: tid=0 2024-09-15T22:20:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.807+0000 7f2e9d952740 1 client.16251 shutdown 2024-09-15T22:20:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.807+0000 7f2e9d952740 1 -- 172.21.15.45:0/3148537658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864afd40 msgr2=0x560f86523ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.807+0000 7f2e9d952740 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864afd40 0x560f86523ff0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x560f864ac510 tx=0x7f2e84003a30 comp rx=0 tx=0).stop 2024-09-15T22:20:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.807+0000 7f2e9d952740 1 -- 172.21.15.45:0/3148537658 shutdown_connections 2024-09-15T22:20:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.807+0000 7f2e9d952740 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x560f8652bd70 0x560f8652e190 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.807+0000 7f2e9d952740 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f864b4110 0x560f864b4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.807+0000 7f2e9d952740 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560f864afd40 0x560f86523ff0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.807+0000 7f2e9d952740 1 --2- 172.21.15.45:0/3148537658 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x560f864a5480 0x560f86523ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.807+0000 7f2e9d952740 1 -- 172.21.15.45:0/3148537658 >> 172.21.15.45:0/3148537658 conn(0x560f864a10f0 msgr2=0x560f864a0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.807+0000 7f2e7cff9640 0 client.16251 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.807+0000 7f2e9d952740 1 -- 172.21.15.45:0/3148537658 shutdown_connections 2024-09-15T22:20:32.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9d952740 1 -- 172.21.15.45:0/3148537658 wait complete. 2024-09-15T22:20:32.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9d952740 20 client.16251 trim_cache size 0 max 16384 2024-09-15T22:20:32.826 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:20:32.826 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:20:32.826 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "30e044ab-2a14-4bec-a2f9-63f128f9d18f", 2024-09-15T22:20:32.826 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:20:32.826 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:20:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9b579640 1 -- 172.21.15.45:0/3601119721 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2e800a33b0 msgr2=0x7f2e800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9b579640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2e800a33b0 0x7f2e800a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c005e30 tx=0x7f2e8c005d80 comp rx=0 tx=0).stop 2024-09-15T22:20:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9b579640 1 -- 172.21.15.45:0/3601119721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e94074590 msgr2=0x7f2e941a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9b579640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e94074590 0x7f2e941a4780 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000d770 tx=0x7f2e9000dc30 comp rx=0 tx=0).stop 2024-09-15T22:20:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9b579640 1 -- 172.21.15.45:0/3601119721 shutdown_connections 2024-09-15T22:20:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9b579640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2e800a33b0 0x7f2e800a5870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9b579640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e94112b90 0x7f2e9419e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9b579640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e94074eb0 0x7f2e941a4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9b579640 1 --2- 172.21.15.45:0/3601119721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e94074590 0x7f2e941a4780 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9b579640 1 -- 172.21.15.45:0/3601119721 >> 172.21.15.45:0/3601119721 conn(0x7f2e940fd8c0 msgr2=0x7f2e940fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9b579640 1 -- 172.21.15.45:0/3601119721 shutdown_connections 2024-09-15T22:20:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:32.808+0000 7f2e9b579640 1 -- 172.21.15.45:0/3601119721 wait complete. 2024-09-15T22:20:33.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:33 smithi100 ceph-mon[35319]: pgmap v132: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:33.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:33 smithi045 ceph-mon[31180]: pgmap v132: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:33.637 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:20:33.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:33 smithi165 ceph-mon[35551]: pgmap v132: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:33.901 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:20:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:34 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:20:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:34 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:20:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:34 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:20:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:34 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:20:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.403+0000 7f9d16406640 1 -- 172.21.15.45:0/709231467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10106f10 msgr2=0x7f9d1010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.403+0000 7f9d16406640 1 --2- 172.21.15.45:0/709231467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10106f10 0x7f9d1010ea90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009ca0 tx=0x7f9d0802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.403+0000 7f9d16406640 1 -- 172.21.15.45:0/709231467 shutdown_connections 2024-09-15T22:20:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.403+0000 7f9d16406640 1 --2- 172.21.15.45:0/709231467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10106f10 0x7f9d1010ea90 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.403+0000 7f9d16406640 1 --2- 172.21.15.45:0/709231467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d10102790 0x7f9d101067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.403+0000 7f9d16406640 1 --2- 172.21.15.45:0/709231467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d10101de0 0x7f9d101021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.403+0000 7f9d16406640 1 -- 172.21.15.45:0/709231467 >> 172.21.15.45:0/709231467 conn(0x7f9d100fd8c0 msgr2=0x7f9d100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.403+0000 7f9d16406640 1 -- 172.21.15.45:0/709231467 shutdown_connections 2024-09-15T22:20:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.403+0000 7f9d16406640 1 -- 172.21.15.45:0/709231467 wait complete. 2024-09-15T22:20:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.403+0000 7f9d16406640 1 Processor -- start 2024-09-15T22:20:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.403+0000 7f9d16406640 1 -- start start 2024-09-15T22:20:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d16406640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10101de0 0x7f9d1019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d16406640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d10102790 0x7f9d1019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d16406640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d10106f10 0x7f9d1019eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d16406640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10112090 con 0x7f9d10101de0 2024-09-15T22:20:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d16406640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10111f10 con 0x7f9d10106f10 2024-09-15T22:20:34.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d16406640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9d10112210 con 0x7f9d10102790 2024-09-15T22:20:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10101de0 0x7f9d1019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10101de0 0x7f9d1019a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60906/0 (socket says 172.21.15.45:60906) 2024-09-15T22:20:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d0ffff640 1 -- 172.21.15.45:0/3435456602 learned_addr learned my addr 172.21.15.45:0/3435456602 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d149a3640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d10106f10 0x7f9d1019eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d07fff640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d10102790 0x7f9d1019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d0ffff640 1 -- 172.21.15.45:0/3435456602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d10102790 msgr2=0x7f9d1019ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d10102790 0x7f9d1019ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d0ffff640 1 -- 172.21.15.45:0/3435456602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d10106f10 msgr2=0x7f9d1019eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d10106f10 0x7f9d1019eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d0ffff640 1 -- 172.21.15.45:0/3435456602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1019f6d0 con 0x7f9d10101de0 2024-09-15T22:20:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d149a3640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d10106f10 0x7f9d1019eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:20:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10101de0 0x7f9d1019a720 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000d950 tx=0x7f9d0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d0dffb640 1 -- 172.21.15.45:0/3435456602 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00017030 con 0x7f9d10101de0 2024-09-15T22:20:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d0dffb640 1 -- 172.21.15.45:0/3435456602 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d00004020 con 0x7f9d10101de0 2024-09-15T22:20:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d16406640 1 -- 172.21.15.45:0/3435456602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1019f9c0 con 0x7f9d10101de0 2024-09-15T22:20:34.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d0dffb640 1 -- 172.21.15.45:0/3435456602 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00004a00 con 0x7f9d10101de0 2024-09-15T22:20:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.404+0000 7f9d16406640 1 -- 172.21.15.45:0/3435456602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d101a72a0 con 0x7f9d10101de0 2024-09-15T22:20:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.407+0000 7f9d0dffb640 1 -- 172.21.15.45:0/3435456602 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9d000041d0 con 0x7f9d10101de0 2024-09-15T22:20:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.407+0000 7f9d187df740 1 Processor -- start 2024-09-15T22:20:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.407+0000 7f9d187df740 1 -- start start 2024-09-15T22:20:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.407+0000 7f9d187df740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ff4a0 0x5621076ff880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.407+0000 7f9d187df740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621076ffdc0 0x56210770a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d187df740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56210770a680 0x56210770ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d187df740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5621076652e0 con 0x56210770a680 2024-09-15T22:20:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d187df740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56210760cce0 con 0x5621076ffdc0 2024-09-15T22:20:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d187df740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5621076612a0 con 0x5621076ff4a0 2024-09-15T22:20:34.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d07fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56210770a680 0x56210770ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d07fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56210770a680 0x56210770ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60914/0 (socket says 172.21.15.45:60914) 2024-09-15T22:20:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d07fff640 1 -- 172.21.15.45:0/32270944 learned_addr learned my addr 172.21.15.45:0/32270944 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/32270944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621076ffdc0 0x56210770a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d149a3640 1 --2- 172.21.15.45:0/32270944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ff4a0 0x5621076ff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d0dffb640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9cfc0a3430 0x7f9cfc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d07fff640 1 -- 172.21.15.45:0/32270944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ff4a0 msgr2=0x5621076ff880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d07fff640 1 --2- 172.21.15.45:0/32270944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ff4a0 0x5621076ff880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d07fff640 1 -- 172.21.15.45:0/32270944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621076ffdc0 msgr2=0x56210770a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d07fff640 1 --2- 172.21.15.45:0/32270944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621076ffdc0 0x56210770a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d07fff640 1 -- 172.21.15.45:0/32270944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621075f1440 con 0x56210770a680 2024-09-15T22:20:34.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/32270944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621076ffdc0 0x56210770a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:20:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d149a3640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9cfc0a3430 0x7f9cfc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d0dffb640 1 -- 172.21.15.45:0/3435456602 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f9d000cfb50 con 0x7f9d10101de0 2024-09-15T22:20:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.408+0000 7f9d07fff640 1 --2- 172.21.15.45:0/32270944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56210770a680 0x56210770ca70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009ae0 tx=0x7f9cf800e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62d18953ca16a5e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.409+0000 7f9d067fc640 1 -- 172.21.15.45:0/32270944 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8016070 con 0x56210770a680 2024-09-15T22:20:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.409+0000 7f9d067fc640 1 -- 172.21.15.45:0/32270944 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9cf800ecc0 con 0x56210770a680 2024-09-15T22:20:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.409+0000 7f9d067fc640 1 -- 172.21.15.45:0/32270944 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80107c0 con 0x56210770a680 2024-09-15T22:20:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.409+0000 7f9d187df740 1 -- 172.21.15.45:0/32270944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56210770a680 msgr2=0x56210770ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.409+0000 7f9d149a3640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9cfc0a3430 0x7f9cfc0a58f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9d08005e30 tx=0x7f9d0803e040 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.409+0000 7f9d187df740 1 --2- 172.21.15.45:0/32270944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56210770a680 0x56210770ca70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009ae0 tx=0x7f9cf800e2f0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.409+0000 7f9d187df740 1 -- 172.21.15.45:0/32270944 shutdown_connections 2024-09-15T22:20:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.409+0000 7f9d187df740 1 --2- 172.21.15.45:0/32270944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56210770a680 0x56210770ca70 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.409+0000 7f9d187df740 1 --2- 172.21.15.45:0/32270944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5621076ffdc0 0x56210770a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.409+0000 7f9d187df740 1 --2- 172.21.15.45:0/32270944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ff4a0 0x5621076ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.409+0000 7f9d187df740 1 -- 172.21.15.45:0/32270944 >> 172.21.15.45:0/32270944 conn(0x5621076fba30 msgr2=0x5621076fbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.409+0000 7f9d187df740 1 -- 172.21.15.45:0/32270944 shutdown_connections 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.409+0000 7f9d187df740 1 -- 172.21.15.45:0/32270944 wait complete. 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.410+0000 7f9d187df740 1 -- start start 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.410+0000 7f9d187df740 1 Processor -- start 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.410+0000 7f9d187df740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 0x562107709ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.410+0000 7f9d187df740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ffdc0 0x562107707190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.410+0000 7f9d187df740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 0x5621077076d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.410+0000 7f9d187df740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56210770d250 con 0x5621076ff4a0 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.410+0000 7f9d187df740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562107620050 con 0x56210770a680 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.410+0000 7f9d187df740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56210770d3d0 con 0x5621076ffdc0 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.410+0000 7f9d187df740 10 client.0 _ll_register_callbacks cb 0x562107660160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:34.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.410+0000 7f9d0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 0x562107709ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.410+0000 7f9d0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 0x562107709ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60930/0 (socket says 172.21.15.45:60930) 2024-09-15T22:20:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.410+0000 7f9d0ffff640 1 -- 172.21.15.45:0/607850737 learned_addr learned my addr 172.21.15.45:0/607850737 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.410+0000 7f9d149a3640 1 --2- 172.21.15.45:0/607850737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 0x5621077076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9d07fff640 1 --2- 172.21.15.45:0/607850737 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ffdc0 0x562107707190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9d0ffff640 1 -- 172.21.15.45:0/607850737 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ffdc0 msgr2=0x562107707190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/607850737 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ffdc0 0x562107707190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9d0ffff640 1 -- 172.21.15.45:0/607850737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 msgr2=0x5621077076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/607850737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 0x5621077076d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9d0ffff640 1 -- 172.21.15.45:0/607850737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621073d63c0 con 0x5621076ff4a0 2024-09-15T22:20:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/607850737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 0x562107709ee0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009610 tx=0x7f9d0009b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818619590fbe2f21 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:34.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9cef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:20:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9cef7fe640 1 -- 172.21.15.45:0/607850737 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0009ba10 con 0x5621076ff4a0 2024-09-15T22:20:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9cef7fe640 1 -- 172.21.15.45:0/607850737 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f9d00098080 con 0x5621076ff4a0 2024-09-15T22:20:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9d187df740 1 -- 172.21.15.45:0/607850737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cf800ecc0 con 0x5621076ff4a0 2024-09-15T22:20:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9cef7fe640 1 -- 172.21.15.45:0/607850737 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9d0009fdc0 con 0x5621076ff4a0 2024-09-15T22:20:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9d187df740 10 client.16263 fetch_fsmap learned FSMap version 21 2024-09-15T22:20:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9d187df740 1 -- 172.21.15.45:0/607850737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562107718b40 con 0x5621076ff4a0 2024-09-15T22:20:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.411+0000 7f9cef7fe640 1 -- 172.21.15.45:0/607850737 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9cf800ecc0 con 0x5621076ff4a0 2024-09-15T22:20:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.412+0000 7f9cef7fe640 1 -- 172.21.15.45:0/607850737 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9d0009ae60 con 0x5621076ff4a0 2024-09-15T22:20:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.412+0000 7f9d187df740 10 client.16263 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:20:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.412+0000 7f9d187df740 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.412+0000 7f9d187df740 20 client.16263 populate_metadata read hostname 'smithi045' 2024-09-15T22:20:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.412+0000 7f9d187df740 1 --2- 172.21.15.45:0/607850737 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562107719f50 0x56210771c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.412+0000 7f9d187df740 4 client.16263 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:20:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.412+0000 7f9d187df740 1 -- 172.21.15.45:0/607850737 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562107672850 con 0x562107719f50 2024-09-15T22:20:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.412+0000 7f9d07fff640 1 --2- 172.21.15.45:0/607850737 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562107719f50 0x56210771c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.412+0000 7f9d07fff640 1 --2- 172.21.15.45:0/607850737 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562107719f50 0x56210771c3e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a99212bac3d19489 server_cookie=490f6afd0235b5ac in_seq=0 out_seq=0 2024-09-15T22:20:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.412+0000 7f9cef7fe640 10 client.16263 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9cef7fe640 1 -- 172.21.15.45:0/607850737 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562107672850 con 0x562107719f50 2024-09-15T22:20:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9cef7fe640 10 client.16263 handle_command_reply: tid=0 2024-09-15T22:20:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9d187df740 1 client.16263 shutdown 2024-09-15T22:20:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9d187df740 1 -- 172.21.15.45:0/607850737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 msgr2=0x562107709ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9d187df740 1 --2- 172.21.15.45:0/607850737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 0x562107709ee0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009610 tx=0x7f9d0009b550 comp rx=0 tx=0).stop 2024-09-15T22:20:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9d187df740 1 -- 172.21.15.45:0/607850737 shutdown_connections 2024-09-15T22:20:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9d187df740 1 --2- 172.21.15.45:0/607850737 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562107719f50 0x56210771c3e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9d187df740 1 --2- 172.21.15.45:0/607850737 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 0x5621077076d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9d187df740 1 --2- 172.21.15.45:0/607850737 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ffdc0 0x562107707190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9d187df740 1 --2- 172.21.15.45:0/607850737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 0x562107709ee0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9d187df740 1 -- 172.21.15.45:0/607850737 >> 172.21.15.45:0/607850737 conn(0x5621076fba30 msgr2=0x562107701710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9cef7fe640 0 client.16263 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9d187df740 1 -- 172.21.15.45:0/607850737 shutdown_connections 2024-09-15T22:20:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.413+0000 7f9d187df740 1 -- 172.21.15.45:0/607850737 wait complete. 2024-09-15T22:20:34.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.414+0000 7f9d187df740 20 client.16263 trim_cache size 0 max 16384 2024-09-15T22:20:34.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d187df740 1 Processor -- start 2024-09-15T22:20:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d187df740 1 -- start start 2024-09-15T22:20:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d187df740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 0x56210771bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d187df740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ffdc0 0x5621076faa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d187df740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 0x562107721d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d187df740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101af370 con 0x5621076ff4a0 2024-09-15T22:20:34.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d187df740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101b1bf0 con 0x56210770a680 2024-09-15T22:20:34.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d187df740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101af9e0 con 0x5621076ffdc0 2024-09-15T22:20:34.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 0x56210771bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d0ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 0x56210771bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60932/0 (socket says 172.21.15.45:60932) 2024-09-15T22:20:34.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d0ffff640 1 -- 172.21.15.45:0/3398969815 learned_addr learned my addr 172.21.15.45:0/3398969815 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:34.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d07fff640 1 --2- 172.21.15.45:0/3398969815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ffdc0 0x5621076faa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d0ffff640 1 -- 172.21.15.45:0/3398969815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ffdc0 msgr2=0x5621076faa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:34.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/3398969815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ffdc0 0x5621076faa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d149a3640 1 --2- 172.21.15.45:0/3398969815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 0x562107721d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.431+0000 7f9d0ffff640 1 -- 172.21.15.45:0/3398969815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 msgr2=0x562107721d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:34.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.432+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/3398969815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 0x562107721d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.432+0000 7f9d0ffff640 1 -- 172.21.15.45:0/3398969815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562107706140 con 0x5621076ff4a0 2024-09-15T22:20:34.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.432+0000 7f9d149a3640 1 --2- 172.21.15.45:0/3398969815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 0x562107721d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:20:34.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.432+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/3398969815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 0x56210771bf60 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9d00004770 tx=0x7f9d00099f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e3da78e2aad21f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:34.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.432+0000 7f9d05ffb640 1 -- 172.21.15.45:0/3398969815 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00014070 con 0x5621076ff4a0 2024-09-15T22:20:34.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.432+0000 7f9d05ffb640 1 -- 172.21.15.45:0/3398969815 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d000b9020 con 0x5621076ff4a0 2024-09-15T22:20:34.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.432+0000 7f9d05ffb640 1 -- 172.21.15.45:0/3398969815 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00098080 con 0x5621076ff4a0 2024-09-15T22:20:34.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.432+0000 7f9d187df740 1 -- 172.21.15.45:0/3398969815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 msgr2=0x56210771bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:34.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.432+0000 7f9d187df740 1 --2- 172.21.15.45:0/3398969815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 0x56210771bf60 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9d00004770 tx=0x7f9d00099f20 comp rx=0 tx=0).stop 2024-09-15T22:20:34.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.433+0000 7f9d187df740 1 -- 172.21.15.45:0/3398969815 shutdown_connections 2024-09-15T22:20:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.433+0000 7f9d187df740 1 --2- 172.21.15.45:0/3398969815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 0x562107721d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.433+0000 7f9d187df740 1 --2- 172.21.15.45:0/3398969815 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ffdc0 0x5621076faa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.433+0000 7f9d187df740 1 --2- 172.21.15.45:0/3398969815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ff4a0 0x56210771bf60 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.433+0000 7f9d187df740 1 -- 172.21.15.45:0/3398969815 >> 172.21.15.45:0/3398969815 conn(0x5621076fba30 msgr2=0x5621076fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.433+0000 7f9d187df740 1 -- 172.21.15.45:0/3398969815 shutdown_connections 2024-09-15T22:20:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.433+0000 7f9d187df740 1 -- 172.21.15.45:0/3398969815 wait complete. 2024-09-15T22:20:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.433+0000 7f9d187df740 1 -- start start 2024-09-15T22:20:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.433+0000 7f9d187df740 1 Processor -- start 2024-09-15T22:20:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.433+0000 7f9d187df740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ff4a0 0x562107712ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.433+0000 7f9d187df740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ffdc0 0x56210770dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d187df740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 0x56210770e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d187df740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101b00b0 con 0x5621076ffdc0 2024-09-15T22:20:34.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d187df740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101b1520 con 0x56210770a680 2024-09-15T22:20:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d187df740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9d101b0780 con 0x5621076ff4a0 2024-09-15T22:20:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d187df740 10 client.0 _ll_register_callbacks cb 0x7f9d000046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:20:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d07fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ffdc0 0x56210770dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d07fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ffdc0 0x56210770dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:60934/0 (socket says 172.21.15.45:60934) 2024-09-15T22:20:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d07fff640 1 -- 172.21.15.45:0/3614337044 learned_addr learned my addr 172.21.15.45:0/3614337044 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:20:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/3614337044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ff4a0 0x562107712ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d149a3640 1 --2- 172.21.15.45:0/3614337044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 0x56210770e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d07fff640 1 -- 172.21.15.45:0/3614337044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ff4a0 msgr2=0x562107712ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d07fff640 1 --2- 172.21.15.45:0/3614337044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ff4a0 0x562107712ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d07fff640 1 -- 172.21.15.45:0/3614337044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 msgr2=0x56210770e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:20:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d07fff640 1 --2- 172.21.15.45:0/3614337044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 0x56210770e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d07fff640 1 -- 172.21.15.45:0/3614337044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56210770ed40 con 0x5621076ffdc0 2024-09-15T22:20:34.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d07fff640 1 --2- 172.21.15.45:0/3614337044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ffdc0 0x56210770dfd0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8005940 tx=0x7f9cf8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ace69a45fcc8af server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:20:34.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9cef7fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:20:34.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9cef7fe640 1 -- 172.21.15.45:0/3614337044 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8016040 con 0x5621076ffdc0 2024-09-15T22:20:34.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9d187df740 1 -- 172.21.15.45:0/3614337044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d000b9020 con 0x5621076ffdc0 2024-09-15T22:20:34.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.434+0000 7f9cef7fe640 1 -- 172.21.15.45:0/3614337044 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f9cf8005240 con 0x5621076ffdc0 2024-09-15T22:20:34.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.435+0000 7f9cef7fe640 1 -- 172.21.15.45:0/3614337044 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9cf8005440 con 0x5621076ffdc0 2024-09-15T22:20:34.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.435+0000 7f9d187df740 10 client.16269 fetch_fsmap learned FSMap version 21 2024-09-15T22:20:34.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.435+0000 7f9d187df740 1 -- 172.21.15.45:0/3614337044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562107784c20 con 0x5621076ffdc0 2024-09-15T22:20:34.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.435+0000 7f9cef7fe640 1 -- 172.21.15.45:0/3614337044 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d000b9020 con 0x5621076ffdc0 2024-09-15T22:20:34.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.435+0000 7f9cef7fe640 1 -- 172.21.15.45:0/3614337044 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9cf800f040 con 0x5621076ffdc0 2024-09-15T22:20:34.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.435+0000 7f9d187df740 10 client.16269 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:20:34.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.435+0000 7f9d187df740 10 client.16269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.435+0000 7f9d187df740 20 client.16269 populate_metadata read hostname 'smithi045' 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.435+0000 7f9d187df740 1 --2- 172.21.15.45:0/3614337044 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562107785260 0x562107787680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.435+0000 7f9d187df740 4 client.16269 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.435+0000 7f9d187df740 1 -- 172.21.15.45:0/3614337044 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56210766cd60 con 0x562107785260 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.435+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/3614337044 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562107785260 0x562107787680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9d0ffff640 1 --2- 172.21.15.45:0/3614337044 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562107785260 0x562107787680 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=428a4c2500f23c8c server_cookie=dd726d1310e7f5c7 in_seq=0 out_seq=0 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9cef7fe640 10 client.16269 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9cef7fe640 1 -- 172.21.15.45:0/3614337044 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56210766cd60 con 0x562107785260 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9cef7fe640 10 client.16269 handle_command_reply: tid=0 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9d187df740 1 client.16269 shutdown 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9d187df740 1 -- 172.21.15.45:0/3614337044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ffdc0 msgr2=0x56210770dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9d187df740 1 --2- 172.21.15.45:0/3614337044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ffdc0 0x56210770dfd0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8005940 tx=0x7f9cf8009750 comp rx=0 tx=0).stop 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9d187df740 1 -- 172.21.15.45:0/3614337044 shutdown_connections 2024-09-15T22:20:34.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9d187df740 1 --2- 172.21.15.45:0/3614337044 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562107785260 0x562107787680 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9d187df740 1 --2- 172.21.15.45:0/3614337044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56210770a680 0x56210770e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9d187df740 1 --2- 172.21.15.45:0/3614337044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5621076ffdc0 0x56210770dfd0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9d187df740 1 --2- 172.21.15.45:0/3614337044 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5621076ff4a0 0x562107712ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9d187df740 1 -- 172.21.15.45:0/3614337044 >> 172.21.15.45:0/3614337044 conn(0x5621076fba30 msgr2=0x5621076fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:34.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9cef7fe640 0 client.16269 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:20:34.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9d187df740 1 -- 172.21.15.45:0/3614337044 shutdown_connections 2024-09-15T22:20:34.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9d187df740 1 -- 172.21.15.45:0/3614337044 wait complete. 2024-09-15T22:20:34.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.436+0000 7f9d187df740 20 client.16269 trim_cache size 0 max 16384 2024-09-15T22:20:34.449 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:20:34.450 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:20:34.450 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:20:34.450 INFO:teuthology.orchestra.run.smithi045.stdout: "30e044ab-2a14-4bec-a2f9-63f128f9d18f": { 2024-09-15T22:20:34.450 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:20:34.450 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "30e044ab-2a14-4bec-a2f9-63f128f9d18f", 2024-09-15T22:20:34.450 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:20:34.450 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:20:34.450 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:20:34.450 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:20:34.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.437+0000 7f9d16406640 1 -- 172.21.15.45:0/3435456602 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9cfc0a3430 msgr2=0x7f9cfc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:34.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.437+0000 7f9d16406640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9cfc0a3430 0x7f9cfc0a58f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9d08005e30 tx=0x7f9d0803e040 comp rx=0 tx=0).stop 2024-09-15T22:20:34.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.437+0000 7f9d16406640 1 -- 172.21.15.45:0/3435456602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10101de0 msgr2=0x7f9d1019a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:20:34.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.437+0000 7f9d16406640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10101de0 0x7f9d1019a720 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000d950 tx=0x7f9d0000de10 comp rx=0 tx=0).stop 2024-09-15T22:20:34.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.437+0000 7f9d16406640 1 -- 172.21.15.45:0/3435456602 shutdown_connections 2024-09-15T22:20:34.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.437+0000 7f9d16406640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9cfc0a3430 0x7f9cfc0a58f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.437+0000 7f9d16406640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d10106f10 0x7f9d1019eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.437+0000 7f9d16406640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9d10102790 0x7f9d1019ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.437+0000 7f9d16406640 1 --2- 172.21.15.45:0/3435456602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d10101de0 0x7f9d1019a720 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:20:34.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.437+0000 7f9d16406640 1 -- 172.21.15.45:0/3435456602 >> 172.21.15.45:0/3435456602 conn(0x7f9d100fd8c0 msgr2=0x7f9d100feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:20:34.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.437+0000 7f9d16406640 1 -- 172.21.15.45:0/3435456602 shutdown_connections 2024-09-15T22:20:34.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:20:34.437+0000 7f9d16406640 1 -- 172.21.15.45:0/3435456602 wait complete. 2024-09-15T22:20:34.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:34 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:20:34.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:34 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:20:34.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:34 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:20:34.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:34 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:20:34.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:34 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:20:34.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:34 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:20:34.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:34 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:20:34.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:34 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:20:35.332 INFO:tasks.cephfs.filesystem:scrub status for tag:30e044ab-2a14-4bec-a2f9-63f128f9d18f - {'path': '/', 'tag': '30e044ab-2a14-4bec-a2f9-63f128f9d18f', 'options': 'recursive,force'} 2024-09-15T22:20:35.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:35 smithi045 ceph-mon[31180]: pgmap v133: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-15T22:20:35.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:35 smithi165 ceph-mon[35551]: pgmap v133: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-15T22:20:35.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:35 smithi100 ceph-mon[35319]: pgmap v133: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-15T22:20:37.518 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:37 smithi045 ceph-mon[31180]: pgmap v134: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:20:37.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:37 smithi165 ceph-mon[35551]: pgmap v134: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:20:37.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:37 smithi100 ceph-mon[35319]: pgmap v134: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:20:38.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:38 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:20:38.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:38 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:20:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:38 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:20:39.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:39 smithi045 ceph-mon[31180]: pgmap v135: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:20:39.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:39 smithi165 ceph-mon[35551]: pgmap v135: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:20:39.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:39 smithi100 ceph-mon[35319]: pgmap v135: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:20:41.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:41 smithi045 ceph-mon[31180]: pgmap v136: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:20:41.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:41 smithi165 ceph-mon[35551]: pgmap v136: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:20:41.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:41 smithi100 ceph-mon[35319]: pgmap v136: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:20:43.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:43 smithi045 ceph-mon[31180]: pgmap v137: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:20:43.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:43 smithi165 ceph-mon[35551]: pgmap v137: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:20:43.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:43 smithi100 ceph-mon[35319]: pgmap v137: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:20:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:45 smithi045 ceph-mon[31180]: pgmap v138: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:20:45.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:45 smithi165 ceph-mon[35551]: pgmap v138: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:20:45.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:45 smithi100 ceph-mon[35319]: pgmap v138: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:20:47.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:47 smithi045 ceph-mon[31180]: pgmap v139: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T22:20:47.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:47 smithi165 ceph-mon[35551]: pgmap v139: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T22:20:47.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:47 smithi100 ceph-mon[35319]: pgmap v139: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T22:20:49.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:49 smithi045 ceph-mon[31180]: pgmap v140: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:49.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:49 smithi165 ceph-mon[35551]: pgmap v140: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:49.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:49 smithi100 ceph-mon[35319]: pgmap v140: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:51.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:51 smithi045 ceph-mon[31180]: pgmap v141: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:20:51.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:51 smithi165 ceph-mon[35551]: pgmap v141: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:20:51.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:51 smithi100 ceph-mon[35319]: pgmap v141: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:20:53.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:53 smithi045 ceph-mon[31180]: pgmap v142: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:53.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:53 smithi165 ceph-mon[35551]: pgmap v142: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:53.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:53 smithi100 ceph-mon[35319]: pgmap v142: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:55.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:55 smithi045 ceph-mon[31180]: pgmap v143: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:20:55.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:55 smithi165 ceph-mon[35551]: pgmap v143: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:20:55.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:55 smithi100 ceph-mon[35319]: pgmap v143: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:20:57.546 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:57 smithi100 ceph-mon[35319]: pgmap v144: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:57.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:57 smithi045 ceph-mon[31180]: pgmap v144: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:57.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:57 smithi165 ceph-mon[35551]: pgmap v144: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:59.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:20:59 smithi045 ceph-mon[31180]: pgmap v145: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:59.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:20:59 smithi165 ceph-mon[35551]: pgmap v145: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:20:59.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:20:59 smithi100 ceph-mon[35319]: pgmap v145: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:01.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:01 smithi045 ceph-mon[31180]: pgmap v146: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:01.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:01 smithi165 ceph-mon[35551]: pgmap v146: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:01.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:01 smithi100 ceph-mon[35319]: pgmap v146: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:03.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:03 smithi045 ceph-mon[31180]: pgmap v147: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:03.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:03 smithi165 ceph-mon[35551]: pgmap v147: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:03.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:03 smithi100 ceph-mon[35319]: pgmap v147: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:05.333 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:21:05.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:05 smithi045 ceph-mon[31180]: pgmap v148: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 12 KiB/s wr, 4 op/s 2024-09-15T22:21:05.608 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:05.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:05 smithi165 ceph-mon[35551]: pgmap v148: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 12 KiB/s wr, 4 op/s 2024-09-15T22:21:05.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:05 smithi100 ceph-mon[35319]: pgmap v148: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 12 KiB/s wr, 4 op/s 2024-09-15T22:21:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.218+0000 7f3c4c889640 1 -- 172.21.15.45:0/2814780619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c48102790 msgr2=0x7f3c481067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.218+0000 7f3c4c889640 1 --2- 172.21.15.45:0/2814780619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c48102790 0x7f3c481067e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009900 tx=0x7f3c3c02a410 comp rx=0 tx=0).stop 2024-09-15T22:21:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.218+0000 7f3c4c889640 1 -- 172.21.15.45:0/2814780619 shutdown_connections 2024-09-15T22:21:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.218+0000 7f3c4c889640 1 --2- 172.21.15.45:0/2814780619 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c48106f10 0x7f3c4810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.218+0000 7f3c4c889640 1 --2- 172.21.15.45:0/2814780619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c48102790 0x7f3c481067e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.218+0000 7f3c4c889640 1 --2- 172.21.15.45:0/2814780619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c48101de0 0x7f3c481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.218+0000 7f3c4c889640 1 -- 172.21.15.45:0/2814780619 >> 172.21.15.45:0/2814780619 conn(0x7f3c480fd8c0 msgr2=0x7f3c480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.218+0000 7f3c4c889640 1 -- 172.21.15.45:0/2814780619 shutdown_connections 2024-09-15T22:21:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.218+0000 7f3c4c889640 1 -- 172.21.15.45:0/2814780619 wait complete. 2024-09-15T22:21:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4c889640 1 Processor -- start 2024-09-15T22:21:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4c889640 1 -- start start 2024-09-15T22:21:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4c889640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c48101de0 0x7f3c481984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4c889640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c48102790 0x7f3c481989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4c889640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c48106f10 0x7f3c4819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4c889640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3c48112090 con 0x7f3c48101de0 2024-09-15T22:21:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4c889640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3c48111f10 con 0x7f3c48106f10 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4c889640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3c48112210 con 0x7f3c48102790 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c48101de0 0x7f3c481984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c48101de0 0x7f3c481984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50408/0 (socket says 172.21.15.45:50408) 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4659c640 1 -- 172.21.15.45:0/464224822 learned_addr learned my addr 172.21.15.45:0/464224822 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c45d9b640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c48102790 0x7f3c481989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4659c640 1 -- 172.21.15.45:0/464224822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c48102790 msgr2=0x7f3c481989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4659c640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c48102790 0x7f3c481989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4659c640 1 -- 172.21.15.45:0/464224822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c48106f10 msgr2=0x7f3c4819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4659c640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c48106f10 0x7f3c4819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c4659c640 1 -- 172.21.15.45:0/464224822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4819d460 con 0x7f3c48101de0 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.219+0000 7f3c45d9b640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c48102790 0x7f3c481989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.220+0000 7f3c4659c640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c48101de0 0x7f3c481984b0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800c920 tx=0x7f3c3800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.220+0000 7f3c377fe640 1 -- 172.21.15.45:0/464224822 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c38007c70 con 0x7f3c48101de0 2024-09-15T22:21:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.220+0000 7f3c4c889640 1 -- 172.21.15.45:0/464224822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4819d750 con 0x7f3c48101de0 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.220+0000 7f3c377fe640 1 -- 172.21.15.45:0/464224822 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c38007e10 con 0x7f3c48101de0 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.220+0000 7f3c377fe640 1 -- 172.21.15.45:0/464224822 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c38018940 con 0x7f3c48101de0 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.220+0000 7f3c4c889640 1 -- 172.21.15.45:0/464224822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c481a5030 con 0x7f3c48101de0 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.223+0000 7f3c377fe640 1 -- 172.21.15.45:0/464224822 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3c38018b00 con 0x7f3c48101de0 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.223+0000 7f3c4ec62740 1 Processor -- start 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.223+0000 7f3c4ec62740 1 -- start start 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.223+0000 7f3c4ec62740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463a380 0x55fc2463a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.223+0000 7f3c4ec62740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463aca0 0x55fc24649550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.223+0000 7f3c4ec62740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 0x55fc2464be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.223+0000 7f3c4ec62740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55fc245a02e0 con 0x55fc2463a380 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.223+0000 7f3c4ec62740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fc24547ce0 con 0x55fc24649a90 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.223+0000 7f3c4ec62740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fc2459c2a0 con 0x55fc2463aca0 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c46d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463a380 0x55fc2463a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c46d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463a380 0x55fc2463a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50420/0 (socket says 172.21.15.45:50420) 2024-09-15T22:21:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c46d9d640 1 -- 172.21.15.45:0/1448570036 learned_addr learned my addr 172.21.15.45:0/1448570036 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c45d9b640 1 --2- 172.21.15.45:0/1448570036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 0x55fc2464be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c4659c640 1 --2- 172.21.15.45:0/1448570036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463aca0 0x55fc24649550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c46d9d640 1 -- 172.21.15.45:0/1448570036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463aca0 msgr2=0x55fc24649550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c46d9d640 1 --2- 172.21.15.45:0/1448570036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463aca0 0x55fc24649550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c377fe640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3c300a33b0 0x7f3c300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c46d9d640 1 -- 172.21.15.45:0/1448570036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 msgr2=0x55fc2464be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c46d9d640 1 --2- 172.21.15.45:0/1448570036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 0x55fc2464be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c46d9d640 1 -- 172.21.15.45:0/1448570036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc2452c440 con 0x55fc2463a380 2024-09-15T22:21:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c377fe640 1 -- 172.21.15.45:0/464224822 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f3c380d02d0 con 0x7f3c48101de0 2024-09-15T22:21:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c46d9d640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3c300a33b0 0x7f3c300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c46d9d640 1 --2- 172.21.15.45:0/1448570036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463a380 0x55fc2463a760 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3c40007bb0 tx=0x7f3c4000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef7b3465459a68b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.224+0000 7f3c34ff9640 1 -- 172.21.15.45:0/1448570036 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4001c930 con 0x55fc2463a380 2024-09-15T22:21:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.225+0000 7f3c34ff9640 1 -- 172.21.15.45:0/1448570036 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c40014050 con 0x55fc2463a380 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.225+0000 7f3c34ff9640 1 -- 172.21.15.45:0/1448570036 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c40022070 con 0x55fc2463a380 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.225+0000 7f3c4ec62740 1 -- 172.21.15.45:0/1448570036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463a380 msgr2=0x55fc2463a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.225+0000 7f3c46d9d640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3c300a33b0 0x7f3c300a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c4001b000 tx=0x7f3c4001e000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.225+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/1448570036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463a380 0x55fc2463a760 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3c40007bb0 tx=0x7f3c4000c6a0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.225+0000 7f3c4ec62740 1 -- 172.21.15.45:0/1448570036 shutdown_connections 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.225+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/1448570036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 0x55fc2464be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.225+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/1448570036 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463aca0 0x55fc24649550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.225+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/1448570036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463a380 0x55fc2463a760 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.225+0000 7f3c4ec62740 1 -- 172.21.15.45:0/1448570036 >> 172.21.15.45:0/1448570036 conn(0x55fc24636a30 msgr2=0x55fc24636e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.226+0000 7f3c4ec62740 1 -- 172.21.15.45:0/1448570036 shutdown_connections 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.226+0000 7f3c4ec62740 1 -- 172.21.15.45:0/1448570036 wait complete. 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.226+0000 7f3c4ec62740 1 -- start start 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.226+0000 7f3c4ec62740 1 Processor -- start 2024-09-15T22:21:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.226+0000 7f3c4ec62740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc2463a380 0x55fc24649420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.226+0000 7f3c4ec62740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc246466d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.226+0000 7f3c4ec62740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc24649a90 0x55fc24646c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.226+0000 7f3c4ec62740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55fc2464c660 con 0x55fc2463aca0 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.226+0000 7f3c4ec62740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fc2455b050 con 0x55fc2463a380 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.226+0000 7f3c4ec62740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fc2464c7e0 con 0x55fc24649a90 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.226+0000 7f3c4ec62740 10 client.0 _ll_register_callbacks cb 0x55fc2459b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c45d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc246466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c45d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc246466d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50426/0 (socket says 172.21.15.45:50426) 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c45d9b640 1 -- 172.21.15.45:0/515866275 learned_addr learned my addr 172.21.15.45:0/515866275 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c4659c640 1 --2- 172.21.15.45:0/515866275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc2463a380 0x55fc24649420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c46d9d640 1 --2- 172.21.15.45:0/515866275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc24649a90 0x55fc24646c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c45d9b640 1 -- 172.21.15.45:0/515866275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc24649a90 msgr2=0x55fc24646c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c45d9b640 1 --2- 172.21.15.45:0/515866275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc24649a90 0x55fc24646c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c45d9b640 1 -- 172.21.15.45:0/515866275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc2463a380 msgr2=0x55fc24649420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c45d9b640 1 --2- 172.21.15.45:0/515866275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc2463a380 0x55fc24649420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c45d9b640 1 -- 172.21.15.45:0/515866275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc243113c0 con 0x55fc2463aca0 2024-09-15T22:21:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c45d9b640 1 --2- 172.21.15.45:0/515866275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc246466d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009230 tx=0x7f3c3c0319c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362f0524b93a2693 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c2dffb640 1 -- 172.21.15.45:0/515866275 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c03f070 con 0x55fc2463aca0 2024-09-15T22:21:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c2dffb640 1 -- 172.21.15.45:0/515866275 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f3c3c004450 con 0x55fc2463aca0 2024-09-15T22:21:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c4ec62740 1 -- 172.21.15.45:0/515866275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c40014050 con 0x55fc2463aca0 2024-09-15T22:21:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c2dffb640 1 -- 172.21.15.45:0/515866275 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3c3c035070 con 0x55fc2463aca0 2024-09-15T22:21:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.227+0000 7f3c4ec62740 10 client.16281 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.228+0000 7f3c4ec62740 1 -- 172.21.15.45:0/515866275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fc24658090 con 0x55fc2463aca0 2024-09-15T22:21:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.228+0000 7f3c2dffb640 1 -- 172.21.15.45:0/515866275 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c40014050 con 0x55fc2463aca0 2024-09-15T22:21:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.228+0000 7f3c2dffb640 1 -- 172.21.15.45:0/515866275 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3c3c0035f0 con 0x55fc2463aca0 2024-09-15T22:21:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.228+0000 7f3c4ec62740 10 client.16281 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.228+0000 7f3c4ec62740 10 client.16281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.228+0000 7f3c4ec62740 20 client.16281 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.228+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/515866275 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fc24659550 0x55fc2465b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.228+0000 7f3c4ec62740 4 client.16281 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.228+0000 7f3c4ec62740 1 -- 172.21.15.45:0/515866275 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc245ad850 con 0x55fc24659550 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.228+0000 7f3c4659c640 1 --2- 172.21.15.45:0/515866275 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fc24659550 0x55fc2465b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.229+0000 7f3c4659c640 1 --2- 172.21.15.45:0/515866275 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fc24659550 0x55fc2465b9b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=593f0a5a0e866e28 server_cookie=19c3372e57ab1b05 in_seq=0 out_seq=0 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.229+0000 7f3c2dffb640 10 client.16281 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.229+0000 7f3c2dffb640 1 -- 172.21.15.45:0/515866275 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc245ad850 con 0x55fc24659550 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.229+0000 7f3c2dffb640 10 client.16281 handle_command_reply: tid=0 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.229+0000 7f3c4ec62740 1 client.16281 shutdown 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.230+0000 7f3c4ec62740 1 -- 172.21.15.45:0/515866275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 msgr2=0x55fc246466d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.230+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/515866275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc246466d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009230 tx=0x7f3c3c0319c0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.230+0000 7f3c4ec62740 1 -- 172.21.15.45:0/515866275 shutdown_connections 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.230+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/515866275 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fc24659550 0x55fc2465b9b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.230+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/515866275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc24649a90 0x55fc24646c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.230+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/515866275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc246466d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.230+0000 7f3c2dffb640 0 client.16281 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.230+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/515866275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc2463a380 0x55fc24649420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.230+0000 7f3c4ec62740 1 -- 172.21.15.45:0/515866275 >> 172.21.15.45:0/515866275 conn(0x55fc24636a30 msgr2=0x55fc2463c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.230+0000 7f3c4ec62740 1 -- 172.21.15.45:0/515866275 shutdown_connections 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.230+0000 7f3c4ec62740 1 -- 172.21.15.45:0/515866275 wait complete. 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.230+0000 7f3c4ec62740 20 client.16281 trim_cache size 0 max 16384 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.247+0000 7f3c4ec62740 1 Processor -- start 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.247+0000 7f3c4ec62740 1 -- start start 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.247+0000 7f3c4ec62740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463a380 0x55fc24655900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.247+0000 7f3c4ec62740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc24648640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.247+0000 7f3c4ec62740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 0x55fc24661280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.247+0000 7f3c4ec62740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3c481aafc0 con 0x55fc2463aca0 2024-09-15T22:21:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.247+0000 7f3c4ec62740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3c481ad840 con 0x55fc24649a90 2024-09-15T22:21:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.247+0000 7f3c4ec62740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3c481ab630 con 0x55fc2463a380 2024-09-15T22:21:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.248+0000 7f3c45d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc24648640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.248+0000 7f3c4659c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463a380 0x55fc24655900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.248+0000 7f3c4659c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463a380 0x55fc24655900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:45074/0 (socket says 172.21.15.45:45074) 2024-09-15T22:21:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.248+0000 7f3c4659c640 1 -- 172.21.15.45:0/2379535212 learned_addr learned my addr 172.21.15.45:0/2379535212 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.248+0000 7f3c46d9d640 1 --2- 172.21.15.45:0/2379535212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 0x55fc24661280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.248+0000 7f3c45d9b640 1 -- 172.21.15.45:0/2379535212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463a380 msgr2=0x55fc24655900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.248+0000 7f3c45d9b640 1 --2- 172.21.15.45:0/2379535212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463a380 0x55fc24655900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.248+0000 7f3c45d9b640 1 -- 172.21.15.45:0/2379535212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 msgr2=0x55fc24661280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.248+0000 7f3c45d9b640 1 --2- 172.21.15.45:0/2379535212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 0x55fc24661280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.248+0000 7f3c45d9b640 1 -- 172.21.15.45:0/2379535212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc24644c20 con 0x55fc2463aca0 2024-09-15T22:21:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.248+0000 7f3c46d9d640 1 --2- 172.21.15.45:0/2379535212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 0x55fc24661280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.249+0000 7f3c45d9b640 1 --2- 172.21.15.45:0/2379535212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc24648640 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c033000 tx=0x7f3c3c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71df919dd225aeb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.249+0000 7f3c2ffff640 1 -- 172.21.15.45:0/2379535212 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c03f070 con 0x55fc2463aca0 2024-09-15T22:21:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.249+0000 7f3c2ffff640 1 -- 172.21.15.45:0/2379535212 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c3c003c30 con 0x55fc2463aca0 2024-09-15T22:21:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.249+0000 7f3c2ffff640 1 -- 172.21.15.45:0/2379535212 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c0049b0 con 0x55fc2463aca0 2024-09-15T22:21:06.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.250+0000 7f3c4ec62740 1 -- 172.21.15.45:0/2379535212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 msgr2=0x55fc24648640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:06.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.250+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/2379535212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc24648640 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c033000 tx=0x7f3c3c02a410 comp rx=0 tx=0).stop 2024-09-15T22:21:06.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.250+0000 7f3c4ec62740 1 -- 172.21.15.45:0/2379535212 shutdown_connections 2024-09-15T22:21:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.250+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/2379535212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 0x55fc24661280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.250+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/2379535212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc24648640 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.250+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/2379535212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463a380 0x55fc24655900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.250+0000 7f3c4ec62740 1 -- 172.21.15.45:0/2379535212 >> 172.21.15.45:0/2379535212 conn(0x55fc24636a30 msgr2=0x55fc24647f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.250+0000 7f3c4ec62740 1 -- 172.21.15.45:0/2379535212 shutdown_connections 2024-09-15T22:21:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.250+0000 7f3c4ec62740 1 -- 172.21.15.45:0/2379535212 wait complete. 2024-09-15T22:21:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.250+0000 7f3c4ec62740 1 -- start start 2024-09-15T22:21:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.251+0000 7f3c4ec62740 1 Processor -- start 2024-09-15T22:21:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.251+0000 7f3c4ec62740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463a380 0x55fc2464dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.251+0000 7f3c4ec62740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc2464e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.251+0000 7f3c4ec62740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 0x55fc246c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.251+0000 7f3c4ec62740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3c481abd00 con 0x55fc2463aca0 2024-09-15T22:21:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.251+0000 7f3c4ec62740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3c481ad170 con 0x55fc24649a90 2024-09-15T22:21:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.251+0000 7f3c4ec62740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3c481ac3d0 con 0x55fc2463a380 2024-09-15T22:21:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.251+0000 7f3c4ec62740 10 client.0 _ll_register_callbacks cb 0x7f3c3c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.251+0000 7f3c45d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc2464e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.251+0000 7f3c45d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc2464e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50444/0 (socket says 172.21.15.45:50444) 2024-09-15T22:21:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.251+0000 7f3c4659c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463a380 0x55fc2464dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.251+0000 7f3c45d9b640 1 -- 172.21.15.45:0/2108041839 learned_addr learned my addr 172.21.15.45:0/2108041839 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.251+0000 7f3c46d9d640 1 --2- 172.21.15.45:0/2108041839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 0x55fc246c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.252+0000 7f3c45d9b640 1 -- 172.21.15.45:0/2108041839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463a380 msgr2=0x55fc2464dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.252+0000 7f3c45d9b640 1 --2- 172.21.15.45:0/2108041839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463a380 0x55fc2464dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.252+0000 7f3c45d9b640 1 -- 172.21.15.45:0/2108041839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 msgr2=0x55fc246c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.252+0000 7f3c45d9b640 1 --2- 172.21.15.45:0/2108041839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 0x55fc246c3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.252+0000 7f3c45d9b640 1 -- 172.21.15.45:0/2108041839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc246c3790 con 0x55fc2463aca0 2024-09-15T22:21:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.252+0000 7f3c4659c640 1 --2- 172.21.15.45:0/2108041839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463a380 0x55fc2464dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.252+0000 7f3c45d9b640 1 --2- 172.21.15.45:0/2108041839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc2464e130 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009850 tx=0x7f3c3c004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95e7357ca55d8b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.252+0000 7f3c2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.252+0000 7f3c2dffb640 1 -- 172.21.15.45:0/2108041839 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c054040 con 0x55fc2463aca0 2024-09-15T22:21:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.252+0000 7f3c2dffb640 1 -- 172.21.15.45:0/2108041839 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f3c3c031b20 con 0x55fc2463aca0 2024-09-15T22:21:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.252+0000 7f3c4ec62740 1 -- 172.21.15.45:0/2108041839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c3c003c30 con 0x55fc2463aca0 2024-09-15T22:21:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.253+0000 7f3c2dffb640 1 -- 172.21.15.45:0/2108041839 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3c3c03f040 con 0x55fc2463aca0 2024-09-15T22:21:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.253+0000 7f3c4ec62740 10 client.16287 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.253+0000 7f3c4ec62740 1 -- 172.21.15.45:0/2108041839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fc246c4960 con 0x55fc2463aca0 2024-09-15T22:21:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.253+0000 7f3c2dffb640 1 -- 172.21.15.45:0/2108041839 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3c3c003c30 con 0x55fc2463aca0 2024-09-15T22:21:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.253+0000 7f3c2dffb640 1 -- 172.21.15.45:0/2108041839 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3c3c0052d0 con 0x55fc2463aca0 2024-09-15T22:21:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.253+0000 7f3c4ec62740 10 client.16287 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.253+0000 7f3c4ec62740 10 client.16287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.253+0000 7f3c4ec62740 20 client.16287 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.253+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/2108041839 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fc246c4e60 0x55fc246c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.253+0000 7f3c4ec62740 4 client.16287 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.253+0000 7f3c4ec62740 1 -- 172.21.15.45:0/2108041839 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fc245a7d60 con 0x55fc246c4e60 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.253+0000 7f3c4659c640 1 --2- 172.21.15.45:0/2108041839 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fc246c4e60 0x55fc246c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.254+0000 7f3c4659c640 1 --2- 172.21.15.45:0/2108041839 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fc246c4e60 0x55fc246c7280 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4db6a9cf6fb39acb server_cookie=659dbc1a16db5dfe in_seq=0 out_seq=0 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.254+0000 7f3c2dffb640 10 client.16287 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.254+0000 7f3c2dffb640 1 -- 172.21.15.45:0/2108041839 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fc245a7d60 con 0x55fc246c4e60 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.254+0000 7f3c2dffb640 10 client.16287 handle_command_reply: tid=0 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.254+0000 7f3c4ec62740 1 client.16287 shutdown 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.254+0000 7f3c4ec62740 1 -- 172.21.15.45:0/2108041839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 msgr2=0x55fc2464e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.254+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/2108041839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc2464e130 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009850 tx=0x7f3c3c004480 comp rx=0 tx=0).stop 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.254+0000 7f3c4ec62740 1 -- 172.21.15.45:0/2108041839 shutdown_connections 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.254+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/2108041839 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fc246c4e60 0x55fc246c7280 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.254+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/2108041839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fc24649a90 0x55fc246c3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.254+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/2108041839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fc2463aca0 0x55fc2464e130 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.254+0000 7f3c4ec62740 1 --2- 172.21.15.45:0/2108041839 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fc2463a380 0x55fc2464dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.254+0000 7f3c4ec62740 1 -- 172.21.15.45:0/2108041839 >> 172.21.15.45:0/2108041839 conn(0x55fc24636a30 msgr2=0x55fc24648750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:06.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.255+0000 7f3c2dffb640 0 client.16287 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:06.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.255+0000 7f3c4ec62740 1 -- 172.21.15.45:0/2108041839 shutdown_connections 2024-09-15T22:21:06.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.255+0000 7f3c4ec62740 1 -- 172.21.15.45:0/2108041839 wait complete. 2024-09-15T22:21:06.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.255+0000 7f3c4ec62740 20 client.16287 trim_cache size 0 max 16384 2024-09-15T22:21:06.270 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:21:06.270 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:21:06.270 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:21:06.270 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:21:06.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.255+0000 7f3c4c889640 1 -- 172.21.15.45:0/464224822 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3c300a33b0 msgr2=0x7f3c300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:06.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.255+0000 7f3c4c889640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3c300a33b0 0x7f3c300a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c4001b000 tx=0x7f3c4001e000 comp rx=0 tx=0).stop 2024-09-15T22:21:06.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.255+0000 7f3c4c889640 1 -- 172.21.15.45:0/464224822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c48101de0 msgr2=0x7f3c481984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:06.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.255+0000 7f3c4c889640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c48101de0 0x7f3c481984b0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800c920 tx=0x7f3c3800cde0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.256+0000 7f3c4c889640 1 -- 172.21.15.45:0/464224822 shutdown_connections 2024-09-15T22:21:06.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.256+0000 7f3c4c889640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3c300a33b0 0x7f3c300a5870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.256+0000 7f3c4c889640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c48106f10 0x7f3c4819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.256+0000 7f3c4c889640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3c48102790 0x7f3c481989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.256+0000 7f3c4c889640 1 --2- 172.21.15.45:0/464224822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c48101de0 0x7f3c481984b0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:06.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.256+0000 7f3c4c889640 1 -- 172.21.15.45:0/464224822 >> 172.21.15.45:0/464224822 conn(0x7f3c480fd8c0 msgr2=0x7f3c480febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:06.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.256+0000 7f3c4c889640 1 -- 172.21.15.45:0/464224822 shutdown_connections 2024-09-15T22:21:06.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:06.256+0000 7f3c4c889640 1 -- 172.21.15.45:0/464224822 wait complete. 2024-09-15T22:21:07.077 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:21:07.077 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:21:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:07.458 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:07 smithi045 ceph-mon[31180]: pgmap v149: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:21:07.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:07 smithi165 ceph-mon[35551]: pgmap v149: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:21:07.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:07 smithi100 ceph-mon[35319]: pgmap v149: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:21:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.816+0000 7f2e5767a640 1 -- 172.21.15.45:0/43154570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50102db0 msgr2=0x7f2e50103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.816+0000 7f2e5767a640 1 --2- 172.21.15.45:0/43154570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50102db0 0x7f2e50103190 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009930 tx=0x7f2e4c02a440 comp rx=0 tx=0).stop 2024-09-15T22:21:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.816+0000 7f2e5767a640 1 -- 172.21.15.45:0/43154570 shutdown_connections 2024-09-15T22:21:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.816+0000 7f2e5767a640 1 --2- 172.21.15.45:0/43154570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e501082e0 0x7f2e5010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.816+0000 7f2e5767a640 1 --2- 172.21.15.45:0/43154570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e50103760 0x7f2e50107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.816+0000 7f2e5767a640 1 --2- 172.21.15.45:0/43154570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e50102db0 0x7f2e50103190 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.816+0000 7f2e5767a640 1 -- 172.21.15.45:0/43154570 >> 172.21.15.45:0/43154570 conn(0x7f2e500fc7d0 msgr2=0x7f2e500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.817+0000 7f2e5767a640 1 -- 172.21.15.45:0/43154570 shutdown_connections 2024-09-15T22:21:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.817+0000 7f2e5767a640 1 -- 172.21.15.45:0/43154570 wait complete. 2024-09-15T22:21:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.817+0000 7f2e5767a640 1 Processor -- start 2024-09-15T22:21:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.817+0000 7f2e5767a640 1 -- start start 2024-09-15T22:21:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.817+0000 7f2e5767a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e50102db0 0x7f2e501a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.817+0000 7f2e5767a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e50103760 0x7f2e501a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.817+0000 7f2e5767a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e501082e0 0x7f2e5019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.817+0000 7f2e5767a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2e50112230 con 0x7f2e501082e0 2024-09-15T22:21:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.817+0000 7f2e5767a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501120b0 con 0x7f2e50103760 2024-09-15T22:21:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.817+0000 7f2e5767a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2e501123b0 con 0x7f2e50102db0 2024-09-15T22:21:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.817+0000 7f2e55c17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e501082e0 0x7f2e5019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e55c17640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e501082e0 0x7f2e5019a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50458/0 (socket says 172.21.15.45:50458) 2024-09-15T22:21:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e55c17640 1 -- 172.21.15.45:0/3959974142 learned_addr learned my addr 172.21.15.45:0/3959974142 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e54c15640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e50103760 0x7f2e501a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e55416640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e50102db0 0x7f2e501a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e55c17640 1 -- 172.21.15.45:0/3959974142 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e50102db0 msgr2=0x7f2e501a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e55c17640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e50102db0 0x7f2e501a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e55c17640 1 -- 172.21.15.45:0/3959974142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e50103760 msgr2=0x7f2e501a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e55c17640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e50103760 0x7f2e501a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e55c17640 1 -- 172.21.15.45:0/3959974142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5019afb0 con 0x7f2e501082e0 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e55c17640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e501082e0 0x7f2e5019a740 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800eaa0 tx=0x7f2e4800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e467fc640 1 -- 172.21.15.45:0/3959974142 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e48004d20 con 0x7f2e501082e0 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e467fc640 1 -- 172.21.15.45:0/3959974142 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2e48005020 con 0x7f2e501082e0 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e5767a640 1 -- 172.21.15.45:0/3959974142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5019b2a0 con 0x7f2e501082e0 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e467fc640 1 -- 172.21.15.45:0/3959974142 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e480116b0 con 0x7f2e501082e0 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.818+0000 7f2e5767a640 1 -- 172.21.15.45:0/3959974142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e501a7420 con 0x7f2e501082e0 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.819+0000 7f2e5767a640 1 -- 172.21.15.45:0/3959974142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e5006a7d0 con 0x7f2e501082e0 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.820+0000 7f2e467fc640 1 -- 172.21.15.45:0/3959974142 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2e480051d0 con 0x7f2e501082e0 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.821+0000 7f2e467fc640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2e3c0a33b0 0x7f2e3c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.821+0000 7f2e55416640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2e3c0a33b0 0x7f2e3c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:07.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.822+0000 7f2e467fc640 1 -- 172.21.15.45:0/3959974142 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f2e480d0390 con 0x7f2e501082e0 2024-09-15T22:21:07.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.822+0000 7f2e55416640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2e3c0a33b0 0x7f2e3c0a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c000c00 tx=0x7f2e4c0058b0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:07.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:07.826+0000 7f2e467fc640 1 -- 172.21.15.45:0/3959974142 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e48016030 con 0x7f2e501082e0 2024-09-15T22:21:08.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.036+0000 7f2e5767a640 1 -- 172.21.15.45:0/3959974142 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e50103190 con 0x7f2e501082e0 2024-09-15T22:21:08.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.037+0000 7f2e467fc640 1 -- 172.21.15.45:0/3959974142 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f2e48096e20 con 0x7f2e501082e0 2024-09-15T22:21:08.040 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:21:08.040 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:21:08.040 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:21:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.039+0000 7f2e5767a640 1 -- 172.21.15.45:0/3959974142 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2e3c0a33b0 msgr2=0x7f2e3c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.039+0000 7f2e5767a640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2e3c0a33b0 0x7f2e3c0a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c000c00 tx=0x7f2e4c0058b0 comp rx=0 tx=0).stop 2024-09-15T22:21:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.039+0000 7f2e5767a640 1 -- 172.21.15.45:0/3959974142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e501082e0 msgr2=0x7f2e5019a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.039+0000 7f2e5767a640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e501082e0 0x7f2e5019a740 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2e4800eaa0 tx=0x7f2e4800eea0 comp rx=0 tx=0).stop 2024-09-15T22:21:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.040+0000 7f2e5767a640 1 -- 172.21.15.45:0/3959974142 shutdown_connections 2024-09-15T22:21:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.040+0000 7f2e5767a640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2e3c0a33b0 0x7f2e3c0a5870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.040+0000 7f2e5767a640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e501082e0 0x7f2e5019a740 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.040+0000 7f2e5767a640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e50103760 0x7f2e501a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.040+0000 7f2e5767a640 1 --2- 172.21.15.45:0/3959974142 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2e50102db0 0x7f2e501a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.040+0000 7f2e5767a640 1 -- 172.21.15.45:0/3959974142 >> 172.21.15.45:0/3959974142 conn(0x7f2e500fc7d0 msgr2=0x7f2e500fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:08.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.040+0000 7f2e5767a640 1 -- 172.21.15.45:0/3959974142 shutdown_connections 2024-09-15T22:21:08.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:08.040+0000 7f2e5767a640 1 -- 172.21.15.45:0/3959974142 wait complete. 2024-09-15T22:21:08.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:08 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3959974142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:21:08.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:08 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3959974142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:21:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:08 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3959974142' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:21:08.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:21:09.133 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:09.521 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:09 smithi045 ceph-mon[31180]: pgmap v150: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:21:09.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.604+0000 7f6bc9126640 1 -- 172.21.15.45:0/1627948150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc4100e20 msgr2=0x7f6bc4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:09.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.604+0000 7f6bc9126640 1 --2- 172.21.15.45:0/1627948150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc4100e20 0x7f6bc4101200 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009900 tx=0x7f6bb402a480 comp rx=0 tx=0).stop 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.604+0000 7f6bc9126640 1 -- 172.21.15.45:0/1627948150 shutdown_connections 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.604+0000 7f6bc9126640 1 --2- 172.21.15.45:0/1627948150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc4102ef0 0x7f6bc410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.604+0000 7f6bc9126640 1 --2- 172.21.15.45:0/1627948150 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bc4102570 0x7f6bc41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.604+0000 7f6bc9126640 1 --2- 172.21.15.45:0/1627948150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc4100e20 0x7f6bc4101200 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.604+0000 7f6bc9126640 1 -- 172.21.15.45:0/1627948150 >> 172.21.15.45:0/1627948150 conn(0x7f6bc40fc7d0 msgr2=0x7f6bc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.604+0000 7f6bc9126640 1 -- 172.21.15.45:0/1627948150 shutdown_connections 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.604+0000 7f6bc9126640 1 -- 172.21.15.45:0/1627948150 wait complete. 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.605+0000 7f6bc9126640 1 Processor -- start 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.605+0000 7f6bc9126640 1 -- start start 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.605+0000 7f6bc9126640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc4100e20 0x7f6bc4197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.605+0000 7f6bc9126640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bc4102570 0x7f6bc4197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.605+0000 7f6bc9126640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc4102ef0 0x7f6bc419bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.605+0000 7f6bc9126640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41110a0 con 0x7f6bc4102ef0 2024-09-15T22:21:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.605+0000 7f6bc9126640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc4110f20 con 0x7f6bc4100e20 2024-09-15T22:21:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.605+0000 7f6bc9126640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc4111220 con 0x7f6bc4102570 2024-09-15T22:21:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.605+0000 7f6bc359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc4102ef0 0x7f6bc419bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.605+0000 7f6bc359e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc4102ef0 0x7f6bc419bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50470/0 (socket says 172.21.15.45:50470) 2024-09-15T22:21:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.605+0000 7f6bc359e640 1 -- 172.21.15.45:0/2283802579 learned_addr learned my addr 172.21.15.45:0/2283802579 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.606+0000 7f6bc259c640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bc4102570 0x7f6bc4197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.606+0000 7f6bc2d9d640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc4100e20 0x7f6bc4197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.606+0000 7f6bc359e640 1 -- 172.21.15.45:0/2283802579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bc4102570 msgr2=0x7f6bc4197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.606+0000 7f6bc359e640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bc4102570 0x7f6bc4197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.606+0000 7f6bc359e640 1 -- 172.21.15.45:0/2283802579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc4100e20 msgr2=0x7f6bc4197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.606+0000 7f6bc359e640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc4100e20 0x7f6bc4197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.606+0000 7f6bc359e640 1 -- 172.21.15.45:0/2283802579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc419c4d0 con 0x7f6bc4102ef0 2024-09-15T22:21:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.606+0000 7f6bc359e640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc4102ef0 0x7f6bc419bdf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00eaa0 tx=0x7f6bbc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.606+0000 7f6babfff640 1 -- 172.21.15.45:0/2283802579 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00cdb0 con 0x7f6bc4102ef0 2024-09-15T22:21:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.606+0000 7f6bc9126640 1 -- 172.21.15.45:0/2283802579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc419c7c0 con 0x7f6bc4102ef0 2024-09-15T22:21:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.606+0000 7f6babfff640 1 -- 172.21.15.45:0/2283802579 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bbc004b20 con 0x7f6bc4102ef0 2024-09-15T22:21:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.606+0000 7f6babfff640 1 -- 172.21.15.45:0/2283802579 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc011760 con 0x7f6bc4102ef0 2024-09-15T22:21:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.606+0000 7f6bc9126640 1 -- 172.21.15.45:0/2283802579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc41a40a0 con 0x7f6bc4102ef0 2024-09-15T22:21:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6babfff640 1 -- 172.21.15.45:0/2283802579 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6bbc004cd0 con 0x7f6bc4102ef0 2024-09-15T22:21:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6bcb4ff740 1 Processor -- start 2024-09-15T22:21:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6bcb4ff740 1 -- start start 2024-09-15T22:21:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6bcb4ff740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d48b40 0x5649b7d47090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6bcb4ff740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d475d0 0x5649b7d47a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6bcb4ff740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d52370 0x5649b7d54760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6bcb4ff740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5649b7cad2f0 con 0x5649b7d48b40 2024-09-15T22:21:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6bcb4ff740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5649b7c54cf0 con 0x5649b7d52370 2024-09-15T22:21:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6bcb4ff740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5649b7ca92b0 con 0x5649b7d475d0 2024-09-15T22:21:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6babfff640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6bac0a33b0 0x7f6bac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6bc259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d48b40 0x5649b7d47090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6bc259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d48b40 0x5649b7d47090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50482/0 (socket says 172.21.15.45:50482) 2024-09-15T22:21:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6bc259c640 1 -- 172.21.15.45:0/3756218325 learned_addr learned my addr 172.21.15.45:0/3756218325 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6bc359e640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6bac0a33b0 0x7f6bac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.609+0000 7f6bc2d9d640 1 --2- 172.21.15.45:0/3756218325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d475d0 0x5649b7d47a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.610+0000 7f6bc259c640 1 --2- 172.21.15.45:0/3756218325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d52370 0x5649b7d54760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.610+0000 7f6babfff640 1 -- 172.21.15.45:0/2283802579 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f6bbc0d02f0 con 0x7f6bc4102ef0 2024-09-15T22:21:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.610+0000 7f6bc259c640 1 -- 172.21.15.45:0/3756218325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d475d0 msgr2=0x5649b7d47a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.610+0000 7f6bc259c640 1 --2- 172.21.15.45:0/3756218325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d475d0 0x5649b7d47a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.610+0000 7f6bc259c640 1 -- 172.21.15.45:0/3756218325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d52370 msgr2=0x5649b7d54760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.610+0000 7f6bc259c640 1 --2- 172.21.15.45:0/3756218325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d52370 0x5649b7d54760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.610+0000 7f6bc259c640 1 -- 172.21.15.45:0/3756218325 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649b7c393a0 con 0x5649b7d48b40 2024-09-15T22:21:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.610+0000 7f6bc259c640 1 --2- 172.21.15.45:0/3756218325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d48b40 0x5649b7d47090 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80058a0 tx=0x7f6bb800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289ad4a5f79316ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.610+0000 7f6bc359e640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6bac0a33b0 0x7f6bac0a5870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0092f0 tx=0x7f6bbc086b00 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.610+0000 7f6ba97fa640 1 -- 172.21.15.45:0/3756218325 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8004030 con 0x5649b7d48b40 2024-09-15T22:21:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.610+0000 7f6ba97fa640 1 -- 172.21.15.45:0/3756218325 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bb80041d0 con 0x5649b7d48b40 2024-09-15T22:21:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.610+0000 7f6ba97fa640 1 -- 172.21.15.45:0/3756218325 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80106c0 con 0x5649b7d48b40 2024-09-15T22:21:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.611+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/3756218325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d48b40 msgr2=0x5649b7d47090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.611+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/3756218325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d48b40 0x5649b7d47090 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80058a0 tx=0x7f6bb800b840 comp rx=0 tx=0).stop 2024-09-15T22:21:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.611+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/3756218325 shutdown_connections 2024-09-15T22:21:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.611+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/3756218325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d52370 0x5649b7d54760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.611+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/3756218325 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d475d0 0x5649b7d47a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.611+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/3756218325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d48b40 0x5649b7d47090 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.611+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/3756218325 >> 172.21.15.45:0/3756218325 conn(0x5649b7d10310 msgr2=0x5649b7d43c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.611+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/3756218325 shutdown_connections 2024-09-15T22:21:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.611+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/3756218325 wait complete. 2024-09-15T22:21:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.611+0000 7f6bcb4ff740 1 -- start start 2024-09-15T22:21:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.611+0000 7f6bcb4ff740 1 Processor -- start 2024-09-15T22:21:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bcb4ff740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d475d0 0x5649b7d5a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bcb4ff740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d48b40 0x5649b7d5a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bcb4ff740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d52370 0x5649b7d51240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bcb4ff740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5649b7d55070 con 0x5649b7d475d0 2024-09-15T22:21:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bcb4ff740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5649b7c68060 con 0x5649b7d48b40 2024-09-15T22:21:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bcb4ff740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5649b7d551f0 con 0x5649b7d52370 2024-09-15T22:21:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bcb4ff740 10 client.0 _ll_register_callbacks cb 0x5649b79bb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bc259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d475d0 0x5649b7d5a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bc259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d475d0 0x5649b7d5a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50488/0 (socket says 172.21.15.45:50488) 2024-09-15T22:21:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bc259c640 1 -- 172.21.15.45:0/778319373 learned_addr learned my addr 172.21.15.45:0/778319373 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bc2d9d640 1 --2- 172.21.15.45:0/778319373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d48b40 0x5649b7d5a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bc259c640 1 --2- 172.21.15.45:0/778319373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d52370 0x5649b7d51240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bc259c640 1 -- 172.21.15.45:0/778319373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d52370 msgr2=0x5649b7d51240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bc259c640 1 --2- 172.21.15.45:0/778319373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d52370 0x5649b7d51240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bc259c640 1 -- 172.21.15.45:0/778319373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d48b40 msgr2=0x5649b7d5a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bc259c640 1 --2- 172.21.15.45:0/778319373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d48b40 0x5649b7d5a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bc259c640 1 -- 172.21.15.45:0/778319373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649b7a1e3c0 con 0x5649b7d475d0 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6bc259c640 1 --2- 172.21.15.45:0/778319373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d475d0 0x5649b7d5a040 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x5649b7d5ad60 tx=0x7f6bb8003c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddaa7c7c50ff255a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.612+0000 7f6ba6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6ba6ff5640 1 -- 172.21.15.45:0/778319373 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8003df0 con 0x5649b7d475d0 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6ba6ff5640 1 -- 172.21.15.45:0/778319373 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f6bb8003f90 con 0x5649b7d475d0 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/778319373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bb80041d0 con 0x5649b7d475d0 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6ba6ff5640 1 -- 172.21.15.45:0/778319373 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6bb8036050 con 0x5649b7d475d0 2024-09-15T22:21:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6bcb4ff740 10 client.16305 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/778319373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5649b7d62ce0 con 0x5649b7d475d0 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6ba6ff5640 1 -- 172.21.15.45:0/778319373 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bb80041d0 con 0x5649b7d475d0 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6ba6ff5640 1 -- 172.21.15.45:0/778319373 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6bb802e020 con 0x5649b7d475d0 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6bcb4ff740 10 client.16305 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6bcb4ff740 10 client.16305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6bcb4ff740 20 client.16305 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/778319373 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5649b7d64030 0x5649b7d66420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6bcb4ff740 4 client.16305 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.613+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/778319373 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649b7cba860 con 0x5649b7d64030 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.614+0000 7f6bc2d9d640 1 --2- 172.21.15.45:0/778319373 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5649b7d64030 0x5649b7d66420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.614+0000 7f6bc2d9d640 1 --2- 172.21.15.45:0/778319373 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5649b7d64030 0x5649b7d66420 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ec8812e601280f2 server_cookie=57c4d56a981c90e9 in_seq=0 out_seq=0 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.614+0000 7f6ba6ff5640 10 client.16305 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6ba6ff5640 1 -- 172.21.15.45:0/778319373 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649b7cba860 con 0x5649b7d64030 2024-09-15T22:21:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6ba6ff5640 10 client.16305 handle_command_reply: tid=0 2024-09-15T22:21:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6bcb4ff740 1 client.16305 shutdown 2024-09-15T22:21:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/778319373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d475d0 msgr2=0x5649b7d5a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/778319373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d475d0 0x5649b7d5a040 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x5649b7d5ad60 tx=0x7f6bb8003c50 comp rx=0 tx=0).stop 2024-09-15T22:21:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/778319373 shutdown_connections 2024-09-15T22:21:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/778319373 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5649b7d64030 0x5649b7d66420 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6ba6ff5640 0 client.16305 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/778319373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d52370 0x5649b7d51240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/778319373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d48b40 0x5649b7d5a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/778319373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d475d0 0x5649b7d5a040 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/778319373 >> 172.21.15.45:0/778319373 conn(0x5649b7d10310 msgr2=0x5649b7d49960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/778319373 shutdown_connections 2024-09-15T22:21:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/778319373 wait complete. 2024-09-15T22:21:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.615+0000 7f6bcb4ff740 20 client.16305 trim_cache size 0 max 16384 2024-09-15T22:21:09.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.628+0000 7f6bcb4ff740 1 Processor -- start 2024-09-15T22:21:09.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.628+0000 7f6bcb4ff740 1 -- start start 2024-09-15T22:21:09.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bcb4ff740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d475d0 0x5649b7d6bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bcb4ff740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d48b40 0x5649b7d6c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bcb4ff740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 0x5649b7d4c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bcb4ff740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41aaf50 con 0x5649b7d52370 2024-09-15T22:21:09.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bcb4ff740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41ad7d0 con 0x5649b7d48b40 2024-09-15T22:21:09.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bcb4ff740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41ab5c0 con 0x5649b7d475d0 2024-09-15T22:21:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bc259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 0x5649b7d4c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bc259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 0x5649b7d4c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50498/0 (socket says 172.21.15.45:50498) 2024-09-15T22:21:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bc259c640 1 -- 172.21.15.45:0/3926189887 learned_addr learned my addr 172.21.15.45:0/3926189887 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bc2d9d640 1 --2- 172.21.15.45:0/3926189887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d48b40 0x5649b7d6c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bc259c640 1 --2- 172.21.15.45:0/3926189887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d475d0 0x5649b7d6bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bc259c640 1 -- 172.21.15.45:0/3926189887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d475d0 msgr2=0x5649b7d6bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bc259c640 1 --2- 172.21.15.45:0/3926189887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d475d0 0x5649b7d6bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bc259c640 1 -- 172.21.15.45:0/3926189887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d48b40 msgr2=0x5649b7d6c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bc259c640 1 --2- 172.21.15.45:0/3926189887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d48b40 0x5649b7d6c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bc259c640 1 -- 172.21.15.45:0/3926189887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649b7d44960 con 0x5649b7d52370 2024-09-15T22:21:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bc2d9d640 1 --2- 172.21.15.45:0/3926189887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d48b40 0x5649b7d6c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6bc259c640 1 --2- 172.21.15.45:0/3926189887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 0x5649b7d4c240 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8001eb0 tx=0x7f6bb8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fa8b88d9d5d703 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.629+0000 7f6ba8ff9640 1 -- 172.21.15.45:0/3926189887 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8005b90 con 0x5649b7d52370 2024-09-15T22:21:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.630+0000 7f6ba8ff9640 1 -- 172.21.15.45:0/3926189887 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bb80041d0 con 0x5649b7d52370 2024-09-15T22:21:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.630+0000 7f6ba8ff9640 1 -- 172.21.15.45:0/3926189887 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8010460 con 0x5649b7d52370 2024-09-15T22:21:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.630+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/3926189887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 msgr2=0x5649b7d4c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.630+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/3926189887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 0x5649b7d4c240 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8001eb0 tx=0x7f6bb8000bc0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.630+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/3926189887 shutdown_connections 2024-09-15T22:21:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.630+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/3926189887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 0x5649b7d4c240 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.630+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/3926189887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d48b40 0x5649b7d6c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.630+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/3926189887 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d475d0 0x5649b7d6bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.630+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/3926189887 >> 172.21.15.45:0/3926189887 conn(0x5649b7d10310 msgr2=0x5649b7d4e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.630+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/3926189887 shutdown_connections 2024-09-15T22:21:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.630+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/3926189887 wait complete. 2024-09-15T22:21:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bcb4ff740 1 -- start start 2024-09-15T22:21:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bcb4ff740 1 Processor -- start 2024-09-15T22:21:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bcb4ff740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d475d0 0x5649b7d60b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bcb4ff740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d48b40 0x5649b7d5de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bcb4ff740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 0x5649b7d5e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bcb4ff740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41abc90 con 0x5649b7d52370 2024-09-15T22:21:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bcb4ff740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41ad100 con 0x5649b7d475d0 2024-09-15T22:21:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bcb4ff740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41ac360 con 0x5649b7d48b40 2024-09-15T22:21:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bcb4ff740 10 client.0 _ll_register_callbacks cb 0x7f6bb8012480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bc259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 0x5649b7d5e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bc259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 0x5649b7d5e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50514/0 (socket says 172.21.15.45:50514) 2024-09-15T22:21:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bc259c640 1 -- 172.21.15.45:0/838482727 learned_addr learned my addr 172.21.15.45:0/838482727 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bc259c640 1 --2- 172.21.15.45:0/838482727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d475d0 0x5649b7d60b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bc2d9d640 1 --2- 172.21.15.45:0/838482727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d48b40 0x5649b7d5de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bc259c640 1 -- 172.21.15.45:0/838482727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d48b40 msgr2=0x5649b7d5de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bc259c640 1 --2- 172.21.15.45:0/838482727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d48b40 0x5649b7d5de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bc259c640 1 -- 172.21.15.45:0/838482727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d475d0 msgr2=0x5649b7d60b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bc259c640 1 --2- 172.21.15.45:0/838482727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d475d0 0x5649b7d60b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.631+0000 7f6bc259c640 1 -- 172.21.15.45:0/838482727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649b7d5ebf0 con 0x5649b7d52370 2024-09-15T22:21:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.632+0000 7f6bc259c640 1 --2- 172.21.15.45:0/838482727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 0x5649b7d5e3c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8004400 tx=0x7f6bb8024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ec8f13859ab863 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.632+0000 7f6ba6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.632+0000 7f6ba6ff5640 1 -- 172.21.15.45:0/838482727 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8041020 con 0x5649b7d52370 2024-09-15T22:21:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.632+0000 7f6ba6ff5640 1 -- 172.21.15.45:0/838482727 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f6bb8003800 con 0x5649b7d52370 2024-09-15T22:21:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.632+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/838482727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bb80041d0 con 0x5649b7d52370 2024-09-15T22:21:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.632+0000 7f6ba6ff5640 1 -- 172.21.15.45:0/838482727 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6bb8005b90 con 0x5649b7d52370 2024-09-15T22:21:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.632+0000 7f6bcb4ff740 10 client.16311 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.632+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/838482727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5649b7dcec90 con 0x5649b7d52370 2024-09-15T22:21:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.632+0000 7f6ba6ff5640 1 -- 172.21.15.45:0/838482727 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bb80041d0 con 0x5649b7d52370 2024-09-15T22:21:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.632+0000 7f6ba6ff5640 1 -- 172.21.15.45:0/838482727 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6bb802e070 con 0x5649b7d52370 2024-09-15T22:21:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.633+0000 7f6bcb4ff740 10 client.16311 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.633+0000 7f6bcb4ff740 10 client.16311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.633+0000 7f6bcb4ff740 20 client.16311 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.633+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/838482727 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5649b7d64030 0x5649b7dd12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.633+0000 7f6bcb4ff740 4 client.16311 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:21:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.633+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/838482727 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5649b7cb4d70 con 0x5649b7d64030 2024-09-15T22:21:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.633+0000 7f6bc2d9d640 1 --2- 172.21.15.45:0/838482727 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5649b7d64030 0x5649b7dd12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.633+0000 7f6bc2d9d640 1 --2- 172.21.15.45:0/838482727 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5649b7d64030 0x5649b7dd12a0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a91904c0aeac9bc9 server_cookie=210c19283e5f62c2 in_seq=0 out_seq=0 2024-09-15T22:21:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.633+0000 7f6ba6ff5640 10 client.16311 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.633+0000 7f6ba6ff5640 1 -- 172.21.15.45:0/838482727 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5649b7cb4d70 con 0x5649b7d64030 2024-09-15T22:21:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.633+0000 7f6ba6ff5640 10 client.16311 handle_command_reply: tid=0 2024-09-15T22:21:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.633+0000 7f6bcb4ff740 1 client.16311 shutdown 2024-09-15T22:21:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.634+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/838482727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 msgr2=0x5649b7d5e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.634+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/838482727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 0x5649b7d5e3c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8004400 tx=0x7f6bb8024040 comp rx=0 tx=0).stop 2024-09-15T22:21:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.634+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/838482727 shutdown_connections 2024-09-15T22:21:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.634+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/838482727 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5649b7d64030 0x5649b7dd12a0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.634+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/838482727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5649b7d52370 0x5649b7d5e3c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.634+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/838482727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5649b7d48b40 0x5649b7d5de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.634+0000 7f6bcb4ff740 1 --2- 172.21.15.45:0/838482727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5649b7d475d0 0x5649b7d60b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.634+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/838482727 >> 172.21.15.45:0/838482727 conn(0x5649b7d10310 msgr2=0x5649b7d42500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:09.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.634+0000 7f6ba6ff5640 0 client.16311 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:09.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.634+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/838482727 shutdown_connections 2024-09-15T22:21:09.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.634+0000 7f6bcb4ff740 1 -- 172.21.15.45:0/838482727 wait complete. 2024-09-15T22:21:09.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.634+0000 7f6bcb4ff740 20 client.16311 trim_cache size 0 max 16384 2024-09-15T22:21:09.642 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:21:09.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.635+0000 7f6bc9126640 1 -- 172.21.15.45:0/2283802579 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6bac0a33b0 msgr2=0x7f6bac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:09.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.635+0000 7f6bc9126640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6bac0a33b0 0x7f6bac0a5870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0092f0 tx=0x7f6bbc086b00 comp rx=0 tx=0).stop 2024-09-15T22:21:09.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.635+0000 7f6bc9126640 1 -- 172.21.15.45:0/2283802579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc4102ef0 msgr2=0x7f6bc419bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:09.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.635+0000 7f6bc9126640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc4102ef0 0x7f6bc419bdf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00eaa0 tx=0x7f6bbc00ef60 comp rx=0 tx=0).stop 2024-09-15T22:21:09.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.635+0000 7f6bc9126640 1 -- 172.21.15.45:0/2283802579 shutdown_connections 2024-09-15T22:21:09.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.635+0000 7f6bc9126640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6bac0a33b0 0x7f6bac0a5870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.635+0000 7f6bc9126640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6bc4102ef0 0x7f6bc419bdf0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.635+0000 7f6bc9126640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6bc4102570 0x7f6bc4197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.635+0000 7f6bc9126640 1 --2- 172.21.15.45:0/2283802579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc4100e20 0x7f6bc4197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.635+0000 7f6bc9126640 1 -- 172.21.15.45:0/2283802579 >> 172.21.15.45:0/2283802579 conn(0x7f6bc40fc7d0 msgr2=0x7f6bc40fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.635+0000 7f6bc9126640 1 -- 172.21.15.45:0/2283802579 shutdown_connections 2024-09-15T22:21:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:09.635+0000 7f6bc9126640 1 -- 172.21.15.45:0/2283802579 wait complete. 2024-09-15T22:21:09.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:09 smithi165 ceph-mon[35551]: pgmap v150: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:21:09.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:09 smithi100 ceph-mon[35319]: pgmap v150: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:21:11.461 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:21:11.461 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:21:11.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:11 smithi165 ceph-mon[35551]: pgmap v151: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:21:11.734 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:11 smithi100 ceph-mon[35319]: pgmap v151: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:21:11.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:11 smithi045 ceph-mon[31180]: pgmap v151: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:21:12.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.249+0000 7fe7848a0640 1 -- 172.21.15.45:0/3098875242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe780106f10 msgr2=0x7fe78010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:12.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.249+0000 7fe7848a0640 1 --2- 172.21.15.45:0/3098875242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe780106f10 0x7fe78010ea90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe778009ca0 tx=0x7fe77802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.249+0000 7fe7848a0640 1 -- 172.21.15.45:0/3098875242 shutdown_connections 2024-09-15T22:21:12.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.249+0000 7fe7848a0640 1 --2- 172.21.15.45:0/3098875242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe780106f10 0x7fe78010ea90 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.249+0000 7fe7848a0640 1 --2- 172.21.15.45:0/3098875242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe780102790 0x7fe7801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.249+0000 7fe7848a0640 1 --2- 172.21.15.45:0/3098875242 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe780101de0 0x7fe7801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.249+0000 7fe7848a0640 1 -- 172.21.15.45:0/3098875242 >> 172.21.15.45:0/3098875242 conn(0x7fe7800fd8c0 msgr2=0x7fe7800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:12.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.249+0000 7fe7848a0640 1 -- 172.21.15.45:0/3098875242 shutdown_connections 2024-09-15T22:21:12.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.249+0000 7fe7848a0640 1 -- 172.21.15.45:0/3098875242 wait complete. 2024-09-15T22:21:12.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe7848a0640 1 Processor -- start 2024-09-15T22:21:12.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe7848a0640 1 -- start start 2024-09-15T22:21:12.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe7848a0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe780101de0 0x7fe7800744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe7848a0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe780102790 0x7fe780074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe7848a0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe780106f10 0x7fe780074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe7848a0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe7801120d0 con 0x7fe780106f10 2024-09-15T22:21:12.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe7848a0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe780111f50 con 0x7fe780101de0 2024-09-15T22:21:12.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe7848a0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe780112250 con 0x7fe780102790 2024-09-15T22:21:12.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe77ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe780106f10 0x7fe780074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe77ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe780106f10 0x7fe780074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50530/0 (socket says 172.21.15.45:50530) 2024-09-15T22:21:12.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe77ed9d640 1 -- 172.21.15.45:0/2448109103 learned_addr learned my addr 172.21.15.45:0/2448109103 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:12.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe777fff640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe780102790 0x7fe780074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe77ed9d640 1 -- 172.21.15.45:0/2448109103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe780102790 msgr2=0x7fe780074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:12.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe77e59c640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe780101de0 0x7fe7800744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe77ed9d640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe780102790 0x7fe780074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.250+0000 7fe77ed9d640 1 -- 172.21.15.45:0/2448109103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe780101de0 msgr2=0x7fe7800744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:12.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.251+0000 7fe77ed9d640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe780101de0 0x7fe7800744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.251+0000 7fe77ed9d640 1 -- 172.21.15.45:0/2448109103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7801a6910 con 0x7fe780106f10 2024-09-15T22:21:12.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.251+0000 7fe77e59c640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe780101de0 0x7fe7800744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:12.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.251+0000 7fe77ed9d640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe780106f10 0x7fe780074f70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe778009dc0 tx=0x7fe778031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:12.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.251+0000 7fe7777fe640 1 -- 172.21.15.45:0/2448109103 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77802fba0 con 0x7fe780106f10 2024-09-15T22:21:12.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.251+0000 7fe7777fe640 1 -- 172.21.15.45:0/2448109103 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe77802fd40 con 0x7fe780106f10 2024-09-15T22:21:12.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.251+0000 7fe7848a0640 1 -- 172.21.15.45:0/2448109103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7801a6ba0 con 0x7fe780106f10 2024-09-15T22:21:12.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.251+0000 7fe7777fe640 1 -- 172.21.15.45:0/2448109103 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe778046a70 con 0x7fe780106f10 2024-09-15T22:21:12.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.251+0000 7fe7848a0640 1 -- 172.21.15.45:0/2448109103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7801a70e0 con 0x7fe780106f10 2024-09-15T22:21:12.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.253+0000 7fe7777fe640 1 -- 172.21.15.45:0/2448109103 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe7780305c0 con 0x7fe780106f10 2024-09-15T22:21:12.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe786c79740 1 Processor -- start 2024-09-15T22:21:12.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe786c79740 1 -- start start 2024-09-15T22:21:12.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe7777fe640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe76c0a33b0 0x7fe76c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe786c79740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa48b60 0x55dcdfa48f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe786c79740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa49480 0x55dcdfa53800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe786c79740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa53d40 0x55dcdfa56130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe786c79740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55dcdf9ae280 con 0x55dcdfa48b60 2024-09-15T22:21:12.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe786c79740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55dcdf955b10 con 0x55dcdfa49480 2024-09-15T22:21:12.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe786c79740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55dcdf9aa240 con 0x55dcdfa53d40 2024-09-15T22:21:12.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe77e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa48b60 0x55dcdfa48f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe77e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa48b60 0x55dcdfa48f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50540/0 (socket says 172.21.15.45:50540) 2024-09-15T22:21:12.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe77e59c640 1 -- 172.21.15.45:0/3038338344 learned_addr learned my addr 172.21.15.45:0/3038338344 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:12.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe7777fe640 1 -- 172.21.15.45:0/2448109103 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fe7780f1760 con 0x7fe780106f10 2024-09-15T22:21:12.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.254+0000 7fe777fff640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe76c0a33b0 0x7fe76c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe777fff640 1 --2- 172.21.15.45:0/3038338344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa49480 0x55dcdfa53800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe77ed9d640 1 --2- 172.21.15.45:0/3038338344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa53d40 0x55dcdfa56130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe77e59c640 1 -- 172.21.15.45:0/3038338344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa53d40 msgr2=0x55dcdfa56130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:12.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe77e59c640 1 --2- 172.21.15.45:0/3038338344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa53d40 0x55dcdfa56130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe77e59c640 1 -- 172.21.15.45:0/3038338344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa49480 msgr2=0x55dcdfa53800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:12.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe77e59c640 1 --2- 172.21.15.45:0/3038338344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa49480 0x55dcdfa53800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe77e59c640 1 -- 172.21.15.45:0/3038338344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcdf9621f0 con 0x55dcdfa48b60 2024-09-15T22:21:12.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe777fff640 1 --2- 172.21.15.45:0/3038338344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa49480 0x55dcdfa53800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:12.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe77ed9d640 1 --2- 172.21.15.45:0/3038338344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa53d40 0x55dcdfa56130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:12.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe77e59c640 1 --2- 172.21.15.45:0/3038338344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa48b60 0x55dcdfa48f40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe77000aa10 tx=0x7fe77000aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589f66112f4fd710 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:12.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe777fff640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe76c0a33b0 0x7fe76c0a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55dcdfa45f50 tx=0x7fe76800a5f0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:12.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe774ff9640 1 -- 172.21.15.45:0/3038338344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770015070 con 0x55dcdfa48b60 2024-09-15T22:21:12.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe774ff9640 1 -- 172.21.15.45:0/3038338344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe77000cc60 con 0x55dcdfa48b60 2024-09-15T22:21:12.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.255+0000 7fe774ff9640 1 -- 172.21.15.45:0/3038338344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7700187c0 con 0x55dcdfa48b60 2024-09-15T22:21:12.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 -- 172.21.15.45:0/3038338344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa48b60 msgr2=0x55dcdfa48f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:12.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 --2- 172.21.15.45:0/3038338344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa48b60 0x55dcdfa48f40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe77000aa10 tx=0x7fe77000aed0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 -- 172.21.15.45:0/3038338344 shutdown_connections 2024-09-15T22:21:12.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 --2- 172.21.15.45:0/3038338344 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa53d40 0x55dcdfa56130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 --2- 172.21.15.45:0/3038338344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa49480 0x55dcdfa53800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 --2- 172.21.15.45:0/3038338344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa48b60 0x55dcdfa48f40 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 -- 172.21.15.45:0/3038338344 >> 172.21.15.45:0/3038338344 conn(0x55dcdfa450f0 msgr2=0x55dcdfa454d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:12.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 -- 172.21.15.45:0/3038338344 shutdown_connections 2024-09-15T22:21:12.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 -- 172.21.15.45:0/3038338344 wait complete. 2024-09-15T22:21:12.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 -- start start 2024-09-15T22:21:12.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 Processor -- start 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa48b60 0x55dcdfa537b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa49480 0x55dcdfa50b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa53d40 0x55dcdfa51240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.256+0000 7fe786c79740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55dcdfa56910 con 0x55dcdfa53d40 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe786c79740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55dcdf968f10 con 0x55dcdfa49480 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe786c79740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55dcdfa56a90 con 0x55dcdfa48b60 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe786c79740 10 client.0 _ll_register_callbacks cb 0x55dcdf931a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe77ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa53d40 0x55dcdfa51240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe77ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa53d40 0x55dcdfa51240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50548/0 (socket says 172.21.15.45:50548) 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe77ed9d640 1 -- 172.21.15.45:0/715589694 learned_addr learned my addr 172.21.15.45:0/715589694 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe777fff640 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa49480 0x55dcdfa50b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe77e59c640 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa48b60 0x55dcdfa537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe77ed9d640 1 -- 172.21.15.45:0/715589694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa48b60 msgr2=0x55dcdfa537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:12.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe77ed9d640 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa48b60 0x55dcdfa537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe77ed9d640 1 -- 172.21.15.45:0/715589694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa49480 msgr2=0x55dcdfa50b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:12.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe77ed9d640 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa49480 0x55dcdfa50b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe77ed9d640 1 -- 172.21.15.45:0/715589694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcdf71f6a0 con 0x55dcdfa53d40 2024-09-15T22:21:12.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe77e59c640 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa48b60 0x55dcdfa537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:12.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe777fff640 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa49480 0x55dcdfa50b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:12.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe77ed9d640 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa53d40 0x55dcdfa51240 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe7780b9b90 tx=0x7fe7780bd180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492b1ff2b7d1a53f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:12.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe765ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:12.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe765ffb640 1 -- 172.21.15.45:0/715589694 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7780bd730 con 0x55dcdfa53d40 2024-09-15T22:21:12.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe765ffb640 1 -- 172.21.15.45:0/715589694 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fe7780a0f90 con 0x55dcdfa53d40 2024-09-15T22:21:12.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe786c79740 1 -- 172.21.15.45:0/715589694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe77000cc60 con 0x55dcdfa53d40 2024-09-15T22:21:12.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe765ffb640 1 -- 172.21.15.45:0/715589694 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe7780c1ae0 con 0x55dcdfa53d40 2024-09-15T22:21:12.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe786c79740 10 client.16323 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:12.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.257+0000 7fe786c79740 1 -- 172.21.15.45:0/715589694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dcdfa56910 con 0x55dcdfa53d40 2024-09-15T22:21:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.258+0000 7fe765ffb640 1 -- 172.21.15.45:0/715589694 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe77000cc60 con 0x55dcdfa53d40 2024-09-15T22:21:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.258+0000 7fe765ffb640 1 -- 172.21.15.45:0/715589694 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe77804e030 con 0x55dcdfa53d40 2024-09-15T22:21:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.258+0000 7fe786c79740 10 client.16323 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.258+0000 7fe786c79740 10 client.16323 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.258+0000 7fe786c79740 20 client.16323 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.258+0000 7fe786c79740 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dcdfa637d0 0x55dcdfa65c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.258+0000 7fe786c79740 4 client.16323 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.258+0000 7fe786c79740 1 -- 172.21.15.45:0/715589694 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcdf9bb7f0 con 0x55dcdfa637d0 2024-09-15T22:21:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.258+0000 7fe77e59c640 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dcdfa637d0 0x55dcdfa65c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.259+0000 7fe765ffb640 10 client.16323 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.259+0000 7fe77e59c640 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dcdfa637d0 0x55dcdfa65c00 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8299d8a27a5617fb server_cookie=b495592d1fd0946e in_seq=0 out_seq=0 2024-09-15T22:21:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.259+0000 7fe765ffb640 1 -- 172.21.15.45:0/715589694 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dcdf9bb7f0 con 0x55dcdfa637d0 2024-09-15T22:21:12.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.259+0000 7fe765ffb640 10 client.16323 handle_command_reply: tid=0 2024-09-15T22:21:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.260+0000 7fe786c79740 1 client.16323 shutdown 2024-09-15T22:21:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.260+0000 7fe786c79740 1 -- 172.21.15.45:0/715589694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa53d40 msgr2=0x55dcdfa51240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.260+0000 7fe786c79740 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa53d40 0x55dcdfa51240 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe7780b9b90 tx=0x7fe7780bd180 comp rx=0 tx=0).stop 2024-09-15T22:21:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.260+0000 7fe786c79740 1 -- 172.21.15.45:0/715589694 shutdown_connections 2024-09-15T22:21:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.260+0000 7fe786c79740 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dcdfa637d0 0x55dcdfa65c00 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.260+0000 7fe786c79740 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa53d40 0x55dcdfa51240 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.260+0000 7fe786c79740 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa49480 0x55dcdfa50b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.260+0000 7fe765ffb640 0 client.16323 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.260+0000 7fe786c79740 1 --2- 172.21.15.45:0/715589694 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa48b60 0x55dcdfa537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.260+0000 7fe786c79740 1 -- 172.21.15.45:0/715589694 >> 172.21.15.45:0/715589694 conn(0x55dcdfa450f0 msgr2=0x55dcdfa4ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.260+0000 7fe786c79740 1 -- 172.21.15.45:0/715589694 shutdown_connections 2024-09-15T22:21:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.260+0000 7fe786c79740 1 -- 172.21.15.45:0/715589694 wait complete. 2024-09-15T22:21:12.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.260+0000 7fe786c79740 20 client.16323 trim_cache size 0 max 16384 2024-09-15T22:21:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.277+0000 7fe786c79740 1 Processor -- start 2024-09-15T22:21:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.277+0000 7fe786c79740 1 -- start start 2024-09-15T22:21:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.277+0000 7fe786c79740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa48b60 0x55dcdfa5fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.277+0000 7fe786c79740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 0x55dcdfa4fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.277+0000 7fe786c79740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa53d40 0x55dcdfa6b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.277+0000 7fe786c79740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe7801af1d0 con 0x55dcdfa49480 2024-09-15T22:21:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.277+0000 7fe786c79740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe7801b1a50 con 0x55dcdfa53d40 2024-09-15T22:21:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.277+0000 7fe786c79740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe7801af840 con 0x55dcdfa48b60 2024-09-15T22:21:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.277+0000 7fe777fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 0x55dcdfa4fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.277+0000 7fe777fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 0x55dcdfa4fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50554/0 (socket says 172.21.15.45:50554) 2024-09-15T22:21:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.277+0000 7fe777fff640 1 -- 172.21.15.45:0/3684739912 learned_addr learned my addr 172.21.15.45:0/3684739912 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.278+0000 7fe77e59c640 1 --2- 172.21.15.45:0/3684739912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa48b60 0x55dcdfa5fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.278+0000 7fe777fff640 1 -- 172.21.15.45:0/3684739912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa48b60 msgr2=0x55dcdfa5fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:12.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.278+0000 7fe777fff640 1 --2- 172.21.15.45:0/3684739912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa48b60 0x55dcdfa5fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.278+0000 7fe777fff640 1 -- 172.21.15.45:0/3684739912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa53d40 msgr2=0x55dcdfa6b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:12.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.278+0000 7fe777fff640 1 --2- 172.21.15.45:0/3684739912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa53d40 0x55dcdfa6b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.278+0000 7fe777fff640 1 -- 172.21.15.45:0/3684739912 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcdfa48990 con 0x55dcdfa49480 2024-09-15T22:21:12.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.278+0000 7fe777fff640 1 --2- 172.21.15.45:0/3684739912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 0x55dcdfa4fae0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe76800aa90 tx=0x7fe76800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d36392b30ee28b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:12.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.278+0000 7fe767fff640 1 -- 172.21.15.45:0/3684739912 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768012e60 con 0x55dcdfa49480 2024-09-15T22:21:12.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.278+0000 7fe767fff640 1 -- 172.21.15.45:0/3684739912 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe768019040 con 0x55dcdfa49480 2024-09-15T22:21:12.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.278+0000 7fe767fff640 1 -- 172.21.15.45:0/3684739912 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768011de0 con 0x55dcdfa49480 2024-09-15T22:21:12.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.278+0000 7fe786c79740 1 -- 172.21.15.45:0/3684739912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 msgr2=0x55dcdfa4fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:12.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.278+0000 7fe786c79740 1 --2- 172.21.15.45:0/3684739912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 0x55dcdfa4fae0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe76800aa90 tx=0x7fe76800e000 comp rx=0 tx=0).stop 2024-09-15T22:21:12.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 -- 172.21.15.45:0/3684739912 shutdown_connections 2024-09-15T22:21:12.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 --2- 172.21.15.45:0/3684739912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa53d40 0x55dcdfa6b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 --2- 172.21.15.45:0/3684739912 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 0x55dcdfa4fae0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 --2- 172.21.15.45:0/3684739912 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa48b60 0x55dcdfa5fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 -- 172.21.15.45:0/3684739912 >> 172.21.15.45:0/3684739912 conn(0x55dcdfa450f0 msgr2=0x55dcdfa4f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:12.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 -- 172.21.15.45:0/3684739912 shutdown_connections 2024-09-15T22:21:12.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 -- 172.21.15.45:0/3684739912 wait complete. 2024-09-15T22:21:12.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 -- start start 2024-09-15T22:21:12.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 Processor -- start 2024-09-15T22:21:12.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa48b60 0x55dcdfa5bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 0x55dcdfa5c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa53d40 0x55dcdfa56ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe7801aff10 con 0x55dcdfa49480 2024-09-15T22:21:12.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe7801b1380 con 0x55dcdfa48b60 2024-09-15T22:21:12.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe7801b05e0 con 0x55dcdfa53d40 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe786c79740 10 client.0 _ll_register_callbacks cb 0x7fe778005f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.279+0000 7fe777fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 0x55dcdfa5c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe777fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 0x55dcdfa5c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50556/0 (socket says 172.21.15.45:50556) 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe777fff640 1 -- 172.21.15.45:0/2314082316 learned_addr learned my addr 172.21.15.45:0/2314082316 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe77ed9d640 1 --2- 172.21.15.45:0/2314082316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa53d40 0x55dcdfa56ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe77e59c640 1 --2- 172.21.15.45:0/2314082316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa48b60 0x55dcdfa5bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe777fff640 1 -- 172.21.15.45:0/2314082316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa53d40 msgr2=0x55dcdfa56ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe777fff640 1 --2- 172.21.15.45:0/2314082316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa53d40 0x55dcdfa56ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe777fff640 1 -- 172.21.15.45:0/2314082316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa48b60 msgr2=0x55dcdfa5bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe777fff640 1 --2- 172.21.15.45:0/2314082316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa48b60 0x55dcdfa5bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe777fff640 1 -- 172.21.15.45:0/2314082316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcdfa44f20 con 0x55dcdfa49480 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe777fff640 1 --2- 172.21.15.45:0/2314082316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 0x55dcdfa5c230 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe768011010 tx=0x7fe768011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c798f590f7eaba5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe765ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:12.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe765ffb640 1 -- 172.21.15.45:0/2314082316 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe768012e60 con 0x55dcdfa49480 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe765ffb640 1 -- 172.21.15.45:0/2314082316 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fe768021a40 con 0x55dcdfa49480 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe786c79740 1 -- 172.21.15.45:0/2314082316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe768019040 con 0x55dcdfa49480 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe765ffb640 1 -- 172.21.15.45:0/2314082316 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe768021c40 con 0x55dcdfa49480 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe786c79740 10 client.16329 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.280+0000 7fe786c79740 1 -- 172.21.15.45:0/2314082316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dcdface9f0 con 0x55dcdfa49480 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.281+0000 7fe765ffb640 1 -- 172.21.15.45:0/2314082316 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe768019040 con 0x55dcdfa49480 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.281+0000 7fe765ffb640 1 -- 172.21.15.45:0/2314082316 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe7680293f0 con 0x55dcdfa49480 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.281+0000 7fe786c79740 10 client.16329 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.281+0000 7fe786c79740 10 client.16329 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.281+0000 7fe786c79740 20 client.16329 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.281+0000 7fe786c79740 1 --2- 172.21.15.45:0/2314082316 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dcdfa637d0 0x55dcdfad10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.281+0000 7fe786c79740 4 client.16329 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.281+0000 7fe786c79740 1 -- 172.21.15.45:0/2314082316 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dcdf9b5d00 con 0x55dcdfa637d0 2024-09-15T22:21:12.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.281+0000 7fe77e59c640 1 --2- 172.21.15.45:0/2314082316 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dcdfa637d0 0x55dcdfad10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:12.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.282+0000 7fe77e59c640 1 --2- 172.21.15.45:0/2314082316 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dcdfa637d0 0x55dcdfad10f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9350f77e840fa8b8 server_cookie=54ffaacc664f6266 in_seq=0 out_seq=0 2024-09-15T22:21:12.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.282+0000 7fe765ffb640 10 client.16329 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.282+0000 7fe765ffb640 1 -- 172.21.15.45:0/2314082316 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dcdf9b5d00 con 0x55dcdfa637d0 2024-09-15T22:21:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.282+0000 7fe765ffb640 10 client.16329 handle_command_reply: tid=0 2024-09-15T22:21:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.283+0000 7fe786c79740 1 client.16329 shutdown 2024-09-15T22:21:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.283+0000 7fe786c79740 1 -- 172.21.15.45:0/2314082316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 msgr2=0x55dcdfa5c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.283+0000 7fe786c79740 1 --2- 172.21.15.45:0/2314082316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 0x55dcdfa5c230 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe768011010 tx=0x7fe768011d90 comp rx=0 tx=0).stop 2024-09-15T22:21:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.283+0000 7fe786c79740 1 -- 172.21.15.45:0/2314082316 shutdown_connections 2024-09-15T22:21:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.283+0000 7fe786c79740 1 --2- 172.21.15.45:0/2314082316 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dcdfa637d0 0x55dcdfad10f0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.283+0000 7fe786c79740 1 --2- 172.21.15.45:0/2314082316 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dcdfa53d40 0x55dcdfa56ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.283+0000 7fe786c79740 1 --2- 172.21.15.45:0/2314082316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dcdfa49480 0x55dcdfa5c230 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.283+0000 7fe765ffb640 0 client.16329 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:12.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.283+0000 7fe786c79740 1 --2- 172.21.15.45:0/2314082316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dcdfa48b60 0x55dcdfa5bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.283+0000 7fe786c79740 1 -- 172.21.15.45:0/2314082316 >> 172.21.15.45:0/2314082316 conn(0x55dcdfa450f0 msgr2=0x55dcdfa4fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:12.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.283+0000 7fe786c79740 1 -- 172.21.15.45:0/2314082316 shutdown_connections 2024-09-15T22:21:12.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.283+0000 7fe786c79740 1 -- 172.21.15.45:0/2314082316 wait complete. 2024-09-15T22:21:12.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.283+0000 7fe786c79740 20 client.16329 trim_cache size 0 max 16384 2024-09-15T22:21:12.301 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:21:12.301 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:21:12.301 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "3a0a2f82-695a-4f99-982d-aed1f6213e41", 2024-09-15T22:21:12.301 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:21:12.301 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:21:12.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.284+0000 7fe7848a0640 1 -- 172.21.15.45:0/2448109103 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe76c0a33b0 msgr2=0x7fe76c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:12.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.284+0000 7fe7848a0640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe76c0a33b0 0x7fe76c0a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x55dcdfa45f50 tx=0x7fe76800a5f0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.284+0000 7fe7848a0640 1 -- 172.21.15.45:0/2448109103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe780106f10 msgr2=0x7fe780074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:12.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.284+0000 7fe7848a0640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe780106f10 0x7fe780074f70 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe778009dc0 tx=0x7fe778031b10 comp rx=0 tx=0).stop 2024-09-15T22:21:12.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.284+0000 7fe7848a0640 1 -- 172.21.15.45:0/2448109103 shutdown_connections 2024-09-15T22:21:12.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.284+0000 7fe7848a0640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe76c0a33b0 0x7fe76c0a5870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.284+0000 7fe7848a0640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe780106f10 0x7fe780074f70 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.284+0000 7fe7848a0640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe780102790 0x7fe780074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.284+0000 7fe7848a0640 1 --2- 172.21.15.45:0/2448109103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe780101de0 0x7fe7800744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:12.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.284+0000 7fe7848a0640 1 -- 172.21.15.45:0/2448109103 >> 172.21.15.45:0/2448109103 conn(0x7fe7800fd8c0 msgr2=0x7fe7800ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:12.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.284+0000 7fe7848a0640 1 -- 172.21.15.45:0/2448109103 shutdown_connections 2024-09-15T22:21:12.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:12.284+0000 7fe7848a0640 1 -- 172.21.15.45:0/2448109103 wait complete. 2024-09-15T22:21:13.085 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:21:13.347 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:13.615 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:13 smithi045 ceph-mon[31180]: pgmap v152: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:21:13.615 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:13 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:21:13.615 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:13 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:21:13.615 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:13 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:21:13.615 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:13 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:21:13.615 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:13 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:21:13.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:13 smithi165 ceph-mon[35551]: pgmap v152: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:21:13.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:13 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:21:13.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:13 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:21:13.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:13 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:21:13.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:13 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:21:13.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:13 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:21:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:13 smithi100 ceph-mon[35319]: pgmap v152: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:21:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:13 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:21:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:13 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:21:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:13 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:21:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:13 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:21:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:13 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:21:13.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.830+0000 7f2d3dad2640 1 -- 172.21.15.45:0/3716352257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d381036e0 msgr2=0x7f2d38107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:13.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.830+0000 7f2d3dad2640 1 --2- 172.21.15.45:0/3716352257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d381036e0 0x7f2d38107b90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009930 tx=0x7f2d2c02a420 comp rx=0 tx=0).stop 2024-09-15T22:21:13.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.831+0000 7f2d3dad2640 1 -- 172.21.15.45:0/3716352257 shutdown_connections 2024-09-15T22:21:13.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.831+0000 7f2d3dad2640 1 --2- 172.21.15.45:0/3716352257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d381082a0 0x7f2d3810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.831+0000 7f2d3dad2640 1 --2- 172.21.15.45:0/3716352257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d381036e0 0x7f2d38107b90 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.831+0000 7f2d3dad2640 1 --2- 172.21.15.45:0/3716352257 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d38102d30 0x7f2d38103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.831+0000 7f2d3dad2640 1 -- 172.21.15.45:0/3716352257 >> 172.21.15.45:0/3716352257 conn(0x7f2d380fc7d0 msgr2=0x7f2d380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.831+0000 7f2d3dad2640 1 -- 172.21.15.45:0/3716352257 shutdown_connections 2024-09-15T22:21:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.831+0000 7f2d3dad2640 1 -- 172.21.15.45:0/3716352257 wait complete. 2024-09-15T22:21:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.831+0000 7f2d3dad2640 1 Processor -- start 2024-09-15T22:21:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d3dad2640 1 -- start start 2024-09-15T22:21:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d3dad2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d38102d30 0x7f2d38198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d3dad2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d381036e0 0x7f2d38198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d3dad2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d381082a0 0x7f2d3819cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d3dad2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2d38112200 con 0x7f2d38102d30 2024-09-15T22:21:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d3dad2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d38112080 con 0x7f2d381036e0 2024-09-15T22:21:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d3dad2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d38112380 con 0x7f2d381082a0 2024-09-15T22:21:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d38102d30 0x7f2d38198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d38102d30 0x7f2d38198720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50572/0 (socket says 172.21.15.45:50572) 2024-09-15T22:21:13.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d377fe640 1 -- 172.21.15.45:0/588212878 learned_addr learned my addr 172.21.15.45:0/588212878 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:13.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d36ffd640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d381036e0 0x7f2d38198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d37fff640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d381082a0 0x7f2d3819cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d377fe640 1 -- 172.21.15.45:0/588212878 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d381082a0 msgr2=0x7f2d3819cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:13.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d377fe640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d381082a0 0x7f2d3819cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d377fe640 1 -- 172.21.15.45:0/588212878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d381036e0 msgr2=0x7f2d38198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:13.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d377fe640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d381036e0 0x7f2d38198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d377fe640 1 -- 172.21.15.45:0/588212878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d3819d6d0 con 0x7f2d38102d30 2024-09-15T22:21:13.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.832+0000 7f2d36ffd640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d381036e0 0x7f2d38198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:13.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.833+0000 7f2d377fe640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d38102d30 0x7f2d38198720 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800b4a0 tx=0x7f2d2800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:13.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.833+0000 7f2d34ff9640 1 -- 172.21.15.45:0/588212878 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28014070 con 0x7f2d38102d30 2024-09-15T22:21:13.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.833+0000 7f2d3dad2640 1 -- 172.21.15.45:0/588212878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3819d9c0 con 0x7f2d38102d30 2024-09-15T22:21:13.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.833+0000 7f2d34ff9640 1 -- 172.21.15.45:0/588212878 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d28010b10 con 0x7f2d38102d30 2024-09-15T22:21:13.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.833+0000 7f2d34ff9640 1 -- 172.21.15.45:0/588212878 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28017d60 con 0x7f2d38102d30 2024-09-15T22:21:13.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.833+0000 7f2d3dad2640 1 -- 172.21.15.45:0/588212878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d381a52a0 con 0x7f2d38102d30 2024-09-15T22:21:13.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.836+0000 7f2d3feab740 1 Processor -- start 2024-09-15T22:21:13.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.836+0000 7f2d34ff9640 1 -- 172.21.15.45:0/588212878 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2d28017070 con 0x7f2d38102d30 2024-09-15T22:21:13.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.836+0000 7f2d3feab740 1 -- start start 2024-09-15T22:21:13.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.836+0000 7f2d3feab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c15153a0 0x5618c1515780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.836+0000 7f2d3feab740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 0x5618c1524550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.836+0000 7f2d3feab740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 0x5618c1526e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.836+0000 7f2d3feab740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5618c147b2e0 con 0x5618c1524a90 2024-09-15T22:21:13.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.836+0000 7f2d3feab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5618c1422ce0 con 0x5618c15153a0 2024-09-15T22:21:13.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.836+0000 7f2d3feab740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5618c14772a0 con 0x5618c1515cc0 2024-09-15T22:21:13.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.836+0000 7f2d36ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 0x5618c1526e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.836+0000 7f2d377fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 0x5618c1524550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.836+0000 7f2d36ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 0x5618c1526e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50584/0 (socket says 172.21.15.45:50584) 2024-09-15T22:21:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.836+0000 7f2d36ffd640 1 -- 172.21.15.45:0/957535602 learned_addr learned my addr 172.21.15.45:0/957535602 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d37fff640 1 --2- 172.21.15.45:0/957535602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c15153a0 0x5618c1515780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d34ff9640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d200a33b0 0x7f2d200a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d36ffd640 1 -- 172.21.15.45:0/957535602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 msgr2=0x5618c1524550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d36ffd640 1 --2- 172.21.15.45:0/957535602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 0x5618c1524550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d36ffd640 1 -- 172.21.15.45:0/957535602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c15153a0 msgr2=0x5618c1515780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d36ffd640 1 --2- 172.21.15.45:0/957535602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c15153a0 0x5618c1515780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d36ffd640 1 -- 172.21.15.45:0/957535602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c1407440 con 0x5618c1524a90 2024-09-15T22:21:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d37fff640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d200a33b0 0x7f2d200a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d34ff9640 1 -- 172.21.15.45:0/588212878 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f2d280cf490 con 0x7f2d38102d30 2024-09-15T22:21:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d36ffd640 1 --2- 172.21.15.45:0/957535602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 0x5618c1526e80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2d380697d0 tx=0x7f2d2c031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2390b2e1572f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d1dffb640 1 -- 172.21.15.45:0/957535602 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c03f070 con 0x5618c1524a90 2024-09-15T22:21:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d37fff640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d200a33b0 0x7f2d200a5870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2d30008dc0 tx=0x7f2d30004a40 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d1dffb640 1 -- 172.21.15.45:0/957535602 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d2c0035f0 con 0x5618c1524a90 2024-09-15T22:21:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.837+0000 7f2d1dffb640 1 -- 172.21.15.45:0/957535602 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c035070 con 0x5618c1524a90 2024-09-15T22:21:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.838+0000 7f2d3feab740 1 -- 172.21.15.45:0/957535602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 msgr2=0x5618c1526e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.838+0000 7f2d3feab740 1 --2- 172.21.15.45:0/957535602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 0x5618c1526e80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2d380697d0 tx=0x7f2d2c031640 comp rx=0 tx=0).stop 2024-09-15T22:21:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.838+0000 7f2d3feab740 1 -- 172.21.15.45:0/957535602 shutdown_connections 2024-09-15T22:21:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.838+0000 7f2d3feab740 1 --2- 172.21.15.45:0/957535602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 0x5618c1526e80 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.838+0000 7f2d3feab740 1 --2- 172.21.15.45:0/957535602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 0x5618c1524550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.838+0000 7f2d3feab740 1 --2- 172.21.15.45:0/957535602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c15153a0 0x5618c1515780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.838+0000 7f2d3feab740 1 -- 172.21.15.45:0/957535602 >> 172.21.15.45:0/957535602 conn(0x5618c1511a30 msgr2=0x5618c1511e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.838+0000 7f2d3feab740 1 -- 172.21.15.45:0/957535602 shutdown_connections 2024-09-15T22:21:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.838+0000 7f2d3feab740 1 -- 172.21.15.45:0/957535602 wait complete. 2024-09-15T22:21:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.838+0000 7f2d3feab740 1 -- start start 2024-09-15T22:21:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d3feab740 1 Processor -- start 2024-09-15T22:21:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d3feab740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c15153a0 0x5618c15244b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d3feab740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 0x5618c1521760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d3feab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c1524a90 0x5618c1521d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d3feab740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5618c1527660 con 0x5618c15153a0 2024-09-15T22:21:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d3feab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5618c1436050 con 0x5618c1524a90 2024-09-15T22:21:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d3feab740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5618c15277e0 con 0x5618c1515cc0 2024-09-15T22:21:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d3feab740 10 client.0 _ll_register_callbacks cb 0x5618c1476160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c15153a0 0x5618c15244b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c15153a0 0x5618c15244b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50598/0 (socket says 172.21.15.45:50598) 2024-09-15T22:21:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d377fe640 1 -- 172.21.15.45:0/1087425346 learned_addr learned my addr 172.21.15.45:0/1087425346 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d36ffd640 1 --2- 172.21.15.45:0/1087425346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 0x5618c1521760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d377fe640 1 -- 172.21.15.45:0/1087425346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 msgr2=0x5618c1521760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:13.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d377fe640 1 --2- 172.21.15.45:0/1087425346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 0x5618c1521760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d377fe640 1 -- 172.21.15.45:0/1087425346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c1524a90 msgr2=0x5618c1521d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:13.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d37fff640 1 --2- 172.21.15.45:0/1087425346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c1524a90 0x5618c1521d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d377fe640 1 --2- 172.21.15.45:0/1087425346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c1524a90 0x5618c1521d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.839+0000 7f2d377fe640 1 -- 172.21.15.45:0/1087425346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618c11ec3c0 con 0x5618c15153a0 2024-09-15T22:21:13.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d377fe640 1 --2- 172.21.15.45:0/1087425346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c15153a0 0x5618c15244b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800be60 tx=0x7f2d28017f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59acbf63521e6d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:13.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:13.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d16ffd640 1 -- 172.21.15.45:0/1087425346 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2801e050 con 0x5618c15153a0 2024-09-15T22:21:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d16ffd640 1 -- 172.21.15.45:0/1087425346 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f2d280cf170 con 0x5618c15153a0 2024-09-15T22:21:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d3feab740 1 -- 172.21.15.45:0/1087425346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d2c0035f0 con 0x5618c15153a0 2024-09-15T22:21:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d16ffd640 1 -- 172.21.15.45:0/1087425346 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2d2809ae20 con 0x5618c15153a0 2024-09-15T22:21:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d3feab740 10 client.16341 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d3feab740 1 -- 172.21.15.45:0/1087425346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5618c1533130 con 0x5618c15153a0 2024-09-15T22:21:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d16ffd640 1 -- 172.21.15.45:0/1087425346 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d2c0035f0 con 0x5618c15153a0 2024-09-15T22:21:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d16ffd640 1 -- 172.21.15.45:0/1087425346 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2d280ccaa0 con 0x5618c15153a0 2024-09-15T22:21:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d3feab740 10 client.16341 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d3feab740 10 client.16341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d3feab740 20 client.16341 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d3feab740 1 --2- 172.21.15.45:0/1087425346 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5618c15345f0 0x5618c15369e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d3feab740 4 client.16341 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.840+0000 7f2d3feab740 1 -- 172.21.15.45:0/1087425346 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618c1488850 con 0x5618c15345f0 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.841+0000 7f2d36ffd640 1 --2- 172.21.15.45:0/1087425346 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5618c15345f0 0x5618c15369e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.841+0000 7f2d36ffd640 1 --2- 172.21.15.45:0/1087425346 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5618c15345f0 0x5618c15369e0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a9d7ea8895795a1 server_cookie=dd51bf6cce999004 in_seq=0 out_seq=0 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.841+0000 7f2d16ffd640 10 client.16341 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d16ffd640 1 -- 172.21.15.45:0/1087425346 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5618c1488850 con 0x5618c15345f0 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d16ffd640 10 client.16341 handle_command_reply: tid=0 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d3feab740 1 client.16341 shutdown 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d3feab740 1 -- 172.21.15.45:0/1087425346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c15153a0 msgr2=0x5618c15244b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d3feab740 1 --2- 172.21.15.45:0/1087425346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c15153a0 0x5618c15244b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800be60 tx=0x7f2d28017f60 comp rx=0 tx=0).stop 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d3feab740 1 -- 172.21.15.45:0/1087425346 shutdown_connections 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d3feab740 1 --2- 172.21.15.45:0/1087425346 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5618c15345f0 0x5618c15369e0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d3feab740 1 --2- 172.21.15.45:0/1087425346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c1524a90 0x5618c1521d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d3feab740 1 --2- 172.21.15.45:0/1087425346 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 0x5618c1521760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d3feab740 1 --2- 172.21.15.45:0/1087425346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c15153a0 0x5618c15244b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d16ffd640 0 client.16341 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:13.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d3feab740 1 -- 172.21.15.45:0/1087425346 >> 172.21.15.45:0/1087425346 conn(0x5618c1511a30 msgr2=0x5618c1517790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:13.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d3feab740 1 -- 172.21.15.45:0/1087425346 shutdown_connections 2024-09-15T22:21:13.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d3feab740 1 -- 172.21.15.45:0/1087425346 wait complete. 2024-09-15T22:21:13.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.842+0000 7f2d3feab740 20 client.16341 trim_cache size 0 max 16384 2024-09-15T22:21:13.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.860+0000 7f2d3feab740 1 Processor -- start 2024-09-15T22:21:13.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.860+0000 7f2d3feab740 1 -- start start 2024-09-15T22:21:13.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.860+0000 7f2d3feab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c15153a0 0x5618c1530900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.860+0000 7f2d3feab740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 0x5618c153c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.860+0000 7f2d3feab740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 0x5618c153c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.860+0000 7f2d3feab740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381aaee0 con 0x5618c1524a90 2024-09-15T22:21:13.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.860+0000 7f2d3feab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381ad760 con 0x5618c15153a0 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.860+0000 7f2d3feab740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381ab550 con 0x5618c1515cc0 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.860+0000 7f2d37fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 0x5618c153c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.860+0000 7f2d37fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 0x5618c153c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50608/0 (socket says 172.21.15.45:50608) 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.860+0000 7f2d37fff640 1 -- 172.21.15.45:0/224425576 learned_addr learned my addr 172.21.15.45:0/224425576 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.861+0000 7f2d36ffd640 1 --2- 172.21.15.45:0/224425576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 0x5618c153c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.861+0000 7f2d377fe640 1 --2- 172.21.15.45:0/224425576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c15153a0 0x5618c1530900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.861+0000 7f2d37fff640 1 -- 172.21.15.45:0/224425576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 msgr2=0x5618c153c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.861+0000 7f2d37fff640 1 --2- 172.21.15.45:0/224425576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 0x5618c153c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.861+0000 7f2d37fff640 1 -- 172.21.15.45:0/224425576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c15153a0 msgr2=0x5618c1530900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.861+0000 7f2d37fff640 1 --2- 172.21.15.45:0/224425576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c15153a0 0x5618c1530900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.861+0000 7f2d37fff640 1 -- 172.21.15.45:0/224425576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618c1515af0 con 0x5618c1524a90 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.861+0000 7f2d377fe640 1 --2- 172.21.15.45:0/224425576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c15153a0 0x5618c1530900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.861+0000 7f2d37fff640 1 --2- 172.21.15.45:0/224425576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 0x5618c153c780 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2d3001e560 tx=0x7f2d30013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f934d9141811cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.861+0000 7f2d1d7fa640 1 -- 172.21.15.45:0/224425576 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30012920 con 0x5618c1524a90 2024-09-15T22:21:13.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.861+0000 7f2d1d7fa640 1 -- 172.21.15.45:0/224425576 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d30027480 con 0x5618c1524a90 2024-09-15T22:21:13.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.861+0000 7f2d1d7fa640 1 -- 172.21.15.45:0/224425576 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3001b680 con 0x5618c1524a90 2024-09-15T22:21:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.862+0000 7f2d3feab740 1 -- 172.21.15.45:0/224425576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 msgr2=0x5618c153c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.862+0000 7f2d3feab740 1 --2- 172.21.15.45:0/224425576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 0x5618c153c780 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2d3001e560 tx=0x7f2d30013000 comp rx=0 tx=0).stop 2024-09-15T22:21:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.862+0000 7f2d3feab740 1 -- 172.21.15.45:0/224425576 shutdown_connections 2024-09-15T22:21:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.862+0000 7f2d3feab740 1 --2- 172.21.15.45:0/224425576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1524a90 0x5618c153c780 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.862+0000 7f2d3feab740 1 --2- 172.21.15.45:0/224425576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c1515cc0 0x5618c153c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.862+0000 7f2d3feab740 1 --2- 172.21.15.45:0/224425576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c15153a0 0x5618c1530900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.862+0000 7f2d3feab740 1 -- 172.21.15.45:0/224425576 >> 172.21.15.45:0/224425576 conn(0x5618c1511a30 msgr2=0x5618c151cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.862+0000 7f2d3feab740 1 -- 172.21.15.45:0/224425576 shutdown_connections 2024-09-15T22:21:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.862+0000 7f2d3feab740 1 -- 172.21.15.45:0/224425576 wait complete. 2024-09-15T22:21:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.862+0000 7f2d3feab740 1 -- start start 2024-09-15T22:21:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.863+0000 7f2d3feab740 1 Processor -- start 2024-09-15T22:21:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.863+0000 7f2d3feab740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c15153a0 0x5618c1528b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.863+0000 7f2d3feab740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1515cc0 0x5618c1529050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.863+0000 7f2d3feab740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c1524a90 0x5618c15295b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.863+0000 7f2d3feab740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381abc20 con 0x5618c1515cc0 2024-09-15T22:21:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.863+0000 7f2d3feab740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381ad090 con 0x5618c1524a90 2024-09-15T22:21:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.863+0000 7f2d3feab740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381ac2f0 con 0x5618c15153a0 2024-09-15T22:21:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.863+0000 7f2d3feab740 10 client.0 _ll_register_callbacks cb 0x7f2d280d2cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.863+0000 7f2d36ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1515cc0 0x5618c1529050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.863+0000 7f2d36ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1515cc0 0x5618c1529050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50610/0 (socket says 172.21.15.45:50610) 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.863+0000 7f2d36ffd640 1 -- 172.21.15.45:0/228132983 learned_addr learned my addr 172.21.15.45:0/228132983 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.863+0000 7f2d377fe640 1 --2- 172.21.15.45:0/228132983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c15153a0 0x5618c1528b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.863+0000 7f2d37fff640 1 --2- 172.21.15.45:0/228132983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c1524a90 0x5618c15295b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.864+0000 7f2d36ffd640 1 -- 172.21.15.45:0/228132983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c15153a0 msgr2=0x5618c1528b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.864+0000 7f2d36ffd640 1 --2- 172.21.15.45:0/228132983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c15153a0 0x5618c1528b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.864+0000 7f2d36ffd640 1 -- 172.21.15.45:0/228132983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c1524a90 msgr2=0x5618c15295b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.864+0000 7f2d36ffd640 1 --2- 172.21.15.45:0/228132983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c1524a90 0x5618c15295b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.864+0000 7f2d36ffd640 1 -- 172.21.15.45:0/228132983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618c159e4e0 con 0x5618c1515cc0 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.864+0000 7f2d36ffd640 1 --2- 172.21.15.45:0/228132983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1515cc0 0x5618c1529050 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c02a940 tx=0x7f2d2c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451bb829294414e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.864+0000 7f2d16ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.864+0000 7f2d16ffd640 1 -- 172.21.15.45:0/228132983 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c035040 con 0x5618c1515cc0 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.864+0000 7f2d16ffd640 1 -- 172.21.15.45:0/228132983 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f2d2c0042e0 con 0x5618c1515cc0 2024-09-15T22:21:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.864+0000 7f2d3feab740 1 -- 172.21.15.45:0/228132983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d30027480 con 0x5618c1515cc0 2024-09-15T22:21:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.864+0000 7f2d16ffd640 1 -- 172.21.15.45:0/228132983 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2d2c05f050 con 0x5618c1515cc0 2024-09-15T22:21:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.864+0000 7f2d3feab740 10 client.16347 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.864+0000 7f2d3feab740 1 -- 172.21.15.45:0/228132983 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5618c159f850 con 0x5618c1515cc0 2024-09-15T22:21:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.865+0000 7f2d16ffd640 1 -- 172.21.15.45:0/228132983 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d30027480 con 0x5618c1515cc0 2024-09-15T22:21:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.865+0000 7f2d16ffd640 1 -- 172.21.15.45:0/228132983 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2d2c004b40 con 0x5618c1515cc0 2024-09-15T22:21:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.865+0000 7f2d3feab740 10 client.16347 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.865+0000 7f2d3feab740 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.865+0000 7f2d3feab740 20 client.16347 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.865+0000 7f2d3feab740 1 --2- 172.21.15.45:0/228132983 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5618c159fb40 0x5618c15a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.865+0000 7f2d3feab740 4 client.16347 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:21:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.865+0000 7f2d3feab740 1 -- 172.21.15.45:0/228132983 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5618c1482d60 con 0x5618c159fb40 2024-09-15T22:21:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.865+0000 7f2d377fe640 1 --2- 172.21.15.45:0/228132983 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5618c159fb40 0x5618c15a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:13.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d377fe640 1 --2- 172.21.15.45:0/228132983 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5618c159fb40 0x5618c15a1f30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8052f8880d2bbe7c server_cookie=88a4c4f1506a985e in_seq=0 out_seq=0 2024-09-15T22:21:13.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d16ffd640 10 client.16347 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:13.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d16ffd640 1 -- 172.21.15.45:0/228132983 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5618c1482d60 con 0x5618c159fb40 2024-09-15T22:21:13.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d16ffd640 10 client.16347 handle_command_reply: tid=0 2024-09-15T22:21:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d3feab740 1 client.16347 shutdown 2024-09-15T22:21:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d3feab740 1 -- 172.21.15.45:0/228132983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1515cc0 msgr2=0x5618c1529050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d3feab740 1 --2- 172.21.15.45:0/228132983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1515cc0 0x5618c1529050 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c02a940 tx=0x7f2d2c02a420 comp rx=0 tx=0).stop 2024-09-15T22:21:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d3feab740 1 -- 172.21.15.45:0/228132983 shutdown_connections 2024-09-15T22:21:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d3feab740 1 --2- 172.21.15.45:0/228132983 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5618c159fb40 0x5618c15a1f30 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d3feab740 1 --2- 172.21.15.45:0/228132983 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5618c1524a90 0x5618c15295b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d3feab740 1 --2- 172.21.15.45:0/228132983 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5618c1515cc0 0x5618c1529050 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d3feab740 1 --2- 172.21.15.45:0/228132983 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5618c15153a0 0x5618c1528b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d3feab740 1 -- 172.21.15.45:0/228132983 >> 172.21.15.45:0/228132983 conn(0x5618c1511a30 msgr2=0x5618c1516f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d16ffd640 0 client.16347 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d3feab740 1 -- 172.21.15.45:0/228132983 shutdown_connections 2024-09-15T22:21:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d3feab740 1 -- 172.21.15.45:0/228132983 wait complete. 2024-09-15T22:21:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.866+0000 7f2d3feab740 20 client.16347 trim_cache size 0 max 16384 2024-09-15T22:21:13.873 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:21:13.873 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:21:13.873 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:21:13.873 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:21:13.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.867+0000 7f2d3dad2640 1 -- 172.21.15.45:0/588212878 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d200a33b0 msgr2=0x7f2d200a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:13.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.867+0000 7f2d3dad2640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d200a33b0 0x7f2d200a5870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2d30008dc0 tx=0x7f2d30004a40 comp rx=0 tx=0).stop 2024-09-15T22:21:13.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.867+0000 7f2d3dad2640 1 -- 172.21.15.45:0/588212878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d38102d30 msgr2=0x7f2d38198720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.867+0000 7f2d3dad2640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d38102d30 0x7f2d38198720 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800b4a0 tx=0x7f2d2800b960 comp rx=0 tx=0).stop 2024-09-15T22:21:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.867+0000 7f2d3dad2640 1 -- 172.21.15.45:0/588212878 shutdown_connections 2024-09-15T22:21:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.867+0000 7f2d3dad2640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d200a33b0 0x7f2d200a5870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.867+0000 7f2d3dad2640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d381082a0 0x7f2d3819cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.867+0000 7f2d3dad2640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d381036e0 0x7f2d38198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.867+0000 7f2d3dad2640 1 --2- 172.21.15.45:0/588212878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d38102d30 0x7f2d38198720 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.867+0000 7f2d3dad2640 1 -- 172.21.15.45:0/588212878 >> 172.21.15.45:0/588212878 conn(0x7f2d380fc7d0 msgr2=0x7f2d38105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.867+0000 7f2d3dad2640 1 -- 172.21.15.45:0/588212878 shutdown_connections 2024-09-15T22:21:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:13.867+0000 7f2d3dad2640 1 -- 172.21.15.45:0/588212878 wait complete. 2024-09-15T22:21:14.783 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:21:14.783 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:21:15.048 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:15.468 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:15 smithi045 ceph-mon[31180]: pgmap v153: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:21:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.547+0000 7f17b62e3640 1 -- 172.21.15.45:0/3223991835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17b0102790 msgr2=0x7f17b01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.547+0000 7f17b62e3640 1 --2- 172.21.15.45:0/3223991835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17b0102790 0x7f17b01067e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009900 tx=0x7f17a402a410 comp rx=0 tx=0).stop 2024-09-15T22:21:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.547+0000 7f17b62e3640 1 -- 172.21.15.45:0/3223991835 shutdown_connections 2024-09-15T22:21:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.547+0000 7f17b62e3640 1 --2- 172.21.15.45:0/3223991835 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17b0106f10 0x7f17b010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.547+0000 7f17b62e3640 1 --2- 172.21.15.45:0/3223991835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17b0102790 0x7f17b01067e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.547+0000 7f17b62e3640 1 --2- 172.21.15.45:0/3223991835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b0101de0 0x7f17b01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.547+0000 7f17b62e3640 1 -- 172.21.15.45:0/3223991835 >> 172.21.15.45:0/3223991835 conn(0x7f17b00fd8c0 msgr2=0x7f17b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.547+0000 7f17b62e3640 1 -- 172.21.15.45:0/3223991835 shutdown_connections 2024-09-15T22:21:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.547+0000 7f17b62e3640 1 -- 172.21.15.45:0/3223991835 wait complete. 2024-09-15T22:21:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.548+0000 7f17b62e3640 1 Processor -- start 2024-09-15T22:21:15.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.548+0000 7f17b62e3640 1 -- start start 2024-09-15T22:21:15.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.548+0000 7f17b62e3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b0101de0 0x7f17b01985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:15.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.548+0000 7f17b62e3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17b0102790 0x7f17b0198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:15.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.548+0000 7f17b62e3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17b0106f10 0x7f17b019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:15.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.548+0000 7f17b62e3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f17b01120d0 con 0x7f17b0102790 2024-09-15T22:21:15.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.548+0000 7f17b62e3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f17b0111f50 con 0x7f17b0101de0 2024-09-15T22:21:15.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.548+0000 7f17b62e3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f17b0112250 con 0x7f17b0106f10 2024-09-15T22:21:15.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.548+0000 7f17af7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17b0102790 0x7f17b0198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:15.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17af7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17b0102790 0x7f17b0198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37510/0 (socket says 172.21.15.45:37510) 2024-09-15T22:21:15.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17af7fe640 1 -- 172.21.15.45:0/4091496591 learned_addr learned my addr 172.21.15.45:0/4091496591 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:15.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17affff640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b0101de0 0x7f17b01985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:15.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17b4880640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17b0106f10 0x7f17b019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:15.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17af7fe640 1 -- 172.21.15.45:0/4091496591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17b0106f10 msgr2=0x7f17b019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:15.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17af7fe640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17b0106f10 0x7f17b019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:15.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17af7fe640 1 -- 172.21.15.45:0/4091496591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b0101de0 msgr2=0x7f17b01985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:15.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17af7fe640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b0101de0 0x7f17b01985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:15.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17af7fe640 1 -- 172.21.15.45:0/4091496591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b019d580 con 0x7f17b0102790 2024-09-15T22:21:15.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17af7fe640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17b0102790 0x7f17b0198b10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f17a4006010 tx=0x7f17a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:15.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17ad7fa640 1 -- 172.21.15.45:0/4091496591 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a403f030 con 0x7f17b0102790 2024-09-15T22:21:15.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17b62e3640 1 -- 172.21.15.45:0/4091496591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b019d810 con 0x7f17b0102790 2024-09-15T22:21:15.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17ad7fa640 1 -- 172.21.15.45:0/4091496591 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f17a4003d00 con 0x7f17b0102790 2024-09-15T22:21:15.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17ad7fa640 1 -- 172.21.15.45:0/4091496591 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4035070 con 0x7f17b0102790 2024-09-15T22:21:15.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.549+0000 7f17b62e3640 1 -- 172.21.15.45:0/4091496591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b01a5150 con 0x7f17b0102790 2024-09-15T22:21:15.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.550+0000 7f17b62e3640 1 -- 172.21.15.45:0/4091496591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b01032c0 con 0x7f17b0102790 2024-09-15T22:21:15.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.551+0000 7f17ad7fa640 1 -- 172.21.15.45:0/4091496591 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f17a4042030 con 0x7f17b0102790 2024-09-15T22:21:15.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.552+0000 7f17ad7fa640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f17980a33b0 0x7f17980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:15.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.552+0000 7f17ad7fa640 1 -- 172.21.15.45:0/4091496591 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f17a40f0750 con 0x7f17b0102790 2024-09-15T22:21:15.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.552+0000 7f17affff640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f17980a33b0 0x7f17980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:15.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.553+0000 7f17affff640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f17980a33b0 0x7f17980a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f17a000bbe0 tx=0x7f17a000b390 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:15.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.557+0000 7f17ad7fa640 1 -- 172.21.15.45:0/4091496591 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17a40bcdd0 con 0x7f17b0102790 2024-09-15T22:21:15.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:15 smithi165 ceph-mon[35551]: pgmap v153: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:21:15.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:15 smithi100 ceph-mon[35319]: pgmap v153: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:21:15.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.769+0000 7f17b62e3640 1 -- 172.21.15.45:0/4091496591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17b01a5320 con 0x7f17b0102790 2024-09-15T22:21:15.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.770+0000 7f17ad7fa640 1 -- 172.21.15.45:0/4091496591 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f17a40bc6d0 con 0x7f17b0102790 2024-09-15T22:21:15.772 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:21:15.772 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:21:15.773 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:21:15.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.772+0000 7f17b62e3640 1 -- 172.21.15.45:0/4091496591 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f17980a33b0 msgr2=0x7f17980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:15.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.772+0000 7f17b62e3640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f17980a33b0 0x7f17980a5870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f17a000bbe0 tx=0x7f17a000b390 comp rx=0 tx=0).stop 2024-09-15T22:21:15.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.772+0000 7f17b62e3640 1 -- 172.21.15.45:0/4091496591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17b0102790 msgr2=0x7f17b0198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:15.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.772+0000 7f17b62e3640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17b0102790 0x7f17b0198b10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f17a4006010 tx=0x7f17a40042f0 comp rx=0 tx=0).stop 2024-09-15T22:21:15.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.772+0000 7f17b62e3640 1 -- 172.21.15.45:0/4091496591 shutdown_connections 2024-09-15T22:21:15.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.772+0000 7f17b62e3640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f17980a33b0 0x7f17980a5870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:15.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.772+0000 7f17b62e3640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f17b0106f10 0x7f17b019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:15.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.772+0000 7f17b62e3640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17b0102790 0x7f17b0198b10 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:15.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.772+0000 7f17b62e3640 1 --2- 172.21.15.45:0/4091496591 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b0101de0 0x7f17b01985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.772+0000 7f17b62e3640 1 -- 172.21.15.45:0/4091496591 >> 172.21.15.45:0/4091496591 conn(0x7f17b00fd8c0 msgr2=0x7f17b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.773+0000 7f17b62e3640 1 -- 172.21.15.45:0/4091496591 shutdown_connections 2024-09-15T22:21:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:15.773+0000 7f17b62e3640 1 -- 172.21.15.45:0/4091496591 wait complete. 2024-09-15T22:21:16.499 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:16 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/4091496591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:21:16.544 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:21:16.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:16 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/4091496591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:21:16.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:16 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/4091496591' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:21:16.804 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:17.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.301+0000 7f6839958640 1 -- 172.21.15.45:0/1807739495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6834106a80 msgr2=0x7f6834106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:17.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.301+0000 7f6839958640 1 --2- 172.21.15.45:0/1807739495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6834106a80 0x7f6834106e60 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6824009930 tx=0x7f682402a420 comp rx=0 tx=0).stop 2024-09-15T22:21:17.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.301+0000 7f6839958640 1 -- 172.21.15.45:0/1807739495 shutdown_connections 2024-09-15T22:21:17.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.301+0000 7f6839958640 1 --2- 172.21.15.45:0/1807739495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6834101420 0x7f683410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.301+0000 7f6839958640 1 --2- 172.21.15.45:0/1807739495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6834100a80 0x7f6834100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.301+0000 7f6839958640 1 --2- 172.21.15.45:0/1807739495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6834106a80 0x7f6834106e60 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.301+0000 7f6839958640 1 -- 172.21.15.45:0/1807739495 >> 172.21.15.45:0/1807739495 conn(0x7f68340fc7a0 msgr2=0x7f68340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:17.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.301+0000 7f6839958640 1 -- 172.21.15.45:0/1807739495 shutdown_connections 2024-09-15T22:21:17.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.301+0000 7f6839958640 1 -- 172.21.15.45:0/1807739495 wait complete. 2024-09-15T22:21:17.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.302+0000 7f6839958640 1 Processor -- start 2024-09-15T22:21:17.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.302+0000 7f6839958640 1 -- start start 2024-09-15T22:21:17.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.302+0000 7f6839958640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6834100a80 0x7f6834198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.302+0000 7f6839958640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6834101420 0x7f6834198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.302+0000 7f6839958640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6834106a80 0x7f683419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.302+0000 7f6839958640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6834110fa0 con 0x7f6834100a80 2024-09-15T22:21:17.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.302+0000 7f6839958640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6834110e20 con 0x7f6834106a80 2024-09-15T22:21:17.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.302+0000 7f6839958640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6834111120 con 0x7f6834101420 2024-09-15T22:21:17.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.302+0000 7f6832ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6834100a80 0x7f6834198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.302+0000 7f6832ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6834100a80 0x7f6834198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37526/0 (socket says 172.21.15.45:37526) 2024-09-15T22:21:17.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.302+0000 7f6832ffd640 1 -- 172.21.15.45:0/825380027 learned_addr learned my addr 172.21.15.45:0/825380027 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:17.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.302+0000 7f68327fc640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6834101420 0x7f6834198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.303+0000 7f68337fe640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6834106a80 0x7f683419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.303+0000 7f6832ffd640 1 -- 172.21.15.45:0/825380027 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6834101420 msgr2=0x7f6834198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:17.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.303+0000 7f6832ffd640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6834101420 0x7f6834198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.303+0000 7f6832ffd640 1 -- 172.21.15.45:0/825380027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6834106a80 msgr2=0x7f683419ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:17.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.303+0000 7f6832ffd640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6834106a80 0x7f683419ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.303+0000 7f6832ffd640 1 -- 172.21.15.45:0/825380027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683419d4f0 con 0x7f6834100a80 2024-09-15T22:21:17.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.303+0000 7f68337fe640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6834106a80 0x7f683419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:17.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.303+0000 7f6832ffd640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6834100a80 0x7f6834198540 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6824009230 tx=0x7f6824004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.303+0000 7f6838956640 1 -- 172.21.15.45:0/825380027 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682403f030 con 0x7f6834100a80 2024-09-15T22:21:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.303+0000 7f6838956640 1 -- 172.21.15.45:0/825380027 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6824003af0 con 0x7f6834100a80 2024-09-15T22:21:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.303+0000 7f6839958640 1 -- 172.21.15.45:0/825380027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683419d780 con 0x7f6834100a80 2024-09-15T22:21:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.303+0000 7f6838956640 1 -- 172.21.15.45:0/825380027 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6824035070 con 0x7f6834100a80 2024-09-15T22:21:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.303+0000 7f6839958640 1 -- 172.21.15.45:0/825380027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68341a50c0 con 0x7f6834100a80 2024-09-15T22:21:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.306+0000 7f6838956640 1 -- 172.21.15.45:0/825380027 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6824042030 con 0x7f6834100a80 2024-09-15T22:21:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.306+0000 7f683bd31740 1 Processor -- start 2024-09-15T22:21:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.306+0000 7f683bd31740 1 -- start start 2024-09-15T22:21:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f683bd31740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced4af50 0x55d1ced494a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f6838956640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f681c0a33b0 0x7f681c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f683bd31740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 0x55d1ced49e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f683bd31740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 0x55d1ced56b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f683bd31740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d1cecab2f0 con 0x55d1ced54780 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f683bd31740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d1cec52cf0 con 0x55d1ced499e0 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f683bd31740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d1ceca72b0 con 0x55d1ced4af50 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f68337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 0x55d1ced56b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f6832ffd640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f681c0a33b0 0x7f681c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f68337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 0x55d1ced56b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37528/0 (socket says 172.21.15.45:37528) 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f68337fe640 1 -- 172.21.15.45:0/1728045394 learned_addr learned my addr 172.21.15.45:0/1728045394 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f6838956640 1 -- 172.21.15.45:0/825380027 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f68240f0980 con 0x7f6834100a80 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f68337fe640 1 --2- 172.21.15.45:0/1728045394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced4af50 0x55d1ced494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f68327fc640 1 --2- 172.21.15.45:0/1728045394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 0x55d1ced49e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f68337fe640 1 -- 172.21.15.45:0/1728045394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced4af50 msgr2=0x55d1ced494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f68337fe640 1 --2- 172.21.15.45:0/1728045394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced4af50 0x55d1ced494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f68337fe640 1 -- 172.21.15.45:0/1728045394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 msgr2=0x55d1ced49e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f68337fe640 1 --2- 172.21.15.45:0/1728045394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 0x55d1ced49e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f6832ffd640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f681c0a33b0 0x7f681c0a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68240b8dc0 tx=0x7f68240b8560 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f68337fe640 1 -- 172.21.15.45:0/1728045394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1cec373a0 con 0x55d1ced54780 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.307+0000 7f68337fe640 1 --2- 172.21.15.45:0/1728045394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 0x55d1ced56b70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f682c0147d0 tx=0x7f682c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04866e76199abf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.308+0000 7f6819ffb640 1 -- 172.21.15.45:0/1728045394 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c01a030 con 0x55d1ced54780 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.308+0000 7f6819ffb640 1 -- 172.21.15.45:0/1728045394 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f682c014e10 con 0x55d1ced54780 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.308+0000 7f6819ffb640 1 -- 172.21.15.45:0/1728045394 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c005450 con 0x55d1ced54780 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.308+0000 7f683bd31740 1 -- 172.21.15.45:0/1728045394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 msgr2=0x55d1ced56b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.308+0000 7f683bd31740 1 --2- 172.21.15.45:0/1728045394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 0x55d1ced56b70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f682c0147d0 tx=0x7f682c009920 comp rx=0 tx=0).stop 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.308+0000 7f683bd31740 1 -- 172.21.15.45:0/1728045394 shutdown_connections 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.308+0000 7f683bd31740 1 --2- 172.21.15.45:0/1728045394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 0x55d1ced56b70 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.308+0000 7f683bd31740 1 --2- 172.21.15.45:0/1728045394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 0x55d1ced49e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.308+0000 7f683bd31740 1 --2- 172.21.15.45:0/1728045394 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced4af50 0x55d1ced494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.308+0000 7f683bd31740 1 -- 172.21.15.45:0/1728045394 >> 172.21.15.45:0/1728045394 conn(0x55d1ced0e310 msgr2=0x55d1ced46070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.308+0000 7f683bd31740 1 -- 172.21.15.45:0/1728045394 shutdown_connections 2024-09-15T22:21:17.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.308+0000 7f683bd31740 1 -- 172.21.15.45:0/1728045394 wait complete. 2024-09-15T22:21:17.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.309+0000 7f683bd31740 1 -- start start 2024-09-15T22:21:17.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.309+0000 7f683bd31740 1 Processor -- start 2024-09-15T22:21:17.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.309+0000 7f683bd31740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced499e0 0x55d1ced54170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.309+0000 7f683bd31740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced4af50 0x55d1ced51420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.309+0000 7f683bd31740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 0x55d1ced51a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.309+0000 7f683bd31740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d1ced57480 con 0x55d1ced54780 2024-09-15T22:21:17.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.309+0000 7f683bd31740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d1cec66060 con 0x55d1ced4af50 2024-09-15T22:21:17.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.309+0000 7f683bd31740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d1ced57600 con 0x55d1ced499e0 2024-09-15T22:21:17.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.309+0000 7f683bd31740 10 client.0 _ll_register_callbacks cb 0x55d1ce9b98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:17.393 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:21:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.309+0000 7f68337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 0x55d1ced51a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f68337fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 0x55d1ced51a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37530/0 (socket says 172.21.15.45:37530) 2024-09-15T22:21:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f68337fe640 1 -- 172.21.15.45:0/1510359278 learned_addr learned my addr 172.21.15.45:0/1510359278 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f68327fc640 1 --2- 172.21.15.45:0/1510359278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced4af50 0x55d1ced51420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f68337fe640 1 --2- 172.21.15.45:0/1510359278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced499e0 0x55d1ced54170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f68337fe640 1 -- 172.21.15.45:0/1510359278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced499e0 msgr2=0x55d1ced54170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:17.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f68337fe640 1 --2- 172.21.15.45:0/1510359278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced499e0 0x55d1ced54170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f68337fe640 1 -- 172.21.15.45:0/1510359278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced4af50 msgr2=0x55d1ced51420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f68337fe640 1 --2- 172.21.15.45:0/1510359278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced4af50 0x55d1ced51420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f68337fe640 1 -- 172.21.15.45:0/1510359278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1cea1c3c0 con 0x55d1ced54780 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f68337fe640 1 --2- 172.21.15.45:0/1510359278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 0x55d1ced51a10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f682c002230 tx=0x7f682c009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8369f6e33626b97 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f6812ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f6812ffd640 1 -- 172.21.15.45:0/1510359278 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f682c023020 con 0x55d1ced54780 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f6812ffd640 1 -- 172.21.15.45:0/1510359278 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f682c002030 con 0x55d1ced54780 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f683bd31740 1 -- 172.21.15.45:0/1510359278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f682c014e10 con 0x55d1ced54780 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f6812ffd640 1 -- 172.21.15.45:0/1510359278 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f682c034050 con 0x55d1ced54780 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f683bd31740 10 client.16365 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.310+0000 7f683bd31740 1 -- 172.21.15.45:0/1510359278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d1ced62f20 con 0x55d1ced54780 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.311+0000 7f6812ffd640 1 -- 172.21.15.45:0/1510359278 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f682c014e10 con 0x55d1ced54780 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.311+0000 7f6812ffd640 1 -- 172.21.15.45:0/1510359278 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f682c00f040 con 0x55d1ced54780 2024-09-15T22:21:17.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.311+0000 7f683bd31740 10 client.16365 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.311+0000 7f683bd31740 10 client.16365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.311+0000 7f683bd31740 20 client.16365 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.311+0000 7f683bd31740 1 --2- 172.21.15.45:0/1510359278 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d1ced64320 0x55d1ced66710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.311+0000 7f683bd31740 4 client.16365 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.311+0000 7f683bd31740 1 -- 172.21.15.45:0/1510359278 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1cecb8860 con 0x55d1ced64320 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.311+0000 7f68327fc640 1 --2- 172.21.15.45:0/1510359278 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d1ced64320 0x55d1ced66710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f6812ffd640 10 client.16365 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f68327fc640 1 --2- 172.21.15.45:0/1510359278 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d1ced64320 0x55d1ced66710 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39fda1958d00f47f server_cookie=1a0fe7442bf143b0 in_seq=0 out_seq=0 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f6812ffd640 1 -- 172.21.15.45:0/1510359278 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d1cecb8860 con 0x55d1ced64320 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f6812ffd640 10 client.16365 handle_command_reply: tid=0 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f683bd31740 1 client.16365 shutdown 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f683bd31740 1 -- 172.21.15.45:0/1510359278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 msgr2=0x55d1ced51a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f683bd31740 1 --2- 172.21.15.45:0/1510359278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 0x55d1ced51a10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f682c002230 tx=0x7f682c009280 comp rx=0 tx=0).stop 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f683bd31740 1 -- 172.21.15.45:0/1510359278 shutdown_connections 2024-09-15T22:21:17.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f683bd31740 1 --2- 172.21.15.45:0/1510359278 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d1ced64320 0x55d1ced66710 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f683bd31740 1 --2- 172.21.15.45:0/1510359278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced54780 0x55d1ced51a10 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f683bd31740 1 --2- 172.21.15.45:0/1510359278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced4af50 0x55d1ced51420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f683bd31740 1 --2- 172.21.15.45:0/1510359278 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced499e0 0x55d1ced54170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f6812ffd640 0 client.16365 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.312+0000 7f683bd31740 1 -- 172.21.15.45:0/1510359278 >> 172.21.15.45:0/1510359278 conn(0x55d1ced0e310 msgr2=0x55d1ced4bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.313+0000 7f683bd31740 1 -- 172.21.15.45:0/1510359278 shutdown_connections 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.313+0000 7f683bd31740 1 -- 172.21.15.45:0/1510359278 wait complete. 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.313+0000 7f683bd31740 20 client.16365 trim_cache size 0 max 16384 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.328+0000 7f683bd31740 1 Processor -- start 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.328+0000 7f683bd31740 1 -- start start 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.328+0000 7f683bd31740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 0x55d1ced46130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.328+0000 7f683bd31740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 0x55d1ced60720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.328+0000 7f683bd31740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced54780 0x55d1ced6bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.328+0000 7f683bd31740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f68341aaf00 con 0x55d1ced4af50 2024-09-15T22:21:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.328+0000 7f683bd31740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f68341ad780 con 0x55d1ced499e0 2024-09-15T22:21:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.328+0000 7f683bd31740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f68341ab570 con 0x55d1ced54780 2024-09-15T22:21:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.328+0000 7f68327fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 0x55d1ced60720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.328+0000 7f68327fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 0x55d1ced60720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37538/0 (socket says 172.21.15.45:37538) 2024-09-15T22:21:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.328+0000 7f68327fc640 1 -- 172.21.15.45:0/1179758646 learned_addr learned my addr 172.21.15.45:0/1179758646 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.328+0000 7f68337fe640 1 --2- 172.21.15.45:0/1179758646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 0x55d1ced46130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.329+0000 7f68337fe640 1 --2- 172.21.15.45:0/1179758646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced54780 0x55d1ced6bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.329+0000 7f68327fc640 1 -- 172.21.15.45:0/1179758646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced54780 msgr2=0x55d1ced6bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.329+0000 7f68327fc640 1 --2- 172.21.15.45:0/1179758646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced54780 0x55d1ced6bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.329+0000 7f68327fc640 1 -- 172.21.15.45:0/1179758646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 msgr2=0x55d1ced46130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.329+0000 7f68327fc640 1 --2- 172.21.15.45:0/1179758646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 0x55d1ced46130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.329+0000 7f68327fc640 1 -- 172.21.15.45:0/1179758646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1ced544e0 con 0x55d1ced4af50 2024-09-15T22:21:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.329+0000 7f68337fe640 1 --2- 172.21.15.45:0/1179758646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 0x55d1ced46130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:21:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.329+0000 7f68327fc640 1 --2- 172.21.15.45:0/1179758646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 0x55d1ced60720 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x55d1ced54750 tx=0x7f682800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f9fcee46b180a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.329+0000 7f68197fa640 1 -- 172.21.15.45:0/1179758646 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828003d00 con 0x55d1ced4af50 2024-09-15T22:21:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.329+0000 7f68197fa640 1 -- 172.21.15.45:0/1179758646 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6828005520 con 0x55d1ced4af50 2024-09-15T22:21:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.329+0000 7f68197fa640 1 -- 172.21.15.45:0/1179758646 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828026460 con 0x55d1ced4af50 2024-09-15T22:21:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.330+0000 7f683bd31740 1 -- 172.21.15.45:0/1179758646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 msgr2=0x55d1ced60720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.330+0000 7f683bd31740 1 --2- 172.21.15.45:0/1179758646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 0x55d1ced60720 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x55d1ced54750 tx=0x7f682800b390 comp rx=0 tx=0).stop 2024-09-15T22:21:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.330+0000 7f683bd31740 1 -- 172.21.15.45:0/1179758646 shutdown_connections 2024-09-15T22:21:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.330+0000 7f683bd31740 1 --2- 172.21.15.45:0/1179758646 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced54780 0x55d1ced6bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.330+0000 7f683bd31740 1 --2- 172.21.15.45:0/1179758646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 0x55d1ced60720 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.330+0000 7f683bd31740 1 --2- 172.21.15.45:0/1179758646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 0x55d1ced46130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.330+0000 7f683bd31740 1 -- 172.21.15.45:0/1179758646 >> 172.21.15.45:0/1179758646 conn(0x55d1ced0e310 msgr2=0x55d1ced45a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:17.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.330+0000 7f683bd31740 1 -- 172.21.15.45:0/1179758646 shutdown_connections 2024-09-15T22:21:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.330+0000 7f683bd31740 1 -- 172.21.15.45:0/1179758646 wait complete. 2024-09-15T22:21:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.330+0000 7f683bd31740 1 -- start start 2024-09-15T22:21:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.330+0000 7f683bd31740 1 Processor -- start 2024-09-15T22:21:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f683bd31740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 0x55d1ced5c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f683bd31740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 0x55d1ced5cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f683bd31740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced54780 0x55d1ced4d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f683bd31740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f68341abc40 con 0x55d1ced4af50 2024-09-15T22:21:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f683bd31740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f68341ad0b0 con 0x55d1ced499e0 2024-09-15T22:21:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f683bd31740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f68341ac310 con 0x55d1ced54780 2024-09-15T22:21:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f683bd31740 10 client.0 _ll_register_callbacks cb 0x7f682800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f68327fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 0x55d1ced5cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f68327fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 0x55d1ced5cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37550/0 (socket says 172.21.15.45:37550) 2024-09-15T22:21:17.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f68327fc640 1 -- 172.21.15.45:0/621855904 learned_addr learned my addr 172.21.15.45:0/621855904 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f68337fe640 1 --2- 172.21.15.45:0/621855904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced54780 0x55d1ced4d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f68337fe640 1 --2- 172.21.15.45:0/621855904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 0x55d1ced5c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f68327fc640 1 -- 172.21.15.45:0/621855904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced54780 msgr2=0x55d1ced4d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f68327fc640 1 --2- 172.21.15.45:0/621855904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced54780 0x55d1ced4d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f68327fc640 1 -- 172.21.15.45:0/621855904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 msgr2=0x55d1ced5c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f68327fc640 1 --2- 172.21.15.45:0/621855904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 0x55d1ced5c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f68327fc640 1 -- 172.21.15.45:0/621855904 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1ced5d440 con 0x55d1ced4af50 2024-09-15T22:21:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f68327fc640 1 --2- 172.21.15.45:0/621855904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 0x55d1ced5cdd0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6828004c50 tx=0x7f6828004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a3a506e0c10044 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f6812ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.331+0000 7f6812ffd640 1 -- 172.21.15.45:0/621855904 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828004730 con 0x55d1ced4af50 2024-09-15T22:21:17.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.332+0000 7f6812ffd640 1 -- 172.21.15.45:0/621855904 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f68280048d0 con 0x55d1ced4af50 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.332+0000 7f683bd31740 1 -- 172.21.15.45:0/621855904 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6828005520 con 0x55d1ced4af50 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.332+0000 7f6812ffd640 1 -- 172.21.15.45:0/621855904 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6828038050 con 0x55d1ced4af50 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.332+0000 7f683bd31740 10 client.16371 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.332+0000 7f683bd31740 1 -- 172.21.15.45:0/621855904 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d1cedce1b0 con 0x55d1ced4af50 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.332+0000 7f6812ffd640 1 -- 172.21.15.45:0/621855904 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6828005520 con 0x55d1ced4af50 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.332+0000 7f6812ffd640 1 -- 172.21.15.45:0/621855904 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f68280269f0 con 0x55d1ced4af50 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.332+0000 7f683bd31740 10 client.16371 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.332+0000 7f683bd31740 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.332+0000 7f683bd31740 20 client.16371 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.332+0000 7f683bd31740 1 --2- 172.21.15.45:0/621855904 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d1cedce7c0 0x55d1cedd0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.332+0000 7f683bd31740 4 client.16371 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.332+0000 7f683bd31740 1 -- 172.21.15.45:0/621855904 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d1cecb2d70 con 0x55d1cedce7c0 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f68337fe640 1 --2- 172.21.15.45:0/621855904 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d1cedce7c0 0x55d1cedd0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:17.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f6812ffd640 10 client.16371 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f68337fe640 1 --2- 172.21.15.45:0/621855904 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d1cedce7c0 0x55d1cedd0bb0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b63ef4fee596a76 server_cookie=ce1b8debad99aae in_seq=0 out_seq=0 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f6812ffd640 1 -- 172.21.15.45:0/621855904 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d1cecb2d70 con 0x55d1cedce7c0 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f6812ffd640 10 client.16371 handle_command_reply: tid=0 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f683bd31740 1 client.16371 shutdown 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f683bd31740 1 -- 172.21.15.45:0/621855904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 msgr2=0x55d1ced5cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f683bd31740 1 --2- 172.21.15.45:0/621855904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 0x55d1ced5cdd0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6828004c50 tx=0x7f6828004180 comp rx=0 tx=0).stop 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f683bd31740 1 -- 172.21.15.45:0/621855904 shutdown_connections 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f683bd31740 1 --2- 172.21.15.45:0/621855904 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d1cedce7c0 0x55d1cedd0bb0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f683bd31740 1 --2- 172.21.15.45:0/621855904 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d1ced54780 0x55d1ced4d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f683bd31740 1 --2- 172.21.15.45:0/621855904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1ced4af50 0x55d1ced5cdd0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f683bd31740 1 --2- 172.21.15.45:0/621855904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d1ced499e0 0x55d1ced5c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f6812ffd640 0 client.16371 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.333+0000 7f683bd31740 1 -- 172.21.15.45:0/621855904 >> 172.21.15.45:0/621855904 conn(0x55d1ced0e310 msgr2=0x55d1ced4fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:17.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f683bd31740 1 -- 172.21.15.45:0/621855904 shutdown_connections 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f683bd31740 1 -- 172.21.15.45:0/621855904 wait complete. 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f683bd31740 20 client.16371 trim_cache size 0 max 16384 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f6839958640 1 -- 172.21.15.45:0/825380027 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f681c0a33b0 msgr2=0x7f681c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f6839958640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f681c0a33b0 0x7f681c0a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f68240b8dc0 tx=0x7f68240b8560 comp rx=0 tx=0).stop 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f6839958640 1 -- 172.21.15.45:0/825380027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6834100a80 msgr2=0x7f6834198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f6839958640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6834100a80 0x7f6834198540 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6824009230 tx=0x7f6824004270 comp rx=0 tx=0).stop 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f6839958640 1 -- 172.21.15.45:0/825380027 shutdown_connections 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f6839958640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f681c0a33b0 0x7f681c0a5870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f6839958640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6834106a80 0x7f683419ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f6839958640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6834101420 0x7f6834198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f6839958640 1 --2- 172.21.15.45:0/825380027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6834100a80 0x7f6834198540 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f6839958640 1 -- 172.21.15.45:0/825380027 >> 172.21.15.45:0/825380027 conn(0x7f68340fc7a0 msgr2=0x7f683406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f6839958640 1 -- 172.21.15.45:0/825380027 shutdown_connections 2024-09-15T22:21:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:17.334+0000 7f6839958640 1 -- 172.21.15.45:0/825380027 wait complete. 2024-09-15T22:21:17.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:17 smithi045 ceph-mon[31180]: pgmap v154: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:21:17.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:17 smithi165 ceph-mon[35551]: pgmap v154: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:21:17.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:17 smithi100 ceph-mon[35319]: pgmap v154: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-15T22:21:19.224 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:21:19.225 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:21:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:19.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:19 smithi045 ceph-mon[31180]: pgmap v155: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:21:19.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:19 smithi165 ceph-mon[35551]: pgmap v155: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:21:19.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:19 smithi100 ceph-mon[35319]: pgmap v155: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:21:20.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.988+0000 7fc4b94c5640 1 -- 172.21.15.45:0/1002907173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4b410c170 msgr2=0x7fc4b410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:20.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.988+0000 7fc4b94c5640 1 --2- 172.21.15.45:0/1002907173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4b410c170 0x7fc4b410e610 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009ca0 tx=0x7fc4ac02a950 comp rx=0 tx=0).stop 2024-09-15T22:21:20.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.988+0000 7fc4b94c5640 1 -- 172.21.15.45:0/1002907173 shutdown_connections 2024-09-15T22:21:20.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.988+0000 7fc4b94c5640 1 --2- 172.21.15.45:0/1002907173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4b410c170 0x7fc4b410e610 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.988+0000 7fc4b94c5640 1 --2- 172.21.15.45:0/1002907173 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b4103660 0x7fc4b410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.988+0000 7fc4b94c5640 1 --2- 172.21.15.45:0/1002907173 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4b4102d40 0x7fc4b4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.988+0000 7fc4b94c5640 1 -- 172.21.15.45:0/1002907173 >> 172.21.15.45:0/1002907173 conn(0x7fc4b40fc7a0 msgr2=0x7fc4b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:20.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.988+0000 7fc4b94c5640 1 -- 172.21.15.45:0/1002907173 shutdown_connections 2024-09-15T22:21:20.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.988+0000 7fc4b94c5640 1 -- 172.21.15.45:0/1002907173 wait complete. 2024-09-15T22:21:20.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.989+0000 7fc4b94c5640 1 Processor -- start 2024-09-15T22:21:20.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.989+0000 7fc4b94c5640 1 -- start start 2024-09-15T22:21:20.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.989+0000 7fc4b94c5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4b4102d40 0x7fc4b41009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.989+0000 7fc4b94c5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4b4103660 0x7fc4b4100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.989+0000 7fc4b94c5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b410c170 0x7fc4b4101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.989+0000 7fc4b94c5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b41120f0 con 0x7fc4b4102d40 2024-09-15T22:21:20.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.989+0000 7fc4b94c5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b4111f70 con 0x7fc4b4103660 2024-09-15T22:21:20.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.989+0000 7fc4b94c5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b4112270 con 0x7fc4b410c170 2024-09-15T22:21:20.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.989+0000 7fc4b2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4b4102d40 0x7fc4b41009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.989+0000 7fc4b2ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4b4102d40 0x7fc4b41009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37574/0 (socket says 172.21.15.45:37574) 2024-09-15T22:21:20.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc4b2ffd640 1 -- 172.21.15.45:0/2689283246 learned_addr learned my addr 172.21.15.45:0/2689283246 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:20.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc4b27fc640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4b4103660 0x7fc4b4100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b410c170 0x7fc4b4101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc4b2ffd640 1 -- 172.21.15.45:0/2689283246 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b410c170 msgr2=0x7fc4b4101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:20.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc4b2ffd640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b410c170 0x7fc4b4101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc4b2ffd640 1 -- 172.21.15.45:0/2689283246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4b4103660 msgr2=0x7fc4b4100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:20.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc4b2ffd640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4b4103660 0x7fc4b4100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc4b2ffd640 1 -- 172.21.15.45:0/2689283246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b41a69f0 con 0x7fc4b4102d40 2024-09-15T22:21:20.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc4b2ffd640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4b4102d40 0x7fc4b41009a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400d950 tx=0x7fc4a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:20.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc49bfff640 1 -- 172.21.15.45:0/2689283246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4017070 con 0x7fc4b4102d40 2024-09-15T22:21:20.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc4b94c5640 1 -- 172.21.15.45:0/2689283246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b41a6ce0 con 0x7fc4b4102d40 2024-09-15T22:21:20.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc49bfff640 1 -- 172.21.15.45:0/2689283246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc4a4009c30 con 0x7fc4b4102d40 2024-09-15T22:21:20.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc49bfff640 1 -- 172.21.15.45:0/2689283246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a400f740 con 0x7fc4b4102d40 2024-09-15T22:21:20.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.990+0000 7fc4b94c5640 1 -- 172.21.15.45:0/2689283246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b41a7210 con 0x7fc4b4102d40 2024-09-15T22:21:20.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc49bfff640 1 -- 172.21.15.45:0/2689283246 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc4a4010a80 con 0x7fc4b4102d40 2024-09-15T22:21:20.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc4bb89e740 1 Processor -- start 2024-09-15T22:21:20.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc4bb89e740 1 -- start start 2024-09-15T22:21:20.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc4bb89e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56553385ab60 0x56553385af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc4bb89e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385b480 0x565533865800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc4bb89e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565533865d40 0x565533868130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc4bb89e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5655337c0280 con 0x56553385ab60 2024-09-15T22:21:20.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc4bb89e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x565533767b10 con 0x565533865d40 2024-09-15T22:21:20.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc4bb89e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5655337bc240 con 0x56553385b480 2024-09-15T22:21:20.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc4b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56553385ab60 0x56553385af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc4b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56553385ab60 0x56553385af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37576/0 (socket says 172.21.15.45:37576) 2024-09-15T22:21:20.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc4b37fe640 1 -- 172.21.15.45:0/869169378 learned_addr learned my addr 172.21.15.45:0/869169378 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc4b27fc640 1 --2- 172.21.15.45:0/869169378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565533865d40 0x565533868130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.993+0000 7fc4b2ffd640 1 --2- 172.21.15.45:0/869169378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385b480 0x565533865800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.994+0000 7fc49bfff640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc49c0a33b0 0x7fc49c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.994+0000 7fc4b37fe640 1 -- 172.21.15.45:0/869169378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385b480 msgr2=0x565533865800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.994+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/869169378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385b480 0x565533865800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.994+0000 7fc4b37fe640 1 -- 172.21.15.45:0/869169378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565533865d40 msgr2=0x565533868130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.994+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/869169378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565533865d40 0x565533868130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.994+0000 7fc4b37fe640 1 -- 172.21.15.45:0/869169378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655337741f0 con 0x56553385ab60 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.994+0000 7fc4b2ffd640 1 --2- 172.21.15.45:0/869169378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385b480 0x565533865800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.994+0000 7fc49bfff640 1 -- 172.21.15.45:0/2689283246 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fc4a40cfdd0 con 0x7fc4b4102d40 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.994+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc49c0a33b0 0x7fc49c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.994+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/869169378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56553385ab60 0x56553385af40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009880 tx=0x7fc4ac0098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7aecb040a6d8b5a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.994+0000 7fc4997fa640 1 -- 172.21.15.45:0/869169378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac034050 con 0x56553385ab60 2024-09-15T22:21:20.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.994+0000 7fc4997fa640 1 -- 172.21.15.45:0/869169378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc4ac004040 con 0x56553385ab60 2024-09-15T22:21:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.994+0000 7fc4997fa640 1 -- 172.21.15.45:0/869169378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0306a0 con 0x56553385ab60 2024-09-15T22:21:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.995+0000 7fc4bb89e740 1 -- 172.21.15.45:0/869169378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56553385ab60 msgr2=0x56553385af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.995+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/869169378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56553385ab60 0x56553385af40 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009880 tx=0x7fc4ac0098b0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.995+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc49c0a33b0 0x7fc49c0a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac048000 tx=0x7fc4ac049000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.995+0000 7fc4bb89e740 1 -- 172.21.15.45:0/869169378 shutdown_connections 2024-09-15T22:21:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.995+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/869169378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x565533865d40 0x565533868130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.995+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/869169378 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385b480 0x565533865800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.995+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/869169378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56553385ab60 0x56553385af40 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.995+0000 7fc4bb89e740 1 -- 172.21.15.45:0/869169378 >> 172.21.15.45:0/869169378 conn(0x5655338570f0 msgr2=0x5655338574d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.995+0000 7fc4bb89e740 1 -- 172.21.15.45:0/869169378 shutdown_connections 2024-09-15T22:21:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.995+0000 7fc4bb89e740 1 -- 172.21.15.45:0/869169378 wait complete. 2024-09-15T22:21:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.995+0000 7fc4bb89e740 1 -- start start 2024-09-15T22:21:20.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.995+0000 7fc4bb89e740 1 Processor -- start 2024-09-15T22:21:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4bb89e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 0x565533862b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4bb89e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 0x5655338630c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4bb89e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x565533863600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4bb89e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x565533868910 con 0x565533865d40 2024-09-15T22:21:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4bb89e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56553377af10 con 0x56553385b480 2024-09-15T22:21:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4bb89e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x565533868a90 con 0x56553385ab60 2024-09-15T22:21:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4bb89e740 10 client.0 _ll_register_callbacks cb 0x565533743a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x565533863600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x565533863600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37578/0 (socket says 172.21.15.45:37578) 2024-09-15T22:21:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4b37fe640 1 -- 172.21.15.45:0/3471427442 learned_addr learned my addr 172.21.15.45:0/3471427442 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4b27fc640 1 --2- 172.21.15.45:0/3471427442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 0x5655338630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4b2ffd640 1 --2- 172.21.15.45:0/3471427442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 0x565533862b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4b37fe640 1 -- 172.21.15.45:0/3471427442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 msgr2=0x565533862b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/3471427442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 0x565533862b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4b37fe640 1 -- 172.21.15.45:0/3471427442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 msgr2=0x5655338630c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/3471427442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 0x5655338630c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4b37fe640 1 -- 172.21.15.45:0/3471427442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5655335316a0 con 0x565533865d40 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/3471427442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x565533863600 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac004450 tx=0x7fc4ac004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ec224557cd37be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc496ff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc496ff5640 1 -- 172.21.15.45:0/3471427442 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac034070 con 0x565533865d40 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.996+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3471427442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4ac004040 con 0x565533865d40 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.997+0000 7fc496ff5640 1 -- 172.21.15.45:0/3471427442 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fc4ac050690 con 0x565533865d40 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.997+0000 7fc496ff5640 1 -- 172.21.15.45:0/3471427442 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc4ac062050 con 0x565533865d40 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.997+0000 7fc4bb89e740 10 client.16383 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.997+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3471427442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x565533868910 con 0x565533865d40 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.997+0000 7fc496ff5640 1 -- 172.21.15.45:0/3471427442 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc4ac004040 con 0x565533865d40 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.997+0000 7fc496ff5640 1 -- 172.21.15.45:0/3471427442 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc4ac059630 con 0x565533865d40 2024-09-15T22:21:20.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.997+0000 7fc4bb89e740 10 client.16383 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.997+0000 7fc4bb89e740 10 client.16383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.997+0000 7fc4bb89e740 20 client.16383 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.997+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/3471427442 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x565533875630 0x565533877a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.997+0000 7fc4bb89e740 4 client.16383 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.997+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3471427442 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5655337cd7f0 con 0x565533875630 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.998+0000 7fc4b2ffd640 1 --2- 172.21.15.45:0/3471427442 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x565533875630 0x565533877a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.998+0000 7fc4b2ffd640 1 --2- 172.21.15.45:0/3471427442 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x565533875630 0x565533877a20 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b5d4ba1c6ac30f6 server_cookie=24b04fc8d3cb5263 in_seq=0 out_seq=0 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.998+0000 7fc496ff5640 10 client.16383 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc496ff5640 1 -- 172.21.15.45:0/3471427442 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5655337cd7f0 con 0x565533875630 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc496ff5640 10 client.16383 handle_command_reply: tid=0 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc4bb89e740 1 client.16383 shutdown 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3471427442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 msgr2=0x565533863600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/3471427442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x565533863600 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac004450 tx=0x7fc4ac004480 comp rx=0 tx=0).stop 2024-09-15T22:21:20.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3471427442 shutdown_connections 2024-09-15T22:21:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/3471427442 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x565533875630 0x565533877a20 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/3471427442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x565533863600 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/3471427442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 0x5655338630c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/3471427442 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 0x565533862b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3471427442 >> 172.21.15.45:0/3471427442 conn(0x5655338570f0 msgr2=0x565533856270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc496ff5640 0 client.16383 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3471427442 shutdown_connections 2024-09-15T22:21:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3471427442 wait complete. 2024-09-15T22:21:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:19.999+0000 7fc4bb89e740 20 client.16383 trim_cache size 0 max 16384 2024-09-15T22:21:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.016+0000 7fc4bb89e740 1 Processor -- start 2024-09-15T22:21:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.016+0000 7fc4bb89e740 1 -- start start 2024-09-15T22:21:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.016+0000 7fc4bb89e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 0x56553385d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.016+0000 7fc4bb89e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 0x5655338649e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.016+0000 7fc4bb89e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x56553387d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.016+0000 7fc4bb89e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b41af360 con 0x565533865d40 2024-09-15T22:21:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.016+0000 7fc4bb89e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b41b1be0 con 0x56553385b480 2024-09-15T22:21:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.016+0000 7fc4bb89e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b41af9d0 con 0x56553385ab60 2024-09-15T22:21:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.016+0000 7fc4b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x56553387d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.016+0000 7fc4b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x56553387d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37592/0 (socket says 172.21.15.45:37592) 2024-09-15T22:21:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.016+0000 7fc4b37fe640 1 -- 172.21.15.45:0/548592071 learned_addr learned my addr 172.21.15.45:0/548592071 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc4b2ffd640 1 --2- 172.21.15.45:0/548592071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 0x56553385d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc4b27fc640 1 --2- 172.21.15.45:0/548592071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 0x5655338649e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc4b37fe640 1 -- 172.21.15.45:0/548592071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 msgr2=0x56553385d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/548592071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 0x56553385d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc4b37fe640 1 -- 172.21.15.45:0/548592071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 msgr2=0x5655338649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:20.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/548592071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 0x5655338649e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc4b37fe640 1 -- 172.21.15.45:0/548592071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565533856f20 con 0x565533865d40 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc4b2ffd640 1 --2- 172.21.15.45:0/548592071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 0x56553385d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/548592071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x56553387d200 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac004420 tx=0x7fc4ac005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbdf4f1a3421a18 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc498ff9640 1 -- 172.21.15.45:0/548592071 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac034070 con 0x565533865d40 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc498ff9640 1 -- 172.21.15.45:0/548592071 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc4ac054070 con 0x565533865d40 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc498ff9640 1 -- 172.21.15.45:0/548592071 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac050850 con 0x565533865d40 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc4bb89e740 1 -- 172.21.15.45:0/548592071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 msgr2=0x56553387d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.017+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/548592071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x56553387d200 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac004420 tx=0x7fc4ac005d80 comp rx=0 tx=0).stop 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 -- 172.21.15.45:0/548592071 shutdown_connections 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/548592071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x56553387d200 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/548592071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 0x5655338649e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/548592071 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 0x56553385d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 -- 172.21.15.45:0/548592071 >> 172.21.15.45:0/548592071 conn(0x5655338570f0 msgr2=0x5655338642d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 -- 172.21.15.45:0/548592071 shutdown_connections 2024-09-15T22:21:20.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 -- 172.21.15.45:0/548592071 wait complete. 2024-09-15T22:21:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 -- start start 2024-09-15T22:21:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 Processor -- start 2024-09-15T22:21:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 0x56553386e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 0x565533869750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x565533869c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b41b00a0 con 0x565533865d40 2024-09-15T22:21:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b41b1510 con 0x56553385b480 2024-09-15T22:21:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b41b0770 con 0x56553385ab60 2024-09-15T22:21:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4bb89e740 10 client.0 _ll_register_callbacks cb 0x7fc4ac047020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x565533869c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4b37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x565533869c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37600/0 (socket says 172.21.15.45:37600) 2024-09-15T22:21:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.018+0000 7fc4b37fe640 1 -- 172.21.15.45:0/3830185124 learned_addr learned my addr 172.21.15.45:0/3830185124 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:20.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc4b27fc640 1 --2- 172.21.15.45:0/3830185124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 0x565533869750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc4b2ffd640 1 --2- 172.21.15.45:0/3830185124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 0x56553386e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc4b37fe640 1 -- 172.21.15.45:0/3830185124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 msgr2=0x56553386e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/3830185124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 0x56553386e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc4b37fe640 1 -- 172.21.15.45:0/3830185124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 msgr2=0x565533869750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/3830185124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 0x565533869750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc4b37fe640 1 -- 172.21.15.45:0/3830185124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56553386a490 con 0x565533865d40 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc4b37fe640 1 --2- 172.21.15.45:0/3830185124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x565533869c90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac059b70 tx=0x7fc4ac02afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22bd2fc6da4f670 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc496ff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc496ff5640 1 -- 172.21.15.45:0/3830185124 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac034070 con 0x565533865d40 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc496ff5640 1 -- 172.21.15.45:0/3830185124 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fc4ac05f070 con 0x565533865d40 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3830185124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4ac054070 con 0x565533865d40 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc496ff5640 1 -- 172.21.15.45:0/3830185124 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc4ac077050 con 0x565533865d40 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc4bb89e740 10 client.16389 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:20.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3830185124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5655338e0150 con 0x565533865d40 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc496ff5640 1 -- 172.21.15.45:0/3830185124 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc4ac054070 con 0x565533865d40 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.019+0000 7fc496ff5640 1 -- 172.21.15.45:0/3830185124 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc4ac050bc0 con 0x565533865d40 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.020+0000 7fc4bb89e740 10 client.16389 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.020+0000 7fc4bb89e740 10 client.16389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.020+0000 7fc4bb89e740 20 client.16389 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.020+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/3830185124 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5655338e0760 0x5655338e2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.020+0000 7fc4bb89e740 4 client.16389 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.020+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3830185124 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5655337c7d00 con 0x5655338e0760 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.020+0000 7fc4b2ffd640 1 --2- 172.21.15.45:0/3830185124 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5655338e0760 0x5655338e2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.020+0000 7fc496ff5640 10 client.16389 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.020+0000 7fc4b2ffd640 1 --2- 172.21.15.45:0/3830185124 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5655338e0760 0x5655338e2b50 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92d3fd64ebf45059 server_cookie=3d26541c4a20f01 in_seq=0 out_seq=0 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.021+0000 7fc496ff5640 1 -- 172.21.15.45:0/3830185124 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5655337c7d00 con 0x5655338e0760 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.021+0000 7fc496ff5640 10 client.16389 handle_command_reply: tid=0 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.021+0000 7fc4bb89e740 1 client.16389 shutdown 2024-09-15T22:21:20.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.021+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3830185124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 msgr2=0x565533869c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.021+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/3830185124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x565533869c90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac059b70 tx=0x7fc4ac02afd0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3830185124 shutdown_connections 2024-09-15T22:21:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/3830185124 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5655338e0760 0x5655338e2b50 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/3830185124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565533865d40 0x565533869c90 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/3830185124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56553385b480 0x565533869750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4bb89e740 1 --2- 172.21.15.45:0/3830185124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56553385ab60 0x56553386e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.063 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:21:20.063 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:21:20.063 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "93d87daa-30fb-45d9-8545-1412b76a1182", 2024-09-15T22:21:20.063 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:21:20.064 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:21:20.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3830185124 >> 172.21.15.45:0/3830185124 conn(0x5655338570f0 msgr2=0x565533856270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:20.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc496ff5640 0 client.16389 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:20.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3830185124 shutdown_connections 2024-09-15T22:21:20.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4bb89e740 1 -- 172.21.15.45:0/3830185124 wait complete. 2024-09-15T22:21:20.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4bb89e740 20 client.16389 trim_cache size 0 max 16384 2024-09-15T22:21:20.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4b94c5640 1 -- 172.21.15.45:0/2689283246 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc49c0a33b0 msgr2=0x7fc49c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:20.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4b94c5640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc49c0a33b0 0x7fc49c0a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac048000 tx=0x7fc4ac049000 comp rx=0 tx=0).stop 2024-09-15T22:21:20.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4b94c5640 1 -- 172.21.15.45:0/2689283246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4b4102d40 msgr2=0x7fc4b41009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:20.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4b94c5640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4b4102d40 0x7fc4b41009a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400d950 tx=0x7fc4a400de10 comp rx=0 tx=0).stop 2024-09-15T22:21:20.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4b94c5640 1 -- 172.21.15.45:0/2689283246 shutdown_connections 2024-09-15T22:21:20.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4b94c5640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc49c0a33b0 0x7fc49c0a5870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4b94c5640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc4b410c170 0x7fc4b4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4b94c5640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4b4103660 0x7fc4b4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4b94c5640 1 --2- 172.21.15.45:0/2689283246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4b4102d40 0x7fc4b41009a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:20.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.022+0000 7fc4b94c5640 1 -- 172.21.15.45:0/2689283246 >> 172.21.15.45:0/2689283246 conn(0x7fc4b40fc7a0 msgr2=0x7fc4b40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:20.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.023+0000 7fc4b94c5640 1 -- 172.21.15.45:0/2689283246 shutdown_connections 2024-09-15T22:21:20.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:20.023+0000 7fc4b94c5640 1 -- 172.21.15.45:0/2689283246 wait complete. 2024-09-15T22:21:20.638 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:20 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:21:20.638 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:20 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:21:20.638 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:20 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:21:20.638 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:20 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:21:20.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:20 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:21:20.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:20 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:21:20.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:20 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:21:20.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:20 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:21:20.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:20 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:21:20.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:20 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:21:20.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:20 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:21:20.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:20 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:21:20.892 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:21:21.149 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:21.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:21 smithi045 ceph-mon[31180]: pgmap v156: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T22:21:21.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.665+0000 7f333349b640 1 -- 172.21.15.45:0/2475021892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f332c074590 msgr2=0x7f332c074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:21.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.665+0000 7f333349b640 1 --2- 172.21.15.45:0/2475021892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f332c074590 0x7f332c074970 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3328009900 tx=0x7f332802a480 comp rx=0 tx=0).stop 2024-09-15T22:21:21.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.666+0000 7f333349b640 1 -- 172.21.15.45:0/2475021892 shutdown_connections 2024-09-15T22:21:21.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.666+0000 7f333349b640 1 --2- 172.21.15.45:0/2475021892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f332c112b90 0x7f332c114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.666+0000 7f333349b640 1 --2- 172.21.15.45:0/2475021892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f332c074eb0 0x7f332c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.666+0000 7f333349b640 1 --2- 172.21.15.45:0/2475021892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f332c074590 0x7f332c074970 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.666+0000 7f333349b640 1 -- 172.21.15.45:0/2475021892 >> 172.21.15.45:0/2475021892 conn(0x7f332c0fd8c0 msgr2=0x7f332c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:21.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.666+0000 7f333349b640 1 -- 172.21.15.45:0/2475021892 shutdown_connections 2024-09-15T22:21:21.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.666+0000 7f333349b640 1 -- 172.21.15.45:0/2475021892 wait complete. 2024-09-15T22:21:21.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.666+0000 7f333349b640 1 Processor -- start 2024-09-15T22:21:21.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.666+0000 7f333349b640 1 -- start start 2024-09-15T22:21:21.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f333349b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f332c074590 0x7f332c1a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f333349b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f332c074eb0 0x7f332c1a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f333349b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f332c112b90 0x7f332c19e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f333349b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f332c118670 con 0x7f332c112b90 2024-09-15T22:21:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f333349b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1184f0 con 0x7f332c074eb0 2024-09-15T22:21:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f333349b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1187f0 con 0x7f332c074590 2024-09-15T22:21:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f3331a38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f332c112b90 0x7f332c19e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f3331a38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f332c112b90 0x7f332c19e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37620/0 (socket says 172.21.15.45:37620) 2024-09-15T22:21:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f3331a38640 1 -- 172.21.15.45:0/1586725907 learned_addr learned my addr 172.21.15.45:0/1586725907 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f3330a36640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f332c074eb0 0x7f332c1a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f3331237640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f332c074590 0x7f332c1a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f3331a38640 1 -- 172.21.15.45:0/1586725907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f332c074590 msgr2=0x7f332c1a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f3331a38640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f332c074590 0x7f332c1a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f3331a38640 1 -- 172.21.15.45:0/1586725907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f332c074eb0 msgr2=0x7f332c1a4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f3331a38640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f332c074eb0 0x7f332c1a4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f3331a38640 1 -- 172.21.15.45:0/1586725907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f332c19f090 con 0x7f332c112b90 2024-09-15T22:21:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.667+0000 7f3331a38640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f332c112b90 0x7f332c19e960 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f332400cad0 tx=0x7f332400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.668+0000 7f33227fc640 1 -- 172.21.15.45:0/1586725907 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332400ae20 con 0x7f332c112b90 2024-09-15T22:21:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.668+0000 7f333349b640 1 -- 172.21.15.45:0/1586725907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f332c19f380 con 0x7f332c112b90 2024-09-15T22:21:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.668+0000 7f33227fc640 1 -- 172.21.15.45:0/1586725907 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3324004030 con 0x7f332c112b90 2024-09-15T22:21:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.668+0000 7f33227fc640 1 -- 172.21.15.45:0/1586725907 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332401d060 con 0x7f332c112b90 2024-09-15T22:21:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.668+0000 7f333349b640 1 -- 172.21.15.45:0/1586725907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f332c1ab670 con 0x7f332c112b90 2024-09-15T22:21:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.670+0000 7f33227fc640 1 -- 172.21.15.45:0/1586725907 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f33240041e0 con 0x7f332c112b90 2024-09-15T22:21:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.670+0000 7f3335874740 1 Processor -- start 2024-09-15T22:21:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.670+0000 7f3335874740 1 -- start start 2024-09-15T22:21:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3335874740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d804a0 0x55e7b0d80880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3335874740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d8b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3335874740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d8b680 0x55e7b0d8da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3335874740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e7b0ce62e0 con 0x55e7b0d80dc0 2024-09-15T22:21:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3335874740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e7b0c8dce0 con 0x55e7b0d804a0 2024-09-15T22:21:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3335874740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e7b0ce22a0 con 0x55e7b0d8b680 2024-09-15T22:21:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f33227fc640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f33180a33b0 0x7f33180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3331237640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d8b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3331237640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d8b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37630/0 (socket says 172.21.15.45:37630) 2024-09-15T22:21:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3331237640 1 -- 172.21.15.45:0/2988285688 learned_addr learned my addr 172.21.15.45:0/2988285688 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3330a36640 1 --2- 172.21.15.45:0/2988285688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d804a0 0x55e7b0d80880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3331a38640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f33180a33b0 0x7f33180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3330a36640 1 --2- 172.21.15.45:0/2988285688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d8b680 0x55e7b0d8da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f33227fc640 1 -- 172.21.15.45:0/1586725907 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f33240d0370 con 0x7f332c112b90 2024-09-15T22:21:21.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3331237640 1 -- 172.21.15.45:0/2988285688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d8b680 msgr2=0x55e7b0d8da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3331237640 1 --2- 172.21.15.45:0/2988285688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d8b680 0x55e7b0d8da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3331237640 1 -- 172.21.15.45:0/2988285688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d804a0 msgr2=0x55e7b0d80880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3331237640 1 --2- 172.21.15.45:0/2988285688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d804a0 0x55e7b0d80880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3331237640 1 -- 172.21.15.45:0/2988285688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7b0c72440 con 0x55e7b0d80dc0 2024-09-15T22:21:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3331237640 1 --2- 172.21.15.45:0/2988285688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d8b140 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3328009900 tx=0x7f3328031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e362bfc9c2b3481f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.671+0000 7f3331a38640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f33180a33b0 0x7f33180a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f33240cd700 tx=0x7f3324091770 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.672+0000 7f33177fe640 1 -- 172.21.15.45:0/2988285688 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328040070 con 0x55e7b0d80dc0 2024-09-15T22:21:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.672+0000 7f33177fe640 1 -- 172.21.15.45:0/2988285688 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3328005020 con 0x55e7b0d80dc0 2024-09-15T22:21:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.672+0000 7f33177fe640 1 -- 172.21.15.45:0/2988285688 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328035040 con 0x55e7b0d80dc0 2024-09-15T22:21:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.672+0000 7f3335874740 1 -- 172.21.15.45:0/2988285688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d80dc0 msgr2=0x55e7b0d8b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.672+0000 7f3335874740 1 --2- 172.21.15.45:0/2988285688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d8b140 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3328009900 tx=0x7f3328031770 comp rx=0 tx=0).stop 2024-09-15T22:21:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.672+0000 7f3335874740 1 -- 172.21.15.45:0/2988285688 shutdown_connections 2024-09-15T22:21:21.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.672+0000 7f3335874740 1 --2- 172.21.15.45:0/2988285688 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d8b680 0x55e7b0d8da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.672+0000 7f3335874740 1 --2- 172.21.15.45:0/2988285688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d8b140 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.672+0000 7f3335874740 1 --2- 172.21.15.45:0/2988285688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d804a0 0x55e7b0d80880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.672+0000 7f3335874740 1 -- 172.21.15.45:0/2988285688 >> 172.21.15.45:0/2988285688 conn(0x55e7b0d7ca30 msgr2=0x55e7b0d7ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.673+0000 7f3335874740 1 -- 172.21.15.45:0/2988285688 shutdown_connections 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.673+0000 7f3335874740 1 -- 172.21.15.45:0/2988285688 wait complete. 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.673+0000 7f3335874740 1 -- start start 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.673+0000 7f3335874740 1 Processor -- start 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.673+0000 7f3335874740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d804a0 0x55e7b0d8af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.673+0000 7f3335874740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d881d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.673+0000 7f3335874740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d8b680 0x55e7b0d88710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.673+0000 7f3335874740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e7b0d8e250 con 0x55e7b0d804a0 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.673+0000 7f3335874740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e7b0ca1050 con 0x55e7b0d8b680 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3335874740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e7b0d8e3d0 con 0x55e7b0d80dc0 2024-09-15T22:21:21.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3335874740 10 client.0 _ll_register_callbacks cb 0x55e7b0ce1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3330a36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d804a0 0x55e7b0d8af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3330a36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d804a0 0x55e7b0d8af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37642/0 (socket says 172.21.15.45:37642) 2024-09-15T22:21:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3330a36640 1 -- 172.21.15.45:0/1247335589 learned_addr learned my addr 172.21.15.45:0/1247335589 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3331237640 1 --2- 172.21.15.45:0/1247335589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d881d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3330a36640 1 --2- 172.21.15.45:0/1247335589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d8b680 0x55e7b0d88710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3330a36640 1 -- 172.21.15.45:0/1247335589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d80dc0 msgr2=0x55e7b0d881d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3330a36640 1 --2- 172.21.15.45:0/1247335589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d881d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3330a36640 1 -- 172.21.15.45:0/1247335589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d8b680 msgr2=0x55e7b0d88710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3330a36640 1 --2- 172.21.15.45:0/1247335589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d8b680 0x55e7b0d88710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3330a36640 1 -- 172.21.15.45:0/1247335589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7b0a573c0 con 0x55e7b0d804a0 2024-09-15T22:21:21.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3330a36640 1 --2- 172.21.15.45:0/1247335589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d804a0 0x55e7b0d8af20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f331c010f70 tx=0x7f331c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbe2e6e40bc66fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3314ff9640 1 -- 172.21.15.45:0/1247335589 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c004020 con 0x55e7b0d804a0 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3314ff9640 1 -- 172.21.15.45:0/1247335589 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f331c0041c0 con 0x55e7b0d804a0 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.674+0000 7f3335874740 1 -- 172.21.15.45:0/1247335589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3328005020 con 0x55e7b0d804a0 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.675+0000 7f3314ff9640 1 -- 172.21.15.45:0/1247335589 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f331c029050 con 0x55e7b0d804a0 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.675+0000 7f3335874740 10 client.16401 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.675+0000 7f3335874740 1 -- 172.21.15.45:0/1247335589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e7b0d99bd0 con 0x55e7b0d804a0 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.675+0000 7f3314ff9640 1 -- 172.21.15.45:0/1247335589 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3328005020 con 0x55e7b0d804a0 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.675+0000 7f3314ff9640 1 -- 172.21.15.45:0/1247335589 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f331c01e4e0 con 0x55e7b0d804a0 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.675+0000 7f3335874740 10 client.16401 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.675+0000 7f3335874740 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.675+0000 7f3335874740 20 client.16401 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.675+0000 7f3335874740 1 --2- 172.21.15.45:0/1247335589 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e7b0d9b090 0x55e7b0d9d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.675+0000 7f3335874740 4 client.16401 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.675+0000 7f3335874740 1 -- 172.21.15.45:0/1247335589 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7b0cf3850 con 0x55e7b0d9b090 2024-09-15T22:21:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.675+0000 7f3331237640 1 --2- 172.21.15.45:0/1247335589 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e7b0d9b090 0x55e7b0d9d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.676+0000 7f3331237640 1 --2- 172.21.15.45:0/1247335589 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e7b0d9b090 0x55e7b0d9d480 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d40cfacff01de41 server_cookie=3e7174d79b9711ca in_seq=0 out_seq=0 2024-09-15T22:21:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.676+0000 7f3314ff9640 10 client.16401 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.676+0000 7f3314ff9640 1 -- 172.21.15.45:0/1247335589 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7b0cf3850 con 0x55e7b0d9b090 2024-09-15T22:21:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.676+0000 7f3314ff9640 10 client.16401 handle_command_reply: tid=0 2024-09-15T22:21:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.676+0000 7f3335874740 1 client.16401 shutdown 2024-09-15T22:21:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.677+0000 7f3335874740 1 -- 172.21.15.45:0/1247335589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d804a0 msgr2=0x55e7b0d8af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.677+0000 7f3335874740 1 --2- 172.21.15.45:0/1247335589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d804a0 0x55e7b0d8af20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f331c010f70 tx=0x7f331c004730 comp rx=0 tx=0).stop 2024-09-15T22:21:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.677+0000 7f3335874740 1 -- 172.21.15.45:0/1247335589 shutdown_connections 2024-09-15T22:21:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.677+0000 7f3335874740 1 --2- 172.21.15.45:0/1247335589 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e7b0d9b090 0x55e7b0d9d480 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.677+0000 7f3314ff9640 0 client.16401 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.677+0000 7f3335874740 1 --2- 172.21.15.45:0/1247335589 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d8b680 0x55e7b0d88710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.677+0000 7f3335874740 1 --2- 172.21.15.45:0/1247335589 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d881d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.677+0000 7f3335874740 1 --2- 172.21.15.45:0/1247335589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d804a0 0x55e7b0d8af20 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.677+0000 7f3335874740 1 -- 172.21.15.45:0/1247335589 >> 172.21.15.45:0/1247335589 conn(0x55e7b0d7ca30 msgr2=0x55e7b0d7bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:21.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.677+0000 7f3335874740 1 -- 172.21.15.45:0/1247335589 shutdown_connections 2024-09-15T22:21:21.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.677+0000 7f3335874740 1 -- 172.21.15.45:0/1247335589 wait complete. 2024-09-15T22:21:21.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.677+0000 7f3335874740 20 client.16401 trim_cache size 0 max 16384 2024-09-15T22:21:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.694+0000 7f3335874740 1 Processor -- start 2024-09-15T22:21:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.694+0000 7f3335874740 1 -- start start 2024-09-15T22:21:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.694+0000 7f3335874740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d804a0 0x55e7b0d974b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3335874740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d7ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3335874740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 0x55e7b0d836d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3335874740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1b37d0 con 0x55e7b0d8b680 2024-09-15T22:21:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3335874740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1b6050 con 0x55e7b0d80dc0 2024-09-15T22:21:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3335874740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1b3e40 con 0x55e7b0d804a0 2024-09-15T22:21:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3330a36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 0x55e7b0d836d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3330a36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 0x55e7b0d836d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37650/0 (socket says 172.21.15.45:37650) 2024-09-15T22:21:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3330a36640 1 -- 172.21.15.45:0/2839916748 learned_addr learned my addr 172.21.15.45:0/2839916748 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3330a36640 1 --2- 172.21.15.45:0/2839916748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d804a0 0x55e7b0d974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3331237640 1 --2- 172.21.15.45:0/2839916748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d7ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3330a36640 1 -- 172.21.15.45:0/2839916748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d804a0 msgr2=0x55e7b0d974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3330a36640 1 --2- 172.21.15.45:0/2839916748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d804a0 0x55e7b0d974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3330a36640 1 -- 172.21.15.45:0/2839916748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d80dc0 msgr2=0x55e7b0d7ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3330a36640 1 --2- 172.21.15.45:0/2839916748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d7ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3330a36640 1 -- 172.21.15.45:0/2839916748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7b0d9d7f0 con 0x55e7b0d8b680 2024-09-15T22:21:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3330a36640 1 --2- 172.21.15.45:0/2839916748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 0x55e7b0d836d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f331c00fca0 tx=0x7f331c012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca302daf19512178 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3316ffd640 1 -- 172.21.15.45:0/2839916748 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c00a2d0 con 0x55e7b0d8b680 2024-09-15T22:21:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3316ffd640 1 -- 172.21.15.45:0/2839916748 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f331c01ead0 con 0x55e7b0d8b680 2024-09-15T22:21:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.695+0000 7f3316ffd640 1 -- 172.21.15.45:0/2839916748 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c0047a0 con 0x55e7b0d8b680 2024-09-15T22:21:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.696+0000 7f3335874740 1 -- 172.21.15.45:0/2839916748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 msgr2=0x55e7b0d836d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.696+0000 7f3335874740 1 --2- 172.21.15.45:0/2839916748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 0x55e7b0d836d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f331c00fca0 tx=0x7f331c012040 comp rx=0 tx=0).stop 2024-09-15T22:21:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.696+0000 7f3335874740 1 -- 172.21.15.45:0/2839916748 shutdown_connections 2024-09-15T22:21:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.696+0000 7f3335874740 1 --2- 172.21.15.45:0/2839916748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 0x55e7b0d836d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.696+0000 7f3335874740 1 --2- 172.21.15.45:0/2839916748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d7ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.696+0000 7f3335874740 1 --2- 172.21.15.45:0/2839916748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d804a0 0x55e7b0d974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.696+0000 7f3335874740 1 -- 172.21.15.45:0/2839916748 >> 172.21.15.45:0/2839916748 conn(0x55e7b0d7ca30 msgr2=0x55e7b0d82fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.696+0000 7f3335874740 1 -- 172.21.15.45:0/2839916748 shutdown_connections 2024-09-15T22:21:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.696+0000 7f3335874740 1 -- 172.21.15.45:0/2839916748 wait complete. 2024-09-15T22:21:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.696+0000 7f3335874740 1 -- start start 2024-09-15T22:21:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.697+0000 7f3335874740 1 Processor -- start 2024-09-15T22:21:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.697+0000 7f3335874740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d804a0 0x55e7b0d93d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.697+0000 7f3335874740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d8f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.697+0000 7f3335874740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 0x55e7b0d8f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.697+0000 7f3335874740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1b4510 con 0x55e7b0d8b680 2024-09-15T22:21:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.697+0000 7f3335874740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1b5980 con 0x55e7b0d804a0 2024-09-15T22:21:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.697+0000 7f3335874740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f332c1b4be0 con 0x55e7b0d80dc0 2024-09-15T22:21:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.697+0000 7f3335874740 10 client.0 _ll_register_callbacks cb 0x7f331c00ac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.697+0000 7f3330a36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 0x55e7b0d8f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.697+0000 7f3330a36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 0x55e7b0d8f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37660/0 (socket says 172.21.15.45:37660) 2024-09-15T22:21:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.697+0000 7f3330a36640 1 -- 172.21.15.45:0/2389709105 learned_addr learned my addr 172.21.15.45:0/2389709105 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.697+0000 7f3330a36640 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d804a0 0x55e7b0d93d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.697+0000 7f3331237640 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d8f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3330a36640 1 -- 172.21.15.45:0/2389709105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d80dc0 msgr2=0x55e7b0d8f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3330a36640 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d8f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3330a36640 1 -- 172.21.15.45:0/2389709105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d804a0 msgr2=0x55e7b0d93d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3330a36640 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d804a0 0x55e7b0d93d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3330a36640 1 -- 172.21.15.45:0/2389709105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7b0d8fd70 con 0x55e7b0d8b680 2024-09-15T22:21:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3331237640 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d8f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3330a36640 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 0x55e7b0d8f590 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f331c010fd0 tx=0x7f331c005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63482e8ea2ed09f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3314ff9640 1 -- 172.21.15.45:0/2389709105 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c034040 con 0x55e7b0d8b680 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3314ff9640 1 -- 172.21.15.45:0/2389709105 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f331c01e360 con 0x55e7b0d8b680 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3335874740 1 -- 172.21.15.45:0/2389709105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f331c01ead0 con 0x55e7b0d8b680 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3314ff9640 1 -- 172.21.15.45:0/2389709105 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f331c00a360 con 0x55e7b0d8b680 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3335874740 10 client.16407 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3335874740 1 -- 172.21.15.45:0/2389709105 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e7b0e05c90 con 0x55e7b0d8b680 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3314ff9640 1 -- 172.21.15.45:0/2389709105 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f331c01ead0 con 0x55e7b0d8b680 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.698+0000 7f3314ff9640 1 -- 172.21.15.45:0/2389709105 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f331c03a030 con 0x55e7b0d8b680 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.699+0000 7f3335874740 10 client.16407 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.699+0000 7f3335874740 10 client.16407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.699+0000 7f3335874740 20 client.16407 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.699+0000 7f3335874740 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e7b0d9b090 0x55e7b0e082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.699+0000 7f3335874740 4 client.16407 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:21:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.699+0000 7f3335874740 1 -- 172.21.15.45:0/2389709105 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e7b0cedd60 con 0x55e7b0d9b090 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.699+0000 7f3331237640 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e7b0d9b090 0x55e7b0e082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.699+0000 7f3331237640 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e7b0d9b090 0x55e7b0e082e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e673e1a369f9a249 server_cookie=3efb8a19ec61fd6b in_seq=0 out_seq=0 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.699+0000 7f3314ff9640 10 client.16407 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.699+0000 7f3314ff9640 1 -- 172.21.15.45:0/2389709105 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e7b0cedd60 con 0x55e7b0d9b090 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.699+0000 7f3314ff9640 10 client.16407 handle_command_reply: tid=0 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.699+0000 7f3335874740 1 client.16407 shutdown 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f3335874740 1 -- 172.21.15.45:0/2389709105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 msgr2=0x55e7b0d8f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f3335874740 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 0x55e7b0d8f590 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f331c010fd0 tx=0x7f331c005310 comp rx=0 tx=0).stop 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f3335874740 1 -- 172.21.15.45:0/2389709105 shutdown_connections 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f3335874740 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e7b0d9b090 0x55e7b0e082e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f3335874740 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e7b0d8b680 0x55e7b0d8f590 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f3335874740 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e7b0d80dc0 0x55e7b0d8f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f3335874740 1 --2- 172.21.15.45:0/2389709105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e7b0d804a0 0x55e7b0d93d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f3335874740 1 -- 172.21.15.45:0/2389709105 >> 172.21.15.45:0/2389709105 conn(0x55e7b0d7ca30 msgr2=0x55e7b0d837e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f3314ff9640 0 client.16407 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f3335874740 1 -- 172.21.15.45:0/2389709105 shutdown_connections 2024-09-15T22:21:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f3335874740 1 -- 172.21.15.45:0/2389709105 wait complete. 2024-09-15T22:21:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f3335874740 20 client.16407 trim_cache size 0 max 16384 2024-09-15T22:21:21.713 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:21:21.713 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:21:21.713 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:21:21.713 INFO:teuthology.orchestra.run.smithi045.stdout: "93d87daa-30fb-45d9-8545-1412b76a1182": { 2024-09-15T22:21:21.713 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:21:21.713 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "93d87daa-30fb-45d9-8545-1412b76a1182", 2024-09-15T22:21:21.714 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:21:21.714 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:21:21.714 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:21:21.714 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:21:21.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f333349b640 1 -- 172.21.15.45:0/1586725907 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f33180a33b0 msgr2=0x7f33180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f333349b640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f33180a33b0 0x7f33180a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f33240cd700 tx=0x7f3324091770 comp rx=0 tx=0).stop 2024-09-15T22:21:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f333349b640 1 -- 172.21.15.45:0/1586725907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f332c112b90 msgr2=0x7f332c19e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f333349b640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f332c112b90 0x7f332c19e960 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f332400cad0 tx=0x7f332400cf90 comp rx=0 tx=0).stop 2024-09-15T22:21:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f333349b640 1 -- 172.21.15.45:0/1586725907 shutdown_connections 2024-09-15T22:21:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f333349b640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f33180a33b0 0x7f33180a5870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f333349b640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f332c112b90 0x7f332c19e960 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f333349b640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f332c074eb0 0x7f332c1a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.700+0000 7f333349b640 1 --2- 172.21.15.45:0/1586725907 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f332c074590 0x7f332c1a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.701+0000 7f333349b640 1 -- 172.21.15.45:0/1586725907 >> 172.21.15.45:0/1586725907 conn(0x7f332c0fd8c0 msgr2=0x7f332c0fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.701+0000 7f333349b640 1 -- 172.21.15.45:0/1586725907 shutdown_connections 2024-09-15T22:21:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:21.701+0000 7f333349b640 1 -- 172.21.15.45:0/1586725907 wait complete. 2024-09-15T22:21:21.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:21 smithi165 ceph-mon[35551]: pgmap v156: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T22:21:21.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:21 smithi100 ceph-mon[35319]: pgmap v156: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T22:21:22.460 INFO:tasks.cephfs.filesystem:scrub status for tag:93d87daa-30fb-45d9-8545-1412b76a1182 - {'path': '/', 'tag': '93d87daa-30fb-45d9-8545-1412b76a1182', 'options': 'recursive,force'} 2024-09-15T22:21:22.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:22 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:21:22.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:22 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:21:22.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:22 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:21:23.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:23 smithi165 ceph-mon[35551]: pgmap v157: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:21:23.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:23 smithi100 ceph-mon[35319]: pgmap v157: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:21:23.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:23 smithi045 ceph-mon[31180]: pgmap v157: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:21:25.602 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:25 smithi045 ceph-mon[31180]: pgmap v158: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-15T22:21:25.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:25 smithi165 ceph-mon[35551]: pgmap v158: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-15T22:21:25.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:25 smithi100 ceph-mon[35319]: pgmap v158: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-15T22:21:27.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:27 smithi165 ceph-mon[35551]: pgmap v159: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-15T22:21:27.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:27 smithi100 ceph-mon[35319]: pgmap v159: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-15T22:21:27.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:27 smithi045 ceph-mon[31180]: pgmap v159: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-15T22:21:29.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:29 smithi165 ceph-mon[35551]: pgmap v160: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:21:29.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:29 smithi100 ceph-mon[35319]: pgmap v160: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:21:29.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:29 smithi045 ceph-mon[31180]: pgmap v160: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:21:31.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:31 smithi165 ceph-mon[35551]: pgmap v161: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:21:31.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:31 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:31.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:31 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:31.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:31 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:31.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:31 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:21:31.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:31 smithi100 ceph-mon[35319]: pgmap v161: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:21:31.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:31 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:31.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:31 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:31.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:31 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:31.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:31 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:21:31.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:31 smithi045 ceph-mon[31180]: pgmap v161: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:21:31.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:31 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:21:31.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:31 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:21:31.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:31 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:21:31.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:31 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:21:33.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:33 smithi165 ceph-mon[35551]: pgmap v162: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:21:33.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:33 smithi100 ceph-mon[35319]: pgmap v162: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:21:33.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:33 smithi045 ceph-mon[31180]: pgmap v162: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:21:35.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:35 smithi165 ceph-mon[35551]: pgmap v163: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:21:35.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:35 smithi100 ceph-mon[35319]: pgmap v163: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:21:35.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:35 smithi045 ceph-mon[31180]: pgmap v163: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:21:37.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:37 smithi165 ceph-mon[35551]: pgmap v164: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T22:21:37.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:37 smithi100 ceph-mon[35319]: pgmap v164: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T22:21:37.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:37 smithi045 ceph-mon[31180]: pgmap v164: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T22:21:39.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:39 smithi165 ceph-mon[35551]: pgmap v165: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:39.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:39 smithi100 ceph-mon[35319]: pgmap v165: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:39.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:39 smithi045 ceph-mon[31180]: pgmap v165: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:41.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:41 smithi165 ceph-mon[35551]: pgmap v166: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:41.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:41 smithi100 ceph-mon[35319]: pgmap v166: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:41.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:41 smithi045 ceph-mon[31180]: pgmap v166: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:43.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:43 smithi165 ceph-mon[35551]: pgmap v167: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:43.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:43 smithi100 ceph-mon[35319]: pgmap v167: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:43.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:43 smithi045 ceph-mon[31180]: pgmap v167: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:45.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:45 smithi165 ceph-mon[35551]: pgmap v168: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:45.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:45 smithi100 ceph-mon[35319]: pgmap v168: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:45.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:45 smithi045 ceph-mon[31180]: pgmap v168: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:47.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:47 smithi165 ceph-mon[35551]: pgmap v169: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:47.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:47 smithi100 ceph-mon[35319]: pgmap v169: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:47.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:47 smithi045 ceph-mon[31180]: pgmap v169: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:49.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:49 smithi165 ceph-mon[35551]: pgmap v170: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:49.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:49 smithi100 ceph-mon[35319]: pgmap v170: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:49.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:49 smithi045 ceph-mon[31180]: pgmap v170: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:51.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:51 smithi165 ceph-mon[35551]: pgmap v171: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:51.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:51 smithi100 ceph-mon[35319]: pgmap v171: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:51.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:51 smithi045 ceph-mon[31180]: pgmap v171: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:52.461 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:21:52.736 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:53.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.364+0000 7fd66e08a640 1 -- 172.21.15.45:0/3239123569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd668100a90 msgr2=0x7fd668100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:53.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.364+0000 7fd66e08a640 1 --2- 172.21.15.45:0/3239123569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd668100a90 0x7fd668100ef0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd650009930 tx=0x7fd65002a420 comp rx=0 tx=0).stop 2024-09-15T22:21:53.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.364+0000 7fd66e08a640 1 -- 172.21.15.45:0/3239123569 shutdown_connections 2024-09-15T22:21:53.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.364+0000 7fd66e08a640 1 --2- 172.21.15.45:0/3239123569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd668101430 0x7fd66810d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.364+0000 7fd66e08a640 1 --2- 172.21.15.45:0/3239123569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd668100a90 0x7fd668100ef0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.364+0000 7fd66e08a640 1 --2- 172.21.15.45:0/3239123569 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd668106a90 0x7fd668106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.364+0000 7fd66e08a640 1 -- 172.21.15.45:0/3239123569 >> 172.21.15.45:0/3239123569 conn(0x7fd6680fc7d0 msgr2=0x7fd6680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:53.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.364+0000 7fd66e08a640 1 -- 172.21.15.45:0/3239123569 shutdown_connections 2024-09-15T22:21:53.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.364+0000 7fd66e08a640 1 -- 172.21.15.45:0/3239123569 wait complete. 2024-09-15T22:21:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.364+0000 7fd66e08a640 1 Processor -- start 2024-09-15T22:21:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.364+0000 7fd66e08a640 1 -- start start 2024-09-15T22:21:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd66e08a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd668100a90 0x7fd668198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd66e08a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd668101430 0x7fd668198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd66e08a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd668106a90 0x7fd66819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd66e08a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd668110fb0 con 0x7fd668100a90 2024-09-15T22:21:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd66e08a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd668110e30 con 0x7fd668106a90 2024-09-15T22:21:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd66e08a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd668111130 con 0x7fd668101430 2024-09-15T22:21:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd6677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd668100a90 0x7fd668198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd6677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd668100a90 0x7fd668198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58998/0 (socket says 172.21.15.45:58998) 2024-09-15T22:21:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd6677fe640 1 -- 172.21.15.45:0/3542684689 learned_addr learned my addr 172.21.15.45:0/3542684689 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:53.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd65ffff640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd668101430 0x7fd668198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd667fff640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd668106a90 0x7fd66819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd6677fe640 1 -- 172.21.15.45:0/3542684689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd668101430 msgr2=0x7fd668198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:53.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd6677fe640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd668101430 0x7fd668198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd6677fe640 1 -- 172.21.15.45:0/3542684689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd668106a90 msgr2=0x7fd66819ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:53.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd6677fe640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd668106a90 0x7fd66819ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd6677fe640 1 -- 172.21.15.45:0/3542684689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66819d510 con 0x7fd668100a90 2024-09-15T22:21:53.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd667fff640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd668106a90 0x7fd66819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:53.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd6677fe640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd668100a90 0x7fd668198560 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd65800d770 tx=0x7fd65800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:53.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.365+0000 7fd6657fa640 1 -- 172.21.15.45:0/3542684689 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658017070 con 0x7fd668100a90 2024-09-15T22:21:53.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.366+0000 7fd66e08a640 1 -- 172.21.15.45:0/3542684689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd66819d800 con 0x7fd668100a90 2024-09-15T22:21:53.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.366+0000 7fd6657fa640 1 -- 172.21.15.45:0/3542684689 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd658005520 con 0x7fd668100a90 2024-09-15T22:21:53.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.366+0000 7fd6657fa640 1 -- 172.21.15.45:0/3542684689 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658010460 con 0x7fd668100a90 2024-09-15T22:21:53.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.366+0000 7fd66e08a640 1 -- 172.21.15.45:0/3542684689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6681a50e0 con 0x7fd668100a90 2024-09-15T22:21:53.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.368+0000 7fd6657fa640 1 -- 172.21.15.45:0/3542684689 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd658004ea0 con 0x7fd668100a90 2024-09-15T22:21:53.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.368+0000 7fd670463740 1 Processor -- start 2024-09-15T22:21:53.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.368+0000 7fd670463740 1 -- start start 2024-09-15T22:21:53.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.368+0000 7fd6657fa640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd6540a33b0 0x7fd6540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.368+0000 7fd670463740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e014760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd670463740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 0x55de6e023550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd670463740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e025e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd670463740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55de6df7a2e0 con 0x55de6e014380 2024-09-15T22:21:53.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd670463740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55de6df21ce0 con 0x55de6e023a90 2024-09-15T22:21:53.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd670463740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55de6df762a0 con 0x55de6e014ca0 2024-09-15T22:21:53.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd667fff640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd6540a33b0 0x7fd6540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd6677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e014760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd6657fa640 1 -- 172.21.15.45:0/3542684689 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fd6580cfbf0 con 0x7fd668100a90 2024-09-15T22:21:53.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd6677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e014760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59000/0 (socket says 172.21.15.45:59000) 2024-09-15T22:21:53.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd6677fe640 1 -- 172.21.15.45:0/3435872080 learned_addr learned my addr 172.21.15.45:0/3435872080 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:53.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd667fff640 1 --2- 172.21.15.45:0/3435872080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e025e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd65ffff640 1 --2- 172.21.15.45:0/3435872080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 0x55de6e023550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd6677fe640 1 -- 172.21.15.45:0/3435872080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 msgr2=0x55de6e023550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:53.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd6677fe640 1 --2- 172.21.15.45:0/3435872080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 0x55de6e023550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd6677fe640 1 -- 172.21.15.45:0/3435872080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 msgr2=0x55de6e025e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd6677fe640 1 --2- 172.21.15.45:0/3435872080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e025e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd6677fe640 1 -- 172.21.15.45:0/3435872080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de6df06440 con 0x55de6e014380 2024-09-15T22:21:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.369+0000 7fd667fff640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd6540a33b0 0x7fd6540a5870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd660005fd0 tx=0x7fd660014b70 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.370+0000 7fd6677fe640 1 --2- 172.21.15.45:0/3435872080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e014760 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd658009610 tx=0x7fd65801e7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82c488e45f16355 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.370+0000 7fd65dffb640 1 -- 172.21.15.45:0/3435872080 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658020020 con 0x55de6e014380 2024-09-15T22:21:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.370+0000 7fd65dffb640 1 -- 172.21.15.45:0/3435872080 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd65809c1b0 con 0x55de6e014380 2024-09-15T22:21:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.370+0000 7fd65dffb640 1 -- 172.21.15.45:0/3435872080 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6580a0d90 con 0x55de6e014380 2024-09-15T22:21:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.370+0000 7fd670463740 1 -- 172.21.15.45:0/3435872080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 msgr2=0x55de6e014760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.370+0000 7fd670463740 1 --2- 172.21.15.45:0/3435872080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e014760 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd658009610 tx=0x7fd65801e7b0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.370+0000 7fd670463740 1 -- 172.21.15.45:0/3435872080 shutdown_connections 2024-09-15T22:21:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.370+0000 7fd670463740 1 --2- 172.21.15.45:0/3435872080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e025e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.370+0000 7fd670463740 1 --2- 172.21.15.45:0/3435872080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 0x55de6e023550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.370+0000 7fd670463740 1 --2- 172.21.15.45:0/3435872080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e014760 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.371+0000 7fd670463740 1 -- 172.21.15.45:0/3435872080 >> 172.21.15.45:0/3435872080 conn(0x55de6e010a30 msgr2=0x55de6e010e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.371+0000 7fd670463740 1 -- 172.21.15.45:0/3435872080 shutdown_connections 2024-09-15T22:21:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.371+0000 7fd670463740 1 -- 172.21.15.45:0/3435872080 wait complete. 2024-09-15T22:21:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.371+0000 7fd670463740 1 -- start start 2024-09-15T22:21:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.371+0000 7fd670463740 1 Processor -- start 2024-09-15T22:21:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.371+0000 7fd670463740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e0233d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.371+0000 7fd670463740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 0x55de6e0206d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.371+0000 7fd670463740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e020c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.371+0000 7fd670463740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55de6e026660 con 0x55de6e014380 2024-09-15T22:21:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.371+0000 7fd670463740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55de6df35050 con 0x55de6e023a90 2024-09-15T22:21:53.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.371+0000 7fd670463740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55de6e0267e0 con 0x55de6e014ca0 2024-09-15T22:21:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.371+0000 7fd670463740 10 client.0 _ll_register_callbacks cb 0x55de6df75160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd6677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e0233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd6677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e0233d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59004/0 (socket says 172.21.15.45:59004) 2024-09-15T22:21:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd6677fe640 1 -- 172.21.15.45:0/1541164060 learned_addr learned my addr 172.21.15.45:0/1541164060 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd667fff640 1 --2- 172.21.15.45:0/1541164060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e020c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd65ffff640 1 --2- 172.21.15.45:0/1541164060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 0x55de6e0206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd6677fe640 1 -- 172.21.15.45:0/1541164060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 msgr2=0x55de6e0206d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd6677fe640 1 --2- 172.21.15.45:0/1541164060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 0x55de6e0206d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd6677fe640 1 -- 172.21.15.45:0/1541164060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 msgr2=0x55de6e020c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd6677fe640 1 --2- 172.21.15.45:0/1541164060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e020c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd6677fe640 1 -- 172.21.15.45:0/1541164060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de6dceb3c0 con 0x55de6e014380 2024-09-15T22:21:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd6677fe640 1 --2- 172.21.15.45:0/1541164060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e0233d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd65809ba40 tx=0x7fd658004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b16d013e13b74f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd646ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd646ffd640 1 -- 172.21.15.45:0/1541164060 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658020050 con 0x55de6e014380 2024-09-15T22:21:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd646ffd640 1 -- 172.21.15.45:0/1541164060 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fd6580a1230 con 0x55de6e014380 2024-09-15T22:21:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd670463740 1 -- 172.21.15.45:0/1541164060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd65809c1b0 con 0x55de6e014380 2024-09-15T22:21:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd646ffd640 1 -- 172.21.15.45:0/1541164060 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd6580a0ff0 con 0x55de6e014380 2024-09-15T22:21:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd670463740 10 client.16419 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.372+0000 7fd670463740 1 -- 172.21.15.45:0/1541164060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55de6e032090 con 0x55de6e014380 2024-09-15T22:21:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.373+0000 7fd646ffd640 1 -- 172.21.15.45:0/1541164060 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd65809c1b0 con 0x55de6e014380 2024-09-15T22:21:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.373+0000 7fd646ffd640 1 -- 172.21.15.45:0/1541164060 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd6580860b0 con 0x55de6e014380 2024-09-15T22:21:53.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.373+0000 7fd670463740 10 client.16419 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.373+0000 7fd670463740 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.373+0000 7fd670463740 20 client.16419 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.373+0000 7fd670463740 1 --2- 172.21.15.45:0/1541164060 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55de6e0333e0 0x55de6e0357d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.373+0000 7fd670463740 4 client.16419 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.373+0000 7fd670463740 1 -- 172.21.15.45:0/1541164060 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de6df87850 con 0x55de6e0333e0 2024-09-15T22:21:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.373+0000 7fd65ffff640 1 --2- 172.21.15.45:0/1541164060 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55de6e0333e0 0x55de6e0357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.374+0000 7fd65ffff640 1 --2- 172.21.15.45:0/1541164060 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55de6e0333e0 0x55de6e0357d0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4a67d66ea4fc1dc server_cookie=ece63d1ccbd704df in_seq=0 out_seq=0 2024-09-15T22:21:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.374+0000 7fd646ffd640 10 client.16419 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.374+0000 7fd646ffd640 1 -- 172.21.15.45:0/1541164060 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de6df87850 con 0x55de6e0333e0 2024-09-15T22:21:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.374+0000 7fd646ffd640 10 client.16419 handle_command_reply: tid=0 2024-09-15T22:21:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.374+0000 7fd670463740 1 client.16419 shutdown 2024-09-15T22:21:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.375+0000 7fd670463740 1 -- 172.21.15.45:0/1541164060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 msgr2=0x55de6e0233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:53.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.375+0000 7fd670463740 1 --2- 172.21.15.45:0/1541164060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e0233d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd65809ba40 tx=0x7fd658004940 comp rx=0 tx=0).stop 2024-09-15T22:21:53.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.375+0000 7fd670463740 1 -- 172.21.15.45:0/1541164060 shutdown_connections 2024-09-15T22:21:53.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.375+0000 7fd670463740 1 --2- 172.21.15.45:0/1541164060 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55de6e0333e0 0x55de6e0357d0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.375+0000 7fd670463740 1 --2- 172.21.15.45:0/1541164060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e020c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.375+0000 7fd670463740 1 --2- 172.21.15.45:0/1541164060 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 0x55de6e0206d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.375+0000 7fd670463740 1 --2- 172.21.15.45:0/1541164060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e0233d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.375+0000 7fd646ffd640 0 client.16419 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:53.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.375+0000 7fd670463740 1 -- 172.21.15.45:0/1541164060 >> 172.21.15.45:0/1541164060 conn(0x55de6e010a30 msgr2=0x55de6e016790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:53.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.375+0000 7fd670463740 1 -- 172.21.15.45:0/1541164060 shutdown_connections 2024-09-15T22:21:53.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.375+0000 7fd670463740 1 -- 172.21.15.45:0/1541164060 wait complete. 2024-09-15T22:21:53.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.375+0000 7fd670463740 20 client.16419 trim_cache size 0 max 16384 2024-09-15T22:21:53.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd670463740 1 Processor -- start 2024-09-15T22:21:53.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd670463740 1 -- start start 2024-09-15T22:21:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd670463740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e0387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd670463740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 0x55de6e038d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd670463740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e01d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd670463740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd6681ab040 con 0x55de6e014380 2024-09-15T22:21:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd670463740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd6681ad8c0 con 0x55de6e023a90 2024-09-15T22:21:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd670463740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd6681ab6b0 con 0x55de6e014ca0 2024-09-15T22:21:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd6677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e0387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd6677fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e0387f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59010/0 (socket says 172.21.15.45:59010) 2024-09-15T22:21:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd6677fe640 1 -- 172.21.15.45:0/1193254229 learned_addr learned my addr 172.21.15.45:0/1193254229 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd6677fe640 1 -- 172.21.15.45:0/1193254229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 msgr2=0x55de6e038d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd65ffff640 1 --2- 172.21.15.45:0/1193254229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 0x55de6e038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd667fff640 1 --2- 172.21.15.45:0/1193254229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e01d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd6677fe640 1 --2- 172.21.15.45:0/1193254229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 0x55de6e038d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd6677fe640 1 -- 172.21.15.45:0/1193254229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 msgr2=0x55de6e01d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:53.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd6677fe640 1 --2- 172.21.15.45:0/1193254229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e01d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd6677fe640 1 -- 172.21.15.45:0/1193254229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de6e0104d0 con 0x55de6e014380 2024-09-15T22:21:53.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.393+0000 7fd667fff640 1 --2- 172.21.15.45:0/1193254229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e01d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:53.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.394+0000 7fd6677fe640 1 --2- 172.21.15.45:0/1193254229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e0387f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd658097f10 tx=0x7fd658099fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f172e3af98cba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:53.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.394+0000 7fd65d7fa640 1 -- 172.21.15.45:0/1193254229 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65807e030 con 0x55de6e014380 2024-09-15T22:21:53.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.394+0000 7fd65d7fa640 1 -- 172.21.15.45:0/1193254229 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd65809c1b0 con 0x55de6e014380 2024-09-15T22:21:53.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.394+0000 7fd65d7fa640 1 -- 172.21.15.45:0/1193254229 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658020040 con 0x55de6e014380 2024-09-15T22:21:53.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.395+0000 7fd670463740 1 -- 172.21.15.45:0/1193254229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 msgr2=0x55de6e0387f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:53.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.395+0000 7fd670463740 1 --2- 172.21.15.45:0/1193254229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e0387f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd658097f10 tx=0x7fd658099fc0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.395+0000 7fd670463740 1 -- 172.21.15.45:0/1193254229 shutdown_connections 2024-09-15T22:21:53.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.395+0000 7fd670463740 1 --2- 172.21.15.45:0/1193254229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e01d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.395+0000 7fd670463740 1 --2- 172.21.15.45:0/1193254229 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014ca0 0x55de6e038d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.395+0000 7fd670463740 1 --2- 172.21.15.45:0/1193254229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014380 0x55de6e0387f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.395+0000 7fd670463740 1 -- 172.21.15.45:0/1193254229 >> 172.21.15.45:0/1193254229 conn(0x55de6e010a30 msgr2=0x55de6e01f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:53.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.395+0000 7fd670463740 1 -- 172.21.15.45:0/1193254229 shutdown_connections 2024-09-15T22:21:53.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.395+0000 7fd670463740 1 -- 172.21.15.45:0/1193254229 wait complete. 2024-09-15T22:21:53.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.395+0000 7fd670463740 1 -- start start 2024-09-15T22:21:53.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.396+0000 7fd670463740 1 Processor -- start 2024-09-15T22:21:53.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.396+0000 7fd670463740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014380 0x55de6e038b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.396+0000 7fd670463740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014ca0 0x55de6e0390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.396+0000 7fd670463740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e036130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.396+0000 7fd670463740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd6681abd80 con 0x55de6e014ca0 2024-09-15T22:21:53.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.396+0000 7fd670463740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd6681ad1f0 con 0x55de6e023a90 2024-09-15T22:21:53.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.396+0000 7fd670463740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd6681ac450 con 0x55de6e014380 2024-09-15T22:21:53.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.396+0000 7fd670463740 10 client.0 _ll_register_callbacks cb 0x7fd660009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:53.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.396+0000 7fd65ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014ca0 0x55de6e0390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.396+0000 7fd65ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014ca0 0x55de6e0390d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59024/0 (socket says 172.21.15.45:59024) 2024-09-15T22:21:53.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.396+0000 7fd65ffff640 1 -- 172.21.15.45:0/829152785 learned_addr learned my addr 172.21.15.45:0/829152785 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:53.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.396+0000 7fd667fff640 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e036130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.396+0000 7fd6677fe640 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014380 0x55de6e038b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd65ffff640 1 -- 172.21.15.45:0/829152785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014380 msgr2=0x55de6e038b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd65ffff640 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014380 0x55de6e038b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd65ffff640 1 -- 172.21.15.45:0/829152785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 msgr2=0x55de6e036130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd65ffff640 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e036130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd65ffff640 1 -- 172.21.15.45:0/829152785 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de6e036960 con 0x55de6e014ca0 2024-09-15T22:21:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd6677fe640 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014380 0x55de6e038b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd65ffff640 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014ca0 0x55de6e0390d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd650009900 tx=0x7fd65002ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfce7286b66433f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd646ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd646ffd640 1 -- 172.21.15.45:0/829152785 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65004d070 con 0x55de6e014ca0 2024-09-15T22:21:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd646ffd640 1 -- 172.21.15.45:0/829152785 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fd650004240 con 0x55de6e014ca0 2024-09-15T22:21:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd670463740 1 -- 172.21.15.45:0/829152785 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd65809c1b0 con 0x55de6e014ca0 2024-09-15T22:21:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd646ffd640 1 -- 172.21.15.45:0/829152785 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd650058050 con 0x55de6e014ca0 2024-09-15T22:21:53.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd670463740 10 client.16425 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.397+0000 7fd670463740 1 -- 172.21.15.45:0/829152785 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55de6e09d990 con 0x55de6e014ca0 2024-09-15T22:21:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.398+0000 7fd646ffd640 1 -- 172.21.15.45:0/829152785 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd65809c1b0 con 0x55de6e014ca0 2024-09-15T22:21:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.398+0000 7fd646ffd640 1 -- 172.21.15.45:0/829152785 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd650004c50 con 0x55de6e014ca0 2024-09-15T22:21:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.398+0000 7fd670463740 10 client.16425 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.398+0000 7fd670463740 10 client.16425 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.398+0000 7fd670463740 20 client.16425 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.398+0000 7fd670463740 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55de6e09e140 0x55de6e0a0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.398+0000 7fd670463740 4 client.16425 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:21:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.398+0000 7fd670463740 1 -- 172.21.15.45:0/829152785 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55de6df81d60 con 0x55de6e09e140 2024-09-15T22:21:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.398+0000 7fd6677fe640 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55de6e09e140 0x55de6e0a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.398+0000 7fd6677fe640 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55de6e09e140 0x55de6e0a0560 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9321fcbfec2bb1f7 server_cookie=268b48bdea7cebc2 in_seq=0 out_seq=0 2024-09-15T22:21:53.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.398+0000 7fd646ffd640 10 client.16425 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd646ffd640 1 -- 172.21.15.45:0/829152785 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55de6df81d60 con 0x55de6e09e140 2024-09-15T22:21:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd646ffd640 10 client.16425 handle_command_reply: tid=0 2024-09-15T22:21:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd670463740 1 client.16425 shutdown 2024-09-15T22:21:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd670463740 1 -- 172.21.15.45:0/829152785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014ca0 msgr2=0x55de6e0390d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd670463740 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014ca0 0x55de6e0390d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fd650009900 tx=0x7fd65002ab90 comp rx=0 tx=0).stop 2024-09-15T22:21:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd670463740 1 -- 172.21.15.45:0/829152785 shutdown_connections 2024-09-15T22:21:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd670463740 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55de6e09e140 0x55de6e0a0560 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd670463740 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55de6e023a90 0x55de6e036130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd670463740 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55de6e014ca0 0x55de6e0390d0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd646ffd640 0 client.16425 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd670463740 1 --2- 172.21.15.45:0/829152785 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55de6e014380 0x55de6e038b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd670463740 1 -- 172.21.15.45:0/829152785 >> 172.21.15.45:0/829152785 conn(0x55de6e010a30 msgr2=0x55de6e00f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd670463740 1 -- 172.21.15.45:0/829152785 shutdown_connections 2024-09-15T22:21:53.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd670463740 1 -- 172.21.15.45:0/829152785 wait complete. 2024-09-15T22:21:53.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.399+0000 7fd670463740 20 client.16425 trim_cache size 0 max 16384 2024-09-15T22:21:53.410 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:21:53.410 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:21:53.410 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:21:53.410 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:21:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.400+0000 7fd66e08a640 1 -- 172.21.15.45:0/3542684689 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd6540a33b0 msgr2=0x7fd6540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.400+0000 7fd66e08a640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd6540a33b0 0x7fd6540a5870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd660005fd0 tx=0x7fd660014b70 comp rx=0 tx=0).stop 2024-09-15T22:21:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.400+0000 7fd66e08a640 1 -- 172.21.15.45:0/3542684689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd668100a90 msgr2=0x7fd668198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.400+0000 7fd66e08a640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd668100a90 0x7fd668198560 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd65800d770 tx=0x7fd65800dc30 comp rx=0 tx=0).stop 2024-09-15T22:21:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.400+0000 7fd66e08a640 1 -- 172.21.15.45:0/3542684689 shutdown_connections 2024-09-15T22:21:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.400+0000 7fd66e08a640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd6540a33b0 0x7fd6540a5870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.400+0000 7fd66e08a640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd668106a90 0x7fd66819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.400+0000 7fd66e08a640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd668101430 0x7fd668198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.400+0000 7fd66e08a640 1 --2- 172.21.15.45:0/3542684689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd668100a90 0x7fd668198560 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:53.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.400+0000 7fd66e08a640 1 -- 172.21.15.45:0/3542684689 >> 172.21.15.45:0/3542684689 conn(0x7fd6680fc7d0 msgr2=0x7fd66806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:53.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.400+0000 7fd66e08a640 1 -- 172.21.15.45:0/3542684689 shutdown_connections 2024-09-15T22:21:53.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:53.400+0000 7fd66e08a640 1 -- 172.21.15.45:0/3542684689 wait complete. 2024-09-15T22:21:53.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:53 smithi045 ceph-mon[31180]: pgmap v172: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:53.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:53 smithi165 ceph-mon[35551]: pgmap v172: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:53.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:53 smithi100 ceph-mon[35319]: pgmap v172: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:54.270 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:21:54.271 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:21:54.535 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.035+0000 7f9465d2e640 1 -- 172.21.15.45:0/1372730039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9460102790 msgr2=0x7f94601067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.035+0000 7f9465d2e640 1 --2- 172.21.15.45:0/1372730039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9460102790 0x7f94601067e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9448009900 tx=0x7f944802a410 comp rx=0 tx=0).stop 2024-09-15T22:21:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 -- 172.21.15.45:0/1372730039 shutdown_connections 2024-09-15T22:21:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 --2- 172.21.15.45:0/1372730039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9460106f10 0x7f946010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 --2- 172.21.15.45:0/1372730039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9460102790 0x7f94601067e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 --2- 172.21.15.45:0/1372730039 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9460101de0 0x7f94601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 -- 172.21.15.45:0/1372730039 >> 172.21.15.45:0/1372730039 conn(0x7f94600fd8c0 msgr2=0x7f94600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 -- 172.21.15.45:0/1372730039 shutdown_connections 2024-09-15T22:21:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 -- 172.21.15.45:0/1372730039 wait complete. 2024-09-15T22:21:55.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 Processor -- start 2024-09-15T22:21:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 -- start start 2024-09-15T22:21:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9460101de0 0x7f94601984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9460102790 0x7f9460198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9460106f10 0x7f946019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f94601120a0 con 0x7f9460101de0 2024-09-15T22:21:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9460111f20 con 0x7f9460102790 2024-09-15T22:21:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.036+0000 7f9465d2e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9460112220 con 0x7f9460106f10 2024-09-15T22:21:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f945f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9460101de0 0x7f94601984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f945f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9460101de0 0x7f94601984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36980/0 (socket says 172.21.15.45:36980) 2024-09-15T22:21:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f945f7fe640 1 -- 172.21.15.45:0/3494748147 learned_addr learned my addr 172.21.15.45:0/3494748147 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f9457fff640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9460102790 0x7f9460198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f945f7fe640 1 -- 172.21.15.45:0/3494748147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9460106f10 msgr2=0x7f946019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:55.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f945f7fe640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9460106f10 0x7f946019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f945f7fe640 1 -- 172.21.15.45:0/3494748147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9460102790 msgr2=0x7f9460198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f945f7fe640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9460102790 0x7f9460198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f945f7fe640 1 -- 172.21.15.45:0/3494748147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f946019d470 con 0x7f9460101de0 2024-09-15T22:21:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f9457fff640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9460102790 0x7f9460198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f945f7fe640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9460101de0 0x7f94601984c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f945000c920 tx=0x7f945000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f945d7fa640 1 -- 172.21.15.45:0/3494748147 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450007c70 con 0x7f9460101de0 2024-09-15T22:21:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f945d7fa640 1 -- 172.21.15.45:0/3494748147 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9450007e10 con 0x7f9460101de0 2024-09-15T22:21:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f9465d2e640 1 -- 172.21.15.45:0/3494748147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f946019d760 con 0x7f9460101de0 2024-09-15T22:21:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f945d7fa640 1 -- 172.21.15.45:0/3494748147 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450018940 con 0x7f9460101de0 2024-09-15T22:21:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.037+0000 7f9465d2e640 1 -- 172.21.15.45:0/3494748147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94601a5040 con 0x7f9460101de0 2024-09-15T22:21:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.038+0000 7f9465d2e640 1 -- 172.21.15.45:0/3494748147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94601021c0 con 0x7f9460101de0 2024-09-15T22:21:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.039+0000 7f945d7fa640 1 -- 172.21.15.45:0/3494748147 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9450018b20 con 0x7f9460101de0 2024-09-15T22:21:55.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.040+0000 7f945d7fa640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f944c0a33b0 0x7f944c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:55.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.040+0000 7f9457fff640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f944c0a33b0 0x7f944c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:55.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.040+0000 7f945d7fa640 1 -- 172.21.15.45:0/3494748147 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f94500d0390 con 0x7f9460101de0 2024-09-15T22:21:55.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.041+0000 7f9457fff640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f944c0a33b0 0x7f944c0a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94480315e0 tx=0x7f9448000bc0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:55.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.044+0000 7f945d7fa640 1 -- 172.21.15.45:0/3494748147 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9450014030 con 0x7f9460101de0 2024-09-15T22:21:55.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.255+0000 7f9465d2e640 1 -- 172.21.15.45:0/3494748147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9460199820 con 0x7f9460101de0 2024-09-15T22:21:55.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.256+0000 7f945d7fa640 1 -- 172.21.15.45:0/3494748147 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f945000de20 con 0x7f9460101de0 2024-09-15T22:21:55.257 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:21:55.257 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:21:55.257 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:21:55.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.258+0000 7f9465d2e640 1 -- 172.21.15.45:0/3494748147 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f944c0a33b0 msgr2=0x7f944c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:55.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.258+0000 7f9465d2e640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f944c0a33b0 0x7f944c0a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f94480315e0 tx=0x7f9448000bc0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.258+0000 7f9465d2e640 1 -- 172.21.15.45:0/3494748147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9460101de0 msgr2=0x7f94601984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:55.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.258+0000 7f9465d2e640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9460101de0 0x7f94601984c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f945000c920 tx=0x7f945000cde0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.258+0000 7f9465d2e640 1 -- 172.21.15.45:0/3494748147 shutdown_connections 2024-09-15T22:21:55.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.258+0000 7f9465d2e640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f944c0a33b0 0x7f944c0a5870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.258+0000 7f9465d2e640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9460106f10 0x7f946019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.258+0000 7f9465d2e640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9460102790 0x7f9460198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.258+0000 7f9465d2e640 1 --2- 172.21.15.45:0/3494748147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9460101de0 0x7f94601984c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:55.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.258+0000 7f9465d2e640 1 -- 172.21.15.45:0/3494748147 >> 172.21.15.45:0/3494748147 conn(0x7f94600fd8c0 msgr2=0x7f94600ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:55.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.258+0000 7f9465d2e640 1 -- 172.21.15.45:0/3494748147 shutdown_connections 2024-09-15T22:21:55.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:55.258+0000 7f9465d2e640 1 -- 172.21.15.45:0/3494748147 wait complete. 2024-09-15T22:21:55.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:55 smithi045 ceph-mon[31180]: pgmap v173: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:55.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:55 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3494748147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:21:55.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:55 smithi165 ceph-mon[35551]: pgmap v173: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:55.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:55 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3494748147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:21:55.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:55 smithi100 ceph-mon[35319]: pgmap v173: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:21:55.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:55 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3494748147' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:21:55.909 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:21:56.173 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:56.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.694+0000 7fce5aaeb640 1 -- 172.21.15.45:0/53970265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce54106f10 msgr2=0x7fce5410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:56.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.694+0000 7fce5aaeb640 1 --2- 172.21.15.45:0/53970265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce54106f10 0x7fce5410ea90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009ca0 tx=0x7fce4c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.694+0000 7fce5aaeb640 1 -- 172.21.15.45:0/53970265 shutdown_connections 2024-09-15T22:21:56.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.694+0000 7fce5aaeb640 1 --2- 172.21.15.45:0/53970265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce54106f10 0x7fce5410ea90 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.694+0000 7fce5aaeb640 1 --2- 172.21.15.45:0/53970265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce54102790 0x7fce541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.694+0000 7fce5aaeb640 1 --2- 172.21.15.45:0/53970265 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce54101de0 0x7fce541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.694+0000 7fce5aaeb640 1 -- 172.21.15.45:0/53970265 >> 172.21.15.45:0/53970265 conn(0x7fce540fd8c0 msgr2=0x7fce540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:56.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.694+0000 7fce5aaeb640 1 -- 172.21.15.45:0/53970265 shutdown_connections 2024-09-15T22:21:56.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.694+0000 7fce5aaeb640 1 -- 172.21.15.45:0/53970265 wait complete. 2024-09-15T22:21:56.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.695+0000 7fce5aaeb640 1 Processor -- start 2024-09-15T22:21:56.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.695+0000 7fce5aaeb640 1 -- start start 2024-09-15T22:21:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.695+0000 7fce5aaeb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce54101de0 0x7fce540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.695+0000 7fce5aaeb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce54102790 0x7fce54074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.695+0000 7fce5aaeb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce54106f10 0x7fce54074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.695+0000 7fce5aaeb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fce541120d0 con 0x7fce54106f10 2024-09-15T22:21:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.695+0000 7fce5aaeb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce54111f50 con 0x7fce54101de0 2024-09-15T22:21:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.695+0000 7fce5aaeb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce54112250 con 0x7fce54102790 2024-09-15T22:21:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.695+0000 7fce59088640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce54106f10 0x7fce54074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.695+0000 7fce59088640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce54106f10 0x7fce54074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36988/0 (socket says 172.21.15.45:36988) 2024-09-15T22:21:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.695+0000 7fce59088640 1 -- 172.21.15.45:0/4215651462 learned_addr learned my addr 172.21.15.45:0/4215651462 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce53fff640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce54102790 0x7fce54074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce58887640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce54101de0 0x7fce540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce59088640 1 -- 172.21.15.45:0/4215651462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce54102790 msgr2=0x7fce54074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:56.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce59088640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce54102790 0x7fce54074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce59088640 1 -- 172.21.15.45:0/4215651462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce54101de0 msgr2=0x7fce540744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:56.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce59088640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce54101de0 0x7fce540744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce59088640 1 -- 172.21.15.45:0/4215651462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce541a6910 con 0x7fce54106f10 2024-09-15T22:21:56.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce53fff640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce54102790 0x7fce54074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:56.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce59088640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce54106f10 0x7fce54074f70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009dc0 tx=0x7fce4c031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:56.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce51ffb640 1 -- 172.21.15.45:0/4215651462 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c02fba0 con 0x7fce54106f10 2024-09-15T22:21:56.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce51ffb640 1 -- 172.21.15.45:0/4215651462 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce4c02fd40 con 0x7fce54106f10 2024-09-15T22:21:56.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce5aaeb640 1 -- 172.21.15.45:0/4215651462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce541a6ba0 con 0x7fce54106f10 2024-09-15T22:21:56.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce51ffb640 1 -- 172.21.15.45:0/4215651462 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c046a70 con 0x7fce54106f10 2024-09-15T22:21:56.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.696+0000 7fce5aaeb640 1 -- 172.21.15.45:0/4215651462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce541a7130 con 0x7fce54106f10 2024-09-15T22:21:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce51ffb640 1 -- 172.21.15.45:0/4215651462 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fce4c0305c0 con 0x7fce54106f10 2024-09-15T22:21:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce5cec4740 1 Processor -- start 2024-09-15T22:21:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce5cec4740 1 -- start start 2024-09-15T22:21:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce5cec4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c22b40 0x5593b1c21090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce5cec4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c215d0 0x5593b1c21a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce5cec4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c2c370 0x5593b1c2e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce5cec4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5593b1b872f0 con 0x5593b1c215d0 2024-09-15T22:21:56.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce5cec4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5593b1b2ecf0 con 0x5593b1c2c370 2024-09-15T22:21:56.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce5cec4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5593b1b832b0 con 0x5593b1c22b40 2024-09-15T22:21:56.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce58887640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c215d0 0x5593b1c21a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce58887640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c215d0 0x5593b1c21a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36994/0 (socket says 172.21.15.45:36994) 2024-09-15T22:21:56.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce58887640 1 -- 172.21.15.45:0/1254314804 learned_addr learned my addr 172.21.15.45:0/1254314804 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:56.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce53fff640 1 --2- 172.21.15.45:0/1254314804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c22b40 0x5593b1c21090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.699+0000 7fce53fff640 1 --2- 172.21.15.45:0/1254314804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c2c370 0x5593b1c2e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.700+0000 7fce51ffb640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fce440a3430 0x7fce440a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.700+0000 7fce58887640 1 -- 172.21.15.45:0/1254314804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c22b40 msgr2=0x5593b1c21090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:56.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.700+0000 7fce58887640 1 --2- 172.21.15.45:0/1254314804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c22b40 0x5593b1c21090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.700+0000 7fce58887640 1 -- 172.21.15.45:0/1254314804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c2c370 msgr2=0x5593b1c2e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.700+0000 7fce58887640 1 --2- 172.21.15.45:0/1254314804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c2c370 0x5593b1c2e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.700+0000 7fce58887640 1 -- 172.21.15.45:0/1254314804 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593b1b133a0 con 0x5593b1c215d0 2024-09-15T22:21:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.700+0000 7fce53fff640 1 --2- 172.21.15.45:0/1254314804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c2c370 0x5593b1c2e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:21:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.700+0000 7fce59088640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fce440a3430 0x7fce440a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.700+0000 7fce51ffb640 1 -- 172.21.15.45:0/4215651462 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fce4c0f16d0 con 0x7fce54106f10 2024-09-15T22:21:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.700+0000 7fce58887640 1 --2- 172.21.15.45:0/1254314804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c215d0 0x5593b1c21a10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fce4800b820 tx=0x7fce4800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8737108445ca6c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.700+0000 7fce3effd640 1 -- 172.21.15.45:0/1254314804 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4800d950 con 0x5593b1c215d0 2024-09-15T22:21:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.700+0000 7fce3effd640 1 -- 172.21.15.45:0/1254314804 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce48019070 con 0x5593b1c215d0 2024-09-15T22:21:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.700+0000 7fce3effd640 1 -- 172.21.15.45:0/1254314804 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce480123e0 con 0x5593b1c215d0 2024-09-15T22:21:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.701+0000 7fce5cec4740 1 -- 172.21.15.45:0/1254314804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c215d0 msgr2=0x5593b1c21a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.701+0000 7fce59088640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fce440a3430 0x7fce440a58f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0ba0d0 tx=0x7fce4c08c3f0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.701+0000 7fce5cec4740 1 --2- 172.21.15.45:0/1254314804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c215d0 0x5593b1c21a10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fce4800b820 tx=0x7fce4800bce0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.701+0000 7fce5cec4740 1 -- 172.21.15.45:0/1254314804 shutdown_connections 2024-09-15T22:21:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.701+0000 7fce5cec4740 1 --2- 172.21.15.45:0/1254314804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c2c370 0x5593b1c2e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.701+0000 7fce5cec4740 1 --2- 172.21.15.45:0/1254314804 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c215d0 0x5593b1c21a10 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.701+0000 7fce5cec4740 1 --2- 172.21.15.45:0/1254314804 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c22b40 0x5593b1c21090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.701+0000 7fce5cec4740 1 -- 172.21.15.45:0/1254314804 >> 172.21.15.45:0/1254314804 conn(0x5593b1bea310 msgr2=0x5593b1c1dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.701+0000 7fce5cec4740 1 -- 172.21.15.45:0/1254314804 shutdown_connections 2024-09-15T22:21:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.701+0000 7fce5cec4740 1 -- 172.21.15.45:0/1254314804 wait complete. 2024-09-15T22:21:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.701+0000 7fce5cec4740 1 -- start start 2024-09-15T22:21:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce5cec4740 1 Processor -- start 2024-09-15T22:21:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce5cec4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c215d0 0x5593b1c2bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce5cec4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 0x5593b1c29020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce5cec4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c2c370 0x5593b1c29610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce5cec4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5593b1c2f070 con 0x5593b1c22b40 2024-09-15T22:21:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce5cec4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5593b1b42060 con 0x5593b1c215d0 2024-09-15T22:21:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce5cec4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5593b1c2f1f0 con 0x5593b1c2c370 2024-09-15T22:21:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce5cec4740 10 client.0 _ll_register_callbacks cb 0x5593b18958c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce58887640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 0x5593b1c29020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce58887640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 0x5593b1c29020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37008/0 (socket says 172.21.15.45:37008) 2024-09-15T22:21:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce58887640 1 -- 172.21.15.45:0/2264235317 learned_addr learned my addr 172.21.15.45:0/2264235317 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce53fff640 1 --2- 172.21.15.45:0/2264235317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c2c370 0x5593b1c29610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce58887640 1 -- 172.21.15.45:0/2264235317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c2c370 msgr2=0x5593b1c29610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce58887640 1 --2- 172.21.15.45:0/2264235317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c2c370 0x5593b1c29610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce58887640 1 -- 172.21.15.45:0/2264235317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c215d0 msgr2=0x5593b1c2bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce58887640 1 --2- 172.21.15.45:0/2264235317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c215d0 0x5593b1c2bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce58887640 1 -- 172.21.15.45:0/2264235317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593b18f83c0 con 0x5593b1c22b40 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.702+0000 7fce53fff640 1 --2- 172.21.15.45:0/2264235317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c2c370 0x5593b1c29610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce58887640 1 --2- 172.21.15.45:0/2264235317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 0x5593b1c29020 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fce48000c00 tx=0x7fce48014660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739add1fa9ecc86e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce33fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce33fff640 1 -- 172.21.15.45:0/2264235317 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce48023070 con 0x5593b1c22b40 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce5cec4740 1 -- 172.21.15.45:0/2264235317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce48019070 con 0x5593b1c22b40 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce33fff640 1 -- 172.21.15.45:0/2264235317 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fce4800dd60 con 0x5593b1c22b40 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce33fff640 1 -- 172.21.15.45:0/2264235317 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fce4802f050 con 0x5593b1c22b40 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce5cec4740 10 client.16443 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce5cec4740 1 -- 172.21.15.45:0/2264235317 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5593b1c3ab40 con 0x5593b1c22b40 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce33fff640 1 -- 172.21.15.45:0/2264235317 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce48019070 con 0x5593b1c22b40 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce33fff640 1 -- 172.21.15.45:0/2264235317 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fce48013070 con 0x5593b1c22b40 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce5cec4740 10 client.16443 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce5cec4740 10 client.16443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:56.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce5cec4740 20 client.16443 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:56.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.703+0000 7fce5cec4740 1 --2- 172.21.15.45:0/2264235317 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5593b1c3be90 0x5593b1c3e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.704+0000 7fce5cec4740 4 client.16443 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:56.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.704+0000 7fce5cec4740 1 -- 172.21.15.45:0/2264235317 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593b1b94860 con 0x5593b1c3be90 2024-09-15T22:21:56.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.704+0000 7fce53fff640 1 --2- 172.21.15.45:0/2264235317 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5593b1c3be90 0x5593b1c3e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.704+0000 7fce53fff640 1 --2- 172.21.15.45:0/2264235317 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5593b1c3be90 0x5593b1c3e280 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23f60c1fcd5447ca server_cookie=be99c39f478ffb4e in_seq=0 out_seq=0 2024-09-15T22:21:56.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.704+0000 7fce33fff640 10 client.16443 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:56.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce33fff640 1 -- 172.21.15.45:0/2264235317 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593b1b94860 con 0x5593b1c3be90 2024-09-15T22:21:56.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce33fff640 10 client.16443 handle_command_reply: tid=0 2024-09-15T22:21:56.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce5cec4740 1 client.16443 shutdown 2024-09-15T22:21:56.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce5cec4740 1 -- 172.21.15.45:0/2264235317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 msgr2=0x5593b1c29020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:56.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce5cec4740 1 --2- 172.21.15.45:0/2264235317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 0x5593b1c29020 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fce48000c00 tx=0x7fce48014660 comp rx=0 tx=0).stop 2024-09-15T22:21:56.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce5cec4740 1 -- 172.21.15.45:0/2264235317 shutdown_connections 2024-09-15T22:21:56.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce5cec4740 1 --2- 172.21.15.45:0/2264235317 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5593b1c3be90 0x5593b1c3e280 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce5cec4740 1 --2- 172.21.15.45:0/2264235317 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c2c370 0x5593b1c29610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce5cec4740 1 --2- 172.21.15.45:0/2264235317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 0x5593b1c29020 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce5cec4740 1 --2- 172.21.15.45:0/2264235317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c215d0 0x5593b1c2bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce5cec4740 1 -- 172.21.15.45:0/2264235317 >> 172.21.15.45:0/2264235317 conn(0x5593b1bea310 msgr2=0x5593b1c23930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:56.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce33fff640 0 client.16443 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:56.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce5cec4740 1 -- 172.21.15.45:0/2264235317 shutdown_connections 2024-09-15T22:21:56.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.705+0000 7fce5cec4740 1 -- 172.21.15.45:0/2264235317 wait complete. 2024-09-15T22:21:56.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.706+0000 7fce5cec4740 20 client.16443 trim_cache size 0 max 16384 2024-09-15T22:21:56.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce5cec4740 1 Processor -- start 2024-09-15T22:21:56.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce5cec4740 1 -- start start 2024-09-15T22:21:56.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce5cec4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c215d0 0x5593b1c38340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce5cec4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c22b40 0x5593b1c24120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce5cec4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c2c370 0x5593b1c24660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce5cec4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fce541af260 con 0x5593b1c2c370 2024-09-15T22:21:56.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce5cec4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce541b1ae0 con 0x5593b1c22b40 2024-09-15T22:21:56.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce5cec4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce541af8d0 con 0x5593b1c215d0 2024-09-15T22:21:56.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce53fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c2c370 0x5593b1c24660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce53fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c2c370 0x5593b1c24660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37012/0 (socket says 172.21.15.45:37012) 2024-09-15T22:21:56.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce53fff640 1 -- 172.21.15.45:0/1489336309 learned_addr learned my addr 172.21.15.45:0/1489336309 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce58887640 1 --2- 172.21.15.45:0/1489336309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c22b40 0x5593b1c24120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce53fff640 1 -- 172.21.15.45:0/1489336309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c215d0 msgr2=0x5593b1c38340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce53fff640 1 --2- 172.21.15.45:0/1489336309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c215d0 0x5593b1c38340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce53fff640 1 -- 172.21.15.45:0/1489336309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c22b40 msgr2=0x5593b1c24120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce53fff640 1 --2- 172.21.15.45:0/1489336309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c22b40 0x5593b1c24120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce53fff640 1 -- 172.21.15.45:0/1489336309 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593b1c1e960 con 0x5593b1c2c370 2024-09-15T22:21:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce58887640 1 --2- 172.21.15.45:0/1489336309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c22b40 0x5593b1c24120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.719+0000 7fce53fff640 1 --2- 172.21.15.45:0/1489336309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c2c370 0x5593b1c24660 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b3d0 tx=0x7fce40005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2fe60332901d5b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.720+0000 7fce3e7fc640 1 -- 172.21.15.45:0/1489336309 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40020070 con 0x5593b1c2c370 2024-09-15T22:21:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.720+0000 7fce3e7fc640 1 -- 172.21.15.45:0/1489336309 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce40004220 con 0x5593b1c2c370 2024-09-15T22:21:56.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.720+0000 7fce3e7fc640 1 -- 172.21.15.45:0/1489336309 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce400117c0 con 0x5593b1c2c370 2024-09-15T22:21:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.720+0000 7fce5cec4740 1 -- 172.21.15.45:0/1489336309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c2c370 msgr2=0x5593b1c24660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.720+0000 7fce5cec4740 1 --2- 172.21.15.45:0/1489336309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c2c370 0x5593b1c24660 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b3d0 tx=0x7fce40005f90 comp rx=0 tx=0).stop 2024-09-15T22:21:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.720+0000 7fce5cec4740 1 -- 172.21.15.45:0/1489336309 shutdown_connections 2024-09-15T22:21:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.720+0000 7fce5cec4740 1 --2- 172.21.15.45:0/1489336309 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c2c370 0x5593b1c24660 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.720+0000 7fce5cec4740 1 --2- 172.21.15.45:0/1489336309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c22b40 0x5593b1c24120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.720+0000 7fce5cec4740 1 --2- 172.21.15.45:0/1489336309 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c215d0 0x5593b1c38340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.720+0000 7fce5cec4740 1 -- 172.21.15.45:0/1489336309 >> 172.21.15.45:0/1489336309 conn(0x5593b1bea310 msgr2=0x5593b1c2b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.720+0000 7fce5cec4740 1 -- 172.21.15.45:0/1489336309 shutdown_connections 2024-09-15T22:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.720+0000 7fce5cec4740 1 -- 172.21.15.45:0/1489336309 wait complete. 2024-09-15T22:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.721+0000 7fce5cec4740 1 -- start start 2024-09-15T22:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.721+0000 7fce5cec4740 1 Processor -- start 2024-09-15T22:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.721+0000 7fce5cec4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c215d0 0x5593b1c344b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.721+0000 7fce5cec4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 0x5593b1c349f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.721+0000 7fce5cec4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c2c370 0x5593b1c25610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.721+0000 7fce5cec4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fce541affa0 con 0x5593b1c22b40 2024-09-15T22:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.721+0000 7fce5cec4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fce541b1410 con 0x5593b1c215d0 2024-09-15T22:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.721+0000 7fce5cec4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fce541b0670 con 0x5593b1c2c370 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.721+0000 7fce5cec4740 10 client.0 _ll_register_callbacks cb 0x7fce4000ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.721+0000 7fce58887640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 0x5593b1c349f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.721+0000 7fce58887640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 0x5593b1c349f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37024/0 (socket says 172.21.15.45:37024) 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.721+0000 7fce58887640 1 -- 172.21.15.45:0/755679319 learned_addr learned my addr 172.21.15.45:0/755679319 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce53fff640 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c2c370 0x5593b1c25610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce58887640 1 -- 172.21.15.45:0/755679319 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c2c370 msgr2=0x5593b1c25610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce58887640 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c2c370 0x5593b1c25610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce53fff640 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c215d0 0x5593b1c344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce58887640 1 -- 172.21.15.45:0/755679319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c215d0 msgr2=0x5593b1c344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce58887640 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c215d0 0x5593b1c344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce58887640 1 -- 172.21.15.45:0/755679319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593b1c25bd0 con 0x5593b1c22b40 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce53fff640 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c215d0 0x5593b1c344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce58887640 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 0x5593b1c349f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fce4800bd20 tx=0x7fce4800d5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54df271b3985be1b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce33fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce33fff640 1 -- 172.21.15.45:0/755679319 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce48023050 con 0x5593b1c22b40 2024-09-15T22:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce33fff640 1 -- 172.21.15.45:0/755679319 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fce48014a10 con 0x5593b1c22b40 2024-09-15T22:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce5cec4740 1 -- 172.21.15.45:0/755679319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce40004220 con 0x5593b1c22b40 2024-09-15T22:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce33fff640 1 -- 172.21.15.45:0/755679319 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fce4803b050 con 0x5593b1c22b40 2024-09-15T22:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce5cec4740 10 client.16449 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce5cec4740 1 -- 172.21.15.45:0/755679319 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5593b1ca6110 con 0x5593b1c22b40 2024-09-15T22:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.722+0000 7fce33fff640 1 -- 172.21.15.45:0/755679319 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fce40004220 con 0x5593b1c22b40 2024-09-15T22:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.723+0000 7fce33fff640 1 -- 172.21.15.45:0/755679319 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fce48034770 con 0x5593b1c22b40 2024-09-15T22:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.723+0000 7fce5cec4740 10 client.16449 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.723+0000 7fce5cec4740 10 client.16449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.723+0000 7fce5cec4740 20 client.16449 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.723+0000 7fce5cec4740 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5593b1ca6860 0x5593b1ca8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.723+0000 7fce5cec4740 4 client.16449 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.723+0000 7fce5cec4740 1 -- 172.21.15.45:0/755679319 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5593b1b8ed70 con 0x5593b1ca6860 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.723+0000 7fce53fff640 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5593b1ca6860 0x5593b1ca8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.723+0000 7fce53fff640 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5593b1ca6860 0x5593b1ca8c80 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbe64682e6a8dceb server_cookie=99ae0385f81cffea in_seq=0 out_seq=0 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.723+0000 7fce33fff640 10 client.16449 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce33fff640 1 -- 172.21.15.45:0/755679319 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5593b1b8ed70 con 0x5593b1ca6860 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce33fff640 10 client.16449 handle_command_reply: tid=0 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce5cec4740 1 client.16449 shutdown 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce5cec4740 1 -- 172.21.15.45:0/755679319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 msgr2=0x5593b1c349f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce5cec4740 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 0x5593b1c349f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fce4800bd20 tx=0x7fce4800d5b0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce5cec4740 1 -- 172.21.15.45:0/755679319 shutdown_connections 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce5cec4740 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5593b1ca6860 0x5593b1ca8c80 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce5cec4740 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5593b1c2c370 0x5593b1c25610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce5cec4740 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5593b1c22b40 0x5593b1c349f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce5cec4740 1 --2- 172.21.15.45:0/755679319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5593b1c215d0 0x5593b1c344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce33fff640 0 client.16449 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce5cec4740 1 -- 172.21.15.45:0/755679319 >> 172.21.15.45:0/755679319 conn(0x5593b1bea310 msgr2=0x5593b1c277c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce5cec4740 1 -- 172.21.15.45:0/755679319 shutdown_connections 2024-09-15T22:21:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce5cec4740 1 -- 172.21.15.45:0/755679319 wait complete. 2024-09-15T22:21:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.724+0000 7fce5cec4740 20 client.16449 trim_cache size 0 max 16384 2024-09-15T22:21:56.731 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:21:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.725+0000 7fce5aaeb640 1 -- 172.21.15.45:0/4215651462 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fce440a3430 msgr2=0x7fce440a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.725+0000 7fce5aaeb640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fce440a3430 0x7fce440a58f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fce4c0ba0d0 tx=0x7fce4c08c3f0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.725+0000 7fce5aaeb640 1 -- 172.21.15.45:0/4215651462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce54106f10 msgr2=0x7fce54074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.725+0000 7fce5aaeb640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce54106f10 0x7fce54074f70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009dc0 tx=0x7fce4c031b10 comp rx=0 tx=0).stop 2024-09-15T22:21:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.725+0000 7fce5aaeb640 1 -- 172.21.15.45:0/4215651462 shutdown_connections 2024-09-15T22:21:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.725+0000 7fce5aaeb640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fce440a3430 0x7fce440a58f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.725+0000 7fce5aaeb640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce54106f10 0x7fce54074f70 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.725+0000 7fce5aaeb640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fce54102790 0x7fce54074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.725+0000 7fce5aaeb640 1 --2- 172.21.15.45:0/4215651462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce54101de0 0x7fce540744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.725+0000 7fce5aaeb640 1 -- 172.21.15.45:0/4215651462 >> 172.21.15.45:0/4215651462 conn(0x7fce540fd8c0 msgr2=0x7fce540ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.725+0000 7fce5aaeb640 1 -- 172.21.15.45:0/4215651462 shutdown_connections 2024-09-15T22:21:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:56.725+0000 7fce5aaeb640 1 -- 172.21.15.45:0/4215651462 wait complete. 2024-09-15T22:21:57.607 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:57 smithi045 ceph-mon[31180]: pgmap v174: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:57.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:57 smithi165 ceph-mon[35551]: pgmap v174: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:57.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:57 smithi100 ceph-mon[35319]: pgmap v174: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:58.609 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:21:58.610 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:21:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:21:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.392+0000 7fd1ed057640 1 -- 172.21.15.45:0/1544330916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e8102d50 msgr2=0x7fd1e8103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.392+0000 7fd1ed057640 1 --2- 172.21.15.45:0/1544330916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e8102d50 0x7fd1e8103130 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8009900 tx=0x7fd1d802a480 comp rx=0 tx=0).stop 2024-09-15T22:21:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.392+0000 7fd1ed057640 1 -- 172.21.15.45:0/1544330916 shutdown_connections 2024-09-15T22:21:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.392+0000 7fd1ed057640 1 --2- 172.21.15.45:0/1544330916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e810c180 0x7fd1e810e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.392+0000 7fd1ed057640 1 --2- 172.21.15.45:0/1544330916 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1e8103670 0x7fd1e810bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.392+0000 7fd1ed057640 1 --2- 172.21.15.45:0/1544330916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e8102d50 0x7fd1e8103130 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.392+0000 7fd1ed057640 1 -- 172.21.15.45:0/1544330916 >> 172.21.15.45:0/1544330916 conn(0x7fd1e80fc7d0 msgr2=0x7fd1e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.393+0000 7fd1ed057640 1 -- 172.21.15.45:0/1544330916 shutdown_connections 2024-09-15T22:21:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.393+0000 7fd1ed057640 1 -- 172.21.15.45:0/1544330916 wait complete. 2024-09-15T22:21:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.393+0000 7fd1ed057640 1 Processor -- start 2024-09-15T22:21:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.393+0000 7fd1ed057640 1 -- start start 2024-09-15T22:21:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1ed057640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e8102d50 0x7fd1e81009b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1ed057640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1e8103670 0x7fd1e8100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1ed057640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e810c180 0x7fd1e8101430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1ed057640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81120a0 con 0x7fd1e810c180 2024-09-15T22:21:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1ed057640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e8111f20 con 0x7fd1e8102d50 2024-09-15T22:21:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1ed057640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e8112220 con 0x7fd1e8103670 2024-09-15T22:21:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1e759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e810c180 0x7fd1e8101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1e759e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e810c180 0x7fd1e8101430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37036/0 (socket says 172.21.15.45:37036) 2024-09-15T22:21:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1e759e640 1 -- 172.21.15.45:0/1201480372 learned_addr learned my addr 172.21.15.45:0/1201480372 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1e659c640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1e8103670 0x7fd1e8100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1e6d9d640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e8102d50 0x7fd1e81009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1e759e640 1 -- 172.21.15.45:0/1201480372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1e8103670 msgr2=0x7fd1e8100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1e759e640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1e8103670 0x7fd1e8100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1e759e640 1 -- 172.21.15.45:0/1201480372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e8102d50 msgr2=0x7fd1e81009b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1e759e640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e8102d50 0x7fd1e81009b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1e759e640 1 -- 172.21.15.45:0/1201480372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e81a6a00 con 0x7fd1e810c180 2024-09-15T22:21:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1e759e640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e810c180 0x7fd1e8101430 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000eaa0 tx=0x7fd1e000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.394+0000 7fd1cffff640 1 -- 172.21.15.45:0/1201480372 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e000cdb0 con 0x7fd1e810c180 2024-09-15T22:21:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.395+0000 7fd1ed057640 1 -- 172.21.15.45:0/1201480372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e81a6cf0 con 0x7fd1e810c180 2024-09-15T22:21:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.395+0000 7fd1cffff640 1 -- 172.21.15.45:0/1201480372 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd1e0004b20 con 0x7fd1e810c180 2024-09-15T22:21:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.395+0000 7fd1cffff640 1 -- 172.21.15.45:0/1201480372 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1e0011760 con 0x7fd1e810c180 2024-09-15T22:21:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.395+0000 7fd1ed057640 1 -- 172.21.15.45:0/1201480372 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e81a71e0 con 0x7fd1e810c180 2024-09-15T22:21:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.397+0000 7fd1cffff640 1 -- 172.21.15.45:0/1201480372 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd1e0004cd0 con 0x7fd1e810c180 2024-09-15T22:21:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.397+0000 7fd1ef430740 1 Processor -- start 2024-09-15T22:21:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.397+0000 7fd1ef430740 1 -- start start 2024-09-15T22:21:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1ef430740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684653b60 0x555684653f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1ef430740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555684654480 0x55568465e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1ef430740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 0x555684661130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1ef430740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5556845b9280 con 0x55568465ed40 2024-09-15T22:21:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1ef430740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555684560b10 con 0x555684653b60 2024-09-15T22:21:59.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1ef430740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5556845b5240 con 0x555684654480 2024-09-15T22:21:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1e659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 0x555684661130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1cffff640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd1d00a33b0 0x7fd1d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1e659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 0x555684661130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37044/0 (socket says 172.21.15.45:37044) 2024-09-15T22:21:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1e659c640 1 -- 172.21.15.45:0/614556411 learned_addr learned my addr 172.21.15.45:0/614556411 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1e6d9d640 1 --2- 172.21.15.45:0/614556411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555684654480 0x55568465e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1e659c640 1 --2- 172.21.15.45:0/614556411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684653b60 0x555684653f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1e759e640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd1d00a33b0 0x7fd1d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1cffff640 1 -- 172.21.15.45:0/1201480372 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fd1e00d02c0 con 0x7fd1e810c180 2024-09-15T22:21:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1e659c640 1 -- 172.21.15.45:0/614556411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555684654480 msgr2=0x55568465e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1e659c640 1 --2- 172.21.15.45:0/614556411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555684654480 0x55568465e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1e659c640 1 -- 172.21.15.45:0/614556411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684653b60 msgr2=0x555684653f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1e659c640 1 --2- 172.21.15.45:0/614556411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684653b60 0x555684653f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.398+0000 7fd1e659c640 1 -- 172.21.15.45:0/614556411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55568456d1f0 con 0x55568465ed40 2024-09-15T22:21:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.399+0000 7fd1e659c640 1 --2- 172.21.15.45:0/614556411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 0x555684661130 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc012770 tx=0x7fd1dc00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648b562fdd62e79b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.399+0000 7fd1e759e640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd1d00a33b0 0x7fd1d00a5870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0098690 tx=0x7fd1e00bc040 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.399+0000 7fd1cd7fa640 1 -- 172.21.15.45:0/614556411 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc004030 con 0x55568465ed40 2024-09-15T22:21:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.399+0000 7fd1cd7fa640 1 -- 172.21.15.45:0/614556411 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd1dc005520 con 0x55568465ed40 2024-09-15T22:21:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.399+0000 7fd1cd7fa640 1 -- 172.21.15.45:0/614556411 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc004e40 con 0x55568465ed40 2024-09-15T22:21:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.399+0000 7fd1ef430740 1 -- 172.21.15.45:0/614556411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 msgr2=0x555684661130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.399+0000 7fd1ef430740 1 --2- 172.21.15.45:0/614556411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 0x555684661130 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc012770 tx=0x7fd1dc00b7b0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 -- 172.21.15.45:0/614556411 shutdown_connections 2024-09-15T22:21:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 --2- 172.21.15.45:0/614556411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 0x555684661130 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 --2- 172.21.15.45:0/614556411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555684654480 0x55568465e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 --2- 172.21.15.45:0/614556411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684653b60 0x555684653f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 -- 172.21.15.45:0/614556411 >> 172.21.15.45:0/614556411 conn(0x5556846500f0 msgr2=0x5556846504d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 -- 172.21.15.45:0/614556411 shutdown_connections 2024-09-15T22:21:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 -- 172.21.15.45:0/614556411 wait complete. 2024-09-15T22:21:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 -- start start 2024-09-15T22:21:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 Processor -- start 2024-09-15T22:21:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684653b60 0x55568465bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684654480 0x55568465c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55568465ed40 0x55568465c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555684661910 con 0x555684654480 2024-09-15T22:21:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555684573f10 con 0x555684653b60 2024-09-15T22:21:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555684661a90 con 0x55568465ed40 2024-09-15T22:21:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1ef430740 10 client.0 _ll_register_callbacks cb 0x55568453ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1e6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684654480 0x55568465c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1e6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684654480 0x55568465c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37060/0 (socket says 172.21.15.45:37060) 2024-09-15T22:21:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.400+0000 7fd1e6d9d640 1 -- 172.21.15.45:0/3021608985 learned_addr learned my addr 172.21.15.45:0/3021608985 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1e659c640 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684653b60 0x55568465bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1e659c640 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55568465ed40 0x55568465c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1e6d9d640 1 -- 172.21.15.45:0/3021608985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55568465ed40 msgr2=0x55568465c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1e6d9d640 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55568465ed40 0x55568465c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1e6d9d640 1 -- 172.21.15.45:0/3021608985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684653b60 msgr2=0x55568465bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1e6d9d640 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684653b60 0x55568465bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1e6d9d640 1 -- 172.21.15.45:0/3021608985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55568432a6a0 con 0x555684654480 2024-09-15T22:21:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1e659c640 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684653b60 0x55568465bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1e6d9d640 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684654480 0x55568465c130 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd1d802a9a0 tx=0x7fd1d80318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa1f142a3488ca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1caff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1caff5640 1 -- 172.21.15.45:0/3021608985 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8035040 con 0x555684654480 2024-09-15T22:21:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1caff5640 1 -- 172.21.15.45:0/3021608985 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fd1d8004240 con 0x555684654480 2024-09-15T22:21:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1ef430740 1 -- 172.21.15.45:0/3021608985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1dc005520 con 0x555684654480 2024-09-15T22:21:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1caff5640 1 -- 172.21.15.45:0/3021608985 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd1d8004440 con 0x555684654480 2024-09-15T22:21:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1ef430740 10 client.16461 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1ef430740 1 -- 172.21.15.45:0/3021608985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55568466d510 con 0x555684654480 2024-09-15T22:21:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.401+0000 7fd1caff5640 1 -- 172.21.15.45:0/3021608985 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd1dc005520 con 0x555684654480 2024-09-15T22:21:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.402+0000 7fd1caff5640 1 -- 172.21.15.45:0/3021608985 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd1d8046820 con 0x555684654480 2024-09-15T22:21:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.402+0000 7fd1ef430740 10 client.16461 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.402+0000 7fd1ef430740 10 client.16461 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.402+0000 7fd1ef430740 20 client.16461 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.402+0000 7fd1ef430740 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55568466e9d0 0x555684670e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.402+0000 7fd1ef430740 4 client.16461 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:21:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.402+0000 7fd1ef430740 1 -- 172.21.15.45:0/3021608985 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556845c67f0 con 0x55568466e9d0 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.402+0000 7fd1e659c640 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55568466e9d0 0x555684670e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.402+0000 7fd1caff5640 10 client.16461 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.402+0000 7fd1e659c640 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55568466e9d0 0x555684670e00 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f155bde2a302dd3 server_cookie=3416b923af4f677d in_seq=0 out_seq=0 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1caff5640 1 -- 172.21.15.45:0/3021608985 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556845c67f0 con 0x55568466e9d0 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1caff5640 10 client.16461 handle_command_reply: tid=0 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1ef430740 1 client.16461 shutdown 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1ef430740 1 -- 172.21.15.45:0/3021608985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684654480 msgr2=0x55568465c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1ef430740 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684654480 0x55568465c130 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd1d802a9a0 tx=0x7fd1d80318e0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1ef430740 1 -- 172.21.15.45:0/3021608985 shutdown_connections 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1ef430740 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55568466e9d0 0x555684670e00 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1ef430740 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55568465ed40 0x55568465c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1ef430740 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684654480 0x55568465c130 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1ef430740 1 --2- 172.21.15.45:0/3021608985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684653b60 0x55568465bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1caff5640 0 client.16461 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1ef430740 1 -- 172.21.15.45:0/3021608985 >> 172.21.15.45:0/3021608985 conn(0x5556846500f0 msgr2=0x555684655dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:59.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1ef430740 1 -- 172.21.15.45:0/3021608985 shutdown_connections 2024-09-15T22:21:59.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.403+0000 7fd1ef430740 1 -- 172.21.15.45:0/3021608985 wait complete. 2024-09-15T22:21:59.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.404+0000 7fd1ef430740 20 client.16461 trim_cache size 0 max 16384 2024-09-15T22:21:59.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.421+0000 7fd1ef430740 1 Processor -- start 2024-09-15T22:21:59.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.421+0000 7fd1ef430740 1 -- start start 2024-09-15T22:21:59.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.421+0000 7fd1ef430740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555684653b60 0x55568465da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.421+0000 7fd1ef430740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684654480 0x5556846766d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.421+0000 7fd1ef430740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 0x555684676c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.421+0000 7fd1ef430740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81af370 con 0x55568465ed40 2024-09-15T22:21:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.421+0000 7fd1ef430740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81b1bf0 con 0x555684654480 2024-09-15T22:21:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.421+0000 7fd1ef430740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81af9e0 con 0x555684653b60 2024-09-15T22:21:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.421+0000 7fd1e659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 0x555684676c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.421+0000 7fd1e659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 0x555684676c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37076/0 (socket says 172.21.15.45:37076) 2024-09-15T22:21:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.421+0000 7fd1e659c640 1 -- 172.21.15.45:0/840774979 learned_addr learned my addr 172.21.15.45:0/840774979 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.422+0000 7fd1e659c640 1 -- 172.21.15.45:0/840774979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555684653b60 msgr2=0x55568465da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.422+0000 7fd1e659c640 1 --2- 172.21.15.45:0/840774979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555684653b60 0x55568465da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.422+0000 7fd1e659c640 1 -- 172.21.15.45:0/840774979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684654480 msgr2=0x5556846766d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.422+0000 7fd1e659c640 1 --2- 172.21.15.45:0/840774979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684654480 0x5556846766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.422+0000 7fd1e659c640 1 -- 172.21.15.45:0/840774979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555684671480 con 0x55568465ed40 2024-09-15T22:21:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.422+0000 7fd1e659c640 1 --2- 172.21.15.45:0/840774979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 0x555684676c10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc012740 tx=0x7fd1dc00bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff926833cbcdc26 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.422+0000 7fd1ccff9640 1 -- 172.21.15.45:0/840774979 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc02f070 con 0x55568465ed40 2024-09-15T22:21:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.422+0000 7fd1ccff9640 1 -- 172.21.15.45:0/840774979 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd1dc029810 con 0x55568465ed40 2024-09-15T22:21:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.422+0000 7fd1ccff9640 1 -- 172.21.15.45:0/840774979 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc01f5f0 con 0x55568465ed40 2024-09-15T22:21:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 -- 172.21.15.45:0/840774979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 msgr2=0x555684676c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 --2- 172.21.15.45:0/840774979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 0x555684676c10 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc012740 tx=0x7fd1dc00bbd0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 -- 172.21.15.45:0/840774979 shutdown_connections 2024-09-15T22:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 --2- 172.21.15.45:0/840774979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55568465ed40 0x555684676c10 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 --2- 172.21.15.45:0/840774979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684654480 0x5556846766d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 --2- 172.21.15.45:0/840774979 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555684653b60 0x55568465da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 -- 172.21.15.45:0/840774979 >> 172.21.15.45:0/840774979 conn(0x5556846500f0 msgr2=0x55568465d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 -- 172.21.15.45:0/840774979 shutdown_connections 2024-09-15T22:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 -- 172.21.15.45:0/840774979 wait complete. 2024-09-15T22:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 -- start start 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 Processor -- start 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684653b60 0x555684662c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684654480 0x555684663190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55568465ed40 0x5556846636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81b00b0 con 0x555684653b60 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81b1520 con 0x555684654480 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e81b0780 con 0x55568465ed40 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1ef430740 10 client.0 _ll_register_callbacks cb 0x7fd1d8009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.423+0000 7fd1e659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684653b60 0x555684662c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1e659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684653b60 0x555684662c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37092/0 (socket says 172.21.15.45:37092) 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1e659c640 1 -- 172.21.15.45:0/2363025285 learned_addr learned my addr 172.21.15.45:0/2363025285 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1e659c640 1 -- 172.21.15.45:0/2363025285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55568465ed40 msgr2=0x5556846636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1e6d9d640 1 --2- 172.21.15.45:0/2363025285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684654480 0x555684663190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1e659c640 1 --2- 172.21.15.45:0/2363025285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55568465ed40 0x5556846636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1e659c640 1 -- 172.21.15.45:0/2363025285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684654480 msgr2=0x555684663190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1e659c640 1 --2- 172.21.15.45:0/2363025285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684654480 0x555684663190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1e659c640 1 -- 172.21.15.45:0/2363025285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556846d88a0 con 0x555684653b60 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1e6d9d640 1 --2- 172.21.15.45:0/2363025285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684654480 0x555684663190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1e659c640 1 --2- 172.21.15.45:0/2363025285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684653b60 0x555684662c50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc02d040 tx=0x7fd1dc00bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a620fa70e983f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1caff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1caff5640 1 -- 172.21.15.45:0/2363025285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc02f070 con 0x555684653b60 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1caff5640 1 -- 172.21.15.45:0/2363025285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fd1dc029510 con 0x555684653b60 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1ef430740 1 -- 172.21.15.45:0/2363025285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1dc029810 con 0x555684653b60 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1caff5640 1 -- 172.21.15.45:0/2363025285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd1dc03d050 con 0x555684653b60 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1ef430740 10 client.16467 fetch_fsmap learned FSMap version 21 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.424+0000 7fd1ef430740 1 -- 172.21.15.45:0/2363025285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5556846d9ba0 con 0x555684653b60 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.425+0000 7fd1caff5640 1 -- 172.21.15.45:0/2363025285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd1dc029810 con 0x555684653b60 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.425+0000 7fd1caff5640 1 -- 172.21.15.45:0/2363025285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd1dc01f5b0 con 0x555684653b60 2024-09-15T22:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.425+0000 7fd1ef430740 10 client.16467 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.425+0000 7fd1ef430740 10 client.16467 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.425+0000 7fd1ef430740 20 client.16467 populate_metadata read hostname 'smithi045' 2024-09-15T22:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.425+0000 7fd1ef430740 1 --2- 172.21.15.45:0/2363025285 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5556846d9fd0 0x5556846dc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.425+0000 7fd1ef430740 4 client.16467 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.425+0000 7fd1ef430740 1 -- 172.21.15.45:0/2363025285 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5556845c0d00 con 0x5556846d9fd0 2024-09-15T22:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.425+0000 7fd1e6d9d640 1 --2- 172.21.15.45:0/2363025285 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5556846d9fd0 0x5556846dc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.426+0000 7fd1e6d9d640 1 --2- 172.21.15.45:0/2363025285 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5556846d9fd0 0x5556846dc3c0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9deb381983b5b166 server_cookie=1c1abf9ecfca1f71 in_seq=0 out_seq=0 2024-09-15T22:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.426+0000 7fd1caff5640 10 client.16467 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.426+0000 7fd1caff5640 1 -- 172.21.15.45:0/2363025285 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5556845c0d00 con 0x5556846d9fd0 2024-09-15T22:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.426+0000 7fd1caff5640 10 client.16467 handle_command_reply: tid=0 2024-09-15T22:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.426+0000 7fd1ef430740 1 client.16467 shutdown 2024-09-15T22:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ef430740 1 -- 172.21.15.45:0/2363025285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684653b60 msgr2=0x555684662c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ef430740 1 --2- 172.21.15.45:0/2363025285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684653b60 0x555684662c50 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc02d040 tx=0x7fd1dc00bb10 comp rx=0 tx=0).stop 2024-09-15T22:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ef430740 1 -- 172.21.15.45:0/2363025285 shutdown_connections 2024-09-15T22:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ef430740 1 --2- 172.21.15.45:0/2363025285 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5556846d9fd0 0x5556846dc3c0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ef430740 1 --2- 172.21.15.45:0/2363025285 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55568465ed40 0x5556846636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ef430740 1 --2- 172.21.15.45:0/2363025285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555684654480 0x555684663190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ef430740 1 --2- 172.21.15.45:0/2363025285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555684653b60 0x555684662c50 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1caff5640 0 client.16467 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ef430740 1 -- 172.21.15.45:0/2363025285 >> 172.21.15.45:0/2363025285 conn(0x5556846500f0 msgr2=0x555684655dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ef430740 1 -- 172.21.15.45:0/2363025285 shutdown_connections 2024-09-15T22:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ef430740 1 -- 172.21.15.45:0/2363025285 wait complete. 2024-09-15T22:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ef430740 20 client.16467 trim_cache size 0 max 16384 2024-09-15T22:21:59.433 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:21:59.433 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:21:59.433 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "cf8b728f-ce18-4c08-add5-8dadaa667e51", 2024-09-15T22:21:59.434 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:21:59.434 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:21:59.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ed057640 1 -- 172.21.15.45:0/1201480372 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd1d00a33b0 msgr2=0x7fd1d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ed057640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd1d00a33b0 0x7fd1d00a5870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0098690 tx=0x7fd1e00bc040 comp rx=0 tx=0).stop 2024-09-15T22:21:59.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ed057640 1 -- 172.21.15.45:0/1201480372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e810c180 msgr2=0x7fd1e8101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:21:59.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ed057640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e810c180 0x7fd1e8101430 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000eaa0 tx=0x7fd1e000ef60 comp rx=0 tx=0).stop 2024-09-15T22:21:59.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ed057640 1 -- 172.21.15.45:0/1201480372 shutdown_connections 2024-09-15T22:21:59.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ed057640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd1d00a33b0 0x7fd1d00a5870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ed057640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e810c180 0x7fd1e8101430 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ed057640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd1e8103670 0x7fd1e8100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ed057640 1 --2- 172.21.15.45:0/1201480372 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e8102d50 0x7fd1e81009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:21:59.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.427+0000 7fd1ed057640 1 -- 172.21.15.45:0/1201480372 >> 172.21.15.45:0/1201480372 conn(0x7fd1e80fc7d0 msgr2=0x7fd1e80fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:21:59.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.428+0000 7fd1ed057640 1 -- 172.21.15.45:0/1201480372 shutdown_connections 2024-09-15T22:21:59.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:21:59.428+0000 7fd1ed057640 1 -- 172.21.15.45:0/1201480372 wait complete. 2024-09-15T22:21:59.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:21:59 smithi165 ceph-mon[35551]: pgmap v175: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:59.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:21:59 smithi100 ceph-mon[35319]: pgmap v175: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:21:59.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:21:59 smithi045 ceph-mon[31180]: pgmap v175: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:00.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:22:00.567 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:00.688 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:00 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:22:00.688 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:00 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:22:00.689 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:00 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:22:00.689 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:00 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:22:00.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:00 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:22:00.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:00 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:22:00.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:00 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:22:00.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:00 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:22:00.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:00 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:22:00.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:00 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:22:00.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:00 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:22:00.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:00 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:22:01.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.066+0000 7feceae6f640 1 -- 172.21.15.45:0/3441315470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece4106f10 msgr2=0x7fece410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.066+0000 7feceae6f640 1 --2- 172.21.15.45:0/3441315470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece4106f10 0x7fece410ea90 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009ca0 tx=0x7fecdc02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.066+0000 7feceae6f640 1 -- 172.21.15.45:0/3441315470 shutdown_connections 2024-09-15T22:22:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.066+0000 7feceae6f640 1 --2- 172.21.15.45:0/3441315470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece4106f10 0x7fece410ea90 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.066+0000 7feceae6f640 1 --2- 172.21.15.45:0/3441315470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece4102790 0x7fece41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.066+0000 7feceae6f640 1 --2- 172.21.15.45:0/3441315470 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece4101de0 0x7fece41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.066+0000 7feceae6f640 1 -- 172.21.15.45:0/3441315470 >> 172.21.15.45:0/3441315470 conn(0x7fece40fd8c0 msgr2=0x7fece40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.067+0000 7feceae6f640 1 -- 172.21.15.45:0/3441315470 shutdown_connections 2024-09-15T22:22:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.067+0000 7feceae6f640 1 -- 172.21.15.45:0/3441315470 wait complete. 2024-09-15T22:22:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.067+0000 7feceae6f640 1 Processor -- start 2024-09-15T22:22:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.067+0000 7feceae6f640 1 -- start start 2024-09-15T22:22:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.067+0000 7feceae6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece4101de0 0x7fece4198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.067+0000 7feceae6f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece4102790 0x7fece4198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.067+0000 7feceae6f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece4106f10 0x7fece419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.067+0000 7feceae6f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fece41120d0 con 0x7fece4101de0 2024-09-15T22:22:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.067+0000 7feceae6f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fece4111f50 con 0x7fece4106f10 2024-09-15T22:22:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.067+0000 7feceae6f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fece4112250 con 0x7fece4102790 2024-09-15T22:22:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.067+0000 7fece8c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece4101de0 0x7fece4198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.067+0000 7fece8c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece4101de0 0x7fece4198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37108/0 (socket says 172.21.15.45:37108) 2024-09-15T22:22:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.067+0000 7fece8c0b640 1 -- 172.21.15.45:0/2089268720 learned_addr learned my addr 172.21.15.45:0/2089268720 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7fece940c640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece4106f10 0x7fece419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7fece3fff640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece4102790 0x7fece4198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7fece8c0b640 1 -- 172.21.15.45:0/2089268720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece4102790 msgr2=0x7fece4198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7fece8c0b640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece4102790 0x7fece4198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7fece8c0b640 1 -- 172.21.15.45:0/2089268720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece4106f10 msgr2=0x7fece419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7fece8c0b640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece4106f10 0x7fece419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7fece8c0b640 1 -- 172.21.15.45:0/2089268720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece419d4b0 con 0x7fece4101de0 2024-09-15T22:22:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7fece3fff640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece4102790 0x7fece4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7fece940c640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece4106f10 0x7fece419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7fece8c0b640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece4101de0 0x7fece4198500 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fecd800b4a0 tx=0x7fecd800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7fece1ffb640 1 -- 172.21.15.45:0/2089268720 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd8014070 con 0x7fece4101de0 2024-09-15T22:22:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7feceae6f640 1 -- 172.21.15.45:0/2089268720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece419d7a0 con 0x7fece4101de0 2024-09-15T22:22:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7fece1ffb640 1 -- 172.21.15.45:0/2089268720 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fecd8010b10 con 0x7fece4101de0 2024-09-15T22:22:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7fece1ffb640 1 -- 172.21.15.45:0/2089268720 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd8017d60 con 0x7fece4101de0 2024-09-15T22:22:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.068+0000 7feceae6f640 1 -- 172.21.15.45:0/2089268720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece41a5080 con 0x7fece4101de0 2024-09-15T22:22:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7fece1ffb640 1 -- 172.21.15.45:0/2089268720 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fecd8017070 con 0x7fece4101de0 2024-09-15T22:22:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7feced248740 1 Processor -- start 2024-09-15T22:22:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7feced248740 1 -- start start 2024-09-15T22:22:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7feced248740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 0x558c453ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7feced248740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7feced248740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453b7680 0x558c453b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7feced248740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558c453122e0 con 0x558c453ac4a0 2024-09-15T22:22:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7feced248740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558c452b9ce0 con 0x558c453acdc0 2024-09-15T22:22:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7feced248740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558c4530e2a0 con 0x558c453b7680 2024-09-15T22:22:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7fece940c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 0x558c453ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7fece940c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 0x558c453ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37118/0 (socket says 172.21.15.45:37118) 2024-09-15T22:22:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7fece940c640 1 -- 172.21.15.45:0/989629555 learned_addr learned my addr 172.21.15.45:0/989629555 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7fece8c0b640 1 --2- 172.21.15.45:0/989629555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.071+0000 7fece1ffb640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fecd40a33b0 0x7fecd40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.072+0000 7fece3fff640 1 --2- 172.21.15.45:0/989629555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453b7680 0x558c453b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.072+0000 7fece940c640 1 -- 172.21.15.45:0/989629555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453b7680 msgr2=0x558c453b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:01.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.072+0000 7fece940c640 1 --2- 172.21.15.45:0/989629555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453b7680 0x558c453b9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.072+0000 7fece940c640 1 -- 172.21.15.45:0/989629555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 msgr2=0x558c453b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.072+0000 7fece940c640 1 --2- 172.21.15.45:0/989629555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453b7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.072+0000 7fece940c640 1 -- 172.21.15.45:0/989629555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c4529e440 con 0x558c453ac4a0 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.072+0000 7fece1ffb640 1 -- 172.21.15.45:0/2089268720 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fecd80cf490 con 0x7fece4101de0 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.072+0000 7fece940c640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fecd40a33b0 0x7fecd40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.072+0000 7fece940c640 1 --2- 172.21.15.45:0/989629555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 0x558c453ac880 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009a10 tx=0x7fecdc031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92cf491482895d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.072+0000 7fecceffd640 1 -- 172.21.15.45:0/989629555 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc041040 con 0x558c453ac4a0 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.072+0000 7fecceffd640 1 -- 172.21.15.45:0/989629555 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fecdc036070 con 0x558c453ac4a0 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.072+0000 7fecceffd640 1 -- 172.21.15.45:0/989629555 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc02fb40 con 0x558c453ac4a0 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.073+0000 7feced248740 1 -- 172.21.15.45:0/989629555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 msgr2=0x558c453ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.073+0000 7fece940c640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fecd40a33b0 0x7fecd40a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fecdc04c000 tx=0x7fecdc04d000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.073+0000 7feced248740 1 --2- 172.21.15.45:0/989629555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 0x558c453ac880 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009a10 tx=0x7fecdc031bb0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.073+0000 7feced248740 1 -- 172.21.15.45:0/989629555 shutdown_connections 2024-09-15T22:22:01.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.073+0000 7feced248740 1 --2- 172.21.15.45:0/989629555 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453b7680 0x558c453b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.073+0000 7feced248740 1 --2- 172.21.15.45:0/989629555 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453b7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.073+0000 7feced248740 1 --2- 172.21.15.45:0/989629555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 0x558c453ac880 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.073+0000 7feced248740 1 -- 172.21.15.45:0/989629555 >> 172.21.15.45:0/989629555 conn(0x558c453a8a30 msgr2=0x558c453a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.073+0000 7feced248740 1 -- 172.21.15.45:0/989629555 shutdown_connections 2024-09-15T22:22:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.073+0000 7feced248740 1 -- 172.21.15.45:0/989629555 wait complete. 2024-09-15T22:22:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.073+0000 7feced248740 1 -- start start 2024-09-15T22:22:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.073+0000 7feced248740 1 Processor -- start 2024-09-15T22:22:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7feced248740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 0x558c453b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7feced248740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453b4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7feced248740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453b7680 0x558c453b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7feced248740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558c453ba250 con 0x558c453ac4a0 2024-09-15T22:22:01.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7feced248740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x558c452cd050 con 0x558c453acdc0 2024-09-15T22:22:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7feced248740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x558c453ba3d0 con 0x558c453b7680 2024-09-15T22:22:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7feced248740 10 client.0 _ll_register_callbacks cb 0x558c4530d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fece8c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 0x558c453b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fece8c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 0x558c453b6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37122/0 (socket says 172.21.15.45:37122) 2024-09-15T22:22:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fece8c0b640 1 -- 172.21.15.45:0/2536237999 learned_addr learned my addr 172.21.15.45:0/2536237999 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fece940c640 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453b7680 0x558c453b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fece3fff640 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fece8c0b640 1 -- 172.21.15.45:0/2536237999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453b7680 msgr2=0x558c453b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fece8c0b640 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453b7680 0x558c453b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fece8c0b640 1 -- 172.21.15.45:0/2536237999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 msgr2=0x558c453b4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:01.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fece8c0b640 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453b4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fece8c0b640 1 -- 172.21.15.45:0/2536237999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c450833c0 con 0x558c453ac4a0 2024-09-15T22:22:01.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fece940c640 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453b7680 0x558c453b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:01.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fece3fff640 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:01.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fece8c0b640 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 0x558c453b6fa0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fecd80cc990 tx=0x7fecd800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e014b2395d326776 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:01.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fecc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:22:01.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.074+0000 7fecc3fff640 1 -- 172.21.15.45:0/2536237999 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd801e050 con 0x558c453ac4a0 2024-09-15T22:22:01.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.075+0000 7fecc3fff640 1 -- 172.21.15.45:0/2536237999 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fecd80173f0 con 0x558c453ac4a0 2024-09-15T22:22:01.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.075+0000 7feced248740 1 -- 172.21.15.45:0/2536237999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecdc036070 con 0x558c453ac4a0 2024-09-15T22:22:01.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.075+0000 7fecc3fff640 1 -- 172.21.15.45:0/2536237999 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fecd809bbc0 con 0x558c453ac4a0 2024-09-15T22:22:01.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.075+0000 7feced248740 10 client.16479 fetch_fsmap learned FSMap version 21 2024-09-15T22:22:01.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.075+0000 7feced248740 1 -- 172.21.15.45:0/2536237999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558c453c5bd0 con 0x558c453ac4a0 2024-09-15T22:22:01.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.075+0000 7fecc3fff640 1 -- 172.21.15.45:0/2536237999 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fecdc036070 con 0x558c453ac4a0 2024-09-15T22:22:01.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.075+0000 7fecc3fff640 1 -- 172.21.15.45:0/2536237999 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fecd80ccaa0 con 0x558c453ac4a0 2024-09-15T22:22:01.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.075+0000 7feced248740 10 client.16479 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:22:01.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.075+0000 7feced248740 10 client.16479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:01.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.075+0000 7feced248740 20 client.16479 populate_metadata read hostname 'smithi045' 2024-09-15T22:22:01.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.075+0000 7feced248740 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558c453c7090 0x558c453c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.075+0000 7feced248740 4 client.16479 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:22:01.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.075+0000 7feced248740 1 -- 172.21.15.45:0/2536237999 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c4531f850 con 0x558c453c7090 2024-09-15T22:22:01.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.076+0000 7fece3fff640 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558c453c7090 0x558c453c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.076+0000 7fece3fff640 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558c453c7090 0x558c453c94e0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f64067dc23ec976 server_cookie=ebac7c15635ea298 in_seq=0 out_seq=0 2024-09-15T22:22:01.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.076+0000 7fecc3fff640 10 client.16479 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:01.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7fecc3fff640 1 -- 172.21.15.45:0/2536237999 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c4531f850 con 0x558c453c7090 2024-09-15T22:22:01.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7fecc3fff640 10 client.16479 handle_command_reply: tid=0 2024-09-15T22:22:01.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7feced248740 1 client.16479 shutdown 2024-09-15T22:22:01.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7feced248740 1 -- 172.21.15.45:0/2536237999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 msgr2=0x558c453b6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7feced248740 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 0x558c453b6fa0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fecd80cc990 tx=0x7fecd800bf90 comp rx=0 tx=0).stop 2024-09-15T22:22:01.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7feced248740 1 -- 172.21.15.45:0/2536237999 shutdown_connections 2024-09-15T22:22:01.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7feced248740 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558c453c7090 0x558c453c94e0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7feced248740 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453b7680 0x558c453b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7feced248740 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453b4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7fecc3fff640 0 client.16479 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:01.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7feced248740 1 --2- 172.21.15.45:0/2536237999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453ac4a0 0x558c453b6fa0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7feced248740 1 -- 172.21.15.45:0/2536237999 >> 172.21.15.45:0/2536237999 conn(0x558c453a8a30 msgr2=0x558c453a7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:01.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7feced248740 1 -- 172.21.15.45:0/2536237999 shutdown_connections 2024-09-15T22:22:01.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7feced248740 1 -- 172.21.15.45:0/2536237999 wait complete. 2024-09-15T22:22:01.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.077+0000 7feced248740 20 client.16479 trim_cache size 0 max 16384 2024-09-15T22:22:01.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.094+0000 7feced248740 1 Processor -- start 2024-09-15T22:22:01.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.094+0000 7feced248740 1 -- start start 2024-09-15T22:22:01.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7feced248740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 0x558c453a7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7feced248740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453ac4a0 0x558c453a7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7feced248740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7feced248740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fece41ad1f0 con 0x558c453a8a30 2024-09-15T22:22:01.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7feced248740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fece41afa70 con 0x558c453acdc0 2024-09-15T22:22:01.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7feced248740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fece41ad860 con 0x558c453ac4a0 2024-09-15T22:22:01.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fece8c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 0x558c453a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fece8c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 0x558c453a7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37126/0 (socket says 172.21.15.45:37126) 2024-09-15T22:22:01.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fece8c0b640 1 -- 172.21.15.45:0/2284066901 learned_addr learned my addr 172.21.15.45:0/2284066901 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:01.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fece3fff640 1 --2- 172.21.15.45:0/2284066901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453ac4a0 0x558c453a7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fece940c640 1 --2- 172.21.15.45:0/2284066901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fece8c0b640 1 -- 172.21.15.45:0/2284066901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453ac4a0 msgr2=0x558c453a7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:01.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fece8c0b640 1 --2- 172.21.15.45:0/2284066901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453ac4a0 0x558c453a7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fece8c0b640 1 -- 172.21.15.45:0/2284066901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 msgr2=0x558c453cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:01.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fece8c0b640 1 --2- 172.21.15.45:0/2284066901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fece8c0b640 1 -- 172.21.15.45:0/2284066901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c453b7310 con 0x558c453a8a30 2024-09-15T22:22:01.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fece940c640 1 --2- 172.21.15.45:0/2284066901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:01.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fece8c0b640 1 --2- 172.21.15.45:0/2284066901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 0x558c453a7980 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fecd809b450 tx=0x7fecd80cf170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247c00ca804082c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:01.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fecce7fc640 1 -- 172.21.15.45:0/2284066901 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd801e030 con 0x558c453a8a30 2024-09-15T22:22:01.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.095+0000 7fecce7fc640 1 -- 172.21.15.45:0/2284066901 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fecd809f870 con 0x558c453a8a30 2024-09-15T22:22:01.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.096+0000 7fecce7fc640 1 -- 172.21.15.45:0/2284066901 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd8010de0 con 0x558c453a8a30 2024-09-15T22:22:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.096+0000 7feced248740 1 -- 172.21.15.45:0/2284066901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 msgr2=0x558c453a7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.096+0000 7feced248740 1 --2- 172.21.15.45:0/2284066901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 0x558c453a7980 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fecd809b450 tx=0x7fecd80cf170 comp rx=0 tx=0).stop 2024-09-15T22:22:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.096+0000 7feced248740 1 -- 172.21.15.45:0/2284066901 shutdown_connections 2024-09-15T22:22:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.096+0000 7feced248740 1 --2- 172.21.15.45:0/2284066901 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453acdc0 0x558c453cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.096+0000 7feced248740 1 --2- 172.21.15.45:0/2284066901 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453ac4a0 0x558c453a7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.096+0000 7feced248740 1 --2- 172.21.15.45:0/2284066901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 0x558c453a7980 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.096+0000 7feced248740 1 -- 172.21.15.45:0/2284066901 >> 172.21.15.45:0/2284066901 conn(0x558c453b48f0 msgr2=0x558c453a7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.096+0000 7feced248740 1 -- 172.21.15.45:0/2284066901 shutdown_connections 2024-09-15T22:22:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.096+0000 7feced248740 1 -- 172.21.15.45:0/2284066901 wait complete. 2024-09-15T22:22:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7feced248740 1 -- start start 2024-09-15T22:22:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7feced248740 1 Processor -- start 2024-09-15T22:22:01.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7feced248740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 0x558c453bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7feced248740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453ac4a0 0x558c453bce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7feced248740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453acdc0 0x558c453bd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7feced248740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fece41adf30 con 0x558c453a8a30 2024-09-15T22:22:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7feced248740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fece41af3a0 con 0x558c453ac4a0 2024-09-15T22:22:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7feced248740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fece41ae600 con 0x558c453acdc0 2024-09-15T22:22:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7feced248740 10 client.0 _ll_register_callbacks cb 0x7fecd800b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7fece8c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 0x558c453bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7fece8c0b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 0x558c453bfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37132/0 (socket says 172.21.15.45:37132) 2024-09-15T22:22:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7fece8c0b640 1 -- 172.21.15.45:0/2815428875 learned_addr learned my addr 172.21.15.45:0/2815428875 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7fece3fff640 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453ac4a0 0x558c453bce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.097+0000 7fece940c640 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453acdc0 0x558c453bd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7fece8c0b640 1 -- 172.21.15.45:0/2815428875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453acdc0 msgr2=0x558c453bd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7fece8c0b640 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453acdc0 0x558c453bd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7fece8c0b640 1 -- 172.21.15.45:0/2815428875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453ac4a0 msgr2=0x558c453bce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7fece8c0b640 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453ac4a0 0x558c453bce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7fece8c0b640 1 -- 172.21.15.45:0/2815428875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c453bd8d0 con 0x558c453a8a30 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7fece3fff640 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453ac4a0 0x558c453bce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7fece8c0b640 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 0x558c453bfad0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fecd809b1c0 tx=0x7fecd8010cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bade0a9ea3a13bd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7fecc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7fecc3fff640 1 -- 172.21.15.45:0/2815428875 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd801e030 con 0x558c453a8a30 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7fecc3fff640 1 -- 172.21.15.45:0/2815428875 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fecd80662a0 con 0x558c453a8a30 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7feced248740 1 -- 172.21.15.45:0/2815428875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecd809f870 con 0x558c453a8a30 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7fecc3fff640 1 -- 172.21.15.45:0/2815428875 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fecd809b000 con 0x558c453a8a30 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7feced248740 10 client.16485 fetch_fsmap learned FSMap version 21 2024-09-15T22:22:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7feced248740 1 -- 172.21.15.45:0/2815428875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558c453bd8d0 con 0x558c453a8a30 2024-09-15T22:22:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7fecc3fff640 1 -- 172.21.15.45:0/2815428875 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fecd809f870 con 0x558c453a8a30 2024-09-15T22:22:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.098+0000 7fecc3fff640 1 -- 172.21.15.45:0/2815428875 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fecd8097210 con 0x558c453a8a30 2024-09-15T22:22:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.099+0000 7feced248740 10 client.16485 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:22:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.099+0000 7feced248740 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.099+0000 7feced248740 20 client.16485 populate_metadata read hostname 'smithi045' 2024-09-15T22:22:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.099+0000 7feced248740 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558c453b7680 0x558c45433df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.099+0000 7feced248740 4 client.16485 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:22:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.099+0000 7feced248740 1 -- 172.21.15.45:0/2815428875 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558c45319d60 con 0x558c453b7680 2024-09-15T22:22:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.099+0000 7fece3fff640 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558c453b7680 0x558c45433df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.099+0000 7fece3fff640 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558c453b7680 0x558c45433df0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f2ac2e1a417c604 server_cookie=25087e8b8d36a01c in_seq=0 out_seq=0 2024-09-15T22:22:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.099+0000 7fecc3fff640 10 client.16485 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.099+0000 7fecc3fff640 1 -- 172.21.15.45:0/2815428875 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558c45319d60 con 0x558c453b7680 2024-09-15T22:22:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7fecc3fff640 10 client.16485 handle_command_reply: tid=0 2024-09-15T22:22:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7feced248740 1 client.16485 shutdown 2024-09-15T22:22:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7feced248740 1 -- 172.21.15.45:0/2815428875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 msgr2=0x558c453bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7feced248740 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 0x558c453bfad0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fecd809b1c0 tx=0x7fecd8010cc0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7feced248740 1 -- 172.21.15.45:0/2815428875 shutdown_connections 2024-09-15T22:22:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7feced248740 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x558c453b7680 0x558c45433df0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7feced248740 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x558c453acdc0 0x558c453bd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7feced248740 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c453ac4a0 0x558c453bce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7fecc3fff640 0 client.16485 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7feced248740 1 --2- 172.21.15.45:0/2815428875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558c453a8a30 0x558c453bfad0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7feced248740 1 -- 172.21.15.45:0/2815428875 >> 172.21.15.45:0/2815428875 conn(0x558c453b48f0 msgr2=0x558c453a7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7feced248740 1 -- 172.21.15.45:0/2815428875 shutdown_connections 2024-09-15T22:22:01.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7feced248740 1 -- 172.21.15.45:0/2815428875 wait complete. 2024-09-15T22:22:01.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.100+0000 7feced248740 20 client.16485 trim_cache size 0 max 16384 2024-09-15T22:22:01.108 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:22:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:22:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:22:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: "cf8b728f-ce18-4c08-add5-8dadaa667e51": { 2024-09-15T22:22:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:22:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "cf8b728f-ce18-4c08-add5-8dadaa667e51", 2024-09-15T22:22:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:22:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:22:01.108 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:22:01.109 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:22:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.101+0000 7feceae6f640 1 -- 172.21.15.45:0/2089268720 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fecd40a33b0 msgr2=0x7fecd40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.101+0000 7feceae6f640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fecd40a33b0 0x7fecd40a5870 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fecdc04c000 tx=0x7fecdc04d000 comp rx=0 tx=0).stop 2024-09-15T22:22:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.101+0000 7feceae6f640 1 -- 172.21.15.45:0/2089268720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece4101de0 msgr2=0x7fece4198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.101+0000 7feceae6f640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece4101de0 0x7fece4198500 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fecd800b4a0 tx=0x7fecd800b960 comp rx=0 tx=0).stop 2024-09-15T22:22:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.101+0000 7feceae6f640 1 -- 172.21.15.45:0/2089268720 shutdown_connections 2024-09-15T22:22:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.101+0000 7feceae6f640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fecd40a33b0 0x7fecd40a5870 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.101+0000 7feceae6f640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fece4106f10 0x7fece419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.101+0000 7feceae6f640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fece4102790 0x7fece4198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.101+0000 7feceae6f640 1 --2- 172.21.15.45:0/2089268720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fece4101de0 0x7fece4198500 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.101+0000 7feceae6f640 1 -- 172.21.15.45:0/2089268720 >> 172.21.15.45:0/2089268720 conn(0x7fece40fd8c0 msgr2=0x7fece40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.101+0000 7feceae6f640 1 -- 172.21.15.45:0/2089268720 shutdown_connections 2024-09-15T22:22:01.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:01.101+0000 7feceae6f640 1 -- 172.21.15.45:0/2089268720 wait complete. 2024-09-15T22:22:01.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:01 smithi165 ceph-mon[35551]: pgmap v176: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:22:01.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:01 smithi100 ceph-mon[35319]: pgmap v176: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:22:01.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:01 smithi045 ceph-mon[31180]: pgmap v176: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:22:01.908 INFO:tasks.cephfs.filesystem:scrub status for tag:cf8b728f-ce18-4c08-add5-8dadaa667e51 - {'path': '/', 'tag': 'cf8b728f-ce18-4c08-add5-8dadaa667e51', 'options': 'recursive,force'} 2024-09-15T22:22:02.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:02 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:22:02.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:02 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:22:02.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:02 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:22:03.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:03 smithi165 ceph-mon[35551]: pgmap v177: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:03.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:03 smithi100 ceph-mon[35319]: pgmap v177: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:03.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:03 smithi045 ceph-mon[31180]: pgmap v177: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:05.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:05 smithi165 ceph-mon[35551]: pgmap v178: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:22:05.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:05 smithi100 ceph-mon[35319]: pgmap v178: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:22:05.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:05 smithi045 ceph-mon[31180]: pgmap v178: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:22:07.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:07 smithi165 ceph-mon[35551]: pgmap v179: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:22:07.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:07 smithi100 ceph-mon[35319]: pgmap v179: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:22:07.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:07 smithi045 ceph-mon[31180]: pgmap v179: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:22:09.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:09 smithi165 ceph-mon[35551]: pgmap v180: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:22:09.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:09 smithi100 ceph-mon[35319]: pgmap v180: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:22:09.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:09 smithi045 ceph-mon[31180]: pgmap v180: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-15T22:22:11.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:11 smithi165 ceph-mon[35551]: pgmap v181: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:22:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:11 smithi100 ceph-mon[35319]: pgmap v181: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:22:11.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:11 smithi045 ceph-mon[31180]: pgmap v181: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:22:13.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:13 smithi165 ceph-mon[35551]: pgmap v182: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:22:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:13 smithi100 ceph-mon[35319]: pgmap v182: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:22:13.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:13 smithi045 ceph-mon[31180]: pgmap v182: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:22:15.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:15 smithi165 ceph-mon[35551]: pgmap v183: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:22:15.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:15 smithi100 ceph-mon[35319]: pgmap v183: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:22:15.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:15 smithi045 ceph-mon[31180]: pgmap v183: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-15T22:22:17.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:17 smithi165 ceph-mon[35551]: pgmap v184: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:22:17.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:17 smithi100 ceph-mon[35319]: pgmap v184: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:22:17.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:17 smithi045 ceph-mon[31180]: pgmap v184: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:22:19.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:19 smithi165 ceph-mon[35551]: pgmap v185: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:22:19.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:19 smithi100 ceph-mon[35319]: pgmap v185: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:22:19.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:19 smithi045 ceph-mon[31180]: pgmap v185: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 85 B/s wr, 1 op/s 2024-09-15T22:22:21.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:21 smithi165 ceph-mon[35551]: pgmap v186: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T22:22:21.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:21 smithi100 ceph-mon[35319]: pgmap v186: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T22:22:21.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:21 smithi045 ceph-mon[31180]: pgmap v186: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 85 B/s wr, 2 op/s 2024-09-15T22:22:22.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:22 smithi100 ceph-mon[35319]: pgmap v187: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:22.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:22 smithi045 ceph-mon[31180]: pgmap v187: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:22.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:22 smithi165 ceph-mon[35551]: pgmap v187: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:24.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:24 smithi165 ceph-mon[35551]: pgmap v188: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:22:24.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:24 smithi100 ceph-mon[35319]: pgmap v188: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:22:25.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:24 smithi045 ceph-mon[31180]: pgmap v188: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:22:26.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:26 smithi165 ceph-mon[35551]: pgmap v189: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:26.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:26 smithi100 ceph-mon[35319]: pgmap v189: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:27.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:26 smithi045 ceph-mon[31180]: pgmap v189: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:28.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:28 smithi100 ceph-mon[35319]: pgmap v190: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:29.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:28 smithi045 ceph-mon[31180]: pgmap v190: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:29.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:28 smithi165 ceph-mon[35551]: pgmap v190: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:30.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:30 smithi100 ceph-mon[35319]: pgmap v191: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:22:31.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:30 smithi045 ceph-mon[31180]: pgmap v191: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:22:31.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:30 smithi165 ceph-mon[35551]: pgmap v191: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:22:31.910 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:22:31.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:31 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:31.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:31 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:31.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:31 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:31.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:31 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:22:32.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:31 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:32.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:31 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:32.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:31 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:32.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:31 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:22:32.174 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:32.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:31 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:22:32.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:31 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:22:32.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:31 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:22:32.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:31 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:22:32.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.710+0000 7f813fdc2640 1 -- 172.21.15.45:0/53559123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8138100a80 msgr2=0x7f8138100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.710+0000 7f813fdc2640 1 --2- 172.21.15.45:0/53559123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8138100a80 0x7f8138100ee0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8128009930 tx=0x7f812802a420 comp rx=0 tx=0).stop 2024-09-15T22:22:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.710+0000 7f813fdc2640 1 -- 172.21.15.45:0/53559123 shutdown_connections 2024-09-15T22:22:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.710+0000 7f813fdc2640 1 --2- 172.21.15.45:0/53559123 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8138101420 0x7f813810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.710+0000 7f813fdc2640 1 --2- 172.21.15.45:0/53559123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8138100a80 0x7f8138100ee0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.710+0000 7f813fdc2640 1 --2- 172.21.15.45:0/53559123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138106a80 0x7f8138106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.710+0000 7f813fdc2640 1 -- 172.21.15.45:0/53559123 >> 172.21.15.45:0/53559123 conn(0x7f81380fc7a0 msgr2=0x7f81380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.710+0000 7f813fdc2640 1 -- 172.21.15.45:0/53559123 shutdown_connections 2024-09-15T22:22:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.710+0000 7f813fdc2640 1 -- 172.21.15.45:0/53559123 wait complete. 2024-09-15T22:22:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.710+0000 7f813fdc2640 1 Processor -- start 2024-09-15T22:22:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813fdc2640 1 -- start start 2024-09-15T22:22:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813fdc2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8138100a80 0x7f8138198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813fdc2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8138101420 0x7f8138198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813fdc2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138106a80 0x7f813819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813fdc2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8138110fa0 con 0x7f8138100a80 2024-09-15T22:22:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813fdc2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8138110e20 con 0x7f8138106a80 2024-09-15T22:22:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813fdc2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8138111120 con 0x7f8138101420 2024-09-15T22:22:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813db5e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8138100a80 0x7f8138198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813db5e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8138100a80 0x7f8138198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45598/0 (socket says 172.21.15.45:45598) 2024-09-15T22:22:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813db5e640 1 -- 172.21.15.45:0/1316132182 learned_addr learned my addr 172.21.15.45:0/1316132182 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813d35d640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8138101420 0x7f8138198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813db5e640 1 -- 172.21.15.45:0/1316132182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8138101420 msgr2=0x7f8138198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813db5e640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8138101420 0x7f8138198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813e35f640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138106a80 0x7f813819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813db5e640 1 -- 172.21.15.45:0/1316132182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138106a80 msgr2=0x7f813819ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813db5e640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138106a80 0x7f813819ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813db5e640 1 -- 172.21.15.45:0/1316132182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813819d540 con 0x7f8138100a80 2024-09-15T22:22:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.711+0000 7f813e35f640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138106a80 0x7f813819ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:32.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.712+0000 7f813db5e640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8138100a80 0x7f8138198590 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f813400d950 tx=0x7f813400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:32.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.712+0000 7f812effd640 1 -- 172.21.15.45:0/1316132182 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134017070 con 0x7f8138100a80 2024-09-15T22:22:32.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.712+0000 7f812effd640 1 -- 172.21.15.45:0/1316132182 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8134009c30 con 0x7f8138100a80 2024-09-15T22:22:32.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.712+0000 7f813fdc2640 1 -- 172.21.15.45:0/1316132182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813819d830 con 0x7f8138100a80 2024-09-15T22:22:32.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.712+0000 7f812effd640 1 -- 172.21.15.45:0/1316132182 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813400f740 con 0x7f8138100a80 2024-09-15T22:22:32.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.712+0000 7f813fdc2640 1 -- 172.21.15.45:0/1316132182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81381a5110 con 0x7f8138100a80 2024-09-15T22:22:32.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.714+0000 7f812effd640 1 -- 172.21.15.45:0/1316132182 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8134010a80 con 0x7f8138100a80 2024-09-15T22:22:32.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.714+0000 7f814219b740 1 Processor -- start 2024-09-15T22:22:32.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f814219b740 1 -- start start 2024-09-15T22:22:32.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f814219b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99360 0x55a1abe99740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f814219b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99c80 0x55a1abea8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f814219b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abeaae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f814219b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a1abdff2e0 con 0x55a1abea8a90 2024-09-15T22:22:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f814219b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a1abda6ce0 con 0x55a1abe99c80 2024-09-15T22:22:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f814219b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a1abdfb2a0 con 0x55a1abe99360 2024-09-15T22:22:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f813d35d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abeaae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f813e35f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99360 0x55a1abe99740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f813d35d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abeaae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45608/0 (socket says 172.21.15.45:45608) 2024-09-15T22:22:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f813d35d640 1 -- 172.21.15.45:0/1142544986 learned_addr learned my addr 172.21.15.45:0/1142544986 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f813db5e640 1 --2- 172.21.15.45:0/1142544986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99c80 0x55a1abea8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f812effd640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f81240a3430 0x7f81240a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f813e35f640 1 -- 172.21.15.45:0/1142544986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99c80 msgr2=0x55a1abea8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f813e35f640 1 --2- 172.21.15.45:0/1142544986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99c80 0x55a1abea8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f813e35f640 1 -- 172.21.15.45:0/1142544986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 msgr2=0x55a1abeaae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.715+0000 7f813e35f640 1 --2- 172.21.15.45:0/1142544986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abeaae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.716+0000 7f813e35f640 1 -- 172.21.15.45:0/1142544986 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1abd8b440 con 0x55a1abe99360 2024-09-15T22:22:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.716+0000 7f813d35d640 1 --2- 172.21.15.45:0/1142544986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abeaae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.716+0000 7f812effd640 1 -- 172.21.15.45:0/1316132182 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f81340cfd80 con 0x7f8138100a80 2024-09-15T22:22:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.716+0000 7f813e35f640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f81240a3430 0x7f81240a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.716+0000 7f813e35f640 1 --2- 172.21.15.45:0/1142544986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99360 0x55a1abe99740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8130009f60 tx=0x7f8130009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7abfe280ac614272 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.716+0000 7f8123fff640 1 -- 172.21.15.45:0/1142544986 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813001a610 con 0x55a1abe99360 2024-09-15T22:22:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.716+0000 7f8123fff640 1 -- 172.21.15.45:0/1142544986 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f813001acb0 con 0x55a1abe99360 2024-09-15T22:22:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.716+0000 7f8123fff640 1 -- 172.21.15.45:0/1142544986 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130010b10 con 0x55a1abe99360 2024-09-15T22:22:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.716+0000 7f813e35f640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f81240a3430 0x7f81240a58f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8130020000 tx=0x7f813001d000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.717+0000 7f814219b740 1 -- 172.21.15.45:0/1142544986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99360 msgr2=0x55a1abe99740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.717+0000 7f814219b740 1 --2- 172.21.15.45:0/1142544986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99360 0x55a1abe99740 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8130009f60 tx=0x7f8130009f90 comp rx=0 tx=0).stop 2024-09-15T22:22:32.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.717+0000 7f814219b740 1 -- 172.21.15.45:0/1142544986 shutdown_connections 2024-09-15T22:22:32.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.717+0000 7f814219b740 1 --2- 172.21.15.45:0/1142544986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abeaae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.717+0000 7f814219b740 1 --2- 172.21.15.45:0/1142544986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99c80 0x55a1abea8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.717+0000 7f814219b740 1 --2- 172.21.15.45:0/1142544986 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99360 0x55a1abe99740 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.717+0000 7f814219b740 1 -- 172.21.15.45:0/1142544986 >> 172.21.15.45:0/1142544986 conn(0x55a1abe95a30 msgr2=0x55a1abe95e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:32.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.717+0000 7f814219b740 1 -- 172.21.15.45:0/1142544986 shutdown_connections 2024-09-15T22:22:32.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.717+0000 7f814219b740 1 -- 172.21.15.45:0/1142544986 wait complete. 2024-09-15T22:22:32.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.717+0000 7f814219b740 1 -- start start 2024-09-15T22:22:32.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.717+0000 7f814219b740 1 Processor -- start 2024-09-15T22:22:32.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f814219b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abe99360 0x55a1abea8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f814219b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99c80 0x55a1abea56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f814219b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abea8a90 0x55a1abea5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f814219b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a1abeab660 con 0x55a1abe99360 2024-09-15T22:22:32.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f814219b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a1abdba050 con 0x55a1abea8a90 2024-09-15T22:22:32.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f814219b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a1abeab7e0 con 0x55a1abe99c80 2024-09-15T22:22:32.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f814219b740 10 client.0 _ll_register_callbacks cb 0x55a1abdfa160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:32.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f813db5e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abe99360 0x55a1abea8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f813db5e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abe99360 0x55a1abea8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45616/0 (socket says 172.21.15.45:45616) 2024-09-15T22:22:32.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f813db5e640 1 -- 172.21.15.45:0/1005885275 learned_addr learned my addr 172.21.15.45:0/1005885275 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:32.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f813d35d640 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99c80 0x55a1abea56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f813e35f640 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abea8a90 0x55a1abea5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f813db5e640 1 -- 172.21.15.45:0/1005885275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99c80 msgr2=0x55a1abea56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:32.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f813db5e640 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99c80 0x55a1abea56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f813db5e640 1 -- 172.21.15.45:0/1005885275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abea8a90 msgr2=0x55a1abea5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:32.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f813db5e640 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abea8a90 0x55a1abea5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f813db5e640 1 -- 172.21.15.45:0/1005885275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1abb703c0 con 0x55a1abe99360 2024-09-15T22:22:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.718+0000 7f813e35f640 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abea8a90 0x55a1abea5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f813db5e640 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abe99360 0x55a1abea8440 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8134098610 tx=0x7f8134010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591533d199a69108 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f81217fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:22:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f81217fa640 1 -- 172.21.15.45:0/1005885275 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81340d1070 con 0x55a1abe99360 2024-09-15T22:22:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f81217fa640 1 -- 172.21.15.45:0/1005885275 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f813409b090 con 0x55a1abe99360 2024-09-15T22:22:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f814219b740 1 -- 172.21.15.45:0/1005885275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f813001acb0 con 0x55a1abe99360 2024-09-15T22:22:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f81217fa640 1 -- 172.21.15.45:0/1005885275 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8134020070 con 0x55a1abe99360 2024-09-15T22:22:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f814219b740 10 client.16497 fetch_fsmap learned FSMap version 21 2024-09-15T22:22:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f814219b740 1 -- 172.21.15.45:0/1005885275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a1abeb7110 con 0x55a1abe99360 2024-09-15T22:22:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f81217fa640 1 -- 172.21.15.45:0/1005885275 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f813001acb0 con 0x55a1abe99360 2024-09-15T22:22:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f81217fa640 1 -- 172.21.15.45:0/1005885275 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f81340860b0 con 0x55a1abe99360 2024-09-15T22:22:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f814219b740 10 client.16497 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:22:32.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f814219b740 10 client.16497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:32.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f814219b740 20 client.16497 populate_metadata read hostname 'smithi045' 2024-09-15T22:22:32.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f814219b740 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1abeb85d0 0x55a1abeba9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f814219b740 4 client.16497 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:22:32.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.719+0000 7f814219b740 1 -- 172.21.15.45:0/1005885275 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1abe0c850 con 0x55a1abeb85d0 2024-09-15T22:22:32.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.720+0000 7f813d35d640 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1abeb85d0 0x55a1abeba9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.720+0000 7f813d35d640 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1abeb85d0 0x55a1abeba9c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8809cebad7a1887e server_cookie=9ba4ae2442b96f3f in_seq=0 out_seq=0 2024-09-15T22:22:32.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.720+0000 7f81217fa640 10 client.16497 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:32.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f81217fa640 1 -- 172.21.15.45:0/1005885275 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a1abe0c850 con 0x55a1abeb85d0 2024-09-15T22:22:32.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f81217fa640 10 client.16497 handle_command_reply: tid=0 2024-09-15T22:22:32.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f814219b740 1 client.16497 shutdown 2024-09-15T22:22:32.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f814219b740 1 -- 172.21.15.45:0/1005885275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abe99360 msgr2=0x55a1abea8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f814219b740 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abe99360 0x55a1abea8440 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f8134098610 tx=0x7f8134010d70 comp rx=0 tx=0).stop 2024-09-15T22:22:32.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f814219b740 1 -- 172.21.15.45:0/1005885275 shutdown_connections 2024-09-15T22:22:32.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f814219b740 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1abeb85d0 0x55a1abeba9c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f814219b740 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abea8a90 0x55a1abea5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f814219b740 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99c80 0x55a1abea56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f814219b740 1 --2- 172.21.15.45:0/1005885275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abe99360 0x55a1abea8440 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f81217fa640 0 client.16497 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:32.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f814219b740 1 -- 172.21.15.45:0/1005885275 >> 172.21.15.45:0/1005885275 conn(0x55a1abe95a30 msgr2=0x55a1abe9b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:32.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f814219b740 1 -- 172.21.15.45:0/1005885275 shutdown_connections 2024-09-15T22:22:32.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.721+0000 7f814219b740 1 -- 172.21.15.45:0/1005885275 wait complete. 2024-09-15T22:22:32.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.722+0000 7f814219b740 20 client.16497 trim_cache size 0 max 16384 2024-09-15T22:22:32.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f814219b740 1 Processor -- start 2024-09-15T22:22:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f814219b740 1 -- start start 2024-09-15T22:22:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f814219b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99360 0x55a1abeb4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f814219b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99c80 0x55a1abec01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f814219b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abec0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f814219b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f81381ab060 con 0x55a1abea8a90 2024-09-15T22:22:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f814219b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f81381ad8e0 con 0x55a1abe99c80 2024-09-15T22:22:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f814219b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f81381ab6d0 con 0x55a1abe99360 2024-09-15T22:22:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f813e35f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abec0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f813e35f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abec0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45628/0 (socket says 172.21.15.45:45628) 2024-09-15T22:22:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f813e35f640 1 -- 172.21.15.45:0/1089132199 learned_addr learned my addr 172.21.15.45:0/1089132199 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f813db5e640 1 --2- 172.21.15.45:0/1089132199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99360 0x55a1abeb4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f813e35f640 1 -- 172.21.15.45:0/1089132199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99360 msgr2=0x55a1abeb4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f813e35f640 1 --2- 172.21.15.45:0/1089132199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99360 0x55a1abeb4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f813d35d640 1 --2- 172.21.15.45:0/1089132199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99c80 0x55a1abec01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f813e35f640 1 -- 172.21.15.45:0/1089132199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99c80 msgr2=0x55a1abec01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f813e35f640 1 --2- 172.21.15.45:0/1089132199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99c80 0x55a1abec01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f813e35f640 1 -- 172.21.15.45:0/1089132199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1abea3c40 con 0x55a1abea8a90 2024-09-15T22:22:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.739+0000 7f813d35d640 1 --2- 172.21.15.45:0/1089132199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99c80 0x55a1abec01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.740+0000 7f813e35f640 1 --2- 172.21.15.45:0/1089132199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abec0730 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8130009eb0 tx=0x7f8130013eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c27e152ebdcdc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.740+0000 7f81237fe640 1 -- 172.21.15.45:0/1089132199 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130009a90 con 0x55a1abea8a90 2024-09-15T22:22:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.740+0000 7f81237fe640 1 -- 172.21.15.45:0/1089132199 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8130033070 con 0x55a1abea8a90 2024-09-15T22:22:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.740+0000 7f81237fe640 1 -- 172.21.15.45:0/1089132199 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813001a940 con 0x55a1abea8a90 2024-09-15T22:22:32.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.740+0000 7f814219b740 1 -- 172.21.15.45:0/1089132199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 msgr2=0x55a1abec0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.740+0000 7f814219b740 1 --2- 172.21.15.45:0/1089132199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abec0730 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8130009eb0 tx=0x7f8130013eb0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.740+0000 7f814219b740 1 -- 172.21.15.45:0/1089132199 shutdown_connections 2024-09-15T22:22:32.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.740+0000 7f814219b740 1 --2- 172.21.15.45:0/1089132199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abec0730 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.740+0000 7f814219b740 1 --2- 172.21.15.45:0/1089132199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99c80 0x55a1abec01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.740+0000 7f814219b740 1 --2- 172.21.15.45:0/1089132199 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99360 0x55a1abeb4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.740+0000 7f814219b740 1 -- 172.21.15.45:0/1089132199 >> 172.21.15.45:0/1089132199 conn(0x55a1abe95a30 msgr2=0x55a1abea0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:32.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.740+0000 7f814219b740 1 -- 172.21.15.45:0/1089132199 shutdown_connections 2024-09-15T22:22:32.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.741+0000 7f814219b740 1 -- 172.21.15.45:0/1089132199 wait complete. 2024-09-15T22:22:32.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.741+0000 7f814219b740 1 -- start start 2024-09-15T22:22:32.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.741+0000 7f814219b740 1 Processor -- start 2024-09-15T22:22:32.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.741+0000 7f814219b740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99360 0x55a1abeace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.741+0000 7f814219b740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99c80 0x55a1abead3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.741+0000 7f814219b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abf221c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.741+0000 7f814219b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f81381abda0 con 0x55a1abea8a90 2024-09-15T22:22:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.741+0000 7f814219b740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f81381ad210 con 0x55a1abe99360 2024-09-15T22:22:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.741+0000 7f814219b740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f81381ac470 con 0x55a1abe99c80 2024-09-15T22:22:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f814219b740 10 client.0 _ll_register_callbacks cb 0x7f813409bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f813e35f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abf221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f813e35f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abf221c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45644/0 (socket says 172.21.15.45:45644) 2024-09-15T22:22:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f813e35f640 1 -- 172.21.15.45:0/822002461 learned_addr learned my addr 172.21.15.45:0/822002461 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f813d35d640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99c80 0x55a1abead3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f813db5e640 1 --2- 172.21.15.45:0/822002461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99360 0x55a1abeace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f813e35f640 1 -- 172.21.15.45:0/822002461 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99c80 msgr2=0x55a1abead3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f813e35f640 1 --2- 172.21.15.45:0/822002461 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99c80 0x55a1abead3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f813e35f640 1 -- 172.21.15.45:0/822002461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99360 msgr2=0x55a1abeace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f813e35f640 1 --2- 172.21.15.45:0/822002461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99360 0x55a1abeace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f813e35f640 1 -- 172.21.15.45:0/822002461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1abf22700 con 0x55a1abea8a90 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f813db5e640 1 --2- 172.21.15.45:0/822002461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99360 0x55a1abeace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f813e35f640 1 --2- 172.21.15.45:0/822002461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abf221c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8130010010 tx=0x7f8130005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99411c2f9e411e9f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f81217fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f81217fa640 1 -- 172.21.15.45:0/822002461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813001aad0 con 0x55a1abea8a90 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f81217fa640 1 -- 172.21.15.45:0/822002461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f813001ac70 con 0x55a1abea8a90 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.742+0000 7f814219b740 1 -- 172.21.15.45:0/822002461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8130033070 con 0x55a1abea8a90 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.743+0000 7f81217fa640 1 -- 172.21.15.45:0/822002461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8130009a90 con 0x55a1abea8a90 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.743+0000 7f814219b740 10 client.16503 fetch_fsmap learned FSMap version 21 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.743+0000 7f814219b740 1 -- 172.21.15.45:0/822002461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a1abf238e0 con 0x55a1abea8a90 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.743+0000 7f81217fa640 1 -- 172.21.15.45:0/822002461 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8130033070 con 0x55a1abea8a90 2024-09-15T22:22:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.743+0000 7f81217fa640 1 -- 172.21.15.45:0/822002461 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f813002e7f0 con 0x55a1abea8a90 2024-09-15T22:22:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.743+0000 7f814219b740 10 client.16503 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:22:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.743+0000 7f814219b740 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.743+0000 7f814219b740 20 client.16503 populate_metadata read hostname 'smithi045' 2024-09-15T22:22:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.743+0000 7f814219b740 1 --2- 172.21.15.45:0/822002461 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1abf23e00 0x55a1abf261f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.743+0000 7f814219b740 4 client.16503 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:22:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.743+0000 7f814219b740 1 -- 172.21.15.45:0/822002461 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a1abe06d60 con 0x55a1abf23e00 2024-09-15T22:22:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.743+0000 7f813db5e640 1 --2- 172.21.15.45:0/822002461 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1abf23e00 0x55a1abf261f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f813db5e640 1 --2- 172.21.15.45:0/822002461 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1abf23e00 0x55a1abf261f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=214b43c1236dfe3d server_cookie=c9a79c038f4c42d9 in_seq=0 out_seq=0 2024-09-15T22:22:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f81217fa640 10 client.16503 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f81217fa640 1 -- 172.21.15.45:0/822002461 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a1abe06d60 con 0x55a1abf23e00 2024-09-15T22:22:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f81217fa640 10 client.16503 handle_command_reply: tid=0 2024-09-15T22:22:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f814219b740 1 client.16503 shutdown 2024-09-15T22:22:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f814219b740 1 -- 172.21.15.45:0/822002461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 msgr2=0x55a1abf221c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f814219b740 1 --2- 172.21.15.45:0/822002461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abf221c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8130010010 tx=0x7f8130005fd0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f814219b740 1 -- 172.21.15.45:0/822002461 shutdown_connections 2024-09-15T22:22:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f814219b740 1 --2- 172.21.15.45:0/822002461 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1abf23e00 0x55a1abf261f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f814219b740 1 --2- 172.21.15.45:0/822002461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1abea8a90 0x55a1abf221c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f814219b740 1 --2- 172.21.15.45:0/822002461 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1abe99c80 0x55a1abead3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f81217fa640 0 client.16503 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f814219b740 1 --2- 172.21.15.45:0/822002461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1abe99360 0x55a1abeace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f814219b740 1 -- 172.21.15.45:0/822002461 >> 172.21.15.45:0/822002461 conn(0x55a1abe95a30 msgr2=0x55a1abe94350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f814219b740 1 -- 172.21.15.45:0/822002461 shutdown_connections 2024-09-15T22:22:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f814219b740 1 -- 172.21.15.45:0/822002461 wait complete. 2024-09-15T22:22:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.744+0000 7f814219b740 20 client.16503 trim_cache size 0 max 16384 2024-09-15T22:22:32.752 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:22:32.752 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:22:32.752 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:22:32.752 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:22:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.745+0000 7f813fdc2640 1 -- 172.21.15.45:0/1316132182 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f81240a3430 msgr2=0x7f81240a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.745+0000 7f813fdc2640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f81240a3430 0x7f81240a58f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8130020000 tx=0x7f813001d000 comp rx=0 tx=0).stop 2024-09-15T22:22:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.745+0000 7f813fdc2640 1 -- 172.21.15.45:0/1316132182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8138100a80 msgr2=0x7f8138198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.745+0000 7f813fdc2640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8138100a80 0x7f8138198590 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f813400d950 tx=0x7f813400de10 comp rx=0 tx=0).stop 2024-09-15T22:22:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.745+0000 7f813fdc2640 1 -- 172.21.15.45:0/1316132182 shutdown_connections 2024-09-15T22:22:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.745+0000 7f813fdc2640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f81240a3430 0x7f81240a58f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.745+0000 7f813fdc2640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8138106a80 0x7f813819ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.745+0000 7f813fdc2640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8138101420 0x7f8138198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.745+0000 7f813fdc2640 1 --2- 172.21.15.45:0/1316132182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8138100a80 0x7f8138198590 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.745+0000 7f813fdc2640 1 -- 172.21.15.45:0/1316132182 >> 172.21.15.45:0/1316132182 conn(0x7f81380fc7a0 msgr2=0x7f813806aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:32.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.745+0000 7f813fdc2640 1 -- 172.21.15.45:0/1316132182 shutdown_connections 2024-09-15T22:22:32.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:32.745+0000 7f813fdc2640 1 -- 172.21.15.45:0/1316132182 wait complete. 2024-09-15T22:22:33.582 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:33 smithi045 ceph-mon[31180]: pgmap v192: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:33.584 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:22:33.585 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:22:33.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:33 smithi165 ceph-mon[35551]: pgmap v192: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:33.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:33 smithi100 ceph-mon[35319]: pgmap v192: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:34.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.368+0000 7fc219cca640 1 -- 172.21.15.45:0/434246003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc214102ef0 msgr2=0x7fc21410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:34.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.368+0000 7fc219cca640 1 --2- 172.21.15.45:0/434246003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc214102ef0 0x7fc21410da40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009900 tx=0x7fc20c02a480 comp rx=0 tx=0).stop 2024-09-15T22:22:34.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.368+0000 7fc219cca640 1 -- 172.21.15.45:0/434246003 shutdown_connections 2024-09-15T22:22:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.368+0000 7fc219cca640 1 --2- 172.21.15.45:0/434246003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc214102ef0 0x7fc21410da40 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.368+0000 7fc219cca640 1 --2- 172.21.15.45:0/434246003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc214102570 0x7fc2141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.368+0000 7fc219cca640 1 --2- 172.21.15.45:0/434246003 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc214100e20 0x7fc214101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.368+0000 7fc219cca640 1 -- 172.21.15.45:0/434246003 >> 172.21.15.45:0/434246003 conn(0x7fc2140fc7d0 msgr2=0x7fc2140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.368+0000 7fc219cca640 1 -- 172.21.15.45:0/434246003 shutdown_connections 2024-09-15T22:22:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.368+0000 7fc219cca640 1 -- 172.21.15.45:0/434246003 wait complete. 2024-09-15T22:22:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.368+0000 7fc219cca640 1 Processor -- start 2024-09-15T22:22:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.368+0000 7fc219cca640 1 -- start start 2024-09-15T22:22:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc219cca640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc214100e20 0x7fc2141985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc219cca640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc214102570 0x7fc214198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc219cca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc214102ef0 0x7fc21419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:34.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc219cca640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc2141110a0 con 0x7fc214102ef0 2024-09-15T22:22:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc219cca640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc214110f20 con 0x7fc214102570 2024-09-15T22:22:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc219cca640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc214111220 con 0x7fc214100e20 2024-09-15T22:22:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc213fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc214102ef0 0x7fc21419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc213fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc214102ef0 0x7fc21419ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34944/0 (socket says 172.21.15.45:34944) 2024-09-15T22:22:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc213fff640 1 -- 172.21.15.45:0/2594745364 learned_addr learned my addr 172.21.15.45:0/2594745364 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc2137fe640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc214100e20 0x7fc2141985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc212ffd640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc214102570 0x7fc214198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc213fff640 1 -- 172.21.15.45:0/2594745364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc214100e20 msgr2=0x7fc2141985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc213fff640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc214100e20 0x7fc2141985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc213fff640 1 -- 172.21.15.45:0/2594745364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc214102570 msgr2=0x7fc214198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc213fff640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc214102570 0x7fc214198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc213fff640 1 -- 172.21.15.45:0/2594745364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21419d570 con 0x7fc214102ef0 2024-09-15T22:22:34.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.369+0000 7fc213fff640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc214102ef0 0x7fc21419ce90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc20c004770 tx=0x7fc20c004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.370+0000 7fc210ff9640 1 -- 172.21.15.45:0/2594745364 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c03f030 con 0x7fc214102ef0 2024-09-15T22:22:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.370+0000 7fc219cca640 1 -- 172.21.15.45:0/2594745364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc21419d800 con 0x7fc214102ef0 2024-09-15T22:22:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.370+0000 7fc210ff9640 1 -- 172.21.15.45:0/2594745364 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc20c005500 con 0x7fc214102ef0 2024-09-15T22:22:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.370+0000 7fc210ff9640 1 -- 172.21.15.45:0/2594745364 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c035070 con 0x7fc214102ef0 2024-09-15T22:22:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.370+0000 7fc219cca640 1 -- 172.21.15.45:0/2594745364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2141a5140 con 0x7fc214102ef0 2024-09-15T22:22:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.371+0000 7fc219cca640 1 -- 172.21.15.45:0/2594745364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc214101200 con 0x7fc214102ef0 2024-09-15T22:22:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.372+0000 7fc210ff9640 1 -- 172.21.15.45:0/2594745364 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc20c042030 con 0x7fc214102ef0 2024-09-15T22:22:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.373+0000 7fc210ff9640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc1fc0a33b0 0x7fc1fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.373+0000 7fc2137fe640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc1fc0a33b0 0x7fc1fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.373+0000 7fc210ff9640 1 -- 172.21.15.45:0/2594745364 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fc20c0f04a0 con 0x7fc214102ef0 2024-09-15T22:22:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.373+0000 7fc2137fe640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc1fc0a33b0 0x7fc1fc0a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc204005c40 tx=0x7fc20400a590 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:34.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.377+0000 7fc210ff9640 1 -- 172.21.15.45:0/2594745364 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc20c0bc510 con 0x7fc214102ef0 2024-09-15T22:22:34.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.591+0000 7fc219cca640 1 -- 172.21.15.45:0/2594745364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc21410a0a0 con 0x7fc214102ef0 2024-09-15T22:22:34.594 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.592+0000 7fc210ff9640 1 -- 172.21.15.45:0/2594745364 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fc20c0c0810 con 0x7fc214102ef0 2024-09-15T22:22:34.594 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:22:34.594 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:22:34.595 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:22:34.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.594+0000 7fc219cca640 1 -- 172.21.15.45:0/2594745364 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc1fc0a33b0 msgr2=0x7fc1fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:34.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.594+0000 7fc219cca640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc1fc0a33b0 0x7fc1fc0a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc204005c40 tx=0x7fc20400a590 comp rx=0 tx=0).stop 2024-09-15T22:22:34.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.594+0000 7fc219cca640 1 -- 172.21.15.45:0/2594745364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc214102ef0 msgr2=0x7fc21419ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:34.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.594+0000 7fc219cca640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc214102ef0 0x7fc21419ce90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc20c004770 tx=0x7fc20c004c00 comp rx=0 tx=0).stop 2024-09-15T22:22:34.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.594+0000 7fc219cca640 1 -- 172.21.15.45:0/2594745364 shutdown_connections 2024-09-15T22:22:34.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.594+0000 7fc219cca640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc1fc0a33b0 0x7fc1fc0a5870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:34.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.594+0000 7fc219cca640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc214102ef0 0x7fc21419ce90 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:34.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.594+0000 7fc219cca640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc214102570 0x7fc214198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:34.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.594+0000 7fc219cca640 1 --2- 172.21.15.45:0/2594745364 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc214100e20 0x7fc2141985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:34.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.594+0000 7fc219cca640 1 -- 172.21.15.45:0/2594745364 >> 172.21.15.45:0/2594745364 conn(0x7fc2140fc7d0 msgr2=0x7fc21406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:34.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.594+0000 7fc219cca640 1 -- 172.21.15.45:0/2594745364 shutdown_connections 2024-09-15T22:22:34.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:34.594+0000 7fc219cca640 1 -- 172.21.15.45:0/2594745364 wait complete. 2024-09-15T22:22:35.301 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:22:35.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:35 smithi045 ceph-mon[31180]: pgmap v193: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:22:35.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:35 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2594745364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:35.563 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:35.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:35 smithi165 ceph-mon[35551]: pgmap v193: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:22:35.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:35 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2594745364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:35.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:35 smithi100 ceph-mon[35319]: pgmap v193: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:22:35.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:35 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2594745364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:22:36.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.047+0000 7f9893719640 1 -- 172.21.15.45:0/1180513209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f988c102790 msgr2=0x7f988c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.047+0000 7f9893719640 1 --2- 172.21.15.45:0/1180513209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f988c102790 0x7f988c1067e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f987c009900 tx=0x7f987c02a410 comp rx=0 tx=0).stop 2024-09-15T22:22:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.047+0000 7f9893719640 1 -- 172.21.15.45:0/1180513209 shutdown_connections 2024-09-15T22:22:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.047+0000 7f9893719640 1 --2- 172.21.15.45:0/1180513209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f988c106f10 0x7f988c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.047+0000 7f9893719640 1 --2- 172.21.15.45:0/1180513209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f988c102790 0x7f988c1067e0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.047+0000 7f9893719640 1 --2- 172.21.15.45:0/1180513209 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f988c101de0 0x7f988c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.047+0000 7f9893719640 1 -- 172.21.15.45:0/1180513209 >> 172.21.15.45:0/1180513209 conn(0x7f988c0fd8c0 msgr2=0x7f988c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.047+0000 7f9893719640 1 -- 172.21.15.45:0/1180513209 shutdown_connections 2024-09-15T22:22:36.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.047+0000 7f9893719640 1 -- 172.21.15.45:0/1180513209 wait complete. 2024-09-15T22:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.047+0000 7f9893719640 1 Processor -- start 2024-09-15T22:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f9893719640 1 -- start start 2024-09-15T22:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f9893719640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f988c101de0 0x7f988c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f9893719640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f988c102790 0x7f988c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f9893719640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f988c106f10 0x7f988c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f9893719640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f988c112050 con 0x7f988c101de0 2024-09-15T22:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f9893719640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f988c111ed0 con 0x7f988c106f10 2024-09-15T22:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f9893719640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f988c1121d0 con 0x7f988c102790 2024-09-15T22:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f98914b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f988c101de0 0x7f988c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f98914b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f988c101de0 0x7f988c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34972/0 (socket says 172.21.15.45:34972) 2024-09-15T22:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f98914b5640 1 -- 172.21.15.45:0/2283769597 learned_addr learned my addr 172.21.15.45:0/2283769597 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:36.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f9890cb4640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f988c102790 0x7f988c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f9891cb6640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f988c106f10 0x7f988c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f98914b5640 1 -- 172.21.15.45:0/2283769597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f988c102790 msgr2=0x7f988c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f98914b5640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f988c102790 0x7f988c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f98914b5640 1 -- 172.21.15.45:0/2283769597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f988c106f10 msgr2=0x7f988c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f98914b5640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f988c106f10 0x7f988c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f98914b5640 1 -- 172.21.15.45:0/2283769597 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988c19d440 con 0x7f988c101de0 2024-09-15T22:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f9890cb4640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f988c102790 0x7f988c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f9891cb6640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f988c106f10 0x7f988c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.048+0000 7f98914b5640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f988c101de0 0x7f988c198490 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f988800c920 tx=0x7f988800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.049+0000 7f98827fc640 1 -- 172.21.15.45:0/2283769597 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9888007c70 con 0x7f988c101de0 2024-09-15T22:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.049+0000 7f98827fc640 1 -- 172.21.15.45:0/2283769597 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9888007e10 con 0x7f988c101de0 2024-09-15T22:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.049+0000 7f98827fc640 1 -- 172.21.15.45:0/2283769597 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9888018940 con 0x7f988c101de0 2024-09-15T22:22:36.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.049+0000 7f9893719640 1 -- 172.21.15.45:0/2283769597 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988c19d730 con 0x7f988c101de0 2024-09-15T22:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.049+0000 7f9893719640 1 -- 172.21.15.45:0/2283769597 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f988c1a5010 con 0x7f988c101de0 2024-09-15T22:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.051+0000 7f98827fc640 1 -- 172.21.15.45:0/2283769597 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9888018b20 con 0x7f988c101de0 2024-09-15T22:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.051+0000 7f9895af2740 1 Processor -- start 2024-09-15T22:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.051+0000 7f9895af2740 1 -- start start 2024-09-15T22:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9895af2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 0x55c321a1f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9895af2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a1f5d0 0x55c321a1fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9895af2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a2e780 0x55c321a30b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9895af2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c3219852f0 con 0x55c321a20b40 2024-09-15T22:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9895af2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c32192ccf0 con 0x55c321a2e780 2024-09-15T22:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9895af2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c3219812b0 con 0x55c321a1f5d0 2024-09-15T22:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9891cb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 0x55c321a1f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f98827fc640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f98780a33b0 0x7f98780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9891cb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 0x55c321a1f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34974/0 (socket says 172.21.15.45:34974) 2024-09-15T22:22:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9891cb6640 1 -- 172.21.15.45:0/1681667337 learned_addr learned my addr 172.21.15.45:0/1681667337 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9891cb6640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f98780a33b0 0x7f98780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f98914b5640 1 --2- 172.21.15.45:0/1681667337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a1f5d0 0x55c321a1fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9890cb4640 1 --2- 172.21.15.45:0/1681667337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a2e780 0x55c321a30b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9891cb6640 1 -- 172.21.15.45:0/1681667337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a1f5d0 msgr2=0x55c321a1fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9891cb6640 1 --2- 172.21.15.45:0/1681667337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a1f5d0 0x55c321a1fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f98827fc640 1 -- 172.21.15.45:0/2283769597 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f98880d0390 con 0x7f988c101de0 2024-09-15T22:22:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9891cb6640 1 -- 172.21.15.45:0/1681667337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a2e780 msgr2=0x55c321a30b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9891cb6640 1 --2- 172.21.15.45:0/1681667337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a2e780 0x55c321a30b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9891cb6640 1 -- 172.21.15.45:0/1681667337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3219113a0 con 0x55c321a20b40 2024-09-15T22:22:36.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f98914b5640 1 --2- 172.21.15.45:0/1681667337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a1f5d0 0x55c321a1fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9890cb4640 1 --2- 172.21.15.45:0/1681667337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a2e780 0x55c321a30b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.052+0000 7f9891cb6640 1 --2- 172.21.15.45:0/1681667337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 0x55c321a1f090 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9884012990 tx=0x7f9884012e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25eccd8a23a1b217 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.053+0000 7f98777fe640 1 -- 172.21.15.45:0/1681667337 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9884022070 con 0x55c321a20b40 2024-09-15T22:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.053+0000 7f98777fe640 1 -- 172.21.15.45:0/1681667337 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f98840123b0 con 0x55c321a20b40 2024-09-15T22:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.053+0000 7f98777fe640 1 -- 172.21.15.45:0/1681667337 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9884005690 con 0x55c321a20b40 2024-09-15T22:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.053+0000 7f9891cb6640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f98780a33b0 0x7f98780a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f988401f000 tx=0x7f988401b000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.053+0000 7f9895af2740 1 -- 172.21.15.45:0/1681667337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 msgr2=0x55c321a1f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.053+0000 7f9895af2740 1 --2- 172.21.15.45:0/1681667337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 0x55c321a1f090 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9884012990 tx=0x7f9884012e50 comp rx=0 tx=0).stop 2024-09-15T22:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.053+0000 7f9895af2740 1 -- 172.21.15.45:0/1681667337 shutdown_connections 2024-09-15T22:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.053+0000 7f9895af2740 1 --2- 172.21.15.45:0/1681667337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a2e780 0x55c321a30b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.053+0000 7f9895af2740 1 --2- 172.21.15.45:0/1681667337 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a1f5d0 0x55c321a1fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.053+0000 7f9895af2740 1 --2- 172.21.15.45:0/1681667337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 0x55c321a1f090 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.053+0000 7f9895af2740 1 -- 172.21.15.45:0/1681667337 >> 172.21.15.45:0/1681667337 conn(0x55c3219e8310 msgr2=0x55c321a1bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.053+0000 7f9895af2740 1 -- 172.21.15.45:0/1681667337 shutdown_connections 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.053+0000 7f9895af2740 1 -- 172.21.15.45:0/1681667337 wait complete. 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.054+0000 7f9895af2740 1 -- start start 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.054+0000 7f9895af2740 1 Processor -- start 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.054+0000 7f9895af2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a1f5d0 0x55c321a2e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.054+0000 7f9895af2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a20b40 0x55c321a2b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.054+0000 7f9895af2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 0x55c321a2ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.054+0000 7f9895af2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c321a31480 con 0x55c321a2e780 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.054+0000 7f9895af2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c321940060 con 0x55c321a1f5d0 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.054+0000 7f9895af2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c321a31600 con 0x55c321a20b40 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.054+0000 7f9895af2740 10 client.0 _ll_register_callbacks cb 0x55c3216938c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.054+0000 7f9891cb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 0x55c321a2ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.054+0000 7f9891cb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 0x55c321a2ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34986/0 (socket says 172.21.15.45:34986) 2024-09-15T22:22:36.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.054+0000 7f9891cb6640 1 -- 172.21.15.45:0/3622998145 learned_addr learned my addr 172.21.15.45:0/3622998145 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:36.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f98914b5640 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a1f5d0 0x55c321a2e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9890cb4640 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a20b40 0x55c321a2b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9891cb6640 1 -- 172.21.15.45:0/3622998145 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a20b40 msgr2=0x55c321a2b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:36.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9891cb6640 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a20b40 0x55c321a2b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9891cb6640 1 -- 172.21.15.45:0/3622998145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a1f5d0 msgr2=0x55c321a2e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:36.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9891cb6640 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a1f5d0 0x55c321a2e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9891cb6640 1 -- 172.21.15.45:0/3622998145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3216f63c0 con 0x55c321a2e780 2024-09-15T22:22:36.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f98914b5640 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a1f5d0 0x55c321a2e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:36.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9891cb6640 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 0x55c321a2ba50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9884009350 tx=0x7f9884009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9598c775ec3d6f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:36.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9874ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:22:36.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9874ff9640 1 -- 172.21.15.45:0/3622998145 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9884036060 con 0x55c321a2e780 2024-09-15T22:22:36.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9895af2740 1 -- 172.21.15.45:0/3622998145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c321992860 con 0x55c321a2e780 2024-09-15T22:22:36.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9874ff9640 1 -- 172.21.15.45:0/3622998145 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f9884005620 con 0x55c321a2e780 2024-09-15T22:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9874ff9640 1 -- 172.21.15.45:0/3622998145 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f988403d050 con 0x55c321a2e780 2024-09-15T22:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9895af2740 10 client.16521 fetch_fsmap learned FSMap version 21 2024-09-15T22:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.055+0000 7f9895af2740 1 -- 172.21.15.45:0/3622998145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c321a3cec0 con 0x55c321a2e780 2024-09-15T22:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.056+0000 7f9874ff9640 1 -- 172.21.15.45:0/3622998145 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55c321992860 con 0x55c321a2e780 2024-09-15T22:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.056+0000 7f9874ff9640 1 -- 172.21.15.45:0/3622998145 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9884031590 con 0x55c321a2e780 2024-09-15T22:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.056+0000 7f9895af2740 10 client.16521 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.056+0000 7f9895af2740 10 client.16521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.056+0000 7f9895af2740 20 client.16521 populate_metadata read hostname 'smithi045' 2024-09-15T22:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.056+0000 7f9895af2740 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c321a3e2d0 0x55c321a406c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.056+0000 7f9895af2740 4 client.16521 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.056+0000 7f9895af2740 1 -- 172.21.15.45:0/3622998145 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c32198cd70 con 0x55c321a3e2d0 2024-09-15T22:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.056+0000 7f98914b5640 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c321a3e2d0 0x55c321a406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.057+0000 7f98914b5640 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c321a3e2d0 0x55c321a406c0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9a36ac8e8e5186c server_cookie=9e5b8c271f3127e6 in_seq=0 out_seq=0 2024-09-15T22:22:36.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.057+0000 7f9874ff9640 10 client.16521 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:36.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.057+0000 7f9874ff9640 1 -- 172.21.15.45:0/3622998145 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c32198cd70 con 0x55c321a3e2d0 2024-09-15T22:22:36.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.057+0000 7f9874ff9640 10 client.16521 handle_command_reply: tid=0 2024-09-15T22:22:36.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.057+0000 7f9895af2740 1 client.16521 shutdown 2024-09-15T22:22:36.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.058+0000 7f9895af2740 1 -- 172.21.15.45:0/3622998145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 msgr2=0x55c321a2ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:36.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.058+0000 7f9895af2740 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 0x55c321a2ba50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9884009350 tx=0x7f9884009820 comp rx=0 tx=0).stop 2024-09-15T22:22:36.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.058+0000 7f9895af2740 1 -- 172.21.15.45:0/3622998145 shutdown_connections 2024-09-15T22:22:36.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.058+0000 7f9895af2740 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c321a3e2d0 0x55c321a406c0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.058+0000 7f9895af2740 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 0x55c321a2ba50 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.058+0000 7f9874ff9640 0 client.16521 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:36.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.058+0000 7f9895af2740 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a20b40 0x55c321a2b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.058+0000 7f9895af2740 1 --2- 172.21.15.45:0/3622998145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a1f5d0 0x55c321a2e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.058+0000 7f9895af2740 1 -- 172.21.15.45:0/3622998145 >> 172.21.15.45:0/3622998145 conn(0x55c3219e8310 msgr2=0x55c321a21960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:36.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.058+0000 7f9895af2740 1 -- 172.21.15.45:0/3622998145 shutdown_connections 2024-09-15T22:22:36.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.058+0000 7f9895af2740 1 -- 172.21.15.45:0/3622998145 wait complete. 2024-09-15T22:22:36.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.058+0000 7f9895af2740 20 client.16521 trim_cache size 0 max 16384 2024-09-15T22:22:36.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.071+0000 7f9895af2740 1 Processor -- start 2024-09-15T22:22:36.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.071+0000 7f9895af2740 1 -- start start 2024-09-15T22:22:36.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9895af2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a1f5d0 0x55c321a3a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9895af2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a20b40 0x55c321a2d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9895af2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 0x55c321a45e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9895af2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f988c1aae50 con 0x55c321a2e780 2024-09-15T22:22:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9895af2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f988c1ad6d0 con 0x55c321a1f5d0 2024-09-15T22:22:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9895af2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f988c1ab4c0 con 0x55c321a20b40 2024-09-15T22:22:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9891cb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 0x55c321a45e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9891cb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 0x55c321a45e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34994/0 (socket says 172.21.15.45:34994) 2024-09-15T22:22:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9891cb6640 1 -- 172.21.15.45:0/282808623 learned_addr learned my addr 172.21.15.45:0/282808623 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9890cb4640 1 --2- 172.21.15.45:0/282808623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a20b40 0x55c321a2d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f98914b5640 1 --2- 172.21.15.45:0/282808623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a1f5d0 0x55c321a3a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9891cb6640 1 -- 172.21.15.45:0/282808623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a20b40 msgr2=0x55c321a2d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9891cb6640 1 --2- 172.21.15.45:0/282808623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a20b40 0x55c321a2d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9891cb6640 1 -- 172.21.15.45:0/282808623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a1f5d0 msgr2=0x55c321a3a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9891cb6640 1 --2- 172.21.15.45:0/282808623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a1f5d0 0x55c321a3a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9891cb6640 1 -- 172.21.15.45:0/282808623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c321a1f2d0 con 0x55c321a2e780 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.072+0000 7f9891cb6640 1 --2- 172.21.15.45:0/282808623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 0x55c321a45e80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9884002230 tx=0x7f98840052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d3bc63b69ec5f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.073+0000 7f9876ffd640 1 -- 172.21.15.45:0/282808623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9884036040 con 0x55c321a2e780 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.073+0000 7f9876ffd640 1 -- 172.21.15.45:0/282808623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9884005620 con 0x55c321a2e780 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.073+0000 7f9876ffd640 1 -- 172.21.15.45:0/282808623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9884022040 con 0x55c321a2e780 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.073+0000 7f9895af2740 1 -- 172.21.15.45:0/282808623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 msgr2=0x55c321a45e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.073+0000 7f9895af2740 1 --2- 172.21.15.45:0/282808623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 0x55c321a45e80 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9884002230 tx=0x7f98840052e0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.073+0000 7f9895af2740 1 -- 172.21.15.45:0/282808623 shutdown_connections 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.073+0000 7f9895af2740 1 --2- 172.21.15.45:0/282808623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a2e780 0x55c321a45e80 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.073+0000 7f9895af2740 1 --2- 172.21.15.45:0/282808623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a20b40 0x55c321a2d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.073+0000 7f9895af2740 1 --2- 172.21.15.45:0/282808623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a1f5d0 0x55c321a3a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.073+0000 7f9895af2740 1 -- 172.21.15.45:0/282808623 >> 172.21.15.45:0/282808623 conn(0x55c3219e8310 msgr2=0x55c321a2cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.073+0000 7f9895af2740 1 -- 172.21.15.45:0/282808623 shutdown_connections 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.073+0000 7f9895af2740 1 -- 172.21.15.45:0/282808623 wait complete. 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.074+0000 7f9895af2740 1 -- start start 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.074+0000 7f9895af2740 1 Processor -- start 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.074+0000 7f9895af2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a1f5d0 0x55c321a36ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.074+0000 7f9895af2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 0x55c321a32320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.074+0000 7f9895af2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a2e780 0x55c321a32860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.074+0000 7f9895af2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f988c1abb90 con 0x55c321a20b40 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.074+0000 7f9895af2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f988c1ad000 con 0x55c321a2e780 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.074+0000 7f9895af2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f988c1ac260 con 0x55c321a1f5d0 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.074+0000 7f9895af2740 10 client.0 _ll_register_callbacks cb 0x7f9884020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:36.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.074+0000 7f9890cb4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 0x55c321a32320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.074+0000 7f98914b5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a1f5d0 0x55c321a36ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.074+0000 7f9890cb4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 0x55c321a32320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35002/0 (socket says 172.21.15.45:35002) 2024-09-15T22:22:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.074+0000 7f9890cb4640 1 -- 172.21.15.45:0/2507867383 learned_addr learned my addr 172.21.15.45:0/2507867383 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9891cb6640 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a2e780 0x55c321a32860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9890cb4640 1 -- 172.21.15.45:0/2507867383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a1f5d0 msgr2=0x55c321a36ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9890cb4640 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a1f5d0 0x55c321a36ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9890cb4640 1 -- 172.21.15.45:0/2507867383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a2e780 msgr2=0x55c321a32860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9890cb4640 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a2e780 0x55c321a32860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9890cb4640 1 -- 172.21.15.45:0/2507867383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c321a1c960 con 0x55c321a20b40 2024-09-15T22:22:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f98914b5640 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a1f5d0 0x55c321a36ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:22:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9891cb6640 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a2e780 0x55c321a32860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9890cb4640 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 0x55c321a32320 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f987c02a930 tx=0x7f987c0319b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27f6c97ad6aa4c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:36.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9874ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:22:36.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9874ff9640 1 -- 172.21.15.45:0/2507867383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987c035050 con 0x55c321a20b40 2024-09-15T22:22:36.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9874ff9640 1 -- 172.21.15.45:0/2507867383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7f987c004250 con 0x55c321a20b40 2024-09-15T22:22:36.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9895af2740 1 -- 172.21.15.45:0/2507867383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9884005620 con 0x55c321a20b40 2024-09-15T22:22:36.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9874ff9640 1 -- 172.21.15.45:0/2507867383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f987c04e050 con 0x55c321a20b40 2024-09-15T22:22:36.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9895af2740 10 client.16527 fetch_fsmap learned FSMap version 21 2024-09-15T22:22:36.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.075+0000 7f9895af2740 1 -- 172.21.15.45:0/2507867383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c321aa8ca0 con 0x55c321a20b40 2024-09-15T22:22:36.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.076+0000 7f9874ff9640 1 -- 172.21.15.45:0/2507867383 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9884005620 con 0x55c321a20b40 2024-09-15T22:22:36.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.076+0000 7f9874ff9640 1 -- 172.21.15.45:0/2507867383 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f987c004b80 con 0x55c321a20b40 2024-09-15T22:22:36.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.076+0000 7f9895af2740 10 client.16527 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:22:36.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.076+0000 7f9895af2740 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:36.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.076+0000 7f9895af2740 20 client.16527 populate_metadata read hostname 'smithi045' 2024-09-15T22:22:36.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.076+0000 7f9895af2740 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c321a3e2d0 0x55c321aab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.076+0000 7f9895af2740 4 client.16527 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:22:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.076+0000 7f9895af2740 1 -- 172.21.15.45:0/2507867383 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c321909170 con 0x55c321a3e2d0 2024-09-15T22:22:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.076+0000 7f98914b5640 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c321a3e2d0 0x55c321aab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.076+0000 7f98914b5640 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c321a3e2d0 0x55c321aab4e0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2599689adedff606 server_cookie=82b9a4dac908cef in_seq=0 out_seq=0 2024-09-15T22:22:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9874ff9640 10 client.16527 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9874ff9640 1 -- 172.21.15.45:0/2507867383 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c321909170 con 0x55c321a3e2d0 2024-09-15T22:22:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9874ff9640 10 client.16527 handle_command_reply: tid=0 2024-09-15T22:22:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9895af2740 1 client.16527 shutdown 2024-09-15T22:22:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9895af2740 1 -- 172.21.15.45:0/2507867383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 msgr2=0x55c321a32320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9895af2740 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 0x55c321a32320 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f987c02a930 tx=0x7f987c0319b0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9895af2740 1 -- 172.21.15.45:0/2507867383 shutdown_connections 2024-09-15T22:22:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9895af2740 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c321a3e2d0 0x55c321aab4e0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9895af2740 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c321a2e780 0x55c321a32860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9895af2740 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c321a20b40 0x55c321a32320 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9895af2740 1 --2- 172.21.15.45:0/2507867383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c321a1f5d0 0x55c321a36ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9895af2740 1 -- 172.21.15.45:0/2507867383 >> 172.21.15.45:0/2507867383 conn(0x55c3219e8310 msgr2=0x55c321a21930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:36.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9874ff9640 0 client.16527 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:36.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9895af2740 1 -- 172.21.15.45:0/2507867383 shutdown_connections 2024-09-15T22:22:36.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9895af2740 1 -- 172.21.15.45:0/2507867383 wait complete. 2024-09-15T22:22:36.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.077+0000 7f9895af2740 20 client.16527 trim_cache size 0 max 16384 2024-09-15T22:22:36.094 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:22:36.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.078+0000 7f9893719640 1 -- 172.21.15.45:0/2283769597 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f98780a33b0 msgr2=0x7f98780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:36.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.078+0000 7f9893719640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f98780a33b0 0x7f98780a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f988401f000 tx=0x7f988401b000 comp rx=0 tx=0).stop 2024-09-15T22:22:36.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.078+0000 7f9893719640 1 -- 172.21.15.45:0/2283769597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f988c101de0 msgr2=0x7f988c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:36.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.078+0000 7f9893719640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f988c101de0 0x7f988c198490 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f988800c920 tx=0x7f988800cde0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.078+0000 7f9893719640 1 -- 172.21.15.45:0/2283769597 shutdown_connections 2024-09-15T22:22:36.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.078+0000 7f9893719640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f98780a33b0 0x7f98780a5870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.078+0000 7f9893719640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f988c106f10 0x7f988c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.078+0000 7f9893719640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f988c102790 0x7f988c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.078+0000 7f9893719640 1 --2- 172.21.15.45:0/2283769597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f988c101de0 0x7f988c198490 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:36.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.078+0000 7f9893719640 1 -- 172.21.15.45:0/2283769597 >> 172.21.15.45:0/2283769597 conn(0x7f988c0fd8c0 msgr2=0x7f988c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:36.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.078+0000 7f9893719640 1 -- 172.21.15.45:0/2283769597 shutdown_connections 2024-09-15T22:22:36.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:36.078+0000 7f9893719640 1 -- 172.21.15.45:0/2283769597 wait complete. 2024-09-15T22:22:37.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:37 smithi165 ceph-mon[35551]: pgmap v194: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:37.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:37 smithi100 ceph-mon[35319]: pgmap v194: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:37.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:37 smithi045 ceph-mon[31180]: pgmap v194: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:37.818 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:22:37.818 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:22:38.093 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:38.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.599+0000 7fcb197a7640 1 -- 172.21.15.45:0/1620159446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb141002a0 msgr2=0x7fcb141006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.599+0000 7fcb197a7640 1 --2- 172.21.15.45:0/1620159446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb141002a0 0x7fcb141006c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009900 tx=0x7fcb0802a410 comp rx=0 tx=0).stop 2024-09-15T22:22:38.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.599+0000 7fcb197a7640 1 -- 172.21.15.45:0/1620159446 shutdown_connections 2024-09-15T22:22:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.599+0000 7fcb197a7640 1 --2- 172.21.15.45:0/1620159446 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb14100c00 0x7fcb1410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.599+0000 7fcb197a7640 1 --2- 172.21.15.45:0/1620159446 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb141002a0 0x7fcb141006c0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.599+0000 7fcb197a7640 1 --2- 172.21.15.45:0/1620159446 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb141062b0 0x7fcb14106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.599+0000 7fcb197a7640 1 -- 172.21.15.45:0/1620159446 >> 172.21.15.45:0/1620159446 conn(0x7fcb140fc5c0 msgr2=0x7fcb140fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.599+0000 7fcb197a7640 1 -- 172.21.15.45:0/1620159446 shutdown_connections 2024-09-15T22:22:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.599+0000 7fcb197a7640 1 -- 172.21.15.45:0/1620159446 wait complete. 2024-09-15T22:22:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.600+0000 7fcb197a7640 1 Processor -- start 2024-09-15T22:22:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.600+0000 7fcb197a7640 1 -- start start 2024-09-15T22:22:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb197a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb141002a0 0x7fcb14198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb197a7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb14100c00 0x7fcb14198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb197a7640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb141062b0 0x7fcb1419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb197a7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcb141120f0 con 0x7fcb141002a0 2024-09-15T22:22:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb197a7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14111f70 con 0x7fcb14100c00 2024-09-15T22:22:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb197a7640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14112270 con 0x7fcb141062b0 2024-09-15T22:22:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb12ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb141002a0 0x7fcb14198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb12ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb141002a0 0x7fcb14198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35016/0 (socket says 172.21.15.45:35016) 2024-09-15T22:22:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb12ffd640 1 -- 172.21.15.45:0/3466787762 learned_addr learned my addr 172.21.15.45:0/3466787762 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb137fe640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb141062b0 0x7fcb1419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb127fc640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb14100c00 0x7fcb14198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb12ffd640 1 -- 172.21.15.45:0/3466787762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb141062b0 msgr2=0x7fcb1419ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb141062b0 0x7fcb1419ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb12ffd640 1 -- 172.21.15.45:0/3466787762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb14100c00 msgr2=0x7fcb14198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb14100c00 0x7fcb14198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.611 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb12ffd640 1 -- 172.21.15.45:0/3466787762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1419d510 con 0x7fcb141002a0 2024-09-15T22:22:38.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb127fc640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb14100c00 0x7fcb14198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:38.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb141002a0 0x7fcb14198560 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400d950 tx=0x7fcb0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:38.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.601+0000 7fcafbfff640 1 -- 172.21.15.45:0/3466787762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04017070 con 0x7fcb141002a0 2024-09-15T22:22:38.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.602+0000 7fcb197a7640 1 -- 172.21.15.45:0/3466787762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1419d800 con 0x7fcb141002a0 2024-09-15T22:22:38.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.602+0000 7fcafbfff640 1 -- 172.21.15.45:0/3466787762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb04009c30 con 0x7fcb141002a0 2024-09-15T22:22:38.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.602+0000 7fcafbfff640 1 -- 172.21.15.45:0/3466787762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0400f740 con 0x7fcb141002a0 2024-09-15T22:22:38.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.602+0000 7fcb197a7640 1 -- 172.21.15.45:0/3466787762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb141a50e0 con 0x7fcb141002a0 2024-09-15T22:22:38.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.604+0000 7fcafbfff640 1 -- 172.21.15.45:0/3466787762 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fcb04010a80 con 0x7fcb141002a0 2024-09-15T22:22:38.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.604+0000 7fcb1bb80740 1 Processor -- start 2024-09-15T22:22:38.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.604+0000 7fcb1bb80740 1 -- start start 2024-09-15T22:22:38.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.605+0000 7fcb1bb80740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41200b60 0x55ed41200f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.605+0000 7fcb1bb80740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed41201480 0x55ed4120b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.605+0000 7fcb1bb80740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed4120bd40 0x55ed4120e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.605+0000 7fcb1bb80740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ed41166280 con 0x55ed41201480 2024-09-15T22:22:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.605+0000 7fcb1bb80740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ed4110db10 con 0x55ed4120bd40 2024-09-15T22:22:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.605+0000 7fcb1bb80740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ed41162240 con 0x55ed41200b60 2024-09-15T22:22:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.605+0000 7fcb12ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed41201480 0x55ed4120b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.605+0000 7fcb137fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41200b60 0x55ed41200f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.605+0000 7fcb137fe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41200b60 0x55ed41200f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.165:3300/0 says I am v2:172.21.15.45:42322/0 (socket says 172.21.15.45:42322) 2024-09-15T22:22:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.605+0000 7fcb137fe640 1 -- 172.21.15.45:0/674545502 learned_addr learned my addr 172.21.15.45:0/674545502 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.605+0000 7fcb127fc640 1 --2- 172.21.15.45:0/674545502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed4120bd40 0x55ed4120e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.605+0000 7fcb12ffd640 1 -- 172.21.15.45:0/674545502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41200b60 msgr2=0x55ed41200f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.605+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/674545502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41200b60 0x55ed41200f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.606+0000 7fcb12ffd640 1 -- 172.21.15.45:0/674545502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed4120bd40 msgr2=0x55ed4120e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.606+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/674545502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed4120bd40 0x55ed4120e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.606+0000 7fcb12ffd640 1 -- 172.21.15.45:0/674545502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed4111a1f0 con 0x55ed41201480 2024-09-15T22:22:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.606+0000 7fcb137fe640 1 --2- 172.21.15.45:0/674545502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41200b60 0x55ed41200f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.606+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/674545502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed41201480 0x55ed4120b800 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcb040cd430 tx=0x7fcb040d83b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979eddec9f7e92ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.606+0000 7fcaf97fa640 1 -- 172.21.15.45:0/674545502 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb040e3070 con 0x55ed41201480 2024-09-15T22:22:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.606+0000 7fcafbfff640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a33b0 0x7fcafc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.606+0000 7fcaf97fa640 1 -- 172.21.15.45:0/674545502 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb040d8bb0 con 0x55ed41201480 2024-09-15T22:22:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.606+0000 7fcaf97fa640 1 -- 172.21.15.45:0/674545502 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb040de770 con 0x55ed41201480 2024-09-15T22:22:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.606+0000 7fcb137fe640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a33b0 0x7fcafc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.607+0000 7fcafbfff640 1 -- 172.21.15.45:0/3466787762 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fcb040d0100 con 0x7fcb141002a0 2024-09-15T22:22:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.607+0000 7fcb1bb80740 1 -- 172.21.15.45:0/674545502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed41201480 msgr2=0x55ed4120b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.607+0000 7fcb137fe640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a33b0 0x7fcafc0a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009fd0 tx=0x7fcb0c00d040 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.607+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/674545502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed41201480 0x55ed4120b800 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcb040cd430 tx=0x7fcb040d83b0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.607+0000 7fcb1bb80740 1 -- 172.21.15.45:0/674545502 shutdown_connections 2024-09-15T22:22:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.607+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/674545502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed4120bd40 0x55ed4120e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.607+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/674545502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed41201480 0x55ed4120b800 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.607+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/674545502 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41200b60 0x55ed41200f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.607+0000 7fcb1bb80740 1 -- 172.21.15.45:0/674545502 >> 172.21.15.45:0/674545502 conn(0x55ed411fd0f0 msgr2=0x55ed411fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.607+0000 7fcb1bb80740 1 -- 172.21.15.45:0/674545502 shutdown_connections 2024-09-15T22:22:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.607+0000 7fcb1bb80740 1 -- 172.21.15.45:0/674545502 wait complete. 2024-09-15T22:22:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb1bb80740 1 -- start start 2024-09-15T22:22:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb1bb80740 1 Processor -- start 2024-09-15T22:22:38.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb1bb80740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41200b60 0x55ed41208c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb1bb80740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed41201480 0x55ed41209170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb1bb80740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 0x55ed412096b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb1bb80740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ed41212d20 con 0x55ed4120bd40 2024-09-15T22:22:38.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb1bb80740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55ed41120f10 con 0x55ed41201480 2024-09-15T22:22:38.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb1bb80740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55ed41212ea0 con 0x55ed41200b60 2024-09-15T22:22:38.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb1bb80740 10 client.0 _ll_register_callbacks cb 0x55ed410e9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:38.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 0x55ed412096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 0x55ed412096b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35034/0 (socket says 172.21.15.45:35034) 2024-09-15T22:22:38.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb137fe640 1 -- 172.21.15.45:0/1756356457 learned_addr learned my addr 172.21.15.45:0/1756356457 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:38.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/1756356457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41200b60 0x55ed41208c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.608+0000 7fcb127fc640 1 --2- 172.21.15.45:0/1756356457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed41201480 0x55ed41209170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcb137fe640 1 -- 172.21.15.45:0/1756356457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41200b60 msgr2=0x55ed41208c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:38.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcb137fe640 1 --2- 172.21.15.45:0/1756356457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41200b60 0x55ed41208c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcb137fe640 1 -- 172.21.15.45:0/1756356457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed41201480 msgr2=0x55ed41209170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:38.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcb137fe640 1 --2- 172.21.15.45:0/1756356457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed41201480 0x55ed41209170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcb137fe640 1 -- 172.21.15.45:0/1756356457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed40ed76a0 con 0x55ed4120bd40 2024-09-15T22:22:38.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcb137fe640 1 --2- 172.21.15.45:0/1756356457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 0x55ed412096b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c007b00 tx=0x7fcb0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47285cf5b93dcf0d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:38.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcaf6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:22:38.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcaf6ff5640 1 -- 172.21.15.45:0/1756356457 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c028060 con 0x55ed4120bd40 2024-09-15T22:22:38.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1756356457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb040d8bb0 con 0x55ed4120bd40 2024-09-15T22:22:38.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcaf6ff5640 1 -- 172.21.15.45:0/1756356457 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fcb0c018df0 con 0x55ed4120bd40 2024-09-15T22:22:38.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcaf6ff5640 1 -- 172.21.15.45:0/1756356457 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcb0c02f050 con 0x55ed4120bd40 2024-09-15T22:22:38.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcb1bb80740 10 client.16539 fetch_fsmap learned FSMap version 21 2024-09-15T22:22:38.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1756356457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ed4121e990 con 0x55ed4120bd40 2024-09-15T22:22:38.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.609+0000 7fcaf6ff5640 1 -- 172.21.15.45:0/1756356457 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb040d8bb0 con 0x55ed4120bd40 2024-09-15T22:22:38.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.610+0000 7fcaf6ff5640 1 -- 172.21.15.45:0/1756356457 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcb0c016760 con 0x55ed4120bd40 2024-09-15T22:22:38.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.610+0000 7fcb1bb80740 10 client.16539 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:22:38.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.610+0000 7fcb1bb80740 10 client.16539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:38.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.610+0000 7fcb1bb80740 20 client.16539 populate_metadata read hostname 'smithi045' 2024-09-15T22:22:38.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.610+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/1756356457 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55ed4121fe50 0x55ed41222260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.610+0000 7fcb1bb80740 4 client.16539 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:22:38.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.610+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1756356457 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed411737f0 con 0x55ed4121fe50 2024-09-15T22:22:38.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.610+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/1756356457 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55ed4121fe50 0x55ed41222260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.611+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/1756356457 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55ed4121fe50 0x55ed41222260 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91eea2a1cc364a10 server_cookie=cc90a131244e0d7c in_seq=0 out_seq=0 2024-09-15T22:22:38.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.611+0000 7fcaf6ff5640 10 client.16539 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:38.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.611+0000 7fcaf6ff5640 1 -- 172.21.15.45:0/1756356457 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed411737f0 con 0x55ed4121fe50 2024-09-15T22:22:38.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.611+0000 7fcaf6ff5640 10 client.16539 handle_command_reply: tid=0 2024-09-15T22:22:38.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.611+0000 7fcb1bb80740 1 client.16539 shutdown 2024-09-15T22:22:38.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.612+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1756356457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 msgr2=0x55ed412096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.612+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/1756356457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 0x55ed412096b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c007b00 tx=0x7fcb0c004a40 comp rx=0 tx=0).stop 2024-09-15T22:22:38.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.612+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1756356457 shutdown_connections 2024-09-15T22:22:38.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.612+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/1756356457 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55ed4121fe50 0x55ed41222260 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.612+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/1756356457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 0x55ed412096b0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.612+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/1756356457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed41201480 0x55ed41209170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.612+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/1756356457 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41200b60 0x55ed41208c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.612+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1756356457 >> 172.21.15.45:0/1756356457 conn(0x55ed411fd0f0 msgr2=0x55ed41202dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:38.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.612+0000 7fcaf6ff5640 0 client.16539 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:38.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.612+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1756356457 shutdown_connections 2024-09-15T22:22:38.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.612+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1756356457 wait complete. 2024-09-15T22:22:38.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.612+0000 7fcb1bb80740 20 client.16539 trim_cache size 0 max 16384 2024-09-15T22:22:38.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.629+0000 7fcb1bb80740 1 Processor -- start 2024-09-15T22:22:38.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.629+0000 7fcb1bb80740 1 -- start start 2024-09-15T22:22:38.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.629+0000 7fcb1bb80740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed41200b60 0x55ed41202cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.629+0000 7fcb1bb80740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41201480 0x55ed41227b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.629+0000 7fcb1bb80740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed4120bd40 0x55ed41228070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.629+0000 7fcb1bb80740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcb141ab0c0 con 0x55ed41200b60 2024-09-15T22:22:38.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.629+0000 7fcb1bb80740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb141ad940 con 0x55ed4120bd40 2024-09-15T22:22:38.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.629+0000 7fcb1bb80740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb141ab730 con 0x55ed41201480 2024-09-15T22:22:38.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.629+0000 7fcb12ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed41200b60 0x55ed41202cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.629+0000 7fcb12ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed41200b60 0x55ed41202cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35036/0 (socket says 172.21.15.45:35036) 2024-09-15T22:22:38.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.629+0000 7fcb12ffd640 1 -- 172.21.15.45:0/947858281 learned_addr learned my addr 172.21.15.45:0/947858281 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:38.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.630+0000 7fcb137fe640 1 --2- 172.21.15.45:0/947858281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed4120bd40 0x55ed41228070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.630+0000 7fcb12ffd640 1 -- 172.21.15.45:0/947858281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41201480 msgr2=0x55ed41227b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:38.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.630+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/947858281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41201480 0x55ed41227b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.630+0000 7fcb12ffd640 1 -- 172.21.15.45:0/947858281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed4120bd40 msgr2=0x55ed41228070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:38.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.630+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/947858281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed4120bd40 0x55ed41228070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.630+0000 7fcb12ffd640 1 -- 172.21.15.45:0/947858281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed41207be0 con 0x55ed41200b60 2024-09-15T22:22:38.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.630+0000 7fcb137fe640 1 --2- 172.21.15.45:0/947858281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed4120bd40 0x55ed41228070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:38.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.630+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/947858281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed41200b60 0x55ed41202cc0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcb04010fd0 tx=0x7fcb0400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c5047c1e400aee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:38.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.630+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/947858281 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb04020040 con 0x55ed41200b60 2024-09-15T22:22:38.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.630+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/947858281 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb040bc0b0 con 0x55ed41200b60 2024-09-15T22:22:38.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.630+0000 7fcaf8ff9640 1 -- 172.21.15.45:0/947858281 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0409bfc0 con 0x55ed41200b60 2024-09-15T22:22:38.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.631+0000 7fcb1bb80740 1 -- 172.21.15.45:0/947858281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed41200b60 msgr2=0x55ed41202cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.631+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/947858281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed41200b60 0x55ed41202cc0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcb04010fd0 tx=0x7fcb0400bf60 comp rx=0 tx=0).stop 2024-09-15T22:22:38.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.631+0000 7fcb1bb80740 1 -- 172.21.15.45:0/947858281 shutdown_connections 2024-09-15T22:22:38.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.631+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/947858281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed4120bd40 0x55ed41228070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.631+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/947858281 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41201480 0x55ed41227b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.631+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/947858281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed41200b60 0x55ed41202cc0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.631+0000 7fcb1bb80740 1 -- 172.21.15.45:0/947858281 >> 172.21.15.45:0/947858281 conn(0x55ed411fd0f0 msgr2=0x55ed412025b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.631+0000 7fcb1bb80740 1 -- 172.21.15.45:0/947858281 shutdown_connections 2024-09-15T22:22:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.631+0000 7fcb1bb80740 1 -- 172.21.15.45:0/947858281 wait complete. 2024-09-15T22:22:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.631+0000 7fcb1bb80740 1 -- start start 2024-09-15T22:22:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.631+0000 7fcb1bb80740 1 Processor -- start 2024-09-15T22:22:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb1bb80740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed41200b60 0x55ed41214120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb1bb80740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41201480 0x55ed41214660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb1bb80740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 0x55ed41214bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb1bb80740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcb141abe00 con 0x55ed4120bd40 2024-09-15T22:22:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb1bb80740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb141ad270 con 0x55ed41200b60 2024-09-15T22:22:38.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb1bb80740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb141ac4d0 con 0x55ed41201480 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb1bb80740 10 client.0 _ll_register_callbacks cb 0x7fcb0c009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 0x55ed41214bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb137fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 0x55ed41214bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35042/0 (socket says 172.21.15.45:35042) 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb137fe640 1 -- 172.21.15.45:0/1963301919 learned_addr learned my addr 172.21.15.45:0/1963301919 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb127fc640 1 --2- 172.21.15.45:0/1963301919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41201480 0x55ed41214660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/1963301919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed41200b60 0x55ed41214120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb137fe640 1 -- 172.21.15.45:0/1963301919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41201480 msgr2=0x55ed41214660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb137fe640 1 --2- 172.21.15.45:0/1963301919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41201480 0x55ed41214660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb137fe640 1 -- 172.21.15.45:0/1963301919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed41200b60 msgr2=0x55ed41214120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb137fe640 1 --2- 172.21.15.45:0/1963301919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed41200b60 0x55ed41214120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb137fe640 1 -- 172.21.15.45:0/1963301919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed41289dd0 con 0x55ed4120bd40 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcb137fe640 1 --2- 172.21.15.45:0/1963301919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 0x55ed41214bc0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009690 tx=0x7fcb0c016f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61508300548498c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.632+0000 7fcaf6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:22:38.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcaf6ff5640 1 -- 172.21.15.45:0/1963301919 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c038060 con 0x55ed4120bd40 2024-09-15T22:22:38.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1963301919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb040bc0b0 con 0x55ed4120bd40 2024-09-15T22:22:38.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcaf6ff5640 1 -- 172.21.15.45:0/1963301919 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fcb0c0163d0 con 0x55ed4120bd40 2024-09-15T22:22:38.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcaf6ff5640 1 -- 172.21.15.45:0/1963301919 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcb0c028020 con 0x55ed4120bd40 2024-09-15T22:22:38.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcb1bb80740 10 client.16545 fetch_fsmap learned FSMap version 21 2024-09-15T22:22:38.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1963301919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ed4128b0e0 con 0x55ed4120bd40 2024-09-15T22:22:38.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcaf6ff5640 1 -- 172.21.15.45:0/1963301919 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb040bc0b0 con 0x55ed4120bd40 2024-09-15T22:22:38.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcaf6ff5640 1 -- 172.21.15.45:0/1963301919 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcb0c023be0 con 0x55ed4120bd40 2024-09-15T22:22:38.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcb1bb80740 10 client.16545 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:22:38.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcb1bb80740 10 client.16545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:38.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcb1bb80740 20 client.16545 populate_metadata read hostname 'smithi045' 2024-09-15T22:22:38.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/1963301919 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55ed4128b830 0x55ed4128dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:38.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcb1bb80740 4 client.16545 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:22:38.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.633+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1963301919 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ed4116dd00 con 0x55ed4128b830 2024-09-15T22:22:38.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.634+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/1963301919 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55ed4128b830 0x55ed4128dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:38.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.634+0000 7fcb12ffd640 1 --2- 172.21.15.45:0/1963301919 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55ed4128b830 0x55ed4128dc50 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2acbbb209fe2283 server_cookie=6b14f2b02c3fecf5 in_seq=0 out_seq=0 2024-09-15T22:22:38.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.634+0000 7fcaf6ff5640 10 client.16545 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:38.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.635+0000 7fcaf6ff5640 1 -- 172.21.15.45:0/1963301919 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ed4116dd00 con 0x55ed4128b830 2024-09-15T22:22:38.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.635+0000 7fcaf6ff5640 10 client.16545 handle_command_reply: tid=0 2024-09-15T22:22:38.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.635+0000 7fcb1bb80740 1 client.16545 shutdown 2024-09-15T22:22:38.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.635+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1963301919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 msgr2=0x55ed41214bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.635+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/1963301919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 0x55ed41214bc0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009690 tx=0x7fcb0c016f80 comp rx=0 tx=0).stop 2024-09-15T22:22:38.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.635+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1963301919 shutdown_connections 2024-09-15T22:22:38.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.635+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/1963301919 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55ed4128b830 0x55ed4128dc50 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.635+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/1963301919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ed4120bd40 0x55ed41214bc0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.635+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/1963301919 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55ed41201480 0x55ed41214660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.635+0000 7fcaf6ff5640 0 client.16545 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:38.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.635+0000 7fcb1bb80740 1 --2- 172.21.15.45:0/1963301919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55ed41200b60 0x55ed41214120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.635+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1963301919 >> 172.21.15.45:0/1963301919 conn(0x55ed411fd0f0 msgr2=0x55ed411fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:38.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.635+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1963301919 shutdown_connections 2024-09-15T22:22:38.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb1bb80740 1 -- 172.21.15.45:0/1963301919 wait complete. 2024-09-15T22:22:38.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb1bb80740 20 client.16545 trim_cache size 0 max 16384 2024-09-15T22:22:38.642 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:22:38.642 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:22:38.642 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "e3a42aef-8494-4433-8afe-b2172f8652d3", 2024-09-15T22:22:38.642 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:22:38.642 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:22:38.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb197a7640 1 -- 172.21.15.45:0/3466787762 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a33b0 msgr2=0x7fcafc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb197a7640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a33b0 0x7fcafc0a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009fd0 tx=0x7fcb0c00d040 comp rx=0 tx=0).stop 2024-09-15T22:22:38.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb197a7640 1 -- 172.21.15.45:0/3466787762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb141002a0 msgr2=0x7fcb14198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:38.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb197a7640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb141002a0 0x7fcb14198560 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcb0400d950 tx=0x7fcb0400de10 comp rx=0 tx=0).stop 2024-09-15T22:22:38.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb197a7640 1 -- 172.21.15.45:0/3466787762 shutdown_connections 2024-09-15T22:22:38.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb197a7640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcafc0a33b0 0x7fcafc0a5870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb197a7640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb141062b0 0x7fcb1419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb197a7640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb14100c00 0x7fcb14198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb197a7640 1 --2- 172.21.15.45:0/3466787762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb141002a0 0x7fcb14198560 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:38.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb197a7640 1 -- 172.21.15.45:0/3466787762 >> 172.21.15.45:0/3466787762 conn(0x7fcb140fc5c0 msgr2=0x7fcb140fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:38.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb197a7640 1 -- 172.21.15.45:0/3466787762 shutdown_connections 2024-09-15T22:22:38.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:38.636+0000 7fcb197a7640 1 -- 172.21.15.45:0/3466787762 wait complete. 2024-09-15T22:22:39.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:22:39.697 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:22:39.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:39 smithi165 ceph-mon[35551]: pgmap v195: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:39.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:39 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:22:39.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:39 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:22:39.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:39 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:22:39.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:39 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:22:39.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:39 smithi100 ceph-mon[35319]: pgmap v195: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:39.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:39 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:22:39.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:39 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:22:39.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:39 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:22:39.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:39 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:22:39.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:39 smithi045 ceph-mon[31180]: pgmap v195: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:39.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:39 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:22:39.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:39 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:22:39.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:39 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:22:39.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:39 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:22:40.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 -- 172.21.15.45:0/1508428768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe64c1062b0 msgr2=0x7fe64c106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:40.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 --2- 172.21.15.45:0/1508428768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe64c1062b0 0x7fe64c106690 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009900 tx=0x7fe63c02a410 comp rx=0 tx=0).stop 2024-09-15T22:22:40.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 -- 172.21.15.45:0/1508428768 shutdown_connections 2024-09-15T22:22:40.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 --2- 172.21.15.45:0/1508428768 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe64c100c00 0x7fe64c10d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 --2- 172.21.15.45:0/1508428768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe64c1002a0 0x7fe64c1006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 --2- 172.21.15.45:0/1508428768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe64c1062b0 0x7fe64c106690 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 -- 172.21.15.45:0/1508428768 >> 172.21.15.45:0/1508428768 conn(0x7fe64c0fc5c0 msgr2=0x7fe64c0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:40.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 -- 172.21.15.45:0/1508428768 shutdown_connections 2024-09-15T22:22:40.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 -- 172.21.15.45:0/1508428768 wait complete. 2024-09-15T22:22:40.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 Processor -- start 2024-09-15T22:22:40.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 -- start start 2024-09-15T22:22:40.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe64c1002a0 0x7fe64c10e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe64c100c00 0x7fe64c10eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.191+0000 7fe652c0c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe64c1062b0 0x7fe64c10f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe652c0c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c1120b0 con 0x7fe64c1002a0 2024-09-15T22:22:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe652c0c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c111f30 con 0x7fe64c100c00 2024-09-15T22:22:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe652c0c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c112230 con 0x7fe64c1062b0 2024-09-15T22:22:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe6509a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe64c1002a0 0x7fe64c10e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe6509a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe64c1002a0 0x7fe64c10e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35062/0 (socket says 172.21.15.45:35062) 2024-09-15T22:22:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe6509a8640 1 -- 172.21.15.45:0/4216927262 learned_addr learned my addr 172.21.15.45:0/4216927262 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe64bfff640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe64c100c00 0x7fe64c10eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe6511a9640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe64c1062b0 0x7fe64c10f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe6509a8640 1 -- 172.21.15.45:0/4216927262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe64c1062b0 msgr2=0x7fe64c10f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe6509a8640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe64c1062b0 0x7fe64c10f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe6509a8640 1 -- 172.21.15.45:0/4216927262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe64c100c00 msgr2=0x7fe64c10eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:40.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe6509a8640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe64c100c00 0x7fe64c10eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe6509a8640 1 -- 172.21.15.45:0/4216927262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64c1a6a10 con 0x7fe64c1002a0 2024-09-15T22:22:40.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe6511a9640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe64c1062b0 0x7fe64c10f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:40.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe6509a8640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe64c1002a0 0x7fe64c10e990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe63c006010 tx=0x7fe63c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:40.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe649ffb640 1 -- 172.21.15.45:0/4216927262 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c03f030 con 0x7fe64c1002a0 2024-09-15T22:22:40.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe652c0c640 1 -- 172.21.15.45:0/4216927262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64c1a6ca0 con 0x7fe64c1002a0 2024-09-15T22:22:40.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe649ffb640 1 -- 172.21.15.45:0/4216927262 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe63c0044c0 con 0x7fe64c1002a0 2024-09-15T22:22:40.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.192+0000 7fe649ffb640 1 -- 172.21.15.45:0/4216927262 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c035070 con 0x7fe64c1002a0 2024-09-15T22:22:40.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.193+0000 7fe652c0c640 1 -- 172.21.15.45:0/4216927262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe64c1a7180 con 0x7fe64c1002a0 2024-09-15T22:22:40.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.195+0000 7fe649ffb640 1 -- 172.21.15.45:0/4216927262 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe63c042030 con 0x7fe64c1002a0 2024-09-15T22:22:40.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.195+0000 7fe654fe5740 1 Processor -- start 2024-09-15T22:22:40.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.195+0000 7fe654fe5740 1 -- start start 2024-09-15T22:22:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.195+0000 7fe654fe5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710e44a0 0x5558710e4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.195+0000 7fe654fe5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e4dc0 0x5558710ef140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe654fe5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710ef680 0x5558710f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe654fe5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55587104a2e0 con 0x5558710ef680 2024-09-15T22:22:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe654fe5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555870ff1ce0 con 0x5558710e44a0 2024-09-15T22:22:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe654fe5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5558710462a0 con 0x5558710e4dc0 2024-09-15T22:22:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe649ffb640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe6340a33b0 0x7fe6340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe64bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710ef680 0x5558710f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe64bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710ef680 0x5558710f1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35066/0 (socket says 172.21.15.45:35066) 2024-09-15T22:22:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe64bfff640 1 -- 172.21.15.45:0/2720220840 learned_addr learned my addr 172.21.15.45:0/2720220840 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe6511a9640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe6340a33b0 0x7fe6340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe6511a9640 1 --2- 172.21.15.45:0/2720220840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710e44a0 0x5558710e4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe649ffb640 1 -- 172.21.15.45:0/4216927262 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fe63c0f04b0 con 0x7fe64c1002a0 2024-09-15T22:22:40.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe6509a8640 1 --2- 172.21.15.45:0/2720220840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e4dc0 0x5558710ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe64bfff640 1 -- 172.21.15.45:0/2720220840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e4dc0 msgr2=0x5558710ef140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:40.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe64bfff640 1 --2- 172.21.15.45:0/2720220840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e4dc0 0x5558710ef140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe64bfff640 1 -- 172.21.15.45:0/2720220840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710e44a0 msgr2=0x5558710e4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:40.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe64bfff640 1 --2- 172.21.15.45:0/2720220840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710e44a0 0x5558710e4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe64bfff640 1 -- 172.21.15.45:0/2720220840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555870fd6440 con 0x5558710ef680 2024-09-15T22:22:40.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe6509a8640 1 --2- 172.21.15.45:0/2720220840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e4dc0 0x5558710ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:40.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe6511a9640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe6340a33b0 0x7fe6340a5870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe644009270 tx=0x7fe644013b60 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:40.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe64bfff640 1 --2- 172.21.15.45:0/2720220840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710ef680 0x5558710f1a70 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe640009c90 tx=0x7fe640011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533ee727c079a58d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:40.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.196+0000 7fe632ffd640 1 -- 172.21.15.45:0/2720220840 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64001e070 con 0x5558710ef680 2024-09-15T22:22:40.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.197+0000 7fe632ffd640 1 -- 172.21.15.45:0/2720220840 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe640019b30 con 0x5558710ef680 2024-09-15T22:22:40.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.197+0000 7fe632ffd640 1 -- 172.21.15.45:0/2720220840 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64000ea70 con 0x5558710ef680 2024-09-15T22:22:40.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.197+0000 7fe654fe5740 1 -- 172.21.15.45:0/2720220840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710ef680 msgr2=0x5558710f1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:40.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.197+0000 7fe654fe5740 1 --2- 172.21.15.45:0/2720220840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710ef680 0x5558710f1a70 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe640009c90 tx=0x7fe640011810 comp rx=0 tx=0).stop 2024-09-15T22:22:40.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.197+0000 7fe654fe5740 1 -- 172.21.15.45:0/2720220840 shutdown_connections 2024-09-15T22:22:40.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.197+0000 7fe654fe5740 1 --2- 172.21.15.45:0/2720220840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710ef680 0x5558710f1a70 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.197+0000 7fe654fe5740 1 --2- 172.21.15.45:0/2720220840 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e4dc0 0x5558710ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.197+0000 7fe654fe5740 1 --2- 172.21.15.45:0/2720220840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710e44a0 0x5558710e4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.197+0000 7fe654fe5740 1 -- 172.21.15.45:0/2720220840 >> 172.21.15.45:0/2720220840 conn(0x5558710e0a30 msgr2=0x5558710e0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:40.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.197+0000 7fe654fe5740 1 -- 172.21.15.45:0/2720220840 shutdown_connections 2024-09-15T22:22:40.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.197+0000 7fe654fe5740 1 -- 172.21.15.45:0/2720220840 wait complete. 2024-09-15T22:22:40.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.198+0000 7fe654fe5740 1 -- start start 2024-09-15T22:22:40.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.198+0000 7fe654fe5740 1 Processor -- start 2024-09-15T22:22:40.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.198+0000 7fe654fe5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710e44a0 0x5558710eef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.198+0000 7fe654fe5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 0x5558710ec1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.198+0000 7fe654fe5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710ef680 0x5558710ec730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.198+0000 7fe654fe5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5558710f2250 con 0x5558710e4dc0 2024-09-15T22:22:40.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.198+0000 7fe654fe5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555871005050 con 0x5558710e44a0 2024-09-15T22:22:40.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.198+0000 7fe654fe5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5558710f23d0 con 0x5558710ef680 2024-09-15T22:22:40.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.198+0000 7fe654fe5740 10 client.0 _ll_register_callbacks cb 0x555871045160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:40.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.198+0000 7fe64bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 0x5558710ec1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.198+0000 7fe64bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 0x5558710ec1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35072/0 (socket says 172.21.15.45:35072) 2024-09-15T22:22:40.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.198+0000 7fe64bfff640 1 -- 172.21.15.45:0/1441754861 learned_addr learned my addr 172.21.15.45:0/1441754861 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:40.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe6509a8640 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710e44a0 0x5558710eef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe6511a9640 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710ef680 0x5558710ec730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe64bfff640 1 -- 172.21.15.45:0/1441754861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710ef680 msgr2=0x5558710ec730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:40.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe64bfff640 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710ef680 0x5558710ec730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe64bfff640 1 -- 172.21.15.45:0/1441754861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710e44a0 msgr2=0x5558710eef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:40.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe64bfff640 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710e44a0 0x5558710eef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe64bfff640 1 -- 172.21.15.45:0/1441754861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555870dbb3c0 con 0x5558710e4dc0 2024-09-15T22:22:40.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe6509a8640 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710e44a0 0x5558710eef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:22:40.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe64bfff640 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 0x5558710ec1f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe64001c040 tx=0x7fe640005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f34949a0d3f7cd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:40.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe62bfff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:22:40.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe62bfff640 1 -- 172.21.15.45:0/1441754861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64001e050 con 0x5558710e4dc0 2024-09-15T22:22:40.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe62bfff640 1 -- 172.21.15.45:0/1441754861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fe640005450 con 0x5558710e4dc0 2024-09-15T22:22:40.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe654fe5740 1 -- 172.21.15.45:0/1441754861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe640019b30 con 0x5558710e4dc0 2024-09-15T22:22:40.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe62bfff640 1 -- 172.21.15.45:0/1441754861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe640032050 con 0x5558710e4dc0 2024-09-15T22:22:40.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe654fe5740 10 client.16557 fetch_fsmap learned FSMap version 21 2024-09-15T22:22:40.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe654fe5740 1 -- 172.21.15.45:0/1441754861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5558710fdbd0 con 0x5558710e4dc0 2024-09-15T22:22:40.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.199+0000 7fe62bfff640 1 -- 172.21.15.45:0/1441754861 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe640019b30 con 0x5558710e4dc0 2024-09-15T22:22:40.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.200+0000 7fe62bfff640 1 -- 172.21.15.45:0/1441754861 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe64002d030 con 0x5558710e4dc0 2024-09-15T22:22:40.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.200+0000 7fe654fe5740 10 client.16557 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:22:40.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.200+0000 7fe654fe5740 10 client.16557 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:40.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.200+0000 7fe654fe5740 20 client.16557 populate_metadata read hostname 'smithi045' 2024-09-15T22:22:40.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.200+0000 7fe654fe5740 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5558710ff090 0x555871101480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.200+0000 7fe654fe5740 4 client.16557 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:22:40.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.200+0000 7fe654fe5740 1 -- 172.21.15.45:0/1441754861 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555871057850 con 0x5558710ff090 2024-09-15T22:22:40.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.200+0000 7fe6509a8640 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5558710ff090 0x555871101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.200+0000 7fe6509a8640 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5558710ff090 0x555871101480 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5338d0d6a14b7d77 server_cookie=965485dcb4f12ea1 in_seq=0 out_seq=0 2024-09-15T22:22:40.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.200+0000 7fe62bfff640 10 client.16557 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:40.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe62bfff640 1 -- 172.21.15.45:0/1441754861 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555871057850 con 0x5558710ff090 2024-09-15T22:22:40.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe62bfff640 10 client.16557 handle_command_reply: tid=0 2024-09-15T22:22:40.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe654fe5740 1 client.16557 shutdown 2024-09-15T22:22:40.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe654fe5740 1 -- 172.21.15.45:0/1441754861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 msgr2=0x5558710ec1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:40.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe654fe5740 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 0x5558710ec1f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe64001c040 tx=0x7fe640005db0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe654fe5740 1 -- 172.21.15.45:0/1441754861 shutdown_connections 2024-09-15T22:22:40.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe654fe5740 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5558710ff090 0x555871101480 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe654fe5740 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710ef680 0x5558710ec730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe654fe5740 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 0x5558710ec1f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe654fe5740 1 --2- 172.21.15.45:0/1441754861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710e44a0 0x5558710eef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe62bfff640 0 client.16557 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:40.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe654fe5740 1 -- 172.21.15.45:0/1441754861 >> 172.21.15.45:0/1441754861 conn(0x5558710e0a30 msgr2=0x5558710e6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:40.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe654fe5740 1 -- 172.21.15.45:0/1441754861 shutdown_connections 2024-09-15T22:22:40.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.201+0000 7fe654fe5740 1 -- 172.21.15.45:0/1441754861 wait complete. 2024-09-15T22:22:40.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.202+0000 7fe654fe5740 20 client.16557 trim_cache size 0 max 16384 2024-09-15T22:22:40.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe654fe5740 1 Processor -- start 2024-09-15T22:22:40.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe654fe5740 1 -- start start 2024-09-15T22:22:40.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe654fe5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e44a0 0x5558710fb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe654fe5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e4dc0 0x555871106c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe654fe5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710ef680 0x5558711071d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe654fe5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c1af400 con 0x5558710e44a0 2024-09-15T22:22:40.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe654fe5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c1b1c80 con 0x5558710ef680 2024-09-15T22:22:40.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe654fe5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c1afa70 con 0x5558710e4dc0 2024-09-15T22:22:40.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe6509a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e44a0 0x5558710fb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe6509a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e44a0 0x5558710fb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35082/0 (socket says 172.21.15.45:35082) 2024-09-15T22:22:40.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe6509a8640 1 -- 172.21.15.45:0/3637162637 learned_addr learned my addr 172.21.15.45:0/3637162637 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:40.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe6511a9640 1 --2- 172.21.15.45:0/3637162637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710ef680 0x5558711071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe6509a8640 1 -- 172.21.15.45:0/3637162637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e4dc0 msgr2=0x555871106c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:40.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe6509a8640 1 --2- 172.21.15.45:0/3637162637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e4dc0 0x555871106c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe6509a8640 1 -- 172.21.15.45:0/3637162637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710ef680 msgr2=0x5558711071d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:40.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe6509a8640 1 --2- 172.21.15.45:0/3637162637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710ef680 0x5558711071d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe6509a8640 1 -- 172.21.15.45:0/3637162637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558710e0860 con 0x5558710e44a0 2024-09-15T22:22:40.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe6511a9640 1 --2- 172.21.15.45:0/3637162637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710ef680 0x5558711071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:22:40.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.219+0000 7fe6509a8640 1 --2- 172.21.15.45:0/3637162637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e44a0 0x5558710fb4e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0b87d0 tx=0x7fe63c086d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8768bb9fbc862d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:40.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.220+0000 7fe6327fc640 1 -- 172.21.15.45:0/3637162637 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c049040 con 0x5558710e44a0 2024-09-15T22:22:40.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.220+0000 7fe6327fc640 1 -- 172.21.15.45:0/3637162637 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe63c0bca70 con 0x5558710e44a0 2024-09-15T22:22:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.220+0000 7fe6327fc640 1 -- 172.21.15.45:0/3637162637 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0b89e0 con 0x5558710e44a0 2024-09-15T22:22:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.220+0000 7fe654fe5740 1 -- 172.21.15.45:0/3637162637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e44a0 msgr2=0x5558710fb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.220+0000 7fe654fe5740 1 --2- 172.21.15.45:0/3637162637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e44a0 0x5558710fb4e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0b87d0 tx=0x7fe63c086d60 comp rx=0 tx=0).stop 2024-09-15T22:22:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.220+0000 7fe654fe5740 1 -- 172.21.15.45:0/3637162637 shutdown_connections 2024-09-15T22:22:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.220+0000 7fe654fe5740 1 --2- 172.21.15.45:0/3637162637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710ef680 0x5558711071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.220+0000 7fe654fe5740 1 --2- 172.21.15.45:0/3637162637 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e4dc0 0x555871106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.220+0000 7fe654fe5740 1 --2- 172.21.15.45:0/3637162637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e44a0 0x5558710fb4e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.220+0000 7fe654fe5740 1 -- 172.21.15.45:0/3637162637 >> 172.21.15.45:0/3637162637 conn(0x5558710e0a30 msgr2=0x5558710e7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.220+0000 7fe654fe5740 1 -- 172.21.15.45:0/3637162637 shutdown_connections 2024-09-15T22:22:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.220+0000 7fe654fe5740 1 -- 172.21.15.45:0/3637162637 wait complete. 2024-09-15T22:22:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.221+0000 7fe654fe5740 1 -- start start 2024-09-15T22:22:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.221+0000 7fe654fe5740 1 Processor -- start 2024-09-15T22:22:40.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.221+0000 7fe654fe5740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e44a0 0x555871161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.221+0000 7fe654fe5740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 0x555871162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.221+0000 7fe654fe5740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710ef680 0x5558710f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.221+0000 7fe654fe5740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c1b0140 con 0x5558710e4dc0 2024-09-15T22:22:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.221+0000 7fe654fe5740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c1b15b0 con 0x5558710ef680 2024-09-15T22:22:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.221+0000 7fe654fe5740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fe64c1b0810 con 0x5558710e44a0 2024-09-15T22:22:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.221+0000 7fe654fe5740 10 client.0 _ll_register_callbacks cb 0x7fe64001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:22:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.221+0000 7fe64bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 0x555871162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.221+0000 7fe64bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 0x555871162340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35098/0 (socket says 172.21.15.45:35098) 2024-09-15T22:22:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.221+0000 7fe64bfff640 1 -- 172.21.15.45:0/2152168411 learned_addr learned my addr 172.21.15.45:0/2152168411 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:22:40.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe6509a8640 1 --2- 172.21.15.45:0/2152168411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e44a0 0x555871161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe6511a9640 1 --2- 172.21.15.45:0/2152168411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710ef680 0x5558710f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe64bfff640 1 -- 172.21.15.45:0/2152168411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e44a0 msgr2=0x555871161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe64bfff640 1 --2- 172.21.15.45:0/2152168411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e44a0 0x555871161e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe64bfff640 1 -- 172.21.15.45:0/2152168411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710ef680 msgr2=0x5558710f72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:22:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe64bfff640 1 --2- 172.21.15.45:0/2152168411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710ef680 0x5558710f72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe64bfff640 1 -- 172.21.15.45:0/2152168411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558710e5330 con 0x5558710e4dc0 2024-09-15T22:22:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe64bfff640 1 --2- 172.21.15.45:0/2152168411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 0x555871162340 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe64000eef0 tx=0x7fe6400093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a5d44dc594ab1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:22:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe62bfff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:22:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe62bfff640 1 -- 172.21.15.45:0/2152168411 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64003b060 con 0x5558710e4dc0 2024-09-15T22:22:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe62bfff640 1 -- 172.21.15.45:0/2152168411 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9480+0+0 (secure 0 0 0) 0x7fe64000e510 con 0x5558710e4dc0 2024-09-15T22:22:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe654fe5740 1 -- 172.21.15.45:0/2152168411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe63c0bca70 con 0x5558710e4dc0 2024-09-15T22:22:40.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe62bfff640 1 -- 172.21.15.45:0/2152168411 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe640042050 con 0x5558710e4dc0 2024-09-15T22:22:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe654fe5740 10 client.16563 fetch_fsmap learned FSMap version 21 2024-09-15T22:22:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe654fe5740 1 -- 172.21.15.45:0/2152168411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555871169470 con 0x5558710e4dc0 2024-09-15T22:22:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.222+0000 7fe62bfff640 1 -- 172.21.15.45:0/2152168411 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe63c0bca70 con 0x5558710e4dc0 2024-09-15T22:22:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.223+0000 7fe62bfff640 1 -- 172.21.15.45:0/2152168411 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe64002d040 con 0x5558710e4dc0 2024-09-15T22:22:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.223+0000 7fe654fe5740 10 client.16563 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:22:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.223+0000 7fe654fe5740 10 client.16563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:22:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.223+0000 7fe654fe5740 20 client.16563 populate_metadata read hostname 'smithi045' 2024-09-15T22:22:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.223+0000 7fe654fe5740 1 --2- 172.21.15.45:0/2152168411 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555871169bc0 0x55587116bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:22:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.223+0000 7fe654fe5740 4 client.16563 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:22:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.223+0000 7fe654fe5740 1 -- 172.21.15.45:0/2152168411 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555871051d60 con 0x555871169bc0 2024-09-15T22:22:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.223+0000 7fe6509a8640 1 --2- 172.21.15.45:0/2152168411 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555871169bc0 0x55587116bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:22:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe6509a8640 1 --2- 172.21.15.45:0/2152168411 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555871169bc0 0x55587116bfe0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6740310f31aa8d7d server_cookie=ccaaed8720f82073 in_seq=0 out_seq=0 2024-09-15T22:22:40.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe62bfff640 10 client.16563 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe62bfff640 1 -- 172.21.15.45:0/2152168411 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x555871051d60 con 0x555871169bc0 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe62bfff640 10 client.16563 handle_command_reply: tid=0 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe654fe5740 1 client.16563 shutdown 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe654fe5740 1 -- 172.21.15.45:0/2152168411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 msgr2=0x555871162340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe654fe5740 1 --2- 172.21.15.45:0/2152168411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 0x555871162340 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe64000eef0 tx=0x7fe6400093e0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe654fe5740 1 -- 172.21.15.45:0/2152168411 shutdown_connections 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe654fe5740 1 --2- 172.21.15.45:0/2152168411 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555871169bc0 0x55587116bfe0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe654fe5740 1 --2- 172.21.15.45:0/2152168411 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5558710ef680 0x5558710f72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe654fe5740 1 --2- 172.21.15.45:0/2152168411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5558710e4dc0 0x555871162340 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe654fe5740 1 --2- 172.21.15.45:0/2152168411 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5558710e44a0 0x555871161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe62bfff640 0 client.16563 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe654fe5740 1 -- 172.21.15.45:0/2152168411 >> 172.21.15.45:0/2152168411 conn(0x5558710e0a30 msgr2=0x5558710eda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe654fe5740 1 -- 172.21.15.45:0/2152168411 shutdown_connections 2024-09-15T22:22:40.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe654fe5740 1 -- 172.21.15.45:0/2152168411 wait complete. 2024-09-15T22:22:40.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.224+0000 7fe654fe5740 20 client.16563 trim_cache size 0 max 16384 2024-09-15T22:22:40.235 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:22:40.235 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:22:40.235 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:22:40.235 INFO:teuthology.orchestra.run.smithi045.stdout: "e3a42aef-8494-4433-8afe-b2172f8652d3": { 2024-09-15T22:22:40.235 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:22:40.235 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "e3a42aef-8494-4433-8afe-b2172f8652d3", 2024-09-15T22:22:40.235 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:22:40.235 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:22:40.236 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:22:40.236 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:22:40.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.225+0000 7fe652c0c640 1 -- 172.21.15.45:0/4216927262 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe6340a33b0 msgr2=0x7fe6340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:40.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.225+0000 7fe652c0c640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe6340a33b0 0x7fe6340a5870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe644009270 tx=0x7fe644013b60 comp rx=0 tx=0).stop 2024-09-15T22:22:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.225+0000 7fe652c0c640 1 -- 172.21.15.45:0/4216927262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe64c1002a0 msgr2=0x7fe64c10e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:22:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.225+0000 7fe652c0c640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe64c1002a0 0x7fe64c10e990 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe63c006010 tx=0x7fe63c0040c0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.225+0000 7fe652c0c640 1 -- 172.21.15.45:0/4216927262 shutdown_connections 2024-09-15T22:22:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.225+0000 7fe652c0c640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fe6340a33b0 0x7fe6340a5870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.225+0000 7fe652c0c640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fe64c1062b0 0x7fe64c10f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.225+0000 7fe652c0c640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe64c100c00 0x7fe64c10eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.225+0000 7fe652c0c640 1 --2- 172.21.15.45:0/4216927262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe64c1002a0 0x7fe64c10e990 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:22:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.225+0000 7fe652c0c640 1 -- 172.21.15.45:0/4216927262 >> 172.21.15.45:0/4216927262 conn(0x7fe64c0fc5c0 msgr2=0x7fe64c0fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:22:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.225+0000 7fe652c0c640 1 -- 172.21.15.45:0/4216927262 shutdown_connections 2024-09-15T22:22:40.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:22:40.225+0000 7fe652c0c640 1 -- 172.21.15.45:0/4216927262 wait complete. 2024-09-15T22:22:41.121 INFO:tasks.cephfs.filesystem:scrub status for tag:e3a42aef-8494-4433-8afe-b2172f8652d3 - {'path': '/', 'tag': 'e3a42aef-8494-4433-8afe-b2172f8652d3', 'options': 'recursive,force'} 2024-09-15T22:22:41.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:41 smithi165 ceph-mon[35551]: pgmap v196: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-15T22:22:41.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:41 smithi100 ceph-mon[35319]: pgmap v196: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-15T22:22:41.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:41 smithi045 ceph-mon[31180]: pgmap v196: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-15T22:22:42.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:42 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:22:42.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:42 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:22:42.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:42 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:22:43.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:43 smithi165 ceph-mon[35551]: pgmap v197: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T22:22:43.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:43 smithi100 ceph-mon[35319]: pgmap v197: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T22:22:43.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:43 smithi045 ceph-mon[31180]: pgmap v197: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T22:22:45.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:45 smithi165 ceph-mon[35551]: pgmap v198: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:22:45.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:45 smithi100 ceph-mon[35319]: pgmap v198: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:22:45.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:45 smithi045 ceph-mon[31180]: pgmap v198: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:22:47.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:47 smithi165 ceph-mon[35551]: pgmap v199: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:22:47.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:47 smithi100 ceph-mon[35319]: pgmap v199: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:22:47.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:47 smithi045 ceph-mon[31180]: pgmap v199: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:22:49.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:49 smithi165 ceph-mon[35551]: pgmap v200: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:22:49.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:49 smithi100 ceph-mon[35319]: pgmap v200: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:22:49.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:49 smithi045 ceph-mon[31180]: pgmap v200: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:22:51.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:51 smithi165 ceph-mon[35551]: pgmap v201: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:22:51.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:51 smithi100 ceph-mon[35319]: pgmap v201: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:22:51.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:51 smithi045 ceph-mon[31180]: pgmap v201: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:22:53.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:53 smithi165 ceph-mon[35551]: pgmap v202: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T22:22:53.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:53 smithi100 ceph-mon[35319]: pgmap v202: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T22:22:53.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:53 smithi045 ceph-mon[31180]: pgmap v202: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T22:22:55.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:55 smithi165 ceph-mon[35551]: pgmap v203: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-15T22:22:55.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:55 smithi100 ceph-mon[35319]: pgmap v203: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-15T22:22:55.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:55 smithi045 ceph-mon[31180]: pgmap v203: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-15T22:22:57.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:57 smithi165 ceph-mon[35551]: pgmap v204: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:57.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:57 smithi100 ceph-mon[35319]: pgmap v204: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:57.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:57 smithi045 ceph-mon[31180]: pgmap v204: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:58.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:22:58 smithi165 ceph-mon[35551]: pgmap v205: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:58.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:22:58 smithi100 ceph-mon[35319]: pgmap v205: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:22:58.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:22:58 smithi045 ceph-mon[31180]: pgmap v205: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:00.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:00 smithi100 ceph-mon[35319]: pgmap v206: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:01.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:00 smithi045 ceph-mon[31180]: pgmap v206: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:01.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:00 smithi165 ceph-mon[35551]: pgmap v206: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:02.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:02 smithi100 ceph-mon[35319]: pgmap v207: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:03.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:02 smithi045 ceph-mon[31180]: pgmap v207: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:03.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:02 smithi165 ceph-mon[35551]: pgmap v207: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:04.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:04 smithi100 ceph-mon[35319]: pgmap v208: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:23:05.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:04 smithi045 ceph-mon[31180]: pgmap v208: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:23:05.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:04 smithi165 ceph-mon[35551]: pgmap v208: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:23:06.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:06 smithi100 ceph-mon[35319]: pgmap v209: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:23:07.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:06 smithi045 ceph-mon[31180]: pgmap v209: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:23:07.216 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:06 smithi165 ceph-mon[35551]: pgmap v209: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:23:08.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:08 smithi100 ceph-mon[35319]: pgmap v210: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:23:08.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:08 smithi100 ceph-mon[35319]: osdmap e93: 12 total, 12 up, 12 in 2024-09-15T22:23:09.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:08 smithi045 ceph-mon[31180]: pgmap v210: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:23:09.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:08 smithi045 ceph-mon[31180]: osdmap e93: 12 total, 12 up, 12 in 2024-09-15T22:23:09.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:08 smithi165 ceph-mon[35551]: pgmap v210: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:23:09.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:08 smithi165 ceph-mon[35551]: osdmap e93: 12 total, 12 up, 12 in 2024-09-15T22:23:10.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:10 smithi100 ceph-mon[35319]: pgmap v212: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:23:11.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:10 smithi045 ceph-mon[31180]: pgmap v212: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:23:11.123 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:23:11.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:10 smithi165 ceph-mon[35551]: pgmap v212: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:23:11.399 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.929+0000 7f8d084f5640 1 -- 172.21.15.45:0/3234303135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d001037a0 msgr2=0x7f8d0010bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.929+0000 7f8d084f5640 1 --2- 172.21.15.45:0/3234303135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d001037a0 0x7f8d0010bc00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009900 tx=0x7f8cf002a410 comp rx=0 tx=0).stop 2024-09-15T22:23:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.929+0000 7f8d084f5640 1 -- 172.21.15.45:0/3234303135 shutdown_connections 2024-09-15T22:23:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.929+0000 7f8d084f5640 1 --2- 172.21.15.45:0/3234303135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d0010c2f0 0x7f8d0010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.929+0000 7f8d084f5640 1 --2- 172.21.15.45:0/3234303135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d001037a0 0x7f8d0010bc00 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.929+0000 7f8d084f5640 1 --2- 172.21.15.45:0/3234303135 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d00102df0 0x7f8d001031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.929+0000 7f8d084f5640 1 -- 172.21.15.45:0/3234303135 >> 172.21.15.45:0/3234303135 conn(0x7f8d000fc7d0 msgr2=0x7f8d000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.929+0000 7f8d084f5640 1 -- 172.21.15.45:0/3234303135 shutdown_connections 2024-09-15T22:23:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.929+0000 7f8d084f5640 1 -- 172.21.15.45:0/3234303135 wait complete. 2024-09-15T22:23:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.930+0000 7f8d084f5640 1 Processor -- start 2024-09-15T22:23:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.930+0000 7f8d084f5640 1 -- start start 2024-09-15T22:23:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.930+0000 7f8d084f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d00102df0 0x7f8d00100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.930+0000 7f8d084f5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d001037a0 0x7f8d00100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.930+0000 7f8d084f5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0010c2f0 0x7f8d001014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.930+0000 7f8d084f5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00112340 con 0x7f8d00102df0 2024-09-15T22:23:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.930+0000 7f8d084f5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8d001121c0 con 0x7f8d001037a0 2024-09-15T22:23:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.930+0000 7f8d084f5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d001124c0 con 0x7f8d0010c2f0 2024-09-15T22:23:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.930+0000 7f8d06291640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d00102df0 0x7f8d00100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.930+0000 7f8d06291640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d00102df0 0x7f8d00100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34688/0 (socket says 172.21.15.45:34688) 2024-09-15T22:23:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.930+0000 7f8d06291640 1 -- 172.21.15.45:0/1760091642 learned_addr learned my addr 172.21.15.45:0/1760091642 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.930+0000 7f8d05a90640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d001037a0 0x7f8d00100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.930+0000 7f8d06a92640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0010c2f0 0x7f8d001014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.931+0000 7f8d06291640 1 -- 172.21.15.45:0/1760091642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0010c2f0 msgr2=0x7f8d001014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.931+0000 7f8d06291640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0010c2f0 0x7f8d001014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.931+0000 7f8d06291640 1 -- 172.21.15.45:0/1760091642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d001037a0 msgr2=0x7f8d00100f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.931+0000 7f8d06291640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d001037a0 0x7f8d00100f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.931+0000 7f8d06291640 1 -- 172.21.15.45:0/1760091642 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d001a6c70 con 0x7f8d00102df0 2024-09-15T22:23:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.931+0000 7f8d05a90640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d001037a0 0x7f8d00100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.931+0000 7f8d06291640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d00102df0 0x7f8d00100a50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00b4a0 tx=0x7f8cfc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.931+0000 7f8cf77fe640 1 -- 172.21.15.45:0/1760091642 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc014070 con 0x7f8d00102df0 2024-09-15T22:23:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.931+0000 7f8cf77fe640 1 -- 172.21.15.45:0/1760091642 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cfc010b10 con 0x7f8d00102df0 2024-09-15T22:23:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.931+0000 7f8d084f5640 1 -- 172.21.15.45:0/1760091642 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d001a6f60 con 0x7f8d00102df0 2024-09-15T22:23:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.931+0000 7f8cf77fe640 1 -- 172.21.15.45:0/1760091642 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc017d60 con 0x7f8d00102df0 2024-09-15T22:23:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.931+0000 7f8d084f5640 1 -- 172.21.15.45:0/1760091642 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d001a73c0 con 0x7f8d00102df0 2024-09-15T22:23:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.934+0000 7f8cf77fe640 1 -- 172.21.15.45:0/1760091642 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8cfc017070 con 0x7f8d00102df0 2024-09-15T22:23:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.934+0000 7f8d0a8ce740 1 Processor -- start 2024-09-15T22:23:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.934+0000 7f8d0a8ce740 1 -- start start 2024-09-15T22:23:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d0a8ce740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b706c4a0 0x55e3b706c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d0a8ce740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 0x55e3b7077140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d0a8ce740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 0x55e3b7079a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d0a8ce740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e3b6fd22e0 con 0x55e3b7077680 2024-09-15T22:23:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d0a8ce740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e3b6f79ce0 con 0x55e3b706cdc0 2024-09-15T22:23:11.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d0a8ce740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e3b6fce2a0 con 0x55e3b706c4a0 2024-09-15T22:23:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d05a90640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 0x55e3b7079a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d05a90640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 0x55e3b7079a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34696/0 (socket says 172.21.15.45:34696) 2024-09-15T22:23:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d05a90640 1 -- 172.21.15.45:0/2269125610 learned_addr learned my addr 172.21.15.45:0/2269125610 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d06291640 1 --2- 172.21.15.45:0/2269125610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 0x55e3b7077140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d06a92640 1 --2- 172.21.15.45:0/2269125610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b706c4a0 0x55e3b706c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8cf77fe640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8cec0a33b0 0x7f8cec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d06a92640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8cec0a33b0 0x7f8cec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d05a90640 1 -- 172.21.15.45:0/2269125610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b706c4a0 msgr2=0x55e3b706c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d05a90640 1 --2- 172.21.15.45:0/2269125610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b706c4a0 0x55e3b706c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d05a90640 1 -- 172.21.15.45:0/2269125610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 msgr2=0x55e3b7077140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d05a90640 1 --2- 172.21.15.45:0/2269125610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 0x55e3b7077140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.935+0000 7f8d05a90640 1 -- 172.21.15.45:0/2269125610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b6f5e440 con 0x55e3b7077680 2024-09-15T22:23:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.936+0000 7f8cf77fe640 1 -- 172.21.15.45:0/1760091642 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9656+0+0 (secure 0 0 0) 0x7f8cfc0cf4a0 con 0x7f8d00102df0 2024-09-15T22:23:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.936+0000 7f8d05a90640 1 --2- 172.21.15.45:0/2269125610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 0x55e3b7079a70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009900 tx=0x7f8cf00040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d2af75c0b175aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.936+0000 7f8d06a92640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8cec0a33b0 0x7f8cec0a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009fd0 tx=0x7f8cf800e040 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.936+0000 7f8cf4ff9640 1 -- 172.21.15.45:0/2269125610 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf003f070 con 0x55e3b7077680 2024-09-15T22:23:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.936+0000 7f8cf4ff9640 1 -- 172.21.15.45:0/2269125610 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cf0031b40 con 0x55e3b7077680 2024-09-15T22:23:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.936+0000 7f8cf4ff9640 1 -- 172.21.15.45:0/2269125610 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0035070 con 0x55e3b7077680 2024-09-15T22:23:11.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.937+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/2269125610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 msgr2=0x55e3b7079a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.937+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/2269125610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 0x55e3b7079a70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009900 tx=0x7f8cf00040f0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.937+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/2269125610 shutdown_connections 2024-09-15T22:23:11.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.937+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/2269125610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 0x55e3b7079a70 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.937+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/2269125610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 0x55e3b7077140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.937+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/2269125610 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b706c4a0 0x55e3b706c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.937+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/2269125610 >> 172.21.15.45:0/2269125610 conn(0x55e3b7068a30 msgr2=0x55e3b7068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.937+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/2269125610 shutdown_connections 2024-09-15T22:23:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.937+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/2269125610 wait complete. 2024-09-15T22:23:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.937+0000 7f8d0a8ce740 1 -- start start 2024-09-15T22:23:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.937+0000 7f8d0a8ce740 1 Processor -- start 2024-09-15T22:23:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d0a8ce740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706c4a0 0x55e3b7076f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d0a8ce740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706cdc0 0x55e3b70741c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d0a8ce740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b7077680 0x55e3b7074700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d0a8ce740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e3b707a250 con 0x55e3b706cdc0 2024-09-15T22:23:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d0a8ce740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e3b6f8d050 con 0x55e3b706c4a0 2024-09-15T22:23:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d0a8ce740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e3b707a3d0 con 0x55e3b7077680 2024-09-15T22:23:11.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d0a8ce740 10 client.0 _ll_register_callbacks cb 0x55e3b6fcd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d05a90640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706cdc0 0x55e3b70741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d05a90640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706cdc0 0x55e3b70741c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34710/0 (socket says 172.21.15.45:34710) 2024-09-15T22:23:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d05a90640 1 -- 172.21.15.45:0/2338605602 learned_addr learned my addr 172.21.15.45:0/2338605602 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d06291640 1 --2- 172.21.15.45:0/2338605602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706c4a0 0x55e3b7076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d05a90640 1 -- 172.21.15.45:0/2338605602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b7077680 msgr2=0x55e3b7074700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d05a90640 1 --2- 172.21.15.45:0/2338605602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b7077680 0x55e3b7074700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d05a90640 1 -- 172.21.15.45:0/2338605602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706c4a0 msgr2=0x55e3b7076f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d05a90640 1 --2- 172.21.15.45:0/2338605602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706c4a0 0x55e3b7076f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d05a90640 1 -- 172.21.15.45:0/2338605602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3b6d433c0 con 0x55e3b706cdc0 2024-09-15T22:23:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d06291640 1 --2- 172.21.15.45:0/2338605602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706c4a0 0x55e3b7076f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d05a90640 1 --2- 172.21.15.45:0/2338605602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706cdc0 0x55e3b70741c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8cf002a930 tx=0x7f8cf0032f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf7cb914cccfdfc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8ce9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:11.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8ce9ffb640 1 -- 172.21.15.45:0/2338605602 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf004b030 con 0x55e3b706cdc0 2024-09-15T22:23:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8ce9ffb640 1 -- 172.21.15.45:0/2338605602 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9656+0+0 (secure 0 0 0) 0x7f8cf0003d50 con 0x55e3b706cdc0 2024-09-15T22:23:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.938+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/2338605602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cf0031b40 con 0x55e3b706cdc0 2024-09-15T22:23:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.939+0000 7f8ce9ffb640 1 -- 172.21.15.45:0/2338605602 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8cf0055050 con 0x55e3b706cdc0 2024-09-15T22:23:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.939+0000 7f8d0a8ce740 10 client.16575 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.939+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/2338605602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e3b7085b90 con 0x55e3b706cdc0 2024-09-15T22:23:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.939+0000 7f8ce9ffb640 1 -- 172.21.15.45:0/2338605602 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cf0031b40 con 0x55e3b706cdc0 2024-09-15T22:23:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.939+0000 7f8ce9ffb640 1 -- 172.21.15.45:0/2338605602 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8cf0044c20 con 0x55e3b706cdc0 2024-09-15T22:23:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.939+0000 7f8d0a8ce740 10 client.16575 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.939+0000 7f8d0a8ce740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.939+0000 7f8d0a8ce740 20 client.16575 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.939+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/2338605602 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e3b7086ee0 0x55e3b70892d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.939+0000 7f8d0a8ce740 4 client.16575 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:23:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.939+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/2338605602 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3b6fdf850 con 0x55e3b7086ee0 2024-09-15T22:23:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.939+0000 7f8d06291640 1 --2- 172.21.15.45:0/2338605602 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e3b7086ee0 0x55e3b70892d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.940+0000 7f8d06291640 1 --2- 172.21.15.45:0/2338605602 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e3b7086ee0 0x55e3b70892d0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65bcfb031d14c878 server_cookie=7e374e92c933b934 in_seq=0 out_seq=0 2024-09-15T22:23:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.940+0000 7f8ce9ffb640 10 client.16575 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.940+0000 7f8ce9ffb640 1 -- 172.21.15.45:0/2338605602 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3b6fdf850 con 0x55e3b7086ee0 2024-09-15T22:23:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.940+0000 7f8ce9ffb640 10 client.16575 handle_command_reply: tid=0 2024-09-15T22:23:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.941+0000 7f8d0a8ce740 1 client.16575 shutdown 2024-09-15T22:23:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.941+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/2338605602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706cdc0 msgr2=0x55e3b70741c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.941+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/2338605602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706cdc0 0x55e3b70741c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f8cf002a930 tx=0x7f8cf0032f30 comp rx=0 tx=0).stop 2024-09-15T22:23:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.941+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/2338605602 shutdown_connections 2024-09-15T22:23:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.941+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/2338605602 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e3b7086ee0 0x55e3b70892d0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.941+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/2338605602 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b7077680 0x55e3b7074700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.941+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/2338605602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706cdc0 0x55e3b70741c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.941+0000 7f8ce9ffb640 0 client.16575 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:11.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.941+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/2338605602 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706c4a0 0x55e3b7076f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.941+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/2338605602 >> 172.21.15.45:0/2338605602 conn(0x55e3b7068a30 msgr2=0x55e3b706e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:11.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.941+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/2338605602 shutdown_connections 2024-09-15T22:23:11.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.941+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/2338605602 wait complete. 2024-09-15T22:23:11.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.941+0000 7f8d0a8ce740 20 client.16575 trim_cache size 0 max 16384 2024-09-15T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.958+0000 7f8d0a8ce740 1 Processor -- start 2024-09-15T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.958+0000 7f8d0a8ce740 1 -- start start 2024-09-15T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.958+0000 7f8d0a8ce740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b706c4a0 0x55e3b70834e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.958+0000 7f8d0a8ce740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 0x55e3b70731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.958+0000 7f8d0a8ce740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 0x55e3b708e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.958+0000 7f8d0a8ce740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8d001af620 con 0x55e3b7077680 2024-09-15T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.958+0000 7f8d0a8ce740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8d001b1e80 con 0x55e3b706cdc0 2024-09-15T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.958+0000 7f8d0a8ce740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d001afc70 con 0x55e3b706c4a0 2024-09-15T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.958+0000 7f8d06a92640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 0x55e3b708e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.958+0000 7f8d06a92640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 0x55e3b708e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34720/0 (socket says 172.21.15.45:34720) 2024-09-15T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.958+0000 7f8d06a92640 1 -- 172.21.15.45:0/1972508061 learned_addr learned my addr 172.21.15.45:0/1972508061 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.959+0000 7f8d06291640 1 --2- 172.21.15.45:0/1972508061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b706c4a0 0x55e3b70834e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.959+0000 7f8d06a92640 1 -- 172.21.15.45:0/1972508061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b706c4a0 msgr2=0x55e3b70834e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.959+0000 7f8d05a90640 1 --2- 172.21.15.45:0/1972508061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 0x55e3b70731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.959+0000 7f8d06a92640 1 --2- 172.21.15.45:0/1972508061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b706c4a0 0x55e3b70834e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.959+0000 7f8d06a92640 1 -- 172.21.15.45:0/1972508061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 msgr2=0x55e3b70731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.959+0000 7f8d06a92640 1 --2- 172.21.15.45:0/1972508061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 0x55e3b70731a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.959+0000 7f8d06a92640 1 -- 172.21.15.45:0/1972508061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b7068860 con 0x55e3b7077680 2024-09-15T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.959+0000 7f8d06a92640 1 --2- 172.21.15.45:0/1972508061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 0x55e3b708e8a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8cf80096d0 tx=0x7f8cf8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7633385660a44dfe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.959+0000 7f8cebfff640 1 -- 172.21.15.45:0/1972508061 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8015050 con 0x55e3b7077680 2024-09-15T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.959+0000 7f8cebfff640 1 -- 172.21.15.45:0/1972508061 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cf8016040 con 0x55e3b7077680 2024-09-15T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.959+0000 7f8cebfff640 1 -- 172.21.15.45:0/1972508061 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8025c10 con 0x55e3b7077680 2024-09-15T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/1972508061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 msgr2=0x55e3b708e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/1972508061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 0x55e3b708e8a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f8cf80096d0 tx=0x7f8cf8004a40 comp rx=0 tx=0).stop 2024-09-15T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/1972508061 shutdown_connections 2024-09-15T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/1972508061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b7077680 0x55e3b708e8a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/1972508061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 0x55e3b70731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/1972508061 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b706c4a0 0x55e3b70834e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/1972508061 >> 172.21.15.45:0/1972508061 conn(0x55e3b7068a30 msgr2=0x55e3b7072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/1972508061 shutdown_connections 2024-09-15T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/1972508061 wait complete. 2024-09-15T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 -- start start 2024-09-15T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 Processor -- start 2024-09-15T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706c4a0 0x55e3b707ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 0x55e3b7071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b7077680 0x55e3b7071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8d001b0340 con 0x55e3b706c4a0 2024-09-15T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8d001b17b0 con 0x55e3b706cdc0 2024-09-15T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f8d001b0a10 con 0x55e3b7077680 2024-09-15T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d0a8ce740 10 client.0 _ll_register_callbacks cb 0x7f8cfc097740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.960+0000 7f8d06291640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706c4a0 0x55e3b707ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d06291640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706c4a0 0x55e3b707ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34728/0 (socket says 172.21.15.45:34728) 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d06291640 1 -- 172.21.15.45:0/1497632093 learned_addr learned my addr 172.21.15.45:0/1497632093 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d05a90640 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 0x55e3b7071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d06a92640 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b7077680 0x55e3b7071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d06291640 1 -- 172.21.15.45:0/1497632093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b7077680 msgr2=0x55e3b7071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d06291640 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b7077680 0x55e3b7071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d06291640 1 -- 172.21.15.45:0/1497632093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 msgr2=0x55e3b7071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d06291640 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 0x55e3b7071050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d06291640 1 -- 172.21.15.45:0/1497632093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3b70f0870 con 0x55e3b706c4a0 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d05a90640 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 0x55e3b7071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d06291640 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706c4a0 0x55e3b707ff60 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc097880 tx=0x7f8cfc00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8916d345ceb7fac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8ce9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8ce9ffb640 1 -- 172.21.15.45:0/1497632093 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc01e040 con 0x55e3b706c4a0 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8ce9ffb640 1 -- 172.21.15.45:0/1497632093 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9656+0+0 (secure 0 0 0) 0x7f8cfc010cc0 con 0x55e3b706c4a0 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/1497632093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cf8016040 con 0x55e3b706c4a0 2024-09-15T22:23:11.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8ce9ffb640 1 -- 172.21.15.45:0/1497632093 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8cfc09bb20 con 0x55e3b706c4a0 2024-09-15T22:23:11.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d0a8ce740 10 client.16581 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:11.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.961+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/1497632093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e3b70f19e0 con 0x55e3b706c4a0 2024-09-15T22:23:11.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.962+0000 7f8ce9ffb640 1 -- 172.21.15.45:0/1497632093 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cf8016040 con 0x55e3b706c4a0 2024-09-15T22:23:11.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.962+0000 7f8ce9ffb640 1 -- 172.21.15.45:0/1497632093 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8cfc097a90 con 0x55e3b706c4a0 2024-09-15T22:23:11.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.962+0000 7f8d0a8ce740 10 client.16581 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:11.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.962+0000 7f8d0a8ce740 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:11.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.962+0000 7f8d0a8ce740 20 client.16581 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:11.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.962+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e3b70f20b0 0x55e3b70f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:11.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.962+0000 7f8d0a8ce740 4 client.16581 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:23:11.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.962+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/1497632093 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e3b6fd9d60 con 0x55e3b70f20b0 2024-09-15T22:23:11.969 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.962+0000 7f8d05a90640 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e3b70f20b0 0x55e3b70f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:11.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8d05a90640 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e3b70f20b0 0x55e3b70f44a0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7285dcd79ab5da82 server_cookie=3c1ccdd49da83f88 in_seq=0 out_seq=0 2024-09-15T22:23:11.970 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8ce9ffb640 10 client.16581 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:11.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8ce9ffb640 1 -- 172.21.15.45:0/1497632093 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e3b6fd9d60 con 0x55e3b70f20b0 2024-09-15T22:23:11.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8ce9ffb640 10 client.16581 handle_command_reply: tid=0 2024-09-15T22:23:11.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8d0a8ce740 1 client.16581 shutdown 2024-09-15T22:23:11.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/1497632093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706c4a0 msgr2=0x55e3b707ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706c4a0 0x55e3b707ff60 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc097880 tx=0x7f8cfc00bf90 comp rx=0 tx=0).stop 2024-09-15T22:23:11.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/1497632093 shutdown_connections 2024-09-15T22:23:11.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e3b70f20b0 0x55e3b70f44a0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e3b7077680 0x55e3b7071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e3b706cdc0 0x55e3b7071050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8d0a8ce740 1 --2- 172.21.15.45:0/1497632093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e3b706c4a0 0x55e3b707ff60 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/1497632093 >> 172.21.15.45:0/1497632093 conn(0x55e3b7068a30 msgr2=0x55e3b70732b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:11.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8ce9ffb640 0 client.16581 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:11.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/1497632093 shutdown_connections 2024-09-15T22:23:11.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8d0a8ce740 1 -- 172.21.15.45:0/1497632093 wait complete. 2024-09-15T22:23:11.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.963+0000 7f8d0a8ce740 20 client.16581 trim_cache size 0 max 16384 2024-09-15T22:23:11.972 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:23:11.972 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:23:11.972 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:23:11.972 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:23:11.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.964+0000 7f8d084f5640 1 -- 172.21.15.45:0/1760091642 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8cec0a33b0 msgr2=0x7f8cec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.964+0000 7f8d084f5640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8cec0a33b0 0x7f8cec0a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009fd0 tx=0x7f8cf800e040 comp rx=0 tx=0).stop 2024-09-15T22:23:11.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.964+0000 7f8d084f5640 1 -- 172.21.15.45:0/1760091642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d00102df0 msgr2=0x7f8d00100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:11.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.964+0000 7f8d084f5640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d00102df0 0x7f8d00100a50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00b4a0 tx=0x7f8cfc00b960 comp rx=0 tx=0).stop 2024-09-15T22:23:11.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.964+0000 7f8d084f5640 1 -- 172.21.15.45:0/1760091642 shutdown_connections 2024-09-15T22:23:11.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.964+0000 7f8d084f5640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f8cec0a33b0 0x7f8cec0a5870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.964+0000 7f8d084f5640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f8d0010c2f0 0x7f8d001014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.964+0000 7f8d084f5640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8d001037a0 0x7f8d00100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.964+0000 7f8d084f5640 1 --2- 172.21.15.45:0/1760091642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d00102df0 0x7f8d00100a50 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:11.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.964+0000 7f8d084f5640 1 -- 172.21.15.45:0/1760091642 >> 172.21.15.45:0/1760091642 conn(0x7f8d000fc7d0 msgr2=0x7f8d000fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:11.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.964+0000 7f8d084f5640 1 -- 172.21.15.45:0/1760091642 shutdown_connections 2024-09-15T22:23:11.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:11.964+0000 7f8d084f5640 1 -- 172.21.15.45:0/1760091642 wait complete. 2024-09-15T22:23:12.925 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:23:12.925 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:23:12.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:12 smithi100 ceph-mon[35319]: pgmap v213: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:23:13.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:12 smithi045 ceph-mon[31180]: pgmap v213: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:23:13.187 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:13.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:12 smithi165 ceph-mon[35551]: pgmap v213: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:23:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.691+0000 7f498b0c9640 1 -- 172.21.15.45:0/2430023254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49841036e0 msgr2=0x7f4984107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.691+0000 7f498b0c9640 1 --2- 172.21.15.45:0/2430023254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49841036e0 0x7f4984107b90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4978009930 tx=0x7f497802a420 comp rx=0 tx=0).stop 2024-09-15T22:23:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.691+0000 7f498b0c9640 1 -- 172.21.15.45:0/2430023254 shutdown_connections 2024-09-15T22:23:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.691+0000 7f498b0c9640 1 --2- 172.21.15.45:0/2430023254 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49841082a0 0x7f498410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.691+0000 7f498b0c9640 1 --2- 172.21.15.45:0/2430023254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49841036e0 0x7f4984107b90 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.691+0000 7f498b0c9640 1 --2- 172.21.15.45:0/2430023254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4984102d30 0x7f4984103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.691+0000 7f498b0c9640 1 -- 172.21.15.45:0/2430023254 >> 172.21.15.45:0/2430023254 conn(0x7f49840fc7d0 msgr2=0x7f49840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.691+0000 7f498b0c9640 1 -- 172.21.15.45:0/2430023254 shutdown_connections 2024-09-15T22:23:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.691+0000 7f498b0c9640 1 -- 172.21.15.45:0/2430023254 wait complete. 2024-09-15T22:23:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f498b0c9640 1 Processor -- start 2024-09-15T22:23:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f498b0c9640 1 -- start start 2024-09-15T22:23:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f498b0c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4984102d30 0x7f49841a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f498b0c9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49841036e0 0x7f49841a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f498b0c9640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49841082a0 0x7f498419a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f498b0c9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f49841121c0 con 0x7f49841036e0 2024-09-15T22:23:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f498b0c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4984112040 con 0x7f4984102d30 2024-09-15T22:23:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f498b0c9640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4984112340 con 0x7f49841082a0 2024-09-15T22:23:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f4983fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49841036e0 0x7f49841a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f4983fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49841036e0 0x7f49841a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34736/0 (socket says 172.21.15.45:34736) 2024-09-15T22:23:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f4983fff640 1 -- 172.21.15.45:0/2472911877 learned_addr learned my addr 172.21.15.45:0/2472911877 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f4989666640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49841082a0 0x7f498419a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f4988e65640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4984102d30 0x7f49841a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f4983fff640 1 -- 172.21.15.45:0/2472911877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49841082a0 msgr2=0x7f498419a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f4983fff640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49841082a0 0x7f498419a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f4983fff640 1 -- 172.21.15.45:0/2472911877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4984102d30 msgr2=0x7f49841a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f4983fff640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4984102d30 0x7f49841a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f4983fff640 1 -- 172.21.15.45:0/2472911877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f498419afa0 con 0x7f49841036e0 2024-09-15T22:23:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.692+0000 7f4988e65640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4984102d30 0x7f49841a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.693+0000 7f4983fff640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49841036e0 0x7f49841a0ba0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4978004770 tx=0x7f49780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.693+0000 7f4981ffb640 1 -- 172.21.15.45:0/2472911877 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497803f030 con 0x7f49841036e0 2024-09-15T22:23:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.693+0000 7f4981ffb640 1 -- 172.21.15.45:0/2472911877 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4978003d00 con 0x7f49841036e0 2024-09-15T22:23:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.693+0000 7f498b0c9640 1 -- 172.21.15.45:0/2472911877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f498419b230 con 0x7f49841036e0 2024-09-15T22:23:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.693+0000 7f4981ffb640 1 -- 172.21.15.45:0/2472911877 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978035070 con 0x7f49841036e0 2024-09-15T22:23:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.693+0000 7f498b0c9640 1 -- 172.21.15.45:0/2472911877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49841a7410 con 0x7f49841036e0 2024-09-15T22:23:13.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.694+0000 7f498b0c9640 1 -- 172.21.15.45:0/2472911877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f498406a850 con 0x7f49841036e0 2024-09-15T22:23:13.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.696+0000 7f4981ffb640 1 -- 172.21.15.45:0/2472911877 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4978042030 con 0x7f49841036e0 2024-09-15T22:23:13.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.696+0000 7f4981ffb640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f496c0a33b0 0x7f496c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:13.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.696+0000 7f4988e65640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f496c0a33b0 0x7f496c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:13.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.696+0000 7f4981ffb640 1 -- 172.21.15.45:0/2472911877 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9656+0+0 (secure 0 0 0) 0x7f49780f0a00 con 0x7f49841036e0 2024-09-15T22:23:13.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.697+0000 7f4988e65640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f496c0a33b0 0x7f496c0a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4974009b40 tx=0x7f4974005e50 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:13.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.699+0000 7f4981ffb640 1 -- 172.21.15.45:0/2472911877 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f49780bcf10 con 0x7f49841036e0 2024-09-15T22:23:13.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.913+0000 7f498b0c9640 1 -- 172.21.15.45:0/2472911877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4984103110 con 0x7f49841036e0 2024-09-15T22:23:13.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.914+0000 7f4981ffb640 1 -- 172.21.15.45:0/2472911877 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f49780bc810 con 0x7f49841036e0 2024-09-15T22:23:13.917 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:23:13.917 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:23:13.917 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:23:13.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.916+0000 7f498b0c9640 1 -- 172.21.15.45:0/2472911877 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f496c0a33b0 msgr2=0x7f496c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:13.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.916+0000 7f498b0c9640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f496c0a33b0 0x7f496c0a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4974009b40 tx=0x7f4974005e50 comp rx=0 tx=0).stop 2024-09-15T22:23:13.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.916+0000 7f498b0c9640 1 -- 172.21.15.45:0/2472911877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49841036e0 msgr2=0x7f49841a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:13.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.916+0000 7f498b0c9640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49841036e0 0x7f49841a0ba0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4978004770 tx=0x7f49780042f0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.917+0000 7f498b0c9640 1 -- 172.21.15.45:0/2472911877 shutdown_connections 2024-09-15T22:23:13.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.917+0000 7f498b0c9640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f496c0a33b0 0x7f496c0a5870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.917+0000 7f498b0c9640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f49841082a0 0x7f498419a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.917+0000 7f498b0c9640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49841036e0 0x7f49841a0ba0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.917+0000 7f498b0c9640 1 --2- 172.21.15.45:0/2472911877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4984102d30 0x7f49841a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:13.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.917+0000 7f498b0c9640 1 -- 172.21.15.45:0/2472911877 >> 172.21.15.45:0/2472911877 conn(0x7f49840fc7d0 msgr2=0x7f49840fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:13.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.917+0000 7f498b0c9640 1 -- 172.21.15.45:0/2472911877 shutdown_connections 2024-09-15T22:23:13.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:13.917+0000 7f498b0c9640 1 -- 172.21.15.45:0/2472911877 wait complete. 2024-09-15T22:23:14.547 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:23:14.811 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:15.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:14 smithi045 ceph-mon[31180]: pgmap v214: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T22:23:15.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:14 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2472911877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:23:15.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:14 smithi045 ceph-mon[31180]: osdmap e94: 12 total, 12 up, 12 in 2024-09-15T22:23:15.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:14 smithi165 ceph-mon[35551]: pgmap v214: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T22:23:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:14 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2472911877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:23:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:14 smithi165 ceph-mon[35551]: osdmap e94: 12 total, 12 up, 12 in 2024-09-15T22:23:15.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:14 smithi100 ceph-mon[35319]: pgmap v214: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T22:23:15.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:14 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2472911877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:23:15.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:14 smithi100 ceph-mon[35319]: osdmap e94: 12 total, 12 up, 12 in 2024-09-15T22:23:15.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.350+0000 7faeea50f640 1 -- 172.21.15.45:0/3718335569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee4102d40 msgr2=0x7faee4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.350+0000 7faeea50f640 1 --2- 172.21.15.45:0/3718335569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee4102d40 0x7faee4103120 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7faed4009900 tx=0x7faed402a480 comp rx=0 tx=0).stop 2024-09-15T22:23:15.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.350+0000 7faeea50f640 1 -- 172.21.15.45:0/3718335569 shutdown_connections 2024-09-15T22:23:15.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.350+0000 7faeea50f640 1 --2- 172.21.15.45:0/3718335569 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faee410c170 0x7faee410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.350+0000 7faeea50f640 1 --2- 172.21.15.45:0/3718335569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee4103660 0x7faee410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.350+0000 7faeea50f640 1 --2- 172.21.15.45:0/3718335569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee4102d40 0x7faee4103120 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.350+0000 7faeea50f640 1 -- 172.21.15.45:0/3718335569 >> 172.21.15.45:0/3718335569 conn(0x7faee40fc7a0 msgr2=0x7faee40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:15.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.351+0000 7faeea50f640 1 -- 172.21.15.45:0/3718335569 shutdown_connections 2024-09-15T22:23:15.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.351+0000 7faeea50f640 1 -- 172.21.15.45:0/3718335569 wait complete. 2024-09-15T22:23:15.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.351+0000 7faeea50f640 1 Processor -- start 2024-09-15T22:23:15.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.351+0000 7faeea50f640 1 -- start start 2024-09-15T22:23:15.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faeea50f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faee4102d40 0x7faee4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faeea50f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee4103660 0x7faee4198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faeea50f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee410c170 0x7faee419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faeea50f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7faee4112090 con 0x7faee410c170 2024-09-15T22:23:15.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faeea50f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faee4111f10 con 0x7faee4103660 2024-09-15T22:23:15.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faeea50f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faee4112210 con 0x7faee4102d40 2024-09-15T22:23:15.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faee8aac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee410c170 0x7faee419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faee8aac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee410c170 0x7faee419cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44654/0 (socket says 172.21.15.45:44654) 2024-09-15T22:23:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faee8aac640 1 -- 172.21.15.45:0/1237451679 learned_addr learned my addr 172.21.15.45:0/1237451679 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faee3fff640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faee4102d40 0x7faee4198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faee37fe640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee4103660 0x7faee4198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faee8aac640 1 -- 172.21.15.45:0/1237451679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faee4102d40 msgr2=0x7faee4198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faee8aac640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faee4102d40 0x7faee4198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faee8aac640 1 -- 172.21.15.45:0/1237451679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee4103660 msgr2=0x7faee4198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faee8aac640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee4103660 0x7faee4198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faee8aac640 1 -- 172.21.15.45:0/1237451679 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee419d4c0 con 0x7faee410c170 2024-09-15T22:23:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faee37fe640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee4103660 0x7faee4198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.352+0000 7faee8aac640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee410c170 0x7faee419cde0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7faedc00eaa0 tx=0x7faedc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:15.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.353+0000 7faee17fa640 1 -- 172.21.15.45:0/1237451679 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc00cdb0 con 0x7faee410c170 2024-09-15T22:23:15.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.353+0000 7faee17fa640 1 -- 172.21.15.45:0/1237451679 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faedc004b20 con 0x7faee410c170 2024-09-15T22:23:15.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.353+0000 7faee17fa640 1 -- 172.21.15.45:0/1237451679 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faedc011760 con 0x7faee410c170 2024-09-15T22:23:15.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.353+0000 7faeea50f640 1 -- 172.21.15.45:0/1237451679 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee419d7b0 con 0x7faee410c170 2024-09-15T22:23:15.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.353+0000 7faeea50f640 1 -- 172.21.15.45:0/1237451679 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee41a5090 con 0x7faee410c170 2024-09-15T22:23:15.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.356+0000 7faeec8e8740 1 Processor -- start 2024-09-15T22:23:15.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.356+0000 7faee17fa640 1 -- 172.21.15.45:0/1237451679 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7faedc004cd0 con 0x7faee410c170 2024-09-15T22:23:15.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.356+0000 7faeec8e8740 1 -- start start 2024-09-15T22:23:15.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.356+0000 7faeec8e8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 0x563c89553090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.356+0000 7faeec8e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c895535d0 0x563c89553a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.356+0000 7faeec8e8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c89562780 0x563c89564b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.356+0000 7faeec8e8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563c894b92f0 con 0x563c89554b40 2024-09-15T22:23:15.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.356+0000 7faeec8e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563c89460cf0 con 0x563c895535d0 2024-09-15T22:23:15.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.356+0000 7faeec8e8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563c894b52b0 con 0x563c89562780 2024-09-15T22:23:15.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.356+0000 7faee37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 0x563c89553090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.356+0000 7faee37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 0x563c89553090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44656/0 (socket says 172.21.15.45:44656) 2024-09-15T22:23:15.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.356+0000 7faee37fe640 1 -- 172.21.15.45:0/2624461214 learned_addr learned my addr 172.21.15.45:0/2624461214 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:15.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.356+0000 7faee37fe640 1 --2- 172.21.15.45:0/2624461214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c89562780 0x563c89564b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.357+0000 7faee3fff640 1 --2- 172.21.15.45:0/2624461214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c895535d0 0x563c89553a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.357+0000 7faee17fa640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7faecc0a3430 0x7faecc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.357+0000 7faee37fe640 1 -- 172.21.15.45:0/2624461214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c89562780 msgr2=0x563c89564b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.357+0000 7faee37fe640 1 --2- 172.21.15.45:0/2624461214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c89562780 0x563c89564b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.357+0000 7faee37fe640 1 -- 172.21.15.45:0/2624461214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c895535d0 msgr2=0x563c89553a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:15.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.357+0000 7faee37fe640 1 --2- 172.21.15.45:0/2624461214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c895535d0 0x563c89553a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.357+0000 7faee37fe640 1 -- 172.21.15.45:0/2624461214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c894453a0 con 0x563c89554b40 2024-09-15T22:23:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.357+0000 7faee8aac640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7faecc0a3430 0x7faecc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.357+0000 7faee17fa640 1 -- 172.21.15.45:0/1237451679 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7faedc0d0280 con 0x7faee410c170 2024-09-15T22:23:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.357+0000 7faee37fe640 1 --2- 172.21.15.45:0/2624461214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 0x563c89553090 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7faed800bfd0 tx=0x7faed800b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa48ecea8a90812 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.357+0000 7faeca7fc640 1 -- 172.21.15.45:0/2624461214 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8012710 con 0x563c89554b40 2024-09-15T22:23:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.357+0000 7faeca7fc640 1 -- 172.21.15.45:0/2624461214 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faed801a070 con 0x563c89554b40 2024-09-15T22:23:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.357+0000 7faeca7fc640 1 -- 172.21.15.45:0/2624461214 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed800ea20 con 0x563c89554b40 2024-09-15T22:23:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.358+0000 7faeec8e8740 1 -- 172.21.15.45:0/2624461214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 msgr2=0x563c89553090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.358+0000 7faeec8e8740 1 --2- 172.21.15.45:0/2624461214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 0x563c89553090 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7faed800bfd0 tx=0x7faed800b520 comp rx=0 tx=0).stop 2024-09-15T22:23:15.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.358+0000 7faee8aac640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7faecc0a3430 0x7faecc0a58f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faedc0985b0 tx=0x7faedc0bc040 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:15.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.358+0000 7faeec8e8740 1 -- 172.21.15.45:0/2624461214 shutdown_connections 2024-09-15T22:23:15.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.358+0000 7faeec8e8740 1 --2- 172.21.15.45:0/2624461214 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c89562780 0x563c89564b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.358+0000 7faeec8e8740 1 --2- 172.21.15.45:0/2624461214 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c895535d0 0x563c89553a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.358+0000 7faeec8e8740 1 --2- 172.21.15.45:0/2624461214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 0x563c89553090 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.358+0000 7faeec8e8740 1 -- 172.21.15.45:0/2624461214 >> 172.21.15.45:0/2624461214 conn(0x563c8951c310 msgr2=0x563c8954fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:15.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.358+0000 7faeec8e8740 1 -- 172.21.15.45:0/2624461214 shutdown_connections 2024-09-15T22:23:15.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.358+0000 7faeec8e8740 1 -- 172.21.15.45:0/2624461214 wait complete. 2024-09-15T22:23:15.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.358+0000 7faeec8e8740 1 -- start start 2024-09-15T22:23:15.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.358+0000 7faeec8e8740 1 Processor -- start 2024-09-15T22:23:15.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faeec8e8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 0x563c89562140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faeec8e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89554b40 0x563c8955f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faeec8e8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 0x563c8955f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faeec8e8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563c89565480 con 0x563c89562780 2024-09-15T22:23:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faeec8e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563c89474060 con 0x563c89554b40 2024-09-15T22:23:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faeec8e8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563c89565600 con 0x563c895535d0 2024-09-15T22:23:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faeec8e8740 10 client.0 _ll_register_callbacks cb 0x563c891c78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faee37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 0x563c8955f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faee37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 0x563c8955f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44662/0 (socket says 172.21.15.45:44662) 2024-09-15T22:23:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faee37fe640 1 -- 172.21.15.45:0/4087951576 learned_addr learned my addr 172.21.15.45:0/4087951576 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faee37fe640 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 0x563c89562140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faee3fff640 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89554b40 0x563c8955f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faee37fe640 1 -- 172.21.15.45:0/4087951576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 msgr2=0x563c89562140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:15.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faee37fe640 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 0x563c89562140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faee37fe640 1 -- 172.21.15.45:0/4087951576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89554b40 msgr2=0x563c8955f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faee37fe640 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89554b40 0x563c8955f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faee37fe640 1 -- 172.21.15.45:0/4087951576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c8922a3c0 con 0x563c89562780 2024-09-15T22:23:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faee3fff640 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89554b40 0x563c8955f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faee37fe640 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 0x563c8955f9e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7faed80058c0 tx=0x7faed8016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4988bd453a6256f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.359+0000 7faec37fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faec37fe640 1 -- 172.21.15.45:0/4087951576 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed800ec10 con 0x563c89562780 2024-09-15T22:23:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faec37fe640 1 -- 172.21.15.45:0/4087951576 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7faed800edb0 con 0x563c89562780 2024-09-15T22:23:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faeec8e8740 1 -- 172.21.15.45:0/4087951576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faed801a070 con 0x563c89562780 2024-09-15T22:23:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faec37fe640 1 -- 172.21.15.45:0/4087951576 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faed800e470 con 0x563c89562780 2024-09-15T22:23:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faeec8e8740 10 client.16599 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faeec8e8740 1 -- 172.21.15.45:0/4087951576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563c89570ee0 con 0x563c89562780 2024-09-15T22:23:15.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faec37fe640 1 -- 172.21.15.45:0/4087951576 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faed801a070 con 0x563c89562780 2024-09-15T22:23:15.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faec37fe640 1 -- 172.21.15.45:0/4087951576 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faed8011960 con 0x563c89562780 2024-09-15T22:23:15.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faeec8e8740 10 client.16599 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:15.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faeec8e8740 10 client.16599 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:15.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faeec8e8740 20 client.16599 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:15.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faeec8e8740 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563c89572340 0x563c89574730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faeec8e8740 4 client.16599 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:23:15.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.360+0000 7faeec8e8740 1 -- 172.21.15.45:0/4087951576 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c894c6860 con 0x563c89572340 2024-09-15T22:23:15.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.361+0000 7faee3fff640 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563c89572340 0x563c89574730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.361+0000 7faee3fff640 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563c89572340 0x563c89574730 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e954a9164502e3d5 server_cookie=601c1f1eac0f4525 in_seq=0 out_seq=0 2024-09-15T22:23:15.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.361+0000 7faec37fe640 10 client.16599 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:15.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faec37fe640 1 -- 172.21.15.45:0/4087951576 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c894c6860 con 0x563c89572340 2024-09-15T22:23:15.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faec37fe640 10 client.16599 handle_command_reply: tid=0 2024-09-15T22:23:15.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faeec8e8740 1 client.16599 shutdown 2024-09-15T22:23:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faeec8e8740 1 -- 172.21.15.45:0/4087951576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 msgr2=0x563c8955f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faeec8e8740 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 0x563c8955f9e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7faed80058c0 tx=0x7faed8016040 comp rx=0 tx=0).stop 2024-09-15T22:23:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faeec8e8740 1 -- 172.21.15.45:0/4087951576 shutdown_connections 2024-09-15T22:23:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faeec8e8740 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563c89572340 0x563c89574730 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faeec8e8740 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 0x563c8955f9e0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faeec8e8740 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89554b40 0x563c8955f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faec37fe640 0 client.16599 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faeec8e8740 1 --2- 172.21.15.45:0/4087951576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 0x563c89562140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faeec8e8740 1 -- 172.21.15.45:0/4087951576 >> 172.21.15.45:0/4087951576 conn(0x563c8951c310 msgr2=0x563c89555960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faeec8e8740 1 -- 172.21.15.45:0/4087951576 shutdown_connections 2024-09-15T22:23:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faeec8e8740 1 -- 172.21.15.45:0/4087951576 wait complete. 2024-09-15T22:23:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.362+0000 7faeec8e8740 20 client.16599 trim_cache size 0 max 16384 2024-09-15T22:23:15.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.375+0000 7faeec8e8740 1 Processor -- start 2024-09-15T22:23:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.375+0000 7faeec8e8740 1 -- start start 2024-09-15T22:23:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.375+0000 7faeec8e8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 0x563c8955e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.375+0000 7faeec8e8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 0x563c89577750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.375+0000 7faeec8e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89562780 0x563c89577c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.375+0000 7faeec8e8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7faee41ab180 con 0x563c89554b40 2024-09-15T22:23:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.375+0000 7faeec8e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faee41ada00 con 0x563c89562780 2024-09-15T22:23:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.375+0000 7faeec8e8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faee41ab7f0 con 0x563c895535d0 2024-09-15T22:23:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.375+0000 7faee3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 0x563c89577750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.375+0000 7faee3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 0x563c89577750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44674/0 (socket says 172.21.15.45:44674) 2024-09-15T22:23:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.375+0000 7faee3fff640 1 -- 172.21.15.45:0/476615990 learned_addr learned my addr 172.21.15.45:0/476615990 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faee3fff640 1 -- 172.21.15.45:0/476615990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 msgr2=0x563c8955e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faee3fff640 1 --2- 172.21.15.45:0/476615990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 0x563c8955e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faee3fff640 1 -- 172.21.15.45:0/476615990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89562780 msgr2=0x563c89577c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faee3fff640 1 --2- 172.21.15.45:0/476615990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89562780 0x563c89577c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faee3fff640 1 -- 172.21.15.45:0/476615990 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c8954e310 con 0x563c89554b40 2024-09-15T22:23:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faee3fff640 1 --2- 172.21.15.45:0/476615990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 0x563c89577750 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7faed4009230 tx=0x7faed40058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde18c3c6df8e2a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faec9ffb640 1 -- 172.21.15.45:0/476615990 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4035040 con 0x563c89554b40 2024-09-15T22:23:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faec9ffb640 1 -- 172.21.15.45:0/476615990 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faed4031a90 con 0x563c89554b40 2024-09-15T22:23:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faec9ffb640 1 -- 172.21.15.45:0/476615990 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4004920 con 0x563c89554b40 2024-09-15T22:23:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faeec8e8740 1 -- 172.21.15.45:0/476615990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 msgr2=0x563c89577750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faeec8e8740 1 --2- 172.21.15.45:0/476615990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 0x563c89577750 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7faed4009230 tx=0x7faed40058d0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faeec8e8740 1 -- 172.21.15.45:0/476615990 shutdown_connections 2024-09-15T22:23:15.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faeec8e8740 1 --2- 172.21.15.45:0/476615990 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89562780 0x563c89577c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faeec8e8740 1 --2- 172.21.15.45:0/476615990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89554b40 0x563c89577750 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faeec8e8740 1 --2- 172.21.15.45:0/476615990 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 0x563c8955e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.376+0000 7faeec8e8740 1 -- 172.21.15.45:0/476615990 >> 172.21.15.45:0/476615990 conn(0x563c8951c310 msgr2=0x563c8955dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:15.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.377+0000 7faeec8e8740 1 -- 172.21.15.45:0/476615990 shutdown_connections 2024-09-15T22:23:15.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.377+0000 7faeec8e8740 1 -- 172.21.15.45:0/476615990 wait complete. 2024-09-15T22:23:15.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.377+0000 7faeec8e8740 1 -- start start 2024-09-15T22:23:15.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.377+0000 7faeec8e8740 1 Processor -- start 2024-09-15T22:23:15.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.377+0000 7faeec8e8740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 0x563c89577f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.377+0000 7faeec8e8740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89554b40 0x563c89575270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.377+0000 7faeec8e8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 0x563c895757d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.377+0000 7faeec8e8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7faee41abec0 con 0x563c89562780 2024-09-15T22:23:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.377+0000 7faeec8e8740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7faee41ad330 con 0x563c89554b40 2024-09-15T22:23:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.377+0000 7faeec8e8740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7faee41ac590 con 0x563c895535d0 2024-09-15T22:23:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.377+0000 7faeec8e8740 10 client.0 _ll_register_callbacks cb 0x7faed800bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.377+0000 7faee37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 0x563c895757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faee37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 0x563c895757d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44690/0 (socket says 172.21.15.45:44690) 2024-09-15T22:23:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faee37fe640 1 -- 172.21.15.45:0/2525535466 learned_addr learned my addr 172.21.15.45:0/2525535466 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faee3fff640 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89554b40 0x563c89575270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faee37fe640 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 0x563c89577f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faee37fe640 1 -- 172.21.15.45:0/2525535466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 msgr2=0x563c89577f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:15.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faee37fe640 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 0x563c89577f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faee37fe640 1 -- 172.21.15.45:0/2525535466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89554b40 msgr2=0x563c89575270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faee37fe640 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89554b40 0x563c89575270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faee37fe640 1 -- 172.21.15.45:0/2525535466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c89550960 con 0x563c89562780 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faee3fff640 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89554b40 0x563c89575270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faee37fe640 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 0x563c895757d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7faed800c010 tx=0x7faed8005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c62ef4e952a483 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faec37fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faec37fe640 1 -- 172.21.15.45:0/2525535466 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed800b700 con 0x563c89562780 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faec37fe640 1 -- 172.21.15.45:0/2525535466 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7faed8022730 con 0x563c89562780 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faeec8e8740 1 -- 172.21.15.45:0/2525535466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faed4031a90 con 0x563c89562780 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faec37fe640 1 -- 172.21.15.45:0/2525535466 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faed800b480 con 0x563c89562780 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faeec8e8740 10 client.16605 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.378+0000 7faeec8e8740 1 -- 172.21.15.45:0/2525535466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563c895dcb30 con 0x563c89562780 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.379+0000 7faec37fe640 1 -- 172.21.15.45:0/2525535466 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faed4031a90 con 0x563c89562780 2024-09-15T22:23:15.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.379+0000 7faec37fe640 1 -- 172.21.15.45:0/2525535466 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7faed80047c0 con 0x563c89562780 2024-09-15T22:23:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.379+0000 7faeec8e8740 10 client.16605 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.379+0000 7faeec8e8740 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.379+0000 7faeec8e8740 20 client.16605 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.379+0000 7faeec8e8740 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563c895dd190 0x563c895df580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.379+0000 7faeec8e8740 4 client.16605 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:23:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.379+0000 7faeec8e8740 1 -- 172.21.15.45:0/2525535466 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563c894c0d70 con 0x563c895dd190 2024-09-15T22:23:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.379+0000 7faee3fff640 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563c895dd190 0x563c895df580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.379+0000 7faee3fff640 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563c895dd190 0x563c895df580 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bccefd2cff6604de server_cookie=34afb26c2317908f in_seq=0 out_seq=0 2024-09-15T22:23:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.379+0000 7faec37fe640 10 client.16605 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faec37fe640 1 -- 172.21.15.45:0/2525535466 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563c894c0d70 con 0x563c895dd190 2024-09-15T22:23:15.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faec37fe640 10 client.16605 handle_command_reply: tid=0 2024-09-15T22:23:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faeec8e8740 1 client.16605 shutdown 2024-09-15T22:23:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faeec8e8740 1 -- 172.21.15.45:0/2525535466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 msgr2=0x563c895757d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faeec8e8740 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 0x563c895757d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7faed800c010 tx=0x7faed8005be0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faeec8e8740 1 -- 172.21.15.45:0/2525535466 shutdown_connections 2024-09-15T22:23:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faeec8e8740 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563c895dd190 0x563c895df580 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faeec8e8740 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c89562780 0x563c895757d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faeec8e8740 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563c89554b40 0x563c89575270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faeec8e8740 1 --2- 172.21.15.45:0/2525535466 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x563c895535d0 0x563c89577f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faeec8e8740 1 -- 172.21.15.45:0/2525535466 >> 172.21.15.45:0/2525535466 conn(0x563c8951c310 msgr2=0x563c8955e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faec37fe640 0 client.16605 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faeec8e8740 1 -- 172.21.15.45:0/2525535466 shutdown_connections 2024-09-15T22:23:15.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faeec8e8740 1 -- 172.21.15.45:0/2525535466 wait complete. 2024-09-15T22:23:15.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.380+0000 7faeec8e8740 20 client.16605 trim_cache size 0 max 16384 2024-09-15T22:23:15.409 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:23:15.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.381+0000 7faeea50f640 1 -- 172.21.15.45:0/1237451679 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7faecc0a3430 msgr2=0x7faecc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.381+0000 7faeea50f640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7faecc0a3430 0x7faecc0a58f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faedc0985b0 tx=0x7faedc0bc040 comp rx=0 tx=0).stop 2024-09-15T22:23:15.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.381+0000 7faeea50f640 1 -- 172.21.15.45:0/1237451679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee410c170 msgr2=0x7faee419cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:15.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.381+0000 7faeea50f640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee410c170 0x7faee419cde0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7faedc00eaa0 tx=0x7faedc00ef60 comp rx=0 tx=0).stop 2024-09-15T22:23:15.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.381+0000 7faeea50f640 1 -- 172.21.15.45:0/1237451679 shutdown_connections 2024-09-15T22:23:15.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.381+0000 7faeea50f640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7faecc0a3430 0x7faecc0a58f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.381+0000 7faeea50f640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faee410c170 0x7faee419cde0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.381+0000 7faeea50f640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faee4103660 0x7faee4198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.381+0000 7faeea50f640 1 --2- 172.21.15.45:0/1237451679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7faee4102d40 0x7faee4198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:15.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.381+0000 7faeea50f640 1 -- 172.21.15.45:0/1237451679 >> 172.21.15.45:0/1237451679 conn(0x7faee40fc7a0 msgr2=0x7faee40fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:15.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.381+0000 7faeea50f640 1 -- 172.21.15.45:0/1237451679 shutdown_connections 2024-09-15T22:23:15.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:15.381+0000 7faeea50f640 1 -- 172.21.15.45:0/1237451679 wait complete. 2024-09-15T22:23:17.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:16 smithi045 ceph-mon[31180]: pgmap v216: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T22:23:17.105 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:23:17.106 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:23:17.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:16 smithi165 ceph-mon[35551]: pgmap v216: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T22:23:17.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:16 smithi100 ceph-mon[35319]: pgmap v216: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T22:23:17.378 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.902+0000 7ff92af69640 1 -- 172.21.15.45:0/781696944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff924102ef0 msgr2=0x7ff92410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.902+0000 7ff92af69640 1 --2- 172.21.15.45:0/781696944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff924102ef0 0x7ff92410da40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff91c009ca0 tx=0x7ff91c02a950 comp rx=0 tx=0).stop 2024-09-15T22:23:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.902+0000 7ff92af69640 1 -- 172.21.15.45:0/781696944 shutdown_connections 2024-09-15T22:23:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.902+0000 7ff92af69640 1 --2- 172.21.15.45:0/781696944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff924102ef0 0x7ff92410da40 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.902+0000 7ff92af69640 1 --2- 172.21.15.45:0/781696944 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff924102570 0x7ff9241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.902+0000 7ff92af69640 1 --2- 172.21.15.45:0/781696944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff924100e20 0x7ff924101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.902+0000 7ff92af69640 1 -- 172.21.15.45:0/781696944 >> 172.21.15.45:0/781696944 conn(0x7ff9240fc7d0 msgr2=0x7ff9240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.902+0000 7ff92af69640 1 -- 172.21.15.45:0/781696944 shutdown_connections 2024-09-15T22:23:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.902+0000 7ff92af69640 1 -- 172.21.15.45:0/781696944 wait complete. 2024-09-15T22:23:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff92af69640 1 Processor -- start 2024-09-15T22:23:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff92af69640 1 -- start start 2024-09-15T22:23:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff92af69640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff924100e20 0x7ff924198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff92af69640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff924102570 0x7ff924198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff92af69640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff924102ef0 0x7ff92419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff92af69640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff9241110a0 con 0x7ff924102570 2024-09-15T22:23:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff92af69640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff924110f20 con 0x7ff924100e20 2024-09-15T22:23:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff92af69640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff924111220 con 0x7ff924102ef0 2024-09-15T22:23:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff923fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff924102570 0x7ff924198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff923fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff924102570 0x7ff924198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44702/0 (socket says 172.21.15.45:44702) 2024-09-15T22:23:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff923fff640 1 -- 172.21.15.45:0/3691056677 learned_addr learned my addr 172.21.15.45:0/3691056677 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff929506640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff924102ef0 0x7ff92419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff928d05640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff924100e20 0x7ff924198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff923fff640 1 -- 172.21.15.45:0/3691056677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff924102ef0 msgr2=0x7ff92419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff923fff640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff924102ef0 0x7ff92419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff923fff640 1 -- 172.21.15.45:0/3691056677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff924100e20 msgr2=0x7ff924198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff923fff640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff924100e20 0x7ff924198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.903+0000 7ff923fff640 1 -- 172.21.15.45:0/3691056677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92419d4e0 con 0x7ff924102570 2024-09-15T22:23:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.904+0000 7ff923fff640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff924102570 0x7ff924198a70 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff91400d770 tx=0x7ff91400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.904+0000 7ff921ffb640 1 -- 172.21.15.45:0/3691056677 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914017070 con 0x7ff924102570 2024-09-15T22:23:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.904+0000 7ff921ffb640 1 -- 172.21.15.45:0/3691056677 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff914005520 con 0x7ff924102570 2024-09-15T22:23:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.904+0000 7ff92af69640 1 -- 172.21.15.45:0/3691056677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff92419d7d0 con 0x7ff924102570 2024-09-15T22:23:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.904+0000 7ff921ffb640 1 -- 172.21.15.45:0/3691056677 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914010460 con 0x7ff924102570 2024-09-15T22:23:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.904+0000 7ff92af69640 1 -- 172.21.15.45:0/3691056677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9241a50b0 con 0x7ff924102570 2024-09-15T22:23:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.906+0000 7ff921ffb640 1 -- 172.21.15.45:0/3691056677 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff914004ea0 con 0x7ff924102570 2024-09-15T22:23:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.906+0000 7ff92d342740 1 Processor -- start 2024-09-15T22:23:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff92d342740 1 -- start start 2024-09-15T22:23:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff921ffb640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff9100a33b0 0x7ff9100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff92d342740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 0x56487ac80e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff92d342740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac81380 0x56487ac8fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff92d342740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac90150 0x56487ac92540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff92d342740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56487abe6280 con 0x56487ac80a60 2024-09-15T22:23:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff92d342740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56487ab8db10 con 0x56487ac81380 2024-09-15T22:23:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff92d342740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56487abe2240 con 0x56487ac90150 2024-09-15T22:23:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff921ffb640 1 -- 172.21.15.45:0/3691056677 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7ff9140cfc10 con 0x7ff924102570 2024-09-15T22:23:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff928d05640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 0x56487ac80e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff928d05640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 0x56487ac80e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44708/0 (socket says 172.21.15.45:44708) 2024-09-15T22:23:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff928d05640 1 -- 172.21.15.45:0/992821670 learned_addr learned my addr 172.21.15.45:0/992821670 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff929506640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff9100a33b0 0x7ff9100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff928d05640 1 -- 172.21.15.45:0/992821670 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac90150 msgr2=0x56487ac92540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff928d05640 1 --2- 172.21.15.45:0/992821670 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac90150 0x56487ac92540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff928d05640 1 -- 172.21.15.45:0/992821670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac81380 msgr2=0x56487ac8fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:17.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff928d05640 1 --2- 172.21.15.45:0/992821670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac81380 0x56487ac8fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.907+0000 7ff928d05640 1 -- 172.21.15.45:0/992821670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56487ab9a1f0 con 0x56487ac80a60 2024-09-15T22:23:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.908+0000 7ff929506640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff9100a33b0 0x7ff9100a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff91c030040 tx=0x7ff91c009920 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.908+0000 7ff928d05640 1 --2- 172.21.15.45:0/992821670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 0x56487ac80e40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00bd10 tx=0x7ff90c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7934788fe2de4e32 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.908+0000 7ff91affd640 1 -- 172.21.15.45:0/992821670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c015070 con 0x56487ac80a60 2024-09-15T22:23:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.908+0000 7ff91affd640 1 -- 172.21.15.45:0/992821670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff90c01a960 con 0x56487ac80a60 2024-09-15T22:23:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.908+0000 7ff91affd640 1 -- 172.21.15.45:0/992821670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c011a80 con 0x56487ac80a60 2024-09-15T22:23:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.909+0000 7ff92d342740 1 -- 172.21.15.45:0/992821670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 msgr2=0x56487ac80e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.909+0000 7ff92d342740 1 --2- 172.21.15.45:0/992821670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 0x56487ac80e40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff90c00bd10 tx=0x7ff90c00f730 comp rx=0 tx=0).stop 2024-09-15T22:23:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.909+0000 7ff92d342740 1 -- 172.21.15.45:0/992821670 shutdown_connections 2024-09-15T22:23:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.909+0000 7ff92d342740 1 --2- 172.21.15.45:0/992821670 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac90150 0x56487ac92540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.909+0000 7ff92d342740 1 --2- 172.21.15.45:0/992821670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac81380 0x56487ac8fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.909+0000 7ff92d342740 1 --2- 172.21.15.45:0/992821670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 0x56487ac80e40 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.909+0000 7ff92d342740 1 -- 172.21.15.45:0/992821670 >> 172.21.15.45:0/992821670 conn(0x56487ac7d0f0 msgr2=0x56487ac7d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.909+0000 7ff92d342740 1 -- 172.21.15.45:0/992821670 shutdown_connections 2024-09-15T22:23:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.909+0000 7ff92d342740 1 -- 172.21.15.45:0/992821670 wait complete. 2024-09-15T22:23:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.909+0000 7ff92d342740 1 -- start start 2024-09-15T22:23:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.909+0000 7ff92d342740 1 Processor -- start 2024-09-15T22:23:17.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff92d342740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac80a60 0x56487ac8d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff92d342740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac81380 0x56487ac8d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff92d342740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac90150 0x56487ac8db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff92d342740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56487ac92d80 con 0x56487ac81380 2024-09-15T22:23:17.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff92d342740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56487aba0f10 con 0x56487ac90150 2024-09-15T22:23:17.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff92d342740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56487ac92f00 con 0x56487ac80a60 2024-09-15T22:23:17.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff92d342740 10 client.0 _ll_register_callbacks cb 0x56487ab69a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:17.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff923fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac81380 0x56487ac8d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff923fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac81380 0x56487ac8d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44724/0 (socket says 172.21.15.45:44724) 2024-09-15T22:23:17.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff923fff640 1 -- 172.21.15.45:0/1091773627 learned_addr learned my addr 172.21.15.45:0/1091773627 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:17.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff928d05640 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac80a60 0x56487ac8d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff929506640 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac90150 0x56487ac8db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff923fff640 1 -- 172.21.15.45:0/1091773627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac80a60 msgr2=0x56487ac8d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:17.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff923fff640 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac80a60 0x56487ac8d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff923fff640 1 -- 172.21.15.45:0/1091773627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac90150 msgr2=0x56487ac8db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:17.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff923fff640 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac90150 0x56487ac8db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff923fff640 1 -- 172.21.15.45:0/1091773627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56487a9576a0 con 0x56487ac81380 2024-09-15T22:23:17.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff929506640 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac90150 0x56487ac8db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:17.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff923fff640 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac81380 0x56487ac8d600 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff91409ba30 tx=0x7ff91409b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba3c32b2a38cccd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:17.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff903fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:17.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff903fff640 1 -- 172.21.15.45:0/1091773627 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff914020070 con 0x56487ac81380 2024-09-15T22:23:17.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff903fff640 1 -- 172.21.15.45:0/1091773627 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7ff9140860b0 con 0x56487ac81380 2024-09-15T22:23:17.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.910+0000 7ff92d342740 1 -- 172.21.15.45:0/1091773627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff90c01a960 con 0x56487ac81380 2024-09-15T22:23:17.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.911+0000 7ff903fff640 1 -- 172.21.15.45:0/1091773627 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff9140056d0 con 0x56487ac81380 2024-09-15T22:23:17.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.911+0000 7ff92d342740 10 client.16617 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:17.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.911+0000 7ff92d342740 1 -- 172.21.15.45:0/1091773627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56487ac9ea50 con 0x56487ac81380 2024-09-15T22:23:17.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.911+0000 7ff903fff640 1 -- 172.21.15.45:0/1091773627 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff90c01a960 con 0x56487ac81380 2024-09-15T22:23:17.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.911+0000 7ff903fff640 1 -- 172.21.15.45:0/1091773627 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff91404ff20 con 0x56487ac81380 2024-09-15T22:23:17.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.911+0000 7ff92d342740 10 client.16617 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:17.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.911+0000 7ff92d342740 10 client.16617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:17.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.911+0000 7ff92d342740 20 client.16617 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:17.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.911+0000 7ff92d342740 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56487ac9feb0 0x56487aca22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.911+0000 7ff92d342740 4 client.16617 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:23:17.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.911+0000 7ff92d342740 1 -- 172.21.15.45:0/1091773627 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56487abf37f0 con 0x56487ac9feb0 2024-09-15T22:23:17.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.911+0000 7ff928d05640 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56487ac9feb0 0x56487aca22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.912+0000 7ff903fff640 10 client.16617 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:17.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.912+0000 7ff928d05640 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56487ac9feb0 0x56487aca22a0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3acb694b95af1394 server_cookie=8889da8902af9e33 in_seq=0 out_seq=0 2024-09-15T22:23:17.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.912+0000 7ff903fff640 1 -- 172.21.15.45:0/1091773627 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56487abf37f0 con 0x56487ac9feb0 2024-09-15T22:23:17.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.912+0000 7ff903fff640 10 client.16617 handle_command_reply: tid=0 2024-09-15T22:23:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.913+0000 7ff92d342740 1 client.16617 shutdown 2024-09-15T22:23:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.913+0000 7ff92d342740 1 -- 172.21.15.45:0/1091773627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac81380 msgr2=0x56487ac8d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.913+0000 7ff92d342740 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac81380 0x56487ac8d600 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff91409ba30 tx=0x7ff91409b990 comp rx=0 tx=0).stop 2024-09-15T22:23:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.913+0000 7ff92d342740 1 -- 172.21.15.45:0/1091773627 shutdown_connections 2024-09-15T22:23:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.913+0000 7ff92d342740 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56487ac9feb0 0x56487aca22a0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.913+0000 7ff92d342740 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac90150 0x56487ac8db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.913+0000 7ff92d342740 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac81380 0x56487ac8d600 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.913+0000 7ff903fff640 0 client.16617 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.913+0000 7ff92d342740 1 --2- 172.21.15.45:0/1091773627 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac80a60 0x56487ac8d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.913+0000 7ff92d342740 1 -- 172.21.15.45:0/1091773627 >> 172.21.15.45:0/1091773627 conn(0x56487ac7d0f0 msgr2=0x56487ac82e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.913+0000 7ff92d342740 1 -- 172.21.15.45:0/1091773627 shutdown_connections 2024-09-15T22:23:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.913+0000 7ff92d342740 1 -- 172.21.15.45:0/1091773627 wait complete. 2024-09-15T22:23:17.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.913+0000 7ff92d342740 20 client.16617 trim_cache size 0 max 16384 2024-09-15T22:23:17.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.930+0000 7ff92d342740 1 Processor -- start 2024-09-15T22:23:17.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.930+0000 7ff92d342740 1 -- start start 2024-09-15T22:23:17.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.930+0000 7ff92d342740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 0x56487ac82cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.930+0000 7ff92d342740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac81380 0x56487aca7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.930+0000 7ff92d342740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac90150 0x56487aca80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.930+0000 7ff92d342740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff9241aaf40 con 0x56487ac80a60 2024-09-15T22:23:17.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.930+0000 7ff92d342740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9241ad7c0 con 0x56487ac81380 2024-09-15T22:23:17.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.930+0000 7ff92d342740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff9241ab5b0 con 0x56487ac90150 2024-09-15T22:23:17.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff928d05640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 0x56487ac82cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff928d05640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 0x56487ac82cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44736/0 (socket says 172.21.15.45:44736) 2024-09-15T22:23:17.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff928d05640 1 -- 172.21.15.45:0/3087586946 learned_addr learned my addr 172.21.15.45:0/3087586946 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:17.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff923fff640 1 --2- 172.21.15.45:0/3087586946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac81380 0x56487aca7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff929506640 1 --2- 172.21.15.45:0/3087586946 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac90150 0x56487aca80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff928d05640 1 -- 172.21.15.45:0/3087586946 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac90150 msgr2=0x56487aca80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff928d05640 1 --2- 172.21.15.45:0/3087586946 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac90150 0x56487aca80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff928d05640 1 -- 172.21.15.45:0/3087586946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac81380 msgr2=0x56487aca7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff928d05640 1 --2- 172.21.15.45:0/3087586946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac81380 0x56487aca7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff928d05640 1 -- 172.21.15.45:0/3087586946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56487ac8f990 con 0x56487ac80a60 2024-09-15T22:23:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff928d05640 1 --2- 172.21.15.45:0/3087586946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 0x56487ac82cf0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff90c011630 tx=0x7ff90c00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74510ea419ede6f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff91a7fc640 1 -- 172.21.15.45:0/3087586946 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c015040 con 0x56487ac80a60 2024-09-15T22:23:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff91a7fc640 1 -- 172.21.15.45:0/3087586946 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff90c011720 con 0x56487ac80a60 2024-09-15T22:23:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.931+0000 7ff91a7fc640 1 -- 172.21.15.45:0/3087586946 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0048e0 con 0x56487ac80a60 2024-09-15T22:23:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.932+0000 7ff92d342740 1 -- 172.21.15.45:0/3087586946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 msgr2=0x56487ac82cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.932+0000 7ff92d342740 1 --2- 172.21.15.45:0/3087586946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 0x56487ac82cf0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff90c011630 tx=0x7ff90c00b600 comp rx=0 tx=0).stop 2024-09-15T22:23:17.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.932+0000 7ff92d342740 1 -- 172.21.15.45:0/3087586946 shutdown_connections 2024-09-15T22:23:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.932+0000 7ff92d342740 1 --2- 172.21.15.45:0/3087586946 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac90150 0x56487aca80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.932+0000 7ff92d342740 1 --2- 172.21.15.45:0/3087586946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac81380 0x56487aca7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.932+0000 7ff92d342740 1 --2- 172.21.15.45:0/3087586946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac80a60 0x56487ac82cf0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.932+0000 7ff92d342740 1 -- 172.21.15.45:0/3087586946 >> 172.21.15.45:0/3087586946 conn(0x56487ac7d0f0 msgr2=0x56487ac825e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.932+0000 7ff92d342740 1 -- 172.21.15.45:0/3087586946 shutdown_connections 2024-09-15T22:23:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.932+0000 7ff92d342740 1 -- 172.21.15.45:0/3087586946 wait complete. 2024-09-15T22:23:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.932+0000 7ff92d342740 1 -- start start 2024-09-15T22:23:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.932+0000 7ff92d342740 1 Processor -- start 2024-09-15T22:23:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff92d342740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac80a60 0x56487ac94210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff92d342740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac81380 0x56487ac94750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff92d342740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac90150 0x56487ad09b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff92d342740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff9241abc80 con 0x56487ac90150 2024-09-15T22:23:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff92d342740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff9241ad0f0 con 0x56487ac80a60 2024-09-15T22:23:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff92d342740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff9241ac350 con 0x56487ac81380 2024-09-15T22:23:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff92d342740 10 client.0 _ll_register_callbacks cb 0x7ff914004840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff929506640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac90150 0x56487ad09b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff929506640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac90150 0x56487ad09b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44740/0 (socket says 172.21.15.45:44740) 2024-09-15T22:23:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff929506640 1 -- 172.21.15.45:0/3872833922 learned_addr learned my addr 172.21.15.45:0/3872833922 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff923fff640 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac81380 0x56487ac94750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff928d05640 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac80a60 0x56487ac94210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff929506640 1 -- 172.21.15.45:0/3872833922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac81380 msgr2=0x56487ac94750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff929506640 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac81380 0x56487ac94750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff929506640 1 -- 172.21.15.45:0/3872833922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac80a60 msgr2=0x56487ac94210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff929506640 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac80a60 0x56487ac94210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff929506640 1 -- 172.21.15.45:0/3872833922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56487ac94fe0 con 0x56487ac90150 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff928d05640 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac80a60 0x56487ac94210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff929506640 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac90150 0x56487ad09b40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff91c035000 tx=0x7ff91c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a657e0c30e414b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.933+0000 7ff903fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff903fff640 1 -- 172.21.15.45:0/3872833922 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c034040 con 0x56487ac90150 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff903fff640 1 -- 172.21.15.45:0/3872833922 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7ff91c040030 con 0x56487ac90150 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff92d342740 1 -- 172.21.15.45:0/3872833922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff90c011720 con 0x56487ac90150 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff903fff640 1 -- 172.21.15.45:0/3872833922 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff91c003d80 con 0x56487ac90150 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff92d342740 10 client.16623 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff92d342740 1 -- 172.21.15.45:0/3872833922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56487ad0b190 con 0x56487ac90150 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff903fff640 1 -- 172.21.15.45:0/3872833922 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff90c011720 con 0x56487ac90150 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff903fff640 1 -- 172.21.15.45:0/3872833922 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff91c030900 con 0x56487ac90150 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff92d342740 10 client.16623 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff92d342740 10 client.16623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:17.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff92d342740 20 client.16623 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff92d342740 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56487ad0b960 0x56487ad0dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff92d342740 4 client.16623 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:23:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.934+0000 7ff92d342740 1 -- 172.21.15.45:0/3872833922 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56487abedd00 con 0x56487ad0b960 2024-09-15T22:23:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.935+0000 7ff928d05640 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56487ad0b960 0x56487ad0dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.935+0000 7ff928d05640 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56487ad0b960 0x56487ad0dd80 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f767d129a41f6f4 server_cookie=6d4b7876b6772e1b in_seq=0 out_seq=0 2024-09-15T22:23:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.935+0000 7ff903fff640 10 client.16623 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.936+0000 7ff903fff640 1 -- 172.21.15.45:0/3872833922 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56487abedd00 con 0x56487ad0b960 2024-09-15T22:23:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.936+0000 7ff903fff640 10 client.16623 handle_command_reply: tid=0 2024-09-15T22:23:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.936+0000 7ff92d342740 1 client.16623 shutdown 2024-09-15T22:23:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.936+0000 7ff92d342740 1 -- 172.21.15.45:0/3872833922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac90150 msgr2=0x56487ad09b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.936+0000 7ff92d342740 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac90150 0x56487ad09b40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff91c035000 tx=0x7ff91c0095c0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff92d342740 1 -- 172.21.15.45:0/3872833922 shutdown_connections 2024-09-15T22:23:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff92d342740 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56487ad0b960 0x56487ad0dd80 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff92d342740 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56487ac90150 0x56487ad09b40 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff903fff640 0 client.16623 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff92d342740 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56487ac81380 0x56487ac94750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff92d342740 1 --2- 172.21.15.45:0/3872833922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56487ac80a60 0x56487ac94210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff92d342740 1 -- 172.21.15.45:0/3872833922 >> 172.21.15.45:0/3872833922 conn(0x56487ac7d0f0 msgr2=0x56487ac82e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff92d342740 1 -- 172.21.15.45:0/3872833922 shutdown_connections 2024-09-15T22:23:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff92d342740 1 -- 172.21.15.45:0/3872833922 wait complete. 2024-09-15T22:23:17.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff92d342740 20 client.16623 trim_cache size 0 max 16384 2024-09-15T22:23:17.949 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:23:17.949 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:23:17.949 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "7f055240-43f2-44cf-a911-925ae22d43ed", 2024-09-15T22:23:17.949 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:23:17.949 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:23:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff92af69640 1 -- 172.21.15.45:0/3691056677 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff9100a33b0 msgr2=0x7ff9100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff92af69640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff9100a33b0 0x7ff9100a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff91c030040 tx=0x7ff91c009920 comp rx=0 tx=0).stop 2024-09-15T22:23:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff92af69640 1 -- 172.21.15.45:0/3691056677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff924102570 msgr2=0x7ff924198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.937+0000 7ff92af69640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff924102570 0x7ff924198a70 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff91400d770 tx=0x7ff91400dc30 comp rx=0 tx=0).stop 2024-09-15T22:23:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.938+0000 7ff92af69640 1 -- 172.21.15.45:0/3691056677 shutdown_connections 2024-09-15T22:23:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.938+0000 7ff92af69640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff9100a33b0 0x7ff9100a5870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.938+0000 7ff92af69640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff924102ef0 0x7ff92419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.938+0000 7ff92af69640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff924102570 0x7ff924198a70 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.938+0000 7ff92af69640 1 --2- 172.21.15.45:0/3691056677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff924100e20 0x7ff924198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.938+0000 7ff92af69640 1 -- 172.21.15.45:0/3691056677 >> 172.21.15.45:0/3691056677 conn(0x7ff9240fc7d0 msgr2=0x7ff92406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.938+0000 7ff92af69640 1 -- 172.21.15.45:0/3691056677 shutdown_connections 2024-09-15T22:23:17.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:17.938+0000 7ff92af69640 1 -- 172.21.15.45:0/3691056677 wait complete. 2024-09-15T22:23:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:18 smithi045 ceph-mon[31180]: pgmap v217: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 205 B/s wr, 2 op/s 2024-09-15T22:23:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:18 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:23:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:18 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:23:18.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:18 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:23:18.801 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:18 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:23:18.860 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:23:19.123 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:19.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:18 smithi165 ceph-mon[35551]: pgmap v217: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 205 B/s wr, 2 op/s 2024-09-15T22:23:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:18 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:23:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:18 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:23:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:18 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:23:19.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:18 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:23:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:18 smithi100 ceph-mon[35319]: pgmap v217: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 205 B/s wr, 2 op/s 2024-09-15T22:23:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:18 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:23:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:18 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:23:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:18 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:23:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:18 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:23:19.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.610+0000 7f14a3a59640 1 -- 172.21.15.45:0/1059861570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f149c112b90 msgr2=0x7f149c114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:19.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.610+0000 7f14a3a59640 1 --2- 172.21.15.45:0/1059861570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f149c112b90 0x7f149c114f80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1494009900 tx=0x7f149402a480 comp rx=0 tx=0).stop 2024-09-15T22:23:19.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.610+0000 7f14a3a59640 1 -- 172.21.15.45:0/1059861570 shutdown_connections 2024-09-15T22:23:19.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.610+0000 7f14a3a59640 1 --2- 172.21.15.45:0/1059861570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f149c112b90 0x7f149c114f80 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.610+0000 7f14a3a59640 1 --2- 172.21.15.45:0/1059861570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f149c074eb0 0x7f149c112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.610+0000 7f14a3a59640 1 --2- 172.21.15.45:0/1059861570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c074590 0x7f149c074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.610+0000 7f14a3a59640 1 -- 172.21.15.45:0/1059861570 >> 172.21.15.45:0/1059861570 conn(0x7f149c0fd8c0 msgr2=0x7f149c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:19.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.610+0000 7f14a3a59640 1 -- 172.21.15.45:0/1059861570 shutdown_connections 2024-09-15T22:23:19.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.610+0000 7f14a3a59640 1 -- 172.21.15.45:0/1059861570 wait complete. 2024-09-15T22:23:19.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.611+0000 7f14a3a59640 1 Processor -- start 2024-09-15T22:23:19.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.611+0000 7f14a3a59640 1 -- start start 2024-09-15T22:23:19.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.611+0000 7f14a3a59640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c074590 0x7f149c1a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.611+0000 7f14a3a59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f149c074eb0 0x7f149c1a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.611+0000 7f14a3a59640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f149c112b90 0x7f149c19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.611+0000 7f14a3a59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f149c118770 con 0x7f149c074eb0 2024-09-15T22:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.611+0000 7f14a3a59640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1185f0 con 0x7f149c074590 2024-09-15T22:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.611+0000 7f14a3a59640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1188f0 con 0x7f149c112b90 2024-09-15T22:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.611+0000 7f14a0ff4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f149c074eb0 0x7f149c1a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f14a0ff4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f149c074eb0 0x7f149c1a4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44766/0 (socket says 172.21.15.45:44766) 2024-09-15T22:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f14a0ff4640 1 -- 172.21.15.45:0/3228761542 learned_addr learned my addr 172.21.15.45:0/3228761542 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f14a0ff4640 1 -- 172.21.15.45:0/3228761542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f149c112b90 msgr2=0x7f149c19eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f14a0ff4640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f149c112b90 0x7f149c19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f14a0ff4640 1 -- 172.21.15.45:0/3228761542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c074590 msgr2=0x7f149c1a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f14a17f5640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c074590 0x7f149c1a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f14a0ff4640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c074590 0x7f149c1a4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f14a0ff4640 1 -- 172.21.15.45:0/3228761542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149c19f210 con 0x7f149c074eb0 2024-09-15T22:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f14a17f5640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c074590 0x7f149c1a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f14a0ff4640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f149c074eb0 0x7f149c1a4e60 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f149000b4a0 tx=0x7f149000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f149a7fc640 1 -- 172.21.15.45:0/3228761542 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490014070 con 0x7f149c074eb0 2024-09-15T22:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f149a7fc640 1 -- 172.21.15.45:0/3228761542 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1490010b10 con 0x7f149c074eb0 2024-09-15T22:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f14a3a59640 1 -- 172.21.15.45:0/3228761542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f149c19f500 con 0x7f149c074eb0 2024-09-15T22:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f149a7fc640 1 -- 172.21.15.45:0/3228761542 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1490017d60 con 0x7f149c074eb0 2024-09-15T22:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.612+0000 7f14a3a59640 1 -- 172.21.15.45:0/3228761542 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f149c1ab7f0 con 0x7f149c074eb0 2024-09-15T22:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f149a7fc640 1 -- 172.21.15.45:0/3228761542 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1490017070 con 0x7f149c074eb0 2024-09-15T22:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a5e32740 1 Processor -- start 2024-09-15T22:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a5e32740 1 -- start start 2024-09-15T22:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a5e32740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 0x55c3ed393880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a5e32740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed393dc0 0x55c3ed39e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a5e32740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed39e680 0x55c3ed3a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a5e32740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c3ed2f92e0 con 0x55c3ed3934a0 2024-09-15T22:23:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a5e32740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c3ed2a0ce0 con 0x55c3ed39e680 2024-09-15T22:23:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a5e32740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c3ed2f52a0 con 0x55c3ed393dc0 2024-09-15T22:23:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a1ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 0x55c3ed393880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a1ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 0x55c3ed393880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44778/0 (socket says 172.21.15.45:44778) 2024-09-15T22:23:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a1ff6640 1 -- 172.21.15.45:0/446864894 learned_addr learned my addr 172.21.15.45:0/446864894 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a1ff6640 1 -- 172.21.15.45:0/446864894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed393dc0 msgr2=0x55c3ed39e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a17f5640 1 --2- 172.21.15.45:0/446864894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed393dc0 0x55c3ed39e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.615+0000 7f14a0ff4640 1 --2- 172.21.15.45:0/446864894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed39e680 0x55c3ed3a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.616+0000 7f14a1ff6640 1 --2- 172.21.15.45:0/446864894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed393dc0 0x55c3ed39e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.616+0000 7f14a1ff6640 1 -- 172.21.15.45:0/446864894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed39e680 msgr2=0x55c3ed3a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.616+0000 7f14a1ff6640 1 --2- 172.21.15.45:0/446864894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed39e680 0x55c3ed3a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.616+0000 7f14a1ff6640 1 -- 172.21.15.45:0/446864894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ed285440 con 0x55c3ed3934a0 2024-09-15T22:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.616+0000 7f14a17f5640 1 --2- 172.21.15.45:0/446864894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed393dc0 0x55c3ed39e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.616+0000 7f14a0ff4640 1 --2- 172.21.15.45:0/446864894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed39e680 0x55c3ed3a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.616+0000 7f14a1ff6640 1 --2- 172.21.15.45:0/446864894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 0x55c3ed393880 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f14940314b0 tx=0x7f14940314e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee630923165153c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.616+0000 7f149a7fc640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f14840a33b0 0x7f14840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.616+0000 7f14837fe640 1 -- 172.21.15.45:0/446864894 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494040070 con 0x55c3ed3934a0 2024-09-15T22:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.616+0000 7f14a17f5640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f14840a33b0 0x7f14840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.616+0000 7f14837fe640 1 -- 172.21.15.45:0/446864894 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1494004040 con 0x55c3ed3934a0 2024-09-15T22:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.616+0000 7f14837fe640 1 -- 172.21.15.45:0/446864894 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494035040 con 0x55c3ed3934a0 2024-09-15T22:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.616+0000 7f149a7fc640 1 -- 172.21.15.45:0/3228761542 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7f14900cf4e0 con 0x7f149c074eb0 2024-09-15T22:23:19.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.617+0000 7f14a5e32740 1 -- 172.21.15.45:0/446864894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 msgr2=0x55c3ed393880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.617+0000 7f14a17f5640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f14840a33b0 0x7f14840a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55c3ed390890 tx=0x7f148c0074d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.617+0000 7f14a5e32740 1 --2- 172.21.15.45:0/446864894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 0x55c3ed393880 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f14940314b0 tx=0x7f14940314e0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.617+0000 7f14a5e32740 1 -- 172.21.15.45:0/446864894 shutdown_connections 2024-09-15T22:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.617+0000 7f14a5e32740 1 --2- 172.21.15.45:0/446864894 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed39e680 0x55c3ed3a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.617+0000 7f14a5e32740 1 --2- 172.21.15.45:0/446864894 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed393dc0 0x55c3ed39e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.617+0000 7f14a5e32740 1 --2- 172.21.15.45:0/446864894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 0x55c3ed393880 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.617+0000 7f14a5e32740 1 -- 172.21.15.45:0/446864894 >> 172.21.15.45:0/446864894 conn(0x55c3ed38fa30 msgr2=0x55c3ed38fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.617+0000 7f14a5e32740 1 -- 172.21.15.45:0/446864894 shutdown_connections 2024-09-15T22:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.617+0000 7f14a5e32740 1 -- 172.21.15.45:0/446864894 wait complete. 2024-09-15T22:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.617+0000 7f14a5e32740 1 -- start start 2024-09-15T22:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.617+0000 7f14a5e32740 1 Processor -- start 2024-09-15T22:23:19.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a5e32740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed3934a0 0x55c3ed39de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a5e32740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 0x55c3ed39b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a5e32740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 0x55c3ed39b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a5e32740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c3ed3a1250 con 0x55c3ed39e680 2024-09-15T22:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a5e32740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55c3ed2b4050 con 0x55c3ed393dc0 2024-09-15T22:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a5e32740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55c3ed3a13d0 con 0x55c3ed3934a0 2024-09-15T22:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a5e32740 10 client.0 _ll_register_callbacks cb 0x55c3ed2f4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a1ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 0x55c3ed39b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a1ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 0x55c3ed39b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44784/0 (socket says 172.21.15.45:44784) 2024-09-15T22:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a1ff6640 1 -- 172.21.15.45:0/3307327970 learned_addr learned my addr 172.21.15.45:0/3307327970 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a17f5640 1 --2- 172.21.15.45:0/3307327970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed3934a0 0x55c3ed39de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a0ff4640 1 --2- 172.21.15.45:0/3307327970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 0x55c3ed39b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a1ff6640 1 -- 172.21.15.45:0/3307327970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed3934a0 msgr2=0x55c3ed39de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a1ff6640 1 --2- 172.21.15.45:0/3307327970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed3934a0 0x55c3ed39de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a1ff6640 1 -- 172.21.15.45:0/3307327970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 msgr2=0x55c3ed39b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a1ff6640 1 --2- 172.21.15.45:0/3307327970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 0x55c3ed39b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.618+0000 7f14a1ff6640 1 -- 172.21.15.45:0/3307327970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3ed06a3c0 con 0x55c3ed39e680 2024-09-15T22:23:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f14a1ff6640 1 --2- 172.21.15.45:0/3307327970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 0x55c3ed39b660 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f14940037d0 tx=0x7f1494004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5112b9cc071410 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f1480ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f1480ff9640 1 -- 172.21.15.45:0/3307327970 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494035040 con 0x55c3ed39e680 2024-09-15T22:23:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f14a5e32740 1 -- 172.21.15.45:0/3307327970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1494004040 con 0x55c3ed39e680 2024-09-15T22:23:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f1480ff9640 1 -- 172.21.15.45:0/3307327970 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7f14940039d0 con 0x55c3ed39e680 2024-09-15T22:23:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f1480ff9640 1 -- 172.21.15.45:0/3307327970 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1494057050 con 0x55c3ed39e680 2024-09-15T22:23:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f14a5e32740 10 client.16635 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:19.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f14a5e32740 1 -- 172.21.15.45:0/3307327970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c3ed3aca60 con 0x55c3ed39e680 2024-09-15T22:23:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f1480ff9640 1 -- 172.21.15.45:0/3307327970 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1494004040 con 0x55c3ed39e680 2024-09-15T22:23:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f1480ff9640 1 -- 172.21.15.45:0/3307327970 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1494045450 con 0x55c3ed39e680 2024-09-15T22:23:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f14a5e32740 10 client.16635 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f14a5e32740 10 client.16635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f14a5e32740 20 client.16635 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f14a5e32740 1 --2- 172.21.15.45:0/3307327970 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c3ed3addb0 0x55c3ed3b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f14a5e32740 4 client.16635 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:23:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.619+0000 7f14a5e32740 1 -- 172.21.15.45:0/3307327970 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3ed306850 con 0x55c3ed3addb0 2024-09-15T22:23:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.620+0000 7f14a17f5640 1 --2- 172.21.15.45:0/3307327970 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c3ed3addb0 0x55c3ed3b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.620+0000 7f1480ff9640 10 client.16635 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:19.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.620+0000 7f14a17f5640 1 --2- 172.21.15.45:0/3307327970 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c3ed3addb0 0x55c3ed3b01a0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e3f6fe9749c9fbd server_cookie=6afeda65d76f097b in_seq=0 out_seq=0 2024-09-15T22:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f1480ff9640 1 -- 172.21.15.45:0/3307327970 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3ed306850 con 0x55c3ed3addb0 2024-09-15T22:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f1480ff9640 10 client.16635 handle_command_reply: tid=0 2024-09-15T22:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f14a5e32740 1 client.16635 shutdown 2024-09-15T22:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f14a5e32740 1 -- 172.21.15.45:0/3307327970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 msgr2=0x55c3ed39b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f14a5e32740 1 --2- 172.21.15.45:0/3307327970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 0x55c3ed39b660 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f14940037d0 tx=0x7f1494004520 comp rx=0 tx=0).stop 2024-09-15T22:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f14a5e32740 1 -- 172.21.15.45:0/3307327970 shutdown_connections 2024-09-15T22:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f14a5e32740 1 --2- 172.21.15.45:0/3307327970 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c3ed3addb0 0x55c3ed3b01a0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f14a5e32740 1 --2- 172.21.15.45:0/3307327970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 0x55c3ed39b660 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f14a5e32740 1 --2- 172.21.15.45:0/3307327970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 0x55c3ed39b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f14a5e32740 1 --2- 172.21.15.45:0/3307327970 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed3934a0 0x55c3ed39de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f14a5e32740 1 -- 172.21.15.45:0/3307327970 >> 172.21.15.45:0/3307327970 conn(0x55c3ed38fa30 msgr2=0x55c3ed395710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f1480ff9640 0 client.16635 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:19.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f14a5e32740 1 -- 172.21.15.45:0/3307327970 shutdown_connections 2024-09-15T22:23:19.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f14a5e32740 1 -- 172.21.15.45:0/3307327970 wait complete. 2024-09-15T22:23:19.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.621+0000 7f14a5e32740 20 client.16635 trim_cache size 0 max 16384 2024-09-15T22:23:19.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a5e32740 1 Processor -- start 2024-09-15T22:23:19.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a5e32740 1 -- start start 2024-09-15T22:23:19.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a5e32740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 0x55c3ed398380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a5e32740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 0x55c3ed3988c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a5e32740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed39e680 0x55c3ed39fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a5e32740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1b3920 con 0x55c3ed3934a0 2024-09-15T22:23:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a5e32740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1b61a0 con 0x55c3ed393dc0 2024-09-15T22:23:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a5e32740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1b3f90 con 0x55c3ed39e680 2024-09-15T22:23:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a17f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 0x55c3ed398380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a17f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 0x55c3ed398380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44786/0 (socket says 172.21.15.45:44786) 2024-09-15T22:23:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a17f5640 1 -- 172.21.15.45:0/2286719288 learned_addr learned my addr 172.21.15.45:0/2286719288 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a0ff4640 1 --2- 172.21.15.45:0/2286719288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 0x55c3ed3988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a1ff6640 1 --2- 172.21.15.45:0/2286719288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed39e680 0x55c3ed39fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a17f5640 1 -- 172.21.15.45:0/2286719288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed39e680 msgr2=0x55c3ed39fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a17f5640 1 --2- 172.21.15.45:0/2286719288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed39e680 0x55c3ed39fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a17f5640 1 -- 172.21.15.45:0/2286719288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 msgr2=0x55c3ed3988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:19.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a17f5640 1 --2- 172.21.15.45:0/2286719288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 0x55c3ed3988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a17f5640 1 -- 172.21.15.45:0/2286719288 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3ed390ae0 con 0x55c3ed3934a0 2024-09-15T22:23:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.639+0000 7f14a0ff4640 1 --2- 172.21.15.45:0/2286719288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 0x55c3ed3988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:19.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.640+0000 7f14a17f5640 1 --2- 172.21.15.45:0/2286719288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 0x55c3ed398380 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f148c007da0 tx=0x7f148c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720b0b9b1e236907 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:19.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.640+0000 7f1482ffd640 1 -- 172.21.15.45:0/2286719288 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c02b070 con 0x55c3ed3934a0 2024-09-15T22:23:19.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.640+0000 7f1482ffd640 1 -- 172.21.15.45:0/2286719288 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f148c026aa0 con 0x55c3ed3934a0 2024-09-15T22:23:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.640+0000 7f1482ffd640 1 -- 172.21.15.45:0/2286719288 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c01dd10 con 0x55c3ed3934a0 2024-09-15T22:23:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.640+0000 7f14a5e32740 1 -- 172.21.15.45:0/2286719288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 msgr2=0x55c3ed398380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.640+0000 7f14a5e32740 1 --2- 172.21.15.45:0/2286719288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 0x55c3ed398380 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f148c007da0 tx=0x7f148c013000 comp rx=0 tx=0).stop 2024-09-15T22:23:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.640+0000 7f14a5e32740 1 -- 172.21.15.45:0/2286719288 shutdown_connections 2024-09-15T22:23:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.640+0000 7f14a5e32740 1 --2- 172.21.15.45:0/2286719288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed39e680 0x55c3ed39fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.640+0000 7f14a5e32740 1 --2- 172.21.15.45:0/2286719288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 0x55c3ed3988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.640+0000 7f14a5e32740 1 --2- 172.21.15.45:0/2286719288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed3934a0 0x55c3ed398380 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.640+0000 7f14a5e32740 1 -- 172.21.15.45:0/2286719288 >> 172.21.15.45:0/2286719288 conn(0x55c3ed38fa30 msgr2=0x55c3ed39d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.641+0000 7f14a5e32740 1 -- 172.21.15.45:0/2286719288 shutdown_connections 2024-09-15T22:23:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.641+0000 7f14a5e32740 1 -- 172.21.15.45:0/2286719288 wait complete. 2024-09-15T22:23:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.641+0000 7f14a5e32740 1 -- start start 2024-09-15T22:23:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.641+0000 7f14a5e32740 1 Processor -- start 2024-09-15T22:23:19.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.641+0000 7f14a5e32740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed3934a0 0x55c3ed3b3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.641+0000 7f14a5e32740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 0x55c3ed3ae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.641+0000 7f14a5e32740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 0x55c3ed3aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.641+0000 7f14a5e32740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1b4660 con 0x55c3ed39e680 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.641+0000 7f14a5e32740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1b5ad0 con 0x55c3ed393dc0 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.641+0000 7f14a5e32740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f149c1b4d30 con 0x55c3ed3934a0 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.641+0000 7f14a5e32740 10 client.0 _ll_register_callbacks cb 0x7f1494031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.641+0000 7f14a1ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 0x55c3ed3aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f14a1ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 0x55c3ed3aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44802/0 (socket says 172.21.15.45:44802) 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f14a1ff6640 1 -- 172.21.15.45:0/1766914668 learned_addr learned my addr 172.21.15.45:0/1766914668 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f14a17f5640 1 --2- 172.21.15.45:0/1766914668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed3934a0 0x55c3ed3b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f14a0ff4640 1 --2- 172.21.15.45:0/1766914668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 0x55c3ed3ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f14a1ff6640 1 -- 172.21.15.45:0/1766914668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed3934a0 msgr2=0x55c3ed3b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f14a1ff6640 1 --2- 172.21.15.45:0/1766914668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed3934a0 0x55c3ed3b3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f14a1ff6640 1 -- 172.21.15.45:0/1766914668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 msgr2=0x55c3ed3ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f14a1ff6640 1 --2- 172.21.15.45:0/1766914668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 0x55c3ed3ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f14a1ff6640 1 -- 172.21.15.45:0/1766914668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3ed3af190 con 0x55c3ed39e680 2024-09-15T22:23:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f14a1ff6640 1 --2- 172.21.15.45:0/1766914668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 0x55c3ed3aebd0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f14940037d0 tx=0x7f1494003720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a3c61267b519c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f1480ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f1480ff9640 1 -- 172.21.15.45:0/1766914668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494054040 con 0x55c3ed39e680 2024-09-15T22:23:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f14a5e32740 1 -- 172.21.15.45:0/1766914668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f148c026aa0 con 0x55c3ed39e680 2024-09-15T22:23:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f1480ff9640 1 -- 172.21.15.45:0/1766914668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7f1494045a10 con 0x55c3ed39e680 2024-09-15T22:23:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f1480ff9640 1 -- 172.21.15.45:0/1766914668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1494035040 con 0x55c3ed39e680 2024-09-15T22:23:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f14a5e32740 10 client.16641 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.642+0000 7f14a5e32740 1 -- 172.21.15.45:0/1766914668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c3ed418520 con 0x55c3ed39e680 2024-09-15T22:23:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.643+0000 7f1480ff9640 1 -- 172.21.15.45:0/1766914668 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f148c026aa0 con 0x55c3ed39e680 2024-09-15T22:23:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.643+0000 7f1480ff9640 1 -- 172.21.15.45:0/1766914668 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f14940038a0 con 0x55c3ed39e680 2024-09-15T22:23:19.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.643+0000 7f14a5e32740 10 client.16641 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.643+0000 7f14a5e32740 10 client.16641 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.643+0000 7f14a5e32740 20 client.16641 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.643+0000 7f14a5e32740 1 --2- 172.21.15.45:0/1766914668 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c3ed418b00 0x55c3ed41aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.643+0000 7f14a5e32740 4 client.16641 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.643+0000 7f14a5e32740 1 -- 172.21.15.45:0/1766914668 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c3ed300d60 con 0x55c3ed418b00 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.643+0000 7f14a17f5640 1 --2- 172.21.15.45:0/1766914668 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c3ed418b00 0x55c3ed41aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f1480ff9640 10 client.16641 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f14a17f5640 1 --2- 172.21.15.45:0/1766914668 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c3ed418b00 0x55c3ed41aef0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24ad0c3c2748e643 server_cookie=8e518536dabe046d in_seq=0 out_seq=0 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f1480ff9640 1 -- 172.21.15.45:0/1766914668 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c3ed300d60 con 0x55c3ed418b00 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f1480ff9640 10 client.16641 handle_command_reply: tid=0 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f14a5e32740 1 client.16641 shutdown 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f14a5e32740 1 -- 172.21.15.45:0/1766914668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 msgr2=0x55c3ed3aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f14a5e32740 1 --2- 172.21.15.45:0/1766914668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 0x55c3ed3aebd0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f14940037d0 tx=0x7f1494003720 comp rx=0 tx=0).stop 2024-09-15T22:23:19.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f14a5e32740 1 -- 172.21.15.45:0/1766914668 shutdown_connections 2024-09-15T22:23:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f14a5e32740 1 --2- 172.21.15.45:0/1766914668 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55c3ed418b00 0x55c3ed41aef0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f14a5e32740 1 --2- 172.21.15.45:0/1766914668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c3ed39e680 0x55c3ed3aebd0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f1480ff9640 0 client.16641 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f14a5e32740 1 --2- 172.21.15.45:0/1766914668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c3ed393dc0 0x55c3ed3ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f14a5e32740 1 --2- 172.21.15.45:0/1766914668 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55c3ed3934a0 0x55c3ed3b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f14a5e32740 1 -- 172.21.15.45:0/1766914668 >> 172.21.15.45:0/1766914668 conn(0x55c3ed38fa30 msgr2=0x55c3ed39c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f14a5e32740 1 -- 172.21.15.45:0/1766914668 shutdown_connections 2024-09-15T22:23:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f14a5e32740 1 -- 172.21.15.45:0/1766914668 wait complete. 2024-09-15T22:23:19.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.644+0000 7f14a5e32740 20 client.16641 trim_cache size 0 max 16384 2024-09-15T22:23:19.651 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:23:19.652 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:23:19.652 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:23:19.652 INFO:teuthology.orchestra.run.smithi045.stdout: "7f055240-43f2-44cf-a911-925ae22d43ed": { 2024-09-15T22:23:19.652 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:23:19.652 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "7f055240-43f2-44cf-a911-925ae22d43ed", 2024-09-15T22:23:19.652 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:23:19.652 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:23:19.652 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:23:19.652 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:23:19.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.645+0000 7f14a3a59640 1 -- 172.21.15.45:0/3228761542 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f14840a33b0 msgr2=0x7f14840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:19.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.645+0000 7f14a3a59640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f14840a33b0 0x7f14840a5870 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55c3ed390890 tx=0x7f148c0074d0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.645+0000 7f14a3a59640 1 -- 172.21.15.45:0/3228761542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f149c074eb0 msgr2=0x7f149c1a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:19.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.645+0000 7f14a3a59640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f149c074eb0 0x7f149c1a4e60 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f149000b4a0 tx=0x7f149000b960 comp rx=0 tx=0).stop 2024-09-15T22:23:19.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.645+0000 7f14a3a59640 1 -- 172.21.15.45:0/3228761542 shutdown_connections 2024-09-15T22:23:19.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.645+0000 7f14a3a59640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f14840a33b0 0x7f14840a5870 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.645+0000 7f14a3a59640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f149c112b90 0x7f149c19eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.645+0000 7f14a3a59640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f149c074eb0 0x7f149c1a4e60 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.645+0000 7f14a3a59640 1 --2- 172.21.15.45:0/3228761542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f149c074590 0x7f149c1a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:19.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.645+0000 7f14a3a59640 1 -- 172.21.15.45:0/3228761542 >> 172.21.15.45:0/3228761542 conn(0x7f149c0fd8c0 msgr2=0x7f149c0ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:19.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.645+0000 7f14a3a59640 1 -- 172.21.15.45:0/3228761542 shutdown_connections 2024-09-15T22:23:19.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:19.645+0000 7f14a3a59640 1 -- 172.21.15.45:0/3228761542 wait complete. 2024-09-15T22:23:20.516 INFO:tasks.cephfs.filesystem:scrub status for tag:7f055240-43f2-44cf-a911-925ae22d43ed - {'path': '/', 'tag': '7f055240-43f2-44cf-a911-925ae22d43ed', 'options': 'recursive,force'} 2024-09-15T22:23:21.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:20 smithi045 ceph-mon[31180]: pgmap v218: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:23:21.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:20 smithi165 ceph-mon[35551]: pgmap v218: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:23:21.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:20 smithi100 ceph-mon[35319]: pgmap v218: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:23:23.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:22 smithi045 ceph-mon[31180]: pgmap v219: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:23:23.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:22 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:23:23.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:22 smithi165 ceph-mon[35551]: pgmap v219: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:23:23.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:22 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:23:23.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:22 smithi100 ceph-mon[35319]: pgmap v219: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:23:23.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:22 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:23:25.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:24 smithi045 ceph-mon[31180]: pgmap v220: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:25.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:24 smithi165 ceph-mon[35551]: pgmap v220: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:25.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:24 smithi100 ceph-mon[35319]: pgmap v220: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:27.017 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:26 smithi165 ceph-mon[35551]: pgmap v221: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-15T22:23:27.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:26 smithi045 ceph-mon[31180]: pgmap v221: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-15T22:23:27.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:26 smithi100 ceph-mon[35319]: pgmap v221: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 1 op/s 2024-09-15T22:23:29.046 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:28 smithi100 ceph-mon[35319]: pgmap v222: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 B/s rd, 1 op/s 2024-09-15T22:23:29.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:28 smithi045 ceph-mon[31180]: pgmap v222: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 B/s rd, 1 op/s 2024-09-15T22:23:29.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:28 smithi165 ceph-mon[35551]: pgmap v222: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 B/s rd, 1 op/s 2024-09-15T22:23:31.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:30 smithi045 ceph-mon[31180]: pgmap v223: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:23:31.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:30 smithi165 ceph-mon[35551]: pgmap v223: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:23:31.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:30 smithi100 ceph-mon[35319]: pgmap v223: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:23:32.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:31 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:32.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:31 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:32.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:31 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:23:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:32 smithi045 ceph-mon[31180]: pgmap v224: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:32 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:32 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:32 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:23:33.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:32 smithi165 ceph-mon[35551]: pgmap v224: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:33.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:32 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:32 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:32 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:23:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:32 smithi100 ceph-mon[35319]: pgmap v224: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:32 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:23:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:32 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:23:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:32 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:23:35.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:34 smithi045 ceph-mon[31180]: pgmap v225: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:35.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:34 smithi165 ceph-mon[35551]: pgmap v225: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:35.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:34 smithi100 ceph-mon[35319]: pgmap v225: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:37.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:36 smithi045 ceph-mon[31180]: pgmap v226: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:37.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:36 smithi165 ceph-mon[35551]: pgmap v226: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:37.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:36 smithi100 ceph-mon[35319]: pgmap v226: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:39.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:38 smithi045 ceph-mon[31180]: pgmap v227: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:39.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:38 smithi165 ceph-mon[35551]: pgmap v227: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:39.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:38 smithi100 ceph-mon[35319]: pgmap v227: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:41.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:40 smithi045 ceph-mon[31180]: pgmap v228: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:41.216 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:40 smithi165 ceph-mon[35551]: pgmap v228: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:41.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:40 smithi100 ceph-mon[35319]: pgmap v228: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:43.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:42 smithi045 ceph-mon[31180]: pgmap v229: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:43.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:42 smithi165 ceph-mon[35551]: pgmap v229: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:43.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:42 smithi100 ceph-mon[35319]: pgmap v229: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:45.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:44 smithi045 ceph-mon[31180]: pgmap v230: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:45.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:44 smithi165 ceph-mon[35551]: pgmap v230: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:45.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:44 smithi100 ceph-mon[35319]: pgmap v230: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:47.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:46 smithi045 ceph-mon[31180]: pgmap v231: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:47.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:46 smithi165 ceph-mon[35551]: pgmap v231: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:47.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:46 smithi100 ceph-mon[35319]: pgmap v231: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:49.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:48 smithi045 ceph-mon[31180]: pgmap v232: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:49.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:48 smithi165 ceph-mon[35551]: pgmap v232: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:48 smithi100 ceph-mon[35319]: pgmap v232: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:50.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:23:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:51.080 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:50 smithi045 ceph-mon[31180]: pgmap v233: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:51.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:50 smithi165 ceph-mon[35551]: pgmap v233: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:51.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:50 smithi100 ceph-mon[35319]: pgmap v233: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:51.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.329+0000 7fbce8b90640 1 -- 172.21.15.45:0/2176745663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4101de0 msgr2=0x7fbce41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.329+0000 7fbce8b90640 1 --2- 172.21.15.45:0/2176745663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4101de0 0x7fbce41021c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009900 tx=0x7fbcd402a410 comp rx=0 tx=0).stop 2024-09-15T22:23:51.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.329+0000 7fbce8b90640 1 -- 172.21.15.45:0/2176745663 shutdown_connections 2024-09-15T22:23:51.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.329+0000 7fbce8b90640 1 --2- 172.21.15.45:0/2176745663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbce4106f10 0x7fbce410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.329+0000 7fbce8b90640 1 --2- 172.21.15.45:0/2176745663 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbce4102790 0x7fbce41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.329+0000 7fbce8b90640 1 --2- 172.21.15.45:0/2176745663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4101de0 0x7fbce41021c0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.329+0000 7fbce8b90640 1 -- 172.21.15.45:0/2176745663 >> 172.21.15.45:0/2176745663 conn(0x7fbce40fd8c0 msgr2=0x7fbce40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:51.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.329+0000 7fbce8b90640 1 -- 172.21.15.45:0/2176745663 shutdown_connections 2024-09-15T22:23:51.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.329+0000 7fbce8b90640 1 -- 172.21.15.45:0/2176745663 wait complete. 2024-09-15T22:23:51.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.330+0000 7fbce8b90640 1 Processor -- start 2024-09-15T22:23:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.330+0000 7fbce8b90640 1 -- start start 2024-09-15T22:23:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.330+0000 7fbce8b90640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbce4101de0 0x7fbce40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.330+0000 7fbce8b90640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4102790 0x7fbce4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.330+0000 7fbce8b90640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbce4106f10 0x7fbce4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.330+0000 7fbce8b90640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4112150 con 0x7fbce4102790 2024-09-15T22:23:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.330+0000 7fbce8b90640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbce4111fd0 con 0x7fbce4106f10 2024-09-15T22:23:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.330+0000 7fbce8b90640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41122d0 con 0x7fbce4101de0 2024-09-15T22:23:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4102790 0x7fbce4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4102790 0x7fbce4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55206/0 (socket says 172.21.15.45:55206) 2024-09-15T22:23:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce1d9b640 1 -- 172.21.15.45:0/1585957401 learned_addr learned my addr 172.21.15.45:0/1585957401 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:51.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce259c640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbce4101de0 0x7fbce40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce2d9d640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbce4106f10 0x7fbce4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce1d9b640 1 -- 172.21.15.45:0/1585957401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbce4101de0 msgr2=0x7fbce40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce1d9b640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbce4101de0 0x7fbce40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce1d9b640 1 -- 172.21.15.45:0/1585957401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbce4106f10 msgr2=0x7fbce4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce1d9b640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbce4106f10 0x7fbce4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce1d9b640 1 -- 172.21.15.45:0/1585957401 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce41a6b30 con 0x7fbce4102790 2024-09-15T22:23:51.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce259c640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbce4101de0 0x7fbce40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:51.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce1d9b640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4102790 0x7fbce4074a30 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800b4a0 tx=0x7fbcd800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:51.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbcd37fe640 1 -- 172.21.15.45:0/1585957401 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8014070 con 0x7fbce4102790 2024-09-15T22:23:51.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce8b90640 1 -- 172.21.15.45:0/1585957401 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce41a6e20 con 0x7fbce4102790 2024-09-15T22:23:51.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbcd37fe640 1 -- 172.21.15.45:0/1585957401 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbcd8010b10 con 0x7fbce4102790 2024-09-15T22:23:51.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbcd37fe640 1 -- 172.21.15.45:0/1585957401 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8017d60 con 0x7fbce4102790 2024-09-15T22:23:51.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.331+0000 7fbce8b90640 1 -- 172.21.15.45:0/1585957401 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce41a7320 con 0x7fbce4102790 2024-09-15T22:23:51.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.334+0000 7fbcd37fe640 1 -- 172.21.15.45:0/1585957401 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fbcd8017070 con 0x7fbce4102790 2024-09-15T22:23:51.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.334+0000 7fbcd37fe640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbccc0a33b0 0x7fbccc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbceaf69740 1 Processor -- start 2024-09-15T22:23:51.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbce259c640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbccc0a33b0 0x7fbccc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbcd37fe640 1 -- 172.21.15.45:0/1585957401 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7fbcd80cf480 con 0x7fbce4102790 2024-09-15T22:23:51.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbceaf69740 1 -- start start 2024-09-15T22:23:51.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbceaf69740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d534a0 0x55e350d53880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbceaf69740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d53dc0 0x55e350d5e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbceaf69740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 0x55e350d60a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbceaf69740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e350cb92e0 con 0x55e350d5e680 2024-09-15T22:23:51.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbceaf69740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e350c60ce0 con 0x55e350d534a0 2024-09-15T22:23:51.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbceaf69740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e350cb52a0 con 0x55e350d53dc0 2024-09-15T22:23:51.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbce2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 0x55e350d60a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbce2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 0x55e350d60a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55220/0 (socket says 172.21.15.45:55220) 2024-09-15T22:23:51.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbce2d9d640 1 -- 172.21.15.45:0/806806139 learned_addr learned my addr 172.21.15.45:0/806806139 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:51.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbce259c640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbccc0a33b0 0x7fbccc0a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4005ab0 tx=0x7fbcd4005a20 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:51.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.335+0000 7fbce1d9b640 1 --2- 172.21.15.45:0/806806139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d53dc0 0x55e350d5e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.336+0000 7fbce259c640 1 --2- 172.21.15.45:0/806806139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d534a0 0x55e350d53880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.336+0000 7fbce2d9d640 1 -- 172.21.15.45:0/806806139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d53dc0 msgr2=0x55e350d5e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:51.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.336+0000 7fbce2d9d640 1 --2- 172.21.15.45:0/806806139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d53dc0 0x55e350d5e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.336+0000 7fbce2d9d640 1 -- 172.21.15.45:0/806806139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d534a0 msgr2=0x55e350d53880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:51.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.336+0000 7fbce2d9d640 1 --2- 172.21.15.45:0/806806139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d534a0 0x55e350d53880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.336+0000 7fbce2d9d640 1 -- 172.21.15.45:0/806806139 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e350c45440 con 0x55e350d5e680 2024-09-15T22:23:51.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.336+0000 7fbce259c640 1 --2- 172.21.15.45:0/806806139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d534a0 0x55e350d53880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:51.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.336+0000 7fbce2d9d640 1 --2- 172.21.15.45:0/806806139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 0x55e350d60a70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009f20 tx=0x7fbcdc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1368a04227c3ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:51.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.336+0000 7fbcd0ff9640 1 -- 172.21.15.45:0/806806139 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc01a070 con 0x55e350d5e680 2024-09-15T22:23:51.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.336+0000 7fbcd0ff9640 1 -- 172.21.15.45:0/806806139 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbcdc015910 con 0x55e350d5e680 2024-09-15T22:23:51.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.336+0000 7fbcd0ff9640 1 -- 172.21.15.45:0/806806139 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00a9c0 con 0x55e350d5e680 2024-09-15T22:23:51.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.337+0000 7fbceaf69740 1 -- 172.21.15.45:0/806806139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 msgr2=0x55e350d60a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.337+0000 7fbceaf69740 1 --2- 172.21.15.45:0/806806139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 0x55e350d60a70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc009f20 tx=0x7fbcdc00c8b0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.337+0000 7fbceaf69740 1 -- 172.21.15.45:0/806806139 shutdown_connections 2024-09-15T22:23:51.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.337+0000 7fbceaf69740 1 --2- 172.21.15.45:0/806806139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 0x55e350d60a70 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.337+0000 7fbceaf69740 1 --2- 172.21.15.45:0/806806139 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d53dc0 0x55e350d5e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.337+0000 7fbceaf69740 1 --2- 172.21.15.45:0/806806139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d534a0 0x55e350d53880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.337+0000 7fbceaf69740 1 -- 172.21.15.45:0/806806139 >> 172.21.15.45:0/806806139 conn(0x55e350d4fa30 msgr2=0x55e350d4fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:51.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.337+0000 7fbceaf69740 1 -- 172.21.15.45:0/806806139 shutdown_connections 2024-09-15T22:23:51.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.337+0000 7fbceaf69740 1 -- 172.21.15.45:0/806806139 wait complete. 2024-09-15T22:23:51.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.337+0000 7fbceaf69740 1 -- start start 2024-09-15T22:23:51.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.337+0000 7fbceaf69740 1 Processor -- start 2024-09-15T22:23:51.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbceaf69740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d534a0 0x55e350d5df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbceaf69740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d53dc0 0x55e350d5b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbceaf69740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 0x55e350d5b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbceaf69740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e350d61250 con 0x55e350d5e680 2024-09-15T22:23:51.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbceaf69740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55e350c74050 con 0x55e350d534a0 2024-09-15T22:23:51.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbceaf69740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55e350d613d0 con 0x55e350d53dc0 2024-09-15T22:23:51.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbceaf69740 10 client.0 _ll_register_callbacks cb 0x55e350cb4160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:51.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbce2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 0x55e350d5b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbce2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 0x55e350d5b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55230/0 (socket says 172.21.15.45:55230) 2024-09-15T22:23:51.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbce2d9d640 1 -- 172.21.15.45:0/159759547 learned_addr learned my addr 172.21.15.45:0/159759547 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:51.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbce1d9b640 1 --2- 172.21.15.45:0/159759547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d53dc0 0x55e350d5b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbce259c640 1 --2- 172.21.15.45:0/159759547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d534a0 0x55e350d5df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbce2d9d640 1 -- 172.21.15.45:0/159759547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d53dc0 msgr2=0x55e350d5b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:51.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbce2d9d640 1 --2- 172.21.15.45:0/159759547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d53dc0 0x55e350d5b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbce2d9d640 1 -- 172.21.15.45:0/159759547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d534a0 msgr2=0x55e350d5df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:51.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbce2d9d640 1 --2- 172.21.15.45:0/159759547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d534a0 0x55e350d5df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbce2d9d640 1 -- 172.21.15.45:0/159759547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e350a2a3c0 con 0x55e350d5e680 2024-09-15T22:23:51.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbce2d9d640 1 --2- 172.21.15.45:0/159759547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 0x55e350d5b740 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc018040 tx=0x7fbcdc015640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c043f6a85ae9525 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:51.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbcc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:51.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbcc9ffb640 1 -- 172.21.15.45:0/159759547 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc01a040 con 0x55e350d5e680 2024-09-15T22:23:51.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbcc9ffb640 1 -- 172.21.15.45:0/159759547 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7fbcdc012040 con 0x55e350d5e680 2024-09-15T22:23:51.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.338+0000 7fbceaf69740 1 -- 172.21.15.45:0/159759547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcdc015910 con 0x55e350d5e680 2024-09-15T22:23:51.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.339+0000 7fbcc9ffb640 1 -- 172.21.15.45:0/159759547 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbcdc00a740 con 0x55e350d5e680 2024-09-15T22:23:51.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.339+0000 7fbceaf69740 10 client.16653 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:51.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.339+0000 7fbceaf69740 1 -- 172.21.15.45:0/159759547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e350d6cb10 con 0x55e350d5e680 2024-09-15T22:23:51.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.339+0000 7fbcc9ffb640 1 -- 172.21.15.45:0/159759547 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbcdc015910 con 0x55e350d5e680 2024-09-15T22:23:51.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.339+0000 7fbcc9ffb640 1 -- 172.21.15.45:0/159759547 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbcdc0206b0 con 0x55e350d5e680 2024-09-15T22:23:51.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.339+0000 7fbceaf69740 10 client.16653 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:51.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.339+0000 7fbceaf69740 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:51.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.339+0000 7fbceaf69740 20 client.16653 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:51.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.339+0000 7fbceaf69740 1 --2- 172.21.15.45:0/159759547 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e350d6df70 0x55e350d70360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.339+0000 7fbceaf69740 4 client.16653 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:23:51.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.339+0000 7fbceaf69740 1 -- 172.21.15.45:0/159759547 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e350cc6850 con 0x55e350d6df70 2024-09-15T22:23:51.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.339+0000 7fbce259c640 1 --2- 172.21.15.45:0/159759547 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e350d6df70 0x55e350d70360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.340+0000 7fbce259c640 1 --2- 172.21.15.45:0/159759547 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e350d6df70 0x55e350d70360 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35ed4fdd0677e77f server_cookie=f8193e3ca24891 in_seq=0 out_seq=0 2024-09-15T22:23:51.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.340+0000 7fbcc9ffb640 10 client.16653 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:51.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbcc9ffb640 1 -- 172.21.15.45:0/159759547 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e350cc6850 con 0x55e350d6df70 2024-09-15T22:23:51.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbcc9ffb640 10 client.16653 handle_command_reply: tid=0 2024-09-15T22:23:51.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbceaf69740 1 client.16653 shutdown 2024-09-15T22:23:51.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbceaf69740 1 -- 172.21.15.45:0/159759547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 msgr2=0x55e350d5b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbceaf69740 1 --2- 172.21.15.45:0/159759547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 0x55e350d5b740 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc018040 tx=0x7fbcdc015640 comp rx=0 tx=0).stop 2024-09-15T22:23:51.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbceaf69740 1 -- 172.21.15.45:0/159759547 shutdown_connections 2024-09-15T22:23:51.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbceaf69740 1 --2- 172.21.15.45:0/159759547 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e350d6df70 0x55e350d70360 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbceaf69740 1 --2- 172.21.15.45:0/159759547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d5e680 0x55e350d5b740 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbceaf69740 1 --2- 172.21.15.45:0/159759547 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d53dc0 0x55e350d5b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbceaf69740 1 --2- 172.21.15.45:0/159759547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d534a0 0x55e350d5df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbceaf69740 1 -- 172.21.15.45:0/159759547 >> 172.21.15.45:0/159759547 conn(0x55e350d4fa30 msgr2=0x55e350d55710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:51.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbcc9ffb640 0 client.16653 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:51.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbceaf69740 1 -- 172.21.15.45:0/159759547 shutdown_connections 2024-09-15T22:23:51.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbceaf69740 1 -- 172.21.15.45:0/159759547 wait complete. 2024-09-15T22:23:51.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.341+0000 7fbceaf69740 20 client.16653 trim_cache size 0 max 16384 2024-09-15T22:23:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbceaf69740 1 Processor -- start 2024-09-15T22:23:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbceaf69740 1 -- start start 2024-09-15T22:23:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbceaf69740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d534a0 0x55e350d5a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbceaf69740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 0x55e350d5d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbceaf69740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d5e680 0x55e350d72fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbceaf69740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41af640 con 0x55e350d53dc0 2024-09-15T22:23:51.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbceaf69740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41b1ec0 con 0x55e350d5e680 2024-09-15T22:23:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbceaf69740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41afcb0 con 0x55e350d534a0 2024-09-15T22:23:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbce1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 0x55e350d5d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbce1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 0x55e350d5d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55244/0 (socket says 172.21.15.45:55244) 2024-09-15T22:23:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbce1d9b640 1 -- 172.21.15.45:0/3019776576 learned_addr learned my addr 172.21.15.45:0/3019776576 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbce259c640 1 --2- 172.21.15.45:0/3019776576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d534a0 0x55e350d5a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbce2d9d640 1 --2- 172.21.15.45:0/3019776576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d5e680 0x55e350d72fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbce1d9b640 1 -- 172.21.15.45:0/3019776576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d534a0 msgr2=0x55e350d5a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbce1d9b640 1 --2- 172.21.15.45:0/3019776576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d534a0 0x55e350d5a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbce1d9b640 1 -- 172.21.15.45:0/3019776576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d5e680 msgr2=0x55e350d72fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbce1d9b640 1 --2- 172.21.15.45:0/3019776576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d5e680 0x55e350d72fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.359+0000 7fbce1d9b640 1 -- 172.21.15.45:0/3019776576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e350d59750 con 0x55e350d53dc0 2024-09-15T22:23:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.360+0000 7fbce1d9b640 1 --2- 172.21.15.45:0/3019776576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 0x55e350d5d170 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fbcd809b3b0 tx=0x7fbcd8095f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5a34ff6534dfc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:51.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.360+0000 7fbccbfff640 1 -- 172.21.15.45:0/3019776576 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd801e040 con 0x55e350d53dc0 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.360+0000 7fbccbfff640 1 -- 172.21.15.45:0/3019776576 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbcd80a4090 con 0x55e350d53dc0 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.360+0000 7fbccbfff640 1 -- 172.21.15.45:0/3019776576 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80cca00 con 0x55e350d53dc0 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.361+0000 7fbceaf69740 1 -- 172.21.15.45:0/3019776576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 msgr2=0x55e350d5d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.361+0000 7fbceaf69740 1 --2- 172.21.15.45:0/3019776576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 0x55e350d5d170 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fbcd809b3b0 tx=0x7fbcd8095f90 comp rx=0 tx=0).stop 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.361+0000 7fbceaf69740 1 -- 172.21.15.45:0/3019776576 shutdown_connections 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.361+0000 7fbceaf69740 1 --2- 172.21.15.45:0/3019776576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d5e680 0x55e350d72fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.361+0000 7fbceaf69740 1 --2- 172.21.15.45:0/3019776576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 0x55e350d5d170 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.361+0000 7fbceaf69740 1 --2- 172.21.15.45:0/3019776576 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d534a0 0x55e350d5a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.361+0000 7fbceaf69740 1 -- 172.21.15.45:0/3019776576 >> 172.21.15.45:0/3019776576 conn(0x55e350d4fa30 msgr2=0x55e350d5ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.361+0000 7fbceaf69740 1 -- 172.21.15.45:0/3019776576 shutdown_connections 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.361+0000 7fbceaf69740 1 -- 172.21.15.45:0/3019776576 wait complete. 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.361+0000 7fbceaf69740 1 -- start start 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.361+0000 7fbceaf69740 1 Processor -- start 2024-09-15T22:23:51.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbceaf69740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d534a0 0x55e350d70760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbceaf69740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 0x55e350d70ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbceaf69740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d5e680 0x55e350d72dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbceaf69740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41b0380 con 0x55e350d53dc0 2024-09-15T22:23:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbceaf69740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41b17f0 con 0x55e350d5e680 2024-09-15T22:23:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbceaf69740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbce41b0a50 con 0x55e350d534a0 2024-09-15T22:23:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbceaf69740 10 client.0 _ll_register_callbacks cb 0x7fbcdc018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbce1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 0x55e350d70ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbce1d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 0x55e350d70ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55254/0 (socket says 172.21.15.45:55254) 2024-09-15T22:23:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbce1d9b640 1 -- 172.21.15.45:0/2907340031 learned_addr learned my addr 172.21.15.45:0/2907340031 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbce2d9d640 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d5e680 0x55e350d72dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbce259c640 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d534a0 0x55e350d70760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbce1d9b640 1 -- 172.21.15.45:0/2907340031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d534a0 msgr2=0x55e350d70760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:51.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbce1d9b640 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d534a0 0x55e350d70760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbce1d9b640 1 -- 172.21.15.45:0/2907340031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d5e680 msgr2=0x55e350d72dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbce1d9b640 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d5e680 0x55e350d72dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbce1d9b640 1 -- 172.21.15.45:0/2907340031 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e350d73430 con 0x55e350d53dc0 2024-09-15T22:23:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbce259c640 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d534a0 0x55e350d70760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbce1d9b640 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 0x55e350d70ca0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8097010 tx=0x7fbcd80177c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89294530c45829c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.362+0000 7fbcc9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbcc9ffb640 1 -- 172.21.15.45:0/2907340031 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80b4060 con 0x55e350d53dc0 2024-09-15T22:23:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbcc9ffb640 1 -- 172.21.15.45:0/2907340031 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7fbcd8097a90 con 0x55e350d53dc0 2024-09-15T22:23:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbceaf69740 1 -- 172.21.15.45:0/2907340031 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcd80a4090 con 0x55e350d53dc0 2024-09-15T22:23:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbcc9ffb640 1 -- 172.21.15.45:0/2907340031 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbcd801e070 con 0x55e350d53dc0 2024-09-15T22:23:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbceaf69740 10 client.16659 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbceaf69740 1 -- 172.21.15.45:0/2907340031 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e350dd83e0 con 0x55e350d53dc0 2024-09-15T22:23:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbcc9ffb640 1 -- 172.21.15.45:0/2907340031 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbcd80a4090 con 0x55e350d53dc0 2024-09-15T22:23:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbcc9ffb640 1 -- 172.21.15.45:0/2907340031 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbcd809a870 con 0x55e350d53dc0 2024-09-15T22:23:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbceaf69740 10 client.16659 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbceaf69740 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbceaf69740 20 client.16659 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbceaf69740 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e350dd89d0 0x55e350ddadf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbceaf69740 4 client.16659 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:23:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.363+0000 7fbceaf69740 1 -- 172.21.15.45:0/2907340031 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e350d5bad0 con 0x55e350dd89d0 2024-09-15T22:23:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.364+0000 7fbce259c640 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e350dd89d0 0x55e350ddadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.364+0000 7fbce259c640 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e350dd89d0 0x55e350ddadf0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa6c3e2fa71f043b server_cookie=bfac5ae69a594d93 in_seq=0 out_seq=0 2024-09-15T22:23:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.364+0000 7fbcc9ffb640 10 client.16659 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:51.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.364+0000 7fbcc9ffb640 1 -- 172.21.15.45:0/2907340031 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e350d5bad0 con 0x55e350dd89d0 2024-09-15T22:23:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.364+0000 7fbcc9ffb640 10 client.16659 handle_command_reply: tid=0 2024-09-15T22:23:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.364+0000 7fbceaf69740 1 client.16659 shutdown 2024-09-15T22:23:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.364+0000 7fbceaf69740 1 -- 172.21.15.45:0/2907340031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 msgr2=0x55e350d70ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.364+0000 7fbceaf69740 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 0x55e350d70ca0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fbcd8097010 tx=0x7fbcd80177c0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.364+0000 7fbceaf69740 1 -- 172.21.15.45:0/2907340031 shutdown_connections 2024-09-15T22:23:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.364+0000 7fbceaf69740 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55e350dd89d0 0x55e350ddadf0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.365+0000 7fbceaf69740 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55e350d5e680 0x55e350d72dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.365+0000 7fbceaf69740 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e350d53dc0 0x55e350d70ca0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.365+0000 7fbceaf69740 1 --2- 172.21.15.45:0/2907340031 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55e350d534a0 0x55e350d70760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.365+0000 7fbcc9ffb640 0 client.16659 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.365+0000 7fbceaf69740 1 -- 172.21.15.45:0/2907340031 >> 172.21.15.45:0/2907340031 conn(0x55e350d4fa30 msgr2=0x55e350d4eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:51.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.365+0000 7fbceaf69740 1 -- 172.21.15.45:0/2907340031 shutdown_connections 2024-09-15T22:23:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.365+0000 7fbceaf69740 1 -- 172.21.15.45:0/2907340031 wait complete. 2024-09-15T22:23:51.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.365+0000 7fbceaf69740 20 client.16659 trim_cache size 0 max 16384 2024-09-15T22:23:51.377 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:23:51.377 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:23:51.377 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:23:51.377 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:23:51.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.365+0000 7fbce8b90640 1 -- 172.21.15.45:0/1585957401 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbccc0a33b0 msgr2=0x7fbccc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.365+0000 7fbce8b90640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbccc0a33b0 0x7fbccc0a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4005ab0 tx=0x7fbcd4005a20 comp rx=0 tx=0).stop 2024-09-15T22:23:51.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.365+0000 7fbce8b90640 1 -- 172.21.15.45:0/1585957401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4102790 msgr2=0x7fbce4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:51.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.365+0000 7fbce8b90640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4102790 0x7fbce4074a30 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800b4a0 tx=0x7fbcd800b960 comp rx=0 tx=0).stop 2024-09-15T22:23:51.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.366+0000 7fbce8b90640 1 -- 172.21.15.45:0/1585957401 shutdown_connections 2024-09-15T22:23:51.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.366+0000 7fbce8b90640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbccc0a33b0 0x7fbccc0a5870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.366+0000 7fbce8b90640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbce4106f10 0x7fbce4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.366+0000 7fbce8b90640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbce4102790 0x7fbce4074a30 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.366+0000 7fbce8b90640 1 --2- 172.21.15.45:0/1585957401 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbce4101de0 0x7fbce40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:51.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.366+0000 7fbce8b90640 1 -- 172.21.15.45:0/1585957401 >> 172.21.15.45:0/1585957401 conn(0x7fbce40fd8c0 msgr2=0x7fbce40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:51.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.366+0000 7fbce8b90640 1 -- 172.21.15.45:0/1585957401 shutdown_connections 2024-09-15T22:23:51.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:51.366+0000 7fbce8b90640 1 -- 172.21.15.45:0/1585957401 wait complete. 2024-09-15T22:23:52.248 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:23:52.248 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:23:52.516 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:52.939 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:52 smithi045 ceph-mon[31180]: pgmap v234: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.020+0000 7f722d47a640 1 -- 172.21.15.45:0/1480530750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7228106f10 msgr2=0x7f722810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.020+0000 7f722d47a640 1 --2- 172.21.15.45:0/1480530750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7228106f10 0x7f722810ea90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7220009ca0 tx=0x7f722002a8c0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.020+0000 7f722d47a640 1 -- 172.21.15.45:0/1480530750 shutdown_connections 2024-09-15T22:23:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.020+0000 7f722d47a640 1 --2- 172.21.15.45:0/1480530750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7228106f10 0x7f722810ea90 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.020+0000 7f722d47a640 1 --2- 172.21.15.45:0/1480530750 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7228102790 0x7f72281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.020+0000 7f722d47a640 1 --2- 172.21.15.45:0/1480530750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7228101de0 0x7f72281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.020+0000 7f722d47a640 1 -- 172.21.15.45:0/1480530750 >> 172.21.15.45:0/1480530750 conn(0x7f72280fd8c0 msgr2=0x7f72280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.020+0000 7f722d47a640 1 -- 172.21.15.45:0/1480530750 shutdown_connections 2024-09-15T22:23:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.020+0000 7f722d47a640 1 -- 172.21.15.45:0/1480530750 wait complete. 2024-09-15T22:23:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.021+0000 7f722d47a640 1 Processor -- start 2024-09-15T22:23:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.021+0000 7f722d47a640 1 -- start start 2024-09-15T22:23:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.021+0000 7f722d47a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7228101de0 0x7f72281984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.021+0000 7f722d47a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7228102790 0x7f72281989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.021+0000 7f722d47a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7228106f10 0x7f722819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.021+0000 7f722d47a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7228112090 con 0x7f7228102790 2024-09-15T22:23:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.021+0000 7f722d47a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7228111f10 con 0x7f7228106f10 2024-09-15T22:23:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.021+0000 7f722d47a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7228112210 con 0x7f7228101de0 2024-09-15T22:23:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.021+0000 7f721e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7228102790 0x7f72281989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.021+0000 7f721e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7228102790 0x7f72281989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55284/0 (socket says 172.21.15.45:55284) 2024-09-15T22:23:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.021+0000 7f721e7fc640 1 -- 172.21.15.45:0/1755247852 learned_addr learned my addr 172.21.15.45:0/1755247852 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.021+0000 7f72277fe640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7228106f10 0x7f722819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.021+0000 7f7226ffd640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7228101de0 0x7f72281984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.022+0000 7f721e7fc640 1 -- 172.21.15.45:0/1755247852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7228101de0 msgr2=0x7f72281984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.022+0000 7f721e7fc640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7228101de0 0x7f72281984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.022+0000 7f721e7fc640 1 -- 172.21.15.45:0/1755247852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7228106f10 msgr2=0x7f722819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.022+0000 7f721e7fc640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7228106f10 0x7f722819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.022+0000 7f721e7fc640 1 -- 172.21.15.45:0/1755247852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722819d450 con 0x7f7228102790 2024-09-15T22:23:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.022+0000 7f7226ffd640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7228101de0 0x7f72281984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.022+0000 7f721e7fc640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7228102790 0x7f72281989e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f721000d770 tx=0x7f721000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.022+0000 7f7224ff9640 1 -- 172.21.15.45:0/1755247852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7210017070 con 0x7f7228102790 2024-09-15T22:23:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.022+0000 7f7224ff9640 1 -- 172.21.15.45:0/1755247852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7210005520 con 0x7f7228102790 2024-09-15T22:23:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.022+0000 7f722d47a640 1 -- 172.21.15.45:0/1755247852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f722819d740 con 0x7f7228102790 2024-09-15T22:23:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.022+0000 7f7224ff9640 1 -- 172.21.15.45:0/1755247852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7210010460 con 0x7f7228102790 2024-09-15T22:23:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.022+0000 7f722d47a640 1 -- 172.21.15.45:0/1755247852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72281a5020 con 0x7f7228102790 2024-09-15T22:23:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.023+0000 7f722d47a640 1 -- 172.21.15.45:0/1755247852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72281021c0 con 0x7f7228102790 2024-09-15T22:23:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.024+0000 7f7224ff9640 1 -- 172.21.15.45:0/1755247852 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7210004ea0 con 0x7f7228102790 2024-09-15T22:23:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.025+0000 7f7224ff9640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f72140a3430 0x7f72140a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.025+0000 7f7226ffd640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f72140a3430 0x7f72140a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.025+0000 7f7224ff9640 1 -- 172.21.15.45:0/1755247852 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7f72100cfb90 con 0x7f7228102790 2024-09-15T22:23:53.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.026+0000 7f7226ffd640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f72140a3430 0x7f72140a58f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f72180058c0 tx=0x7f7218005850 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:53.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.029+0000 7f7224ff9640 1 -- 172.21.15.45:0/1755247852 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f721009c120 con 0x7f7228102790 2024-09-15T22:23:53.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:52 smithi165 ceph-mon[35551]: pgmap v234: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:53.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.239+0000 7f722d47a640 1 -- 172.21.15.45:0/1755247852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f722802d7c0 con 0x7f7228102790 2024-09-15T22:23:53.242 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.240+0000 7f7224ff9640 1 -- 172.21.15.45:0/1755247852 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f721009ba20 con 0x7f7228102790 2024-09-15T22:23:53.242 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:23:53.243 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:23:53.243 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:23:53.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:52 smithi100 ceph-mon[35319]: pgmap v234: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.242+0000 7f722d47a640 1 -- 172.21.15.45:0/1755247852 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f72140a3430 msgr2=0x7f72140a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.242+0000 7f722d47a640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f72140a3430 0x7f72140a58f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f72180058c0 tx=0x7f7218005850 comp rx=0 tx=0).stop 2024-09-15T22:23:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.242+0000 7f722d47a640 1 -- 172.21.15.45:0/1755247852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7228102790 msgr2=0x7f72281989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.242+0000 7f722d47a640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7228102790 0x7f72281989e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f721000d770 tx=0x7f721000dc30 comp rx=0 tx=0).stop 2024-09-15T22:23:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.242+0000 7f722d47a640 1 -- 172.21.15.45:0/1755247852 shutdown_connections 2024-09-15T22:23:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.242+0000 7f722d47a640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f72140a3430 0x7f72140a58f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.242+0000 7f722d47a640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7228106f10 0x7f722819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.242+0000 7f722d47a640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7228102790 0x7f72281989e0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.242+0000 7f722d47a640 1 --2- 172.21.15.45:0/1755247852 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7228101de0 0x7f72281984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.242+0000 7f722d47a640 1 -- 172.21.15.45:0/1755247852 >> 172.21.15.45:0/1755247852 conn(0x7f72280fd8c0 msgr2=0x7f72280febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:53.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.242+0000 7f722d47a640 1 -- 172.21.15.45:0/1755247852 shutdown_connections 2024-09-15T22:23:53.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:53.242+0000 7f722d47a640 1 -- 172.21.15.45:0/1755247852 wait complete. 2024-09-15T22:23:53.944 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:53 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1755247852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:23:53.975 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:23:54.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:53 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1755247852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:23:54.235 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:54.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:53 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1755247852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:23:54.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.729+0000 7fd3e891b640 1 -- 172.21.15.45:0/3432381140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3e4100a70 msgr2=0x7fd3e4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.729+0000 7fd3e891b640 1 --2- 172.21.15.45:0/3432381140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3e4100a70 0x7fd3e4100ed0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009930 tx=0x7fd3cc02a420 comp rx=0 tx=0).stop 2024-09-15T22:23:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.729+0000 7fd3e891b640 1 -- 172.21.15.45:0/3432381140 shutdown_connections 2024-09-15T22:23:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.729+0000 7fd3e891b640 1 --2- 172.21.15.45:0/3432381140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3e4101410 0x7fd3e410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.729+0000 7fd3e891b640 1 --2- 172.21.15.45:0/3432381140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3e4100a70 0x7fd3e4100ed0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.729+0000 7fd3e891b640 1 --2- 172.21.15.45:0/3432381140 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3e4106a70 0x7fd3e4106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.729+0000 7fd3e891b640 1 -- 172.21.15.45:0/3432381140 >> 172.21.15.45:0/3432381140 conn(0x7fd3e40fc790 msgr2=0x7fd3e40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.729+0000 7fd3e891b640 1 -- 172.21.15.45:0/3432381140 shutdown_connections 2024-09-15T22:23:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.729+0000 7fd3e891b640 1 -- 172.21.15.45:0/3432381140 wait complete. 2024-09-15T22:23:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.730+0000 7fd3e891b640 1 Processor -- start 2024-09-15T22:23:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.730+0000 7fd3e891b640 1 -- start start 2024-09-15T22:23:54.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.730+0000 7fd3e891b640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3e4100a70 0x7fd3e41993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.730+0000 7fd3e891b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3e4101410 0x7fd3e41998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.730+0000 7fd3e891b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3e4106a70 0x7fd3e41a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.730+0000 7fd3e891b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e4110fe0 con 0x7fd3e4106a70 2024-09-15T22:23:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.730+0000 7fd3e891b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e4110e60 con 0x7fd3e4101410 2024-09-15T22:23:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.730+0000 7fd3e891b640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e4111160 con 0x7fd3e4100a70 2024-09-15T22:23:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.730+0000 7fd3e2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3e4106a70 0x7fd3e41a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.730+0000 7fd3e2d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3e4106a70 0x7fd3e41a4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54318/0 (socket says 172.21.15.45:54318) 2024-09-15T22:23:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.730+0000 7fd3e2d9d640 1 -- 172.21.15.45:0/2354007791 learned_addr learned my addr 172.21.15.45:0/2354007791 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.730+0000 7fd3e259c640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3e4100a70 0x7fd3e41993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.730+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3e4101410 0x7fd3e41998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.731+0000 7fd3e2d9d640 1 -- 172.21.15.45:0/2354007791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3e4100a70 msgr2=0x7fd3e41993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.731+0000 7fd3e2d9d640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3e4100a70 0x7fd3e41993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.731+0000 7fd3e2d9d640 1 -- 172.21.15.45:0/2354007791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3e4101410 msgr2=0x7fd3e41998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.731+0000 7fd3e2d9d640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3e4101410 0x7fd3e41998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.731+0000 7fd3e2d9d640 1 -- 172.21.15.45:0/2354007791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e41a4970 con 0x7fd3e4106a70 2024-09-15T22:23:54.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.731+0000 7fd3e2d9d640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3e4106a70 0x7fd3e41a4430 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00cad0 tx=0x7fd3dc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:54.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.731+0000 7fd3dbfff640 1 -- 172.21.15.45:0/2354007791 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc00ae20 con 0x7fd3e4106a70 2024-09-15T22:23:54.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.731+0000 7fd3e891b640 1 -- 172.21.15.45:0/2354007791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e41a4b40 con 0x7fd3e4106a70 2024-09-15T22:23:54.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.731+0000 7fd3dbfff640 1 -- 172.21.15.45:0/2354007791 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3dc004b20 con 0x7fd3e4106a70 2024-09-15T22:23:54.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.731+0000 7fd3dbfff640 1 -- 172.21.15.45:0/2354007791 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc00f780 con 0x7fd3e4106a70 2024-09-15T22:23:54.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.731+0000 7fd3e891b640 1 -- 172.21.15.45:0/2354007791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e41a5000 con 0x7fd3e4106a70 2024-09-15T22:23:54.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.733+0000 7fd3dbfff640 1 -- 172.21.15.45:0/2354007791 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd3dc004cd0 con 0x7fd3e4106a70 2024-09-15T22:23:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3eacf4740 1 Processor -- start 2024-09-15T22:23:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3eacf4740 1 -- start start 2024-09-15T22:23:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3eacf4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 0x56277f1af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3eacf4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 0x56277f1afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3eacf4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1ba780 0x56277f1bcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3eacf4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56277f1112f0 con 0x56277f1af9e0 2024-09-15T22:23:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3eacf4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56277f0b8cf0 con 0x56277f1b0f50 2024-09-15T22:23:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3eacf4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56277f10d2b0 con 0x56277f1ba780 2024-09-15T22:23:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3e259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 0x56277f1afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3e259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 0x56277f1afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54330/0 (socket says 172.21.15.45:54330) 2024-09-15T22:23:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3e259c640 1 -- 172.21.15.45:0/3794836495 learned_addr learned my addr 172.21.15.45:0/3794836495 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3dbfff640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd3d00a33b0 0x7fd3d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/3794836495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 0x56277f1af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.734+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/3794836495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1ba780 0x56277f1bcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.735+0000 7fd3e259c640 1 -- 172.21.15.45:0/3794836495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1ba780 msgr2=0x56277f1bcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:54.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.735+0000 7fd3e259c640 1 --2- 172.21.15.45:0/3794836495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1ba780 0x56277f1bcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.735+0000 7fd3e259c640 1 -- 172.21.15.45:0/3794836495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 msgr2=0x56277f1af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:54.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.735+0000 7fd3e259c640 1 --2- 172.21.15.45:0/3794836495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 0x56277f1af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.735+0000 7fd3e259c640 1 -- 172.21.15.45:0/3794836495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56277f09d3a0 con 0x56277f1af9e0 2024-09-15T22:23:54.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.735+0000 7fd3dbfff640 1 -- 172.21.15.45:0/2354007791 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7fd3dc0d01d0 con 0x7fd3e4106a70 2024-09-15T22:23:54.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.735+0000 7fd3e2d9d640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd3d00a33b0 0x7fd3d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.735+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/3794836495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1ba780 0x56277f1bcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:54.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.735+0000 7fd3e259c640 1 --2- 172.21.15.45:0/3794836495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 0x56277f1afe20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd3d400aba0 tx=0x7fd3d400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98ba738d8f3f11d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:54.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.735+0000 7fd3d8d99640 1 -- 172.21.15.45:0/3794836495 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d401d070 con 0x56277f1af9e0 2024-09-15T22:23:54.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.735+0000 7fd3d8d99640 1 -- 172.21.15.45:0/3794836495 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3d4018b40 con 0x56277f1af9e0 2024-09-15T22:23:54.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.735+0000 7fd3d8d99640 1 -- 172.21.15.45:0/3794836495 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4010c50 con 0x56277f1af9e0 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3794836495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 msgr2=0x56277f1afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3794836495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 0x56277f1afe20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fd3d400aba0 tx=0x7fd3d400f790 comp rx=0 tx=0).stop 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3e2d9d640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd3d00a33b0 0x7fd3d00a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0a47e0 tx=0x7fd3dc0058f0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3794836495 shutdown_connections 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3794836495 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1ba780 0x56277f1bcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3794836495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 0x56277f1afe20 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3794836495 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 0x56277f1af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3794836495 >> 172.21.15.45:0/3794836495 conn(0x56277f174310 msgr2=0x56277f1ac070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3794836495 shutdown_connections 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3794836495 wait complete. 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3eacf4740 1 -- start start 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3eacf4740 1 Processor -- start 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3eacf4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1af9e0 0x56277f1ba0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.736+0000 7fd3eacf4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1b0f50 0x56277f1b7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3eacf4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 0x56277f1b7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3eacf4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56277f1bd480 con 0x56277f1ba780 2024-09-15T22:23:54.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3eacf4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56277f0cc060 con 0x56277f1af9e0 2024-09-15T22:23:54.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3eacf4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56277f1bd600 con 0x56277f1b0f50 2024-09-15T22:23:54.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3eacf4740 10 client.0 _ll_register_callbacks cb 0x56277ee1f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:54.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3d9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 0x56277f1b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3d9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 0x56277f1b7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54338/0 (socket says 172.21.15.45:54338) 2024-09-15T22:23:54.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3d9d9b640 1 -- 172.21.15.45:0/306356709 learned_addr learned my addr 172.21.15.45:0/306356709 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:54.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1af9e0 0x56277f1ba0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3e259c640 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1b0f50 0x56277f1b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3d9d9b640 1 -- 172.21.15.45:0/306356709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1b0f50 msgr2=0x56277f1b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:54.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1b0f50 0x56277f1b7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3d9d9b640 1 -- 172.21.15.45:0/306356709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1af9e0 msgr2=0x56277f1ba0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:54.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1af9e0 0x56277f1ba0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3d9d9b640 1 -- 172.21.15.45:0/306356709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56277ee823c0 con 0x56277f1ba780 2024-09-15T22:23:54.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3e259c640 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1b0f50 0x56277f1b7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:54.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 0x56277f1b7990 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009930 tx=0x7fd3cc03f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7bff4e397fc7bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:54.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:54.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3c9ffb640 1 -- 172.21.15.45:0/306356709 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc035040 con 0x56277f1ba780 2024-09-15T22:23:54.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3eacf4740 1 -- 172.21.15.45:0/306356709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3d4018b40 con 0x56277f1ba780 2024-09-15T22:23:54.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.737+0000 7fd3c9ffb640 1 -- 172.21.15.45:0/306356709 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7fd3cc005020 con 0x56277f1ba780 2024-09-15T22:23:54.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.738+0000 7fd3c9ffb640 1 -- 172.21.15.45:0/306356709 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd3cc005220 con 0x56277f1ba780 2024-09-15T22:23:54.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.738+0000 7fd3eacf4740 10 client.16677 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:54.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.738+0000 7fd3eacf4740 1 -- 172.21.15.45:0/306356709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56277f1c8ee0 con 0x56277f1ba780 2024-09-15T22:23:54.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.738+0000 7fd3c9ffb640 1 -- 172.21.15.45:0/306356709 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3d4018b40 con 0x56277f1ba780 2024-09-15T22:23:54.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.738+0000 7fd3c9ffb640 1 -- 172.21.15.45:0/306356709 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd3cc03a040 con 0x56277f1ba780 2024-09-15T22:23:54.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.738+0000 7fd3eacf4740 10 client.16677 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:54.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.738+0000 7fd3eacf4740 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:54.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.738+0000 7fd3eacf4740 20 client.16677 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:54.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.738+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56277f1ca2f0 0x56277f1cc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.738+0000 7fd3eacf4740 4 client.16677 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:23:54.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.738+0000 7fd3eacf4740 1 -- 172.21.15.45:0/306356709 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56277f11e860 con 0x56277f1ca2f0 2024-09-15T22:23:54.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.738+0000 7fd3e259c640 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56277f1ca2f0 0x56277f1cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.739+0000 7fd3e259c640 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56277f1ca2f0 0x56277f1cc720 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc3cefa698439025 server_cookie=350044a1753334d9 in_seq=0 out_seq=0 2024-09-15T22:23:54.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.739+0000 7fd3c9ffb640 10 client.16677 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:54.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.739+0000 7fd3c9ffb640 1 -- 172.21.15.45:0/306356709 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56277f11e860 con 0x56277f1ca2f0 2024-09-15T22:23:54.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.739+0000 7fd3c9ffb640 10 client.16677 handle_command_reply: tid=0 2024-09-15T22:23:54.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.740+0000 7fd3eacf4740 1 client.16677 shutdown 2024-09-15T22:23:54.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.740+0000 7fd3eacf4740 1 -- 172.21.15.45:0/306356709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 msgr2=0x56277f1b7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.740+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 0x56277f1b7990 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009930 tx=0x7fd3cc03f040 comp rx=0 tx=0).stop 2024-09-15T22:23:54.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.740+0000 7fd3eacf4740 1 -- 172.21.15.45:0/306356709 shutdown_connections 2024-09-15T22:23:54.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.740+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56277f1ca2f0 0x56277f1cc720 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.740+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 0x56277f1b7990 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.740+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1b0f50 0x56277f1b7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.740+0000 7fd3c9ffb640 0 client.16677 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:54.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.740+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/306356709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1af9e0 0x56277f1ba0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.740+0000 7fd3eacf4740 1 -- 172.21.15.45:0/306356709 >> 172.21.15.45:0/306356709 conn(0x56277f174310 msgr2=0x56277f1b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:54.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.740+0000 7fd3eacf4740 1 -- 172.21.15.45:0/306356709 shutdown_connections 2024-09-15T22:23:54.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.740+0000 7fd3eacf4740 1 -- 172.21.15.45:0/306356709 wait complete. 2024-09-15T22:23:54.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.740+0000 7fd3eacf4740 20 client.16677 trim_cache size 0 max 16384 2024-09-15T22:23:54.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3eacf4740 1 Processor -- start 2024-09-15T22:23:54.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3eacf4740 1 -- start start 2024-09-15T22:23:54.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3eacf4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 0x56277f1ac220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3eacf4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 0x56277f1c6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3eacf4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1ba780 0x56277f1d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3eacf4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e41ab0b0 con 0x56277f1af9e0 2024-09-15T22:23:54.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3eacf4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e41ad930 con 0x56277f1b0f50 2024-09-15T22:23:54.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3eacf4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e41ab720 con 0x56277f1ba780 2024-09-15T22:23:54.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3d9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 0x56277f1ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3d9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 0x56277f1ac220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54344/0 (socket says 172.21.15.45:54344) 2024-09-15T22:23:54.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3d9d9b640 1 -- 172.21.15.45:0/3415872860 learned_addr learned my addr 172.21.15.45:0/3415872860 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:54.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3e259c640 1 --2- 172.21.15.45:0/3415872860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 0x56277f1c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3d9d9b640 1 -- 172.21.15.45:0/3415872860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1ba780 msgr2=0x56277f1d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:54.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/3415872860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1ba780 0x56277f1d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3d9d9b640 1 -- 172.21.15.45:0/3415872860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 msgr2=0x56277f1c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:54.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/3415872860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 0x56277f1c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3d9d9b640 1 -- 172.21.15.45:0/3415872860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56277f1a6310 con 0x56277f1af9e0 2024-09-15T22:23:54.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.753+0000 7fd3e259c640 1 --2- 172.21.15.45:0/3415872860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 0x56277f1c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:54.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.754+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/3415872860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 0x56277f1ac220 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc005d00 tx=0x7fd3cc031b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7fefd0aab79ce server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:54.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.754+0000 7fd3cbfff640 1 -- 172.21.15.45:0/3415872860 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc035070 con 0x56277f1af9e0 2024-09-15T22:23:54.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.754+0000 7fd3cbfff640 1 -- 172.21.15.45:0/3415872860 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3cc03db80 con 0x56277f1af9e0 2024-09-15T22:23:54.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.754+0000 7fd3cbfff640 1 -- 172.21.15.45:0/3415872860 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc0035f0 con 0x56277f1af9e0 2024-09-15T22:23:54.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.754+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3415872860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 msgr2=0x56277f1ac220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.754+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3415872860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 0x56277f1ac220 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc005d00 tx=0x7fd3cc031b00 comp rx=0 tx=0).stop 2024-09-15T22:23:54.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.754+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3415872860 shutdown_connections 2024-09-15T22:23:54.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.754+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3415872860 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1ba780 0x56277f1d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.754+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3415872860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 0x56277f1c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.754+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3415872860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1af9e0 0x56277f1ac220 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.754+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3415872860 >> 172.21.15.45:0/3415872860 conn(0x56277f174310 msgr2=0x56277f1abb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3415872860 shutdown_connections 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3415872860 wait complete. 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3eacf4740 1 -- start start 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3eacf4740 1 Processor -- start 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3eacf4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1af9e0 0x56277f1c2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3eacf4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 0x56277f1b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3eacf4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 0x56277f1b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3eacf4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e41abdf0 con 0x56277f1ba780 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3eacf4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e41ad260 con 0x56277f1b0f50 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3eacf4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e41ac4c0 con 0x56277f1af9e0 2024-09-15T22:23:54.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3eacf4740 10 client.0 _ll_register_callbacks cb 0x7fd3cc031c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:54.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3d9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 0x56277f1b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3d9d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 0x56277f1b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54354/0 (socket says 172.21.15.45:54354) 2024-09-15T22:23:54.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.755+0000 7fd3d9d9b640 1 -- 172.21.15.45:0/3630865845 learned_addr learned my addr 172.21.15.45:0/3630865845 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:54.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3e259c640 1 --2- 172.21.15.45:0/3630865845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 0x56277f1b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/3630865845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1af9e0 0x56277f1c2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3d9d9b640 1 -- 172.21.15.45:0/3630865845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1af9e0 msgr2=0x56277f1c2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:54.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/3630865845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1af9e0 0x56277f1c2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3d9d9b640 1 -- 172.21.15.45:0/3630865845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 msgr2=0x56277f1b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:54.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/3630865845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 0x56277f1b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3d9d9b640 1 -- 172.21.15.45:0/3630865845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56277f1b4b30 con 0x56277f1ba780 2024-09-15T22:23:54.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3d9d9b640 1 --2- 172.21.15.45:0/3630865845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 0x56277f1b44f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0059d0 tx=0x7fd3cc004160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23e006aa02551e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:54.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:54.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3c9ffb640 1 -- 172.21.15.45:0/3630865845 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc035040 con 0x56277f1ba780 2024-09-15T22:23:54.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3c9ffb640 1 -- 172.21.15.45:0/3630865845 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7fd3cc03d030 con 0x56277f1ba780 2024-09-15T22:23:54.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3630865845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3cc03db80 con 0x56277f1ba780 2024-09-15T22:23:54.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3c9ffb640 1 -- 172.21.15.45:0/3630865845 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd3cc065050 con 0x56277f1ba780 2024-09-15T22:23:54.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3eacf4740 10 client.16683 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:54.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.756+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3630865845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56277f234d80 con 0x56277f1ba780 2024-09-15T22:23:54.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.757+0000 7fd3c9ffb640 1 -- 172.21.15.45:0/3630865845 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd3cc03db80 con 0x56277f1ba780 2024-09-15T22:23:54.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.757+0000 7fd3c9ffb640 1 -- 172.21.15.45:0/3630865845 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd3cc0047a0 con 0x56277f1ba780 2024-09-15T22:23:54.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.757+0000 7fd3eacf4740 10 client.16683 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:54.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.757+0000 7fd3eacf4740 10 client.16683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:54.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.757+0000 7fd3eacf4740 20 client.16683 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:54.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.757+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3630865845 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56277f235380 0x56277f2377a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:54.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.757+0000 7fd3eacf4740 4 client.16683 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:23:54.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.757+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3630865845 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56277f118d70 con 0x56277f235380 2024-09-15T22:23:54.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.757+0000 7fd3e259c640 1 --2- 172.21.15.45:0/3630865845 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56277f235380 0x56277f2377a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:54.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3c9ffb640 10 client.16683 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:54.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3e259c640 1 --2- 172.21.15.45:0/3630865845 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56277f235380 0x56277f2377a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6f9fa2a2f48869b server_cookie=38d1d2cbcb879a8 in_seq=0 out_seq=0 2024-09-15T22:23:54.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3c9ffb640 1 -- 172.21.15.45:0/3630865845 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56277f118d70 con 0x56277f235380 2024-09-15T22:23:54.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3c9ffb640 10 client.16683 handle_command_reply: tid=0 2024-09-15T22:23:54.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3eacf4740 1 client.16683 shutdown 2024-09-15T22:23:54.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3630865845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 msgr2=0x56277f1b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3630865845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 0x56277f1b44f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc0059d0 tx=0x7fd3cc004160 comp rx=0 tx=0).stop 2024-09-15T22:23:54.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3630865845 shutdown_connections 2024-09-15T22:23:54.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3630865845 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56277f235380 0x56277f2377a0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3630865845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56277f1ba780 0x56277f1b44f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3630865845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56277f1b0f50 0x56277f1b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3eacf4740 1 --2- 172.21.15.45:0/3630865845 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56277f1af9e0 0x56277f1c2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3c9ffb640 0 client.16683 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:54.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3630865845 >> 172.21.15.45:0/3630865845 conn(0x56277f174310 msgr2=0x56277f1b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:54.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3630865845 shutdown_connections 2024-09-15T22:23:54.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3eacf4740 1 -- 172.21.15.45:0/3630865845 wait complete. 2024-09-15T22:23:54.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.758+0000 7fd3eacf4740 20 client.16683 trim_cache size 0 max 16384 2024-09-15T22:23:54.777 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:23:54.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.759+0000 7fd3e891b640 1 -- 172.21.15.45:0/2354007791 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd3d00a33b0 msgr2=0x7fd3d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.759+0000 7fd3e891b640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd3d00a33b0 0x7fd3d00a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0a47e0 tx=0x7fd3dc0058f0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.759+0000 7fd3e891b640 1 -- 172.21.15.45:0/2354007791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3e4106a70 msgr2=0x7fd3e41a4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:54.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.759+0000 7fd3e891b640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3e4106a70 0x7fd3e41a4430 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00cad0 tx=0x7fd3dc00cf90 comp rx=0 tx=0).stop 2024-09-15T22:23:54.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.759+0000 7fd3e891b640 1 -- 172.21.15.45:0/2354007791 shutdown_connections 2024-09-15T22:23:54.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.759+0000 7fd3e891b640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fd3d00a33b0 0x7fd3d00a5870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.759+0000 7fd3e891b640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3e4106a70 0x7fd3e41a4430 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.759+0000 7fd3e891b640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3e4101410 0x7fd3e41998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.759+0000 7fd3e891b640 1 --2- 172.21.15.45:0/2354007791 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd3e4100a70 0x7fd3e41993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:54.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.759+0000 7fd3e891b640 1 -- 172.21.15.45:0/2354007791 >> 172.21.15.45:0/2354007791 conn(0x7fd3e40fc790 msgr2=0x7fd3e40fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:54.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.759+0000 7fd3e891b640 1 -- 172.21.15.45:0/2354007791 shutdown_connections 2024-09-15T22:23:54.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:54.759+0000 7fd3e891b640 1 -- 172.21.15.45:0/2354007791 wait complete. 2024-09-15T22:23:55.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:54 smithi045 ceph-mon[31180]: pgmap v235: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:55.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:54 smithi165 ceph-mon[35551]: pgmap v235: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:55.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:54 smithi100 ceph-mon[35319]: pgmap v235: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:23:56.552 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:23:56.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:23:56.825 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:57.074 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:56 smithi045 ceph-mon[31180]: pgmap v236: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:57.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:56 smithi165 ceph-mon[35551]: pgmap v236: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:57.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:56 smithi100 ceph-mon[35319]: pgmap v236: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:57.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.310+0000 7fed0176c640 1 -- 172.21.15.45:0/120518080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecfc106f50 msgr2=0x7fecfc10eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:57.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.310+0000 7fed0176c640 1 --2- 172.21.15.45:0/120518080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecfc106f50 0x7fecfc10eaf0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fecf4009930 tx=0x7fecf402a420 comp rx=0 tx=0).stop 2024-09-15T22:23:57.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.310+0000 7fed0176c640 1 -- 172.21.15.45:0/120518080 shutdown_connections 2024-09-15T22:23:57.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.310+0000 7fed0176c640 1 --2- 172.21.15.45:0/120518080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecfc106f50 0x7fecfc10eaf0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.310+0000 7fed0176c640 1 --2- 172.21.15.45:0/120518080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc100d00 0x7fecfc106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.310+0000 7fed0176c640 1 --2- 172.21.15.45:0/120518080 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecfc100350 0x7fecfc100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.310+0000 7fed0176c640 1 -- 172.21.15.45:0/120518080 >> 172.21.15.45:0/120518080 conn(0x7fecfc077210 msgr2=0x7fecfc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.310+0000 7fed0176c640 1 -- 172.21.15.45:0/120518080 shutdown_connections 2024-09-15T22:23:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.310+0000 7fed0176c640 1 -- 172.21.15.45:0/120518080 wait complete. 2024-09-15T22:23:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.311+0000 7fed0176c640 1 Processor -- start 2024-09-15T22:23:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.311+0000 7fed0176c640 1 -- start start 2024-09-15T22:23:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fed0176c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc100350 0x7fecfc1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fed0176c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecfc100d00 0x7fecfc198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fed0176c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecfc106f50 0x7fecfc19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fed0176c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc112140 con 0x7fecfc106f50 2024-09-15T22:23:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fed0176c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc111fc0 con 0x7fecfc100350 2024-09-15T22:23:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fed0176c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc1122c0 con 0x7fecfc100d00 2024-09-15T22:23:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fecfb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecfc106f50 0x7fecfc19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fecfb7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecfc106f50 0x7fecfc19ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54360/0 (socket says 172.21.15.45:54360) 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fecfb7fe640 1 -- 172.21.15.45:0/290114001 learned_addr learned my addr 172.21.15.45:0/290114001 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fecfaffd640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc100350 0x7fecfc1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecfc100d00 0x7fecfc198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fecfb7fe640 1 -- 172.21.15.45:0/290114001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecfc100d00 msgr2=0x7fecfc198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fecfb7fe640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecfc100d00 0x7fecfc198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fecfb7fe640 1 -- 172.21.15.45:0/290114001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc100350 msgr2=0x7fecfc1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fecfb7fe640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc100350 0x7fecfc1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fecfb7fe640 1 -- 172.21.15.45:0/290114001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc19d570 con 0x7fecfc106f50 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fecfb7fe640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecfc106f50 0x7fecfc19ce90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fecf4004770 tx=0x7fecf40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fece3fff640 1 -- 172.21.15.45:0/290114001 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf403f030 con 0x7fecfc106f50 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fece3fff640 1 -- 172.21.15.45:0/290114001 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fecf4003d00 con 0x7fecfc106f50 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fed0176c640 1 -- 172.21.15.45:0/290114001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecfc19d800 con 0x7fecfc106f50 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.312+0000 7fece3fff640 1 -- 172.21.15.45:0/290114001 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4035070 con 0x7fecfc106f50 2024-09-15T22:23:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.313+0000 7fed0176c640 1 -- 172.21.15.45:0/290114001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecfc1a5140 con 0x7fecfc106f50 2024-09-15T22:23:57.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.315+0000 7fece3fff640 1 -- 172.21.15.45:0/290114001 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fecf4042030 con 0x7fecfc106f50 2024-09-15T22:23:57.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.315+0000 7fed03b45740 1 Processor -- start 2024-09-15T22:23:57.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.315+0000 7fed03b45740 1 -- start start 2024-09-15T22:23:57.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fed03b45740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e3b60 0x55d6082e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fed03b45740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e4480 0x55d6082ee800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fed03b45740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 0x55d6082f1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fed03b45740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d608249280 con 0x55d6082e3b60 2024-09-15T22:23:57.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fed03b45740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d6081f0b10 con 0x55d6082eed40 2024-09-15T22:23:57.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fed03b45740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d608245240 con 0x55d6082e4480 2024-09-15T22:23:57.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fecfa7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e3b60 0x55d6082e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fecfa7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e3b60 0x55d6082e3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54368/0 (socket says 172.21.15.45:54368) 2024-09-15T22:23:57.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fecfa7fc640 1 -- 172.21.15.45:0/697605755 learned_addr learned my addr 172.21.15.45:0/697605755 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:57.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fece3fff640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fece40a33b0 0x7fece40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/697605755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 0x55d6082f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fecfa7fc640 1 -- 172.21.15.45:0/697605755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e4480 msgr2=0x55d6082ee800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/697605755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e4480 0x55d6082ee800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fecfa7fc640 1 -- 172.21.15.45:0/697605755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 msgr2=0x55d6082f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/697605755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 0x55d6082f1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fecfa7fc640 1 -- 172.21.15.45:0/697605755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6081fd1f0 con 0x55d6082e3b60 2024-09-15T22:23:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fecfb7fe640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fece40a33b0 0x7fece40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fece3fff640 1 -- 172.21.15.45:0/290114001 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7fecf40f06c0 con 0x7fecfc106f50 2024-09-15T22:23:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.316+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/697605755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e3b60 0x55d6082e3f40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fecf000bfa0 tx=0x7fecf000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f58be53d90ea09 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.317+0000 7fece17fa640 1 -- 172.21.15.45:0/697605755 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf0019030 con 0x55d6082e3b60 2024-09-15T22:23:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.317+0000 7fece17fa640 1 -- 172.21.15.45:0/697605755 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fecf0011940 con 0x55d6082e3b60 2024-09-15T22:23:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.317+0000 7fece17fa640 1 -- 172.21.15.45:0/697605755 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf001d880 con 0x55d6082e3b60 2024-09-15T22:23:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.317+0000 7fecfb7fe640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fece40a33b0 0x7fece40a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fecf40bc250 tx=0x7fecf408e2d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.317+0000 7fed03b45740 1 -- 172.21.15.45:0/697605755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e3b60 msgr2=0x55d6082e3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.317+0000 7fed03b45740 1 --2- 172.21.15.45:0/697605755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e3b60 0x55d6082e3f40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fecf000bfa0 tx=0x7fecf000b650 comp rx=0 tx=0).stop 2024-09-15T22:23:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.317+0000 7fed03b45740 1 -- 172.21.15.45:0/697605755 shutdown_connections 2024-09-15T22:23:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.317+0000 7fed03b45740 1 --2- 172.21.15.45:0/697605755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 0x55d6082f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.317+0000 7fed03b45740 1 --2- 172.21.15.45:0/697605755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e4480 0x55d6082ee800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.317+0000 7fed03b45740 1 --2- 172.21.15.45:0/697605755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e3b60 0x55d6082e3f40 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.317+0000 7fed03b45740 1 -- 172.21.15.45:0/697605755 >> 172.21.15.45:0/697605755 conn(0x55d6082e00f0 msgr2=0x55d6082e04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.317+0000 7fed03b45740 1 -- 172.21.15.45:0/697605755 shutdown_connections 2024-09-15T22:23:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.318+0000 7fed03b45740 1 -- 172.21.15.45:0/697605755 wait complete. 2024-09-15T22:23:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.318+0000 7fed03b45740 1 -- start start 2024-09-15T22:23:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.318+0000 7fed03b45740 1 Processor -- start 2024-09-15T22:23:57.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.318+0000 7fed03b45740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 0x55d6082ebc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.318+0000 7fed03b45740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082e4480 0x55d6082ec180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.318+0000 7fed03b45740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082eed40 0x55d6082ec6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.318+0000 7fed03b45740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d6082f1910 con 0x55d6082eed40 2024-09-15T22:23:57.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.318+0000 7fed03b45740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d608203f10 con 0x55d6082e4480 2024-09-15T22:23:57.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.318+0000 7fed03b45740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d6082f1a90 con 0x55d6082e3b60 2024-09-15T22:23:57.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.318+0000 7fed03b45740 10 client.0 _ll_register_callbacks cb 0x55d6081cca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:57.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.318+0000 7fecfa7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082eed40 0x55d6082ec6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.318+0000 7fecfa7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082eed40 0x55d6082ec6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54380/0 (socket says 172.21.15.45:54380) 2024-09-15T22:23:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.318+0000 7fecfa7fc640 1 -- 172.21.15.45:0/2642144421 learned_addr learned my addr 172.21.15.45:0/2642144421 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/2642144421 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 0x55d6082ebc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fecfaffd640 1 --2- 172.21.15.45:0/2642144421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082e4480 0x55d6082ec180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fecfa7fc640 1 -- 172.21.15.45:0/2642144421 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 msgr2=0x55d6082ebc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/2642144421 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 0x55d6082ebc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fecfa7fc640 1 -- 172.21.15.45:0/2642144421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082e4480 msgr2=0x55d6082ec180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/2642144421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082e4480 0x55d6082ec180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fecfa7fc640 1 -- 172.21.15.45:0/2642144421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d607fba6a0 con 0x55d6082eed40 2024-09-15T22:23:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/2642144421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082eed40 0x55d6082ec6c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fecf0004630 tx=0x7fecf001d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e13f04605bddec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fecdeff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fecdeff5640 1 -- 172.21.15.45:0/2642144421 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf0019040 con 0x55d6082eed40 2024-09-15T22:23:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fecdeff5640 1 -- 172.21.15.45:0/2642144421 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7fecf0011ca0 con 0x55d6082eed40 2024-09-15T22:23:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fed03b45740 1 -- 172.21.15.45:0/2642144421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecf0011940 con 0x55d6082eed40 2024-09-15T22:23:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fecdeff5640 1 -- 172.21.15.45:0/2642144421 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fecf0033050 con 0x55d6082eed40 2024-09-15T22:23:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fed03b45740 10 client.16695 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.319+0000 7fed03b45740 1 -- 172.21.15.45:0/2642144421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d6082fd540 con 0x55d6082eed40 2024-09-15T22:23:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.320+0000 7fecdeff5640 1 -- 172.21.15.45:0/2642144421 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fecf0011940 con 0x55d6082eed40 2024-09-15T22:23:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.320+0000 7fecdeff5640 1 -- 172.21.15.45:0/2642144421 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fecf002b020 con 0x55d6082eed40 2024-09-15T22:23:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.320+0000 7fed03b45740 10 client.16695 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.320+0000 7fed03b45740 10 client.16695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.320+0000 7fed03b45740 20 client.16695 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.320+0000 7fed03b45740 1 --2- 172.21.15.45:0/2642144421 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d6082fe940 0x55d608300d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.320+0000 7fed03b45740 4 client.16695 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:23:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.320+0000 7fed03b45740 1 -- 172.21.15.45:0/2642144421 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6082567f0 con 0x55d6082fe940 2024-09-15T22:23:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.320+0000 7fecfaffd640 1 --2- 172.21.15.45:0/2642144421 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d6082fe940 0x55d608300d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fecdeff5640 10 client.16695 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fecfaffd640 1 --2- 172.21.15.45:0/2642144421 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d6082fe940 0x55d608300d30 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8211b526a8d36197 server_cookie=1011e5914da622b2 in_seq=0 out_seq=0 2024-09-15T22:23:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fecdeff5640 1 -- 172.21.15.45:0/2642144421 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6082567f0 con 0x55d6082fe940 2024-09-15T22:23:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fecdeff5640 10 client.16695 handle_command_reply: tid=0 2024-09-15T22:23:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fed03b45740 1 client.16695 shutdown 2024-09-15T22:23:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fed03b45740 1 -- 172.21.15.45:0/2642144421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082eed40 msgr2=0x55d6082ec6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fed03b45740 1 --2- 172.21.15.45:0/2642144421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082eed40 0x55d6082ec6c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fecf0004630 tx=0x7fecf001d460 comp rx=0 tx=0).stop 2024-09-15T22:23:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fed03b45740 1 -- 172.21.15.45:0/2642144421 shutdown_connections 2024-09-15T22:23:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fed03b45740 1 --2- 172.21.15.45:0/2642144421 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d6082fe940 0x55d608300d30 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fed03b45740 1 --2- 172.21.15.45:0/2642144421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082eed40 0x55d6082ec6c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fecdeff5640 0 client.16695 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fed03b45740 1 --2- 172.21.15.45:0/2642144421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082e4480 0x55d6082ec180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fed03b45740 1 --2- 172.21.15.45:0/2642144421 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 0x55d6082ebc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.321+0000 7fed03b45740 1 -- 172.21.15.45:0/2642144421 >> 172.21.15.45:0/2642144421 conn(0x55d6082e00f0 msgr2=0x55d6082e5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.322+0000 7fed03b45740 1 -- 172.21.15.45:0/2642144421 shutdown_connections 2024-09-15T22:23:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.322+0000 7fed03b45740 1 -- 172.21.15.45:0/2642144421 wait complete. 2024-09-15T22:23:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.322+0000 7fed03b45740 20 client.16695 trim_cache size 0 max 16384 2024-09-15T22:23:57.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.339+0000 7fed03b45740 1 Processor -- start 2024-09-15T22:23:57.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.339+0000 7fed03b45740 1 -- start start 2024-09-15T22:23:57.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.339+0000 7fed03b45740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 0x55d6082e65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.339+0000 7fed03b45740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 0x55d6082eaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.339+0000 7fed03b45740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 0x55d608306540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.339+0000 7fed03b45740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc1ad2e0 con 0x55d6082e4480 2024-09-15T22:23:57.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.339+0000 7fed03b45740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc1afb60 con 0x55d6082eed40 2024-09-15T22:23:57.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.339+0000 7fed03b45740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc1ad950 con 0x55d6082e3b60 2024-09-15T22:23:57.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.339+0000 7fecfaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 0x55d6082eaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.339+0000 7fecfaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 0x55d6082eaaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54388/0 (socket says 172.21.15.45:54388) 2024-09-15T22:23:57.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.339+0000 7fecfaffd640 1 -- 172.21.15.45:0/2060427451 learned_addr learned my addr 172.21.15.45:0/2060427451 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:57.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.340+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/2060427451 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 0x55d6082e65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.340+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/2060427451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 0x55d608306540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.340+0000 7fecfaffd640 1 -- 172.21.15.45:0/2060427451 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 msgr2=0x55d6082e65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:57.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.340+0000 7fecfaffd640 1 --2- 172.21.15.45:0/2060427451 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 0x55d6082e65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.340+0000 7fecfaffd640 1 -- 172.21.15.45:0/2060427451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 msgr2=0x55d608306540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:57.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.340+0000 7fecfaffd640 1 --2- 172.21.15.45:0/2060427451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 0x55d608306540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.340+0000 7fecfaffd640 1 -- 172.21.15.45:0/2060427451 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6082ee220 con 0x55d6082e4480 2024-09-15T22:23:57.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.340+0000 7fecfaffd640 1 --2- 172.21.15.45:0/2060427451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 0x55d6082eaaf0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fecec009f20 tx=0x7fecec00e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659223942474b536 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:57.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.340+0000 7fece0ff9640 1 -- 172.21.15.45:0/2060427451 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec01c070 con 0x55d6082e4480 2024-09-15T22:23:57.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.340+0000 7fece0ff9640 1 -- 172.21.15.45:0/2060427451 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fecec007ce0 con 0x55d6082e4480 2024-09-15T22:23:57.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.340+0000 7fece0ff9640 1 -- 172.21.15.45:0/2060427451 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec0163a0 con 0x55d6082e4480 2024-09-15T22:23:57.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.341+0000 7fed03b45740 1 -- 172.21.15.45:0/2060427451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 msgr2=0x55d6082eaaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:57.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.341+0000 7fed03b45740 1 --2- 172.21.15.45:0/2060427451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 0x55d6082eaaf0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fecec009f20 tx=0x7fecec00e040 comp rx=0 tx=0).stop 2024-09-15T22:23:57.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.341+0000 7fed03b45740 1 -- 172.21.15.45:0/2060427451 shutdown_connections 2024-09-15T22:23:57.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.341+0000 7fed03b45740 1 --2- 172.21.15.45:0/2060427451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 0x55d608306540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.341+0000 7fed03b45740 1 --2- 172.21.15.45:0/2060427451 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 0x55d6082eaaf0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.341+0000 7fed03b45740 1 --2- 172.21.15.45:0/2060427451 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 0x55d6082e65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.341+0000 7fed03b45740 1 -- 172.21.15.45:0/2060427451 >> 172.21.15.45:0/2060427451 conn(0x55d6082e00f0 msgr2=0x55d6082ea3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:57.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.341+0000 7fed03b45740 1 -- 172.21.15.45:0/2060427451 shutdown_connections 2024-09-15T22:23:57.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.341+0000 7fed03b45740 1 -- 172.21.15.45:0/2060427451 wait complete. 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.341+0000 7fed03b45740 1 -- start start 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.341+0000 7fed03b45740 1 Processor -- start 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fed03b45740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 0x55d6082f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fed03b45740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 0x55d6082f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fed03b45740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 0x55d6082f3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fed03b45740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc1ae020 con 0x55d6082e4480 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fed03b45740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc1af490 con 0x55d6082eed40 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fed03b45740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fecfc1ae6f0 con 0x55d6082e3b60 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fed03b45740 10 client.0 _ll_register_callbacks cb 0x7fecf0013400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecfaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 0x55d6082f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecfaffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 0x55d6082f31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54396/0 (socket says 172.21.15.45:54396) 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecfaffd640 1 -- 172.21.15.45:0/3218490308 learned_addr learned my addr 172.21.15.45:0/3218490308 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 0x55d6082f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 0x55d6082f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecfaffd640 1 -- 172.21.15.45:0/3218490308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 msgr2=0x55d6082f2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:57.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecfaffd640 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 0x55d6082f2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecfaffd640 1 -- 172.21.15.45:0/3218490308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 msgr2=0x55d6082f3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:57.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecfaffd640 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 0x55d6082f3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecfaffd640 1 -- 172.21.15.45:0/3218490308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d608368670 con 0x55d6082e4480 2024-09-15T22:23:57.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 0x55d6082f2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:57.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecfaffd640 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 0x55d6082f31f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fecec009440 tx=0x7fecec017cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3e5ed0c88d0e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:57.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecdeff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:57.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecdeff5640 1 -- 172.21.15.45:0/3218490308 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec01c040 con 0x55d6082e4480 2024-09-15T22:23:57.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fecdeff5640 1 -- 172.21.15.45:0/3218490308 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7fecec017420 con 0x55d6082e4480 2024-09-15T22:23:57.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.342+0000 7fed03b45740 1 -- 172.21.15.45:0/3218490308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecec007ce0 con 0x55d6082e4480 2024-09-15T22:23:57.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.343+0000 7fecdeff5640 1 -- 172.21.15.45:0/3218490308 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fecec017640 con 0x55d6082e4480 2024-09-15T22:23:57.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.343+0000 7fed03b45740 10 client.16701 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:57.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.343+0000 7fed03b45740 1 -- 172.21.15.45:0/3218490308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d608369970 con 0x55d6082e4480 2024-09-15T22:23:57.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.343+0000 7fecdeff5640 1 -- 172.21.15.45:0/3218490308 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fecec007ce0 con 0x55d6082e4480 2024-09-15T22:23:57.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.343+0000 7fecdeff5640 1 -- 172.21.15.45:0/3218490308 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fecec029480 con 0x55d6082e4480 2024-09-15T22:23:57.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.343+0000 7fed03b45740 10 client.16701 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:57.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.343+0000 7fed03b45740 10 client.16701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:57.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.343+0000 7fed03b45740 20 client.16701 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:57.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.343+0000 7fed03b45740 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d60836a020 0x55d60836c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:57.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.343+0000 7fed03b45740 4 client.16701 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:23:57.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.343+0000 7fed03b45740 1 -- 172.21.15.45:0/3218490308 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d608250d00 con 0x55d60836a020 2024-09-15T22:23:57.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.343+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d60836a020 0x55d60836c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:57.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.344+0000 7fecdeff5640 10 client.16701 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:57.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.344+0000 7fecfa7fc640 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d60836a020 0x55d60836c440 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ac3fd57c74d099c server_cookie=b5b3b1f7fa062142 in_seq=0 out_seq=0 2024-09-15T22:23:57.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fecdeff5640 1 -- 172.21.15.45:0/3218490308 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d608250d00 con 0x55d60836a020 2024-09-15T22:23:57.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fecdeff5640 10 client.16701 handle_command_reply: tid=0 2024-09-15T22:23:57.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fed03b45740 1 client.16701 shutdown 2024-09-15T22:23:57.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fed03b45740 1 -- 172.21.15.45:0/3218490308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 msgr2=0x55d6082f31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:57.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fed03b45740 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 0x55d6082f31f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fecec009440 tx=0x7fecec017cf0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fed03b45740 1 -- 172.21.15.45:0/3218490308 shutdown_connections 2024-09-15T22:23:57.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fed03b45740 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d60836a020 0x55d60836c440 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fecdeff5640 0 client.16701 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:57.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fed03b45740 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d6082eed40 0x55d6082f3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fed03b45740 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6082e4480 0x55d6082f31f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fed03b45740 1 --2- 172.21.15.45:0/3218490308 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d6082e3b60 0x55d6082f2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fed03b45740 1 -- 172.21.15.45:0/3218490308 >> 172.21.15.45:0/3218490308 conn(0x55d6082e00f0 msgr2=0x55d6082eac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:57.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fed03b45740 1 -- 172.21.15.45:0/3218490308 shutdown_connections 2024-09-15T22:23:57.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fed03b45740 1 -- 172.21.15.45:0/3218490308 wait complete. 2024-09-15T22:23:57.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.345+0000 7fed03b45740 20 client.16701 trim_cache size 0 max 16384 2024-09-15T22:23:57.354 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:23:57.354 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:23:57.354 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "9661d428-019f-443c-bdcc-8e3a2fcb53e8", 2024-09-15T22:23:57.354 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:23:57.354 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:23:57.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.346+0000 7fed0176c640 1 -- 172.21.15.45:0/290114001 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fece40a33b0 msgr2=0x7fece40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:57.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.346+0000 7fed0176c640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fece40a33b0 0x7fece40a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fecf40bc250 tx=0x7fecf408e2d0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.346+0000 7fed0176c640 1 -- 172.21.15.45:0/290114001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecfc106f50 msgr2=0x7fecfc19ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:57.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.346+0000 7fed0176c640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecfc106f50 0x7fecfc19ce90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fecf4004770 tx=0x7fecf40042f0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.346+0000 7fed0176c640 1 -- 172.21.15.45:0/290114001 shutdown_connections 2024-09-15T22:23:57.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.346+0000 7fed0176c640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fece40a33b0 0x7fece40a5870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.346+0000 7fed0176c640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecfc106f50 0x7fecfc19ce90 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.346+0000 7fed0176c640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fecfc100d00 0x7fecfc198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.346+0000 7fed0176c640 1 --2- 172.21.15.45:0/290114001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecfc100350 0x7fecfc1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:57.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.346+0000 7fed0176c640 1 -- 172.21.15.45:0/290114001 >> 172.21.15.45:0/290114001 conn(0x7fecfc077210 msgr2=0x7fecfc105770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:57.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.346+0000 7fed0176c640 1 -- 172.21.15.45:0/290114001 shutdown_connections 2024-09-15T22:23:57.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:57.346+0000 7fed0176c640 1 -- 172.21.15.45:0/290114001 wait complete. 2024-09-15T22:23:58.100 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:23:58.358 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:23:58.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.859+0000 7f2d8e233640 1 -- 172.21.15.45:0/2305238152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d88101de0 msgr2=0x7f2d881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.859+0000 7f2d8e233640 1 --2- 172.21.15.45:0/2305238152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d88101de0 0x7f2d881021c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009900 tx=0x7f2d7802a410 comp rx=0 tx=0).stop 2024-09-15T22:23:58.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.859+0000 7f2d8e233640 1 -- 172.21.15.45:0/2305238152 shutdown_connections 2024-09-15T22:23:58.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.859+0000 7f2d8e233640 1 --2- 172.21.15.45:0/2305238152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d88106f10 0x7f2d8810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.859+0000 7f2d8e233640 1 --2- 172.21.15.45:0/2305238152 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d88102790 0x7f2d881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.859+0000 7f2d8e233640 1 --2- 172.21.15.45:0/2305238152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d88101de0 0x7f2d881021c0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.859+0000 7f2d8e233640 1 -- 172.21.15.45:0/2305238152 >> 172.21.15.45:0/2305238152 conn(0x7f2d880fd8c0 msgr2=0x7f2d880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.859+0000 7f2d8e233640 1 -- 172.21.15.45:0/2305238152 shutdown_connections 2024-09-15T22:23:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.859+0000 7f2d8e233640 1 -- 172.21.15.45:0/2305238152 wait complete. 2024-09-15T22:23:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.860+0000 7f2d8e233640 1 Processor -- start 2024-09-15T22:23:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.860+0000 7f2d8e233640 1 -- start start 2024-09-15T22:23:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.860+0000 7f2d8e233640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d88101de0 0x7f2d88198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.860+0000 7f2d8e233640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d88102790 0x7f2d881989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.860+0000 7f2d8e233640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d88106f10 0x7f2d8819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.860+0000 7f2d8e233640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2d88112090 con 0x7f2d88102790 2024-09-15T22:23:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.860+0000 7f2d8e233640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d88111f10 con 0x7f2d88101de0 2024-09-15T22:23:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.860+0000 7f2d8e233640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d88112210 con 0x7f2d88106f10 2024-09-15T22:23:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.860+0000 7f2d86ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d88102790 0x7f2d881989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.860+0000 7f2d86ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d88102790 0x7f2d881989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54414/0 (socket says 172.21.15.45:54414) 2024-09-15T22:23:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.860+0000 7f2d86ffd640 1 -- 172.21.15.45:0/1775251029 learned_addr learned my addr 172.21.15.45:0/1775251029 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.860+0000 7f2d877fe640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d88101de0 0x7f2d88198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.861+0000 7f2d87fff640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d88106f10 0x7f2d8819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.861+0000 7f2d86ffd640 1 -- 172.21.15.45:0/1775251029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d88106f10 msgr2=0x7f2d8819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.861+0000 7f2d86ffd640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d88106f10 0x7f2d8819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.861+0000 7f2d86ffd640 1 -- 172.21.15.45:0/1775251029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d88101de0 msgr2=0x7f2d88198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.861+0000 7f2d86ffd640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d88101de0 0x7f2d88198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.861+0000 7f2d86ffd640 1 -- 172.21.15.45:0/1775251029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8819d440 con 0x7f2d88102790 2024-09-15T22:23:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.861+0000 7f2d87fff640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d88106f10 0x7f2d8819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.861+0000 7f2d86ffd640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d88102790 0x7f2d881989d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00d950 tx=0x7f2d7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.861+0000 7f2d84ff9640 1 -- 172.21.15.45:0/1775251029 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c017030 con 0x7f2d88102790 2024-09-15T22:23:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.861+0000 7f2d84ff9640 1 -- 172.21.15.45:0/1775251029 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d7c004020 con 0x7f2d88102790 2024-09-15T22:23:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.861+0000 7f2d8e233640 1 -- 172.21.15.45:0/1775251029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d8819d730 con 0x7f2d88102790 2024-09-15T22:23:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.861+0000 7f2d84ff9640 1 -- 172.21.15.45:0/1775251029 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c004a00 con 0x7f2d88102790 2024-09-15T22:23:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.861+0000 7f2d8e233640 1 -- 172.21.15.45:0/1775251029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d881a5010 con 0x7f2d88102790 2024-09-15T22:23:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.863+0000 7f2d84ff9640 1 -- 172.21.15.45:0/1775251029 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2d7c0041d0 con 0x7f2d88102790 2024-09-15T22:23:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.863+0000 7f2d9060c740 1 Processor -- start 2024-09-15T22:23:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d9060c740 1 -- start start 2024-09-15T22:23:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d9060c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 0x55a698441880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d9060c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 0x55a69844c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d9060c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69844c680 0x55a69844ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d9060c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a6983a72e0 con 0x55a698441dc0 2024-09-15T22:23:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d9060c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a69834ece0 con 0x55a69844c680 2024-09-15T22:23:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d9060c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a6983a32a0 con 0x55a6984414a0 2024-09-15T22:23:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d877fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 0x55a69844c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d877fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 0x55a69844c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54428/0 (socket says 172.21.15.45:54428) 2024-09-15T22:23:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d877fe640 1 -- 172.21.15.45:0/3015370792 learned_addr learned my addr 172.21.15.45:0/3015370792 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d84ff9640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d700a3430 0x7f2d700a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d86ffd640 1 --2- 172.21.15.45:0/3015370792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69844c680 0x55a69844ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d877fe640 1 -- 172.21.15.45:0/3015370792 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 msgr2=0x55a698441880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d877fe640 1 --2- 172.21.15.45:0/3015370792 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 0x55a698441880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d877fe640 1 -- 172.21.15.45:0/3015370792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69844c680 msgr2=0x55a69844ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d877fe640 1 --2- 172.21.15.45:0/3015370792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69844c680 0x55a69844ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d877fe640 1 -- 172.21.15.45:0/3015370792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a698333440 con 0x55a698441dc0 2024-09-15T22:23:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d87fff640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d700a3430 0x7f2d700a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d86ffd640 1 --2- 172.21.15.45:0/3015370792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69844c680 0x55a69844ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.864+0000 7f2d84ff9640 1 -- 172.21.15.45:0/1775251029 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7f2d7c0cfb30 con 0x7f2d88102790 2024-09-15T22:23:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.865+0000 7f2d877fe640 1 --2- 172.21.15.45:0/3015370792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 0x55a69844c140 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009900 tx=0x7f2d78031640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23607de61a51be12 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.865+0000 7f2d6dffb640 1 -- 172.21.15.45:0/3015370792 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d78040070 con 0x55a698441dc0 2024-09-15T22:23:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.865+0000 7f2d6dffb640 1 -- 172.21.15.45:0/3015370792 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d78005020 con 0x55a698441dc0 2024-09-15T22:23:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.865+0000 7f2d6dffb640 1 -- 172.21.15.45:0/3015370792 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d78035040 con 0x55a698441dc0 2024-09-15T22:23:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.865+0000 7f2d9060c740 1 -- 172.21.15.45:0/3015370792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 msgr2=0x55a69844c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.865+0000 7f2d9060c740 1 --2- 172.21.15.45:0/3015370792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 0x55a69844c140 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009900 tx=0x7f2d78031640 comp rx=0 tx=0).stop 2024-09-15T22:23:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.865+0000 7f2d87fff640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d700a3430 0x7f2d700a58f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000ad00 tx=0x7f2d8000a2e0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.865+0000 7f2d9060c740 1 -- 172.21.15.45:0/3015370792 shutdown_connections 2024-09-15T22:23:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.865+0000 7f2d9060c740 1 --2- 172.21.15.45:0/3015370792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69844c680 0x55a69844ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.865+0000 7f2d9060c740 1 --2- 172.21.15.45:0/3015370792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 0x55a69844c140 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.865+0000 7f2d9060c740 1 --2- 172.21.15.45:0/3015370792 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 0x55a698441880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.865+0000 7f2d9060c740 1 -- 172.21.15.45:0/3015370792 >> 172.21.15.45:0/3015370792 conn(0x55a69843da30 msgr2=0x55a69843de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:58.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.866+0000 7f2d9060c740 1 -- 172.21.15.45:0/3015370792 shutdown_connections 2024-09-15T22:23:58.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.866+0000 7f2d9060c740 1 -- 172.21.15.45:0/3015370792 wait complete. 2024-09-15T22:23:58.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.866+0000 7f2d9060c740 1 -- start start 2024-09-15T22:23:58.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.866+0000 7f2d9060c740 1 Processor -- start 2024-09-15T22:23:58.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.866+0000 7f2d9060c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6984414a0 0x55a69844bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.866+0000 7f2d9060c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a698441dc0 0x55a698449200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.866+0000 7f2d9060c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69844c680 0x55a698449740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.866+0000 7f2d9060c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a69844f250 con 0x55a69844c680 2024-09-15T22:23:58.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.866+0000 7f2d9060c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a698362050 con 0x55a6984414a0 2024-09-15T22:23:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.866+0000 7f2d9060c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a69844f3d0 con 0x55a698441dc0 2024-09-15T22:23:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d9060c740 10 client.0 _ll_register_callbacks cb 0x55a6983a2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d87fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69844c680 0x55a698449740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d877fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6984414a0 0x55a69844bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d87fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69844c680 0x55a698449740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54432/0 (socket says 172.21.15.45:54432) 2024-09-15T22:23:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d87fff640 1 -- 172.21.15.45:0/62025824 learned_addr learned my addr 172.21.15.45:0/62025824 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d86ffd640 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a698441dc0 0x55a698449200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d87fff640 1 -- 172.21.15.45:0/62025824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a698441dc0 msgr2=0x55a698449200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d87fff640 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a698441dc0 0x55a698449200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d87fff640 1 -- 172.21.15.45:0/62025824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6984414a0 msgr2=0x55a69844bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d87fff640 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6984414a0 0x55a69844bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d87fff640 1 -- 172.21.15.45:0/62025824 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6981183c0 con 0x55a69844c680 2024-09-15T22:23:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d86ffd640 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a698441dc0 0x55a698449200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d877fe640 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6984414a0 0x55a69844bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:23:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d87fff640 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69844c680 0x55a698449740 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000f9a0 tx=0x7f2d80004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689b644f41411f61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d66ffd640 1 -- 172.21.15.45:0/62025824 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8000fe60 con 0x55a69844c680 2024-09-15T22:23:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d9060c740 1 -- 172.21.15.45:0/62025824 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d78005020 con 0x55a69844c680 2024-09-15T22:23:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d66ffd640 1 -- 172.21.15.45:0/62025824 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7f2d8001ad80 con 0x55a69844c680 2024-09-15T22:23:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d66ffd640 1 -- 172.21.15.45:0/62025824 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2d800286c0 con 0x55a69844c680 2024-09-15T22:23:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d9060c740 10 client.16713 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.867+0000 7f2d9060c740 1 -- 172.21.15.45:0/62025824 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a69845ac50 con 0x55a69844c680 2024-09-15T22:23:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.868+0000 7f2d66ffd640 1 -- 172.21.15.45:0/62025824 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d78005020 con 0x55a69844c680 2024-09-15T22:23:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.868+0000 7f2d66ffd640 1 -- 172.21.15.45:0/62025824 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2d80021070 con 0x55a69844c680 2024-09-15T22:23:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.868+0000 7f2d9060c740 10 client.16713 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:58.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.868+0000 7f2d9060c740 10 client.16713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:58.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.868+0000 7f2d9060c740 20 client.16713 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:58.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.868+0000 7f2d9060c740 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a69845c060 0x55a69845e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.868+0000 7f2d9060c740 4 client.16713 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:23:58.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.868+0000 7f2d9060c740 1 -- 172.21.15.45:0/62025824 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6983b4850 con 0x55a69845c060 2024-09-15T22:23:58.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.868+0000 7f2d877fe640 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a69845c060 0x55a69845e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.869+0000 7f2d877fe640 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a69845c060 0x55a69845e470 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd12c2d1c121de2 server_cookie=8556b05be7502143 in_seq=0 out_seq=0 2024-09-15T22:23:58.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.869+0000 7f2d66ffd640 10 client.16713 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:58.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.869+0000 7f2d66ffd640 1 -- 172.21.15.45:0/62025824 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a6983b4850 con 0x55a69845c060 2024-09-15T22:23:58.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.869+0000 7f2d66ffd640 10 client.16713 handle_command_reply: tid=0 2024-09-15T22:23:58.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.869+0000 7f2d9060c740 1 client.16713 shutdown 2024-09-15T22:23:58.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.870+0000 7f2d9060c740 1 -- 172.21.15.45:0/62025824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69844c680 msgr2=0x55a698449740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.870+0000 7f2d9060c740 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69844c680 0x55a698449740 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000f9a0 tx=0x7f2d80004ab0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.870+0000 7f2d9060c740 1 -- 172.21.15.45:0/62025824 shutdown_connections 2024-09-15T22:23:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.870+0000 7f2d9060c740 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a69845c060 0x55a69845e470 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.870+0000 7f2d9060c740 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69844c680 0x55a698449740 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.870+0000 7f2d9060c740 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a698441dc0 0x55a698449200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.870+0000 7f2d66ffd640 0 client.16713 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.870+0000 7f2d9060c740 1 --2- 172.21.15.45:0/62025824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6984414a0 0x55a69844bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.870+0000 7f2d9060c740 1 -- 172.21.15.45:0/62025824 >> 172.21.15.45:0/62025824 conn(0x55a69843da30 msgr2=0x55a698443710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.870+0000 7f2d9060c740 1 -- 172.21.15.45:0/62025824 shutdown_connections 2024-09-15T22:23:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.870+0000 7f2d9060c740 1 -- 172.21.15.45:0/62025824 wait complete. 2024-09-15T22:23:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.870+0000 7f2d9060c740 20 client.16713 trim_cache size 0 max 16384 2024-09-15T22:23:58.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.887+0000 7f2d9060c740 1 Processor -- start 2024-09-15T22:23:58.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.887+0000 7f2d9060c740 1 -- start start 2024-09-15T22:23:58.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.887+0000 7f2d9060c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69843da30 0x55a6984584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.887+0000 7f2d9060c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 0x55a6984447a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.887+0000 7f2d9060c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 0x55a698463d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d9060c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2d881ad240 con 0x55a698441dc0 2024-09-15T22:23:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d9060c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d881afac0 con 0x55a69843da30 2024-09-15T22:23:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d9060c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d881ad8b0 con 0x55a6984414a0 2024-09-15T22:23:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d87fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 0x55a698463d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d87fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 0x55a698463d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54440/0 (socket says 172.21.15.45:54440) 2024-09-15T22:23:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d87fff640 1 -- 172.21.15.45:0/1991757856 learned_addr learned my addr 172.21.15.45:0/1991757856 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d877fe640 1 --2- 172.21.15.45:0/1991757856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69843da30 0x55a6984584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d86ffd640 1 --2- 172.21.15.45:0/1991757856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 0x55a6984447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d87fff640 1 -- 172.21.15.45:0/1991757856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 msgr2=0x55a6984447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d87fff640 1 --2- 172.21.15.45:0/1991757856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 0x55a6984447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d87fff640 1 -- 172.21.15.45:0/1991757856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69843da30 msgr2=0x55a6984584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d87fff640 1 --2- 172.21.15.45:0/1991757856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69843da30 0x55a6984584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d87fff640 1 -- 172.21.15.45:0/1991757856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a69843d860 con 0x55a698441dc0 2024-09-15T22:23:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d86ffd640 1 --2- 172.21.15.45:0/1991757856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 0x55a6984447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:23:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d877fe640 1 --2- 172.21.15.45:0/1991757856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69843da30 0x55a6984584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d87fff640 1 --2- 172.21.15.45:0/1991757856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 0x55a698463d40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f2d80018760 tx=0x7f2d8000a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a45eb191f8dfc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d6d7fa640 1 -- 172.21.15.45:0/1991757856 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8001a0b0 con 0x55a698441dc0 2024-09-15T22:23:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d6d7fa640 1 -- 172.21.15.45:0/1991757856 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d80018e50 con 0x55a698441dc0 2024-09-15T22:23:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.888+0000 7f2d6d7fa640 1 -- 172.21.15.45:0/1991757856 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d80028860 con 0x55a698441dc0 2024-09-15T22:23:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.889+0000 7f2d9060c740 1 -- 172.21.15.45:0/1991757856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 msgr2=0x55a698463d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.889+0000 7f2d9060c740 1 --2- 172.21.15.45:0/1991757856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 0x55a698463d40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f2d80018760 tx=0x7f2d8000a490 comp rx=0 tx=0).stop 2024-09-15T22:23:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.889+0000 7f2d9060c740 1 -- 172.21.15.45:0/1991757856 shutdown_connections 2024-09-15T22:23:58.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.889+0000 7f2d9060c740 1 --2- 172.21.15.45:0/1991757856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a698441dc0 0x55a698463d40 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.889+0000 7f2d9060c740 1 --2- 172.21.15.45:0/1991757856 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 0x55a6984447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.889+0000 7f2d9060c740 1 --2- 172.21.15.45:0/1991757856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a69843da30 0x55a6984584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.889+0000 7f2d9060c740 1 -- 172.21.15.45:0/1991757856 >> 172.21.15.45:0/1991757856 conn(0x55a6984498a0 msgr2=0x55a698444090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.889+0000 7f2d9060c740 1 -- 172.21.15.45:0/1991757856 shutdown_connections 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.889+0000 7f2d9060c740 1 -- 172.21.15.45:0/1991757856 wait complete. 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.889+0000 7f2d9060c740 1 -- start start 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d9060c740 1 Processor -- start 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d9060c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69843da30 0x55a698454db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d9060c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 0x55a6984500e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d9060c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a698441dc0 0x55a698450620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d9060c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2d881adf80 con 0x55a69843da30 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d9060c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d881af3f0 con 0x55a698441dc0 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d9060c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d881ae650 con 0x55a6984414a0 2024-09-15T22:23:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d9060c740 10 client.0 _ll_register_callbacks cb 0x7f2d8000f650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d877fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69843da30 0x55a698454db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d877fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69843da30 0x55a698454db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54448/0 (socket says 172.21.15.45:54448) 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d877fe640 1 -- 172.21.15.45:0/2874410592 learned_addr learned my addr 172.21.15.45:0/2874410592 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d86ffd640 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 0x55a6984500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d87fff640 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a698441dc0 0x55a698450620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d877fe640 1 -- 172.21.15.45:0/2874410592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 msgr2=0x55a6984500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d877fe640 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 0x55a6984500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d877fe640 1 -- 172.21.15.45:0/2874410592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a698441dc0 msgr2=0x55a698450620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d877fe640 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a698441dc0 0x55a698450620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d877fe640 1 -- 172.21.15.45:0/2874410592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a698450e20 con 0x55a69843da30 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.890+0000 7f2d87fff640 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a698441dc0 0x55a698450620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.891+0000 7f2d877fe640 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69843da30 0x55a698454db0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f2d78005dc0 tx=0x7f2d7802a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8190dd0894fd8e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.891+0000 7f2d66ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:23:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.891+0000 7f2d66ffd640 1 -- 172.21.15.45:0/2874410592 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d78035040 con 0x55a69843da30 2024-09-15T22:23:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.891+0000 7f2d66ffd640 1 -- 172.21.15.45:0/2874410592 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9568+0+0 (secure 0 0 0) 0x7f2d78005040 con 0x55a69843da30 2024-09-15T22:23:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.891+0000 7f2d9060c740 1 -- 172.21.15.45:0/2874410592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d80018e50 con 0x55a69843da30 2024-09-15T22:23:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.891+0000 7f2d66ffd640 1 -- 172.21.15.45:0/2874410592 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2d78040040 con 0x55a69843da30 2024-09-15T22:23:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.891+0000 7f2d9060c740 10 client.16719 fetch_fsmap learned FSMap version 21 2024-09-15T22:23:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.891+0000 7f2d9060c740 1 -- 172.21.15.45:0/2874410592 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a6984c6d50 con 0x55a69843da30 2024-09-15T22:23:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.891+0000 7f2d66ffd640 1 -- 172.21.15.45:0/2874410592 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d80018e50 con 0x55a69843da30 2024-09-15T22:23:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.892+0000 7f2d66ffd640 1 -- 172.21.15.45:0/2874410592 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2d780035f0 con 0x55a69843da30 2024-09-15T22:23:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.892+0000 7f2d9060c740 10 client.16719 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:23:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.892+0000 7f2d9060c740 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:23:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.892+0000 7f2d9060c740 20 client.16719 populate_metadata read hostname 'smithi045' 2024-09-15T22:23:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.892+0000 7f2d9060c740 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a69844c680 0x55a6984c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:23:58.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.892+0000 7f2d9060c740 4 client.16719 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.892+0000 7f2d9060c740 1 -- 172.21.15.45:0/2874410592 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a6983aed60 con 0x55a69844c680 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.892+0000 7f2d86ffd640 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a69844c680 0x55a6984c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.892+0000 7f2d86ffd640 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a69844c680 0x55a6984c9040 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6425da9151cb0fe2 server_cookie=9da4aec8d70dce59 in_seq=0 out_seq=0 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.892+0000 7f2d66ffd640 10 client.16719 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d66ffd640 1 -- 172.21.15.45:0/2874410592 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a6983aed60 con 0x55a69844c680 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d66ffd640 10 client.16719 handle_command_reply: tid=0 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d9060c740 1 client.16719 shutdown 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d9060c740 1 -- 172.21.15.45:0/2874410592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69843da30 msgr2=0x55a698454db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d9060c740 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69843da30 0x55a698454db0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f2d78005dc0 tx=0x7f2d7802a9b0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d9060c740 1 -- 172.21.15.45:0/2874410592 shutdown_connections 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d9060c740 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a69844c680 0x55a6984c9040 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d9060c740 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a698441dc0 0x55a698450620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d9060c740 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a6984414a0 0x55a6984500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d66ffd640 0 client.16719 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:23:58.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d9060c740 1 --2- 172.21.15.45:0/2874410592 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a69843da30 0x55a698454db0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d9060c740 1 -- 172.21.15.45:0/2874410592 >> 172.21.15.45:0/2874410592 conn(0x55a6984498a0 msgr2=0x55a698444810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:58.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d9060c740 1 -- 172.21.15.45:0/2874410592 shutdown_connections 2024-09-15T22:23:58.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d9060c740 1 -- 172.21.15.45:0/2874410592 wait complete. 2024-09-15T22:23:58.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d9060c740 20 client.16719 trim_cache size 0 max 16384 2024-09-15T22:23:58.906 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:23:58.906 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:23:58.906 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:23:58.906 INFO:teuthology.orchestra.run.smithi045.stdout: "9661d428-019f-443c-bdcc-8e3a2fcb53e8": { 2024-09-15T22:23:58.907 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:23:58.907 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "9661d428-019f-443c-bdcc-8e3a2fcb53e8", 2024-09-15T22:23:58.907 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:23:58.907 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:23:58.907 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:23:58.907 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:23:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d8e233640 1 -- 172.21.15.45:0/1775251029 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d700a3430 msgr2=0x7f2d700a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.893+0000 7f2d8e233640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d700a3430 0x7f2d700a58f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000ad00 tx=0x7f2d8000a2e0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.894+0000 7f2d8e233640 1 -- 172.21.15.45:0/1775251029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d88102790 msgr2=0x7f2d881989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:23:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.894+0000 7f2d8e233640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d88102790 0x7f2d881989d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c00d950 tx=0x7f2d7c00de10 comp rx=0 tx=0).stop 2024-09-15T22:23:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.894+0000 7f2d8e233640 1 -- 172.21.15.45:0/1775251029 shutdown_connections 2024-09-15T22:23:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.894+0000 7f2d8e233640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d700a3430 0x7f2d700a58f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.894+0000 7f2d8e233640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d88106f10 0x7f2d8819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.894+0000 7f2d8e233640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d88102790 0x7f2d881989d0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.894+0000 7f2d8e233640 1 --2- 172.21.15.45:0/1775251029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d88101de0 0x7f2d88198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:23:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.894+0000 7f2d8e233640 1 -- 172.21.15.45:0/1775251029 >> 172.21.15.45:0/1775251029 conn(0x7f2d880fd8c0 msgr2=0x7f2d880ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:23:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.894+0000 7f2d8e233640 1 -- 172.21.15.45:0/1775251029 shutdown_connections 2024-09-15T22:23:58.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:23:58.894+0000 7f2d8e233640 1 -- 172.21.15.45:0/1775251029 wait complete. 2024-09-15T22:23:59.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:58 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:23:59.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:58 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:23:59.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:58 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:23:59.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:58 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:23:59.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:23:58 smithi045 ceph-mon[31180]: pgmap v237: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:59.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:58 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:23:59.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:58 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:23:59.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:58 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:23:59.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:58 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:23:59.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:23:58 smithi165 ceph-mon[35551]: pgmap v237: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:59.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:58 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:23:59.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:58 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:23:59.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:58 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:23:59.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:58 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:23:59.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:23:58 smithi100 ceph-mon[35319]: pgmap v237: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:23:59.690 INFO:tasks.cephfs.filesystem:scrub status for tag:9661d428-019f-443c-bdcc-8e3a2fcb53e8 - {'path': '/', 'tag': '9661d428-019f-443c-bdcc-8e3a2fcb53e8', 'options': 'recursive,force'} 2024-09-15T22:24:01.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:00 smithi165 ceph-mon[35551]: pgmap v238: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:24:01.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:00 smithi100 ceph-mon[35319]: pgmap v238: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:24:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:00 smithi045 ceph-mon[31180]: pgmap v238: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:24:03.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:02 smithi165 ceph-mon[35551]: pgmap v239: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:03.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:02 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:24:03.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:02 smithi100 ceph-mon[35319]: pgmap v239: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:03.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:02 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:24:03.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:02 smithi045 ceph-mon[31180]: pgmap v239: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:03.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:02 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:24:05.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:04 smithi165 ceph-mon[35551]: pgmap v240: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:24:05.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:04 smithi100 ceph-mon[35319]: pgmap v240: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:24:05.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:04 smithi045 ceph-mon[31180]: pgmap v240: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:24:07.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:06 smithi045 ceph-mon[31180]: pgmap v241: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:24:07.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:06 smithi165 ceph-mon[35551]: pgmap v241: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:24:07.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:06 smithi100 ceph-mon[35319]: pgmap v241: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:24:09.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:08 smithi165 ceph-mon[35551]: pgmap v242: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:24:09.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:08 smithi165 ceph-mon[35551]: osdmap e95: 12 total, 12 up, 12 in 2024-09-15T22:24:09.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:08 smithi100 ceph-mon[35319]: pgmap v242: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:24:09.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:08 smithi100 ceph-mon[35319]: osdmap e95: 12 total, 12 up, 12 in 2024-09-15T22:24:09.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:08 smithi045 ceph-mon[31180]: pgmap v242: 129 pgs: 129 active+clean; 284 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:24:09.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:08 smithi045 ceph-mon[31180]: osdmap e95: 12 total, 12 up, 12 in 2024-09-15T22:24:11.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:10 smithi165 ceph-mon[35551]: pgmap v244: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 275 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:24:11.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:10 smithi100 ceph-mon[35319]: pgmap v244: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 275 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:24:11.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:10 smithi045 ceph-mon[31180]: pgmap v244: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 275 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:24:13.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:12 smithi165 ceph-mon[35551]: pgmap v245: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 275 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:24:13.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:12 smithi100 ceph-mon[35319]: pgmap v245: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 275 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:24:13.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:12 smithi045 ceph-mon[31180]: pgmap v245: 129 pgs: 18 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 62 active+clean; 275 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:24:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:14 smithi165 ceph-mon[35551]: pgmap v246: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T22:24:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:14 smithi165 ceph-mon[35551]: osdmap e96: 12 total, 12 up, 12 in 2024-09-15T22:24:15.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:14 smithi100 ceph-mon[35319]: pgmap v246: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T22:24:15.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:14 smithi100 ceph-mon[35319]: osdmap e96: 12 total, 12 up, 12 in 2024-09-15T22:24:15.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:14 smithi045 ceph-mon[31180]: pgmap v246: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T22:24:15.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:14 smithi045 ceph-mon[31180]: osdmap e96: 12 total, 12 up, 12 in 2024-09-15T22:24:17.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:16 smithi165 ceph-mon[35551]: pgmap v248: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T22:24:17.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:16 smithi100 ceph-mon[35319]: pgmap v248: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T22:24:17.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:16 smithi045 ceph-mon[31180]: pgmap v248: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T22:24:19.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:18 smithi165 ceph-mon[35551]: pgmap v249: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 207 B/s wr, 2 op/s 2024-09-15T22:24:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:18 smithi100 ceph-mon[35319]: pgmap v249: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 207 B/s wr, 2 op/s 2024-09-15T22:24:19.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:18 smithi045 ceph-mon[31180]: pgmap v249: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 207 B/s wr, 2 op/s 2024-09-15T22:24:21.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:20 smithi165 ceph-mon[35551]: pgmap v250: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:24:21.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:20 smithi100 ceph-mon[35319]: pgmap v250: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:24:21.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:20 smithi045 ceph-mon[31180]: pgmap v250: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:24:23.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:22 smithi165 ceph-mon[35551]: pgmap v251: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:24:23.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:22 smithi100 ceph-mon[35319]: pgmap v251: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:24:23.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:22 smithi045 ceph-mon[31180]: pgmap v251: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:24:25.122 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:24 smithi045 ceph-mon[31180]: pgmap v252: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:25.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:24 smithi165 ceph-mon[35551]: pgmap v252: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:25.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:24 smithi100 ceph-mon[35319]: pgmap v252: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:27.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:26 smithi165 ceph-mon[35551]: pgmap v253: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-09-15T22:24:27.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:26 smithi100 ceph-mon[35319]: pgmap v253: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-09-15T22:24:27.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:26 smithi045 ceph-mon[31180]: pgmap v253: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-09-15T22:24:29.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:28 smithi165 ceph-mon[35551]: pgmap v254: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:24:29.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:28 smithi100 ceph-mon[35319]: pgmap v254: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:24:29.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:28 smithi045 ceph-mon[31180]: pgmap v254: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:24:29.691 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:24:29.967 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:30.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.467+0000 7f23affe6640 1 -- 172.21.15.45:0/35052001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a8101420 msgr2=0x7f23a810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:30.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.467+0000 7f23affe6640 1 --2- 172.21.15.45:0/35052001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a8101420 0x7f23a810d950 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009cd0 tx=0x7f23a002a8e0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.467+0000 7f23affe6640 1 -- 172.21.15.45:0/35052001 shutdown_connections 2024-09-15T22:24:30.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.467+0000 7f23affe6640 1 --2- 172.21.15.45:0/35052001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a8101420 0x7f23a810d950 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.467+0000 7f23affe6640 1 --2- 172.21.15.45:0/35052001 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23a8100a80 0x7f23a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.467+0000 7f23affe6640 1 --2- 172.21.15.45:0/35052001 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a8106a80 0x7f23a8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.467+0000 7f23affe6640 1 -- 172.21.15.45:0/35052001 >> 172.21.15.45:0/35052001 conn(0x7f23a80fc7a0 msgr2=0x7f23a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.467+0000 7f23affe6640 1 -- 172.21.15.45:0/35052001 shutdown_connections 2024-09-15T22:24:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.467+0000 7f23affe6640 1 -- 172.21.15.45:0/35052001 wait complete. 2024-09-15T22:24:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.467+0000 7f23affe6640 1 Processor -- start 2024-09-15T22:24:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.467+0000 7f23affe6640 1 -- start start 2024-09-15T22:24:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23affe6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a8100a80 0x7f23a8199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23affe6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a8101420 0x7f23a8199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23affe6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23a8106a80 0x7f23a81a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23affe6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f23a8110fa0 con 0x7f23a8101420 2024-09-15T22:24:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23affe6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23a8110e20 con 0x7f23a8100a80 2024-09-15T22:24:30.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23affe6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f23a8111120 con 0x7f23a8106a80 2024-09-15T22:24:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23ad581640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a8101420 0x7f23a8199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23ad581640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a8101420 0x7f23a8199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36934/0 (socket says 172.21.15.45:36934) 2024-09-15T22:24:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23ad581640 1 -- 172.21.15.45:0/4146170561 learned_addr learned my addr 172.21.15.45:0/4146170561 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23ae583640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23a8106a80 0x7f23a81a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23add82640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a8100a80 0x7f23a8199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23ad581640 1 -- 172.21.15.45:0/4146170561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23a8106a80 msgr2=0x7f23a81a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23ad581640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23a8106a80 0x7f23a81a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23ad581640 1 -- 172.21.15.45:0/4146170561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a8100a80 msgr2=0x7f23a8199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23ad581640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a8100a80 0x7f23a8199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23ad581640 1 -- 172.21.15.45:0/4146170561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a81a4910 con 0x7f23a8101420 2024-09-15T22:24:30.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23add82640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a8100a80 0x7f23a8199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:24:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23ae583640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23a8106a80 0x7f23a81a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f23ad581640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a8101420 0x7f23a8199890 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f239800d950 tx=0x7f239800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f239effd640 1 -- 172.21.15.45:0/4146170561 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398017070 con 0x7f23a8101420 2024-09-15T22:24:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f239effd640 1 -- 172.21.15.45:0/4146170561 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2398009c30 con 0x7f23a8101420 2024-09-15T22:24:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.468+0000 7f239effd640 1 -- 172.21.15.45:0/4146170561 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239800f740 con 0x7f23a8101420 2024-09-15T22:24:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.469+0000 7f23affe6640 1 -- 172.21.15.45:0/4146170561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a81a4ae0 con 0x7f23a8101420 2024-09-15T22:24:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.469+0000 7f23affe6640 1 -- 172.21.15.45:0/4146170561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a81a4ff0 con 0x7f23a8101420 2024-09-15T22:24:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.471+0000 7f239effd640 1 -- 172.21.15.45:0/4146170561 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2398010a80 con 0x7f23a8101420 2024-09-15T22:24:30.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.471+0000 7f23b23bf740 1 Processor -- start 2024-09-15T22:24:30.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.471+0000 7f23b23bf740 1 -- start start 2024-09-15T22:24:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23b23bf740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e5354a0 0x55907e535880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23b23bf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e540140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23b23bf740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e540680 0x55907e542a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23b23bf740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55907e49b2e0 con 0x55907e540680 2024-09-15T22:24:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23b23bf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55907e442ce0 con 0x55907e535dc0 2024-09-15T22:24:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23b23bf740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55907e4972a0 con 0x55907e5354a0 2024-09-15T22:24:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f239effd640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f23940a33b0 0x7f23940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23ad581640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e540680 0x55907e542a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23add82640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e540140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23ad581640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e540680 0x55907e542a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36948/0 (socket says 172.21.15.45:36948) 2024-09-15T22:24:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23ad581640 1 -- 172.21.15.45:0/1767216941 learned_addr learned my addr 172.21.15.45:0/1767216941 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23ae583640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f23940a33b0 0x7f23940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23ae583640 1 --2- 172.21.15.45:0/1767216941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e5354a0 0x55907e535880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f239effd640 1 -- 172.21.15.45:0/4146170561 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f23980cfe70 con 0x7f23a8101420 2024-09-15T22:24:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23ad581640 1 -- 172.21.15.45:0/1767216941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e5354a0 msgr2=0x55907e535880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23ad581640 1 --2- 172.21.15.45:0/1767216941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e5354a0 0x55907e535880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23ad581640 1 -- 172.21.15.45:0/1767216941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 msgr2=0x55907e540140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23ad581640 1 --2- 172.21.15.45:0/1767216941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e540140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23ad581640 1 -- 172.21.15.45:0/1767216941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55907e427440 con 0x55907e540680 2024-09-15T22:24:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23ae583640 1 --2- 172.21.15.45:0/1767216941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e5354a0 0x55907e535880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23add82640 1 --2- 172.21.15.45:0/1767216941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e540140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23ad581640 1 --2- 172.21.15.45:0/1767216941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e540680 0x55907e542a70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2398010fd0 tx=0x7f239800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f47b82bde2e84 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:30.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.472+0000 7f23ae583640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f23940a33b0 0x7f23940a5870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f23a0005fe0 tx=0x7f23a0005c30 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.473+0000 7f2393fff640 1 -- 172.21.15.45:0/1767216941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398020070 con 0x55907e540680 2024-09-15T22:24:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.473+0000 7f2393fff640 1 -- 172.21.15.45:0/1767216941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f23980a00b0 con 0x55907e540680 2024-09-15T22:24:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.473+0000 7f2393fff640 1 -- 172.21.15.45:0/1767216941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239809b350 con 0x55907e540680 2024-09-15T22:24:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.473+0000 7f23b23bf740 1 -- 172.21.15.45:0/1767216941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e540680 msgr2=0x55907e542a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.473+0000 7f23b23bf740 1 --2- 172.21.15.45:0/1767216941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e540680 0x55907e542a70 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2398010fd0 tx=0x7f239800bf60 comp rx=0 tx=0).stop 2024-09-15T22:24:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.473+0000 7f23b23bf740 1 -- 172.21.15.45:0/1767216941 shutdown_connections 2024-09-15T22:24:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.473+0000 7f23b23bf740 1 --2- 172.21.15.45:0/1767216941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e540680 0x55907e542a70 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.473+0000 7f23b23bf740 1 --2- 172.21.15.45:0/1767216941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e540140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.473+0000 7f23b23bf740 1 --2- 172.21.15.45:0/1767216941 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e5354a0 0x55907e535880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.473+0000 7f23b23bf740 1 -- 172.21.15.45:0/1767216941 >> 172.21.15.45:0/1767216941 conn(0x55907e531a30 msgr2=0x55907e531e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.473+0000 7f23b23bf740 1 -- 172.21.15.45:0/1767216941 shutdown_connections 2024-09-15T22:24:30.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.473+0000 7f23b23bf740 1 -- 172.21.15.45:0/1767216941 wait complete. 2024-09-15T22:24:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.474+0000 7f23b23bf740 1 -- start start 2024-09-15T22:24:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.474+0000 7f23b23bf740 1 Processor -- start 2024-09-15T22:24:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.474+0000 7f23b23bf740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e53ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.474+0000 7f23b23bf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e53d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.474+0000 7f23b23bf740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 0x55907e53d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.474+0000 7f23b23bf740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55907e5431f0 con 0x55907e5354a0 2024-09-15T22:24:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.474+0000 7f23b23bf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55907e456050 con 0x55907e535dc0 2024-09-15T22:24:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.474+0000 7f23b23bf740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55907e543370 con 0x55907e540680 2024-09-15T22:24:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.474+0000 7f23b23bf740 10 client.0 _ll_register_callbacks cb 0x55907e496160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.474+0000 7f23add82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e53ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23add82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e53ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36952/0 (socket says 172.21.15.45:36952) 2024-09-15T22:24:30.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23add82640 1 -- 172.21.15.45:0/3300194467 learned_addr learned my addr 172.21.15.45:0/3300194467 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23ad581640 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e53d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23ae583640 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 0x55907e53d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23add82640 1 -- 172.21.15.45:0/3300194467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 msgr2=0x55907e53d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23add82640 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 0x55907e53d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23add82640 1 -- 172.21.15.45:0/3300194467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 msgr2=0x55907e53d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23add82640 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e53d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23add82640 1 -- 172.21.15.45:0/3300194467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55907e20c3c0 con 0x55907e5354a0 2024-09-15T22:24:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23ad581640 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e53d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23add82640 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e53ffd0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f23a40107f0 tx=0x7f23a4010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c0d800ee48b34b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23917fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23917fa640 1 -- 172.21.15.45:0/3300194467 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a401d060 con 0x55907e5354a0 2024-09-15T22:24:30.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23b23bf740 1 -- 172.21.15.45:0/3300194467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23980a00b0 con 0x55907e5354a0 2024-09-15T22:24:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23917fa640 1 -- 172.21.15.45:0/3300194467 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f23a400eda0 con 0x55907e5354a0 2024-09-15T22:24:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23917fa640 1 -- 172.21.15.45:0/3300194467 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f23a4024050 con 0x55907e5354a0 2024-09-15T22:24:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23b23bf740 10 client.16731 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.475+0000 7f23b23bf740 1 -- 172.21.15.45:0/3300194467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55907e54eca0 con 0x55907e5354a0 2024-09-15T22:24:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.476+0000 7f23917fa640 1 -- 172.21.15.45:0/3300194467 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f23980a00b0 con 0x55907e5354a0 2024-09-15T22:24:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.476+0000 7f23917fa640 1 -- 172.21.15.45:0/3300194467 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f23a4016510 con 0x55907e5354a0 2024-09-15T22:24:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.476+0000 7f23b23bf740 10 client.16731 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.476+0000 7f23b23bf740 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.476+0000 7f23b23bf740 20 client.16731 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.476+0000 7f23b23bf740 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55907e5500b0 0x55907e5524c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.476+0000 7f23b23bf740 4 client.16731 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.476+0000 7f23b23bf740 1 -- 172.21.15.45:0/3300194467 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55907e4a8850 con 0x55907e5500b0 2024-09-15T22:24:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.476+0000 7f23ad581640 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55907e5500b0 0x55907e5524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.477+0000 7f23917fa640 10 client.16731 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:30.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.477+0000 7f23ad581640 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55907e5500b0 0x55907e5524c0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f88410116a859ff server_cookie=21b62b41f6cbab4f in_seq=0 out_seq=0 2024-09-15T22:24:30.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.477+0000 7f23917fa640 1 -- 172.21.15.45:0/3300194467 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55907e4a8850 con 0x55907e5500b0 2024-09-15T22:24:30.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.477+0000 7f23917fa640 10 client.16731 handle_command_reply: tid=0 2024-09-15T22:24:30.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.477+0000 7f23b23bf740 1 client.16731 shutdown 2024-09-15T22:24:30.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.477+0000 7f23b23bf740 1 -- 172.21.15.45:0/3300194467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 msgr2=0x55907e53ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:30.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.477+0000 7f23b23bf740 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e53ffd0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f23a40107f0 tx=0x7f23a4010cb0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.478+0000 7f23b23bf740 1 -- 172.21.15.45:0/3300194467 shutdown_connections 2024-09-15T22:24:30.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.478+0000 7f23b23bf740 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55907e5500b0 0x55907e5524c0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.478+0000 7f23b23bf740 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 0x55907e53d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.478+0000 7f23b23bf740 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e53d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.478+0000 7f23b23bf740 1 --2- 172.21.15.45:0/3300194467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e53ffd0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.478+0000 7f23b23bf740 1 -- 172.21.15.45:0/3300194467 >> 172.21.15.45:0/3300194467 conn(0x55907e531a30 msgr2=0x55907e537710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:30.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.478+0000 7f23917fa640 0 client.16731 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:30.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.478+0000 7f23b23bf740 1 -- 172.21.15.45:0/3300194467 shutdown_connections 2024-09-15T22:24:30.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.478+0000 7f23b23bf740 1 -- 172.21.15.45:0/3300194467 wait complete. 2024-09-15T22:24:30.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.478+0000 7f23b23bf740 20 client.16731 trim_cache size 0 max 16384 2024-09-15T22:24:30.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23b23bf740 1 Processor -- start 2024-09-15T22:24:30.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23b23bf740 1 -- start start 2024-09-15T22:24:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23b23bf740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e54c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23b23bf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e557d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23b23bf740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 0x55907e5582d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23b23bf740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f23a81ad2f0 con 0x55907e5354a0 2024-09-15T22:24:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23b23bf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23a81afb70 con 0x55907e535dc0 2024-09-15T22:24:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23b23bf740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f23a81ad960 con 0x55907e540680 2024-09-15T22:24:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23add82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e54c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23add82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e54c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36964/0 (socket says 172.21.15.45:36964) 2024-09-15T22:24:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23add82640 1 -- 172.21.15.45:0/594820727 learned_addr learned my addr 172.21.15.45:0/594820727 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:30.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23add82640 1 -- 172.21.15.45:0/594820727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 msgr2=0x55907e5582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23add82640 1 --2- 172.21.15.45:0/594820727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 0x55907e5582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23add82640 1 -- 172.21.15.45:0/594820727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 msgr2=0x55907e557d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23add82640 1 --2- 172.21.15.45:0/594820727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e557d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.496+0000 7f23add82640 1 -- 172.21.15.45:0/594820727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55907e542e10 con 0x55907e5354a0 2024-09-15T22:24:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.497+0000 7f23add82640 1 --2- 172.21.15.45:0/594820727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e54c480 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f23a40058e0 tx=0x7f23a40046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56526e39223c669e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.497+0000 7f23937fe640 1 -- 172.21.15.45:0/594820727 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4016d50 con 0x55907e5354a0 2024-09-15T22:24:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.497+0000 7f23937fe640 1 -- 172.21.15.45:0/594820727 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f23a4005d10 con 0x55907e5354a0 2024-09-15T22:24:30.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.497+0000 7f23937fe640 1 -- 172.21.15.45:0/594820727 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4028ad0 con 0x55907e5354a0 2024-09-15T22:24:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.497+0000 7f23b23bf740 1 -- 172.21.15.45:0/594820727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 msgr2=0x55907e54c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.497+0000 7f23b23bf740 1 --2- 172.21.15.45:0/594820727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e54c480 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f23a40058e0 tx=0x7f23a40046e0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.498+0000 7f23b23bf740 1 -- 172.21.15.45:0/594820727 shutdown_connections 2024-09-15T22:24:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.498+0000 7f23b23bf740 1 --2- 172.21.15.45:0/594820727 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 0x55907e5582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.498+0000 7f23b23bf740 1 --2- 172.21.15.45:0/594820727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e557d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.498+0000 7f23b23bf740 1 --2- 172.21.15.45:0/594820727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e54c480 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.498+0000 7f23b23bf740 1 -- 172.21.15.45:0/594820727 >> 172.21.15.45:0/594820727 conn(0x55907e531a30 msgr2=0x55907e53bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:30.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.498+0000 7f23b23bf740 1 -- 172.21.15.45:0/594820727 shutdown_connections 2024-09-15T22:24:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.498+0000 7f23b23bf740 1 -- 172.21.15.45:0/594820727 wait complete. 2024-09-15T22:24:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.498+0000 7f23b23bf740 1 -- start start 2024-09-15T22:24:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.498+0000 7f23b23bf740 1 Processor -- start 2024-09-15T22:24:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23b23bf740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e544650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23b23bf740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e544b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23b23bf740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 0x55907e545110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23b23bf740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f23a81ae030 con 0x55907e5354a0 2024-09-15T22:24:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23b23bf740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23a81af4a0 con 0x55907e535dc0 2024-09-15T22:24:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23b23bf740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f23a81ae700 con 0x55907e540680 2024-09-15T22:24:30.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23b23bf740 10 client.0 _ll_register_callbacks cb 0x7f23a400b650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23add82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e544650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23ad581640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e544b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23add82640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e544650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36972/0 (socket says 172.21.15.45:36972) 2024-09-15T22:24:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23add82640 1 -- 172.21.15.45:0/3354172453 learned_addr learned my addr 172.21.15.45:0/3354172453 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23ae583640 1 --2- 172.21.15.45:0/3354172453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 0x55907e545110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23add82640 1 -- 172.21.15.45:0/3354172453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 msgr2=0x55907e545110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23add82640 1 --2- 172.21.15.45:0/3354172453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 0x55907e545110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23add82640 1 -- 172.21.15.45:0/3354172453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 msgr2=0x55907e544b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23add82640 1 --2- 172.21.15.45:0/3354172453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e544b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23add82640 1 -- 172.21.15.45:0/3354172453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55907e5ba050 con 0x55907e5354a0 2024-09-15T22:24:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23ad581640 1 --2- 172.21.15.45:0/3354172453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e544b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:30.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23add82640 1 --2- 172.21.15.45:0/3354172453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e544650 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f23a4005f20 tx=0x7f23a400e800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30a49cb04befa85 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23917fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23917fa640 1 -- 172.21.15.45:0/3354172453 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4016cd0 con 0x55907e5354a0 2024-09-15T22:24:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.499+0000 7f23917fa640 1 -- 172.21.15.45:0/3354172453 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f23a4016330 con 0x55907e5354a0 2024-09-15T22:24:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.500+0000 7f23b23bf740 1 -- 172.21.15.45:0/3354172453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23a4005d10 con 0x55907e5354a0 2024-09-15T22:24:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.500+0000 7f23917fa640 1 -- 172.21.15.45:0/3354172453 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f23a4016530 con 0x55907e5354a0 2024-09-15T22:24:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.500+0000 7f23b23bf740 10 client.16737 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.500+0000 7f23b23bf740 1 -- 172.21.15.45:0/3354172453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55907e5bb360 con 0x55907e5354a0 2024-09-15T22:24:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.500+0000 7f23917fa640 1 -- 172.21.15.45:0/3354172453 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f23a4005d10 con 0x55907e5354a0 2024-09-15T22:24:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.500+0000 7f23917fa640 1 -- 172.21.15.45:0/3354172453 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f23a4004b60 con 0x55907e5354a0 2024-09-15T22:24:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.500+0000 7f23b23bf740 10 client.16737 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:30.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.500+0000 7f23b23bf740 10 client.16737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.500+0000 7f23b23bf740 20 client.16737 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.500+0000 7f23b23bf740 1 --2- 172.21.15.45:0/3354172453 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55907e5bb960 0x55907e5bdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.500+0000 7f23b23bf740 4 client.16737 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:24:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.500+0000 7f23b23bf740 1 -- 172.21.15.45:0/3354172453 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55907e4a2d60 con 0x55907e5bb960 2024-09-15T22:24:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23ad581640 1 --2- 172.21.15.45:0/3354172453 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55907e5bb960 0x55907e5bdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23ad581640 1 --2- 172.21.15.45:0/3354172453 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55907e5bb960 0x55907e5bdd50 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbd4d5afb4e2a954 server_cookie=6e7dd9c4d6d27b87 in_seq=0 out_seq=0 2024-09-15T22:24:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23917fa640 10 client.16737 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23917fa640 1 -- 172.21.15.45:0/3354172453 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55907e4a2d60 con 0x55907e5bb960 2024-09-15T22:24:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23917fa640 10 client.16737 handle_command_reply: tid=0 2024-09-15T22:24:30.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23b23bf740 1 client.16737 shutdown 2024-09-15T22:24:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23b23bf740 1 -- 172.21.15.45:0/3354172453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 msgr2=0x55907e544650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23b23bf740 1 --2- 172.21.15.45:0/3354172453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e544650 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f23a4005f20 tx=0x7f23a400e800 comp rx=0 tx=0).stop 2024-09-15T22:24:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23b23bf740 1 -- 172.21.15.45:0/3354172453 shutdown_connections 2024-09-15T22:24:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23b23bf740 1 --2- 172.21.15.45:0/3354172453 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55907e5bb960 0x55907e5bdd50 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23b23bf740 1 --2- 172.21.15.45:0/3354172453 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55907e540680 0x55907e545110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23b23bf740 1 --2- 172.21.15.45:0/3354172453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55907e535dc0 0x55907e544b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23917fa640 0 client.16737 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23b23bf740 1 --2- 172.21.15.45:0/3354172453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55907e5354a0 0x55907e544650 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.501+0000 7f23b23bf740 1 -- 172.21.15.45:0/3354172453 >> 172.21.15.45:0/3354172453 conn(0x55907e531a30 msgr2=0x55907e530b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.502+0000 7f23b23bf740 1 -- 172.21.15.45:0/3354172453 shutdown_connections 2024-09-15T22:24:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.502+0000 7f23b23bf740 1 -- 172.21.15.45:0/3354172453 wait complete. 2024-09-15T22:24:30.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.502+0000 7f23b23bf740 20 client.16737 trim_cache size 0 max 16384 2024-09-15T22:24:30.519 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:24:30.519 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:24:30.519 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:24:30.519 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:24:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.502+0000 7f23affe6640 1 -- 172.21.15.45:0/4146170561 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f23940a33b0 msgr2=0x7f23940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.502+0000 7f23affe6640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f23940a33b0 0x7f23940a5870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f23a0005fe0 tx=0x7f23a0005c30 comp rx=0 tx=0).stop 2024-09-15T22:24:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.502+0000 7f23affe6640 1 -- 172.21.15.45:0/4146170561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a8101420 msgr2=0x7f23a8199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.502+0000 7f23affe6640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a8101420 0x7f23a8199890 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f239800d950 tx=0x7f239800de10 comp rx=0 tx=0).stop 2024-09-15T22:24:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.502+0000 7f23affe6640 1 -- 172.21.15.45:0/4146170561 shutdown_connections 2024-09-15T22:24:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.502+0000 7f23affe6640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f23940a33b0 0x7f23940a5870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.502+0000 7f23affe6640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23a8106a80 0x7f23a81a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.502+0000 7f23affe6640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23a8101420 0x7f23a8199890 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.502+0000 7f23affe6640 1 --2- 172.21.15.45:0/4146170561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23a8100a80 0x7f23a8199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:30.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.502+0000 7f23affe6640 1 -- 172.21.15.45:0/4146170561 >> 172.21.15.45:0/4146170561 conn(0x7f23a80fc7a0 msgr2=0x7f23a80fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:30.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.503+0000 7f23affe6640 1 -- 172.21.15.45:0/4146170561 shutdown_connections 2024-09-15T22:24:30.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:30.503+0000 7f23affe6640 1 -- 172.21.15.45:0/4146170561 wait complete. 2024-09-15T22:24:31.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:30 smithi165 ceph-mon[35551]: pgmap v255: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:24:31.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:30 smithi100 ceph-mon[35319]: pgmap v255: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:24:31.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:30 smithi045 ceph-mon[31180]: pgmap v255: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:24:31.573 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:24:31.573 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:24:31.837 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:32.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.443+0000 7f10dcaf4640 1 -- 172.21.15.45:0/594160244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d8100e20 msgr2=0x7f10d8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.443+0000 7f10dcaf4640 1 --2- 172.21.15.45:0/594160244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d8100e20 0x7f10d8101200 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009900 tx=0x7f10c802a480 comp rx=0 tx=0).stop 2024-09-15T22:24:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.443+0000 7f10dcaf4640 1 -- 172.21.15.45:0/594160244 shutdown_connections 2024-09-15T22:24:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.443+0000 7f10dcaf4640 1 --2- 172.21.15.45:0/594160244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10d8102ef0 0x7f10d810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.443+0000 7f10dcaf4640 1 --2- 172.21.15.45:0/594160244 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10d8102570 0x7f10d81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.443+0000 7f10dcaf4640 1 --2- 172.21.15.45:0/594160244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d8100e20 0x7f10d8101200 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.443+0000 7f10dcaf4640 1 -- 172.21.15.45:0/594160244 >> 172.21.15.45:0/594160244 conn(0x7f10d80fc7d0 msgr2=0x7f10d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.443+0000 7f10dcaf4640 1 -- 172.21.15.45:0/594160244 shutdown_connections 2024-09-15T22:24:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.443+0000 7f10dcaf4640 1 -- 172.21.15.45:0/594160244 wait complete. 2024-09-15T22:24:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.444+0000 7f10dcaf4640 1 Processor -- start 2024-09-15T22:24:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.444+0000 7f10dcaf4640 1 -- start start 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.444+0000 7f10dcaf4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10d8100e20 0x7f10d8198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.444+0000 7f10dcaf4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10d8102570 0x7f10d8198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.444+0000 7f10dcaf4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d8102ef0 0x7f10d819cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.444+0000 7f10dcaf4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f10d8111160 con 0x7f10d8102ef0 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.444+0000 7f10dcaf4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f10d8110fe0 con 0x7f10d8100e20 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.444+0000 7f10dcaf4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10d81112e0 con 0x7f10d8102570 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10d6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d8102ef0 0x7f10d819cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10d6d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d8102ef0 0x7f10d819cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37002/0 (socket says 172.21.15.45:37002) 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10d6d9d640 1 -- 172.21.15.45:0/2828835271 learned_addr learned my addr 172.21.15.45:0/2828835271 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10cffff640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10d8102570 0x7f10d8198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10d659c640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10d8100e20 0x7f10d8198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10d6d9d640 1 -- 172.21.15.45:0/2828835271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10d8102570 msgr2=0x7f10d8198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10d6d9d640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10d8102570 0x7f10d8198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:32.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10d6d9d640 1 -- 172.21.15.45:0/2828835271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10d8100e20 msgr2=0x7f10d8198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10d6d9d640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10d8100e20 0x7f10d8198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10d6d9d640 1 -- 172.21.15.45:0/2828835271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d819d6c0 con 0x7f10d8102ef0 2024-09-15T22:24:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10d6d9d640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d8102ef0 0x7f10d819cfe0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f10d000b970 tx=0x7f10d000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10cf7fe640 1 -- 172.21.15.45:0/2828835271 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0019070 con 0x7f10d8102ef0 2024-09-15T22:24:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10dcaf4640 1 -- 172.21.15.45:0/2828835271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d819d9b0 con 0x7f10d8102ef0 2024-09-15T22:24:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10cf7fe640 1 -- 172.21.15.45:0/2828835271 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f10d0014440 con 0x7f10d8102ef0 2024-09-15T22:24:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10cf7fe640 1 -- 172.21.15.45:0/2828835271 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d00075d0 con 0x7f10d8102ef0 2024-09-15T22:24:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.445+0000 7f10dcaf4640 1 -- 172.21.15.45:0/2828835271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d81a5290 con 0x7f10d8102ef0 2024-09-15T22:24:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.447+0000 7f10dcaf4640 1 -- 172.21.15.45:0/2828835271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d8101200 con 0x7f10d8102ef0 2024-09-15T22:24:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.448+0000 7f10cf7fe640 1 -- 172.21.15.45:0/2828835271 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f10d001c070 con 0x7f10d8102ef0 2024-09-15T22:24:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.448+0000 7f10cf7fe640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10c40a33b0 0x7f10c40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.448+0000 7f10d659c640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10c40a33b0 0x7f10c40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.449+0000 7f10cf7fe640 1 -- 172.21.15.45:0/2828835271 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f10d00cf530 con 0x7f10d8102ef0 2024-09-15T22:24:32.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.449+0000 7f10d659c640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10c40a33b0 0x7f10c40a5870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009230 tx=0x7f10c80058d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:32.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.453+0000 7f10cf7fe640 1 -- 172.21.15.45:0/2828835271 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f10d009b5c0 con 0x7f10d8102ef0 2024-09-15T22:24:32.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.700+0000 7f10dcaf4640 1 -- 172.21.15.45:0/2828835271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10d810a0a0 con 0x7f10d8102ef0 2024-09-15T22:24:32.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.701+0000 7f10cf7fe640 1 -- 172.21.15.45:0/2828835271 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f10d009f8c0 con 0x7f10d8102ef0 2024-09-15T22:24:32.703 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:24:32.704 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:24:32.704 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:24:32.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.704+0000 7f10dcaf4640 1 -- 172.21.15.45:0/2828835271 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10c40a33b0 msgr2=0x7f10c40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:32.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.704+0000 7f10dcaf4640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10c40a33b0 0x7f10c40a5870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009230 tx=0x7f10c80058d0 comp rx=0 tx=0).stop 2024-09-15T22:24:32.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.704+0000 7f10dcaf4640 1 -- 172.21.15.45:0/2828835271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d8102ef0 msgr2=0x7f10d819cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:32.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.704+0000 7f10dcaf4640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d8102ef0 0x7f10d819cfe0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f10d000b970 tx=0x7f10d000bd70 comp rx=0 tx=0).stop 2024-09-15T22:24:32.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.704+0000 7f10dcaf4640 1 -- 172.21.15.45:0/2828835271 shutdown_connections 2024-09-15T22:24:32.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.704+0000 7f10dcaf4640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10c40a33b0 0x7f10c40a5870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:32.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.704+0000 7f10dcaf4640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10d8102ef0 0x7f10d819cfe0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.704+0000 7f10dcaf4640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10d8102570 0x7f10d8198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.704+0000 7f10dcaf4640 1 --2- 172.21.15.45:0/2828835271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10d8100e20 0x7f10d8198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.704+0000 7f10dcaf4640 1 -- 172.21.15.45:0/2828835271 >> 172.21.15.45:0/2828835271 conn(0x7f10d80fc7d0 msgr2=0x7f10d806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.704+0000 7f10dcaf4640 1 -- 172.21.15.45:0/2828835271 shutdown_connections 2024-09-15T22:24:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:32.704+0000 7f10dcaf4640 1 -- 172.21.15.45:0/2828835271 wait complete. 2024-09-15T22:24:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:32 smithi045 ceph-mon[31180]: pgmap v256: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:24:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:32 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:32 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:32 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:32 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:24:33.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:32 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2828835271' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:32 smithi165 ceph-mon[35551]: pgmap v256: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:24:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:32 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:32 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:32 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:32 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:24:33.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:32 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2828835271' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:32 smithi100 ceph-mon[35319]: pgmap v256: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:24:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:32 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:24:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:32 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:24:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:32 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:24:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:32 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:24:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:32 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2828835271' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:33.418 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:24:33.681 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:34.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.177+0000 7f2d2ebd0640 1 -- 172.21.15.45:0/1416565975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d28102de0 msgr2=0x7f2d281031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.177+0000 7f2d2ebd0640 1 --2- 172.21.15.45:0/1416565975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d28102de0 0x7f2d281031c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009900 tx=0x7f2d1c02a480 comp rx=0 tx=0).stop 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.177+0000 7f2d2ebd0640 1 -- 172.21.15.45:0/1416565975 shutdown_connections 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.177+0000 7f2d2ebd0640 1 --2- 172.21.15.45:0/1416565975 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d2810c180 0x7f2d2810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.177+0000 7f2d2ebd0640 1 --2- 172.21.15.45:0/1416565975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d28103700 0x7f2d2810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.177+0000 7f2d2ebd0640 1 --2- 172.21.15.45:0/1416565975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d28102de0 0x7f2d281031c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.177+0000 7f2d2ebd0640 1 -- 172.21.15.45:0/1416565975 >> 172.21.15.45:0/1416565975 conn(0x7f2d280fc7a0 msgr2=0x7f2d280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.177+0000 7f2d2ebd0640 1 -- 172.21.15.45:0/1416565975 shutdown_connections 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.177+0000 7f2d2ebd0640 1 -- 172.21.15.45:0/1416565975 wait complete. 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.178+0000 7f2d2ebd0640 1 Processor -- start 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.178+0000 7f2d2ebd0640 1 -- start start 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.178+0000 7f2d2ebd0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d28102de0 0x7f2d2819a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.178+0000 7f2d2ebd0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d28103700 0x7f2d2819ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.178+0000 7f2d2ebd0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d2810c180 0x7f2d2819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.178+0000 7f2d2ebd0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2d28112090 con 0x7f2d2810c180 2024-09-15T22:24:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.178+0000 7f2d2ebd0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d28111f10 con 0x7f2d28102de0 2024-09-15T22:24:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.178+0000 7f2d2ebd0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d28112210 con 0x7f2d28103700 2024-09-15T22:24:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.178+0000 7f2d2d16d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d2810c180 0x7f2d2819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.178+0000 7f2d2d16d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d2810c180 0x7f2d2819efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37028/0 (socket says 172.21.15.45:37028) 2024-09-15T22:24:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.178+0000 7f2d2d16d640 1 -- 172.21.15.45:0/3042478492 learned_addr learned my addr 172.21.15.45:0/3042478492 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.178+0000 7f2d2c96c640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d28102de0 0x7f2d2819a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.179+0000 7f2d27fff640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d28103700 0x7f2d2819ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.179+0000 7f2d2d16d640 1 -- 172.21.15.45:0/3042478492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d28103700 msgr2=0x7f2d2819ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.179+0000 7f2d2d16d640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d28103700 0x7f2d2819ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.179+0000 7f2d2d16d640 1 -- 172.21.15.45:0/3042478492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d28102de0 msgr2=0x7f2d2819a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.179+0000 7f2d2d16d640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d28102de0 0x7f2d2819a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.179+0000 7f2d2d16d640 1 -- 172.21.15.45:0/3042478492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2819f6c0 con 0x7f2d2810c180 2024-09-15T22:24:34.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.179+0000 7f2d27fff640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d28103700 0x7f2d2819ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.179+0000 7f2d2d16d640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d2810c180 0x7f2d2819efe0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000cad0 tx=0x7f2d2000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.179+0000 7f2d25ffb640 1 -- 172.21.15.45:0/3042478492 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000ae20 con 0x7f2d2810c180 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.179+0000 7f2d2ebd0640 1 -- 172.21.15.45:0/3042478492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2819f9b0 con 0x7f2d2810c180 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.179+0000 7f2d25ffb640 1 -- 172.21.15.45:0/3042478492 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d20004b20 con 0x7f2d2810c180 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.179+0000 7f2d25ffb640 1 -- 172.21.15.45:0/3042478492 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000f780 con 0x7f2d2810c180 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.179+0000 7f2d2ebd0640 1 -- 172.21.15.45:0/3042478492 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d281a7290 con 0x7f2d2810c180 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d25ffb640 1 -- 172.21.15.45:0/3042478492 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2d20004cd0 con 0x7f2d2810c180 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d30fa9740 1 Processor -- start 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d30fa9740 1 -- start start 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d30fa9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56226806db40 0x56226806c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d30fa9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806c5d0 0x56226806ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d30fa9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 0x562268079760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d30fa9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x562267fd22f0 con 0x562268077370 2024-09-15T22:24:34.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d30fa9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562267f79cf0 con 0x56226806db40 2024-09-15T22:24:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d30fa9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562267fce2b0 con 0x56226806c5d0 2024-09-15T22:24:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 0x562268079760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 0x562268079760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37042/0 (socket says 172.21.15.45:37042) 2024-09-15T22:24:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d27fff640 1 -- 172.21.15.45:0/3248277775 learned_addr learned my addr 172.21.15.45:0/3248277775 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d25ffb640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d180a33b0 0x7f2d180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d2c96c640 1 --2- 172.21.15.45:0/3248277775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806c5d0 0x56226806ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d27fff640 1 --2- 172.21.15.45:0/3248277775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56226806db40 0x56226806c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.182+0000 7f2d2d16d640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d180a33b0 0x7f2d180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.183+0000 7f2d27fff640 1 -- 172.21.15.45:0/3248277775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806c5d0 msgr2=0x56226806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.183+0000 7f2d27fff640 1 --2- 172.21.15.45:0/3248277775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806c5d0 0x56226806ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.183+0000 7f2d25ffb640 1 -- 172.21.15.45:0/3042478492 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f2d200d0150 con 0x7f2d2810c180 2024-09-15T22:24:34.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.183+0000 7f2d27fff640 1 -- 172.21.15.45:0/3248277775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56226806db40 msgr2=0x56226806c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.183+0000 7f2d27fff640 1 --2- 172.21.15.45:0/3248277775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56226806db40 0x56226806c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.183+0000 7f2d27fff640 1 -- 172.21.15.45:0/3248277775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562267f5e3a0 con 0x562268077370 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.183+0000 7f2d27fff640 1 --2- 172.21.15.45:0/3248277775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 0x562268079760 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400bfa0 tx=0x7f2d1400b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7529f961d8c0fcc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.183+0000 7f2d12ffd640 1 -- 172.21.15.45:0/3248277775 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14019070 con 0x562268077370 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.183+0000 7f2d12ffd640 1 -- 172.21.15.45:0/3248277775 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d140047a0 con 0x562268077370 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.183+0000 7f2d12ffd640 1 -- 172.21.15.45:0/3248277775 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d140118a0 con 0x562268077370 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.184+0000 7f2d30fa9740 1 -- 172.21.15.45:0/3248277775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 msgr2=0x562268079760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.184+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/3248277775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 0x562268079760 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400bfa0 tx=0x7f2d1400b720 comp rx=0 tx=0).stop 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.184+0000 7f2d2d16d640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d180a33b0 0x7f2d180a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d200a4760 tx=0x7f2d200bc040 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.184+0000 7f2d30fa9740 1 -- 172.21.15.45:0/3248277775 shutdown_connections 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.184+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/3248277775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 0x562268079760 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.184+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/3248277775 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806c5d0 0x56226806ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.184+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/3248277775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56226806db40 0x56226806c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.184+0000 7f2d30fa9740 1 -- 172.21.15.45:0/3248277775 >> 172.21.15.45:0/3248277775 conn(0x562268035310 msgr2=0x562268068c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.184+0000 7f2d30fa9740 1 -- 172.21.15.45:0/3248277775 shutdown_connections 2024-09-15T22:24:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.184+0000 7f2d30fa9740 1 -- 172.21.15.45:0/3248277775 wait complete. 2024-09-15T22:24:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.184+0000 7f2d30fa9740 1 -- start start 2024-09-15T22:24:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.184+0000 7f2d30fa9740 1 Processor -- start 2024-09-15T22:24:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d30fa9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 0x562268076d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d30fa9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806db40 0x562268074030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d30fa9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562268077370 0x562268074640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d30fa9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56226807a070 con 0x56226806c5d0 2024-09-15T22:24:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d30fa9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562267f8d060 con 0x562268077370 2024-09-15T22:24:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d30fa9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56226807a1f0 con 0x56226806db40 2024-09-15T22:24:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d30fa9740 10 client.0 _ll_register_callbacks cb 0x562267ce08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 0x562268076d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 0x562268076d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37054/0 (socket says 172.21.15.45:37054) 2024-09-15T22:24:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d27fff640 1 -- 172.21.15.45:0/3286092490 learned_addr learned my addr 172.21.15.45:0/3286092490 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d27fff640 1 --2- 172.21.15.45:0/3286092490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562268077370 0x562268074640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d2c96c640 1 --2- 172.21.15.45:0/3286092490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806db40 0x562268074030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d27fff640 1 -- 172.21.15.45:0/3286092490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806db40 msgr2=0x562268074030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d27fff640 1 --2- 172.21.15.45:0/3286092490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806db40 0x562268074030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d27fff640 1 -- 172.21.15.45:0/3286092490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562268077370 msgr2=0x562268074640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d27fff640 1 --2- 172.21.15.45:0/3286092490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562268077370 0x562268074640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d27fff640 1 -- 172.21.15.45:0/3286092490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562267d433c0 con 0x56226806c5d0 2024-09-15T22:24:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d27fff640 1 --2- 172.21.15.45:0/3286092490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 0x562268076d80 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2d14005970 tx=0x7f2d14011520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72ce044e9bff29f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d07fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d07fff640 1 -- 172.21.15.45:0/3286092490 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14019040 con 0x56226806c5d0 2024-09-15T22:24:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d30fa9740 1 -- 172.21.15.45:0/3286092490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d140047a0 con 0x56226806c5d0 2024-09-15T22:24:34.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.185+0000 7f2d07fff640 1 -- 172.21.15.45:0/3286092490 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f2d14004030 con 0x56226806c5d0 2024-09-15T22:24:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.186+0000 7f2d07fff640 1 -- 172.21.15.45:0/3286092490 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2d14031050 con 0x56226806c5d0 2024-09-15T22:24:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.186+0000 7f2d30fa9740 10 client.16755 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.186+0000 7f2d30fa9740 1 -- 172.21.15.45:0/3286092490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562268085b40 con 0x56226806c5d0 2024-09-15T22:24:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.186+0000 7f2d07fff640 1 -- 172.21.15.45:0/3286092490 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d140047a0 con 0x56226806c5d0 2024-09-15T22:24:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.186+0000 7f2d07fff640 1 -- 172.21.15.45:0/3286092490 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2d14011620 con 0x56226806c5d0 2024-09-15T22:24:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.186+0000 7f2d30fa9740 10 client.16755 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.186+0000 7f2d30fa9740 10 client.16755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.186+0000 7f2d30fa9740 20 client.16755 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.186+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/3286092490 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562268086fa0 0x562268089390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.186+0000 7f2d30fa9740 4 client.16755 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.186+0000 7f2d30fa9740 1 -- 172.21.15.45:0/3286092490 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562267fdf860 con 0x562268086fa0 2024-09-15T22:24:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.186+0000 7f2d2c96c640 1 --2- 172.21.15.45:0/3286092490 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562268086fa0 0x562268089390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.187+0000 7f2d07fff640 10 client.16755 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.187+0000 7f2d2c96c640 1 --2- 172.21.15.45:0/3286092490 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562268086fa0 0x562268089390 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c6aded386ec5b17 server_cookie=8819148f2cc7757b in_seq=0 out_seq=0 2024-09-15T22:24:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.187+0000 7f2d07fff640 1 -- 172.21.15.45:0/3286092490 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562267fdf860 con 0x562268086fa0 2024-09-15T22:24:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.187+0000 7f2d07fff640 10 client.16755 handle_command_reply: tid=0 2024-09-15T22:24:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.188+0000 7f2d30fa9740 1 client.16755 shutdown 2024-09-15T22:24:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.188+0000 7f2d30fa9740 1 -- 172.21.15.45:0/3286092490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 msgr2=0x562268076d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.188+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/3286092490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 0x562268076d80 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f2d14005970 tx=0x7f2d14011520 comp rx=0 tx=0).stop 2024-09-15T22:24:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.188+0000 7f2d30fa9740 1 -- 172.21.15.45:0/3286092490 shutdown_connections 2024-09-15T22:24:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.188+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/3286092490 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562268086fa0 0x562268089390 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.188+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/3286092490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562268077370 0x562268074640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.188+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/3286092490 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806db40 0x562268074030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.188+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/3286092490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 0x562268076d80 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.188+0000 7f2d07fff640 0 client.16755 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.188+0000 7f2d30fa9740 1 -- 172.21.15.45:0/3286092490 >> 172.21.15.45:0/3286092490 conn(0x562268035310 msgr2=0x56226806e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.188+0000 7f2d30fa9740 1 -- 172.21.15.45:0/3286092490 shutdown_connections 2024-09-15T22:24:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.188+0000 7f2d30fa9740 1 -- 172.21.15.45:0/3286092490 wait complete. 2024-09-15T22:24:34.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.188+0000 7f2d30fa9740 20 client.16755 trim_cache size 0 max 16384 2024-09-15T22:24:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.201+0000 7f2d30fa9740 1 Processor -- start 2024-09-15T22:24:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.201+0000 7f2d30fa9740 1 -- start start 2024-09-15T22:24:34.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.201+0000 7f2d30fa9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 0x562268068df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.201+0000 7f2d30fa9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806db40 0x562268083310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.201+0000 7f2d30fa9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562268077370 0x562268073030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.201+0000 7f2d30fa9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281af500 con 0x56226806c5d0 2024-09-15T22:24:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.201+0000 7f2d30fa9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281b1d80 con 0x562268077370 2024-09-15T22:24:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.201+0000 7f2d30fa9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281afb70 con 0x56226806db40 2024-09-15T22:24:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.201+0000 7f2d27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 0x562268068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.201+0000 7f2d27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 0x562268068df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44184/0 (socket says 172.21.15.45:44184) 2024-09-15T22:24:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.201+0000 7f2d27fff640 1 -- 172.21.15.45:0/2963294965 learned_addr learned my addr 172.21.15.45:0/2963294965 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.202+0000 7f2d2c96c640 1 --2- 172.21.15.45:0/2963294965 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806db40 0x562268083310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.202+0000 7f2d27fff640 1 --2- 172.21.15.45:0/2963294965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562268077370 0x562268073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.202+0000 7f2d27fff640 1 -- 172.21.15.45:0/2963294965 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806db40 msgr2=0x562268083310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:34.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.202+0000 7f2d27fff640 1 --2- 172.21.15.45:0/2963294965 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806db40 0x562268083310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.202+0000 7f2d27fff640 1 -- 172.21.15.45:0/2963294965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562268077370 msgr2=0x562268073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.202+0000 7f2d27fff640 1 --2- 172.21.15.45:0/2963294965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562268077370 0x562268073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.202+0000 7f2d27fff640 1 -- 172.21.15.45:0/2963294965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56226806f120 con 0x56226806c5d0 2024-09-15T22:24:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.202+0000 7f2d27fff640 1 --2- 172.21.15.45:0/2963294965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 0x562268068df0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2d14013660 tx=0x7f2d14004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fecb8d67d04ec8e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.202+0000 7f2d127fc640 1 -- 172.21.15.45:0/2963294965 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14019040 con 0x56226806c5d0 2024-09-15T22:24:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.202+0000 7f2d127fc640 1 -- 172.21.15.45:0/2963294965 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d1400b480 con 0x56226806c5d0 2024-09-15T22:24:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.202+0000 7f2d127fc640 1 -- 172.21.15.45:0/2963294965 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d140035f0 con 0x56226806c5d0 2024-09-15T22:24:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.203+0000 7f2d30fa9740 1 -- 172.21.15.45:0/2963294965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 msgr2=0x562268068df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.203+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/2963294965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 0x562268068df0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f2d14013660 tx=0x7f2d14004e30 comp rx=0 tx=0).stop 2024-09-15T22:24:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.203+0000 7f2d30fa9740 1 -- 172.21.15.45:0/2963294965 shutdown_connections 2024-09-15T22:24:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.203+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/2963294965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562268077370 0x562268073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.203+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/2963294965 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806db40 0x562268083310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.203+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/2963294965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56226806c5d0 0x562268068df0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.203+0000 7f2d30fa9740 1 -- 172.21.15.45:0/2963294965 >> 172.21.15.45:0/2963294965 conn(0x562268035310 msgr2=0x562268072920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.203+0000 7f2d30fa9740 1 -- 172.21.15.45:0/2963294965 shutdown_connections 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.203+0000 7f2d30fa9740 1 -- 172.21.15.45:0/2963294965 wait complete. 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.203+0000 7f2d30fa9740 1 -- start start 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d30fa9740 1 Processor -- start 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d30fa9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806c5d0 0x56226807f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d30fa9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56226806db40 0x56226807fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d30fa9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 0x562268070860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d30fa9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281b0240 con 0x562268077370 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d30fa9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281b16b0 con 0x56226806db40 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d30fa9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2d281b0910 con 0x56226806c5d0 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d30fa9740 10 client.0 _ll_register_callbacks cb 0x7f2d140134f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 0x562268070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 0x562268070860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44192/0 (socket says 172.21.15.45:44192) 2024-09-15T22:24:34.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d27fff640 1 -- 172.21.15.45:0/2308343506 learned_addr learned my addr 172.21.15.45:0/2308343506 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d27fff640 1 --2- 172.21.15.45:0/2308343506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806c5d0 0x56226807f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d2c96c640 1 --2- 172.21.15.45:0/2308343506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56226806db40 0x56226807fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d27fff640 1 -- 172.21.15.45:0/2308343506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806c5d0 msgr2=0x56226807f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d27fff640 1 --2- 172.21.15.45:0/2308343506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806c5d0 0x56226807f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d27fff640 1 -- 172.21.15.45:0/2308343506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56226806db40 msgr2=0x56226807fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.204+0000 7f2d27fff640 1 --2- 172.21.15.45:0/2308343506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56226806db40 0x56226807fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d27fff640 1 -- 172.21.15.45:0/2308343506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562268070f70 con 0x562268077370 2024-09-15T22:24:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d27fff640 1 --2- 172.21.15.45:0/2308343506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 0x562268070860 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2d140059f0 tx=0x7f2d14015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e6e8b07bd5558e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d07fff640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d07fff640 1 -- 172.21.15.45:0/2308343506 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d14011c60 con 0x562268077370 2024-09-15T22:24:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d07fff640 1 -- 172.21.15.45:0/2308343506 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f2d14011520 con 0x562268077370 2024-09-15T22:24:34.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d30fa9740 1 -- 172.21.15.45:0/2308343506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d1400b480 con 0x562268077370 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d07fff640 1 -- 172.21.15.45:0/2308343506 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2d14004020 con 0x562268077370 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d30fa9740 10 client.16761 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d30fa9740 1 -- 172.21.15.45:0/2308343506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5622680f1440 con 0x562268077370 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d07fff640 1 -- 172.21.15.45:0/2308343506 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d1400b480 con 0x562268077370 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d07fff640 1 -- 172.21.15.45:0/2308343506 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2d14003bb0 con 0x562268077370 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d30fa9740 10 client.16761 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d30fa9740 10 client.16761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d30fa9740 20 client.16761 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.205+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/2308343506 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5622680f1aa0 0x5622680f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d30fa9740 4 client.16761 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d30fa9740 1 -- 172.21.15.45:0/2308343506 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562267fd9d70 con 0x5622680f1aa0 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d2c96c640 1 --2- 172.21.15.45:0/2308343506 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5622680f1aa0 0x5622680f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d2c96c640 1 --2- 172.21.15.45:0/2308343506 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5622680f1aa0 0x5622680f3e90 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96e66bb107b91a7e server_cookie=5ad6346c5ec010a3 in_seq=0 out_seq=0 2024-09-15T22:24:34.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d07fff640 10 client.16761 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d07fff640 1 -- 172.21.15.45:0/2308343506 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562267fd9d70 con 0x5622680f1aa0 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d07fff640 10 client.16761 handle_command_reply: tid=0 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d30fa9740 1 client.16761 shutdown 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d30fa9740 1 -- 172.21.15.45:0/2308343506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 msgr2=0x562268070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/2308343506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 0x562268070860 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2d140059f0 tx=0x7f2d14015040 comp rx=0 tx=0).stop 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d30fa9740 1 -- 172.21.15.45:0/2308343506 shutdown_connections 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/2308343506 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5622680f1aa0 0x5622680f3e90 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/2308343506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562268077370 0x562268070860 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/2308343506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56226806db40 0x56226807fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.206+0000 7f2d30fa9740 1 --2- 172.21.15.45:0/2308343506 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x56226806c5d0 0x56226807f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d30fa9740 1 -- 172.21.15.45:0/2308343506 >> 172.21.15.45:0/2308343506 conn(0x562268035310 msgr2=0x562268073140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d07fff640 0 client.16761 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d30fa9740 1 -- 172.21.15.45:0/2308343506 shutdown_connections 2024-09-15T22:24:34.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d30fa9740 1 -- 172.21.15.45:0/2308343506 wait complete. 2024-09-15T22:24:34.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d30fa9740 20 client.16761 trim_cache size 0 max 16384 2024-09-15T22:24:34.222 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:24:34.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d2ebd0640 1 -- 172.21.15.45:0/3042478492 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d180a33b0 msgr2=0x7f2d180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d2ebd0640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d180a33b0 0x7f2d180a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2d200a4760 tx=0x7f2d200bc040 comp rx=0 tx=0).stop 2024-09-15T22:24:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d2ebd0640 1 -- 172.21.15.45:0/3042478492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d2810c180 msgr2=0x7f2d2819efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d2ebd0640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d2810c180 0x7f2d2819efe0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000cad0 tx=0x7f2d2000cf90 comp rx=0 tx=0).stop 2024-09-15T22:24:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d2ebd0640 1 -- 172.21.15.45:0/3042478492 shutdown_connections 2024-09-15T22:24:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d2ebd0640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f2d180a33b0 0x7f2d180a5870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d2ebd0640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d2810c180 0x7f2d2819efe0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d2ebd0640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2d28103700 0x7f2d2819ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d2ebd0640 1 --2- 172.21.15.45:0/3042478492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2d28102de0 0x7f2d2819a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d2ebd0640 1 -- 172.21.15.45:0/3042478492 >> 172.21.15.45:0/3042478492 conn(0x7f2d280fc7a0 msgr2=0x7f2d28100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d2ebd0640 1 -- 172.21.15.45:0/3042478492 shutdown_connections 2024-09-15T22:24:34.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:34.207+0000 7f2d2ebd0640 1 -- 172.21.15.45:0/3042478492 wait complete. 2024-09-15T22:24:35.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:34 smithi165 ceph-mon[35551]: pgmap v257: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:24:35.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:34 smithi100 ceph-mon[35319]: pgmap v257: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:24:35.299 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:34 smithi045 ceph-mon[31180]: pgmap v257: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:24:36.029 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:24:36.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:24:36.300 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:36.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.803+0000 7f577e93c640 1 -- 172.21.15.45:0/562990817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5778100e20 msgr2=0x7f5778101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:36.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.803+0000 7f577e93c640 1 --2- 172.21.15.45:0/562990817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5778100e20 0x7f5778101200 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f5768009900 tx=0x7f576802a480 comp rx=0 tx=0).stop 2024-09-15T22:24:36.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.803+0000 7f577e93c640 1 -- 172.21.15.45:0/562990817 shutdown_connections 2024-09-15T22:24:36.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.803+0000 7f577e93c640 1 --2- 172.21.15.45:0/562990817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5778102ef0 0x7f577810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.803+0000 7f577e93c640 1 --2- 172.21.15.45:0/562990817 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5778102570 0x7f57781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.803+0000 7f577e93c640 1 --2- 172.21.15.45:0/562990817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5778100e20 0x7f5778101200 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.803+0000 7f577e93c640 1 -- 172.21.15.45:0/562990817 >> 172.21.15.45:0/562990817 conn(0x7f57780fc7d0 msgr2=0x7f57780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:36.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.803+0000 7f577e93c640 1 -- 172.21.15.45:0/562990817 shutdown_connections 2024-09-15T22:24:36.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.803+0000 7f577e93c640 1 -- 172.21.15.45:0/562990817 wait complete. 2024-09-15T22:24:36.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.803+0000 7f577e93c640 1 Processor -- start 2024-09-15T22:24:36.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.803+0000 7f577e93c640 1 -- start start 2024-09-15T22:24:36.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577e93c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5778100e20 0x7f5778197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577e93c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5778102570 0x7f57781977a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577e93c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5778102ef0 0x7f5778197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577e93c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f57781110a0 con 0x7f5778102ef0 2024-09-15T22:24:36.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577e93c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5778110f20 con 0x7f5778100e20 2024-09-15T22:24:36.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577e93c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5778111220 con 0x7f5778102570 2024-09-15T22:24:36.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577ced9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5778102ef0 0x7f5778197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577ced9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5778102ef0 0x7f5778197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44214/0 (socket says 172.21.15.45:44214) 2024-09-15T22:24:36.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577ced9640 1 -- 172.21.15.45:0/2396756616 learned_addr learned my addr 172.21.15.45:0/2396756616 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:36.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f57777fe640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5778102570 0x7f57781977a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f5777fff640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5778100e20 0x7f5778197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577ced9640 1 -- 172.21.15.45:0/2396756616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5778102570 msgr2=0x7f57781977a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:36.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577ced9640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5778102570 0x7f57781977a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577ced9640 1 -- 172.21.15.45:0/2396756616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5778100e20 msgr2=0x7f5778197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:36.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577ced9640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5778100e20 0x7f5778197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f577ced9640 1 -- 172.21.15.45:0/2396756616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57781a6ad0 con 0x7f5778102ef0 2024-09-15T22:24:36.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.804+0000 7f5777fff640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5778100e20 0x7f5778197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:24:36.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.805+0000 7f577ced9640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5778102ef0 0x7f5778197ce0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5770009fd0 tx=0x7f577000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:36.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.805+0000 7f57757fa640 1 -- 172.21.15.45:0/2396756616 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770017070 con 0x7f5778102ef0 2024-09-15T22:24:36.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.805+0000 7f57757fa640 1 -- 172.21.15.45:0/2396756616 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5770004020 con 0x7f5778102ef0 2024-09-15T22:24:36.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.805+0000 7f577e93c640 1 -- 172.21.15.45:0/2396756616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57781a6dc0 con 0x7f5778102ef0 2024-09-15T22:24:36.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.805+0000 7f57757fa640 1 -- 172.21.15.45:0/2396756616 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57700106c0 con 0x7f5778102ef0 2024-09-15T22:24:36.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.805+0000 7f577e93c640 1 -- 172.21.15.45:0/2396756616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57781a7280 con 0x7f5778102ef0 2024-09-15T22:24:36.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.808+0000 7f57757fa640 1 -- 172.21.15.45:0/2396756616 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f57700041d0 con 0x7f5778102ef0 2024-09-15T22:24:36.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.808+0000 7f5780d15740 1 Processor -- start 2024-09-15T22:24:36.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.808+0000 7f5780d15740 1 -- start start 2024-09-15T22:24:36.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.808+0000 7f5780d15740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720f3b60 0x5638720f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.808+0000 7f5780d15740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f4480 0x5638720fe800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.808+0000 7f5780d15740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720fed40 0x563872101130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.808+0000 7f5780d15740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563872059280 con 0x5638720f3b60 2024-09-15T22:24:36.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.808+0000 7f5780d15740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563872000b10 con 0x5638720f4480 2024-09-15T22:24:36.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.808+0000 7f5780d15740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563872055240 con 0x5638720fed40 2024-09-15T22:24:36.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.808+0000 7f57777fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720f3b60 0x5638720f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.808+0000 7f57777fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720f3b60 0x5638720f3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44224/0 (socket says 172.21.15.45:44224) 2024-09-15T22:24:36.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.808+0000 7f57777fe640 1 -- 172.21.15.45:0/3242324697 learned_addr learned my addr 172.21.15.45:0/3242324697 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:36.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.808+0000 7f5777fff640 1 --2- 172.21.15.45:0/3242324697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f4480 0x5638720fe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f57777fe640 1 --2- 172.21.15.45:0/3242324697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720fed40 0x563872101130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f57757fa640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f57600a33b0 0x7f57600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f57777fe640 1 -- 172.21.15.45:0/3242324697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720fed40 msgr2=0x563872101130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:36.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f57777fe640 1 --2- 172.21.15.45:0/3242324697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720fed40 0x563872101130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f57777fe640 1 -- 172.21.15.45:0/3242324697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f4480 msgr2=0x5638720fe800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:36.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f57777fe640 1 --2- 172.21.15.45:0/3242324697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f4480 0x5638720fe800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f57777fe640 1 -- 172.21.15.45:0/3242324697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56387200d1f0 con 0x5638720f3b60 2024-09-15T22:24:36.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f5777fff640 1 --2- 172.21.15.45:0/3242324697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f4480 0x5638720fe800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:36.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f577ced9640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f57600a33b0 0x7f57600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f57757fa640 1 -- 172.21.15.45:0/2396756616 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f57700cfe40 con 0x7f5778102ef0 2024-09-15T22:24:36.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f57777fe640 1 --2- 172.21.15.45:0/3242324697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720f3b60 0x5638720f3f40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f576c004650 tx=0x7f576c004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e83b01a952fce4b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:36.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f575e7fc640 1 -- 172.21.15.45:0/3242324697 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c00be60 con 0x5638720f3b60 2024-09-15T22:24:36.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f575e7fc640 1 -- 172.21.15.45:0/3242324697 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f576c005520 con 0x5638720f3b60 2024-09-15T22:24:36.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.809+0000 7f575e7fc640 1 -- 172.21.15.45:0/3242324697 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c0106e0 con 0x5638720f3b60 2024-09-15T22:24:36.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.810+0000 7f5780d15740 1 -- 172.21.15.45:0/3242324697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720f3b60 msgr2=0x5638720f3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:36.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.810+0000 7f577ced9640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f57600a33b0 0x7f57600a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f57700986e0 tx=0x7f5770016b40 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:36.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.810+0000 7f5780d15740 1 --2- 172.21.15.45:0/3242324697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720f3b60 0x5638720f3f40 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f576c004650 tx=0x7f576c004250 comp rx=0 tx=0).stop 2024-09-15T22:24:36.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.810+0000 7f5780d15740 1 -- 172.21.15.45:0/3242324697 shutdown_connections 2024-09-15T22:24:36.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.810+0000 7f5780d15740 1 --2- 172.21.15.45:0/3242324697 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720fed40 0x563872101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.810+0000 7f5780d15740 1 --2- 172.21.15.45:0/3242324697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f4480 0x5638720fe800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.810+0000 7f5780d15740 1 --2- 172.21.15.45:0/3242324697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720f3b60 0x5638720f3f40 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.810+0000 7f5780d15740 1 -- 172.21.15.45:0/3242324697 >> 172.21.15.45:0/3242324697 conn(0x5638720f00f0 msgr2=0x5638720f04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:36.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.810+0000 7f5780d15740 1 -- 172.21.15.45:0/3242324697 shutdown_connections 2024-09-15T22:24:36.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.810+0000 7f5780d15740 1 -- 172.21.15.45:0/3242324697 wait complete. 2024-09-15T22:24:36.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.810+0000 7f5780d15740 1 -- start start 2024-09-15T22:24:36.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f5780d15740 1 Processor -- start 2024-09-15T22:24:36.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f5780d15740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f3b60 0x5638720fbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f5780d15740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f4480 0x5638720fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f5780d15740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x5638720fc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f5780d15740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563872101910 con 0x5638720fed40 2024-09-15T22:24:36.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f5780d15740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563872013f10 con 0x5638720f4480 2024-09-15T22:24:36.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f5780d15740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x563872101a90 con 0x5638720f3b60 2024-09-15T22:24:36.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f5780d15740 10 client.0 _ll_register_callbacks cb 0x563871fdca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:36.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f57777fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x5638720fc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f57777fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x5638720fc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44228/0 (socket says 172.21.15.45:44228) 2024-09-15T22:24:36.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f57777fe640 1 -- 172.21.15.45:0/3873988669 learned_addr learned my addr 172.21.15.45:0/3873988669 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:36.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f57777fe640 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f3b60 0x5638720fbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f5777fff640 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f4480 0x5638720fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f57777fe640 1 -- 172.21.15.45:0/3873988669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f3b60 msgr2=0x5638720fbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:36.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f57777fe640 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f3b60 0x5638720fbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f57777fe640 1 -- 172.21.15.45:0/3873988669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f4480 msgr2=0x5638720fc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:36.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f57777fe640 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f4480 0x5638720fc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f57777fe640 1 -- 172.21.15.45:0/3873988669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563871dca6a0 con 0x5638720fed40 2024-09-15T22:24:36.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.811+0000 7f5777fff640 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f4480 0x5638720fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:36.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f57777fe640 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x5638720fc5e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f576c005fd0 tx=0x7f576c004e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2f78415a450645 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:36.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f57577fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:36.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f57577fe640 1 -- 172.21.15.45:0/3873988669 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c0048d0 con 0x5638720fed40 2024-09-15T22:24:36.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f57577fe640 1 -- 172.21.15.45:0/3873988669 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f576c004a70 con 0x5638720fed40 2024-09-15T22:24:36.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f5780d15740 1 -- 172.21.15.45:0/3873988669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f576c005520 con 0x5638720fed40 2024-09-15T22:24:36.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f57577fe640 1 -- 172.21.15.45:0/3873988669 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f576c010460 con 0x5638720fed40 2024-09-15T22:24:36.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f5780d15740 10 client.16773 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:36.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f5780d15740 1 -- 172.21.15.45:0/3873988669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56387210d490 con 0x5638720fed40 2024-09-15T22:24:36.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f57577fe640 1 -- 172.21.15.45:0/3873988669 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f576c005520 con 0x5638720fed40 2024-09-15T22:24:36.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f57577fe640 1 -- 172.21.15.45:0/3873988669 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f576c01f510 con 0x5638720fed40 2024-09-15T22:24:36.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f5780d15740 10 client.16773 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:36.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f5780d15740 10 client.16773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f5780d15740 20 client.16773 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f5780d15740 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56387210e7e0 0x563872110bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f5780d15740 4 client.16773 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.812+0000 7f5780d15740 1 -- 172.21.15.45:0/3873988669 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638720667f0 con 0x56387210e7e0 2024-09-15T22:24:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.813+0000 7f5777fff640 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56387210e7e0 0x563872110bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.813+0000 7f5777fff640 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56387210e7e0 0x563872110bd0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3612ecc950df865 server_cookie=5a6d2fe40312e742 in_seq=0 out_seq=0 2024-09-15T22:24:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.813+0000 7f57577fe640 10 client.16773 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f57577fe640 1 -- 172.21.15.45:0/3873988669 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638720667f0 con 0x56387210e7e0 2024-09-15T22:24:36.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f57577fe640 10 client.16773 handle_command_reply: tid=0 2024-09-15T22:24:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f5780d15740 1 client.16773 shutdown 2024-09-15T22:24:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f5780d15740 1 -- 172.21.15.45:0/3873988669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 msgr2=0x5638720fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f5780d15740 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x5638720fc5e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f576c005fd0 tx=0x7f576c004e60 comp rx=0 tx=0).stop 2024-09-15T22:24:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f5780d15740 1 -- 172.21.15.45:0/3873988669 shutdown_connections 2024-09-15T22:24:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f5780d15740 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x56387210e7e0 0x563872110bd0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f5780d15740 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x5638720fc5e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f5780d15740 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f4480 0x5638720fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f5780d15740 1 --2- 172.21.15.45:0/3873988669 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f3b60 0x5638720fbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f57577fe640 0 client.16773 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:36.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f5780d15740 1 -- 172.21.15.45:0/3873988669 >> 172.21.15.45:0/3873988669 conn(0x5638720f00f0 msgr2=0x5638720f5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:36.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f5780d15740 1 -- 172.21.15.45:0/3873988669 shutdown_connections 2024-09-15T22:24:36.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f5780d15740 1 -- 172.21.15.45:0/3873988669 wait complete. 2024-09-15T22:24:36.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.814+0000 7f5780d15740 20 client.16773 trim_cache size 0 max 16384 2024-09-15T22:24:36.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.832+0000 7f5780d15740 1 Processor -- start 2024-09-15T22:24:36.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.832+0000 7f5780d15740 1 -- start start 2024-09-15T22:24:36.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.832+0000 7f5780d15740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f3b60 0x5638720f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.832+0000 7f5780d15740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f4480 0x5638720fb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.832+0000 7f5780d15740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x563872116390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.832+0000 7f5780d15740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f57781af4e0 con 0x5638720fed40 2024-09-15T22:24:36.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.832+0000 7f5780d15740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f57781b1d60 con 0x5638720f3b60 2024-09-15T22:24:36.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.832+0000 7f5780d15740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f57781afb50 con 0x5638720f4480 2024-09-15T22:24:36.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.832+0000 7f57777fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x563872116390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.832+0000 7f57777fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x563872116390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44240/0 (socket says 172.21.15.45:44240) 2024-09-15T22:24:36.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.832+0000 7f57777fe640 1 -- 172.21.15.45:0/2475698538 learned_addr learned my addr 172.21.15.45:0/2475698538 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:36.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.833+0000 7f57777fe640 1 --2- 172.21.15.45:0/2475698538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f3b60 0x5638720f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.833+0000 7f5777fff640 1 --2- 172.21.15.45:0/2475698538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f4480 0x5638720fb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.833+0000 7f57777fe640 1 -- 172.21.15.45:0/2475698538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f4480 msgr2=0x5638720fb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:36.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.833+0000 7f57777fe640 1 --2- 172.21.15.45:0/2475698538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f4480 0x5638720fb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.833+0000 7f57777fe640 1 -- 172.21.15.45:0/2475698538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f3b60 msgr2=0x5638720f65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.833+0000 7f57777fe640 1 --2- 172.21.15.45:0/2475698538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f3b60 0x5638720f65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.833+0000 7f57777fe640 1 -- 172.21.15.45:0/2475698538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563872111160 con 0x5638720fed40 2024-09-15T22:24:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.833+0000 7f5777fff640 1 --2- 172.21.15.45:0/2475698538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f4480 0x5638720fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:24:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.833+0000 7f57777fe640 1 --2- 172.21.15.45:0/2475698538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x563872116390 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f576c005880 tx=0x7f576c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120e4f5c8abf9a69 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:36.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.833+0000 7f575dffb640 1 -- 172.21.15.45:0/2475698538 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c03c070 con 0x5638720fed40 2024-09-15T22:24:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.833+0000 7f575dffb640 1 -- 172.21.15.45:0/2475698538 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f576c003e50 con 0x5638720fed40 2024-09-15T22:24:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.833+0000 7f575dffb640 1 -- 172.21.15.45:0/2475698538 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c0048d0 con 0x5638720fed40 2024-09-15T22:24:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.834+0000 7f5780d15740 1 -- 172.21.15.45:0/2475698538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 msgr2=0x563872116390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.834+0000 7f5780d15740 1 --2- 172.21.15.45:0/2475698538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x563872116390 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f576c005880 tx=0x7f576c00b4a0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.834+0000 7f5780d15740 1 -- 172.21.15.45:0/2475698538 shutdown_connections 2024-09-15T22:24:36.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.834+0000 7f5780d15740 1 --2- 172.21.15.45:0/2475698538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x563872116390 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.834+0000 7f5780d15740 1 --2- 172.21.15.45:0/2475698538 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f4480 0x5638720fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.834+0000 7f5780d15740 1 --2- 172.21.15.45:0/2475698538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f3b60 0x5638720f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.834+0000 7f5780d15740 1 -- 172.21.15.45:0/2475698538 >> 172.21.15.45:0/2475698538 conn(0x5638720f00f0 msgr2=0x5638720ef270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.834+0000 7f5780d15740 1 -- 172.21.15.45:0/2475698538 shutdown_connections 2024-09-15T22:24:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.834+0000 7f5780d15740 1 -- 172.21.15.45:0/2475698538 wait complete. 2024-09-15T22:24:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.834+0000 7f5780d15740 1 -- start start 2024-09-15T22:24:36.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f5780d15740 1 Processor -- start 2024-09-15T22:24:36.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f5780d15740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f3b60 0x5638720f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f5780d15740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f4480 0x5638720f9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f5780d15740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x5638720f9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f5780d15740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f57781b0220 con 0x5638720fed40 2024-09-15T22:24:36.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f5780d15740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f57781b1690 con 0x5638720f3b60 2024-09-15T22:24:36.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f5780d15740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f57781b08f0 con 0x5638720f4480 2024-09-15T22:24:36.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f5780d15740 10 client.0 _ll_register_callbacks cb 0x7f576c00ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:36.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f57777fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x5638720f9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f57777fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x5638720f9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44252/0 (socket says 172.21.15.45:44252) 2024-09-15T22:24:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f57777fe640 1 -- 172.21.15.45:0/2473051124 learned_addr learned my addr 172.21.15.45:0/2473051124 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f5777fff640 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f4480 0x5638720f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f57777fe640 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f3b60 0x5638720f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f57777fe640 1 -- 172.21.15.45:0/2473051124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f4480 msgr2=0x5638720f9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f57777fe640 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f4480 0x5638720f9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f57777fe640 1 -- 172.21.15.45:0/2473051124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f3b60 msgr2=0x5638720f8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f57777fe640 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f3b60 0x5638720f8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f57777fe640 1 -- 172.21.15.45:0/2473051124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638720f11a0 con 0x5638720fed40 2024-09-15T22:24:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f5777fff640 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f4480 0x5638720f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:36.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f57777fe640 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x5638720f9660 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f576c001eb0 tx=0x7f576c0055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e54b89f3f0d39f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.835+0000 7f57577fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f57577fe640 1 -- 172.21.15.45:0/2473051124 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c03c040 con 0x5638720fed40 2024-09-15T22:24:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f57577fe640 1 -- 172.21.15.45:0/2473051124 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f576c0048d0 con 0x5638720fed40 2024-09-15T22:24:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f5780d15740 1 -- 172.21.15.45:0/2473051124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f576c003e50 con 0x5638720fed40 2024-09-15T22:24:36.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f57577fe640 1 -- 172.21.15.45:0/2473051124 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f576c01fc60 con 0x5638720fed40 2024-09-15T22:24:36.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f5780d15740 10 client.16779 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:36.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f5780d15740 1 -- 172.21.15.45:0/2473051124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5638720eff20 con 0x5638720fed40 2024-09-15T22:24:36.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f57577fe640 1 -- 172.21.15.45:0/2473051124 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f576c003e50 con 0x5638720fed40 2024-09-15T22:24:36.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f57577fe640 1 -- 172.21.15.45:0/2473051124 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f576c037420 con 0x5638720fed40 2024-09-15T22:24:36.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f5780d15740 10 client.16779 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:36.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f5780d15740 10 client.16779 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f5780d15740 20 client.16779 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f5780d15740 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563872179730 0x56387217bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f5780d15740 4 client.16779 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:24:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.836+0000 7f5780d15740 1 -- 172.21.15.45:0/2473051124 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563872060d00 con 0x563872179730 2024-09-15T22:24:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.837+0000 7f5777fff640 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563872179730 0x56387217bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:36.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.837+0000 7f5777fff640 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563872179730 0x56387217bb20 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d9e8b89113f990 server_cookie=4479c8171c98e87c in_seq=0 out_seq=0 2024-09-15T22:24:36.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.837+0000 7f57577fe640 10 client.16779 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:36.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.838+0000 7f57577fe640 1 -- 172.21.15.45:0/2473051124 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563872060d00 con 0x563872179730 2024-09-15T22:24:36.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.838+0000 7f57577fe640 10 client.16779 handle_command_reply: tid=0 2024-09-15T22:24:36.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.838+0000 7f5780d15740 1 client.16779 shutdown 2024-09-15T22:24:36.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.838+0000 7f5780d15740 1 -- 172.21.15.45:0/2473051124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 msgr2=0x5638720f9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:36.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.838+0000 7f5780d15740 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x5638720f9660 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f576c001eb0 tx=0x7f576c0055f0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.838+0000 7f5780d15740 1 -- 172.21.15.45:0/2473051124 shutdown_connections 2024-09-15T22:24:36.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.838+0000 7f5780d15740 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563872179730 0x56387217bb20 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.838+0000 7f5780d15740 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5638720fed40 0x5638720f9660 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.838+0000 7f5780d15740 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5638720f4480 0x5638720f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.838+0000 7f5780d15740 1 --2- 172.21.15.45:0/2473051124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5638720f3b60 0x5638720f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.838+0000 7f5780d15740 1 -- 172.21.15.45:0/2473051124 >> 172.21.15.45:0/2473051124 conn(0x5638720f00f0 msgr2=0x5638720fbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:36.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.838+0000 7f57577fe640 0 client.16779 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:36.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f5780d15740 1 -- 172.21.15.45:0/2473051124 shutdown_connections 2024-09-15T22:24:36.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f5780d15740 1 -- 172.21.15.45:0/2473051124 wait complete. 2024-09-15T22:24:36.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f5780d15740 20 client.16779 trim_cache size 0 max 16384 2024-09-15T22:24:36.873 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:24:36.873 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:24:36.873 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "597b46e8-0142-46b2-bb72-be76b4ef9639", 2024-09-15T22:24:36.874 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:24:36.874 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:24:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f577e93c640 1 -- 172.21.15.45:0/2396756616 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f57600a33b0 msgr2=0x7f57600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f577e93c640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f57600a33b0 0x7f57600a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f57700986e0 tx=0x7f5770016b40 comp rx=0 tx=0).stop 2024-09-15T22:24:36.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f577e93c640 1 -- 172.21.15.45:0/2396756616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5778102ef0 msgr2=0x7f5778197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:36.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f577e93c640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5778102ef0 0x7f5778197ce0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f5770009fd0 tx=0x7f577000b260 comp rx=0 tx=0).stop 2024-09-15T22:24:36.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f577e93c640 1 -- 172.21.15.45:0/2396756616 shutdown_connections 2024-09-15T22:24:36.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f577e93c640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f57600a33b0 0x7f57600a5870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f577e93c640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5778102ef0 0x7f5778197ce0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f577e93c640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5778102570 0x7f57781977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f577e93c640 1 --2- 172.21.15.45:0/2396756616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5778100e20 0x7f5778197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f577e93c640 1 -- 172.21.15.45:0/2396756616 >> 172.21.15.45:0/2396756616 conn(0x7f57780fc7d0 msgr2=0x7f57780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f577e93c640 1 -- 172.21.15.45:0/2396756616 shutdown_connections 2024-09-15T22:24:36.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:36.839+0000 7f577e93c640 1 -- 172.21.15.45:0/2396756616 wait complete. 2024-09-15T22:24:37.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:36 smithi045 ceph-mon[31180]: pgmap v258: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:24:37.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:36 smithi165 ceph-mon[35551]: pgmap v258: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:24:37.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:36 smithi100 ceph-mon[35319]: pgmap v258: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:24:37.623 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:24:37.884 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:38.136 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:37 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:24:38.136 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:37 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:24:38.136 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:37 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:24:38.136 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:37 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:24:38.136 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:37 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:24:38.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:37 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:24:38.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:37 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:24:38.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:37 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:24:38.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:37 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:24:38.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:37 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:24:38.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:37 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:24:38.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:37 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:24:38.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:37 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:24:38.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:37 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:24:38.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:37 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.361+0000 7f151c74c640 1 -- 172.21.15.45:0/201079864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f151410e480 msgr2=0x7f1514110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.361+0000 7f151c74c640 1 --2- 172.21.15.45:0/201079864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f151410e480 0x7f1514110870 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f150c009ca0 tx=0x7f150c02a8c0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.362+0000 7f151c74c640 1 -- 172.21.15.45:0/201079864 shutdown_connections 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.362+0000 7f151c74c640 1 --2- 172.21.15.45:0/201079864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f151410e480 0x7f1514110870 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.362+0000 7f151c74c640 1 --2- 172.21.15.45:0/201079864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1514101280 0x7f151410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.362+0000 7f151c74c640 1 --2- 172.21.15.45:0/201079864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15141008d0 0x7f1514100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.362+0000 7f151c74c640 1 -- 172.21.15.45:0/201079864 >> 172.21.15.45:0/201079864 conn(0x7f15140fc7a0 msgr2=0x7f15140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.362+0000 7f151c74c640 1 -- 172.21.15.45:0/201079864 shutdown_connections 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.362+0000 7f151c74c640 1 -- 172.21.15.45:0/201079864 wait complete. 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.362+0000 7f151c74c640 1 Processor -- start 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.362+0000 7f151c74c640 1 -- start start 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.362+0000 7f151c74c640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15141008d0 0x7f151419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.362+0000 7f151c74c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1514101280 0x7f151419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f151c74c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f151410e480 0x7f151419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f151c74c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f15141142a0 con 0x7f151410e480 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f151c74c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1514114120 con 0x7f1514101280 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f151c74c640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1514114420 con 0x7f15141008d0 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f151ace9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f151410e480 0x7f151419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f1519ce7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1514101280 0x7f151419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f1519ce7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1514101280 0x7f151419ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.45:41166/0 (socket says 172.21.15.45:41166) 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f151ace9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f151410e480 0x7f151419ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44270/0 (socket says 172.21.15.45:44270) 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f1519ce7640 1 -- 172.21.15.45:0/3439805537 learned_addr learned my addr 172.21.15.45:0/3439805537 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f151a4e8640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15141008d0 0x7f151419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f1519ce7640 1 -- 172.21.15.45:0/3439805537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15141008d0 msgr2=0x7f151419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f1519ce7640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15141008d0 0x7f151419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f1519ce7640 1 -- 172.21.15.45:0/3439805537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f151410e480 msgr2=0x7f151419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f1519ce7640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f151410e480 0x7f151419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f1519ce7640 1 -- 172.21.15.45:0/3439805537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151419f670 con 0x7f1514101280 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f151ace9640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f151410e480 0x7f151419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.363+0000 7f1519ce7640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1514101280 0x7f151419ac00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f150400d770 tx=0x7f150400dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.364+0000 7f150b7fe640 1 -- 172.21.15.45:0/3439805537 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504017070 con 0x7f1514101280 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.364+0000 7f151c74c640 1 -- 172.21.15.45:0/3439805537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151419f960 con 0x7f1514101280 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.364+0000 7f150b7fe640 1 -- 172.21.15.45:0/3439805537 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1504005520 con 0x7f1514101280 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.364+0000 7f150b7fe640 1 -- 172.21.15.45:0/3439805537 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504010460 con 0x7f1514101280 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.364+0000 7f151c74c640 1 -- 172.21.15.45:0/3439805537 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15141a7240 con 0x7f1514101280 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.366+0000 7f151eb25740 1 Processor -- start 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.366+0000 7f151eb25740 1 -- start start 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.366+0000 7f150b7fe640 1 -- 172.21.15.45:0/3439805537 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1504004ea0 con 0x7f1514101280 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.366+0000 7f151eb25740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c3894a0 0x55dc3c389880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.366+0000 7f151eb25740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c389dc0 0x55dc3c394140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.366+0000 7f151eb25740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c394680 0x55dc3c396a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.366+0000 7f151eb25740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55dc3c2ef2e0 con 0x55dc3c3894a0 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.366+0000 7f151eb25740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55dc3c296ce0 con 0x55dc3c394680 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.366+0000 7f151eb25740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55dc3c2eb2a0 con 0x55dc3c389dc0 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f151ace9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c3894a0 0x55dc3c389880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f151ace9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c3894a0 0x55dc3c389880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44272/0 (socket says 172.21.15.45:44272) 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f151ace9640 1 -- 172.21.15.45:0/1301354300 learned_addr learned my addr 172.21.15.45:0/1301354300 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f151a4e8640 1 --2- 172.21.15.45:0/1301354300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c389dc0 0x55dc3c394140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f1519ce7640 1 --2- 172.21.15.45:0/1301354300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c394680 0x55dc3c396a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f151ace9640 1 -- 172.21.15.45:0/1301354300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c389dc0 msgr2=0x55dc3c394140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f151ace9640 1 --2- 172.21.15.45:0/1301354300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c389dc0 0x55dc3c394140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f151ace9640 1 -- 172.21.15.45:0/1301354300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c394680 msgr2=0x55dc3c396a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f151ace9640 1 --2- 172.21.15.45:0/1301354300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c394680 0x55dc3c396a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f151ace9640 1 -- 172.21.15.45:0/1301354300 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3c27b440 con 0x55dc3c3894a0 2024-09-15T22:24:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f151a4e8640 1 --2- 172.21.15.45:0/1301354300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c389dc0 0x55dc3c394140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f151ace9640 1 --2- 172.21.15.45:0/1301354300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c3894a0 0x55dc3c389880 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1514102ab0 tx=0x7f150c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309b5f0e8e8e9ad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f1508ff9640 1 -- 172.21.15.45:0/1301354300 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c003b70 con 0x55dc3c3894a0 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f150b7fe640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f15000a33b0 0x7f15000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f1508ff9640 1 -- 172.21.15.45:0/1301354300 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f150c036040 con 0x55dc3c3894a0 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.367+0000 7f1508ff9640 1 -- 172.21.15.45:0/1301354300 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c0047f0 con 0x55dc3c3894a0 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.368+0000 7f151a4e8640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f15000a33b0 0x7f15000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.368+0000 7f150b7fe640 1 -- 172.21.15.45:0/3439805537 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f15040cfb20 con 0x7f1514101280 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.368+0000 7f151eb25740 1 -- 172.21.15.45:0/1301354300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c3894a0 msgr2=0x55dc3c389880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.368+0000 7f151a4e8640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f15000a33b0 0x7f15000a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55dc3c386890 tx=0x7f151000b410 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.368+0000 7f151eb25740 1 --2- 172.21.15.45:0/1301354300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c3894a0 0x55dc3c389880 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1514102ab0 tx=0x7f150c009920 comp rx=0 tx=0).stop 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.368+0000 7f151eb25740 1 -- 172.21.15.45:0/1301354300 shutdown_connections 2024-09-15T22:24:38.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.368+0000 7f151eb25740 1 --2- 172.21.15.45:0/1301354300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c394680 0x55dc3c396a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.368+0000 7f151eb25740 1 --2- 172.21.15.45:0/1301354300 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c389dc0 0x55dc3c394140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.368+0000 7f151eb25740 1 --2- 172.21.15.45:0/1301354300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c3894a0 0x55dc3c389880 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.368+0000 7f151eb25740 1 -- 172.21.15.45:0/1301354300 >> 172.21.15.45:0/1301354300 conn(0x55dc3c385a30 msgr2=0x55dc3c385e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.368+0000 7f151eb25740 1 -- 172.21.15.45:0/1301354300 shutdown_connections 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.368+0000 7f151eb25740 1 -- 172.21.15.45:0/1301354300 wait complete. 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.368+0000 7f151eb25740 1 -- start start 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151eb25740 1 Processor -- start 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151eb25740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c3894a0 0x55dc3c393fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151eb25740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c389dc0 0x55dc3c391250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151eb25740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 0x55dc3c391790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151eb25740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55dc3c3970d0 con 0x55dc3c394680 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151eb25740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55dc3c2aa050 con 0x55dc3c3894a0 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151eb25740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55dc3c397250 con 0x55dc3c389dc0 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151eb25740 10 client.0 _ll_register_callbacks cb 0x55dc3c2ea160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151ace9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 0x55dc3c391790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151ace9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 0x55dc3c391790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44284/0 (socket says 172.21.15.45:44284) 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151ace9640 1 -- 172.21.15.45:0/1305154666 learned_addr learned my addr 172.21.15.45:0/1305154666 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f1519ce7640 1 --2- 172.21.15.45:0/1305154666 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c389dc0 0x55dc3c391250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151a4e8640 1 --2- 172.21.15.45:0/1305154666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c3894a0 0x55dc3c393fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151ace9640 1 -- 172.21.15.45:0/1305154666 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c389dc0 msgr2=0x55dc3c391250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151ace9640 1 --2- 172.21.15.45:0/1305154666 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c389dc0 0x55dc3c391250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151ace9640 1 -- 172.21.15.45:0/1305154666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c3894a0 msgr2=0x55dc3c393fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151ace9640 1 --2- 172.21.15.45:0/1305154666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c3894a0 0x55dc3c393fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.369+0000 7f151ace9640 1 -- 172.21.15.45:0/1305154666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc3c0603c0 con 0x55dc3c394680 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.370+0000 7f151ace9640 1 --2- 172.21.15.45:0/1305154666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 0x55dc3c391790 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f150c02ade0 tx=0x7f150c031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff570e3cdb772caf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.370+0000 7f14fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.370+0000 7f14fdffb640 1 -- 172.21.15.45:0/1305154666 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c003970 con 0x55dc3c394680 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.370+0000 7f14fdffb640 1 -- 172.21.15.45:0/1305154666 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f150c003b10 con 0x55dc3c394680 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.370+0000 7f151eb25740 1 -- 172.21.15.45:0/1305154666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f150c036040 con 0x55dc3c394680 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.370+0000 7f14fdffb640 1 -- 172.21.15.45:0/1305154666 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f150c05d050 con 0x55dc3c394680 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.370+0000 7f151eb25740 10 client.16791 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.370+0000 7f151eb25740 1 -- 172.21.15.45:0/1305154666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dc3c3970d0 con 0x55dc3c394680 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.370+0000 7f14fdffb640 1 -- 172.21.15.45:0/1305154666 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f150c036040 con 0x55dc3c394680 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.370+0000 7f14fdffb640 1 -- 172.21.15.45:0/1305154666 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f150c04e070 con 0x55dc3c394680 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.371+0000 7f151eb25740 10 client.16791 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.371+0000 7f151eb25740 10 client.16791 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.371+0000 7f151eb25740 20 client.16791 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.371+0000 7f151eb25740 1 --2- 172.21.15.45:0/1305154666 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dc3c3a3bd0 0x55dc3c3a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.371+0000 7f151eb25740 4 client.16791 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.371+0000 7f151eb25740 1 -- 172.21.15.45:0/1305154666 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc3c2fc850 con 0x55dc3c3a3bd0 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.371+0000 7f151a4e8640 1 --2- 172.21.15.45:0/1305154666 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dc3c3a3bd0 0x55dc3c3a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.371+0000 7f14fdffb640 10 client.16791 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.371+0000 7f151a4e8640 1 --2- 172.21.15.45:0/1305154666 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dc3c3a3bd0 0x55dc3c3a5fc0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47a9f589afc7a65a server_cookie=fb4801d07bc20ba8 in_seq=0 out_seq=0 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f14fdffb640 1 -- 172.21.15.45:0/1305154666 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc3c2fc850 con 0x55dc3c3a3bd0 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f14fdffb640 10 client.16791 handle_command_reply: tid=0 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f151eb25740 1 client.16791 shutdown 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f151eb25740 1 -- 172.21.15.45:0/1305154666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 msgr2=0x55dc3c391790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f151eb25740 1 --2- 172.21.15.45:0/1305154666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 0x55dc3c391790 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f150c02ade0 tx=0x7f150c031700 comp rx=0 tx=0).stop 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f151eb25740 1 -- 172.21.15.45:0/1305154666 shutdown_connections 2024-09-15T22:24:38.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f151eb25740 1 --2- 172.21.15.45:0/1305154666 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dc3c3a3bd0 0x55dc3c3a5fc0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f151eb25740 1 --2- 172.21.15.45:0/1305154666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 0x55dc3c391790 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f151eb25740 1 --2- 172.21.15.45:0/1305154666 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c389dc0 0x55dc3c391250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f151eb25740 1 --2- 172.21.15.45:0/1305154666 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c3894a0 0x55dc3c393fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f151eb25740 1 -- 172.21.15.45:0/1305154666 >> 172.21.15.45:0/1305154666 conn(0x55dc3c385a30 msgr2=0x55dc3c384b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:38.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f14fdffb640 0 client.16791 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:38.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f151eb25740 1 -- 172.21.15.45:0/1305154666 shutdown_connections 2024-09-15T22:24:38.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f151eb25740 1 -- 172.21.15.45:0/1305154666 wait complete. 2024-09-15T22:24:38.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.372+0000 7f151eb25740 20 client.16791 trim_cache size 0 max 16384 2024-09-15T22:24:38.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.390+0000 7f151eb25740 1 Processor -- start 2024-09-15T22:24:38.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.390+0000 7f151eb25740 1 -- start start 2024-09-15T22:24:38.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.390+0000 7f151eb25740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c3894a0 0x55dc3c3a0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.390+0000 7f151eb25740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c389dc0 0x55dc3c3ab870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.390+0000 7f151eb25740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c394680 0x55dc3c3abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.390+0000 7f151eb25740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f15141af380 con 0x55dc3c389dc0 2024-09-15T22:24:38.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.390+0000 7f151eb25740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15141b1c00 con 0x55dc3c3894a0 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.390+0000 7f151eb25740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f15141af9f0 con 0x55dc3c394680 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.390+0000 7f1519ce7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c389dc0 0x55dc3c3ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.390+0000 7f1519ce7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c389dc0 0x55dc3c3ab870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44300/0 (socket says 172.21.15.45:44300) 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.391+0000 7f1519ce7640 1 -- 172.21.15.45:0/2875065008 learned_addr learned my addr 172.21.15.45:0/2875065008 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.391+0000 7f151a4e8640 1 --2- 172.21.15.45:0/2875065008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c3894a0 0x55dc3c3a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.391+0000 7f151ace9640 1 --2- 172.21.15.45:0/2875065008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c394680 0x55dc3c3abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.391+0000 7f1519ce7640 1 -- 172.21.15.45:0/2875065008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c394680 msgr2=0x55dc3c3abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:38.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.391+0000 7f1519ce7640 1 --2- 172.21.15.45:0/2875065008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c394680 0x55dc3c3abdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.391+0000 7f1519ce7640 1 -- 172.21.15.45:0/2875065008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c3894a0 msgr2=0x55dc3c3a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:38.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.391+0000 7f1519ce7640 1 --2- 172.21.15.45:0/2875065008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c3894a0 0x55dc3c3a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.391+0000 7f1519ce7640 1 -- 172.21.15.45:0/2875065008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3c386ae0 con 0x55dc3c389dc0 2024-09-15T22:24:38.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.391+0000 7f1519ce7640 1 --2- 172.21.15.45:0/2875065008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c389dc0 0x55dc3c3ab870 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1504098470 tx=0x7f1504004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d317efec44b924f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:38.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.391+0000 7f14fffff640 1 -- 172.21.15.45:0/2875065008 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504020040 con 0x55dc3c389dc0 2024-09-15T22:24:38.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.391+0000 7f14fffff640 1 -- 172.21.15.45:0/2875065008 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f150409baa0 con 0x55dc3c389dc0 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.391+0000 7f14fffff640 1 -- 172.21.15.45:0/2875065008 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15040860b0 con 0x55dc3c389dc0 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.392+0000 7f151eb25740 1 -- 172.21.15.45:0/2875065008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c389dc0 msgr2=0x55dc3c3ab870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.392+0000 7f151eb25740 1 --2- 172.21.15.45:0/2875065008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c389dc0 0x55dc3c3ab870 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1504098470 tx=0x7f1504004940 comp rx=0 tx=0).stop 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.392+0000 7f151eb25740 1 -- 172.21.15.45:0/2875065008 shutdown_connections 2024-09-15T22:24:38.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.392+0000 7f151eb25740 1 --2- 172.21.15.45:0/2875065008 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c394680 0x55dc3c3abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.392+0000 7f151eb25740 1 --2- 172.21.15.45:0/2875065008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c389dc0 0x55dc3c3ab870 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.392+0000 7f151eb25740 1 --2- 172.21.15.45:0/2875065008 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c3894a0 0x55dc3c3a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.392+0000 7f151eb25740 1 -- 172.21.15.45:0/2875065008 >> 172.21.15.45:0/2875065008 conn(0x55dc3c385a30 msgr2=0x55dc3c3932d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.392+0000 7f151eb25740 1 -- 172.21.15.45:0/2875065008 shutdown_connections 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.392+0000 7f151eb25740 1 -- 172.21.15.45:0/2875065008 wait complete. 2024-09-15T22:24:38.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151eb25740 1 -- start start 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151eb25740 1 Processor -- start 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151eb25740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c3894a0 0x55dc3c397c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151eb25740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c389dc0 0x55dc3c3981c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151eb25740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 0x55dc3c39c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151eb25740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f15141b00c0 con 0x55dc3c394680 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151eb25740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f15141b1530 con 0x55dc3c389dc0 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151eb25740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f15141b0790 con 0x55dc3c3894a0 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151eb25740 10 client.0 _ll_register_callbacks cb 0x7f150c009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151ace9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 0x55dc3c39c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151ace9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 0x55dc3c39c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44314/0 (socket says 172.21.15.45:44314) 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151ace9640 1 -- 172.21.15.45:0/2790331488 learned_addr learned my addr 172.21.15.45:0/2790331488 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151a4e8640 1 --2- 172.21.15.45:0/2790331488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c3894a0 0x55dc3c397c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f1519ce7640 1 --2- 172.21.15.45:0/2790331488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c389dc0 0x55dc3c3981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151ace9640 1 -- 172.21.15.45:0/2790331488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c3894a0 msgr2=0x55dc3c397c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151ace9640 1 --2- 172.21.15.45:0/2790331488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c3894a0 0x55dc3c397c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151ace9640 1 -- 172.21.15.45:0/2790331488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c389dc0 msgr2=0x55dc3c3981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151ace9640 1 --2- 172.21.15.45:0/2790331488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c389dc0 0x55dc3c3981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.393+0000 7f151ace9640 1 -- 172.21.15.45:0/2790331488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc3c39c920 con 0x55dc3c394680 2024-09-15T22:24:38.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.394+0000 7f151ace9640 1 --2- 172.21.15.45:0/2790331488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 0x55dc3c39c2b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f150c009bf0 tx=0x7f150c0308c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfa0c035470b6ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.394+0000 7f14fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.394+0000 7f14fdffb640 1 -- 172.21.15.45:0/2790331488 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c03f020 con 0x55dc3c394680 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.394+0000 7f14fdffb640 1 -- 172.21.15.45:0/2790331488 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f150c030d20 con 0x55dc3c394680 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.394+0000 7f151eb25740 1 -- 172.21.15.45:0/2790331488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f150409baa0 con 0x55dc3c394680 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.394+0000 7f14fdffb640 1 -- 172.21.15.45:0/2790331488 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f150c06a050 con 0x55dc3c394680 2024-09-15T22:24:38.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.394+0000 7f151eb25740 10 client.16797 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.394+0000 7f151eb25740 1 -- 172.21.15.45:0/2790331488 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dc3c40e370 con 0x55dc3c394680 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.394+0000 7f14fdffb640 1 -- 172.21.15.45:0/2790331488 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f150409baa0 con 0x55dc3c394680 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.394+0000 7f14fdffb640 1 -- 172.21.15.45:0/2790331488 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f150c043070 con 0x55dc3c394680 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.395+0000 7f151eb25740 10 client.16797 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.395+0000 7f151eb25740 10 client.16797 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:38.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.395+0000 7f151eb25740 20 client.16797 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.395+0000 7f151eb25740 1 --2- 172.21.15.45:0/2790331488 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dc3c40ea30 0x55dc3c410e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.395+0000 7f151eb25740 4 client.16797 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.395+0000 7f151eb25740 1 -- 172.21.15.45:0/2790331488 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dc3c2f6d60 con 0x55dc3c40ea30 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.395+0000 7f151a4e8640 1 --2- 172.21.15.45:0/2790331488 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dc3c40ea30 0x55dc3c410e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:38.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.395+0000 7f151a4e8640 1 --2- 172.21.15.45:0/2790331488 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dc3c40ea30 0x55dc3c410e20 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fad5573dad77edd server_cookie=ef1dec05ee711325 in_seq=0 out_seq=0 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.395+0000 7f14fdffb640 10 client.16797 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.395+0000 7f14fdffb640 1 -- 172.21.15.45:0/2790331488 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dc3c2f6d60 con 0x55dc3c40ea30 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.395+0000 7f14fdffb640 10 client.16797 handle_command_reply: tid=0 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.395+0000 7f151eb25740 1 client.16797 shutdown 2024-09-15T22:24:38.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151eb25740 1 -- 172.21.15.45:0/2790331488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 msgr2=0x55dc3c39c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151eb25740 1 --2- 172.21.15.45:0/2790331488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 0x55dc3c39c2b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f150c009bf0 tx=0x7f150c0308c0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151eb25740 1 -- 172.21.15.45:0/2790331488 shutdown_connections 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151eb25740 1 --2- 172.21.15.45:0/2790331488 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55dc3c40ea30 0x55dc3c410e20 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151eb25740 1 --2- 172.21.15.45:0/2790331488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dc3c394680 0x55dc3c39c2b0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151eb25740 1 --2- 172.21.15.45:0/2790331488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55dc3c389dc0 0x55dc3c3981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151eb25740 1 --2- 172.21.15.45:0/2790331488 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55dc3c3894a0 0x55dc3c397c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151eb25740 1 -- 172.21.15.45:0/2790331488 >> 172.21.15.45:0/2790331488 conn(0x55dc3c385a30 msgr2=0x55dc3c384350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f14fdffb640 0 client.16797 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151eb25740 1 -- 172.21.15.45:0/2790331488 shutdown_connections 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151eb25740 1 -- 172.21.15.45:0/2790331488 wait complete. 2024-09-15T22:24:38.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151eb25740 20 client.16797 trim_cache size 0 max 16384 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:24:38.420 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:24:38.421 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151c74c640 1 -- 172.21.15.45:0/3439805537 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f15000a33b0 msgr2=0x7f15000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151c74c640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f15000a33b0 0x7f15000a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55dc3c386890 tx=0x7f151000b410 comp rx=0 tx=0).stop 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151c74c640 1 -- 172.21.15.45:0/3439805537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1514101280 msgr2=0x7f151419ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.396+0000 7f151c74c640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1514101280 0x7f151419ac00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f150400d770 tx=0x7f150400dc30 comp rx=0 tx=0).stop 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.397+0000 7f151c74c640 1 -- 172.21.15.45:0/3439805537 shutdown_connections 2024-09-15T22:24:38.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.397+0000 7f151c74c640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f15000a33b0 0x7f15000a5870 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.397+0000 7f151c74c640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f151410e480 0x7f151419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.397+0000 7f151c74c640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1514101280 0x7f151419ac00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.397+0000 7f151c74c640 1 --2- 172.21.15.45:0/3439805537 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f15141008d0 0x7f151419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.397+0000 7f151c74c640 1 -- 172.21.15.45:0/3439805537 >> 172.21.15.45:0/3439805537 conn(0x7f15140fc7a0 msgr2=0x7f15140feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.397+0000 7f151c74c640 1 -- 172.21.15.45:0/3439805537 shutdown_connections 2024-09-15T22:24:38.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:38.397+0000 7f151c74c640 1 -- 172.21.15.45:0/3439805537 wait complete. 2024-09-15T22:24:39.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:38 smithi045 ceph-mon[31180]: pgmap v259: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:24:39.107 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:24:39.108 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:24:39.216 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:38 smithi165 ceph-mon[35551]: pgmap v259: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:24:39.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:38 smithi100 ceph-mon[35319]: pgmap v259: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:24:39.368 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:39.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.885+0000 7fa464ec2640 1 -- 172.21.15.45:0/3636815809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460101de0 msgr2=0x7fa4601021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:39.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.885+0000 7fa464ec2640 1 --2- 172.21.15.45:0/3636815809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460101de0 0x7fa4601021c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa450009900 tx=0x7fa45002a410 comp rx=0 tx=0).stop 2024-09-15T22:24:39.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.885+0000 7fa464ec2640 1 -- 172.21.15.45:0/3636815809 shutdown_connections 2024-09-15T22:24:39.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.885+0000 7fa464ec2640 1 --2- 172.21.15.45:0/3636815809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460106f10 0x7fa46010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.885+0000 7fa464ec2640 1 --2- 172.21.15.45:0/3636815809 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa460102790 0x7fa4601067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.885+0000 7fa464ec2640 1 --2- 172.21.15.45:0/3636815809 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460101de0 0x7fa4601021c0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.885+0000 7fa464ec2640 1 -- 172.21.15.45:0/3636815809 >> 172.21.15.45:0/3636815809 conn(0x7fa4600fd8c0 msgr2=0x7fa4600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.885+0000 7fa464ec2640 1 -- 172.21.15.45:0/3636815809 shutdown_connections 2024-09-15T22:24:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.885+0000 7fa464ec2640 1 -- 172.21.15.45:0/3636815809 wait complete. 2024-09-15T22:24:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.886+0000 7fa464ec2640 1 Processor -- start 2024-09-15T22:24:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.886+0000 7fa464ec2640 1 -- start start 2024-09-15T22:24:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.886+0000 7fa464ec2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460101de0 0x7fa460198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.886+0000 7fa464ec2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460102790 0x7fa4601989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.886+0000 7fa464ec2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa460106f10 0x7fa46019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.886+0000 7fa464ec2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa460112090 con 0x7fa460101de0 2024-09-15T22:24:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.886+0000 7fa464ec2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa460111f10 con 0x7fa460102790 2024-09-15T22:24:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.886+0000 7fa464ec2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa460112210 con 0x7fa460106f10 2024-09-15T22:24:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.886+0000 7fa45e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460101de0 0x7fa460198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:39.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.886+0000 7fa45e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460101de0 0x7fa460198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44322/0 (socket says 172.21.15.45:44322) 2024-09-15T22:24:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.886+0000 7fa45e59c640 1 -- 172.21.15.45:0/3938910575 learned_addr learned my addr 172.21.15.45:0/3938910575 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.886+0000 7fa45dd9b640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460102790 0x7fa4601989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.886+0000 7fa45ed9d640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa460106f10 0x7fa46019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.887+0000 7fa45e59c640 1 -- 172.21.15.45:0/3938910575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa460106f10 msgr2=0x7fa46019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.887+0000 7fa45e59c640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa460106f10 0x7fa46019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.887+0000 7fa45e59c640 1 -- 172.21.15.45:0/3938910575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460102790 msgr2=0x7fa4601989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.887+0000 7fa45e59c640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460102790 0x7fa4601989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.887+0000 7fa45e59c640 1 -- 172.21.15.45:0/3938910575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46019d440 con 0x7fa460101de0 2024-09-15T22:24:39.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.887+0000 7fa45e59c640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460101de0 0x7fa460198490 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa450006010 tx=0x7fa4500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.887+0000 7fa44f7fe640 1 -- 172.21.15.45:0/3938910575 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45003f030 con 0x7fa460101de0 2024-09-15T22:24:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.887+0000 7fa44f7fe640 1 -- 172.21.15.45:0/3938910575 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa450003d00 con 0x7fa460101de0 2024-09-15T22:24:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.887+0000 7fa464ec2640 1 -- 172.21.15.45:0/3938910575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46019d6d0 con 0x7fa460101de0 2024-09-15T22:24:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.887+0000 7fa44f7fe640 1 -- 172.21.15.45:0/3938910575 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450035070 con 0x7fa460101de0 2024-09-15T22:24:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.887+0000 7fa464ec2640 1 -- 172.21.15.45:0/3938910575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4601a5010 con 0x7fa460101de0 2024-09-15T22:24:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.888+0000 7fa464ec2640 1 -- 172.21.15.45:0/3938910575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4601032c0 con 0x7fa460101de0 2024-09-15T22:24:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.889+0000 7fa44f7fe640 1 -- 172.21.15.45:0/3938910575 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa450042030 con 0x7fa460101de0 2024-09-15T22:24:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.890+0000 7fa44f7fe640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa4480a33b0 0x7fa4480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.890+0000 7fa45dd9b640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa4480a33b0 0x7fa4480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.890+0000 7fa44f7fe640 1 -- 172.21.15.45:0/3938910575 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7fa4500f0920 con 0x7fa460101de0 2024-09-15T22:24:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.890+0000 7fa45dd9b640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa4480a33b0 0x7fa4480a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa4601088e0 tx=0x7fa45400b390 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:39.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:39.893+0000 7fa44f7fe640 1 -- 172.21.15.45:0/3938910575 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4500bc960 con 0x7fa460101de0 2024-09-15T22:24:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.105+0000 7fa464ec2640 1 -- 172.21.15.45:0/3938910575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa46010a0f0 con 0x7fa460101de0 2024-09-15T22:24:40.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.106+0000 7fa44f7fe640 1 -- 172.21.15.45:0/3938910575 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fa4500c0c60 con 0x7fa460101de0 2024-09-15T22:24:40.109 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:24:40.109 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:24:40.109 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:24:40.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.108+0000 7fa464ec2640 1 -- 172.21.15.45:0/3938910575 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa4480a33b0 msgr2=0x7fa4480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:40.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.108+0000 7fa464ec2640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa4480a33b0 0x7fa4480a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa4601088e0 tx=0x7fa45400b390 comp rx=0 tx=0).stop 2024-09-15T22:24:40.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.108+0000 7fa464ec2640 1 -- 172.21.15.45:0/3938910575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460101de0 msgr2=0x7fa460198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:40.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.108+0000 7fa464ec2640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460101de0 0x7fa460198490 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa450006010 tx=0x7fa4500042f0 comp rx=0 tx=0).stop 2024-09-15T22:24:40.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.108+0000 7fa464ec2640 1 -- 172.21.15.45:0/3938910575 shutdown_connections 2024-09-15T22:24:40.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.108+0000 7fa464ec2640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa4480a33b0 0x7fa4480a5870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:40.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.108+0000 7fa464ec2640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa460106f10 0x7fa46019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:40.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.108+0000 7fa464ec2640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa460102790 0x7fa4601989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:40.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.108+0000 7fa464ec2640 1 --2- 172.21.15.45:0/3938910575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa460101de0 0x7fa460198490 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:40.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.108+0000 7fa464ec2640 1 -- 172.21.15.45:0/3938910575 >> 172.21.15.45:0/3938910575 conn(0x7fa4600fd8c0 msgr2=0x7fa4600fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:40.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.108+0000 7fa464ec2640 1 -- 172.21.15.45:0/3938910575 shutdown_connections 2024-09-15T22:24:40.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:40.108+0000 7fa464ec2640 1 -- 172.21.15.45:0/3938910575 wait complete. 2024-09-15T22:24:40.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:40 smithi045 ceph-mon[31180]: pgmap v260: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:24:40.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:40 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3938910575' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:40.856 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:24:40.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:40 smithi165 ceph-mon[35551]: pgmap v260: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:24:40.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:40 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3938910575' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:40.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:40 smithi100 ceph-mon[35319]: pgmap v260: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:24:40.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:40 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3938910575' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:24:41.112 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:41.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.685+0000 7f489fd09640 1 -- 172.21.15.45:0/1741991624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48981037a0 msgr2=0x7f489810bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.685+0000 7f489fd09640 1 --2- 172.21.15.45:0/1741991624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48981037a0 0x7f489810bc00 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4888009900 tx=0x7f488802a410 comp rx=0 tx=0).stop 2024-09-15T22:24:41.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.685+0000 7f489fd09640 1 -- 172.21.15.45:0/1741991624 shutdown_connections 2024-09-15T22:24:41.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.685+0000 7f489fd09640 1 --2- 172.21.15.45:0/1741991624 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f489810c2f0 0x7f489810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.685+0000 7f489fd09640 1 --2- 172.21.15.45:0/1741991624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48981037a0 0x7f489810bc00 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.685+0000 7f489fd09640 1 --2- 172.21.15.45:0/1741991624 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4898102df0 0x7f48981031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.685+0000 7f489fd09640 1 -- 172.21.15.45:0/1741991624 >> 172.21.15.45:0/1741991624 conn(0x7f48980fc7d0 msgr2=0x7f48980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.685+0000 7f489fd09640 1 -- 172.21.15.45:0/1741991624 shutdown_connections 2024-09-15T22:24:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.685+0000 7f489fd09640 1 -- 172.21.15.45:0/1741991624 wait complete. 2024-09-15T22:24:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489fd09640 1 Processor -- start 2024-09-15T22:24:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489fd09640 1 -- start start 2024-09-15T22:24:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489fd09640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4898102df0 0x7f48981986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489fd09640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48981037a0 0x7f4898198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489fd09640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f489810c2f0 0x7f489819cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489fd09640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4898112270 con 0x7f48981037a0 2024-09-15T22:24:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489fd09640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48981120f0 con 0x7f4898102df0 2024-09-15T22:24:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489fd09640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f48981123f0 con 0x7f489810c2f0 2024-09-15T22:24:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489d2a4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48981037a0 0x7f4898198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489d2a4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48981037a0 0x7f4898198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44346/0 (socket says 172.21.15.45:44346) 2024-09-15T22:24:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489d2a4640 1 -- 172.21.15.45:0/100401763 learned_addr learned my addr 172.21.15.45:0/100401763 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489e2a6640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f489810c2f0 0x7f489819cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489daa5640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4898102df0 0x7f48981986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489d2a4640 1 -- 172.21.15.45:0/100401763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f489810c2f0 msgr2=0x7f489819cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489d2a4640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f489810c2f0 0x7f489819cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489d2a4640 1 -- 172.21.15.45:0/100401763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4898102df0 msgr2=0x7f48981986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489d2a4640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4898102df0 0x7f48981986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.686+0000 7f489d2a4640 1 -- 172.21.15.45:0/100401763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489819d680 con 0x7f48981037a0 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.687+0000 7f489d2a4640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48981037a0 0x7f4898198c10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4888005940 tx=0x7f48880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.687+0000 7f488effd640 1 -- 172.21.15.45:0/100401763 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488803f030 con 0x7f48981037a0 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.687+0000 7f489fd09640 1 -- 172.21.15.45:0/100401763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489819d910 con 0x7f48981037a0 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.687+0000 7f488effd640 1 -- 172.21.15.45:0/100401763 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4888003d00 con 0x7f48981037a0 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.687+0000 7f488effd640 1 -- 172.21.15.45:0/100401763 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888035070 con 0x7f48981037a0 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.687+0000 7f489fd09640 1 -- 172.21.15.45:0/100401763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48981a5250 con 0x7f48981037a0 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.689+0000 7f488effd640 1 -- 172.21.15.45:0/100401763 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4888042030 con 0x7f48981037a0 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f48a20e2740 1 Processor -- start 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f48a20e2740 1 -- start start 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f48a20e2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb5f50 0x5614f0fb44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f48a20e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb49e0 0x5614f0fb4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f48a20e2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fbf780 0x5614f0fc1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f48a20e2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5614f0f162f0 con 0x5614f0fb5f50 2024-09-15T22:24:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f48a20e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5614f0ebdcf0 con 0x5614f0fb49e0 2024-09-15T22:24:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f48a20e2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5614f0f122b0 con 0x5614f0fbf780 2024-09-15T22:24:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f489e2a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb5f50 0x5614f0fb44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f489e2a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb5f50 0x5614f0fb44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44350/0 (socket says 172.21.15.45:44350) 2024-09-15T22:24:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f489e2a6640 1 -- 172.21.15.45:0/541584695 learned_addr learned my addr 172.21.15.45:0/541584695 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f489daa5640 1 --2- 172.21.15.45:0/541584695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb49e0 0x5614f0fb4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f488effd640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f48840a33b0 0x7f48840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f489d2a4640 1 --2- 172.21.15.45:0/541584695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fbf780 0x5614f0fc1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.690+0000 7f489e2a6640 1 -- 172.21.15.45:0/541584695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fbf780 msgr2=0x5614f0fc1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.691+0000 7f489e2a6640 1 --2- 172.21.15.45:0/541584695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fbf780 0x5614f0fc1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.691+0000 7f489e2a6640 1 -- 172.21.15.45:0/541584695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb49e0 msgr2=0x5614f0fb4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:41.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.691+0000 7f489e2a6640 1 --2- 172.21.15.45:0/541584695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb49e0 0x5614f0fb4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.691+0000 7f489e2a6640 1 -- 172.21.15.45:0/541584695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f0ea23a0 con 0x5614f0fb5f50 2024-09-15T22:24:41.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.691+0000 7f489daa5640 1 --2- 172.21.15.45:0/541584695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb49e0 0x5614f0fb4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:41.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.691+0000 7f489d2a4640 1 --2- 172.21.15.45:0/541584695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fbf780 0x5614f0fc1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:24:41.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.691+0000 7f488effd640 1 -- 172.21.15.45:0/100401763 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f48880f0760 con 0x7f48981037a0 2024-09-15T22:24:41.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.691+0000 7f489e2a6640 1 --2- 172.21.15.45:0/541584695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb5f50 0x5614f0fb44a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4890007f40 tx=0x7f489000f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a762b061e33cb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:41.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.691+0000 7f489e2a6640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f48840a33b0 0x7f48840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.691+0000 7f4883fff640 1 -- 172.21.15.45:0/541584695 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4890010b20 con 0x5614f0fb5f50 2024-09-15T22:24:41.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.691+0000 7f4883fff640 1 -- 172.21.15.45:0/541584695 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f489001ae20 con 0x5614f0fb5f50 2024-09-15T22:24:41.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.691+0000 7f4883fff640 1 -- 172.21.15.45:0/541584695 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4890019cf0 con 0x5614f0fb5f50 2024-09-15T22:24:41.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.692+0000 7f48a20e2740 1 -- 172.21.15.45:0/541584695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb5f50 msgr2=0x5614f0fb44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.692+0000 7f48a20e2740 1 --2- 172.21.15.45:0/541584695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb5f50 0x5614f0fb44a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4890007f40 tx=0x7f489000f850 comp rx=0 tx=0).stop 2024-09-15T22:24:41.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.692+0000 7f489e2a6640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f48840a33b0 0x7f48840a5870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f489001e000 tx=0x7f489001f000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:41.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.692+0000 7f48a20e2740 1 -- 172.21.15.45:0/541584695 shutdown_connections 2024-09-15T22:24:41.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.692+0000 7f48a20e2740 1 --2- 172.21.15.45:0/541584695 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fbf780 0x5614f0fc1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.692+0000 7f48a20e2740 1 --2- 172.21.15.45:0/541584695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb49e0 0x5614f0fb4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.692+0000 7f48a20e2740 1 --2- 172.21.15.45:0/541584695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb5f50 0x5614f0fb44a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.692+0000 7f48a20e2740 1 -- 172.21.15.45:0/541584695 >> 172.21.15.45:0/541584695 conn(0x5614f0f79310 msgr2=0x5614f0fb1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:41.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.692+0000 7f48a20e2740 1 -- 172.21.15.45:0/541584695 shutdown_connections 2024-09-15T22:24:41.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.692+0000 7f48a20e2740 1 -- 172.21.15.45:0/541584695 wait complete. 2024-09-15T22:24:41.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.692+0000 7f48a20e2740 1 -- start start 2024-09-15T22:24:41.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.692+0000 7f48a20e2740 1 Processor -- start 2024-09-15T22:24:41.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f48a20e2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 0x5614f0fbf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f48a20e2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fb5f50 0x5614f0fbc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f48a20e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fbf780 0x5614f0fbc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f48a20e2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5614f0fc2480 con 0x5614f0fb49e0 2024-09-15T22:24:41.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f48a20e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5614f0ed1060 con 0x5614f0fbf780 2024-09-15T22:24:41.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f48a20e2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5614f0fc2600 con 0x5614f0fb5f50 2024-09-15T22:24:41.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f48a20e2740 10 client.0 _ll_register_callbacks cb 0x5614f0c248c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:41.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f489daa5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 0x5614f0fbf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f489daa5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 0x5614f0fbf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44354/0 (socket says 172.21.15.45:44354) 2024-09-15T22:24:41.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f489daa5640 1 -- 172.21.15.45:0/3017902973 learned_addr learned my addr 172.21.15.45:0/3017902973 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:41.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f489d2a4640 1 --2- 172.21.15.45:0/3017902973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fb5f50 0x5614f0fbc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f489e2a6640 1 --2- 172.21.15.45:0/3017902973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fbf780 0x5614f0fbc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f489daa5640 1 -- 172.21.15.45:0/3017902973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fb5f50 msgr2=0x5614f0fbc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:41.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f489daa5640 1 --2- 172.21.15.45:0/3017902973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fb5f50 0x5614f0fbc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f489daa5640 1 -- 172.21.15.45:0/3017902973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fbf780 msgr2=0x5614f0fbc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:41.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f489daa5640 1 --2- 172.21.15.45:0/3017902973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fbf780 0x5614f0fbc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.693+0000 7f489daa5640 1 -- 172.21.15.45:0/3017902973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614f0c873c0 con 0x5614f0fb49e0 2024-09-15T22:24:41.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f489daa5640 1 --2- 172.21.15.45:0/3017902973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 0x5614f0fbf140 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f489400bf10 tx=0x7f489400f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5493a1bffe7672b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:41.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48817fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:41.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48817fa640 1 -- 172.21.15.45:0/3017902973 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4894019020 con 0x5614f0fb49e0 2024-09-15T22:24:41.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48817fa640 1 -- 172.21.15.45:0/3017902973 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f4894014660 con 0x5614f0fb49e0 2024-09-15T22:24:41.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48a20e2740 1 -- 172.21.15.45:0/3017902973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f489001ae20 con 0x5614f0fb49e0 2024-09-15T22:24:41.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48817fa640 1 -- 172.21.15.45:0/3017902973 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4894024050 con 0x5614f0fb49e0 2024-09-15T22:24:41.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48a20e2740 10 client.16815 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:41.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48a20e2740 1 -- 172.21.15.45:0/3017902973 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5614f0fcdeb0 con 0x5614f0fb49e0 2024-09-15T22:24:41.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48817fa640 1 -- 172.21.15.45:0/3017902973 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f489001ae20 con 0x5614f0fb49e0 2024-09-15T22:24:41.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48817fa640 1 -- 172.21.15.45:0/3017902973 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f4894015bb0 con 0x5614f0fb49e0 2024-09-15T22:24:41.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48a20e2740 10 client.16815 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:41.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48a20e2740 10 client.16815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:41.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48a20e2740 20 client.16815 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:41.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48a20e2740 1 --2- 172.21.15.45:0/3017902973 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5614f0fcf370 0x5614f0fd1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48a20e2740 4 client.16815 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:41.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.694+0000 7f48a20e2740 1 -- 172.21.15.45:0/3017902973 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614f0f23860 con 0x5614f0fcf370 2024-09-15T22:24:41.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.695+0000 7f489d2a4640 1 --2- 172.21.15.45:0/3017902973 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5614f0fcf370 0x5614f0fd1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.695+0000 7f489d2a4640 1 --2- 172.21.15.45:0/3017902973 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5614f0fcf370 0x5614f0fd1780 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cea920bfc8a91bf9 server_cookie=bdae075ee2191ec in_seq=0 out_seq=0 2024-09-15T22:24:41.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.695+0000 7f48817fa640 10 client.16815 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:41.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48817fa640 1 -- 172.21.15.45:0/3017902973 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614f0f23860 con 0x5614f0fcf370 2024-09-15T22:24:41.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48817fa640 10 client.16815 handle_command_reply: tid=0 2024-09-15T22:24:41.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48a20e2740 1 client.16815 shutdown 2024-09-15T22:24:41.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48a20e2740 1 -- 172.21.15.45:0/3017902973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 msgr2=0x5614f0fbf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48a20e2740 1 --2- 172.21.15.45:0/3017902973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 0x5614f0fbf140 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f489400bf10 tx=0x7f489400f5b0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48a20e2740 1 -- 172.21.15.45:0/3017902973 shutdown_connections 2024-09-15T22:24:41.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48a20e2740 1 --2- 172.21.15.45:0/3017902973 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5614f0fcf370 0x5614f0fd1780 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48a20e2740 1 --2- 172.21.15.45:0/3017902973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fbf780 0x5614f0fbc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48a20e2740 1 --2- 172.21.15.45:0/3017902973 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fb5f50 0x5614f0fbc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48817fa640 0 client.16815 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:41.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48a20e2740 1 --2- 172.21.15.45:0/3017902973 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 0x5614f0fbf140 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48a20e2740 1 -- 172.21.15.45:0/3017902973 >> 172.21.15.45:0/3017902973 conn(0x5614f0f79310 msgr2=0x5614f0fb6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:41.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48a20e2740 1 -- 172.21.15.45:0/3017902973 shutdown_connections 2024-09-15T22:24:41.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48a20e2740 1 -- 172.21.15.45:0/3017902973 wait complete. 2024-09-15T22:24:41.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.696+0000 7f48a20e2740 20 client.16815 trim_cache size 0 max 16384 2024-09-15T22:24:41.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.709+0000 7f48a20e2740 1 Processor -- start 2024-09-15T22:24:41.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.709+0000 7f48a20e2740 1 -- start start 2024-09-15T22:24:41.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.709+0000 7f48a20e2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 0x5614f0fabc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.709+0000 7f48a20e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb5f50 0x5614f0fb7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.709+0000 7f48a20e2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fbf780 0x5614f0fb7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.709+0000 7f48a20e2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f48981ab060 con 0x5614f0fb49e0 2024-09-15T22:24:41.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.709+0000 7f48a20e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48981ad8e0 con 0x5614f0fb5f50 2024-09-15T22:24:41.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.709+0000 7f48a20e2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f48981ab6d0 con 0x5614f0fbf780 2024-09-15T22:24:41.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f489daa5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 0x5614f0fabc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f489daa5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 0x5614f0fabc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44368/0 (socket says 172.21.15.45:44368) 2024-09-15T22:24:41.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f489daa5640 1 -- 172.21.15.45:0/4199093147 learned_addr learned my addr 172.21.15.45:0/4199093147 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:41.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f489daa5640 1 -- 172.21.15.45:0/4199093147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fbf780 msgr2=0x5614f0fb7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:41.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f489e2a6640 1 --2- 172.21.15.45:0/4199093147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fbf780 0x5614f0fb7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f489d2a4640 1 --2- 172.21.15.45:0/4199093147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb5f50 0x5614f0fb7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f489daa5640 1 --2- 172.21.15.45:0/4199093147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fbf780 0x5614f0fb7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f489daa5640 1 -- 172.21.15.45:0/4199093147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb5f50 msgr2=0x5614f0fb7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:41.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f489daa5640 1 --2- 172.21.15.45:0/4199093147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb5f50 0x5614f0fb7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f489daa5640 1 -- 172.21.15.45:0/4199093147 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614f0fba940 con 0x5614f0fb49e0 2024-09-15T22:24:41.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f489e2a6640 1 --2- 172.21.15.45:0/4199093147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fbf780 0x5614f0fb7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:24:41.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f489daa5640 1 --2- 172.21.15.45:0/4199093147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 0x5614f0fabc10 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4894001eb0 tx=0x7f489400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c7d13897d51905 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:41.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f48837fe640 1 -- 172.21.15.45:0/4199093147 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4894019040 con 0x5614f0fb49e0 2024-09-15T22:24:41.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f48837fe640 1 -- 172.21.15.45:0/4199093147 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4894013c80 con 0x5614f0fb49e0 2024-09-15T22:24:41.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.710+0000 7f48837fe640 1 -- 172.21.15.45:0/4199093147 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4894014d90 con 0x5614f0fb49e0 2024-09-15T22:24:41.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.711+0000 7f48a20e2740 1 -- 172.21.15.45:0/4199093147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 msgr2=0x5614f0fabc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.711+0000 7f48a20e2740 1 --2- 172.21.15.45:0/4199093147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 0x5614f0fabc10 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4894001eb0 tx=0x7f489400b420 comp rx=0 tx=0).stop 2024-09-15T22:24:41.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.711+0000 7f48a20e2740 1 -- 172.21.15.45:0/4199093147 shutdown_connections 2024-09-15T22:24:41.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.711+0000 7f48a20e2740 1 --2- 172.21.15.45:0/4199093147 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fbf780 0x5614f0fb7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.711+0000 7f48a20e2740 1 --2- 172.21.15.45:0/4199093147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb5f50 0x5614f0fb7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.711+0000 7f48a20e2740 1 --2- 172.21.15.45:0/4199093147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fb49e0 0x5614f0fabc10 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.711+0000 7f48a20e2740 1 -- 172.21.15.45:0/4199093147 >> 172.21.15.45:0/4199093147 conn(0x5614f0f79310 msgr2=0x5614f0fab500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:41.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.711+0000 7f48a20e2740 1 -- 172.21.15.45:0/4199093147 shutdown_connections 2024-09-15T22:24:41.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.711+0000 7f48a20e2740 1 -- 172.21.15.45:0/4199093147 wait complete. 2024-09-15T22:24:41.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.711+0000 7f48a20e2740 1 -- start start 2024-09-15T22:24:41.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.711+0000 7f48a20e2740 1 Processor -- start 2024-09-15T22:24:41.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f48a20e2740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fb49e0 0x5614f0fc3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f48a20e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb5f50 0x5614f0fc3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f48a20e2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fbf780 0x5614f0fc41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f48a20e2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f48981abda0 con 0x5614f0fbf780 2024-09-15T22:24:41.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f48a20e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f48981ad210 con 0x5614f0fb5f50 2024-09-15T22:24:41.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f48a20e2740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f48981ac470 con 0x5614f0fb49e0 2024-09-15T22:24:41.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f48a20e2740 10 client.0 _ll_register_callbacks cb 0x7f489400b220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:41.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f489e2a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fbf780 0x5614f0fc41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f489e2a6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fbf780 0x5614f0fc41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44380/0 (socket says 172.21.15.45:44380) 2024-09-15T22:24:41.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f489e2a6640 1 -- 172.21.15.45:0/2097347998 learned_addr learned my addr 172.21.15.45:0/2097347998 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:41.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f489d2a4640 1 --2- 172.21.15.45:0/2097347998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb5f50 0x5614f0fc3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f489daa5640 1 --2- 172.21.15.45:0/2097347998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fb49e0 0x5614f0fc3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f489e2a6640 1 -- 172.21.15.45:0/2097347998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fb49e0 msgr2=0x5614f0fc3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:41.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f489e2a6640 1 --2- 172.21.15.45:0/2097347998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fb49e0 0x5614f0fc3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.763 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:24:41.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f489e2a6640 1 -- 172.21.15.45:0/2097347998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb5f50 msgr2=0x5614f0fc3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:41.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f489e2a6640 1 --2- 172.21.15.45:0/2097347998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb5f50 0x5614f0fc3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f489e2a6640 1 -- 172.21.15.45:0/2097347998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614f10391c0 con 0x5614f0fbf780 2024-09-15T22:24:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f489e2a6640 1 --2- 172.21.15.45:0/2097347998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fbf780 0x5614f0fc41e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4890007f40 tx=0x7f4890007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8719b5bf35719c55 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.712+0000 7f48817fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48817fa640 1 -- 172.21.15.45:0/2097347998 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4890007b30 con 0x5614f0fbf780 2024-09-15T22:24:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48817fa640 1 -- 172.21.15.45:0/2097347998 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f489002c050 con 0x5614f0fbf780 2024-09-15T22:24:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48a20e2740 1 -- 172.21.15.45:0/2097347998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4894013c80 con 0x5614f0fbf780 2024-09-15T22:24:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48817fa640 1 -- 172.21.15.45:0/2097347998 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f489003e050 con 0x5614f0fbf780 2024-09-15T22:24:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48a20e2740 10 client.16821 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48a20e2740 1 -- 172.21.15.45:0/2097347998 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5614f103a3d0 con 0x5614f0fbf780 2024-09-15T22:24:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48817fa640 1 -- 172.21.15.45:0/2097347998 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4894013c80 con 0x5614f0fbf780 2024-09-15T22:24:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48817fa640 1 -- 172.21.15.45:0/2097347998 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f489001a8a0 con 0x5614f0fbf780 2024-09-15T22:24:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48a20e2740 10 client.16821 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:41.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48a20e2740 10 client.16821 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:41.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48a20e2740 20 client.16821 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:41.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48a20e2740 1 --2- 172.21.15.45:0/2097347998 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5614f103a860 0x5614f103cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:41.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48a20e2740 4 client.16821 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:24:41.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.713+0000 7f48a20e2740 1 -- 172.21.15.45:0/2097347998 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5614f0f1dd70 con 0x5614f103a860 2024-09-15T22:24:41.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f489daa5640 1 --2- 172.21.15.45:0/2097347998 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5614f103a860 0x5614f103cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:41.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f489daa5640 1 --2- 172.21.15.45:0/2097347998 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5614f103a860 0x5614f103cc80 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73ea8b5e871f63f6 server_cookie=9028db9e94370a9 in_seq=0 out_seq=0 2024-09-15T22:24:41.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48817fa640 10 client.16821 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:41.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48817fa640 1 -- 172.21.15.45:0/2097347998 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5614f0f1dd70 con 0x5614f103a860 2024-09-15T22:24:41.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48817fa640 10 client.16821 handle_command_reply: tid=0 2024-09-15T22:24:41.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48a20e2740 1 client.16821 shutdown 2024-09-15T22:24:41.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48a20e2740 1 -- 172.21.15.45:0/2097347998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fbf780 msgr2=0x5614f0fc41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48a20e2740 1 --2- 172.21.15.45:0/2097347998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fbf780 0x5614f0fc41e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4890007f40 tx=0x7f4890007940 comp rx=0 tx=0).stop 2024-09-15T22:24:41.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48a20e2740 1 -- 172.21.15.45:0/2097347998 shutdown_connections 2024-09-15T22:24:41.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48a20e2740 1 --2- 172.21.15.45:0/2097347998 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5614f103a860 0x5614f103cc80 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48a20e2740 1 --2- 172.21.15.45:0/2097347998 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5614f0fbf780 0x5614f0fc41e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48a20e2740 1 --2- 172.21.15.45:0/2097347998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5614f0fb5f50 0x5614f0fc3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48a20e2740 1 --2- 172.21.15.45:0/2097347998 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5614f0fb49e0 0x5614f0fc3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48a20e2740 1 -- 172.21.15.45:0/2097347998 >> 172.21.15.45:0/2097347998 conn(0x5614f0f79310 msgr2=0x5614f0fabd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:41.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48817fa640 0 client.16821 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:41.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48a20e2740 1 -- 172.21.15.45:0/2097347998 shutdown_connections 2024-09-15T22:24:41.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.714+0000 7f48a20e2740 1 -- 172.21.15.45:0/2097347998 wait complete. 2024-09-15T22:24:41.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.715+0000 7f48a20e2740 20 client.16821 trim_cache size 0 max 16384 2024-09-15T22:24:41.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.715+0000 7f489fd09640 1 -- 172.21.15.45:0/100401763 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f48840a33b0 msgr2=0x7f48840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.715+0000 7f489fd09640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f48840a33b0 0x7f48840a5870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f489001e000 tx=0x7f489001f000 comp rx=0 tx=0).stop 2024-09-15T22:24:41.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.715+0000 7f489fd09640 1 -- 172.21.15.45:0/100401763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48981037a0 msgr2=0x7f4898198c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:41.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.715+0000 7f489fd09640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48981037a0 0x7f4898198c10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4888005940 tx=0x7f48880042f0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.715+0000 7f489fd09640 1 -- 172.21.15.45:0/100401763 shutdown_connections 2024-09-15T22:24:41.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.715+0000 7f489fd09640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f48840a33b0 0x7f48840a5870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.715+0000 7f489fd09640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f489810c2f0 0x7f489819cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.715+0000 7f489fd09640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48981037a0 0x7f4898198c10 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.715+0000 7f489fd09640 1 --2- 172.21.15.45:0/100401763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4898102df0 0x7f48981986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:41.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.715+0000 7f489fd09640 1 -- 172.21.15.45:0/100401763 >> 172.21.15.45:0/100401763 conn(0x7f48980fc7d0 msgr2=0x7f48980fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:41.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.715+0000 7f489fd09640 1 -- 172.21.15.45:0/100401763 shutdown_connections 2024-09-15T22:24:41.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:41.715+0000 7f489fd09640 1 -- 172.21.15.45:0/100401763 wait complete. 2024-09-15T22:24:43.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:42 smithi045 ceph-mon[31180]: pgmap v261: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:43.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:42 smithi165 ceph-mon[35551]: pgmap v261: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:43.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:42 smithi100 ceph-mon[35319]: pgmap v261: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:43.518 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:24:43.519 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:24:43.794 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:44.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.299+0000 7f1209ccb640 1 -- 172.21.15.45:0/3576223037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1204106a80 msgr2=0x7f1204106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:44.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.299+0000 7f1209ccb640 1 --2- 172.21.15.45:0/3576223037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1204106a80 0x7f1204106e60 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009930 tx=0x7f11f402a420 comp rx=0 tx=0).stop 2024-09-15T22:24:44.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.299+0000 7f1209ccb640 1 -- 172.21.15.45:0/3576223037 shutdown_connections 2024-09-15T22:24:44.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.299+0000 7f1209ccb640 1 --2- 172.21.15.45:0/3576223037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1204101420 0x7f120410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.299+0000 7f1209ccb640 1 --2- 172.21.15.45:0/3576223037 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1204100a80 0x7f1204100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.299+0000 7f1209ccb640 1 --2- 172.21.15.45:0/3576223037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1204106a80 0x7f1204106e60 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.299+0000 7f1209ccb640 1 -- 172.21.15.45:0/3576223037 >> 172.21.15.45:0/3576223037 conn(0x7f12040fc7a0 msgr2=0x7f12040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:44.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.299+0000 7f1209ccb640 1 -- 172.21.15.45:0/3576223037 shutdown_connections 2024-09-15T22:24:44.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.299+0000 7f1209ccb640 1 -- 172.21.15.45:0/3576223037 wait complete. 2024-09-15T22:24:44.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.299+0000 7f1209ccb640 1 Processor -- start 2024-09-15T22:24:44.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1209ccb640 1 -- start start 2024-09-15T22:24:44.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1209ccb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1204100a80 0x7f12041985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1209ccb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1204101420 0x7f1204198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1209ccb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1204106a80 0x7f120419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1209ccb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1204110fe0 con 0x7f1204101420 2024-09-15T22:24:44.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1209ccb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1204110e60 con 0x7f1204106a80 2024-09-15T22:24:44.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1209ccb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f1204111160 con 0x7f1204100a80 2024-09-15T22:24:44.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1202ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1204101420 0x7f1204198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1202ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1204101420 0x7f1204198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52582/0 (socket says 172.21.15.45:52582) 2024-09-15T22:24:44.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1202ffd640 1 -- 172.21.15.45:0/2247172778 learned_addr learned my addr 172.21.15.45:0/2247172778 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:44.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f12037fe640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1204100a80 0x7f12041985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1203fff640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1204106a80 0x7f120419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1202ffd640 1 -- 172.21.15.45:0/2247172778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1204100a80 msgr2=0x7f12041985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:44.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1202ffd640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1204100a80 0x7f12041985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1202ffd640 1 -- 172.21.15.45:0/2247172778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1204106a80 msgr2=0x7f120419cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:44.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1202ffd640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1204106a80 0x7f120419cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f1202ffd640 1 -- 172.21.15.45:0/2247172778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120419d580 con 0x7f1204101420 2024-09-15T22:24:44.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.300+0000 7f12037fe640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1204100a80 0x7f12041985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:44.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.301+0000 7f1202ffd640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1204101420 0x7f1204198b10 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f11f800b4a0 tx=0x7f11f800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:44.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.301+0000 7f1200ff9640 1 -- 172.21.15.45:0/2247172778 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8014070 con 0x7f1204101420 2024-09-15T22:24:44.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.301+0000 7f1200ff9640 1 -- 172.21.15.45:0/2247172778 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11f8010b10 con 0x7f1204101420 2024-09-15T22:24:44.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.301+0000 7f1209ccb640 1 -- 172.21.15.45:0/2247172778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120419d870 con 0x7f1204101420 2024-09-15T22:24:44.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.301+0000 7f1200ff9640 1 -- 172.21.15.45:0/2247172778 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8017d60 con 0x7f1204101420 2024-09-15T22:24:44.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.301+0000 7f1209ccb640 1 -- 172.21.15.45:0/2247172778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12041a5150 con 0x7f1204101420 2024-09-15T22:24:44.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.303+0000 7f1200ff9640 1 -- 172.21.15.45:0/2247172778 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f11f8017070 con 0x7f1204101420 2024-09-15T22:24:44.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.303+0000 7f120c0a4740 1 Processor -- start 2024-09-15T22:24:44.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f120c0a4740 1 -- start start 2024-09-15T22:24:44.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f120c0a4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c0a20 0x561fff2c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f120c0a4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f120c0a4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2d0150 0x561fff2d2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f120c0a4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561fff226280 con 0x561fff2c0a20 2024-09-15T22:24:44.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f120c0a4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561fff1cdb10 con 0x561fff2c1340 2024-09-15T22:24:44.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f120c0a4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561fff222240 con 0x561fff2d0150 2024-09-15T22:24:44.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f1203fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c0a20 0x561fff2c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f1203fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c0a20 0x561fff2c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52594/0 (socket says 172.21.15.45:52594) 2024-09-15T22:24:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f1203fff640 1 -- 172.21.15.45:0/2228371273 learned_addr learned my addr 172.21.15.45:0/2228371273 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f12037fe640 1 --2- 172.21.15.45:0/2228371273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f1202ffd640 1 --2- 172.21.15.45:0/2228371273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2d0150 0x561fff2d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f1200ff9640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f11ec0a33b0 0x7f11ec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f1203fff640 1 -- 172.21.15.45:0/2228371273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2d0150 msgr2=0x561fff2d2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f1203fff640 1 --2- 172.21.15.45:0/2228371273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2d0150 0x561fff2d2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f1203fff640 1 -- 172.21.15.45:0/2228371273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 msgr2=0x561fff2cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f1203fff640 1 --2- 172.21.15.45:0/2228371273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f1203fff640 1 -- 172.21.15.45:0/2228371273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fff1da1f0 con 0x561fff2c0a20 2024-09-15T22:24:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f12037fe640 1 --2- 172.21.15.45:0/2228371273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.304+0000 7f1200ff9640 1 -- 172.21.15.45:0/2247172778 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f11f80cf400 con 0x7f1204101420 2024-09-15T22:24:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.305+0000 7f1203fff640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f11ec0a33b0 0x7f11ec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.305+0000 7f1203fff640 1 --2- 172.21.15.45:0/2228371273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c0a20 0x561fff2c0e00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f11fc010370 tx=0x7f11fc010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad0e3f7e50b93e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.305+0000 7f11e9ffb640 1 -- 172.21.15.45:0/2228371273 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc022070 con 0x561fff2c0a20 2024-09-15T22:24:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.305+0000 7f11e9ffb640 1 -- 172.21.15.45:0/2228371273 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11fc0113e0 con 0x561fff2c0a20 2024-09-15T22:24:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.305+0000 7f11e9ffb640 1 -- 172.21.15.45:0/2228371273 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc016070 con 0x561fff2c0a20 2024-09-15T22:24:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.306+0000 7f120c0a4740 1 -- 172.21.15.45:0/2228371273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c0a20 msgr2=0x561fff2c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.306+0000 7f120c0a4740 1 --2- 172.21.15.45:0/2228371273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c0a20 0x561fff2c0e00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f11fc010370 tx=0x7f11fc010830 comp rx=0 tx=0).stop 2024-09-15T22:24:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.306+0000 7f1203fff640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f11ec0a33b0 0x7f11ec0a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f11fc01f000 tx=0x7f11fc022000 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:44.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.306+0000 7f120c0a4740 1 -- 172.21.15.45:0/2228371273 shutdown_connections 2024-09-15T22:24:44.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.306+0000 7f120c0a4740 1 --2- 172.21.15.45:0/2228371273 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2d0150 0x561fff2d2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.306+0000 7f120c0a4740 1 --2- 172.21.15.45:0/2228371273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.306+0000 7f120c0a4740 1 --2- 172.21.15.45:0/2228371273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c0a20 0x561fff2c0e00 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.306+0000 7f120c0a4740 1 -- 172.21.15.45:0/2228371273 >> 172.21.15.45:0/2228371273 conn(0x561fff2bd0f0 msgr2=0x561fff2bd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:44.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.306+0000 7f120c0a4740 1 -- 172.21.15.45:0/2228371273 shutdown_connections 2024-09-15T22:24:44.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.306+0000 7f120c0a4740 1 -- 172.21.15.45:0/2228371273 wait complete. 2024-09-15T22:24:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.306+0000 7f120c0a4740 1 -- start start 2024-09-15T22:24:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.306+0000 7f120c0a4740 1 Processor -- start 2024-09-15T22:24:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f120c0a4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2c0a20 0x561fff2cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f120c0a4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f120c0a4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 0x561fff2cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f120c0a4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561fff2d2d20 con 0x561fff2d0150 2024-09-15T22:24:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f120c0a4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x561fff1e0f10 con 0x561fff2c1340 2024-09-15T22:24:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f120c0a4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x561fff2d2ea0 con 0x561fff2c0a20 2024-09-15T22:24:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f120c0a4740 10 client.0 _ll_register_callbacks cb 0x561fff1a9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f1203fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 0x561fff2cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f1203fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 0x561fff2cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52608/0 (socket says 172.21.15.45:52608) 2024-09-15T22:24:44.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f1203fff640 1 -- 172.21.15.45:0/2543499267 learned_addr learned my addr 172.21.15.45:0/2543499267 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:44.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f1202ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f12037fe640 1 --2- 172.21.15.45:0/2543499267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2c0a20 0x561fff2cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f1203fff640 1 -- 172.21.15.45:0/2543499267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2c0a20 msgr2=0x561fff2cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:44.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f1203fff640 1 --2- 172.21.15.45:0/2543499267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2c0a20 0x561fff2cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f1203fff640 1 -- 172.21.15.45:0/2543499267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 msgr2=0x561fff2cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:44.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f1203fff640 1 --2- 172.21.15.45:0/2543499267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f1203fff640 1 -- 172.21.15.45:0/2543499267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ffef976a0 con 0x561fff2d0150 2024-09-15T22:24:44.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f1202ffd640 1 --2- 172.21.15.45:0/2543499267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:24:44.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f1203fff640 1 --2- 172.21.15.45:0/2543499267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 0x561fff2cdb70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f11fc006010 tx=0x7f11fc012a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cba9d834c8d383a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:44.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.307+0000 7f11e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:44.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f11e2ffd640 1 -- 172.21.15.45:0/2543499267 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc016050 con 0x561fff2d0150 2024-09-15T22:24:44.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f11e2ffd640 1 -- 172.21.15.45:0/2543499267 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f11fc01ca60 con 0x561fff2d0150 2024-09-15T22:24:44.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f120c0a4740 1 -- 172.21.15.45:0/2543499267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11fc0113e0 con 0x561fff2d0150 2024-09-15T22:24:44.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f11e2ffd640 1 -- 172.21.15.45:0/2543499267 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f11fc03a050 con 0x561fff2d0150 2024-09-15T22:24:44.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f120c0a4740 10 client.16833 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:44.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f120c0a4740 1 -- 172.21.15.45:0/2543499267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561fff2dea20 con 0x561fff2d0150 2024-09-15T22:24:44.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f11e2ffd640 1 -- 172.21.15.45:0/2543499267 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11fc0113e0 con 0x561fff2d0150 2024-09-15T22:24:44.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f11e2ffd640 1 -- 172.21.15.45:0/2543499267 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f11fc02e030 con 0x561fff2d0150 2024-09-15T22:24:44.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f120c0a4740 10 client.16833 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:44.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f120c0a4740 10 client.16833 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f120c0a4740 20 client.16833 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f120c0a4740 1 --2- 172.21.15.45:0/2543499267 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561fff2dfe20 0x561fff2e2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f120c0a4740 4 client.16833 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.308+0000 7f120c0a4740 1 -- 172.21.15.45:0/2543499267 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fff2337f0 con 0x561fff2dfe20 2024-09-15T22:24:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.309+0000 7f12037fe640 1 --2- 172.21.15.45:0/2543499267 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561fff2dfe20 0x561fff2e2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.309+0000 7f11e2ffd640 10 client.16833 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.309+0000 7f12037fe640 1 --2- 172.21.15.45:0/2543499267 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561fff2dfe20 0x561fff2e2210 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ad783fd8ad73cf6 server_cookie=e183c92ca00da5d2 in_seq=0 out_seq=0 2024-09-15T22:24:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f11e2ffd640 1 -- 172.21.15.45:0/2543499267 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fff2337f0 con 0x561fff2dfe20 2024-09-15T22:24:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f11e2ffd640 10 client.16833 handle_command_reply: tid=0 2024-09-15T22:24:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f120c0a4740 1 client.16833 shutdown 2024-09-15T22:24:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f120c0a4740 1 -- 172.21.15.45:0/2543499267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 msgr2=0x561fff2cdb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f120c0a4740 1 --2- 172.21.15.45:0/2543499267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 0x561fff2cdb70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f11fc006010 tx=0x7f11fc012a80 comp rx=0 tx=0).stop 2024-09-15T22:24:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f120c0a4740 1 -- 172.21.15.45:0/2543499267 shutdown_connections 2024-09-15T22:24:44.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f120c0a4740 1 --2- 172.21.15.45:0/2543499267 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561fff2dfe20 0x561fff2e2210 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f120c0a4740 1 --2- 172.21.15.45:0/2543499267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 0x561fff2cdb70 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f120c0a4740 1 --2- 172.21.15.45:0/2543499267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f120c0a4740 1 --2- 172.21.15.45:0/2543499267 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2c0a20 0x561fff2cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f11e2ffd640 0 client.16833 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:44.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f120c0a4740 1 -- 172.21.15.45:0/2543499267 >> 172.21.15.45:0/2543499267 conn(0x561fff2bd0f0 msgr2=0x561fff2c2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:44.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f120c0a4740 1 -- 172.21.15.45:0/2543499267 shutdown_connections 2024-09-15T22:24:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f120c0a4740 1 -- 172.21.15.45:0/2543499267 wait complete. 2024-09-15T22:24:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.310+0000 7f120c0a4740 20 client.16833 trim_cache size 0 max 16384 2024-09-15T22:24:44.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f120c0a4740 1 Processor -- start 2024-09-15T22:24:44.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f120c0a4740 1 -- start start 2024-09-15T22:24:44.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f120c0a4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2c0a20 0x561fff2e7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f120c0a4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2e7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f120c0a4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 0x561fff2d8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f120c0a4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f12041ab190 con 0x561fff2d0150 2024-09-15T22:24:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f120c0a4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f12041ada10 con 0x561fff2c1340 2024-09-15T22:24:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f120c0a4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f12041ab800 con 0x561fff2c0a20 2024-09-15T22:24:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f1203fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 0x561fff2d8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f1203fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 0x561fff2d8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52612/0 (socket says 172.21.15.45:52612) 2024-09-15T22:24:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f1203fff640 1 -- 172.21.15.45:0/3983858311 learned_addr learned my addr 172.21.15.45:0/3983858311 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f1202ffd640 1 --2- 172.21.15.45:0/3983858311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2e7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f12037fe640 1 --2- 172.21.15.45:0/3983858311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2c0a20 0x561fff2e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f1203fff640 1 -- 172.21.15.45:0/3983858311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2c0a20 msgr2=0x561fff2e7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f1203fff640 1 --2- 172.21.15.45:0/3983858311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2c0a20 0x561fff2e7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f1203fff640 1 -- 172.21.15.45:0/3983858311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 msgr2=0x561fff2e7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f1203fff640 1 --2- 172.21.15.45:0/3983858311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2e7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f1203fff640 1 -- 172.21.15.45:0/3983858311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fff2cf9c0 con 0x561fff2d0150 2024-09-15T22:24:44.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f12037fe640 1 --2- 172.21.15.45:0/3983858311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2c0a20 0x561fff2e7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:24:44.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.328+0000 7f1203fff640 1 --2- 172.21.15.45:0/3983858311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 0x561fff2d8120 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009640 tx=0x7f11fc000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5d88fe0624539d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:44.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.329+0000 7f11e97fa640 1 -- 172.21.15.45:0/3983858311 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc016070 con 0x561fff2d0150 2024-09-15T22:24:44.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.329+0000 7f11e97fa640 1 -- 172.21.15.45:0/3983858311 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11fc0113e0 con 0x561fff2d0150 2024-09-15T22:24:44.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.329+0000 7f11e97fa640 1 -- 172.21.15.45:0/3983858311 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc003f40 con 0x561fff2d0150 2024-09-15T22:24:44.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.329+0000 7f120c0a4740 1 -- 172.21.15.45:0/3983858311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 msgr2=0x561fff2d8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:44.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.329+0000 7f120c0a4740 1 --2- 172.21.15.45:0/3983858311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 0x561fff2d8120 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009640 tx=0x7f11fc000f40 comp rx=0 tx=0).stop 2024-09-15T22:24:44.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.329+0000 7f120c0a4740 1 -- 172.21.15.45:0/3983858311 shutdown_connections 2024-09-15T22:24:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.329+0000 7f120c0a4740 1 --2- 172.21.15.45:0/3983858311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2d0150 0x561fff2d8120 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.329+0000 7f120c0a4740 1 --2- 172.21.15.45:0/3983858311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c1340 0x561fff2e7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.329+0000 7f120c0a4740 1 --2- 172.21.15.45:0/3983858311 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2c0a20 0x561fff2e7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.329+0000 7f120c0a4740 1 -- 172.21.15.45:0/3983858311 >> 172.21.15.45:0/3983858311 conn(0x561fff2bd0f0 msgr2=0x561fff2cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.329+0000 7f120c0a4740 1 -- 172.21.15.45:0/3983858311 shutdown_connections 2024-09-15T22:24:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.329+0000 7f120c0a4740 1 -- 172.21.15.45:0/3983858311 wait complete. 2024-09-15T22:24:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.330+0000 7f120c0a4740 1 -- start start 2024-09-15T22:24:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.330+0000 7f120c0a4740 1 Processor -- start 2024-09-15T22:24:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.330+0000 7f120c0a4740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c0a20 0x561fff2d59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.330+0000 7f120c0a4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c1340 0x561fff2d5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.330+0000 7f120c0a4740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2d0150 0x561fff2d7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.330+0000 7f120c0a4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f12041abed0 con 0x561fff2c1340 2024-09-15T22:24:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.330+0000 7f120c0a4740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f12041ad340 con 0x561fff2c0a20 2024-09-15T22:24:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.330+0000 7f120c0a4740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f12041ac5a0 con 0x561fff2d0150 2024-09-15T22:24:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.330+0000 7f120c0a4740 10 client.0 _ll_register_callbacks cb 0x7f11fc020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.330+0000 7f1202ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c1340 0x561fff2d5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.330+0000 7f1202ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c1340 0x561fff2d5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52622/0 (socket says 172.21.15.45:52622) 2024-09-15T22:24:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.330+0000 7f1202ffd640 1 -- 172.21.15.45:0/849759113 learned_addr learned my addr 172.21.15.45:0/849759113 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.330+0000 7f1203fff640 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2d0150 0x561fff2d7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f12037fe640 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c0a20 0x561fff2d59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f1202ffd640 1 -- 172.21.15.45:0/849759113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2d0150 msgr2=0x561fff2d7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f1202ffd640 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2d0150 0x561fff2d7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f1202ffd640 1 -- 172.21.15.45:0/849759113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c0a20 msgr2=0x561fff2d59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f1202ffd640 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c0a20 0x561fff2d59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f1202ffd640 1 -- 172.21.15.45:0/849759113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fff2d8570 con 0x561fff2c1340 2024-09-15T22:24:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f12037fe640 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c0a20 0x561fff2d59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:24:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f1203fff640 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2d0150 0x561fff2d7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f1202ffd640 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c1340 0x561fff2d5f20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f11f800b470 tx=0x7f11f8017360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfaf37cbb236a8d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f11e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f11e2ffd640 1 -- 172.21.15.45:0/849759113 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f801e040 con 0x561fff2c1340 2024-09-15T22:24:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f11e2ffd640 1 -- 172.21.15.45:0/849759113 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f11f8010cc0 con 0x561fff2c1340 2024-09-15T22:24:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f120c0a4740 1 -- 172.21.15.45:0/849759113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11fc0113e0 con 0x561fff2c1340 2024-09-15T22:24:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f11e2ffd640 1 -- 172.21.15.45:0/849759113 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f11f809b3a0 con 0x561fff2c1340 2024-09-15T22:24:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f120c0a4740 10 client.16839 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:44.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f120c0a4740 1 -- 172.21.15.45:0/849759113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561fff34a490 con 0x561fff2c1340 2024-09-15T22:24:44.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.331+0000 7f11e2ffd640 1 -- 172.21.15.45:0/849759113 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f11fc0113e0 con 0x561fff2c1340 2024-09-15T22:24:44.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.332+0000 7f11e2ffd640 1 -- 172.21.15.45:0/849759113 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f11f80cc980 con 0x561fff2c1340 2024-09-15T22:24:44.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.332+0000 7f120c0a4740 10 client.16839 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:44.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.332+0000 7f120c0a4740 10 client.16839 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:44.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.332+0000 7f120c0a4740 20 client.16839 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:44.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.332+0000 7f120c0a4740 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561fff34abf0 0x561fff34d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:44.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.332+0000 7f120c0a4740 4 client.16839 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:24:44.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.332+0000 7f120c0a4740 1 -- 172.21.15.45:0/849759113 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561fff22dd00 con 0x561fff34abf0 2024-09-15T22:24:44.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.332+0000 7f12037fe640 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561fff34abf0 0x561fff34d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:44.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.332+0000 7f11e2ffd640 10 client.16839 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:44.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.332+0000 7f12037fe640 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561fff34abf0 0x561fff34d010 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c37b1a6e80396ef server_cookie=710795368d8dc170 in_seq=0 out_seq=0 2024-09-15T22:24:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.333+0000 7f11e2ffd640 1 -- 172.21.15.45:0/849759113 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561fff22dd00 con 0x561fff34abf0 2024-09-15T22:24:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.333+0000 7f11e2ffd640 10 client.16839 handle_command_reply: tid=0 2024-09-15T22:24:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.333+0000 7f120c0a4740 1 client.16839 shutdown 2024-09-15T22:24:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.333+0000 7f120c0a4740 1 -- 172.21.15.45:0/849759113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c1340 msgr2=0x561fff2d5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.333+0000 7f120c0a4740 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c1340 0x561fff2d5f20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f11f800b470 tx=0x7f11f8017360 comp rx=0 tx=0).stop 2024-09-15T22:24:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f120c0a4740 1 -- 172.21.15.45:0/849759113 shutdown_connections 2024-09-15T22:24:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f120c0a4740 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x561fff34abf0 0x561fff34d010 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f120c0a4740 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x561fff2d0150 0x561fff2d7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f120c0a4740 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561fff2c1340 0x561fff2d5f20 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f120c0a4740 1 --2- 172.21.15.45:0/849759113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x561fff2c0a20 0x561fff2d59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f120c0a4740 1 -- 172.21.15.45:0/849759113 >> 172.21.15.45:0/849759113 conn(0x561fff2bd0f0 msgr2=0x561fff2c2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f11e2ffd640 0 client.16839 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:44.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f120c0a4740 1 -- 172.21.15.45:0/849759113 shutdown_connections 2024-09-15T22:24:44.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f120c0a4740 1 -- 172.21.15.45:0/849759113 wait complete. 2024-09-15T22:24:44.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f120c0a4740 20 client.16839 trim_cache size 0 max 16384 2024-09-15T22:24:44.355 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:24:44.355 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:24:44.355 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "993b0625-9d52-49d2-b59f-bb11e3d99583", 2024-09-15T22:24:44.355 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:24:44.355 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:24:44.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f1209ccb640 1 -- 172.21.15.45:0/2247172778 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f11ec0a33b0 msgr2=0x7f11ec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:44.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f1209ccb640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f11ec0a33b0 0x7f11ec0a5870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f11fc01f000 tx=0x7f11fc022000 comp rx=0 tx=0).stop 2024-09-15T22:24:44.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f1209ccb640 1 -- 172.21.15.45:0/2247172778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1204101420 msgr2=0x7f1204198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:44.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f1209ccb640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1204101420 0x7f1204198b10 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f11f800b4a0 tx=0x7f11f800b960 comp rx=0 tx=0).stop 2024-09-15T22:24:44.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f1209ccb640 1 -- 172.21.15.45:0/2247172778 shutdown_connections 2024-09-15T22:24:44.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f1209ccb640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f11ec0a33b0 0x7f11ec0a5870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f1209ccb640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1204106a80 0x7f120419cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f1209ccb640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1204101420 0x7f1204198b10 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.334+0000 7f1209ccb640 1 --2- 172.21.15.45:0/2247172778 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f1204100a80 0x7f12041985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:44.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.335+0000 7f1209ccb640 1 -- 172.21.15.45:0/2247172778 >> 172.21.15.45:0/2247172778 conn(0x7f12040fc7a0 msgr2=0x7f120406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:44.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.335+0000 7f1209ccb640 1 -- 172.21.15.45:0/2247172778 shutdown_connections 2024-09-15T22:24:44.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:44.335+0000 7f1209ccb640 1 -- 172.21.15.45:0/2247172778 wait complete. 2024-09-15T22:24:45.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:44 smithi045 ceph-mon[31180]: pgmap v262: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:24:45.103 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:24:45.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:44 smithi165 ceph-mon[35551]: pgmap v262: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:24:45.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:44 smithi100 ceph-mon[35319]: pgmap v262: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:24:45.369 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:24:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.831+0000 7f90645b5640 1 -- 172.21.15.45:0/842648606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f905c10c170 msgr2=0x7f905c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.831+0000 7f90645b5640 1 --2- 172.21.15.45:0/842648606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f905c10c170 0x7f905c10e610 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9054009900 tx=0x7f905402a480 comp rx=0 tx=0).stop 2024-09-15T22:24:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 -- 172.21.15.45:0/842648606 shutdown_connections 2024-09-15T22:24:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 --2- 172.21.15.45:0/842648606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f905c10c170 0x7f905c10e610 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 --2- 172.21.15.45:0/842648606 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f905c103660 0x7f905c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 --2- 172.21.15.45:0/842648606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f905c102d40 0x7f905c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 -- 172.21.15.45:0/842648606 >> 172.21.15.45:0/842648606 conn(0x7f905c0fc7a0 msgr2=0x7f905c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 -- 172.21.15.45:0/842648606 shutdown_connections 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 -- 172.21.15.45:0/842648606 wait complete. 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 Processor -- start 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 -- start start 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f905c102d40 0x7f905c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f905c103660 0x7f905c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f905c10c170 0x7f905c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f905c112090 con 0x7f905c10c170 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f905c111f10 con 0x7f905c102d40 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.832+0000 7f90645b5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f905c112210 con 0x7f905c103660 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f9062b52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f905c10c170 0x7f905c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f9062b52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f905c10c170 0x7f905c19cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52638/0 (socket says 172.21.15.45:52638) 2024-09-15T22:24:45.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f9062b52640 1 -- 172.21.15.45:0/358650481 learned_addr learned my addr 172.21.15.45:0/358650481 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f9062351640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f905c102d40 0x7f905c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f9061b50640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f905c103660 0x7f905c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f9062b52640 1 -- 172.21.15.45:0/358650481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f905c103660 msgr2=0x7f905c198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f9062b52640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f905c103660 0x7f905c198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f9062b52640 1 -- 172.21.15.45:0/358650481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f905c102d40 msgr2=0x7f905c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f9062b52640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f905c102d40 0x7f905c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f9062b52640 1 -- 172.21.15.45:0/358650481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c19d480 con 0x7f905c10c170 2024-09-15T22:24:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f9062b52640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f905c10c170 0x7f905c19cda0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9054005ab0 tx=0x7f90540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f90537fe640 1 -- 172.21.15.45:0/358650481 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f905403f030 con 0x7f905c10c170 2024-09-15T22:24:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f90645b5640 1 -- 172.21.15.45:0/358650481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905c19d710 con 0x7f905c10c170 2024-09-15T22:24:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f90537fe640 1 -- 172.21.15.45:0/358650481 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9054003d00 con 0x7f905c10c170 2024-09-15T22:24:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f90537fe640 1 -- 172.21.15.45:0/358650481 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9054035070 con 0x7f905c10c170 2024-09-15T22:24:45.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.833+0000 7f90645b5640 1 -- 172.21.15.45:0/358650481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f905c1a5050 con 0x7f905c10c170 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.835+0000 7f90537fe640 1 -- 172.21.15.45:0/358650481 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9054042030 con 0x7f905c10c170 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.836+0000 7f906698e740 1 Processor -- start 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.836+0000 7f906698e740 1 -- start start 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.836+0000 7f906698e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec54a0 0x556b89ec5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.836+0000 7f906698e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ec5dc0 0x556b89ed0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.836+0000 7f906698e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ed0680 0x556b89ed2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.836+0000 7f906698e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556b89e2b2e0 con 0x556b89ed0680 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.836+0000 7f906698e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556b89dd2ce0 con 0x556b89ec54a0 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.836+0000 7f906698e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556b89e272a0 con 0x556b89ec5dc0 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.836+0000 7f90537fe640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f90480a33b0 0x7f90480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.836+0000 7f9061b50640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ed0680 0x556b89ed2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.836+0000 7f9061b50640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ed0680 0x556b89ed2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52648/0 (socket says 172.21.15.45:52648) 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.836+0000 7f9061b50640 1 -- 172.21.15.45:0/517911154 learned_addr learned my addr 172.21.15.45:0/517911154 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:45.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f9062351640 1 --2- 172.21.15.45:0/517911154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ec5dc0 0x556b89ed0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f9061b50640 1 --2- 172.21.15.45:0/517911154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec54a0 0x556b89ec5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f9062b52640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f90480a33b0 0x7f90480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f90537fe640 1 -- 172.21.15.45:0/358650481 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f90540f04f0 con 0x7f905c10c170 2024-09-15T22:24:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f9061b50640 1 -- 172.21.15.45:0/517911154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ec5dc0 msgr2=0x556b89ed0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f9061b50640 1 --2- 172.21.15.45:0/517911154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ec5dc0 0x556b89ed0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f9061b50640 1 -- 172.21.15.45:0/517911154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec54a0 msgr2=0x556b89ec5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f9061b50640 1 --2- 172.21.15.45:0/517911154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec54a0 0x556b89ec5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f9061b50640 1 -- 172.21.15.45:0/517911154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b89db7440 con 0x556b89ed0680 2024-09-15T22:24:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f9061b50640 1 --2- 172.21.15.45:0/517911154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ed0680 0x556b89ed2a70 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f904c0126c0 tx=0x7f904c00d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6768da6b8c15d7e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f9050ff9640 1 -- 172.21.15.45:0/517911154 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c005220 con 0x556b89ed0680 2024-09-15T22:24:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f9062b52640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f90480a33b0 0x7f90480a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f90540ed980 tx=0x7f905403b720 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f9050ff9640 1 -- 172.21.15.45:0/517911154 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f904c012e50 con 0x556b89ed0680 2024-09-15T22:24:45.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.837+0000 7f9050ff9640 1 -- 172.21.15.45:0/517911154 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c00aa10 con 0x556b89ed0680 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.838+0000 7f906698e740 1 -- 172.21.15.45:0/517911154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ed0680 msgr2=0x556b89ed2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.838+0000 7f906698e740 1 --2- 172.21.15.45:0/517911154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ed0680 0x556b89ed2a70 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f904c0126c0 tx=0x7f904c00d360 comp rx=0 tx=0).stop 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.838+0000 7f906698e740 1 -- 172.21.15.45:0/517911154 shutdown_connections 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.838+0000 7f906698e740 1 --2- 172.21.15.45:0/517911154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ed0680 0x556b89ed2a70 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.838+0000 7f906698e740 1 --2- 172.21.15.45:0/517911154 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ec5dc0 0x556b89ed0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.838+0000 7f906698e740 1 --2- 172.21.15.45:0/517911154 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec54a0 0x556b89ec5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.838+0000 7f906698e740 1 -- 172.21.15.45:0/517911154 >> 172.21.15.45:0/517911154 conn(0x556b89ec1a30 msgr2=0x556b89ec1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.838+0000 7f906698e740 1 -- 172.21.15.45:0/517911154 shutdown_connections 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.838+0000 7f906698e740 1 -- 172.21.15.45:0/517911154 wait complete. 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.838+0000 7f906698e740 1 -- start start 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f906698e740 1 Processor -- start 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f906698e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89ed0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f906698e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 0x556b89ecd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f906698e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 0x556b89ecd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f906698e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556b89ed3250 con 0x556b89ec54a0 2024-09-15T22:24:45.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f906698e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x556b89de6050 con 0x556b89ec5dc0 2024-09-15T22:24:45.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f906698e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x556b89ed33d0 con 0x556b89ed0680 2024-09-15T22:24:45.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f906698e740 10 client.0 _ll_register_callbacks cb 0x556b89e26160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:45.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f9061b50640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89ed0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f9061b50640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89ed0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52652/0 (socket says 172.21.15.45:52652) 2024-09-15T22:24:45.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f9061b50640 1 -- 172.21.15.45:0/1306840146 learned_addr learned my addr 172.21.15.45:0/1306840146 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:45.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f9061b50640 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 0x556b89ecd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f9062351640 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 0x556b89ecd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f9061b50640 1 -- 172.21.15.45:0/1306840146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 msgr2=0x556b89ecd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:45.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f9061b50640 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 0x556b89ecd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f9061b50640 1 -- 172.21.15.45:0/1306840146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 msgr2=0x556b89ecd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f9061b50640 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 0x556b89ecd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f9061b50640 1 -- 172.21.15.45:0/1306840146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b89b9c3c0 con 0x556b89ec54a0 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f9062351640 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 0x556b89ecd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f9061b50640 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89ed0010 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f904c015040 tx=0x7f904c00a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2850138ea1283f57 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.839+0000 7f9045ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f9045ffb640 1 -- 172.21.15.45:0/1306840146 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c00a9d0 con 0x556b89ec54a0 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f9045ffb640 1 -- 172.21.15.45:0/1306840146 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f904c00ab70 con 0x556b89ec54a0 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f906698e740 1 -- 172.21.15.45:0/1306840146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f904c012e50 con 0x556b89ec54a0 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f9045ffb640 1 -- 172.21.15.45:0/1306840146 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f904c033050 con 0x556b89ec54a0 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f906698e740 10 client.16851 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f906698e740 1 -- 172.21.15.45:0/1306840146 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556b89edec40 con 0x556b89ec54a0 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f9045ffb640 1 -- 172.21.15.45:0/1306840146 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f904c012e50 con 0x556b89ec54a0 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f9045ffb640 1 -- 172.21.15.45:0/1306840146 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f904c02a070 con 0x556b89ec54a0 2024-09-15T22:24:45.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f906698e740 10 client.16851 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:45.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f906698e740 10 client.16851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:45.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f906698e740 20 client.16851 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:45.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f906698e740 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556b89edff90 0x556b89ee2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f906698e740 4 client.16851 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:24:45.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.840+0000 7f906698e740 1 -- 172.21.15.45:0/1306840146 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b89e38850 con 0x556b89edff90 2024-09-15T22:24:45.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.841+0000 7f9062351640 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556b89edff90 0x556b89ee2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.841+0000 7f9062351640 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556b89edff90 0x556b89ee2380 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc3dbfa982eff1c6 server_cookie=1a6742b278fd8c6 in_seq=0 out_seq=0 2024-09-15T22:24:45.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.841+0000 7f9045ffb640 10 client.16851 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f9045ffb640 1 -- 172.21.15.45:0/1306840146 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b89e38850 con 0x556b89edff90 2024-09-15T22:24:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f9045ffb640 10 client.16851 handle_command_reply: tid=0 2024-09-15T22:24:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f906698e740 1 client.16851 shutdown 2024-09-15T22:24:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f906698e740 1 -- 172.21.15.45:0/1306840146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 msgr2=0x556b89ed0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f906698e740 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89ed0010 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f904c015040 tx=0x7f904c00a6f0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f906698e740 1 -- 172.21.15.45:0/1306840146 shutdown_connections 2024-09-15T22:24:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f906698e740 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556b89edff90 0x556b89ee2380 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f906698e740 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 0x556b89ecd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f906698e740 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 0x556b89ecd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f9045ffb640 0 client.16851 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f906698e740 1 --2- 172.21.15.45:0/1306840146 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89ed0010 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f906698e740 1 -- 172.21.15.45:0/1306840146 >> 172.21.15.45:0/1306840146 conn(0x556b89ec1a30 msgr2=0x556b89ec7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:45.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f906698e740 1 -- 172.21.15.45:0/1306840146 shutdown_connections 2024-09-15T22:24:45.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f906698e740 1 -- 172.21.15.45:0/1306840146 wait complete. 2024-09-15T22:24:45.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.842+0000 7f906698e740 20 client.16851 trim_cache size 0 max 16384 2024-09-15T22:24:45.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f906698e740 1 Processor -- start 2024-09-15T22:24:45.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f906698e740 1 -- start start 2024-09-15T22:24:45.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f906698e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89edc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f906698e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 0x556b89eccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f906698e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 0x556b89ee79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f906698e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1ad270 con 0x556b89ec54a0 2024-09-15T22:24:45.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f906698e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1afaf0 con 0x556b89ec5dc0 2024-09-15T22:24:45.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f906698e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1ad8e0 con 0x556b89ed0680 2024-09-15T22:24:45.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f9061b50640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89edc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f9061b50640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89edc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52654/0 (socket says 172.21.15.45:52654) 2024-09-15T22:24:45.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f9061b50640 1 -- 172.21.15.45:0/1664914793 learned_addr learned my addr 172.21.15.45:0/1664914793 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:45.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f9062351640 1 --2- 172.21.15.45:0/1664914793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 0x556b89eccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f9061b50640 1 -- 172.21.15.45:0/1664914793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 msgr2=0x556b89ee79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:45.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f9061b50640 1 --2- 172.21.15.45:0/1664914793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 0x556b89ee79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f9061b50640 1 -- 172.21.15.45:0/1664914793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 msgr2=0x556b89eccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:45.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f9061b50640 1 --2- 172.21.15.45:0/1664914793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 0x556b89eccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f9061b50640 1 -- 172.21.15.45:0/1664914793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b89ec2630 con 0x556b89ec54a0 2024-09-15T22:24:45.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.860+0000 7f9061b50640 1 --2- 172.21.15.45:0/1664914793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89edc4b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f904c01d550 tx=0x7f904c01d580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df682804e0999618 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:45.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.861+0000 7f9047fff640 1 -- 172.21.15.45:0/1664914793 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c03c070 con 0x556b89ec54a0 2024-09-15T22:24:45.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.861+0000 7f9047fff640 1 -- 172.21.15.45:0/1664914793 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f904c012e50 con 0x556b89ec54a0 2024-09-15T22:24:45.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.861+0000 7f9047fff640 1 -- 172.21.15.45:0/1664914793 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c00aa50 con 0x556b89ec54a0 2024-09-15T22:24:45.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.861+0000 7f906698e740 1 -- 172.21.15.45:0/1664914793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 msgr2=0x556b89edc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:45.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.861+0000 7f906698e740 1 --2- 172.21.15.45:0/1664914793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89edc4b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f904c01d550 tx=0x7f904c01d580 comp rx=0 tx=0).stop 2024-09-15T22:24:45.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.861+0000 7f906698e740 1 -- 172.21.15.45:0/1664914793 shutdown_connections 2024-09-15T22:24:45.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.861+0000 7f906698e740 1 --2- 172.21.15.45:0/1664914793 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 0x556b89ee79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.861+0000 7f906698e740 1 --2- 172.21.15.45:0/1664914793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 0x556b89eccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.861+0000 7f906698e740 1 --2- 172.21.15.45:0/1664914793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89edc4b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.861+0000 7f906698e740 1 -- 172.21.15.45:0/1664914793 >> 172.21.15.45:0/1664914793 conn(0x556b89ec1a30 msgr2=0x556b89ec8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:45.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.861+0000 7f906698e740 1 -- 172.21.15.45:0/1664914793 shutdown_connections 2024-09-15T22:24:45.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.861+0000 7f906698e740 1 -- 172.21.15.45:0/1664914793 wait complete. 2024-09-15T22:24:45.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f906698e740 1 -- start start 2024-09-15T22:24:45.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f906698e740 1 Processor -- start 2024-09-15T22:24:45.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f906698e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89ed8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f906698e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 0x556b89ed8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f906698e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 0x556b89ec95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f906698e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1adfb0 con 0x556b89ec54a0 2024-09-15T22:24:45.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f906698e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1af420 con 0x556b89ec5dc0 2024-09-15T22:24:45.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f906698e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f905c1ae680 con 0x556b89ed0680 2024-09-15T22:24:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f906698e740 10 client.0 _ll_register_callbacks cb 0x7f904c00dcb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:24:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f9061b50640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89ed8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f9061b50640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89ed8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52660/0 (socket says 172.21.15.45:52660) 2024-09-15T22:24:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f9061b50640 1 -- 172.21.15.45:0/2272918423 learned_addr learned my addr 172.21.15.45:0/2272918423 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:24:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f9062351640 1 --2- 172.21.15.45:0/2272918423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 0x556b89ed8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f9061b50640 1 --2- 172.21.15.45:0/2272918423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 0x556b89ec95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f9061b50640 1 -- 172.21.15.45:0/2272918423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 msgr2=0x556b89ec95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f9061b50640 1 --2- 172.21.15.45:0/2272918423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 0x556b89ec95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f9061b50640 1 -- 172.21.15.45:0/2272918423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 msgr2=0x556b89ed8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:24:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f9061b50640 1 --2- 172.21.15.45:0/2272918423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 0x556b89ed8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.862+0000 7f9061b50640 1 -- 172.21.15.45:0/2272918423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b89ed9250 con 0x556b89ec54a0 2024-09-15T22:24:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f9061b50640 1 --2- 172.21.15.45:0/2272918423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89ed8620 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f904c03a040 tx=0x7f904c012420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49e8b47571da639 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:24:45.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f9045ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f9045ffb640 1 -- 172.21.15.45:0/2272918423 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c03c040 con 0x556b89ec54a0 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f9045ffb640 1 -- 172.21.15.45:0/2272918423 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9568+0+0 (secure 0 0 0) 0x7f904c01d9b0 con 0x556b89ec54a0 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f906698e740 1 -- 172.21.15.45:0/2272918423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f904c012e50 con 0x556b89ec54a0 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f9045ffb640 1 -- 172.21.15.45:0/2272918423 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f904c01dbb0 con 0x556b89ec54a0 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f906698e740 10 client.16857 fetch_fsmap learned FSMap version 21 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f906698e740 1 -- 172.21.15.45:0/2272918423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556b89f49f90 con 0x556b89ec54a0 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f9045ffb640 1 -- 172.21.15.45:0/2272918423 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f904c012e50 con 0x556b89ec54a0 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f9045ffb640 1 -- 172.21.15.45:0/2272918423 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f904c042070 con 0x556b89ec54a0 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f906698e740 10 client.16857 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f906698e740 10 client.16857 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f906698e740 20 client.16857 populate_metadata read hostname 'smithi045' 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f906698e740 1 --2- 172.21.15.45:0/2272918423 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556b89f4a640 0x556b89f4ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f906698e740 4 client.16857 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:24:45.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.863+0000 7f906698e740 1 -- 172.21.15.45:0/2272918423 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556b89e32d60 con 0x556b89f4a640 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.864+0000 7f9062351640 1 --2- 172.21.15.45:0/2272918423 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556b89f4a640 0x556b89f4ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.864+0000 7f9062351640 1 --2- 172.21.15.45:0/2272918423 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556b89f4a640 0x556b89f4ca60 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86c0151a3e54bd47 server_cookie=587d6831c09315d2 in_seq=0 out_seq=0 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.864+0000 7f9045ffb640 10 client.16857 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.864+0000 7f9045ffb640 1 -- 172.21.15.45:0/2272918423 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556b89e32d60 con 0x556b89f4a640 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.864+0000 7f9045ffb640 10 client.16857 handle_command_reply: tid=0 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.864+0000 7f906698e740 1 client.16857 shutdown 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f906698e740 1 -- 172.21.15.45:0/2272918423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 msgr2=0x556b89ed8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f906698e740 1 --2- 172.21.15.45:0/2272918423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89ed8620 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f904c03a040 tx=0x7f904c012420 comp rx=0 tx=0).stop 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f906698e740 1 -- 172.21.15.45:0/2272918423 shutdown_connections 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f906698e740 1 --2- 172.21.15.45:0/2272918423 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x556b89f4a640 0x556b89f4ca60 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f906698e740 1 --2- 172.21.15.45:0/2272918423 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x556b89ed0680 0x556b89ec95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f906698e740 1 --2- 172.21.15.45:0/2272918423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x556b89ec5dc0 0x556b89ed8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f906698e740 1 --2- 172.21.15.45:0/2272918423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b89ec54a0 0x556b89ed8620 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f906698e740 1 -- 172.21.15.45:0/2272918423 >> 172.21.15.45:0/2272918423 conn(0x556b89ec1a30 msgr2=0x556b89ec6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:45.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f9045ffb640 0 client.16857 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:24:45.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f906698e740 1 -- 172.21.15.45:0/2272918423 shutdown_connections 2024-09-15T22:24:45.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f906698e740 1 -- 172.21.15.45:0/2272918423 wait complete. 2024-09-15T22:24:45.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f906698e740 20 client.16857 trim_cache size 0 max 16384 2024-09-15T22:24:45.880 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:24:45.880 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:24:45.880 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:24:45.880 INFO:teuthology.orchestra.run.smithi045.stdout: "993b0625-9d52-49d2-b59f-bb11e3d99583": { 2024-09-15T22:24:45.880 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:24:45.881 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "993b0625-9d52-49d2-b59f-bb11e3d99583", 2024-09-15T22:24:45.881 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:24:45.881 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:24:45.881 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:24:45.881 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:24:45.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f90645b5640 1 -- 172.21.15.45:0/358650481 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f90480a33b0 msgr2=0x7f90480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:45.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f90645b5640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f90480a33b0 0x7f90480a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f90540ed980 tx=0x7f905403b720 comp rx=0 tx=0).stop 2024-09-15T22:24:45.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f90645b5640 1 -- 172.21.15.45:0/358650481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f905c10c170 msgr2=0x7f905c19cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:24:45.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.865+0000 7f90645b5640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f905c10c170 0x7f905c19cda0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9054005ab0 tx=0x7f90540042f0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.866+0000 7f90645b5640 1 -- 172.21.15.45:0/358650481 shutdown_connections 2024-09-15T22:24:45.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.866+0000 7f90645b5640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f90480a33b0 0x7f90480a5870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.866+0000 7f90645b5640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f905c10c170 0x7f905c19cda0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.866+0000 7f90645b5640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f905c103660 0x7f905c198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.866+0000 7f90645b5640 1 --2- 172.21.15.45:0/358650481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f905c102d40 0x7f905c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:24:45.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.866+0000 7f90645b5640 1 -- 172.21.15.45:0/358650481 >> 172.21.15.45:0/358650481 conn(0x7f905c0fc7a0 msgr2=0x7f905c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:24:45.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.866+0000 7f90645b5640 1 -- 172.21.15.45:0/358650481 shutdown_connections 2024-09-15T22:24:45.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:24:45.866+0000 7f90645b5640 1 -- 172.21.15.45:0/358650481 wait complete. 2024-09-15T22:24:46.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:45 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:24:46.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:45 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:24:46.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:45 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:24:46.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:45 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:24:46.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:45 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:24:46.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:45 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:24:46.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:45 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:24:46.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:45 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:24:46.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:45 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:24:46.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:45 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:24:46.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:45 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:24:46.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:45 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:24:46.594 INFO:tasks.cephfs.filesystem:scrub status for tag:993b0625-9d52-49d2-b59f-bb11e3d99583 - {'path': '/', 'tag': '993b0625-9d52-49d2-b59f-bb11e3d99583', 'options': 'recursive,force'} 2024-09-15T22:24:47.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:46 smithi045 ceph-mon[31180]: pgmap v263: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:47.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:46 smithi165 ceph-mon[35551]: pgmap v263: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:47.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:46 smithi100 ceph-mon[35319]: pgmap v263: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:48.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:47 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:24:48.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:47 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:24:48.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:47 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:24:49.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:48 smithi045 ceph-mon[31180]: pgmap v264: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:49.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:48 smithi165 ceph-mon[35551]: pgmap v264: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:49.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:48 smithi100 ceph-mon[35319]: pgmap v264: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:51.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:50 smithi045 ceph-mon[31180]: pgmap v265: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-15T22:24:51.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:50 smithi165 ceph-mon[35551]: pgmap v265: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-15T22:24:51.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:50 smithi100 ceph-mon[35319]: pgmap v265: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 2 op/s 2024-09-15T22:24:53.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:52 smithi045 ceph-mon[31180]: pgmap v266: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:53.216 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:52 smithi165 ceph-mon[35551]: pgmap v266: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:53.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:52 smithi100 ceph-mon[35319]: pgmap v266: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:55.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:54 smithi045 ceph-mon[31180]: pgmap v267: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:24:55.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:54 smithi165 ceph-mon[35551]: pgmap v267: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:24:55.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:54 smithi100 ceph-mon[35319]: pgmap v267: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:24:57.052 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:56 smithi045 ceph-mon[31180]: pgmap v268: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:57.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:56 smithi165 ceph-mon[35551]: pgmap v268: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:57.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:56 smithi100 ceph-mon[35319]: pgmap v268: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:59.046 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:24:58 smithi100 ceph-mon[35319]: pgmap v269: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:59.049 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:24:58 smithi045 ceph-mon[31180]: pgmap v269: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:24:59.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:24:58 smithi165 ceph-mon[35551]: pgmap v269: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:25:01.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:00 smithi045 ceph-mon[31180]: pgmap v270: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-15T22:25:01.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:00 smithi165 ceph-mon[35551]: pgmap v270: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-15T22:25:01.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:00 smithi100 ceph-mon[35319]: pgmap v270: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-15T22:25:03.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:02 smithi045 ceph-mon[31180]: pgmap v271: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:25:03.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:02 smithi165 ceph-mon[35551]: pgmap v271: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:25:03.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:02 smithi100 ceph-mon[35319]: pgmap v271: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 1 op/s 2024-09-15T22:25:05.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:04 smithi165 ceph-mon[35551]: pgmap v272: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:25:05.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:04 smithi100 ceph-mon[35319]: pgmap v272: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:25:05.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:04 smithi045 ceph-mon[31180]: pgmap v272: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:25:07.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:06 smithi165 ceph-mon[35551]: pgmap v273: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-15T22:25:07.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:06 smithi100 ceph-mon[35319]: pgmap v273: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-15T22:25:07.301 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:06 smithi045 ceph-mon[31180]: pgmap v273: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-15T22:25:09.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:08 smithi165 ceph-mon[35551]: pgmap v274: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-15T22:25:09.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:08 smithi165 ceph-mon[35551]: osdmap e97: 12 total, 12 up, 12 in 2024-09-15T22:25:09.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:08 smithi100 ceph-mon[35319]: pgmap v274: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-15T22:25:09.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:08 smithi100 ceph-mon[35319]: osdmap e97: 12 total, 12 up, 12 in 2024-09-15T22:25:09.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:08 smithi045 ceph-mon[31180]: pgmap v274: 129 pgs: 129 active+clean; 264 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-15T22:25:09.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:08 smithi045 ceph-mon[31180]: osdmap e97: 12 total, 12 up, 12 in 2024-09-15T22:25:11.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:10 smithi165 ceph-mon[35551]: pgmap v276: 129 pgs: 16 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 64 active+clean; 222 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:25:11.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:10 smithi100 ceph-mon[35319]: pgmap v276: 129 pgs: 16 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 64 active+clean; 222 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:25:11.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:10 smithi045 ceph-mon[31180]: pgmap v276: 129 pgs: 16 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 64 active+clean; 222 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:25:13.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:12 smithi165 ceph-mon[35551]: pgmap v277: 129 pgs: 16 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 64 active+clean; 222 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:25:13.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:12 smithi100 ceph-mon[35319]: pgmap v277: 129 pgs: 16 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 64 active+clean; 222 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:25:13.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:12 smithi045 ceph-mon[31180]: pgmap v277: 129 pgs: 16 active+clean+snaptrim, 49 active+clean+snaptrim_wait, 64 active+clean; 222 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:25:15.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:14 smithi165 ceph-mon[35551]: pgmap v278: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T22:25:15.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:14 smithi165 ceph-mon[35551]: osdmap e98: 12 total, 12 up, 12 in 2024-09-15T22:25:15.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:14 smithi100 ceph-mon[35319]: pgmap v278: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T22:25:15.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:14 smithi100 ceph-mon[35319]: osdmap e98: 12 total, 12 up, 12 in 2024-09-15T22:25:15.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:14 smithi045 ceph-mon[31180]: pgmap v278: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T22:25:15.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:14 smithi045 ceph-mon[31180]: osdmap e98: 12 total, 12 up, 12 in 2024-09-15T22:25:16.595 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:25:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:25:16.994 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:16 smithi045 ceph-mon[31180]: pgmap v280: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T22:25:17.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:16 smithi165 ceph-mon[35551]: pgmap v280: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T22:25:17.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:16 smithi100 ceph-mon[35319]: pgmap v280: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T22:25:17.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.487+0000 7fa8b0145640 1 -- 172.21.15.45:0/3381305623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8a8102d30 msgr2=0x7fa8a8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:17.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.487+0000 7fa8b0145640 1 --2- 172.21.15.45:0/3381305623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8a8102d30 0x7fa8a8103110 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009930 tx=0x7fa8a402a420 comp rx=0 tx=0).stop 2024-09-15T22:25:17.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.487+0000 7fa8b0145640 1 -- 172.21.15.45:0/3381305623 shutdown_connections 2024-09-15T22:25:17.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.487+0000 7fa8b0145640 1 --2- 172.21.15.45:0/3381305623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a81082a0 0x7fa8a810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.487+0000 7fa8b0145640 1 --2- 172.21.15.45:0/3381305623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8a81036e0 0x7fa8a8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.487+0000 7fa8b0145640 1 --2- 172.21.15.45:0/3381305623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8a8102d30 0x7fa8a8103110 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.487+0000 7fa8b0145640 1 -- 172.21.15.45:0/3381305623 >> 172.21.15.45:0/3381305623 conn(0x7fa8a80fc7d0 msgr2=0x7fa8a80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:17.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.487+0000 7fa8b0145640 1 -- 172.21.15.45:0/3381305623 shutdown_connections 2024-09-15T22:25:17.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.487+0000 7fa8b0145640 1 -- 172.21.15.45:0/3381305623 wait complete. 2024-09-15T22:25:17.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.488+0000 7fa8b0145640 1 Processor -- start 2024-09-15T22:25:17.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.488+0000 7fa8b0145640 1 -- start start 2024-09-15T22:25:17.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.488+0000 7fa8b0145640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8a8102d30 0x7fa8a8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.488+0000 7fa8b0145640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8a81036e0 0x7fa8a8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.488+0000 7fa8b0145640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a81082a0 0x7fa8a8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.488+0000 7fa8b0145640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81121e0 con 0x7fa8a8102d30 2024-09-15T22:25:17.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.488+0000 7fa8b0145640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a8112060 con 0x7fa8a81082a0 2024-09-15T22:25:17.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.488+0000 7fa8b0145640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a8112360 con 0x7fa8a81036e0 2024-09-15T22:25:17.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.488+0000 7fa8adee1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8a8102d30 0x7fa8a8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.488+0000 7fa8adee1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8a8102d30 0x7fa8a8100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48950/0 (socket says 172.21.15.45:48950) 2024-09-15T22:25:17.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.488+0000 7fa8adee1640 1 -- 172.21.15.45:0/1373377407 learned_addr learned my addr 172.21.15.45:0/1373377407 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:17.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.488+0000 7fa8ae6e2640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a81082a0 0x7fa8a8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.489+0000 7fa8ad6e0640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8a81036e0 0x7fa8a8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.489+0000 7fa8adee1640 1 -- 172.21.15.45:0/1373377407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8a81036e0 msgr2=0x7fa8a8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:17.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.489+0000 7fa8adee1640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8a81036e0 0x7fa8a8100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.489+0000 7fa8adee1640 1 -- 172.21.15.45:0/1373377407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a81082a0 msgr2=0x7fa8a8101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:17.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.489+0000 7fa8adee1640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a81082a0 0x7fa8a8101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.489+0000 7fa8adee1640 1 -- 172.21.15.45:0/1373377407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a81a6b60 con 0x7fa8a8102d30 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.489+0000 7fa8adee1640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8a8102d30 0x7fa8a8100990 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009230 tx=0x7fa8a4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.489+0000 7fa89affd640 1 -- 172.21.15.45:0/1373377407 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a403f030 con 0x7fa8a8102d30 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.489+0000 7fa89affd640 1 -- 172.21.15.45:0/1373377407 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8a4003af0 con 0x7fa8a8102d30 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.489+0000 7fa8b0145640 1 -- 172.21.15.45:0/1373377407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a81a6df0 con 0x7fa8a8102d30 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.489+0000 7fa89affd640 1 -- 172.21.15.45:0/1373377407 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4035070 con 0x7fa8a8102d30 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.489+0000 7fa8b0145640 1 -- 172.21.15.45:0/1373377407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a81a7270 con 0x7fa8a8102d30 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.492+0000 7fa89affd640 1 -- 172.21.15.45:0/1373377407 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa8a4042030 con 0x7fa8a8102d30 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.492+0000 7fa8b251e740 1 Processor -- start 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.492+0000 7fa8b251e740 1 -- start start 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.492+0000 7fa8b251e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 0x55fb646c8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.492+0000 7fa8b251e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.492+0000 7fa8b251e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646d3680 0x55fb646d5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.492+0000 7fa8b251e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55fb6462e2e0 con 0x55fb646c8dc0 2024-09-15T22:25:17.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.492+0000 7fa8b251e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fb645d5ce0 con 0x55fb646d3680 2024-09-15T22:25:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.492+0000 7fa8b251e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fb6462a2a0 con 0x55fb646c84a0 2024-09-15T22:25:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8adee1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa89affd640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa8940a33b0 0x7fa8940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8adee1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48958/0 (socket says 172.21.15.45:48958) 2024-09-15T22:25:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8adee1640 1 -- 172.21.15.45:0/2858188131 learned_addr learned my addr 172.21.15.45:0/2858188131 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8ad6e0640 1 --2- 172.21.15.45:0/2858188131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646d3680 0x55fb646d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8ae6e2640 1 --2- 172.21.15.45:0/2858188131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 0x55fb646c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8ae6e2640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa8940a33b0 0x7fa8940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8ad6e0640 1 -- 172.21.15.45:0/2858188131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 msgr2=0x55fb646c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8ad6e0640 1 --2- 172.21.15.45:0/2858188131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 0x55fb646c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8ad6e0640 1 -- 172.21.15.45:0/2858188131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 msgr2=0x55fb646d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:17.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa89affd640 1 -- 172.21.15.45:0/1373377407 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fa8a40f0670 con 0x7fa8a8102d30 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8ad6e0640 1 --2- 172.21.15.45:0/2858188131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8ad6e0640 1 -- 172.21.15.45:0/2858188131 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb645ba440 con 0x55fb646d3680 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8adee1640 1 --2- 172.21.15.45:0/2858188131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8ad6e0640 1 --2- 172.21.15.45:0/2858188131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646d3680 0x55fb646d5a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0058c0 tx=0x7fa89c00f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adc8f5d191e40282 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.493+0000 7fa8ae6e2640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa8940a33b0 0x7fa8940a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009fd0 tx=0x7fa8a0009600 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.494+0000 7fa893fff640 1 -- 172.21.15.45:0/2858188131 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c004020 con 0x55fb646d3680 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.494+0000 7fa893fff640 1 -- 172.21.15.45:0/2858188131 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa89c0041c0 con 0x55fb646d3680 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.494+0000 7fa893fff640 1 -- 172.21.15.45:0/2858188131 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c0187b0 con 0x55fb646d3680 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.494+0000 7fa8b251e740 1 -- 172.21.15.45:0/2858188131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646d3680 msgr2=0x55fb646d5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.494+0000 7fa8b251e740 1 --2- 172.21.15.45:0/2858188131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646d3680 0x55fb646d5a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0058c0 tx=0x7fa89c00f3c0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.494+0000 7fa8b251e740 1 -- 172.21.15.45:0/2858188131 shutdown_connections 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.494+0000 7fa8b251e740 1 --2- 172.21.15.45:0/2858188131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646d3680 0x55fb646d5a70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.494+0000 7fa8b251e740 1 --2- 172.21.15.45:0/2858188131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.494+0000 7fa8b251e740 1 --2- 172.21.15.45:0/2858188131 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 0x55fb646c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.494+0000 7fa8b251e740 1 -- 172.21.15.45:0/2858188131 >> 172.21.15.45:0/2858188131 conn(0x55fb646c4a30 msgr2=0x55fb646c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.495+0000 7fa8b251e740 1 -- 172.21.15.45:0/2858188131 shutdown_connections 2024-09-15T22:25:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.495+0000 7fa8b251e740 1 -- 172.21.15.45:0/2858188131 wait complete. 2024-09-15T22:25:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.495+0000 7fa8b251e740 1 -- start start 2024-09-15T22:25:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.495+0000 7fa8b251e740 1 Processor -- start 2024-09-15T22:25:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8b251e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 0x55fb646d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8b251e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8b251e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646d3680 0x55fb646d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8b251e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55fb646d6250 con 0x55fb646c8dc0 2024-09-15T22:25:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8b251e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fb645e9050 con 0x55fb646d3680 2024-09-15T22:25:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8b251e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55fb646d63d0 con 0x55fb646c84a0 2024-09-15T22:25:17.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8b251e740 10 client.0 _ll_register_callbacks cb 0x55fb64629160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8ad6e0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8ad6e0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48972/0 (socket says 172.21.15.45:48972) 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8ad6e0640 1 -- 172.21.15.45:0/754752186 learned_addr learned my addr 172.21.15.45:0/754752186 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8adee1640 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 0x55fb646d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8ae6e2640 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646d3680 0x55fb646d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8ad6e0640 1 -- 172.21.15.45:0/754752186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 msgr2=0x55fb646d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8ad6e0640 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 0x55fb646d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8ad6e0640 1 -- 172.21.15.45:0/754752186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646d3680 msgr2=0x55fb646d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8ad6e0640 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646d3680 0x55fb646d06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8ad6e0640 1 -- 172.21.15.45:0/754752186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb6439f3c0 con 0x55fb646c8dc0 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8ae6e2640 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646d3680 0x55fb646d06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8ad6e0640 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d01b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00b010 tx=0x7fa89c0043f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296622073af018c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.496+0000 7fa8917fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:25:17.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8917fa640 1 -- 172.21.15.45:0/754752186 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c027020 con 0x55fb646c8dc0 2024-09-15T22:25:17.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8b251e740 1 -- 172.21.15.45:0/754752186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa89c0041c0 con 0x55fb646c8dc0 2024-09-15T22:25:17.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8917fa640 1 -- 172.21.15.45:0/754752186 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fa89c005250 con 0x55fb646c8dc0 2024-09-15T22:25:17.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8917fa640 1 -- 172.21.15.45:0/754752186 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa89c032050 con 0x55fb646c8dc0 2024-09-15T22:25:17.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8b251e740 10 client.16869 fetch_fsmap learned FSMap version 21 2024-09-15T22:25:17.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8b251e740 1 -- 172.21.15.45:0/754752186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fb646e1bc0 con 0x55fb646c8dc0 2024-09-15T22:25:17.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8917fa640 1 -- 172.21.15.45:0/754752186 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa89c0041c0 con 0x55fb646c8dc0 2024-09-15T22:25:17.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8917fa640 1 -- 172.21.15.45:0/754752186 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa89c004ac0 con 0x55fb646c8dc0 2024-09-15T22:25:17.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8b251e740 10 client.16869 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:25:17.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8b251e740 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:25:17.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8b251e740 20 client.16869 populate_metadata read hostname 'smithi045' 2024-09-15T22:25:17.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8b251e740 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fb646e3020 0x55fb646e5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8b251e740 4 client.16869 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:25:17.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8b251e740 1 -- 172.21.15.45:0/754752186 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb6463b850 con 0x55fb646e3020 2024-09-15T22:25:17.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.497+0000 7fa8adee1640 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fb646e3020 0x55fb646e5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.498+0000 7fa8adee1640 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fb646e3020 0x55fb646e5410 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5111b18b7d4018 server_cookie=84594d007439d6f2 in_seq=0 out_seq=0 2024-09-15T22:25:17.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.498+0000 7fa8917fa640 10 client.16869 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:17.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.498+0000 7fa8917fa640 1 -- 172.21.15.45:0/754752186 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb6463b850 con 0x55fb646e3020 2024-09-15T22:25:17.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.498+0000 7fa8917fa640 10 client.16869 handle_command_reply: tid=0 2024-09-15T22:25:17.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.498+0000 7fa8b251e740 1 client.16869 shutdown 2024-09-15T22:25:17.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.499+0000 7fa8b251e740 1 -- 172.21.15.45:0/754752186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 msgr2=0x55fb646d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:17.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.499+0000 7fa8b251e740 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d01b0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00b010 tx=0x7fa89c0043f0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.499+0000 7fa8b251e740 1 -- 172.21.15.45:0/754752186 shutdown_connections 2024-09-15T22:25:17.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.499+0000 7fa8b251e740 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fb646e3020 0x55fb646e5410 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.499+0000 7fa8b251e740 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646d3680 0x55fb646d06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.499+0000 7fa8b251e740 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d01b0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.499+0000 7fa8917fa640 0 client.16869 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.499+0000 7fa8b251e740 1 --2- 172.21.15.45:0/754752186 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 0x55fb646d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.499+0000 7fa8b251e740 1 -- 172.21.15.45:0/754752186 >> 172.21.15.45:0/754752186 conn(0x55fb646c4a30 msgr2=0x55fb646ca760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.499+0000 7fa8b251e740 1 -- 172.21.15.45:0/754752186 shutdown_connections 2024-09-15T22:25:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.499+0000 7fa8b251e740 1 -- 172.21.15.45:0/754752186 wait complete. 2024-09-15T22:25:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.499+0000 7fa8b251e740 20 client.16869 trim_cache size 0 max 16384 2024-09-15T22:25:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.516+0000 7fa8b251e740 1 Processor -- start 2024-09-15T22:25:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.516+0000 7fa8b251e740 1 -- start start 2024-09-15T22:25:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8b251e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 0x55fb646df510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8b251e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646c8dc0 0x55fb646eaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8b251e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646d3680 0x55fb646eafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8b251e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81af4f0 con 0x55fb646d3680 2024-09-15T22:25:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8b251e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81b1d70 con 0x55fb646c8dc0 2024-09-15T22:25:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8b251e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81afb60 con 0x55fb646c84a0 2024-09-15T22:25:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8ae6e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646d3680 0x55fb646eafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8adee1640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 0x55fb646df510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8ae6e2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646d3680 0x55fb646eafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48978/0 (socket says 172.21.15.45:48978) 2024-09-15T22:25:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8ae6e2640 1 -- 172.21.15.45:0/582205520 learned_addr learned my addr 172.21.15.45:0/582205520 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8ad6e0640 1 --2- 172.21.15.45:0/582205520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646c8dc0 0x55fb646eaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8adee1640 1 -- 172.21.15.45:0/582205520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646c8dc0 msgr2=0x55fb646eaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8adee1640 1 --2- 172.21.15.45:0/582205520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646c8dc0 0x55fb646eaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8adee1640 1 -- 172.21.15.45:0/582205520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646d3680 msgr2=0x55fb646eafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8adee1640 1 --2- 172.21.15.45:0/582205520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646d3680 0x55fb646eafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8adee1640 1 -- 172.21.15.45:0/582205520 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb646c8bf0 con 0x55fb646c84a0 2024-09-15T22:25:17.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.517+0000 7fa8adee1640 1 --2- 172.21.15.45:0/582205520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 0x55fb646df510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40bc3b0 tx=0x7fa8a40f2d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd45cbc28d74d0c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.518+0000 7fa8937fe640 1 -- 172.21.15.45:0/582205520 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a40f0070 con 0x55fb646c84a0 2024-09-15T22:25:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.518+0000 7fa8937fe640 1 -- 172.21.15.45:0/582205520 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8a40dc040 con 0x55fb646c84a0 2024-09-15T22:25:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.518+0000 7fa8937fe640 1 -- 172.21.15.45:0/582205520 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4049040 con 0x55fb646c84a0 2024-09-15T22:25:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.518+0000 7fa8b251e740 1 -- 172.21.15.45:0/582205520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 msgr2=0x55fb646df510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.518+0000 7fa8b251e740 1 --2- 172.21.15.45:0/582205520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 0x55fb646df510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40bc3b0 tx=0x7fa8a40f2d10 comp rx=0 tx=0).stop 2024-09-15T22:25:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.518+0000 7fa8b251e740 1 -- 172.21.15.45:0/582205520 shutdown_connections 2024-09-15T22:25:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.518+0000 7fa8b251e740 1 --2- 172.21.15.45:0/582205520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646d3680 0x55fb646eafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.518+0000 7fa8b251e740 1 --2- 172.21.15.45:0/582205520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646c8dc0 0x55fb646eaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.518+0000 7fa8b251e740 1 --2- 172.21.15.45:0/582205520 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646c84a0 0x55fb646df510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.518+0000 7fa8b251e740 1 -- 172.21.15.45:0/582205520 >> 172.21.15.45:0/582205520 conn(0x55fb646c4a30 msgr2=0x55fb646cf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.519+0000 7fa8b251e740 1 -- 172.21.15.45:0/582205520 shutdown_connections 2024-09-15T22:25:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.519+0000 7fa8b251e740 1 -- 172.21.15.45:0/582205520 wait complete. 2024-09-15T22:25:17.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.519+0000 7fa8b251e740 1 -- start start 2024-09-15T22:25:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.519+0000 7fa8b251e740 1 Processor -- start 2024-09-15T22:25:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.519+0000 7fa8b251e740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646c84a0 0x55fb646d7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.519+0000 7fa8b251e740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.519+0000 7fa8b251e740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646d3680 0x55fb646d8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.519+0000 7fa8b251e740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81b0230 con 0x55fb646c8dc0 2024-09-15T22:25:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.519+0000 7fa8b251e740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81b16a0 con 0x55fb646c84a0 2024-09-15T22:25:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.519+0000 7fa8b251e740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a81b0900 con 0x55fb646d3680 2024-09-15T22:25:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.519+0000 7fa8b251e740 10 client.0 _ll_register_callbacks cb 0x7fa8a40b8220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8ad6e0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8ad6e0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48990/0 (socket says 172.21.15.45:48990) 2024-09-15T22:25:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8ad6e0640 1 -- 172.21.15.45:0/4176538623 learned_addr learned my addr 172.21.15.45:0/4176538623 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:17.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8adee1640 1 --2- 172.21.15.45:0/4176538623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646c84a0 0x55fb646d7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8ae6e2640 1 --2- 172.21.15.45:0/4176538623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646d3680 0x55fb646d8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8ad6e0640 1 -- 172.21.15.45:0/4176538623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646d3680 msgr2=0x55fb646d8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8ad6e0640 1 --2- 172.21.15.45:0/4176538623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646d3680 0x55fb646d8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8ad6e0640 1 -- 172.21.15.45:0/4176538623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646c84a0 msgr2=0x55fb646d7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8ad6e0640 1 --2- 172.21.15.45:0/4176538623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646c84a0 0x55fb646d7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8ad6e0640 1 -- 172.21.15.45:0/4176538623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb6474ccc0 con 0x55fb646c8dc0 2024-09-15T22:25:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8ad6e0640 1 --2- 172.21.15.45:0/4176538623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d7bd0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa89c004ee0 tx=0x7fa89c018440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb1a61c315e2018 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8917fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:25:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8917fa640 1 -- 172.21.15.45:0/4176538623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c027040 con 0x55fb646c8dc0 2024-09-15T22:25:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8917fa640 1 -- 172.21.15.45:0/4176538623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fa89c004a70 con 0x55fb646c8dc0 2024-09-15T22:25:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8b251e740 1 -- 172.21.15.45:0/4176538623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8a40dc040 con 0x55fb646c8dc0 2024-09-15T22:25:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8917fa640 1 -- 172.21.15.45:0/4176538623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa89c044050 con 0x55fb646c8dc0 2024-09-15T22:25:17.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8b251e740 10 client.16875 fetch_fsmap learned FSMap version 21 2024-09-15T22:25:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.520+0000 7fa8b251e740 1 -- 172.21.15.45:0/4176538623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fb6474dfd0 con 0x55fb646c8dc0 2024-09-15T22:25:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.521+0000 7fa8917fa640 1 -- 172.21.15.45:0/4176538623 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8a40dc040 con 0x55fb646c8dc0 2024-09-15T22:25:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.521+0000 7fa8917fa640 1 -- 172.21.15.45:0/4176538623 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa89c0185d0 con 0x55fb646c8dc0 2024-09-15T22:25:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.521+0000 7fa8b251e740 10 client.16875 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:25:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.521+0000 7fa8b251e740 10 client.16875 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:25:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.521+0000 7fa8b251e740 20 client.16875 populate_metadata read hostname 'smithi045' 2024-09-15T22:25:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.521+0000 7fa8b251e740 1 --2- 172.21.15.45:0/4176538623 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fb6474e680 0x55fb64750aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.521+0000 7fa8b251e740 4 client.16875 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:25:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.521+0000 7fa8b251e740 1 -- 172.21.15.45:0/4176538623 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fb646d0a80 con 0x55fb6474e680 2024-09-15T22:25:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.521+0000 7fa8adee1640 1 --2- 172.21.15.45:0/4176538623 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fb6474e680 0x55fb64750aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8adee1640 1 --2- 172.21.15.45:0/4176538623 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fb6474e680 0x55fb64750aa0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b939e73b2c1314e3 server_cookie=214ddc8b785d86a3 in_seq=0 out_seq=0 2024-09-15T22:25:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8917fa640 10 client.16875 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:17.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8917fa640 1 -- 172.21.15.45:0/4176538623 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fb646d0a80 con 0x55fb6474e680 2024-09-15T22:25:17.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8917fa640 10 client.16875 handle_command_reply: tid=0 2024-09-15T22:25:17.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8b251e740 1 client.16875 shutdown 2024-09-15T22:25:17.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8b251e740 1 -- 172.21.15.45:0/4176538623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 msgr2=0x55fb646d7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:17.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8b251e740 1 --2- 172.21.15.45:0/4176538623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d7bd0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa89c004ee0 tx=0x7fa89c018440 comp rx=0 tx=0).stop 2024-09-15T22:25:17.858 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:25:17.858 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:25:17.858 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:25:17.859 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:25:17.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8b251e740 1 -- 172.21.15.45:0/4176538623 shutdown_connections 2024-09-15T22:25:17.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8b251e740 1 --2- 172.21.15.45:0/4176538623 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55fb6474e680 0x55fb64750aa0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8b251e740 1 --2- 172.21.15.45:0/4176538623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55fb646d3680 0x55fb646d8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8b251e740 1 --2- 172.21.15.45:0/4176538623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fb646c8dc0 0x55fb646d7bd0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8b251e740 1 --2- 172.21.15.45:0/4176538623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fb646c84a0 0x55fb646d7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8917fa640 0 client.16875 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:17.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8b251e740 1 -- 172.21.15.45:0/4176538623 >> 172.21.15.45:0/4176538623 conn(0x55fb646c4a30 msgr2=0x55fb646c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:17.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8b251e740 1 -- 172.21.15.45:0/4176538623 shutdown_connections 2024-09-15T22:25:17.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8b251e740 1 -- 172.21.15.45:0/4176538623 wait complete. 2024-09-15T22:25:17.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.522+0000 7fa8b251e740 20 client.16875 trim_cache size 0 max 16384 2024-09-15T22:25:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.523+0000 7fa8b0145640 1 -- 172.21.15.45:0/1373377407 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa8940a33b0 msgr2=0x7fa8940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.523+0000 7fa8b0145640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa8940a33b0 0x7fa8940a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009fd0 tx=0x7fa8a0009600 comp rx=0 tx=0).stop 2024-09-15T22:25:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.523+0000 7fa8b0145640 1 -- 172.21.15.45:0/1373377407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8a8102d30 msgr2=0x7fa8a8100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.523+0000 7fa8b0145640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8a8102d30 0x7fa8a8100990 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4009230 tx=0x7fa8a4004270 comp rx=0 tx=0).stop 2024-09-15T22:25:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.523+0000 7fa8b0145640 1 -- 172.21.15.45:0/1373377407 shutdown_connections 2024-09-15T22:25:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.523+0000 7fa8b0145640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa8940a33b0 0x7fa8940a5870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.523+0000 7fa8b0145640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8a81082a0 0x7fa8a8101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.523+0000 7fa8b0145640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa8a81036e0 0x7fa8a8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.523+0000 7fa8b0145640 1 --2- 172.21.15.45:0/1373377407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8a8102d30 0x7fa8a8100990 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.523+0000 7fa8b0145640 1 -- 172.21.15.45:0/1373377407 >> 172.21.15.45:0/1373377407 conn(0x7fa8a80fc7d0 msgr2=0x7fa8a8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.523+0000 7fa8b0145640 1 -- 172.21.15.45:0/1373377407 shutdown_connections 2024-09-15T22:25:17.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:17.523+0000 7fa8b0145640 1 -- 172.21.15.45:0/1373377407 wait complete. 2024-09-15T22:25:18.775 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:25:18.775 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:25:19.038 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:25:19.159 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:18 smithi045 ceph-mon[31180]: pgmap v281: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 206 B/s wr, 2 op/s 2024-09-15T22:25:19.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:18 smithi165 ceph-mon[35551]: pgmap v281: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 206 B/s wr, 2 op/s 2024-09-15T22:25:19.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:18 smithi100 ceph-mon[35319]: pgmap v281: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 206 B/s wr, 2 op/s 2024-09-15T22:25:19.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.524+0000 7f0124efb640 1 -- 172.21.15.45:0/1880567331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0120101420 msgr2=0x7f012010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:19.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.524+0000 7f0124efb640 1 --2- 172.21.15.45:0/1880567331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0120101420 0x7f012010d950 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f0118009cd0 tx=0x7f011802a8e0 comp rx=0 tx=0).stop 2024-09-15T22:25:19.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.525+0000 7f0124efb640 1 -- 172.21.15.45:0/1880567331 shutdown_connections 2024-09-15T22:25:19.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.525+0000 7f0124efb640 1 --2- 172.21.15.45:0/1880567331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0120101420 0x7f012010d950 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.525+0000 7f0124efb640 1 --2- 172.21.15.45:0/1880567331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0120100a80 0x7f0120100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.525+0000 7f0124efb640 1 --2- 172.21.15.45:0/1880567331 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0120106a80 0x7f0120106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.525+0000 7f0124efb640 1 -- 172.21.15.45:0/1880567331 >> 172.21.15.45:0/1880567331 conn(0x7f01200fc7a0 msgr2=0x7f01200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.525+0000 7f0124efb640 1 -- 172.21.15.45:0/1880567331 shutdown_connections 2024-09-15T22:25:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.525+0000 7f0124efb640 1 -- 172.21.15.45:0/1880567331 wait complete. 2024-09-15T22:25:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.525+0000 7f0124efb640 1 Processor -- start 2024-09-15T22:25:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.525+0000 7f0124efb640 1 -- start start 2024-09-15T22:25:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f0124efb640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0120100a80 0x7f01200fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f0124efb640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0120101420 0x7f01200fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f0124efb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0120106a80 0x7f01200fd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f0124efb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0120110fa0 con 0x7f0120106a80 2024-09-15T22:25:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f0124efb640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0120110e20 con 0x7f0120100a80 2024-09-15T22:25:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f0124efb640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f0120111120 con 0x7f0120101420 2024-09-15T22:25:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f011ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0120106a80 0x7f01200fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f011ed9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0120106a80 0x7f01200fd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48998/0 (socket says 172.21.15.45:48998) 2024-09-15T22:25:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f011ed9d640 1 -- 172.21.15.45:0/1536801291 learned_addr learned my addr 172.21.15.45:0/1536801291 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f011e59c640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0120100a80 0x7f01200fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f011dd9b640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0120101420 0x7f01200fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f011ed9d640 1 -- 172.21.15.45:0/1536801291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0120101420 msgr2=0x7f01200fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f011ed9d640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0120101420 0x7f01200fd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f011ed9d640 1 -- 172.21.15.45:0/1536801291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0120100a80 msgr2=0x7f01200fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f011ed9d640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0120100a80 0x7f01200fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f011ed9d640 1 -- 172.21.15.45:0/1536801291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01201a69c0 con 0x7f0120106a80 2024-09-15T22:25:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f011dd9b640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0120101420 0x7f01200fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.526+0000 7f011ed9d640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0120106a80 0x7f01200fd770 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0118009ca0 tx=0x7f0118003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.527+0000 7f01177fe640 1 -- 172.21.15.45:0/1536801291 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0118032e60 con 0x7f0120106a80 2024-09-15T22:25:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.527+0000 7f01177fe640 1 -- 172.21.15.45:0/1536801291 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0118004540 con 0x7f0120106a80 2024-09-15T22:25:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.527+0000 7f0124efb640 1 -- 172.21.15.45:0/1536801291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01201a6c50 con 0x7f0120106a80 2024-09-15T22:25:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.527+0000 7f01177fe640 1 -- 172.21.15.45:0/1536801291 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0118046480 con 0x7f0120106a80 2024-09-15T22:25:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.527+0000 7f0124efb640 1 -- 172.21.15.45:0/1536801291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01201a7190 con 0x7f0120106a80 2024-09-15T22:25:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.528+0000 7f0124efb640 1 -- 172.21.15.45:0/1536801291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0120100ee0 con 0x7f0120106a80 2024-09-15T22:25:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.529+0000 7f01177fe640 1 -- 172.21.15.45:0/1536801291 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0118046620 con 0x7f0120106a80 2024-09-15T22:25:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.530+0000 7f01177fe640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f010c0a33b0 0x7f010c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.530+0000 7f011e59c640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f010c0a33b0 0x7f010c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.530+0000 7f01177fe640 1 -- 172.21.15.45:0/1536801291 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7f011802e030 con 0x7f0120106a80 2024-09-15T22:25:19.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.530+0000 7f011e59c640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f010c0a33b0 0x7f010c0a5870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0110005fd0 tx=0x7f011000b510 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:19.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.534+0000 7f01177fe640 1 -- 172.21.15.45:0/1536801291 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f011804b060 con 0x7f0120106a80 2024-09-15T22:25:19.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.747+0000 7f0124efb640 1 -- 172.21.15.45:0/1536801291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f012010a000 con 0x7f0120106a80 2024-09-15T22:25:19.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.747+0000 7f01177fe640 1 -- 172.21.15.45:0/1536801291 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f01180bdf20 con 0x7f0120106a80 2024-09-15T22:25:19.749 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:25:19.749 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:25:19.750 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:25:19.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.750+0000 7f0124efb640 1 -- 172.21.15.45:0/1536801291 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f010c0a33b0 msgr2=0x7f010c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:19.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.750+0000 7f0124efb640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f010c0a33b0 0x7f010c0a5870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0110005fd0 tx=0x7f011000b510 comp rx=0 tx=0).stop 2024-09-15T22:25:19.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.750+0000 7f0124efb640 1 -- 172.21.15.45:0/1536801291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0120106a80 msgr2=0x7f01200fd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:19.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.750+0000 7f0124efb640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0120106a80 0x7f01200fd770 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0118009ca0 tx=0x7f0118003f10 comp rx=0 tx=0).stop 2024-09-15T22:25:19.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.750+0000 7f0124efb640 1 -- 172.21.15.45:0/1536801291 shutdown_connections 2024-09-15T22:25:19.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.750+0000 7f0124efb640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f010c0a33b0 0x7f010c0a5870 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:19.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.750+0000 7f0124efb640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0120106a80 0x7f01200fd770 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:19.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.750+0000 7f0124efb640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f0120101420 0x7f01200fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:19.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.750+0000 7f0124efb640 1 --2- 172.21.15.45:0/1536801291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0120100a80 0x7f01200fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:19.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.750+0000 7f0124efb640 1 -- 172.21.15.45:0/1536801291 >> 172.21.15.45:0/1536801291 conn(0x7f01200fc7a0 msgr2=0x7f012006a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:19.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.750+0000 7f0124efb640 1 -- 172.21.15.45:0/1536801291 shutdown_connections 2024-09-15T22:25:19.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:19.750+0000 7f0124efb640 1 -- 172.21.15.45:0/1536801291 wait complete. 2024-09-15T22:25:20.050 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:19 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1536801291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:25:20.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:19 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1536801291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:25:20.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:19 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1536801291' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:25:20.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:25:20.738 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:25:21.135 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:20 smithi045 ceph-mon[31180]: pgmap v282: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:25:21.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:20 smithi165 ceph-mon[35551]: pgmap v282: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:25:21.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:20 smithi100 ceph-mon[35319]: pgmap v282: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:25:21.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.217+0000 7effcd3b3640 1 -- 172.21.15.45:0/2685161288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc8106a80 msgr2=0x7effc8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:21.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.217+0000 7effcd3b3640 1 --2- 172.21.15.45:0/2685161288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc8106a80 0x7effc8106e60 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7effb8009930 tx=0x7effb802a420 comp rx=0 tx=0).stop 2024-09-15T22:25:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.217+0000 7effcd3b3640 1 -- 172.21.15.45:0/2685161288 shutdown_connections 2024-09-15T22:25:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.217+0000 7effcd3b3640 1 --2- 172.21.15.45:0/2685161288 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effc8101420 0x7effc810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.217+0000 7effcd3b3640 1 --2- 172.21.15.45:0/2685161288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc8100a80 0x7effc8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.217+0000 7effcd3b3640 1 --2- 172.21.15.45:0/2685161288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc8106a80 0x7effc8106e60 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.217+0000 7effcd3b3640 1 -- 172.21.15.45:0/2685161288 >> 172.21.15.45:0/2685161288 conn(0x7effc80fc7a0 msgr2=0x7effc80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.217+0000 7effcd3b3640 1 -- 172.21.15.45:0/2685161288 shutdown_connections 2024-09-15T22:25:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.217+0000 7effcd3b3640 1 -- 172.21.15.45:0/2685161288 wait complete. 2024-09-15T22:25:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effcd3b3640 1 Processor -- start 2024-09-15T22:25:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effcd3b3640 1 -- start start 2024-09-15T22:25:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effcd3b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc8100a80 0x7effc8198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effcd3b3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc8101420 0x7effc8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effcd3b3640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effc8106a80 0x7effc819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effcd3b3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7effc8112100 con 0x7effc8100a80 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effcd3b3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effc8111f80 con 0x7effc8101420 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effcd3b3640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7effc8112280 con 0x7effc8106a80 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effc6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc8100a80 0x7effc8198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effc6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc8100a80 0x7effc8198500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49016/0 (socket says 172.21.15.45:49016) 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effc6ffd640 1 -- 172.21.15.45:0/1832258526 learned_addr learned my addr 172.21.15.45:0/1832258526 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effc67fc640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc8101420 0x7effc8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effc77fe640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effc8106a80 0x7effc819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effc6ffd640 1 -- 172.21.15.45:0/1832258526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effc8106a80 msgr2=0x7effc819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effc6ffd640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effc8106a80 0x7effc819cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effc6ffd640 1 -- 172.21.15.45:0/1832258526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc8101420 msgr2=0x7effc8198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effc6ffd640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc8101420 0x7effc8198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.218+0000 7effc6ffd640 1 -- 172.21.15.45:0/1832258526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc819d4b0 con 0x7effc8100a80 2024-09-15T22:25:21.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.219+0000 7effc6ffd640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc8100a80 0x7effc8198500 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7effb802a940 tx=0x7effb80329c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.219+0000 7effaffff640 1 -- 172.21.15.45:0/1832258526 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb803f030 con 0x7effc8100a80 2024-09-15T22:25:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.219+0000 7effaffff640 1 -- 172.21.15.45:0/1832258526 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7effb8032df0 con 0x7effc8100a80 2024-09-15T22:25:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.219+0000 7effaffff640 1 -- 172.21.15.45:0/1832258526 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8035070 con 0x7effc8100a80 2024-09-15T22:25:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.219+0000 7effcd3b3640 1 -- 172.21.15.45:0/1832258526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc819d740 con 0x7effc8100a80 2024-09-15T22:25:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.219+0000 7effcd3b3640 1 -- 172.21.15.45:0/1832258526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc81a5080 con 0x7effc8100a80 2024-09-15T22:25:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.222+0000 7effaffff640 1 -- 172.21.15.45:0/1832258526 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7effb8042030 con 0x7effc8100a80 2024-09-15T22:25:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.222+0000 7effcf78c740 1 Processor -- start 2024-09-15T22:25:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.222+0000 7effcf78c740 1 -- start start 2024-09-15T22:25:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.222+0000 7effcf78c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823ba090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.222+0000 7effcf78c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 0x5586823baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.222+0000 7effcf78c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.222+0000 7effcf78c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5586823202f0 con 0x5586823bbb40 2024-09-15T22:25:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.222+0000 7effcf78c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5586822c7cf0 con 0x5586823c5370 2024-09-15T22:25:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.222+0000 7effcf78c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55868231c2b0 con 0x5586823ba5d0 2024-09-15T22:25:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.222+0000 7effc77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823ba090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.222+0000 7effc77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823ba090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49026/0 (socket says 172.21.15.45:49026) 2024-09-15T22:25:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.222+0000 7effc77fe640 1 -- 172.21.15.45:0/2892309127 learned_addr learned my addr 172.21.15.45:0/2892309127 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effc6ffd640 1 --2- 172.21.15.45:0/2892309127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 0x5586823baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effc67fc640 1 --2- 172.21.15.45:0/2892309127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effc77fe640 1 -- 172.21.15.45:0/2892309127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 msgr2=0x5586823baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effc77fe640 1 --2- 172.21.15.45:0/2892309127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 0x5586823baa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effc77fe640 1 -- 172.21.15.45:0/2892309127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 msgr2=0x5586823c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effc77fe640 1 --2- 172.21.15.45:0/2892309127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effc77fe640 1 -- 172.21.15.45:0/2892309127 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586822ac3a0 con 0x5586823bbb40 2024-09-15T22:25:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effc67fc640 1 --2- 172.21.15.45:0/2892309127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:25:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effc6ffd640 1 --2- 172.21.15.45:0/2892309127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 0x5586823baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:25:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effaffff640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7effb00a33b0 0x7effb00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effc77fe640 1 --2- 172.21.15.45:0/2892309127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823ba090 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7effc0009b50 tx=0x7effc0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f878f36db791e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effc6ffd640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7effb00a33b0 0x7effb00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effad7fa640 1 -- 172.21.15.45:0/2892309127 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0009e40 con 0x5586823bbb40 2024-09-15T22:25:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effaffff640 1 -- 172.21.15.45:0/1832258526 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7effb80f0520 con 0x7effc8100a80 2024-09-15T22:25:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effad7fa640 1 -- 172.21.15.45:0/2892309127 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7effc001b980 con 0x5586823bbb40 2024-09-15T22:25:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.223+0000 7effad7fa640 1 -- 172.21.15.45:0/2892309127 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0012b90 con 0x5586823bbb40 2024-09-15T22:25:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.224+0000 7effcf78c740 1 -- 172.21.15.45:0/2892309127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 msgr2=0x5586823ba090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.224+0000 7effc6ffd640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7effb00a33b0 0x7effb00a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7effb80ed9b0 tx=0x7effb8009260 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.224+0000 7effcf78c740 1 --2- 172.21.15.45:0/2892309127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823ba090 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7effc0009b50 tx=0x7effc0010740 comp rx=0 tx=0).stop 2024-09-15T22:25:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.224+0000 7effcf78c740 1 -- 172.21.15.45:0/2892309127 shutdown_connections 2024-09-15T22:25:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.224+0000 7effcf78c740 1 --2- 172.21.15.45:0/2892309127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.224+0000 7effcf78c740 1 --2- 172.21.15.45:0/2892309127 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 0x5586823baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.224+0000 7effcf78c740 1 --2- 172.21.15.45:0/2892309127 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823ba090 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.224+0000 7effcf78c740 1 -- 172.21.15.45:0/2892309127 >> 172.21.15.45:0/2892309127 conn(0x558682383310 msgr2=0x5586823b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.224+0000 7effcf78c740 1 -- 172.21.15.45:0/2892309127 shutdown_connections 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.224+0000 7effcf78c740 1 -- 172.21.15.45:0/2892309127 wait complete. 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.224+0000 7effcf78c740 1 -- start start 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.224+0000 7effcf78c740 1 Processor -- start 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effcf78c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 0x5586823c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effcf78c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effcf78c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effcf78c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5586823c8070 con 0x5586823bbb40 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effcf78c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5586822db060 con 0x5586823c5370 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effcf78c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5586823c81f0 con 0x5586823ba5d0 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effcf78c740 10 client.0 _ll_register_callbacks cb 0x55868202e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effc67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effc67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823c1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49032/0 (socket says 172.21.15.45:49032) 2024-09-15T22:25:21.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effc67fc640 1 -- 172.21.15.45:0/511996732 learned_addr learned my addr 172.21.15.45:0/511996732 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:21.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effc77fe640 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effc77fe640 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 0x5586823c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effc67fc640 1 -- 172.21.15.45:0/511996732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 msgr2=0x5586823c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:21.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effc67fc640 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 0x5586823c4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effc67fc640 1 -- 172.21.15.45:0/511996732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 msgr2=0x5586823c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:21.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effc67fc640 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effc67fc640 1 -- 172.21.15.45:0/511996732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586820913c0 con 0x5586823bbb40 2024-09-15T22:25:21.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effc77fe640 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:21.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effc67fc640 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823c1f70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7effbc00f460 tx=0x7effbc00f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d32a8745d06d78 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:21.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effaaff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:25:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effaaff5640 1 -- 172.21.15.45:0/511996732 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc011910 con 0x5586823bbb40 2024-09-15T22:25:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effaaff5640 1 -- 172.21.15.45:0/511996732 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7effbc011ab0 con 0x5586823bbb40 2024-09-15T22:25:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.225+0000 7effcf78c740 1 -- 172.21.15.45:0/511996732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effc001b980 con 0x5586823bbb40 2024-09-15T22:25:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.226+0000 7effaaff5640 1 -- 172.21.15.45:0/511996732 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7effbc024050 con 0x5586823bbb40 2024-09-15T22:25:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.226+0000 7effcf78c740 10 client.16893 fetch_fsmap learned FSMap version 21 2024-09-15T22:25:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.226+0000 7effcf78c740 1 -- 172.21.15.45:0/511996732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5586823d3a50 con 0x5586823bbb40 2024-09-15T22:25:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.226+0000 7effaaff5640 1 -- 172.21.15.45:0/511996732 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7effc001b980 con 0x5586823bbb40 2024-09-15T22:25:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.226+0000 7effaaff5640 1 -- 172.21.15.45:0/511996732 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7effbc0103d0 con 0x5586823bbb40 2024-09-15T22:25:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.226+0000 7effcf78c740 10 client.16893 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:25:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.226+0000 7effcf78c740 10 client.16893 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:25:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.226+0000 7effcf78c740 20 client.16893 populate_metadata read hostname 'smithi045' 2024-09-15T22:25:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.226+0000 7effcf78c740 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5586823d4fb0 0x5586823d73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.226+0000 7effcf78c740 4 client.16893 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:25:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.226+0000 7effcf78c740 1 -- 172.21.15.45:0/511996732 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55868232d860 con 0x5586823d4fb0 2024-09-15T22:25:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.226+0000 7effc77fe640 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5586823d4fb0 0x5586823d73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.227+0000 7effc77fe640 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5586823d4fb0 0x5586823d73d0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aae5faa515bf1bf server_cookie=8c6c325af50d7ae3 in_seq=0 out_seq=0 2024-09-15T22:25:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.227+0000 7effaaff5640 10 client.16893 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.227+0000 7effaaff5640 1 -- 172.21.15.45:0/511996732 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55868232d860 con 0x5586823d4fb0 2024-09-15T22:25:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.227+0000 7effaaff5640 10 client.16893 handle_command_reply: tid=0 2024-09-15T22:25:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.228+0000 7effcf78c740 1 client.16893 shutdown 2024-09-15T22:25:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.228+0000 7effcf78c740 1 -- 172.21.15.45:0/511996732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 msgr2=0x5586823c1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.228+0000 7effcf78c740 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823c1f70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7effbc00f460 tx=0x7effbc00f920 comp rx=0 tx=0).stop 2024-09-15T22:25:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.228+0000 7effcf78c740 1 -- 172.21.15.45:0/511996732 shutdown_connections 2024-09-15T22:25:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.228+0000 7effcf78c740 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5586823d4fb0 0x5586823d73d0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.228+0000 7effcf78c740 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.228+0000 7effaaff5640 0 client.16893 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.228+0000 7effcf78c740 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823c1f70 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.228+0000 7effcf78c740 1 --2- 172.21.15.45:0/511996732 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 0x5586823c4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.228+0000 7effcf78c740 1 -- 172.21.15.45:0/511996732 >> 172.21.15.45:0/511996732 conn(0x558682383310 msgr2=0x5586823bc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.228+0000 7effcf78c740 1 -- 172.21.15.45:0/511996732 shutdown_connections 2024-09-15T22:25:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.228+0000 7effcf78c740 1 -- 172.21.15.45:0/511996732 wait complete. 2024-09-15T22:25:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.228+0000 7effcf78c740 20 client.16893 trim_cache size 0 max 16384 2024-09-15T22:25:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effcf78c740 1 Processor -- start 2024-09-15T22:25:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effcf78c740 1 -- start start 2024-09-15T22:25:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effcf78c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 0x5586823d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effcf78c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effcf78c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823dcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effcf78c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7effc81ad250 con 0x5586823bbb40 2024-09-15T22:25:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effcf78c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effc81afad0 con 0x5586823c5370 2024-09-15T22:25:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effcf78c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7effc81ad8c0 con 0x5586823ba5d0 2024-09-15T22:25:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effc67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effc67fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823c0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49040/0 (socket says 172.21.15.45:49040) 2024-09-15T22:25:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effc67fc640 1 -- 172.21.15.45:0/1734871718 learned_addr learned my addr 172.21.15.45:0/1734871718 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effc67fc640 1 -- 172.21.15.45:0/1734871718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 msgr2=0x5586823d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effc67fc640 1 --2- 172.21.15.45:0/1734871718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 0x5586823d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effc67fc640 1 -- 172.21.15.45:0/1734871718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 msgr2=0x5586823dcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effc67fc640 1 --2- 172.21.15.45:0/1734871718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823dcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effc67fc640 1 -- 172.21.15.45:0/1734871718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586823bad50 con 0x5586823bbb40 2024-09-15T22:25:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.241+0000 7effc67fc640 1 --2- 172.21.15.45:0/1734871718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823c0f50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7effbc009550 tx=0x7effbc009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9292cc977d4c974 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.242+0000 7effacff9640 1 -- 172.21.15.45:0/1734871718 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc0103d0 con 0x5586823bbb40 2024-09-15T22:25:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.242+0000 7effacff9640 1 -- 172.21.15.45:0/1734871718 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7effbc02c030 con 0x5586823bbb40 2024-09-15T22:25:21.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.242+0000 7effacff9640 1 -- 172.21.15.45:0/1734871718 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc011a00 con 0x5586823bbb40 2024-09-15T22:25:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.242+0000 7effcf78c740 1 -- 172.21.15.45:0/1734871718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 msgr2=0x5586823c0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.242+0000 7effcf78c740 1 --2- 172.21.15.45:0/1734871718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823c0f50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7effbc009550 tx=0x7effbc009930 comp rx=0 tx=0).stop 2024-09-15T22:25:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.242+0000 7effcf78c740 1 -- 172.21.15.45:0/1734871718 shutdown_connections 2024-09-15T22:25:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.242+0000 7effcf78c740 1 --2- 172.21.15.45:0/1734871718 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823dcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.242+0000 7effcf78c740 1 --2- 172.21.15.45:0/1734871718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823bbb40 0x5586823c0f50 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.242+0000 7effcf78c740 1 --2- 172.21.15.45:0/1734871718 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823ba5d0 0x5586823d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.242+0000 7effcf78c740 1 -- 172.21.15.45:0/1734871718 >> 172.21.15.45:0/1734871718 conn(0x558682383310 msgr2=0x5586823c0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.242+0000 7effcf78c740 1 -- 172.21.15.45:0/1734871718 shutdown_connections 2024-09-15T22:25:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.242+0000 7effcf78c740 1 -- 172.21.15.45:0/1734871718 wait complete. 2024-09-15T22:25:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.242+0000 7effcf78c740 1 -- start start 2024-09-15T22:25:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effcf78c740 1 Processor -- start 2024-09-15T22:25:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effcf78c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823ba5d0 0x5586823cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effcf78c740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823bbb40 0x5586823c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effcf78c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effcf78c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7effc81adf90 con 0x5586823ba5d0 2024-09-15T22:25:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effcf78c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effc81af400 con 0x5586823c5370 2024-09-15T22:25:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effcf78c740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7effc81ae660 con 0x5586823bbb40 2024-09-15T22:25:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effcf78c740 10 client.0 _ll_register_callbacks cb 0x7effbc009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effc77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823ba5d0 0x5586823cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effc77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823ba5d0 0x5586823cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49050/0 (socket says 172.21.15.45:49050) 2024-09-15T22:25:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effc77fe640 1 -- 172.21.15.45:0/2388777045 learned_addr learned my addr 172.21.15.45:0/2388777045 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effc67fc640 1 --2- 172.21.15.45:0/2388777045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823bbb40 0x5586823c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effc77fe640 1 -- 172.21.15.45:0/2388777045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823bbb40 msgr2=0x5586823c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effc77fe640 1 --2- 172.21.15.45:0/2388777045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823bbb40 0x5586823c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effc77fe640 1 -- 172.21.15.45:0/2388777045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 msgr2=0x5586823c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effc77fe640 1 --2- 172.21.15.45:0/2388777045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effc77fe640 1 -- 172.21.15.45:0/2388777045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586823c9c00 con 0x5586823ba5d0 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effc77fe640 1 --2- 172.21.15.45:0/2388777045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823ba5d0 0x5586823cdb90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7effc00128a0 tx=0x7effc0010f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc07a587c3ee45f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.243+0000 7effaaff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effaaff5640 1 -- 172.21.15.45:0/2388777045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0024040 con 0x5586823ba5d0 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effaaff5640 1 -- 172.21.15.45:0/2388777045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7effc00050f0 con 0x5586823ba5d0 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effcf78c740 1 -- 172.21.15.45:0/2388777045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effbc02c030 con 0x5586823ba5d0 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effaaff5640 1 -- 172.21.15.45:0/2388777045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7effc0032050 con 0x5586823ba5d0 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effcf78c740 10 client.16899 fetch_fsmap learned FSMap version 21 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effcf78c740 1 -- 172.21.15.45:0/2388777045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558682444050 con 0x5586823ba5d0 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effaaff5640 1 -- 172.21.15.45:0/2388777045 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7effbc02c030 con 0x5586823ba5d0 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effaaff5640 1 -- 172.21.15.45:0/2388777045 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7effc000f040 con 0x5586823ba5d0 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effcf78c740 10 client.16899 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effcf78c740 10 client.16899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:25:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effcf78c740 20 client.16899 populate_metadata read hostname 'smithi045' 2024-09-15T22:25:21.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effcf78c740 1 --2- 172.21.15.45:0/2388777045 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5586824445e0 0x5586824469d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:21.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effcf78c740 4 client.16899 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:25:21.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.244+0000 7effcf78c740 1 -- 172.21.15.45:0/2388777045 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558682327d70 con 0x5586824445e0 2024-09-15T22:25:21.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effc67fc640 1 --2- 172.21.15.45:0/2388777045 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5586824445e0 0x5586824469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:21.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effc67fc640 1 --2- 172.21.15.45:0/2388777045 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5586824445e0 0x5586824469d0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e58b9e52cc79437 server_cookie=15365630efd05493 in_seq=0 out_seq=0 2024-09-15T22:25:21.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effaaff5640 10 client.16899 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:21.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effaaff5640 1 -- 172.21.15.45:0/2388777045 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558682327d70 con 0x5586824445e0 2024-09-15T22:25:21.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effaaff5640 10 client.16899 handle_command_reply: tid=0 2024-09-15T22:25:21.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effcf78c740 1 client.16899 shutdown 2024-09-15T22:25:21.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effcf78c740 1 -- 172.21.15.45:0/2388777045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823ba5d0 msgr2=0x5586823cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:21.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effcf78c740 1 --2- 172.21.15.45:0/2388777045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823ba5d0 0x5586823cdb90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7effc00128a0 tx=0x7effc0010f70 comp rx=0 tx=0).stop 2024-09-15T22:25:21.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effcf78c740 1 -- 172.21.15.45:0/2388777045 shutdown_connections 2024-09-15T22:25:21.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effcf78c740 1 --2- 172.21.15.45:0/2388777045 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5586824445e0 0x5586824469d0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effcf78c740 1 --2- 172.21.15.45:0/2388777045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5586823c5370 0x5586823c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effcf78c740 1 --2- 172.21.15.45:0/2388777045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5586823bbb40 0x5586823c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effcf78c740 1 --2- 172.21.15.45:0/2388777045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586823ba5d0 0x5586823cdb90 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effcf78c740 1 -- 172.21.15.45:0/2388777045 >> 172.21.15.45:0/2388777045 conn(0x558682383310 msgr2=0x5586823bc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:21.268 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:25:21.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effaaff5640 0 client.16899 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:21.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effcf78c740 1 -- 172.21.15.45:0/2388777045 shutdown_connections 2024-09-15T22:25:21.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effcf78c740 1 -- 172.21.15.45:0/2388777045 wait complete. 2024-09-15T22:25:21.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.245+0000 7effcf78c740 20 client.16899 trim_cache size 0 max 16384 2024-09-15T22:25:21.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.246+0000 7effcd3b3640 1 -- 172.21.15.45:0/1832258526 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7effb00a33b0 msgr2=0x7effb00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:21.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.246+0000 7effcd3b3640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7effb00a33b0 0x7effb00a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7effb80ed9b0 tx=0x7effb8009260 comp rx=0 tx=0).stop 2024-09-15T22:25:21.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.246+0000 7effcd3b3640 1 -- 172.21.15.45:0/1832258526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc8100a80 msgr2=0x7effc8198500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:21.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.246+0000 7effcd3b3640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc8100a80 0x7effc8198500 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7effb802a940 tx=0x7effb80329c0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.246+0000 7effcd3b3640 1 -- 172.21.15.45:0/1832258526 shutdown_connections 2024-09-15T22:25:21.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.246+0000 7effcd3b3640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7effb00a33b0 0x7effb00a5870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.246+0000 7effcd3b3640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7effc8106a80 0x7effc819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.246+0000 7effcd3b3640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effc8101420 0x7effc8198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.246+0000 7effcd3b3640 1 --2- 172.21.15.45:0/1832258526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effc8100a80 0x7effc8198500 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:21.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.246+0000 7effcd3b3640 1 -- 172.21.15.45:0/1832258526 >> 172.21.15.45:0/1832258526 conn(0x7effc80fc7a0 msgr2=0x7effc80fcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:21.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.246+0000 7effcd3b3640 1 -- 172.21.15.45:0/1832258526 shutdown_connections 2024-09-15T22:25:21.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:21.246+0000 7effcd3b3640 1 -- 172.21.15.45:0/1832258526 wait complete. 2024-09-15T22:25:23.074 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:25:23.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:25:23.105 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:22 smithi045 ceph-mon[31180]: pgmap v283: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:25:23.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:22 smithi165 ceph-mon[35551]: pgmap v283: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:25:23.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:22 smithi100 ceph-mon[35319]: pgmap v283: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:25:23.345 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:25:23.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.854+0000 7efc8c9b0640 1 -- 172.21.15.45:0/3377879864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc88106f10 msgr2=0x7efc8810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.854+0000 7efc8c9b0640 1 --2- 172.21.15.45:0/3377879864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc88106f10 0x7efc8810ea90 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7efc78009ca0 tx=0x7efc7802a8c0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.854+0000 7efc8c9b0640 1 -- 172.21.15.45:0/3377879864 shutdown_connections 2024-09-15T22:25:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.854+0000 7efc8c9b0640 1 --2- 172.21.15.45:0/3377879864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc88106f10 0x7efc8810ea90 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.854+0000 7efc8c9b0640 1 --2- 172.21.15.45:0/3377879864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc88102790 0x7efc881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.854+0000 7efc8c9b0640 1 --2- 172.21.15.45:0/3377879864 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc88101de0 0x7efc881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.854+0000 7efc8c9b0640 1 -- 172.21.15.45:0/3377879864 >> 172.21.15.45:0/3377879864 conn(0x7efc880fd8c0 msgr2=0x7efc880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.854+0000 7efc8c9b0640 1 -- 172.21.15.45:0/3377879864 shutdown_connections 2024-09-15T22:25:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.854+0000 7efc8c9b0640 1 -- 172.21.15.45:0/3377879864 wait complete. 2024-09-15T22:25:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.855+0000 7efc8c9b0640 1 Processor -- start 2024-09-15T22:25:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.855+0000 7efc8c9b0640 1 -- start start 2024-09-15T22:25:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.855+0000 7efc8c9b0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc88101de0 0x7efc880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.855+0000 7efc8c9b0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc88102790 0x7efc88074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.855+0000 7efc8c9b0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc88106f10 0x7efc88074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.855+0000 7efc8c9b0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7efc88112090 con 0x7efc88102790 2024-09-15T22:25:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.855+0000 7efc8c9b0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efc88111f10 con 0x7efc88106f10 2024-09-15T22:25:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.855+0000 7efc8c9b0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efc88112210 con 0x7efc88101de0 2024-09-15T22:25:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.855+0000 7efc85d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc88102790 0x7efc88074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.855+0000 7efc85d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc88102790 0x7efc88074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49072/0 (socket says 172.21.15.45:49072) 2024-09-15T22:25:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.855+0000 7efc85d9b640 1 -- 172.21.15.45:0/1373863801 learned_addr learned my addr 172.21.15.45:0/1373863801 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.855+0000 7efc8659c640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc88101de0 0x7efc880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.856+0000 7efc86d9d640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc88106f10 0x7efc88074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.856+0000 7efc85d9b640 1 -- 172.21.15.45:0/1373863801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc88101de0 msgr2=0x7efc880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.856+0000 7efc85d9b640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc88101de0 0x7efc880744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.856+0000 7efc85d9b640 1 -- 172.21.15.45:0/1373863801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc88106f10 msgr2=0x7efc88074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.856+0000 7efc85d9b640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc88106f10 0x7efc88074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.856+0000 7efc85d9b640 1 -- 172.21.15.45:0/1373863801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc881a6930 con 0x7efc88102790 2024-09-15T22:25:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.856+0000 7efc86d9d640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc88106f10 0x7efc88074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:25:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.856+0000 7efc85d9b640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc88102790 0x7efc88074a30 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7efc7000c890 tx=0x7efc7000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.856+0000 7efc7f7fe640 1 -- 172.21.15.45:0/1373863801 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70004220 con 0x7efc88102790 2024-09-15T22:25:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.856+0000 7efc7f7fe640 1 -- 172.21.15.45:0/1373863801 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc700043c0 con 0x7efc88102790 2024-09-15T22:25:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.856+0000 7efc8c9b0640 1 -- 172.21.15.45:0/1373863801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc881a6c20 con 0x7efc88102790 2024-09-15T22:25:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.856+0000 7efc7f7fe640 1 -- 172.21.15.45:0/1373863801 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70004b10 con 0x7efc88102790 2024-09-15T22:25:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.856+0000 7efc8c9b0640 1 -- 172.21.15.45:0/1373863801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc881a71b0 con 0x7efc88102790 2024-09-15T22:25:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.858+0000 7efc7f7fe640 1 -- 172.21.15.45:0/1373863801 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7efc700051b0 con 0x7efc88102790 2024-09-15T22:25:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc8ed89740 1 Processor -- start 2024-09-15T22:25:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc8ed89740 1 -- start start 2024-09-15T22:25:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc8ed89740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594e8b60 0x55a1594e8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc8ed89740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 0x55a1594f3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc8ed89740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594f3d40 0x55a1594f6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc8ed89740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a15944e280 con 0x55a1594e9480 2024-09-15T22:25:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc8ed89740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a1593f5b10 con 0x55a1594f3d40 2024-09-15T22:25:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc8ed89740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a15944a240 con 0x55a1594e8b60 2024-09-15T22:25:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc7f7fe640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7efc740a3430 0x7efc740a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc8659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 0x55a1594f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc8659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 0x55a1594f3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49080/0 (socket says 172.21.15.45:49080) 2024-09-15T22:25:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc8659c640 1 -- 172.21.15.45:0/1177257352 learned_addr learned my addr 172.21.15.45:0/1177257352 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc85d9b640 1 --2- 172.21.15.45:0/1177257352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594f3d40 0x55a1594f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc86d9d640 1 --2- 172.21.15.45:0/1177257352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594e8b60 0x55a1594e8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc7f7fe640 1 -- 172.21.15.45:0/1373863801 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7efc700d0180 con 0x7efc88102790 2024-09-15T22:25:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.859+0000 7efc86d9d640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7efc740a3430 0x7efc740a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.860+0000 7efc8659c640 1 -- 172.21.15.45:0/1177257352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594e8b60 msgr2=0x55a1594e8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.860+0000 7efc8659c640 1 --2- 172.21.15.45:0/1177257352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594e8b60 0x55a1594e8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.860+0000 7efc8659c640 1 -- 172.21.15.45:0/1177257352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594f3d40 msgr2=0x55a1594f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:23.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.860+0000 7efc8659c640 1 --2- 172.21.15.45:0/1177257352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594f3d40 0x55a1594f6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.860+0000 7efc8659c640 1 -- 172.21.15.45:0/1177257352 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1594021f0 con 0x55a1594e9480 2024-09-15T22:25:23.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.860+0000 7efc8659c640 1 --2- 172.21.15.45:0/1177257352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 0x55a1594f3800 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7efc8000cc60 tx=0x7efc8000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6412785e6150bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:23.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.860+0000 7efc86d9d640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7efc740a3430 0x7efc740a58f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efc78009430 tx=0x7efc780095c0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:23.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.860+0000 7efc7cff9640 1 -- 172.21.15.45:0/1177257352 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc80014070 con 0x55a1594e9480 2024-09-15T22:25:23.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.860+0000 7efc7cff9640 1 -- 172.21.15.45:0/1177257352 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc800047a0 con 0x55a1594e9480 2024-09-15T22:25:23.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.860+0000 7efc7cff9640 1 -- 172.21.15.45:0/1177257352 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc800108f0 con 0x55a1594e9480 2024-09-15T22:25:23.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.861+0000 7efc8ed89740 1 -- 172.21.15.45:0/1177257352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 msgr2=0x55a1594f3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:23.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.861+0000 7efc8ed89740 1 --2- 172.21.15.45:0/1177257352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 0x55a1594f3800 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7efc8000cc60 tx=0x7efc8000e720 comp rx=0 tx=0).stop 2024-09-15T22:25:23.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.861+0000 7efc8ed89740 1 -- 172.21.15.45:0/1177257352 shutdown_connections 2024-09-15T22:25:23.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.861+0000 7efc8ed89740 1 --2- 172.21.15.45:0/1177257352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594f3d40 0x55a1594f6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.861+0000 7efc8ed89740 1 --2- 172.21.15.45:0/1177257352 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 0x55a1594f3800 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.861+0000 7efc8ed89740 1 --2- 172.21.15.45:0/1177257352 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594e8b60 0x55a1594e8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.861+0000 7efc8ed89740 1 -- 172.21.15.45:0/1177257352 >> 172.21.15.45:0/1177257352 conn(0x55a1594e50f0 msgr2=0x55a1594e54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:23.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.861+0000 7efc8ed89740 1 -- 172.21.15.45:0/1177257352 shutdown_connections 2024-09-15T22:25:23.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.861+0000 7efc8ed89740 1 -- 172.21.15.45:0/1177257352 wait complete. 2024-09-15T22:25:23.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.861+0000 7efc8ed89740 1 -- start start 2024-09-15T22:25:23.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.861+0000 7efc8ed89740 1 Processor -- start 2024-09-15T22:25:23.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8ed89740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 0x55a1594f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8ed89740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e9480 0x55a1594f1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8ed89740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 0x55a1594f1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8ed89740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55a1594f6910 con 0x55a1594e8b60 2024-09-15T22:25:23.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8ed89740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a159408f10 con 0x55a1594e9480 2024-09-15T22:25:23.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8ed89740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55a1594f6a90 con 0x55a1594f3d40 2024-09-15T22:25:23.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8ed89740 10 client.0 _ll_register_callbacks cb 0x55a1593d1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:23.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 0x55a1594f0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 0x55a1594f0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49092/0 (socket says 172.21.15.45:49092) 2024-09-15T22:25:23.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8659c640 1 -- 172.21.15.45:0/4265772340 learned_addr learned my addr 172.21.15.45:0/4265772340 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:23.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc85d9b640 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e9480 0x55a1594f1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8659c640 1 -- 172.21.15.45:0/4265772340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 msgr2=0x55a1594f1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:23.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc86d9d640 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 0x55a1594f1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8659c640 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 0x55a1594f1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8659c640 1 -- 172.21.15.45:0/4265772340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e9480 msgr2=0x55a1594f1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:23.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8659c640 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e9480 0x55a1594f1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8659c640 1 -- 172.21.15.45:0/4265772340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1591bf6a0 con 0x55a1594e8b60 2024-09-15T22:25:23.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc85d9b640 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e9480 0x55a1594f1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:25:23.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8659c640 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 0x55a1594f0be0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7efc80010c80 tx=0x7efc80010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f2919bb0a2fa49 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:23.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:25:23.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc6dffb640 1 -- 172.21.15.45:0/4265772340 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc80027060 con 0x55a1594e8b60 2024-09-15T22:25:23.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc6dffb640 1 -- 172.21.15.45:0/4265772340 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7efc80022410 con 0x55a1594e8b60 2024-09-15T22:25:23.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.862+0000 7efc8ed89740 1 -- 172.21.15.45:0/4265772340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc800047a0 con 0x55a1594e8b60 2024-09-15T22:25:23.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.863+0000 7efc6dffb640 1 -- 172.21.15.45:0/4265772340 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efc8002e050 con 0x55a1594e8b60 2024-09-15T22:25:23.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.863+0000 7efc8ed89740 10 client.16911 fetch_fsmap learned FSMap version 21 2024-09-15T22:25:23.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.863+0000 7efc8ed89740 1 -- 172.21.15.45:0/4265772340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a1595024e0 con 0x55a1594e8b60 2024-09-15T22:25:23.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.863+0000 7efc6dffb640 1 -- 172.21.15.45:0/4265772340 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc800047a0 con 0x55a1594e8b60 2024-09-15T22:25:23.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.863+0000 7efc6dffb640 1 -- 172.21.15.45:0/4265772340 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7efc800186b0 con 0x55a1594e8b60 2024-09-15T22:25:23.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.863+0000 7efc8ed89740 10 client.16911 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:25:23.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.863+0000 7efc8ed89740 10 client.16911 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:25:23.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.863+0000 7efc8ed89740 20 client.16911 populate_metadata read hostname 'smithi045' 2024-09-15T22:25:23.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.863+0000 7efc8ed89740 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1595039a0 0x55a159505d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.863+0000 7efc8ed89740 4 client.16911 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:25:23.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.863+0000 7efc8ed89740 1 -- 172.21.15.45:0/4265772340 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a15945b7f0 con 0x55a1595039a0 2024-09-15T22:25:23.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.864+0000 7efc85d9b640 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1595039a0 0x55a159505d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.864+0000 7efc85d9b640 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1595039a0 0x55a159505d90 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cbc8fd6ac1eb368 server_cookie=fa6202e787d52062 in_seq=0 out_seq=0 2024-09-15T22:25:23.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.864+0000 7efc6dffb640 10 client.16911 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:23.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc6dffb640 1 -- 172.21.15.45:0/4265772340 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a15945b7f0 con 0x55a1595039a0 2024-09-15T22:25:23.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc6dffb640 10 client.16911 handle_command_reply: tid=0 2024-09-15T22:25:23.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc8ed89740 1 client.16911 shutdown 2024-09-15T22:25:23.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc8ed89740 1 -- 172.21.15.45:0/4265772340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 msgr2=0x55a1594f0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:23.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc8ed89740 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 0x55a1594f0be0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7efc80010c80 tx=0x7efc80010cb0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc8ed89740 1 -- 172.21.15.45:0/4265772340 shutdown_connections 2024-09-15T22:25:23.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc8ed89740 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a1595039a0 0x55a159505d90 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc8ed89740 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 0x55a1594f1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc8ed89740 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e9480 0x55a1594f1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc8ed89740 1 --2- 172.21.15.45:0/4265772340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 0x55a1594f0be0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc8ed89740 1 -- 172.21.15.45:0/4265772340 >> 172.21.15.45:0/4265772340 conn(0x55a1594e50f0 msgr2=0x55a1594eadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:23.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc6dffb640 0 client.16911 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:23.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc8ed89740 1 -- 172.21.15.45:0/4265772340 shutdown_connections 2024-09-15T22:25:23.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc8ed89740 1 -- 172.21.15.45:0/4265772340 wait complete. 2024-09-15T22:25:23.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.865+0000 7efc8ed89740 20 client.16911 trim_cache size 0 max 16384 2024-09-15T22:25:23.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc8ed89740 1 Processor -- start 2024-09-15T22:25:23.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc8ed89740 1 -- start start 2024-09-15T22:25:23.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc8ed89740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 0x55a1594eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc8ed89740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e9480 0x55a15950b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc8ed89740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 0x55a15950b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc8ed89740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7efc881af4a0 con 0x55a1594e8b60 2024-09-15T22:25:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc8ed89740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efc881b1d20 con 0x55a1594e9480 2024-09-15T22:25:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc8ed89740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efc881afb10 con 0x55a1594f3d40 2024-09-15T22:25:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc8659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 0x55a1594eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc8659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 0x55a1594eacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49108/0 (socket says 172.21.15.45:49108) 2024-09-15T22:25:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc8659c640 1 -- 172.21.15.45:0/3860931472 learned_addr learned my addr 172.21.15.45:0/3860931472 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc85d9b640 1 --2- 172.21.15.45:0/3860931472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e9480 0x55a15950b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc86d9d640 1 --2- 172.21.15.45:0/3860931472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 0x55a15950b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.883+0000 7efc8659c640 1 -- 172.21.15.45:0/3860931472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 msgr2=0x55a15950b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.884+0000 7efc8659c640 1 --2- 172.21.15.45:0/3860931472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 0x55a15950b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.884+0000 7efc8659c640 1 -- 172.21.15.45:0/3860931472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e9480 msgr2=0x55a15950b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.884+0000 7efc8659c640 1 --2- 172.21.15.45:0/3860931472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e9480 0x55a15950b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.884+0000 7efc8659c640 1 -- 172.21.15.45:0/3860931472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1594e4f20 con 0x55a1594e8b60 2024-09-15T22:25:23.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.884+0000 7efc86d9d640 1 --2- 172.21.15.45:0/3860931472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 0x55a15950b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:25:23.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.884+0000 7efc85d9b640 1 --2- 172.21.15.45:0/3860931472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e9480 0x55a15950b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:23.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.884+0000 7efc8659c640 1 --2- 172.21.15.45:0/3860931472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 0x55a1594eacc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7efc80000c00 tx=0x7efc8000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb12f8c148d68bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:23.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.884+0000 7efc6ffff640 1 -- 172.21.15.45:0/3860931472 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc80014070 con 0x55a1594e8b60 2024-09-15T22:25:23.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.884+0000 7efc6ffff640 1 -- 172.21.15.45:0/3860931472 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc80010d20 con 0x55a1594e8b60 2024-09-15T22:25:23.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.884+0000 7efc6ffff640 1 -- 172.21.15.45:0/3860931472 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc80004550 con 0x55a1594e8b60 2024-09-15T22:25:23.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.885+0000 7efc8ed89740 1 -- 172.21.15.45:0/3860931472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 msgr2=0x55a1594eacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.885+0000 7efc8ed89740 1 --2- 172.21.15.45:0/3860931472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 0x55a1594eacc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7efc80000c00 tx=0x7efc8000ec20 comp rx=0 tx=0).stop 2024-09-15T22:25:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.885+0000 7efc8ed89740 1 -- 172.21.15.45:0/3860931472 shutdown_connections 2024-09-15T22:25:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.885+0000 7efc8ed89740 1 --2- 172.21.15.45:0/3860931472 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 0x55a15950b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.885+0000 7efc8ed89740 1 --2- 172.21.15.45:0/3860931472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e9480 0x55a15950b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.885+0000 7efc8ed89740 1 --2- 172.21.15.45:0/3860931472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e8b60 0x55a1594eacc0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.885+0000 7efc8ed89740 1 -- 172.21.15.45:0/3860931472 >> 172.21.15.45:0/3860931472 conn(0x55a1594e50f0 msgr2=0x55a1594ea5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.885+0000 7efc8ed89740 1 -- 172.21.15.45:0/3860931472 shutdown_connections 2024-09-15T22:25:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.885+0000 7efc8ed89740 1 -- 172.21.15.45:0/3860931472 wait complete. 2024-09-15T22:25:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.885+0000 7efc8ed89740 1 -- start start 2024-09-15T22:25:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.885+0000 7efc8ed89740 1 Processor -- start 2024-09-15T22:25:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc8ed89740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e8b60 0x55a1594f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc8ed89740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 0x55a1594f8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc8ed89740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 0x55a15956d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc8ed89740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7efc881b01e0 con 0x55a1594e9480 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc8ed89740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efc881b1650 con 0x55a1594e8b60 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc8ed89740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7efc881b08b0 con 0x55a1594f3d40 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc8ed89740 10 client.0 _ll_register_callbacks cb 0x7efc700057c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc85d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 0x55a1594f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc85d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 0x55a1594f8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49120/0 (socket says 172.21.15.45:49120) 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc85d9b640 1 -- 172.21.15.45:0/3354037396 learned_addr learned my addr 172.21.15.45:0/3354037396 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc8659c640 1 --2- 172.21.15.45:0/3354037396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e8b60 0x55a1594f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc85d9b640 1 -- 172.21.15.45:0/3354037396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 msgr2=0x55a15956d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc85d9b640 1 --2- 172.21.15.45:0/3354037396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 0x55a15956d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc85d9b640 1 -- 172.21.15.45:0/3354037396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e8b60 msgr2=0x55a1594f80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc85d9b640 1 --2- 172.21.15.45:0/3354037396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e8b60 0x55a1594f80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc85d9b640 1 -- 172.21.15.45:0/3354037396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1594eb9d0 con 0x55a1594e9480 2024-09-15T22:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc85d9b640 1 --2- 172.21.15.45:0/3354037396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 0x55a1594f8630 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7efc700989e0 tx=0x7efc70008820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db1e9487fcdd828 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc6dffb640 1 -- 172.21.15.45:0/3354037396 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7001d040 con 0x55a1594e9480 2024-09-15T22:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc6dffb640 1 -- 172.21.15.45:0/3354037396 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7efc70014d80 con 0x55a1594e9480 2024-09-15T22:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc8ed89740 1 -- 172.21.15.45:0/3354037396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc80010d20 con 0x55a1594e9480 2024-09-15T22:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc6dffb640 1 -- 172.21.15.45:0/3354037396 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efc700a03c0 con 0x55a1594e9480 2024-09-15T22:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.886+0000 7efc8ed89740 10 client.16917 fetch_fsmap learned FSMap version 21 2024-09-15T22:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.887+0000 7efc8ed89740 1 -- 172.21.15.45:0/3354037396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a15956e8e0 con 0x55a1594e9480 2024-09-15T22:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.887+0000 7efc6dffb640 1 -- 172.21.15.45:0/3354037396 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7efc80010d20 con 0x55a1594e9480 2024-09-15T22:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.887+0000 7efc6dffb640 1 -- 172.21.15.45:0/3354037396 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7efc7009c270 con 0x55a1594e9480 2024-09-15T22:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.887+0000 7efc8ed89740 10 client.16917 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.887+0000 7efc8ed89740 10 client.16917 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.887+0000 7efc8ed89740 20 client.16917 populate_metadata read hostname 'smithi045' 2024-09-15T22:25:23.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.887+0000 7efc8ed89740 1 --2- 172.21.15.45:0/3354037396 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a15956efb0 0x55a1595713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:23.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.887+0000 7efc8ed89740 4 client.16917 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:25:23.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.887+0000 7efc8ed89740 1 -- 172.21.15.45:0/3354037396 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a159455d00 con 0x55a15956efb0 2024-09-15T22:25:23.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.887+0000 7efc8659c640 1 --2- 172.21.15.45:0/3354037396 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a15956efb0 0x55a1595713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:23.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.888+0000 7efc8659c640 1 --2- 172.21.15.45:0/3354037396 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a15956efb0 0x55a1595713a0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a49abceec374583 server_cookie=4ba7835216a03fe7 in_seq=0 out_seq=0 2024-09-15T22:25:23.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.888+0000 7efc6dffb640 10 client.16917 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:23.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc6dffb640 1 -- 172.21.15.45:0/3354037396 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a159455d00 con 0x55a15956efb0 2024-09-15T22:25:23.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc6dffb640 10 client.16917 handle_command_reply: tid=0 2024-09-15T22:25:23.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc8ed89740 1 client.16917 shutdown 2024-09-15T22:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc8ed89740 1 -- 172.21.15.45:0/3354037396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 msgr2=0x55a1594f8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc8ed89740 1 --2- 172.21.15.45:0/3354037396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 0x55a1594f8630 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7efc700989e0 tx=0x7efc70008820 comp rx=0 tx=0).stop 2024-09-15T22:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc8ed89740 1 -- 172.21.15.45:0/3354037396 shutdown_connections 2024-09-15T22:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc8ed89740 1 --2- 172.21.15.45:0/3354037396 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55a15956efb0 0x55a1595713a0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc8ed89740 1 --2- 172.21.15.45:0/3354037396 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55a1594f3d40 0x55a15956d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc8ed89740 1 --2- 172.21.15.45:0/3354037396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a1594e9480 0x55a1594f8630 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc6dffb640 0 client.16917 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc8ed89740 1 --2- 172.21.15.45:0/3354037396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a1594e8b60 0x55a1594f80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc8ed89740 1 -- 172.21.15.45:0/3354037396 >> 172.21.15.45:0/3354037396 conn(0x55a1594e50f0 msgr2=0x55a1594e4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc8ed89740 1 -- 172.21.15.45:0/3354037396 shutdown_connections 2024-09-15T22:25:23.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc8ed89740 1 -- 172.21.15.45:0/3354037396 wait complete. 2024-09-15T22:25:23.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.889+0000 7efc8ed89740 20 client.16917 trim_cache size 0 max 16384 2024-09-15T22:25:23.898 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:25:23.898 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:25:23.898 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "fd69c2dd-c001-452f-97dc-9ea31c4d6f24", 2024-09-15T22:25:23.899 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:25:23.899 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:25:23.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.890+0000 7efc8c9b0640 1 -- 172.21.15.45:0/1373863801 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7efc740a3430 msgr2=0x7efc740a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:23.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.890+0000 7efc8c9b0640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7efc740a3430 0x7efc740a58f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efc78009430 tx=0x7efc780095c0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.890+0000 7efc8c9b0640 1 -- 172.21.15.45:0/1373863801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc88102790 msgr2=0x7efc88074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:23.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.890+0000 7efc8c9b0640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc88102790 0x7efc88074a30 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7efc7000c890 tx=0x7efc7000cd50 comp rx=0 tx=0).stop 2024-09-15T22:25:23.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.890+0000 7efc8c9b0640 1 -- 172.21.15.45:0/1373863801 shutdown_connections 2024-09-15T22:25:23.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.890+0000 7efc8c9b0640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7efc740a3430 0x7efc740a58f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.890+0000 7efc8c9b0640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc88106f10 0x7efc88074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.890+0000 7efc8c9b0640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc88102790 0x7efc88074a30 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.890+0000 7efc8c9b0640 1 --2- 172.21.15.45:0/1373863801 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7efc88101de0 0x7efc880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:23.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.890+0000 7efc8c9b0640 1 -- 172.21.15.45:0/1373863801 >> 172.21.15.45:0/1373863801 conn(0x7efc880fd8c0 msgr2=0x7efc880ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:23.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.890+0000 7efc8c9b0640 1 -- 172.21.15.45:0/1373863801 shutdown_connections 2024-09-15T22:25:23.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:23.890+0000 7efc8c9b0640 1 -- 172.21.15.45:0/1373863801 wait complete. 2024-09-15T22:25:24.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:25:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:25:25.175 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:24 smithi045 ceph-mon[31180]: pgmap v284: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:25:25.175 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:24 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:25:25.175 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:24 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:25:25.175 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:24 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:25:25.175 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:24 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:25:25.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:24 smithi165 ceph-mon[35551]: pgmap v284: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:25:25.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:24 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:25:25.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:24 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:25:25.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:24 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:25:25.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:24 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:25:25.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:24 smithi100 ceph-mon[35319]: pgmap v284: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:25:25.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:24 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:25:25.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:24 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:25:25.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:24 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:25:25.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:24 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:25:25.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.413+0000 7fbf33eb6640 1 -- 172.21.15.45:0/1245206148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c074f40 msgr2=0x7fbf2c10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:25.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.413+0000 7fbf33eb6640 1 --2- 172.21.15.45:0/1245206148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c074f40 0x7fbf2c10de80 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009900 tx=0x7fbf1c02a480 comp rx=0 tx=0).stop 2024-09-15T22:25:25.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.413+0000 7fbf33eb6640 1 -- 172.21.15.45:0/1245206148 shutdown_connections 2024-09-15T22:25:25.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.413+0000 7fbf33eb6640 1 --2- 172.21.15.45:0/1245206148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf2c10e3c0 0x7fbf2c110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.413+0000 7fbf33eb6640 1 --2- 172.21.15.45:0/1245206148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c074f40 0x7fbf2c10de80 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.413+0000 7fbf33eb6640 1 --2- 172.21.15.45:0/1245206148 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf2c074620 0x7fbf2c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.413+0000 7fbf33eb6640 1 -- 172.21.15.45:0/1245206148 >> 172.21.15.45:0/1245206148 conn(0x7fbf2c0fd8c0 msgr2=0x7fbf2c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.413+0000 7fbf33eb6640 1 -- 172.21.15.45:0/1245206148 shutdown_connections 2024-09-15T22:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.413+0000 7fbf33eb6640 1 -- 172.21.15.45:0/1245206148 wait complete. 2024-09-15T22:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf33eb6640 1 Processor -- start 2024-09-15T22:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf33eb6640 1 -- start start 2024-09-15T22:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf33eb6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c074620 0x7fbf2c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf33eb6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf2c074f40 0x7fbf2c19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf33eb6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf2c10e3c0 0x7fbf2c19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf33eb6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1142f0 con 0x7fbf2c074620 2024-09-15T22:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf33eb6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c114170 con 0x7fbf2c10e3c0 2024-09-15T22:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf33eb6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c114470 con 0x7fbf2c074f40 2024-09-15T22:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf31c52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c074620 0x7fbf2c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf31c52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c074620 0x7fbf2c19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42100/0 (socket says 172.21.15.45:42100) 2024-09-15T22:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf31c52640 1 -- 172.21.15.45:0/220595993 learned_addr learned my addr 172.21.15.45:0/220595993 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf31451640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf2c074f40 0x7fbf2c19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf31c52640 1 -- 172.21.15.45:0/220595993 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf2c074f40 msgr2=0x7fbf2c19ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf31c52640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf2c074f40 0x7fbf2c19ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf32453640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf2c10e3c0 0x7fbf2c19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf31c52640 1 -- 172.21.15.45:0/220595993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf2c10e3c0 msgr2=0x7fbf2c19efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf31c52640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf2c10e3c0 0x7fbf2c19efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.414+0000 7fbf31c52640 1 -- 172.21.15.45:0/220595993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c19f6b0 con 0x7fbf2c074620 2024-09-15T22:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.415+0000 7fbf31c52640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c074620 0x7fbf2c19a700 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c920 tx=0x7fbf2800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.415+0000 7fbf22ffd640 1 -- 172.21.15.45:0/220595993 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28007c70 con 0x7fbf2c074620 2024-09-15T22:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.415+0000 7fbf22ffd640 1 -- 172.21.15.45:0/220595993 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf28007e10 con 0x7fbf2c074620 2024-09-15T22:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.415+0000 7fbf33eb6640 1 -- 172.21.15.45:0/220595993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2c19f9a0 con 0x7fbf2c074620 2024-09-15T22:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.415+0000 7fbf22ffd640 1 -- 172.21.15.45:0/220595993 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf28018940 con 0x7fbf2c074620 2024-09-15T22:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.415+0000 7fbf33eb6640 1 -- 172.21.15.45:0/220595993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf2c1a7280 con 0x7fbf2c074620 2024-09-15T22:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.418+0000 7fbf3628f740 1 Processor -- start 2024-09-15T22:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.418+0000 7fbf3628f740 1 -- start start 2024-09-15T22:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.418+0000 7fbf22ffd640 1 -- 172.21.15.45:0/220595993 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fbf28018b20 con 0x7fbf2c074620 2024-09-15T22:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.418+0000 7fbf3628f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 0x55d4fb39c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.418+0000 7fbf3628f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.418+0000 7fbf3628f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 0x55d4fb3a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.418+0000 7fbf3628f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d4fb3022e0 con 0x55d4fb3a7680 2024-09-15T22:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.418+0000 7fbf3628f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d4fb2a9ce0 con 0x55d4fb39c4a0 2024-09-15T22:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.418+0000 7fbf3628f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d4fb2fe2a0 con 0x55d4fb39cdc0 2024-09-15T22:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.418+0000 7fbf31451640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 0x55d4fb3a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf31451640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 0x55d4fb3a9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42108/0 (socket says 172.21.15.45:42108) 2024-09-15T22:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf31451640 1 -- 172.21.15.45:0/2228881679 learned_addr learned my addr 172.21.15.45:0/2228881679 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf32453640 1 --2- 172.21.15.45:0/2228881679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 0x55d4fb39c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf31c52640 1 --2- 172.21.15.45:0/2228881679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf31451640 1 -- 172.21.15.45:0/2228881679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39cdc0 msgr2=0x55d4fb3a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf31451640 1 --2- 172.21.15.45:0/2228881679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf31451640 1 -- 172.21.15.45:0/2228881679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 msgr2=0x55d4fb39c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf31451640 1 --2- 172.21.15.45:0/2228881679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 0x55d4fb39c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf31451640 1 -- 172.21.15.45:0/2228881679 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4fb28e440 con 0x55d4fb3a7680 2024-09-15T22:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf31c52640 1 --2- 172.21.15.45:0/2228881679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf31451640 1 --2- 172.21.15.45:0/2228881679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 0x55d4fb3a9a70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c006010 tx=0x7fbf1c032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b68c36d684ada1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf17fff640 1 -- 172.21.15.45:0/2228881679 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c03f070 con 0x55d4fb3a7680 2024-09-15T22:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf22ffd640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbf180a33b0 0x7fbf180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf17fff640 1 -- 172.21.15.45:0/2228881679 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf1c031840 con 0x55d4fb3a7680 2024-09-15T22:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf17fff640 1 -- 172.21.15.45:0/2228881679 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c035070 con 0x55d4fb3a7680 2024-09-15T22:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.419+0000 7fbf32453640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbf180a33b0 0x7fbf180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.420+0000 7fbf22ffd640 1 -- 172.21.15.45:0/220595993 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fbf280d0380 con 0x7fbf2c074620 2024-09-15T22:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.420+0000 7fbf3628f740 1 -- 172.21.15.45:0/2228881679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 msgr2=0x55d4fb3a9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.420+0000 7fbf32453640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbf180a33b0 0x7fbf180a5870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbf24007ed0 tx=0x7fbf240075c0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.420+0000 7fbf3628f740 1 --2- 172.21.15.45:0/2228881679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 0x55d4fb3a9a70 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c006010 tx=0x7fbf1c032c80 comp rx=0 tx=0).stop 2024-09-15T22:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.420+0000 7fbf3628f740 1 -- 172.21.15.45:0/2228881679 shutdown_connections 2024-09-15T22:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.420+0000 7fbf3628f740 1 --2- 172.21.15.45:0/2228881679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 0x55d4fb3a9a70 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.420+0000 7fbf3628f740 1 --2- 172.21.15.45:0/2228881679 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.420+0000 7fbf3628f740 1 --2- 172.21.15.45:0/2228881679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 0x55d4fb39c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.420+0000 7fbf3628f740 1 -- 172.21.15.45:0/2228881679 >> 172.21.15.45:0/2228881679 conn(0x55d4fb398a30 msgr2=0x55d4fb398e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.420+0000 7fbf3628f740 1 -- 172.21.15.45:0/2228881679 shutdown_connections 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.420+0000 7fbf3628f740 1 -- 172.21.15.45:0/2228881679 wait complete. 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf3628f740 1 -- start start 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf3628f740 1 Processor -- start 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf3628f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39c4a0 0x55d4fb3a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf3628f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf3628f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 0x55d4fb3a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf3628f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d4fb3aa250 con 0x55d4fb3a7680 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf3628f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55d4fb2bd050 con 0x55d4fb39cdc0 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf3628f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x55d4fb3aa3d0 con 0x55d4fb39c4a0 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf3628f740 10 client.0 _ll_register_callbacks cb 0x55d4fb2fd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf32453640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 0x55d4fb3a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf32453640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 0x55d4fb3a46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42112/0 (socket says 172.21.15.45:42112) 2024-09-15T22:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf32453640 1 -- 172.21.15.45:0/1945973175 learned_addr learned my addr 172.21.15.45:0/1945973175 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf31c52640 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39c4a0 0x55d4fb3a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.421+0000 7fbf31451640 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf32453640 1 -- 172.21.15.45:0/1945973175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39c4a0 msgr2=0x55d4fb3a6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf32453640 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39c4a0 0x55d4fb3a6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf32453640 1 -- 172.21.15.45:0/1945973175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39cdc0 msgr2=0x55d4fb3a41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf32453640 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf32453640 1 -- 172.21.15.45:0/1945973175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4fb0733c0 con 0x55d4fb3a7680 2024-09-15T22:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf31451640 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf32453640 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 0x55d4fb3a46e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbf24012e00 tx=0x7fbf24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e427454f0bd53200 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf157fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf157fa640 1 -- 172.21.15.45:0/1945973175 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24023020 con 0x55d4fb3a7680 2024-09-15T22:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf3628f740 1 -- 172.21.15.45:0/1945973175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf1c031840 con 0x55d4fb3a7680 2024-09-15T22:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf157fa640 1 -- 172.21.15.45:0/1945973175 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fbf2401f440 con 0x55d4fb3a7680 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf157fa640 1 -- 172.21.15.45:0/1945973175 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbf2402e050 con 0x55d4fb3a7680 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf3628f740 10 client.16929 fetch_fsmap learned FSMap version 21 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf3628f740 1 -- 172.21.15.45:0/1945973175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d4fb3b5bd0 con 0x55d4fb3a7680 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.422+0000 7fbf157fa640 1 -- 172.21.15.45:0/1945973175 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf1c031840 con 0x55d4fb3a7680 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.423+0000 7fbf157fa640 1 -- 172.21.15.45:0/1945973175 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbf24011040 con 0x55d4fb3a7680 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.423+0000 7fbf3628f740 10 client.16929 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.423+0000 7fbf3628f740 10 client.16929 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.423+0000 7fbf3628f740 20 client.16929 populate_metadata read hostname 'smithi045' 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.423+0000 7fbf3628f740 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d4fb3b7090 0x55d4fb3b9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.423+0000 7fbf3628f740 4 client.16929 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.423+0000 7fbf3628f740 1 -- 172.21.15.45:0/1945973175 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4fb30f850 con 0x55d4fb3b7090 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.423+0000 7fbf31c52640 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d4fb3b7090 0x55d4fb3b9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.423+0000 7fbf31c52640 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d4fb3b7090 0x55d4fb3b9530 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d7c67426ecea9af server_cookie=5541d03152932fc in_seq=0 out_seq=0 2024-09-15T22:25:25.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.423+0000 7fbf157fa640 10 client.16929 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:25.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf157fa640 1 -- 172.21.15.45:0/1945973175 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d4fb30f850 con 0x55d4fb3b7090 2024-09-15T22:25:25.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf157fa640 10 client.16929 handle_command_reply: tid=0 2024-09-15T22:25:25.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf3628f740 1 client.16929 shutdown 2024-09-15T22:25:25.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf3628f740 1 -- 172.21.15.45:0/1945973175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 msgr2=0x55d4fb3a46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:25.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf3628f740 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 0x55d4fb3a46e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fbf24012e00 tx=0x7fbf24004a40 comp rx=0 tx=0).stop 2024-09-15T22:25:25.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf3628f740 1 -- 172.21.15.45:0/1945973175 shutdown_connections 2024-09-15T22:25:25.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf3628f740 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d4fb3b7090 0x55d4fb3b9530 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf3628f740 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb3a7680 0x55d4fb3a46e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf3628f740 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf3628f740 1 --2- 172.21.15.45:0/1945973175 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39c4a0 0x55d4fb3a6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf157fa640 0 client.16929 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf3628f740 1 -- 172.21.15.45:0/1945973175 >> 172.21.15.45:0/1945973175 conn(0x55d4fb398a30 msgr2=0x55d4fb39e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf3628f740 1 -- 172.21.15.45:0/1945973175 shutdown_connections 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf3628f740 1 -- 172.21.15.45:0/1945973175 wait complete. 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.424+0000 7fbf3628f740 20 client.16929 trim_cache size 0 max 16384 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.442+0000 7fbf3628f740 1 Processor -- start 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.442+0000 7fbf3628f740 1 -- start start 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.442+0000 7fbf3628f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb398a30 0x55d4fb39f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.442+0000 7fbf3628f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 0x55d4fb3bee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.442+0000 7fbf3628f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3bf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.442+0000 7fbf3628f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1af420 con 0x55d4fb39cdc0 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.442+0000 7fbf3628f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1b1ca0 con 0x55d4fb39c4a0 2024-09-15T22:25:25.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.442+0000 7fbf3628f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1afa90 con 0x55d4fb398a30 2024-09-15T22:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.443+0000 7fbf32453640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3bf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.443+0000 7fbf32453640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3bf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42128/0 (socket says 172.21.15.45:42128) 2024-09-15T22:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.443+0000 7fbf32453640 1 -- 172.21.15.45:0/2840505742 learned_addr learned my addr 172.21.15.45:0/2840505742 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.443+0000 7fbf31451640 1 --2- 172.21.15.45:0/2840505742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 0x55d4fb3bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.443+0000 7fbf32453640 1 -- 172.21.15.45:0/2840505742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb398a30 msgr2=0x55d4fb39f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.443+0000 7fbf32453640 1 --2- 172.21.15.45:0/2840505742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb398a30 0x55d4fb39f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.443+0000 7fbf32453640 1 -- 172.21.15.45:0/2840505742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 msgr2=0x55d4fb3bee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.443+0000 7fbf32453640 1 --2- 172.21.15.45:0/2840505742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 0x55d4fb3bee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.443+0000 7fbf32453640 1 -- 172.21.15.45:0/2840505742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4fb398860 con 0x55d4fb39cdc0 2024-09-15T22:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.443+0000 7fbf32453640 1 --2- 172.21.15.45:0/2840505742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3bf390 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fbf24014040 tx=0x7fbf2400fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa7edf7d5538378 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.443+0000 7fbf177fe640 1 -- 172.21.15.45:0/2840505742 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24036070 con 0x55d4fb39cdc0 2024-09-15T22:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.443+0000 7fbf177fe640 1 -- 172.21.15.45:0/2840505742 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf24018030 con 0x55d4fb39cdc0 2024-09-15T22:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.443+0000 7fbf177fe640 1 -- 172.21.15.45:0/2840505742 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24023050 con 0x55d4fb39cdc0 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.444+0000 7fbf3628f740 1 -- 172.21.15.45:0/2840505742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb39cdc0 msgr2=0x55d4fb3bf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.444+0000 7fbf3628f740 1 --2- 172.21.15.45:0/2840505742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3bf390 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fbf24014040 tx=0x7fbf2400fc30 comp rx=0 tx=0).stop 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.444+0000 7fbf3628f740 1 -- 172.21.15.45:0/2840505742 shutdown_connections 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.444+0000 7fbf3628f740 1 --2- 172.21.15.45:0/2840505742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3bf390 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.444+0000 7fbf3628f740 1 --2- 172.21.15.45:0/2840505742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 0x55d4fb3bee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.444+0000 7fbf3628f740 1 --2- 172.21.15.45:0/2840505742 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb398a30 0x55d4fb39f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.444+0000 7fbf3628f740 1 -- 172.21.15.45:0/2840505742 >> 172.21.15.45:0/2840505742 conn(0x55d4fb3a4840 msgr2=0x55d4fb39f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.444+0000 7fbf3628f740 1 -- 172.21.15.45:0/2840505742 shutdown_connections 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.444+0000 7fbf3628f740 1 -- 172.21.15.45:0/2840505742 wait complete. 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.444+0000 7fbf3628f740 1 -- start start 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.444+0000 7fbf3628f740 1 Processor -- start 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf3628f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb398a30 0x55d4fb3a1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf3628f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 0x55d4fb3a1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf3628f740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf3628f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1b0160 con 0x55d4fb398a30 2024-09-15T22:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf3628f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1b15d0 con 0x55d4fb39c4a0 2024-09-15T22:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf3628f740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1b0830 con 0x55d4fb39cdc0 2024-09-15T22:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf3628f740 10 client.0 _ll_register_callbacks cb 0x7fbf24007b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf31c52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb398a30 0x55d4fb3a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf31c52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb398a30 0x55d4fb3a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42144/0 (socket says 172.21.15.45:42144) 2024-09-15T22:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf31c52640 1 -- 172.21.15.45:0/3918510643 learned_addr learned my addr 172.21.15.45:0/3918510643 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf32453640 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf31451640 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 0x55d4fb3a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf31c52640 1 -- 172.21.15.45:0/3918510643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39cdc0 msgr2=0x55d4fb3a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf31c52640 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf31c52640 1 -- 172.21.15.45:0/3918510643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 msgr2=0x55d4fb3a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf31c52640 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 0x55d4fb3a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf31c52640 1 -- 172.21.15.45:0/3918510643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4fb420e20 con 0x55d4fb398a30 2024-09-15T22:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf32453640 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf31c52640 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb398a30 0x55d4fb3a1150 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbf2809c1e0 tx=0x7fbf28018400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c395ecf6419e4ac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf157fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf157fa640 1 -- 172.21.15.45:0/3918510643 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf280a0600 con 0x55d4fb398a30 2024-09-15T22:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf157fa640 1 -- 172.21.15.45:0/3918510643 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fbf2800fbe0 con 0x55d4fb398a30 2024-09-15T22:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.445+0000 7fbf3628f740 1 -- 172.21.15.45:0/3918510643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf24018030 con 0x55d4fb398a30 2024-09-15T22:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.446+0000 7fbf157fa640 1 -- 172.21.15.45:0/3918510643 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbf280a4ec0 con 0x55d4fb398a30 2024-09-15T22:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.446+0000 7fbf3628f740 10 client.16935 fetch_fsmap learned FSMap version 21 2024-09-15T22:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.446+0000 7fbf3628f740 1 -- 172.21.15.45:0/3918510643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d4fb4220f0 con 0x55d4fb398a30 2024-09-15T22:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.446+0000 7fbf157fa640 1 -- 172.21.15.45:0/3918510643 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbf24018030 con 0x55d4fb398a30 2024-09-15T22:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.446+0000 7fbf157fa640 1 -- 172.21.15.45:0/3918510643 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fbf280a0170 con 0x55d4fb398a30 2024-09-15T22:25:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.446+0000 7fbf3628f740 10 client.16935 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:25:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.446+0000 7fbf3628f740 10 client.16935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:25:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.446+0000 7fbf3628f740 20 client.16935 populate_metadata read hostname 'smithi045' 2024-09-15T22:25:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.446+0000 7fbf3628f740 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d4fb3a7680 0x55d4fb4247d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.446+0000 7fbf3628f740 4 client.16935 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:25:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.446+0000 7fbf3628f740 1 -- 172.21.15.45:0/3918510643 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d4fb309d60 con 0x55d4fb3a7680 2024-09-15T22:25:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.446+0000 7fbf31451640 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d4fb3a7680 0x55d4fb4247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf157fa640 10 client.16935 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf31451640 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d4fb3a7680 0x55d4fb4247d0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ccbdbaf045a698d server_cookie=19522d2cdedf71a2 in_seq=0 out_seq=0 2024-09-15T22:25:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf157fa640 1 -- 172.21.15.45:0/3918510643 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d4fb309d60 con 0x55d4fb3a7680 2024-09-15T22:25:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf157fa640 10 client.16935 handle_command_reply: tid=0 2024-09-15T22:25:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf3628f740 1 client.16935 shutdown 2024-09-15T22:25:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf3628f740 1 -- 172.21.15.45:0/3918510643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb398a30 msgr2=0x55d4fb3a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf3628f740 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb398a30 0x55d4fb3a1150 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fbf2809c1e0 tx=0x7fbf28018400 comp rx=0 tx=0).stop 2024-09-15T22:25:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf3628f740 1 -- 172.21.15.45:0/3918510643 shutdown_connections 2024-09-15T22:25:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf3628f740 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x55d4fb3a7680 0x55d4fb4247d0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.467 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:25:25.467 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:25:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:25:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: "fd69c2dd-c001-452f-97dc-9ea31c4d6f24": { 2024-09-15T22:25:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:25:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "fd69c2dd-c001-452f-97dc-9ea31c4d6f24", 2024-09-15T22:25:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:25:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:25:25.468 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:25:25.468 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf3628f740 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x55d4fb39cdc0 0x55d4fb3a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf3628f740 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55d4fb39c4a0 0x55d4fb3a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf3628f740 1 --2- 172.21.15.45:0/3918510643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4fb398a30 0x55d4fb3a1150 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf157fa640 0 client.16935 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf3628f740 1 -- 172.21.15.45:0/3918510643 >> 172.21.15.45:0/3918510643 conn(0x55d4fb3a4840 msgr2=0x55d4fb39f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf3628f740 1 -- 172.21.15.45:0/3918510643 shutdown_connections 2024-09-15T22:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.447+0000 7fbf3628f740 1 -- 172.21.15.45:0/3918510643 wait complete. 2024-09-15T22:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.448+0000 7fbf3628f740 20 client.16935 trim_cache size 0 max 16384 2024-09-15T22:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.448+0000 7fbf33eb6640 1 -- 172.21.15.45:0/220595993 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbf180a33b0 msgr2=0x7fbf180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.448+0000 7fbf33eb6640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbf180a33b0 0x7fbf180a5870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbf24007ed0 tx=0x7fbf240075c0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.448+0000 7fbf33eb6640 1 -- 172.21.15.45:0/220595993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c074620 msgr2=0x7fbf2c19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.448+0000 7fbf33eb6640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c074620 0x7fbf2c19a700 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c920 tx=0x7fbf2800cde0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.448+0000 7fbf33eb6640 1 -- 172.21.15.45:0/220595993 shutdown_connections 2024-09-15T22:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.448+0000 7fbf33eb6640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbf180a33b0 0x7fbf180a5870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.448+0000 7fbf33eb6640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf2c10e3c0 0x7fbf2c19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.448+0000 7fbf33eb6640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbf2c074f40 0x7fbf2c19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.448+0000 7fbf33eb6640 1 --2- 172.21.15.45:0/220595993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf2c074620 0x7fbf2c19a700 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.448+0000 7fbf33eb6640 1 -- 172.21.15.45:0/220595993 >> 172.21.15.45:0/220595993 conn(0x7fbf2c0fd8c0 msgr2=0x7fbf2c0fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.449+0000 7fbf33eb6640 1 -- 172.21.15.45:0/220595993 shutdown_connections 2024-09-15T22:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:25.449+0000 7fbf33eb6640 1 -- 172.21.15.45:0/220595993 wait complete. 2024-09-15T22:25:26.220 INFO:tasks.cephfs.filesystem:scrub status for tag:fd69c2dd-c001-452f-97dc-9ea31c4d6f24 - {'path': '/', 'tag': 'fd69c2dd-c001-452f-97dc-9ea31c4d6f24', 'options': 'recursive,force'} 2024-09-15T22:25:27.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:26 smithi165 ceph-mon[35551]: pgmap v285: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-09-15T22:25:27.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:26 smithi100 ceph-mon[35319]: pgmap v285: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-09-15T22:25:27.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:26 smithi045 ceph-mon[31180]: pgmap v285: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-09-15T22:25:28.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:27 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:25:28.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:27 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:25:28.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:27 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:25:29.145 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:28 smithi100 ceph-mon[35319]: pgmap v286: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:29.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:28 smithi165 ceph-mon[35551]: pgmap v286: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:29.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:28 smithi045 ceph-mon[31180]: pgmap v286: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:31.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:30 smithi165 ceph-mon[35551]: pgmap v287: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:25:31.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:30 smithi100 ceph-mon[35319]: pgmap v287: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:25:31.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:30 smithi045 ceph-mon[31180]: pgmap v287: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:25:33.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:32 smithi165 ceph-mon[35551]: pgmap v288: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:25:33.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:32 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:33.243 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:32 smithi100 ceph-mon[35319]: pgmap v288: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:25:33.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:32 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:33.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:32 smithi045 ceph-mon[31180]: pgmap v288: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:25:33.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:32 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:25:34.214 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:33 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:34.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:33 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:34.215 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:33 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:25:34.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:33 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:34.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:33 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:34.244 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:33 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:25:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:33 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:25:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:33 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:25:34.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:33 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:25:35.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:35 smithi165 ceph-mon[35551]: pgmap v289: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:25:35.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:35 smithi100 ceph-mon[35319]: pgmap v289: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:25:35.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:35 smithi045 ceph-mon[31180]: pgmap v289: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:25:37.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:37 smithi100 ceph-mon[35319]: pgmap v290: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:25:37.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:37 smithi045 ceph-mon[31180]: pgmap v290: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:25:37.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:37 smithi165 ceph-mon[35551]: pgmap v290: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:25:39.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:39 smithi100 ceph-mon[35319]: pgmap v291: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:25:39.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:39 smithi045 ceph-mon[31180]: pgmap v291: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:25:39.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:39 smithi165 ceph-mon[35551]: pgmap v291: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:25:41.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:41 smithi100 ceph-mon[35319]: pgmap v292: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:25:41.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:41 smithi045 ceph-mon[31180]: pgmap v292: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:25:41.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:41 smithi165 ceph-mon[35551]: pgmap v292: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T22:25:43.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:43 smithi100 ceph-mon[35319]: pgmap v293: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:43.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:43 smithi045 ceph-mon[31180]: pgmap v293: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:43.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:43 smithi165 ceph-mon[35551]: pgmap v293: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:45.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:45 smithi100 ceph-mon[35319]: pgmap v294: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:25:45.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:45 smithi045 ceph-mon[31180]: pgmap v294: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:25:45.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:45 smithi165 ceph-mon[35551]: pgmap v294: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:25:47.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:47 smithi100 ceph-mon[35319]: pgmap v295: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:47.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:47 smithi045 ceph-mon[31180]: pgmap v295: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:47.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:47 smithi165 ceph-mon[35551]: pgmap v295: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:49.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:49 smithi100 ceph-mon[35319]: pgmap v296: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:49.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:49 smithi045 ceph-mon[31180]: pgmap v296: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:49.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:49 smithi165 ceph-mon[35551]: pgmap v296: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:51 smithi100 ceph-mon[35319]: pgmap v297: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:25:51.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:51 smithi045 ceph-mon[31180]: pgmap v297: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:25:51.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:51 smithi165 ceph-mon[35551]: pgmap v297: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:25:53.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:53 smithi100 ceph-mon[35319]: pgmap v298: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:53.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:53 smithi045 ceph-mon[31180]: pgmap v298: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:53.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:53 smithi165 ceph-mon[35551]: pgmap v298: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:55.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:55 smithi100 ceph-mon[35319]: pgmap v299: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:25:55.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:55 smithi045 ceph-mon[31180]: pgmap v299: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:25:55.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:55 smithi165 ceph-mon[35551]: pgmap v299: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:25:56.220 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:25:56.491 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:25:57.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.987+0000 7fb8657f2640 1 -- 172.21.15.45:0/26384000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb860102ef0 msgr2=0x7fb86010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:57.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.987+0000 7fb8657f2640 1 --2- 172.21.15.45:0/26384000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb860102ef0 0x7fb86010da40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb858009900 tx=0x7fb85802a480 comp rx=0 tx=0).stop 2024-09-15T22:25:57.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.987+0000 7fb8657f2640 1 -- 172.21.15.45:0/26384000 shutdown_connections 2024-09-15T22:25:57.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.987+0000 7fb8657f2640 1 --2- 172.21.15.45:0/26384000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb860102ef0 0x7fb86010da40 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.987+0000 7fb8657f2640 1 --2- 172.21.15.45:0/26384000 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb860102570 0x7fb8601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.987+0000 7fb8657f2640 1 --2- 172.21.15.45:0/26384000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb860100e20 0x7fb860101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.987+0000 7fb8657f2640 1 -- 172.21.15.45:0/26384000 >> 172.21.15.45:0/26384000 conn(0x7fb8600fc7d0 msgr2=0x7fb8600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:57.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.987+0000 7fb8657f2640 1 -- 172.21.15.45:0/26384000 shutdown_connections 2024-09-15T22:25:57.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.987+0000 7fb8657f2640 1 -- 172.21.15.45:0/26384000 wait complete. 2024-09-15T22:25:57.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.988+0000 7fb8657f2640 1 Processor -- start 2024-09-15T22:25:57.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.988+0000 7fb8657f2640 1 -- start start 2024-09-15T22:25:57.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.988+0000 7fb8657f2640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb860100e20 0x7fb860197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.988+0000 7fb8657f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb860102570 0x7fb8601979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.988+0000 7fb8657f2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb860102ef0 0x7fb86019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.988+0000 7fb8657f2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601110a0 con 0x7fb860102570 2024-09-15T22:25:57.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.988+0000 7fb8657f2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb860110f20 con 0x7fb860102ef0 2024-09-15T22:25:57.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.988+0000 7fb8657f2640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb860111220 con 0x7fb860100e20 2024-09-15T22:25:57.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.988+0000 7fb85e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb860102570 0x7fb8601979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.988+0000 7fb85e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb860102570 0x7fb8601979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36574/0 (socket says 172.21.15.45:36574) 2024-09-15T22:25:57.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.988+0000 7fb85e7fc640 1 -- 172.21.15.45:0/274977739 learned_addr learned my addr 172.21.15.45:0/274977739 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:57.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb85effd640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb860100e20 0x7fb860197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb85f7fe640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb860102ef0 0x7fb86019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb85e7fc640 1 -- 172.21.15.45:0/274977739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb860100e20 msgr2=0x7fb860197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:57.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb85e7fc640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb860100e20 0x7fb860197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb85e7fc640 1 -- 172.21.15.45:0/274977739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb860102ef0 msgr2=0x7fb86019bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb85e7fc640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb860102ef0 0x7fb86019bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb85e7fc640 1 -- 172.21.15.45:0/274977739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86019c430 con 0x7fb860102570 2024-09-15T22:25:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb85f7fe640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb860102ef0 0x7fb86019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:25:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb85e7fc640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb860102570 0x7fb8601979c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb85400d770 tx=0x7fb85400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb847fff640 1 -- 172.21.15.45:0/274977739 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854017070 con 0x7fb860102570 2024-09-15T22:25:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb847fff640 1 -- 172.21.15.45:0/274977739 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb854005520 con 0x7fb860102570 2024-09-15T22:25:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb8657f2640 1 -- 172.21.15.45:0/274977739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86019c720 con 0x7fb860102570 2024-09-15T22:25:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb847fff640 1 -- 172.21.15.45:0/274977739 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854010460 con 0x7fb860102570 2024-09-15T22:25:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.989+0000 7fb8657f2640 1 -- 172.21.15.45:0/274977739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8601a4000 con 0x7fb860102570 2024-09-15T22:25:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.991+0000 7fb847fff640 1 -- 172.21.15.45:0/274977739 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb854004ea0 con 0x7fb860102570 2024-09-15T22:25:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb867bcb740 1 Processor -- start 2024-09-15T22:25:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb867bcb740 1 -- start start 2024-09-15T22:25:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb867bcb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92309d00 0x555f92308590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb867bcb740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 0x555f92308f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb847fff640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb8480a33b0 0x7fb8480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb867bcb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92315740 0x555f92317b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb867bcb740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555f9226c2e0 con 0x555f92308ad0 2024-09-15T22:25:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb867bcb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555f92213ce0 con 0x555f92315740 2024-09-15T22:25:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb867bcb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555f922682a0 con 0x555f92309d00 2024-09-15T22:25:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb85e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 0x555f92308f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb85effd640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb8480a33b0 0x7fb8480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb85e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 0x555f92308f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36576/0 (socket says 172.21.15.45:36576) 2024-09-15T22:25:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb85e7fc640 1 -- 172.21.15.45:0/1476194489 learned_addr learned my addr 172.21.15.45:0/1476194489 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb85f7fe640 1 --2- 172.21.15.45:0/1476194489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92309d00 0x555f92308590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb847fff640 1 -- 172.21.15.45:0/274977739 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fb8540cfd50 con 0x7fb860102570 2024-09-15T22:25:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.992+0000 7fb85f7fe640 1 --2- 172.21.15.45:0/1476194489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92315740 0x555f92317b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.993+0000 7fb85f7fe640 1 -- 172.21.15.45:0/1476194489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92315740 msgr2=0x555f92317b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.993+0000 7fb85f7fe640 1 --2- 172.21.15.45:0/1476194489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92315740 0x555f92317b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.993+0000 7fb85f7fe640 1 -- 172.21.15.45:0/1476194489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 msgr2=0x555f92308f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.993+0000 7fb85f7fe640 1 --2- 172.21.15.45:0/1476194489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 0x555f92308f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.993+0000 7fb85f7fe640 1 -- 172.21.15.45:0/1476194489 --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f921f8440 con 0x555f92309d00 2024-09-15T22:25:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.993+0000 7fb85e7fc640 1 --2- 172.21.15.45:0/1476194489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 0x555f92308f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:25:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.993+0000 7fb85effd640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb8480a33b0 0x7fb8480a5870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb850005fd0 tx=0x7fb850009870 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.993+0000 7fb85f7fe640 1 --2- 172.21.15.45:0/1476194489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92309d00 0x555f92308590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb858009900 tx=0x7fb858005bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23dc281f062c1e0b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.993+0000 7fb8457fa640 1 -- 172.21.15.45:0/1476194489 <== mon.1 v2:172.21.15.165:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858035040 con 0x555f92309d00 2024-09-15T22:25:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.993+0000 7fb8457fa640 1 -- 172.21.15.45:0/1476194489 <== mon.1 v2:172.21.15.165:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb858043020 con 0x555f92309d00 2024-09-15T22:25:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.993+0000 7fb8457fa640 1 -- 172.21.15.45:0/1476194489 <== mon.1 v2:172.21.15.165:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858003a10 con 0x555f92309d00 2024-09-15T22:25:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 -- 172.21.15.45:0/1476194489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92309d00 msgr2=0x555f92308590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 --2- 172.21.15.45:0/1476194489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92309d00 0x555f92308590 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb858009900 tx=0x7fb858005bb0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 -- 172.21.15.45:0/1476194489 shutdown_connections 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 --2- 172.21.15.45:0/1476194489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92315740 0x555f92317b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 --2- 172.21.15.45:0/1476194489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 0x555f92308f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 --2- 172.21.15.45:0/1476194489 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92309d00 0x555f92308590 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 -- 172.21.15.45:0/1476194489 >> 172.21.15.45:0/1476194489 conn(0x555f92304c40 msgr2=0x555f92305020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 -- 172.21.15.45:0/1476194489 shutdown_connections 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 -- 172.21.15.45:0/1476194489 wait complete. 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 -- start start 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 Processor -- start 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92308ad0 0x555f923150b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92309d00 0x555f923123b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.994+0000 7fb867bcb740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92315740 0x555f923129c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb867bcb740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555f923185f0 con 0x555f92315740 2024-09-15T22:25:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb867bcb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555f92227050 con 0x555f92308ad0 2024-09-15T22:25:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb867bcb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555f92318770 con 0x555f92309d00 2024-09-15T22:25:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb85f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92315740 0x555f923129c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb867bcb740 10 client.0 _ll_register_callbacks cb 0x555f92267160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb85f7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92315740 0x555f923129c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36590/0 (socket says 172.21.15.45:36590) 2024-09-15T22:25:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb85f7fe640 1 -- 172.21.15.45:0/1562878720 learned_addr learned my addr 172.21.15.45:0/1562878720 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb85e7fc640 1 --2- 172.21.15.45:0/1562878720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92309d00 0x555f923123b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb85effd640 1 --2- 172.21.15.45:0/1562878720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92308ad0 0x555f923150b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb85f7fe640 1 -- 172.21.15.45:0/1562878720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92309d00 msgr2=0x555f923123b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb85f7fe640 1 --2- 172.21.15.45:0/1562878720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92309d00 0x555f923123b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb85f7fe640 1 -- 172.21.15.45:0/1562878720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92308ad0 msgr2=0x555f923150b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb85f7fe640 1 --2- 172.21.15.45:0/1562878720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92308ad0 0x555f923150b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb85f7fe640 1 -- 172.21.15.45:0/1562878720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f91fdd3c0 con 0x555f92315740 2024-09-15T22:25:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb85f7fe640 1 --2- 172.21.15.45:0/1562878720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92315740 0x555f923129c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb858005b80 tx=0x7fb85803d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c4ad6079944177 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb842ff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:25:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb842ff5640 1 -- 172.21.15.45:0/1562878720 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85804e020 con 0x555f92315740 2024-09-15T22:25:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb842ff5640 1 -- 172.21.15.45:0/1562878720 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fb85803db50 con 0x555f92315740 2024-09-15T22:25:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.995+0000 7fb867bcb740 1 -- 172.21.15.45:0/1562878720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb858043020 con 0x555f92315740 2024-09-15T22:25:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.996+0000 7fb842ff5640 1 -- 172.21.15.45:0/1562878720 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb858059050 con 0x555f92315740 2024-09-15T22:25:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.996+0000 7fb867bcb740 10 client.16947 fetch_fsmap learned FSMap version 21 2024-09-15T22:25:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.996+0000 7fb867bcb740 1 -- 172.21.15.45:0/1562878720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555f92324040 con 0x555f92315740 2024-09-15T22:25:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.996+0000 7fb842ff5640 1 -- 172.21.15.45:0/1562878720 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb858043020 con 0x555f92315740 2024-09-15T22:25:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.996+0000 7fb842ff5640 1 -- 172.21.15.45:0/1562878720 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb85803a050 con 0x555f92315740 2024-09-15T22:25:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.996+0000 7fb867bcb740 10 client.16947 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:25:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.996+0000 7fb867bcb740 10 client.16947 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:25:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.996+0000 7fb867bcb740 20 client.16947 populate_metadata read hostname 'smithi045' 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.996+0000 7fb867bcb740 1 --2- 172.21.15.45:0/1562878720 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555f92325390 0x555f92327780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.996+0000 7fb867bcb740 4 client.16947 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.996+0000 7fb867bcb740 1 -- 172.21.15.45:0/1562878720 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f92279850 con 0x555f92325390 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.996+0000 7fb85effd640 1 --2- 172.21.15.45:0/1562878720 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555f92325390 0x555f92327780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.997+0000 7fb85effd640 1 --2- 172.21.15.45:0/1562878720 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555f92325390 0x555f92327780 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9bbcdac0a8be78c server_cookie=5bab551eac16dc97 in_seq=0 out_seq=0 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.997+0000 7fb842ff5640 10 client.16947 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.997+0000 7fb842ff5640 1 -- 172.21.15.45:0/1562878720 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555f92279850 con 0x555f92325390 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.997+0000 7fb842ff5640 10 client.16947 handle_command_reply: tid=0 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.998+0000 7fb867bcb740 1 client.16947 shutdown 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.998+0000 7fb867bcb740 1 -- 172.21.15.45:0/1562878720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92315740 msgr2=0x555f923129c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.998+0000 7fb867bcb740 1 --2- 172.21.15.45:0/1562878720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92315740 0x555f923129c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb858005b80 tx=0x7fb85803d720 comp rx=0 tx=0).stop 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.998+0000 7fb867bcb740 1 -- 172.21.15.45:0/1562878720 shutdown_connections 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.998+0000 7fb867bcb740 1 --2- 172.21.15.45:0/1562878720 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555f92325390 0x555f92327780 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.998+0000 7fb867bcb740 1 --2- 172.21.15.45:0/1562878720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92315740 0x555f923129c0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.998+0000 7fb867bcb740 1 --2- 172.21.15.45:0/1562878720 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92309d00 0x555f923123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.998+0000 7fb842ff5640 0 client.16947 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:57.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.998+0000 7fb867bcb740 1 --2- 172.21.15.45:0/1562878720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92308ad0 0x555f923150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.998+0000 7fb867bcb740 1 -- 172.21.15.45:0/1562878720 >> 172.21.15.45:0/1562878720 conn(0x555f92304c40 msgr2=0x555f9230a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:57.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.998+0000 7fb867bcb740 1 -- 172.21.15.45:0/1562878720 shutdown_connections 2024-09-15T22:25:57.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.998+0000 7fb867bcb740 1 -- 172.21.15.45:0/1562878720 wait complete. 2024-09-15T22:25:57.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:56.998+0000 7fb867bcb740 20 client.16947 trim_cache size 0 max 16384 2024-09-15T22:25:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.015+0000 7fb867bcb740 1 Processor -- start 2024-09-15T22:25:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.015+0000 7fb867bcb740 1 -- start start 2024-09-15T22:25:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.015+0000 7fb867bcb740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 0x555f9230ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.015+0000 7fb867bcb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92309d00 0x555f92321890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.015+0000 7fb867bcb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92315740 0x555f92314320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.015+0000 7fb867bcb740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601aae90 con 0x555f92308ad0 2024-09-15T22:25:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.015+0000 7fb867bcb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601ad710 con 0x555f92309d00 2024-09-15T22:25:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.015+0000 7fb867bcb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601ab500 con 0x555f92315740 2024-09-15T22:25:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb85effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 0x555f9230ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb85effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 0x555f9230ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36592/0 (socket says 172.21.15.45:36592) 2024-09-15T22:25:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb85effd640 1 -- 172.21.15.45:0/4197239478 learned_addr learned my addr 172.21.15.45:0/4197239478 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb85f7fe640 1 --2- 172.21.15.45:0/4197239478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92315740 0x555f92314320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb85e7fc640 1 --2- 172.21.15.45:0/4197239478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92309d00 0x555f92321890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb85effd640 1 -- 172.21.15.45:0/4197239478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92315740 msgr2=0x555f92314320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb85effd640 1 --2- 172.21.15.45:0/4197239478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92315740 0x555f92314320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb85effd640 1 -- 172.21.15.45:0/4197239478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92309d00 msgr2=0x555f92321890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb85effd640 1 --2- 172.21.15.45:0/4197239478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92309d00 0x555f92321890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb85effd640 1 -- 172.21.15.45:0/4197239478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f92315420 con 0x555f92308ad0 2024-09-15T22:25:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb85e7fc640 1 --2- 172.21.15.45:0/4197239478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92309d00 0x555f92321890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:25:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb85effd640 1 --2- 172.21.15.45:0/4197239478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 0x555f9230ff20 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb850012620 tx=0x7fb850016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b42a3597b151b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb844ff9640 1 -- 172.21.15.45:0/4197239478 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850012e30 con 0x555f92308ad0 2024-09-15T22:25:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb844ff9640 1 -- 172.21.15.45:0/4197239478 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb850020d80 con 0x555f92308ad0 2024-09-15T22:25:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.016+0000 7fb844ff9640 1 -- 172.21.15.45:0/4197239478 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850027250 con 0x555f92308ad0 2024-09-15T22:25:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.017+0000 7fb867bcb740 1 -- 172.21.15.45:0/4197239478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 msgr2=0x555f9230ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.017+0000 7fb867bcb740 1 --2- 172.21.15.45:0/4197239478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 0x555f9230ff20 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb850012620 tx=0x7fb850016000 comp rx=0 tx=0).stop 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.017+0000 7fb867bcb740 1 -- 172.21.15.45:0/4197239478 shutdown_connections 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.017+0000 7fb867bcb740 1 --2- 172.21.15.45:0/4197239478 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92315740 0x555f92314320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.017+0000 7fb867bcb740 1 --2- 172.21.15.45:0/4197239478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92309d00 0x555f92321890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.017+0000 7fb867bcb740 1 --2- 172.21.15.45:0/4197239478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92308ad0 0x555f9230ff20 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.017+0000 7fb867bcb740 1 -- 172.21.15.45:0/4197239478 >> 172.21.15.45:0/4197239478 conn(0x555f92304c40 msgr2=0x555f92313c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.017+0000 7fb867bcb740 1 -- 172.21.15.45:0/4197239478 shutdown_connections 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.017+0000 7fb867bcb740 1 -- 172.21.15.45:0/4197239478 wait complete. 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.017+0000 7fb867bcb740 1 -- start start 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.017+0000 7fb867bcb740 1 Processor -- start 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb867bcb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92308ad0 0x555f9232ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb867bcb740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92309d00 0x555f9232cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb867bcb740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92315740 0x555f9232d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb867bcb740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601abbd0 con 0x555f92309d00 2024-09-15T22:25:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb867bcb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601ad040 con 0x555f92308ad0 2024-09-15T22:25:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb867bcb740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601ac2a0 con 0x555f92315740 2024-09-15T22:25:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb867bcb740 10 client.0 _ll_register_callbacks cb 0x7fb85400de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:25:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb85e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92309d00 0x555f9232cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb85e7fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92309d00 0x555f9232cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36598/0 (socket says 172.21.15.45:36598) 2024-09-15T22:25:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb85e7fc640 1 -- 172.21.15.45:0/2178016408 learned_addr learned my addr 172.21.15.45:0/2178016408 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb85effd640 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92308ad0 0x555f9232ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb85f7fe640 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92315740 0x555f9232d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb85e7fc640 1 -- 172.21.15.45:0/2178016408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92315740 msgr2=0x555f9232d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:57.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb85e7fc640 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92315740 0x555f9232d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb85e7fc640 1 -- 172.21.15.45:0/2178016408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92308ad0 msgr2=0x555f9232ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:25:57.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb85e7fc640 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92308ad0 0x555f9232ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb85e7fc640 1 -- 172.21.15.45:0/2178016408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f9238ee00 con 0x555f92309d00 2024-09-15T22:25:57.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb85f7fe640 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92315740 0x555f9232d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:25:57.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb85e7fc640 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92309d00 0x555f9232cfb0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb854098040 tx=0x7fb85409b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600f4a9b979bd4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb842ff5640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.018+0000 7fb842ff5640 1 -- 172.21.15.45:0/2178016408 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854020070 con 0x555f92309d00 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb842ff5640 1 -- 172.21.15.45:0/2178016408 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fb85409a1a0 con 0x555f92309d00 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb867bcb740 1 -- 172.21.15.45:0/2178016408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb850020d80 con 0x555f92309d00 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb842ff5640 1 -- 172.21.15.45:0/2178016408 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb8540cd4d0 con 0x555f92309d00 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb867bcb740 10 client.16953 fetch_fsmap learned FSMap version 21 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb867bcb740 1 -- 172.21.15.45:0/2178016408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555f92390060 con 0x555f92309d00 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb842ff5640 1 -- 172.21.15.45:0/2178016408 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb850020d80 con 0x555f92309d00 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb842ff5640 1 -- 172.21.15.45:0/2178016408 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb854066590 con 0x555f92309d00 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb867bcb740 10 client.16953 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb867bcb740 10 client.16953 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb867bcb740 20 client.16953 populate_metadata read hostname 'smithi045' 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb867bcb740 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555f923907d0 0x555f92392bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:57.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb867bcb740 4 client.16953 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:25:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb867bcb740 1 -- 172.21.15.45:0/2178016408 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555f92273d60 con 0x555f923907d0 2024-09-15T22:25:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.019+0000 7fb85effd640 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555f923907d0 0x555f92392bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb85effd640 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555f923907d0 0x555f92392bf0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c464f25eed37c4c1 server_cookie=91485f8b07d21fbf in_seq=0 out_seq=0 2024-09-15T22:25:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb842ff5640 10 client.16953 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb842ff5640 1 -- 172.21.15.45:0/2178016408 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555f92273d60 con 0x555f923907d0 2024-09-15T22:25:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb842ff5640 10 client.16953 handle_command_reply: tid=0 2024-09-15T22:25:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb867bcb740 1 client.16953 shutdown 2024-09-15T22:25:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb867bcb740 1 -- 172.21.15.45:0/2178016408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92309d00 msgr2=0x555f9232cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb867bcb740 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92309d00 0x555f9232cfb0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fb854098040 tx=0x7fb85409b740 comp rx=0 tx=0).stop 2024-09-15T22:25:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb867bcb740 1 -- 172.21.15.45:0/2178016408 shutdown_connections 2024-09-15T22:25:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb867bcb740 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555f923907d0 0x555f92392bf0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb867bcb740 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555f92315740 0x555f9232d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb867bcb740 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f92309d00 0x555f9232cfb0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb867bcb740 1 --2- 172.21.15.45:0/2178016408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555f92308ad0 0x555f9232ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb867bcb740 1 -- 172.21.15.45:0/2178016408 >> 172.21.15.45:0/2178016408 conn(0x555f92304c40 msgr2=0x555f92314430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb842ff5640 0 client.16953 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:25:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb867bcb740 1 -- 172.21.15.45:0/2178016408 shutdown_connections 2024-09-15T22:25:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb867bcb740 1 -- 172.21.15.45:0/2178016408 wait complete. 2024-09-15T22:25:57.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.020+0000 7fb867bcb740 20 client.16953 trim_cache size 0 max 16384 2024-09-15T22:25:57.035 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:25:57.035 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:25:57.035 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:25:57.036 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:25:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.021+0000 7fb8657f2640 1 -- 172.21.15.45:0/274977739 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb8480a33b0 msgr2=0x7fb8480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.021+0000 7fb8657f2640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb8480a33b0 0x7fb8480a5870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb850005fd0 tx=0x7fb850009870 comp rx=0 tx=0).stop 2024-09-15T22:25:57.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.021+0000 7fb8657f2640 1 -- 172.21.15.45:0/274977739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb860102570 msgr2=0x7fb8601979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.021+0000 7fb8657f2640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb860102570 0x7fb8601979c0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb85400d770 tx=0x7fb85400dc30 comp rx=0 tx=0).stop 2024-09-15T22:25:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.021+0000 7fb8657f2640 1 -- 172.21.15.45:0/274977739 shutdown_connections 2024-09-15T22:25:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.021+0000 7fb8657f2640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb8480a33b0 0x7fb8480a5870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.021+0000 7fb8657f2640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb860102ef0 0x7fb86019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.021+0000 7fb8657f2640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb860102570 0x7fb8601979c0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.021+0000 7fb8657f2640 1 --2- 172.21.15.45:0/274977739 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb860100e20 0x7fb860197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.021+0000 7fb8657f2640 1 -- 172.21.15.45:0/274977739 >> 172.21.15.45:0/274977739 conn(0x7fb8600fc7d0 msgr2=0x7fb860106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.021+0000 7fb8657f2640 1 -- 172.21.15.45:0/274977739 shutdown_connections 2024-09-15T22:25:57.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:57.021+0000 7fb8657f2640 1 -- 172.21.15.45:0/274977739 wait complete. 2024-09-15T22:25:57.517 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:57 smithi165 ceph-mon[35551]: pgmap v300: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:57.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:57 smithi045 ceph-mon[31180]: pgmap v300: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:57.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:57 smithi100 ceph-mon[35319]: pgmap v300: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:57.827 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:25:57.828 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:25:58.092 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:25:58.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.612+0000 7f04bafd5640 1 -- 172.21.15.45:0/2739273570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04b41036c0 msgr2=0x7f04b410bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:58.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.612+0000 7f04bafd5640 1 --2- 172.21.15.45:0/2739273570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04b41036c0 0x7f04b410bbb0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009900 tx=0x7f04a002a480 comp rx=0 tx=0).stop 2024-09-15T22:25:58.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.612+0000 7f04bafd5640 1 -- 172.21.15.45:0/2739273570 shutdown_connections 2024-09-15T22:25:58.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.612+0000 7f04bafd5640 1 --2- 172.21.15.45:0/2739273570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04b410c180 0x7f04b410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:58.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.612+0000 7f04bafd5640 1 --2- 172.21.15.45:0/2739273570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04b41036c0 0x7f04b410bbb0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:58.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.612+0000 7f04bafd5640 1 --2- 172.21.15.45:0/2739273570 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04b4102da0 0x7f04b4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:58.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.612+0000 7f04bafd5640 1 -- 172.21.15.45:0/2739273570 >> 172.21.15.45:0/2739273570 conn(0x7f04b40fc7a0 msgr2=0x7f04b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:58.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.612+0000 7f04bafd5640 1 -- 172.21.15.45:0/2739273570 shutdown_connections 2024-09-15T22:25:58.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.612+0000 7f04bafd5640 1 -- 172.21.15.45:0/2739273570 wait complete. 2024-09-15T22:25:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04bafd5640 1 Processor -- start 2024-09-15T22:25:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04bafd5640 1 -- start start 2024-09-15T22:25:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04bafd5640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04b4102da0 0x7f04b4198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04bafd5640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04b41036c0 0x7f04b4198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04bafd5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04b410c180 0x7f04b419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04bafd5640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f04b4112080 con 0x7f04b410c180 2024-09-15T22:25:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04bafd5640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f04b4111f00 con 0x7f04b41036c0 2024-09-15T22:25:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04bafd5640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f04b4112200 con 0x7f04b4102da0 2024-09-15T22:25:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04b9572640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04b410c180 0x7f04b419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04b9572640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04b410c180 0x7f04b419ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36614/0 (socket says 172.21.15.45:36614) 2024-09-15T22:25:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04b9572640 1 -- 172.21.15.45:0/1946816277 learned_addr learned my addr 172.21.15.45:0/1946816277 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:25:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04b8d71640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04b4102da0 0x7f04b4198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04b9572640 1 -- 172.21.15.45:0/1946816277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04b4102da0 msgr2=0x7f04b4198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04b9572640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04b4102da0 0x7f04b4198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04b9572640 1 -- 172.21.15.45:0/1946816277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04b41036c0 msgr2=0x7f04b4198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04b3fff640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04b41036c0 0x7f04b4198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04b9572640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04b41036c0 0x7f04b4198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04b9572640 1 -- 172.21.15.45:0/1946816277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b419d520 con 0x7f04b410c180 2024-09-15T22:25:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.613+0000 7f04b8d71640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04b4102da0 0x7f04b4198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:25:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.614+0000 7f04b9572640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04b410c180 0x7f04b419ce40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00eaa0 tx=0x7f04ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.614+0000 7f04b1ffb640 1 -- 172.21.15.45:0/1946816277 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac00cdb0 con 0x7f04b410c180 2024-09-15T22:25:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.614+0000 7f04bafd5640 1 -- 172.21.15.45:0/1946816277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b419d810 con 0x7f04b410c180 2024-09-15T22:25:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.614+0000 7f04b1ffb640 1 -- 172.21.15.45:0/1946816277 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f04ac004b20 con 0x7f04b410c180 2024-09-15T22:25:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.614+0000 7f04b1ffb640 1 -- 172.21.15.45:0/1946816277 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac011760 con 0x7f04b410c180 2024-09-15T22:25:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.614+0000 7f04bafd5640 1 -- 172.21.15.45:0/1946816277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b41a50f0 con 0x7f04b410c180 2024-09-15T22:25:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.615+0000 7f04bafd5640 1 -- 172.21.15.45:0/1946816277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b4103180 con 0x7f04b410c180 2024-09-15T22:25:58.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.616+0000 7f04b1ffb640 1 -- 172.21.15.45:0/1946816277 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f04ac004cd0 con 0x7f04b410c180 2024-09-15T22:25:58.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.617+0000 7f04b1ffb640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f04a40a33b0 0x7f04a40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:25:58.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.617+0000 7f04b8d71640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f04a40a33b0 0x7f04a40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:25:58.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.617+0000 7f04b1ffb640 1 -- 172.21.15.45:0/1946816277 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7f04ac0d0430 con 0x7f04b410c180 2024-09-15T22:25:58.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.617+0000 7f04b8d71640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f04a40a33b0 0x7f04a40a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f04a80058c0 tx=0x7f04a8005ec0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:25:58.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.621+0000 7f04b1ffb640 1 -- 172.21.15.45:0/1946816277 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f04ac016030 con 0x7f04b410c180 2024-09-15T22:25:58.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.834+0000 7f04bafd5640 1 -- 172.21.15.45:0/1946816277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04b402d7c0 con 0x7f04b410c180 2024-09-15T22:25:58.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.835+0000 7f04b1ffb640 1 -- 172.21.15.45:0/1946816277 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f04ac09c9c0 con 0x7f04b410c180 2024-09-15T22:25:58.837 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:25:58.837 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:25:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:25:58.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.837+0000 7f04bafd5640 1 -- 172.21.15.45:0/1946816277 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f04a40a33b0 msgr2=0x7f04a40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:58.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.837+0000 7f04bafd5640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f04a40a33b0 0x7f04a40a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f04a80058c0 tx=0x7f04a8005ec0 comp rx=0 tx=0).stop 2024-09-15T22:25:58.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.837+0000 7f04bafd5640 1 -- 172.21.15.45:0/1946816277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04b410c180 msgr2=0x7f04b419ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:25:58.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.837+0000 7f04bafd5640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04b410c180 0x7f04b419ce40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00eaa0 tx=0x7f04ac00ef60 comp rx=0 tx=0).stop 2024-09-15T22:25:58.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.837+0000 7f04bafd5640 1 -- 172.21.15.45:0/1946816277 shutdown_connections 2024-09-15T22:25:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.837+0000 7f04bafd5640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f04a40a33b0 0x7f04a40a5870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.837+0000 7f04bafd5640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04b410c180 0x7f04b419ce40 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.837+0000 7f04bafd5640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04b41036c0 0x7f04b4198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.837+0000 7f04bafd5640 1 --2- 172.21.15.45:0/1946816277 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f04b4102da0 0x7f04b4198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:25:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.837+0000 7f04bafd5640 1 -- 172.21.15.45:0/1946816277 >> 172.21.15.45:0/1946816277 conn(0x7f04b40fc7a0 msgr2=0x7f04b40fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:25:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.837+0000 7f04bafd5640 1 -- 172.21.15.45:0/1946816277 shutdown_connections 2024-09-15T22:25:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:25:58.837+0000 7f04bafd5640 1 -- 172.21.15.45:0/1946816277 wait complete. 2024-09-15T22:25:59.495 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:59 smithi045 ceph-mon[31180]: pgmap v301: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:59.495 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:25:59 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1946816277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:25:59.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:25:59.546 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:59 smithi100 ceph-mon[35319]: pgmap v301: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:59.546 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:25:59 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1946816277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:25:59.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:59 smithi165 ceph-mon[35551]: pgmap v301: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:25:59.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:25:59 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1946816277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:25:59.782 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:26:00.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.272+0000 7f110403f640 1 -- 172.21.15.45:0/1164340908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10fc074590 msgr2=0x7f10fc074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:00.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.272+0000 7f110403f640 1 --2- 172.21.15.45:0/1164340908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10fc074590 0x7f10fc074970 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009900 tx=0x7f10f802a480 comp rx=0 tx=0).stop 2024-09-15T22:26:00.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 -- 172.21.15.45:0/1164340908 shutdown_connections 2024-09-15T22:26:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 --2- 172.21.15.45:0/1164340908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10fc112b90 0x7f10fc114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 --2- 172.21.15.45:0/1164340908 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10fc074eb0 0x7f10fc112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 --2- 172.21.15.45:0/1164340908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10fc074590 0x7f10fc074970 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 -- 172.21.15.45:0/1164340908 >> 172.21.15.45:0/1164340908 conn(0x7f10fc0fd8c0 msgr2=0x7f10fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 -- 172.21.15.45:0/1164340908 shutdown_connections 2024-09-15T22:26:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 -- 172.21.15.45:0/1164340908 wait complete. 2024-09-15T22:26:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 Processor -- start 2024-09-15T22:26:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 -- start start 2024-09-15T22:26:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10fc074590 0x7f10fc1a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10fc074eb0 0x7f10fc1a4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10fc112b90 0x7f10fc19ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc118740 con 0x7f10fc112b90 2024-09-15T22:26:00.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1185c0 con 0x7f10fc074590 2024-09-15T22:26:00.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.273+0000 7f110403f640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1188c0 con 0x7f10fc074eb0 2024-09-15T22:26:00.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f11025dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10fc112b90 0x7f10fc19ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f11025dc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10fc112b90 0x7f10fc19ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36640/0 (socket says 172.21.15.45:36640) 2024-09-15T22:26:00.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f11025dc640 1 -- 172.21.15.45:0/497713748 learned_addr learned my addr 172.21.15.45:0/497713748 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:00.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f1101ddb640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10fc074590 0x7f10fc1a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f11015da640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10fc074eb0 0x7f10fc1a4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f11025dc640 1 -- 172.21.15.45:0/497713748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10fc074eb0 msgr2=0x7f10fc1a4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f11025dc640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10fc074eb0 0x7f10fc1a4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f11025dc640 1 -- 172.21.15.45:0/497713748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10fc074590 msgr2=0x7f10fc1a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f11025dc640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10fc074590 0x7f10fc1a4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f11025dc640 1 -- 172.21.15.45:0/497713748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc19f140 con 0x7f10fc112b90 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f11025dc640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10fc112b90 0x7f10fc19ea10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f10f400cad0 tx=0x7f10f400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f10f2ffd640 1 -- 172.21.15.45:0/497713748 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f400ae20 con 0x7f10fc112b90 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f10f2ffd640 1 -- 172.21.15.45:0/497713748 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f10f4004030 con 0x7f10fc112b90 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.274+0000 7f110403f640 1 -- 172.21.15.45:0/497713748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10fc19f430 con 0x7f10fc112b90 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.275+0000 7f10f2ffd640 1 -- 172.21.15.45:0/497713748 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f400f830 con 0x7f10fc112b90 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.275+0000 7f110403f640 1 -- 172.21.15.45:0/497713748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10fc1ab720 con 0x7f10fc112b90 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.277+0000 7f10f2ffd640 1 -- 172.21.15.45:0/497713748 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f10f40041e0 con 0x7f10fc112b90 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.277+0000 7f1106418740 1 Processor -- start 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.277+0000 7f1106418740 1 -- start start 2024-09-15T22:26:00.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.277+0000 7f1106418740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 0x555d56b99090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.277+0000 7f1106418740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56b995d0 0x555d56b99a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.277+0000 7f1106418740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56ba4370 0x555d56ba6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.277+0000 7f1106418740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555d56aff2f0 con 0x555d56b9ab40 2024-09-15T22:26:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.277+0000 7f1106418740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555d56aa6cf0 con 0x555d56ba4370 2024-09-15T22:26:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.277+0000 7f1106418740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555d56afb2b0 con 0x555d56b995d0 2024-09-15T22:26:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f11015da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 0x555d56b99090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f11015da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 0x555d56b99090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36650/0 (socket says 172.21.15.45:36650) 2024-09-15T22:26:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f11015da640 1 -- 172.21.15.45:0/3606802910 learned_addr learned my addr 172.21.15.45:0/3606802910 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f10f2ffd640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10e80a33b0 0x7f10e80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f11015da640 1 --2- 172.21.15.45:0/3606802910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56ba4370 0x555d56ba6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f1101ddb640 1 --2- 172.21.15.45:0/3606802910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56b995d0 0x555d56b99a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f11025dc640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10e80a33b0 0x7f10e80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f11015da640 1 -- 172.21.15.45:0/3606802910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56b995d0 msgr2=0x555d56b99a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f11015da640 1 --2- 172.21.15.45:0/3606802910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56b995d0 0x555d56b99a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f11015da640 1 -- 172.21.15.45:0/3606802910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56ba4370 msgr2=0x555d56ba6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f11015da640 1 --2- 172.21.15.45:0/3606802910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56ba4370 0x555d56ba6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f11015da640 1 -- 172.21.15.45:0/3606802910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d56a8b3a0 con 0x555d56b9ab40 2024-09-15T22:26:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f10f2ffd640 1 -- 172.21.15.45:0/497713748 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7f10f40d04d0 con 0x7f10fc112b90 2024-09-15T22:26:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f11015da640 1 --2- 172.21.15.45:0/3606802910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 0x555d56b99090 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f10ec006e10 tx=0x7f10ec00b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917b449321bb6c43 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f10e7fff640 1 -- 172.21.15.45:0/3606802910 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec0173f0 con 0x555d56b9ab40 2024-09-15T22:26:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f10e7fff640 1 -- 172.21.15.45:0/3606802910 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f10ec010040 con 0x555d56b9ab40 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f11025dc640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10e80a33b0 0x7f10e80a5870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f10f4098d70 tx=0x7f10f406f1d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.278+0000 7f10e7fff640 1 -- 172.21.15.45:0/3606802910 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec016a00 con 0x555d56b9ab40 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.279+0000 7f1106418740 1 -- 172.21.15.45:0/3606802910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 msgr2=0x555d56b99090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.279+0000 7f1106418740 1 --2- 172.21.15.45:0/3606802910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 0x555d56b99090 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f10ec006e10 tx=0x7f10ec00b400 comp rx=0 tx=0).stop 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.279+0000 7f1106418740 1 -- 172.21.15.45:0/3606802910 shutdown_connections 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.279+0000 7f1106418740 1 --2- 172.21.15.45:0/3606802910 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56ba4370 0x555d56ba6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.279+0000 7f1106418740 1 --2- 172.21.15.45:0/3606802910 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56b995d0 0x555d56b99a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.279+0000 7f1106418740 1 --2- 172.21.15.45:0/3606802910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 0x555d56b99090 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.279+0000 7f1106418740 1 -- 172.21.15.45:0/3606802910 >> 172.21.15.45:0/3606802910 conn(0x555d56b62310 msgr2=0x555d56b95c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.279+0000 7f1106418740 1 -- 172.21.15.45:0/3606802910 shutdown_connections 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.279+0000 7f1106418740 1 -- 172.21.15.45:0/3606802910 wait complete. 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f1106418740 1 -- start start 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f1106418740 1 Processor -- start 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f1106418740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56b995d0 0x555d56ba3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f1106418740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b9ab40 0x555d56ba0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f1106418740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56ba4370 0x555d56ba15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f1106418740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555d56ba7010 con 0x555d56ba4370 2024-09-15T22:26:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f1106418740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x555d56aba060 con 0x555d56b9ab40 2024-09-15T22:26:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f1106418740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x555d56ba7190 con 0x555d56b995d0 2024-09-15T22:26:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f1106418740 10 client.0 _ll_register_callbacks cb 0x555d5680d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f11015da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56ba4370 0x555d56ba15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f11015da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56ba4370 0x555d56ba15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36656/0 (socket says 172.21.15.45:36656) 2024-09-15T22:26:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f11015da640 1 -- 172.21.15.45:0/4270775711 learned_addr learned my addr 172.21.15.45:0/4270775711 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f1101ddb640 1 --2- 172.21.15.45:0/4270775711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b9ab40 0x555d56ba0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.280+0000 7f11015da640 1 --2- 172.21.15.45:0/4270775711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56b995d0 0x555d56ba3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f11015da640 1 -- 172.21.15.45:0/4270775711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56b995d0 msgr2=0x555d56ba3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f11015da640 1 --2- 172.21.15.45:0/4270775711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56b995d0 0x555d56ba3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f11015da640 1 -- 172.21.15.45:0/4270775711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b9ab40 msgr2=0x555d56ba0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f11015da640 1 --2- 172.21.15.45:0/4270775711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b9ab40 0x555d56ba0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f11015da640 1 -- 172.21.15.45:0/4270775711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d568703c0 con 0x555d56ba4370 2024-09-15T22:26:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f11015da640 1 --2- 172.21.15.45:0/4270775711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56ba4370 0x555d56ba15d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f10ec007fd0 tx=0x7f10ec0165e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0affdc061be909 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f10e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:26:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f10e57fa640 1 -- 172.21.15.45:0/4270775711 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec029070 con 0x555d56ba4370 2024-09-15T22:26:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f10e57fa640 1 -- 172.21.15.45:0/4270775711 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7f10ec0175f0 con 0x555d56ba4370 2024-09-15T22:26:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f1106418740 1 -- 172.21.15.45:0/4270775711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10ec010040 con 0x555d56ba4370 2024-09-15T22:26:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f10e57fa640 1 -- 172.21.15.45:0/4270775711 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f10ec017a00 con 0x555d56ba4370 2024-09-15T22:26:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f1106418740 10 client.16971 fetch_fsmap learned FSMap version 21 2024-09-15T22:26:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f1106418740 1 -- 172.21.15.45:0/4270775711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555d56bb2a70 con 0x555d56ba4370 2024-09-15T22:26:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.281+0000 7f10e57fa640 1 -- 172.21.15.45:0/4270775711 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f10ec010040 con 0x555d56ba4370 2024-09-15T22:26:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.282+0000 7f10e57fa640 1 -- 172.21.15.45:0/4270775711 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f10ec006380 con 0x555d56ba4370 2024-09-15T22:26:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.282+0000 7f1106418740 10 client.16971 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:26:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.282+0000 7f1106418740 10 client.16971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:26:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.282+0000 7f1106418740 20 client.16971 populate_metadata read hostname 'smithi045' 2024-09-15T22:26:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.282+0000 7f1106418740 1 --2- 172.21.15.45:0/4270775711 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555d56bb3ed0 0x555d56bb62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.282+0000 7f1106418740 4 client.16971 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:26:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.282+0000 7f1106418740 1 -- 172.21.15.45:0/4270775711 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d56b0c860 con 0x555d56bb3ed0 2024-09-15T22:26:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.282+0000 7f1101ddb640 1 --2- 172.21.15.45:0/4270775711 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555d56bb3ed0 0x555d56bb62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.282+0000 7f1101ddb640 1 --2- 172.21.15.45:0/4270775711 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555d56bb3ed0 0x555d56bb62c0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc91261e887a130d server_cookie=3330ff1cdeb64d31 in_seq=0 out_seq=0 2024-09-15T22:26:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.282+0000 7f10e57fa640 10 client.16971 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f10e57fa640 1 -- 172.21.15.45:0/4270775711 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d56b0c860 con 0x555d56bb3ed0 2024-09-15T22:26:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f10e57fa640 10 client.16971 handle_command_reply: tid=0 2024-09-15T22:26:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f1106418740 1 client.16971 shutdown 2024-09-15T22:26:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f1106418740 1 -- 172.21.15.45:0/4270775711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56ba4370 msgr2=0x555d56ba15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f1106418740 1 --2- 172.21.15.45:0/4270775711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56ba4370 0x555d56ba15d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f10ec007fd0 tx=0x7f10ec0165e0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f1106418740 1 -- 172.21.15.45:0/4270775711 shutdown_connections 2024-09-15T22:26:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f1106418740 1 --2- 172.21.15.45:0/4270775711 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555d56bb3ed0 0x555d56bb62c0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f1106418740 1 --2- 172.21.15.45:0/4270775711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56ba4370 0x555d56ba15d0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f1106418740 1 --2- 172.21.15.45:0/4270775711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b9ab40 0x555d56ba0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f1106418740 1 --2- 172.21.15.45:0/4270775711 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56b995d0 0x555d56ba3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f10e57fa640 0 client.16971 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f1106418740 1 -- 172.21.15.45:0/4270775711 >> 172.21.15.45:0/4270775711 conn(0x555d56b62310 msgr2=0x555d56b9b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:00.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f1106418740 1 -- 172.21.15.45:0/4270775711 shutdown_connections 2024-09-15T22:26:00.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f1106418740 1 -- 172.21.15.45:0/4270775711 wait complete. 2024-09-15T22:26:00.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.283+0000 7f1106418740 20 client.16971 trim_cache size 0 max 16384 2024-09-15T22:26:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.296+0000 7f1106418740 1 Processor -- start 2024-09-15T22:26:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.296+0000 7f1106418740 1 -- start start 2024-09-15T22:26:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f1106418740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b995d0 0x555d56bb02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f1106418740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b9ab40 0x555d56b9c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f1106418740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56ba4370 0x555d56b9c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f1106418740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1b39d0 con 0x555d56b995d0 2024-09-15T22:26:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f1106418740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1b6250 con 0x555d56b9ab40 2024-09-15T22:26:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f1106418740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1b4040 con 0x555d56ba4370 2024-09-15T22:26:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f11015da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b995d0 0x555d56bb02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f11015da640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b995d0 0x555d56bb02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36670/0 (socket says 172.21.15.45:36670) 2024-09-15T22:26:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f11015da640 1 -- 172.21.15.45:0/1859852151 learned_addr learned my addr 172.21.15.45:0/1859852151 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f1101ddb640 1 --2- 172.21.15.45:0/1859852151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b9ab40 0x555d56b9c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f11015da640 1 -- 172.21.15.45:0/1859852151 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56ba4370 msgr2=0x555d56b9c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f11015da640 1 --2- 172.21.15.45:0/1859852151 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56ba4370 0x555d56b9c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f11015da640 1 -- 172.21.15.45:0/1859852151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b9ab40 msgr2=0x555d56b9c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f11015da640 1 --2- 172.21.15.45:0/1859852151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b9ab40 0x555d56b9c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f11015da640 1 -- 172.21.15.45:0/1859852151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d56b96960 con 0x555d56b995d0 2024-09-15T22:26:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f1101ddb640 1 --2- 172.21.15.45:0/1859852151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b9ab40 0x555d56b9c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f11015da640 1 --2- 172.21.15.45:0/1859852151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b995d0 0x555d56bb02b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f10ec004700 tx=0x7f10ec016650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ade791fdc4b22ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f10e77fe640 1 -- 172.21.15.45:0/1859852151 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec029040 con 0x555d56b995d0 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f10e77fe640 1 -- 172.21.15.45:0/1859852151 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f10ec0069c0 con 0x555d56b995d0 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.297+0000 7f10e77fe640 1 -- 172.21.15.45:0/1859852151 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ec017e00 con 0x555d56b995d0 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.298+0000 7f1106418740 1 -- 172.21.15.45:0/1859852151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b995d0 msgr2=0x555d56bb02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.298+0000 7f1106418740 1 --2- 172.21.15.45:0/1859852151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b995d0 0x555d56bb02b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f10ec004700 tx=0x7f10ec016650 comp rx=0 tx=0).stop 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.298+0000 7f1106418740 1 -- 172.21.15.45:0/1859852151 shutdown_connections 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.298+0000 7f1106418740 1 --2- 172.21.15.45:0/1859852151 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56ba4370 0x555d56b9c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.298+0000 7f1106418740 1 --2- 172.21.15.45:0/1859852151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b9ab40 0x555d56b9c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.298+0000 7f1106418740 1 --2- 172.21.15.45:0/1859852151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b995d0 0x555d56bb02b0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.298+0000 7f1106418740 1 -- 172.21.15.45:0/1859852151 >> 172.21.15.45:0/1859852151 conn(0x555d56b62310 msgr2=0x555d56ba3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.298+0000 7f1106418740 1 -- 172.21.15.45:0/1859852151 shutdown_connections 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.298+0000 7f1106418740 1 -- 172.21.15.45:0/1859852151 wait complete. 2024-09-15T22:26:00.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.298+0000 7f1106418740 1 -- start start 2024-09-15T22:26:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1106418740 1 Processor -- start 2024-09-15T22:26:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1106418740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b995d0 0x555d56bac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1106418740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 0x555d56ba7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1106418740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56ba4370 0x555d56ba8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1106418740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1b4710 con 0x555d56b9ab40 2024-09-15T22:26:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1106418740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1b5b80 con 0x555d56b995d0 2024-09-15T22:26:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1106418740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc1b4de0 con 0x555d56ba4370 2024-09-15T22:26:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1106418740 10 client.0 _ll_register_callbacks cb 0x7f10ec00bd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1101ddb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 0x555d56ba7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1101ddb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 0x555d56ba7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36676/0 (socket says 172.21.15.45:36676) 2024-09-15T22:26:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1101ddb640 1 -- 172.21.15.45:0/28892212 learned_addr learned my addr 172.21.15.45:0/28892212 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f11015da640 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56ba4370 0x555d56ba8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f11015da640 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b995d0 0x555d56bac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1101ddb640 1 -- 172.21.15.45:0/28892212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56ba4370 msgr2=0x555d56ba8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1101ddb640 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56ba4370 0x555d56ba8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1101ddb640 1 -- 172.21.15.45:0/28892212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b995d0 msgr2=0x555d56bac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1101ddb640 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b995d0 0x555d56bac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f1101ddb640 1 -- 172.21.15.45:0/28892212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d56ba8670 con 0x555d56b9ab40 2024-09-15T22:26:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.299+0000 7f11015da640 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b995d0 0x555d56bac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:26:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f1101ddb640 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 0x555d56ba7bf0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009230 tx=0x7f10f80044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a89983314c0d14 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f10e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:26:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f10e57fa640 1 -- 172.21.15.45:0/28892212 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8049030 con 0x555d56b9ab40 2024-09-15T22:26:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f10e57fa640 1 -- 172.21.15.45:0/28892212 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7f10f8031850 con 0x555d56b9ab40 2024-09-15T22:26:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f1106418740 1 -- 172.21.15.45:0/28892212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555d56b06d70 con 0x555d56b9ab40 2024-09-15T22:26:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f10e57fa640 1 -- 172.21.15.45:0/28892212 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f10f8056050 con 0x555d56b9ab40 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f1106418740 10 client.16977 fetch_fsmap learned FSMap version 21 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f1106418740 1 -- 172.21.15.45:0/28892212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555d56c1e6a0 con 0x555d56b9ab40 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f10e57fa640 1 -- 172.21.15.45:0/28892212 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x555d56b06d70 con 0x555d56b9ab40 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f10e57fa640 1 -- 172.21.15.45:0/28892212 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f10f80452c0 con 0x555d56b9ab40 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f1106418740 10 client.16977 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f1106418740 10 client.16977 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f1106418740 20 client.16977 populate_metadata read hostname 'smithi045' 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.300+0000 7f1106418740 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555d56c1eea0 0x555d56c212c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.301+0000 7f1106418740 4 client.16977 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.301+0000 7f1106418740 1 -- 172.21.15.45:0/28892212 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555d56a83170 con 0x555d56c1eea0 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.301+0000 7f11015da640 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555d56c1eea0 0x555d56c212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.301+0000 7f11015da640 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555d56c1eea0 0x555d56c212c0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=309e8d52b026c684 server_cookie=10d86a4f9cf5bc69 in_seq=0 out_seq=0 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.301+0000 7f10e57fa640 10 client.16977 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.301+0000 7f10e57fa640 1 -- 172.21.15.45:0/28892212 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555d56a83170 con 0x555d56c1eea0 2024-09-15T22:26:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.301+0000 7f10e57fa640 10 client.16977 handle_command_reply: tid=0 2024-09-15T22:26:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.301+0000 7f1106418740 1 client.16977 shutdown 2024-09-15T22:26:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.301+0000 7f1106418740 1 -- 172.21.15.45:0/28892212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 msgr2=0x555d56ba7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.301+0000 7f1106418740 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 0x555d56ba7bf0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009230 tx=0x7f10f80044a0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f1106418740 1 -- 172.21.15.45:0/28892212 shutdown_connections 2024-09-15T22:26:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f1106418740 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x555d56c1eea0 0x555d56c212c0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f1106418740 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x555d56ba4370 0x555d56ba8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f1106418740 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555d56b9ab40 0x555d56ba7bf0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f1106418740 1 --2- 172.21.15.45:0/28892212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x555d56b995d0 0x555d56bac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f1106418740 1 -- 172.21.15.45:0/28892212 >> 172.21.15.45:0/28892212 conn(0x555d56b62310 msgr2=0x555d56b9f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f10e57fa640 0 client.16977 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f1106418740 1 -- 172.21.15.45:0/28892212 shutdown_connections 2024-09-15T22:26:00.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f1106418740 1 -- 172.21.15.45:0/28892212 wait complete. 2024-09-15T22:26:00.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f1106418740 20 client.16977 trim_cache size 0 max 16384 2024-09-15T22:26:00.313 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:26:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f110403f640 1 -- 172.21.15.45:0/497713748 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10e80a33b0 msgr2=0x7f10e80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f110403f640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10e80a33b0 0x7f10e80a5870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f10f4098d70 tx=0x7f10f406f1d0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f110403f640 1 -- 172.21.15.45:0/497713748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10fc112b90 msgr2=0x7f10fc19ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f110403f640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10fc112b90 0x7f10fc19ea10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f10f400cad0 tx=0x7f10f400cf90 comp rx=0 tx=0).stop 2024-09-15T22:26:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f110403f640 1 -- 172.21.15.45:0/497713748 shutdown_connections 2024-09-15T22:26:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f110403f640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f10e80a33b0 0x7f10e80a5870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f110403f640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10fc112b90 0x7f10fc19ea10 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f110403f640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f10fc074eb0 0x7f10fc1a4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f110403f640 1 --2- 172.21.15.45:0/497713748 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f10fc074590 0x7f10fc1a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:00.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f110403f640 1 -- 172.21.15.45:0/497713748 >> 172.21.15.45:0/497713748 conn(0x7f10fc0fd8c0 msgr2=0x7f10fc0fefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:00.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.302+0000 7f110403f640 1 -- 172.21.15.45:0/497713748 shutdown_connections 2024-09-15T22:26:00.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:00.303+0000 7f110403f640 1 -- 172.21.15.45:0/497713748 wait complete. 2024-09-15T22:26:01.300 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:01 smithi045 ceph-mon[31180]: pgmap v302: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:26:01.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:01 smithi165 ceph-mon[35551]: pgmap v302: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:26:01.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:01 smithi100 ceph-mon[35319]: pgmap v302: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:26:02.042 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T22:26:02.043 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T22:26:02.314 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:26:02.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.807+0000 7feaa7891640 1 -- 172.21.15.45:0/3062373816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaa0100e20 msgr2=0x7feaa0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:02.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.807+0000 7feaa7891640 1 --2- 172.21.15.45:0/3062373816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaa0100e20 0x7feaa0101200 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fea98009900 tx=0x7fea9802a480 comp rx=0 tx=0).stop 2024-09-15T22:26:02.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.807+0000 7feaa7891640 1 -- 172.21.15.45:0/3062373816 shutdown_connections 2024-09-15T22:26:02.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.807+0000 7feaa7891640 1 --2- 172.21.15.45:0/3062373816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa0102ef0 0x7feaa010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.807+0000 7feaa7891640 1 --2- 172.21.15.45:0/3062373816 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feaa0102570 0x7feaa01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.807+0000 7feaa7891640 1 --2- 172.21.15.45:0/3062373816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaa0100e20 0x7feaa0101200 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.807+0000 7feaa7891640 1 -- 172.21.15.45:0/3062373816 >> 172.21.15.45:0/3062373816 conn(0x7feaa00fc7d0 msgr2=0x7feaa00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:02.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.807+0000 7feaa7891640 1 -- 172.21.15.45:0/3062373816 shutdown_connections 2024-09-15T22:26:02.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.807+0000 7feaa7891640 1 -- 172.21.15.45:0/3062373816 wait complete. 2024-09-15T22:26:02.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa7891640 1 Processor -- start 2024-09-15T22:26:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa7891640 1 -- start start 2024-09-15T22:26:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa7891640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaa0100e20 0x7feaa010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa7891640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feaa0102570 0x7feaa010ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa7891640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa0102ef0 0x7feaa010ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa7891640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7feaa01121c0 con 0x7feaa0100e20 2024-09-15T22:26:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa7891640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feaa0112040 con 0x7feaa0102ef0 2024-09-15T22:26:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa7891640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feaa0112340 con 0x7feaa0102570 2024-09-15T22:26:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa562d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaa0100e20 0x7feaa010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa562d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaa0100e20 0x7feaa010e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36702/0 (socket says 172.21.15.45:36702) 2024-09-15T22:26:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa562d640 1 -- 172.21.15.45:0/1355225703 learned_addr learned my addr 172.21.15.45:0/1355225703 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa4e2c640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feaa0102570 0x7feaa010ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa5e2e640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa0102ef0 0x7feaa010ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa562d640 1 -- 172.21.15.45:0/1355225703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feaa0102570 msgr2=0x7feaa010ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa562d640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feaa0102570 0x7feaa010ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa562d640 1 -- 172.21.15.45:0/1355225703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa0102ef0 msgr2=0x7feaa010ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa562d640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa0102ef0 0x7feaa010ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa562d640 1 -- 172.21.15.45:0/1355225703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa01a6aa0 con 0x7feaa0100e20 2024-09-15T22:26:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa5e2e640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa0102ef0 0x7feaa010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:26:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.808+0000 7feaa562d640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaa0100e20 0x7feaa010e4d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fea98006010 tx=0x7fea98004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.809+0000 7fea9e7fc640 1 -- 172.21.15.45:0/1355225703 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9803f030 con 0x7feaa0100e20 2024-09-15T22:26:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.809+0000 7feaa7891640 1 -- 172.21.15.45:0/1355225703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa01a6d30 con 0x7feaa0100e20 2024-09-15T22:26:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.809+0000 7fea9e7fc640 1 -- 172.21.15.45:0/1355225703 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea98005500 con 0x7feaa0100e20 2024-09-15T22:26:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.809+0000 7fea9e7fc640 1 -- 172.21.15.45:0/1355225703 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea98035070 con 0x7feaa0100e20 2024-09-15T22:26:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.809+0000 7feaa7891640 1 -- 172.21.15.45:0/1355225703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa01a71b0 con 0x7feaa0100e20 2024-09-15T22:26:02.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.811+0000 7fea9e7fc640 1 -- 172.21.15.45:0/1355225703 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fea98042030 con 0x7feaa0100e20 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.811+0000 7feaa9c6a740 1 Processor -- start 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.811+0000 7feaa9c6a740 1 -- start start 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.811+0000 7feaa9c6a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43d8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa9c6a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d9480 0x5608f43e3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa9c6a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43e3d40 0x5608f43e6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa9c6a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5608f433e280 con 0x5608f43d9480 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa9c6a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5608f42e5b10 con 0x5608f43e3d40 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa9c6a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5608f433a240 con 0x5608f43d8b60 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa562d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d9480 0x5608f43e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa562d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d9480 0x5608f43e3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36706/0 (socket says 172.21.15.45:36706) 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa562d640 1 -- 172.21.15.45:0/1131161892 learned_addr learned my addr 172.21.15.45:0/1131161892 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa4e2c640 1 --2- 172.21.15.45:0/1131161892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43e3d40 0x5608f43e6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa5e2e640 1 --2- 172.21.15.45:0/1131161892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43d8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7fea9e7fc640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fea880a33b0 0x7fea880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa562d640 1 -- 172.21.15.45:0/1131161892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 msgr2=0x5608f43d8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa562d640 1 --2- 172.21.15.45:0/1131161892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43d8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa562d640 1 -- 172.21.15.45:0/1131161892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43e3d40 msgr2=0x5608f43e6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa562d640 1 --2- 172.21.15.45:0/1131161892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43e3d40 0x5608f43e6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa562d640 1 -- 172.21.15.45:0/1131161892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608f42f21f0 con 0x5608f43d9480 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa5e2e640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fea880a33b0 0x7fea880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7fea9e7fc640 1 -- 172.21.15.45:0/1355225703 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fea980f0690 con 0x7feaa0100e20 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.812+0000 7feaa562d640 1 --2- 172.21.15.45:0/1131161892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d9480 0x5608f43e3800 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fea980ed910 tx=0x7fea9808b250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb32fac713329b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.813+0000 7fea877fe640 1 -- 172.21.15.45:0/1131161892 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea98092e60 con 0x5608f43d9480 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.813+0000 7feaa5e2e640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fea880a33b0 0x7fea880a5870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fea90009370 tx=0x7fea90004a40 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.813+0000 7fea877fe640 1 -- 172.21.15.45:0/1131161892 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea98088da0 con 0x5608f43d9480 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.813+0000 7fea877fe640 1 -- 172.21.15.45:0/1131161892 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea980bbec0 con 0x5608f43d9480 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.813+0000 7feaa9c6a740 1 -- 172.21.15.45:0/1131161892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d9480 msgr2=0x5608f43e3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:02.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.813+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/1131161892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d9480 0x5608f43e3800 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fea980ed910 tx=0x7fea9808b250 comp rx=0 tx=0).stop 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.813+0000 7feaa9c6a740 1 -- 172.21.15.45:0/1131161892 shutdown_connections 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.813+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/1131161892 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43e3d40 0x5608f43e6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.813+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/1131161892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d9480 0x5608f43e3800 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.813+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/1131161892 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43d8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.813+0000 7feaa9c6a740 1 -- 172.21.15.45:0/1131161892 >> 172.21.15.45:0/1131161892 conn(0x5608f43d50f0 msgr2=0x5608f43d54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.814+0000 7feaa9c6a740 1 -- 172.21.15.45:0/1131161892 shutdown_connections 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.814+0000 7feaa9c6a740 1 -- 172.21.15.45:0/1131161892 wait complete. 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.814+0000 7feaa9c6a740 1 -- start start 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.814+0000 7feaa9c6a740 1 Processor -- start 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.814+0000 7feaa9c6a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43e0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.814+0000 7feaa9c6a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 0x5608f43e10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.814+0000 7feaa9c6a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 0x5608f43e1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.814+0000 7feaa9c6a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5608f43e66d0 con 0x5608f43e3d40 2024-09-15T22:26:02.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.814+0000 7feaa9c6a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5608f42f8f10 con 0x5608f43d9480 2024-09-15T22:26:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.814+0000 7feaa9c6a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5608f43e6850 con 0x5608f43d8b60 2024-09-15T22:26:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.814+0000 7feaa9c6a740 10 client.0 _ll_register_callbacks cb 0x5608f42c1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.814+0000 7feaa5e2e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 0x5608f43e1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7feaa5e2e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 0x5608f43e1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36720/0 (socket says 172.21.15.45:36720) 2024-09-15T22:26:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7feaa5e2e640 1 -- 172.21.15.45:0/2798923159 learned_addr learned my addr 172.21.15.45:0/2798923159 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7feaa4e2c640 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 0x5608f43e10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7feaa562d640 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43e0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7feaa5e2e640 1 -- 172.21.15.45:0/2798923159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 msgr2=0x5608f43e0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7feaa5e2e640 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43e0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7feaa5e2e640 1 -- 172.21.15.45:0/2798923159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 msgr2=0x5608f43e10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7feaa5e2e640 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 0x5608f43e10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7feaa5e2e640 1 -- 172.21.15.45:0/2798923159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608f40af6a0 con 0x5608f43e3d40 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7feaa562d640 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43e0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7feaa5e2e640 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 0x5608f43e1630 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fea90004010 tx=0x7fea90004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f07cde1969c9b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7fea84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7fea84ff9640 1 -- 172.21.15.45:0/2798923159 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea900128c0 con 0x5608f43e3d40 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7fea84ff9640 1 -- 172.21.15.45:0/2798923159 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fea90012a60 con 0x5608f43e3d40 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7feaa9c6a740 1 -- 172.21.15.45:0/2798923159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5608f434b7f0 con 0x5608f43e3d40 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7fea84ff9640 1 -- 172.21.15.45:0/2798923159 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fea9001f430 con 0x5608f43e3d40 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.815+0000 7feaa9c6a740 10 client.16989 fetch_fsmap learned FSMap version 21 2024-09-15T22:26:02.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.816+0000 7feaa9c6a740 1 -- 172.21.15.45:0/2798923159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5608f43f2230 con 0x5608f43e3d40 2024-09-15T22:26:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.816+0000 7fea84ff9640 1 -- 172.21.15.45:0/2798923159 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x5608f434b7f0 con 0x5608f43e3d40 2024-09-15T22:26:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.816+0000 7fea84ff9640 1 -- 172.21.15.45:0/2798923159 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fea9000f040 con 0x5608f43e3d40 2024-09-15T22:26:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.816+0000 7feaa9c6a740 10 client.16989 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:26:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.816+0000 7feaa9c6a740 10 client.16989 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:26:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.816+0000 7feaa9c6a740 20 client.16989 populate_metadata read hostname 'smithi045' 2024-09-15T22:26:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.816+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5608f43f3790 0x5608f43f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.816+0000 7feaa9c6a740 4 client.16989 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:26:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.816+0000 7feaa9c6a740 1 -- 172.21.15.45:0/2798923159 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608f4345d00 con 0x5608f43f3790 2024-09-15T22:26:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.816+0000 7feaa562d640 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5608f43f3790 0x5608f43f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.817+0000 7feaa562d640 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5608f43f3790 0x5608f43f5bf0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=118b2ca14a11ded5 server_cookie=3aca59b20a64c30e in_seq=0 out_seq=0 2024-09-15T22:26:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.817+0000 7fea84ff9640 10 client.16989 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7fea84ff9640 1 -- 172.21.15.45:0/2798923159 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608f4345d00 con 0x5608f43f3790 2024-09-15T22:26:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7fea84ff9640 10 client.16989 handle_command_reply: tid=0 2024-09-15T22:26:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7feaa9c6a740 1 client.16989 shutdown 2024-09-15T22:26:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7feaa9c6a740 1 -- 172.21.15.45:0/2798923159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 msgr2=0x5608f43e1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 0x5608f43e1630 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fea90004010 tx=0x7fea90004ab0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7feaa9c6a740 1 -- 172.21.15.45:0/2798923159 shutdown_connections 2024-09-15T22:26:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5608f43f3790 0x5608f43f5bf0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 0x5608f43e1630 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 0x5608f43e10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/2798923159 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43e0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7fea84ff9640 0 client.16989 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7feaa9c6a740 1 -- 172.21.15.45:0/2798923159 >> 172.21.15.45:0/2798923159 conn(0x5608f43d50f0 msgr2=0x5608f43dae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7feaa9c6a740 1 -- 172.21.15.45:0/2798923159 shutdown_connections 2024-09-15T22:26:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7feaa9c6a740 1 -- 172.21.15.45:0/2798923159 wait complete. 2024-09-15T22:26:02.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.818+0000 7feaa9c6a740 20 client.16989 trim_cache size 0 max 16384 2024-09-15T22:26:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.836+0000 7feaa9c6a740 1 Processor -- start 2024-09-15T22:26:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.836+0000 7feaa9c6a740 1 -- start start 2024-09-15T22:26:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.836+0000 7feaa9c6a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43db5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.836+0000 7feaa9c6a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 0x5608f43fb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.836+0000 7feaa9c6a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 0x5608f43fba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.836+0000 7feaa9c6a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7feaa01af510 con 0x5608f43e3d40 2024-09-15T22:26:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.836+0000 7feaa9c6a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feaa01b1d90 con 0x5608f43d9480 2024-09-15T22:26:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.836+0000 7feaa9c6a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feaa01afb80 con 0x5608f43d8b60 2024-09-15T22:26:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7feaa5e2e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 0x5608f43fba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7feaa5e2e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 0x5608f43fba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36736/0 (socket says 172.21.15.45:36736) 2024-09-15T22:26:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7feaa5e2e640 1 -- 172.21.15.45:0/2766112170 learned_addr learned my addr 172.21.15.45:0/2766112170 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7feaa4e2c640 1 --2- 172.21.15.45:0/2766112170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 0x5608f43fb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7feaa562d640 1 --2- 172.21.15.45:0/2766112170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43db5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7feaa5e2e640 1 -- 172.21.15.45:0/2766112170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 msgr2=0x5608f43db5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7feaa5e2e640 1 --2- 172.21.15.45:0/2766112170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43db5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7feaa5e2e640 1 -- 172.21.15.45:0/2766112170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 msgr2=0x5608f43fb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7feaa5e2e640 1 --2- 172.21.15.45:0/2766112170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 0x5608f43fb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7feaa5e2e640 1 -- 172.21.15.45:0/2766112170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608f43d4f20 con 0x5608f43e3d40 2024-09-15T22:26:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7feaa562d640 1 --2- 172.21.15.45:0/2766112170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43db5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7feaa5e2e640 1 --2- 172.21.15.45:0/2766112170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 0x5608f43fba00 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fea90010900 tx=0x7fea900097a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8706f3b996bcb62b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7fea86ffd640 1 -- 172.21.15.45:0/2766112170 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea90010cf0 con 0x5608f43e3d40 2024-09-15T22:26:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7fea86ffd640 1 -- 172.21.15.45:0/2766112170 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea90024070 con 0x5608f43e3d40 2024-09-15T22:26:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.837+0000 7fea86ffd640 1 -- 172.21.15.45:0/2766112170 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9001f900 con 0x5608f43e3d40 2024-09-15T22:26:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.838+0000 7feaa9c6a740 1 -- 172.21.15.45:0/2766112170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 msgr2=0x5608f43fba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.838+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/2766112170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 0x5608f43fba00 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fea90010900 tx=0x7fea900097a0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.838+0000 7feaa9c6a740 1 -- 172.21.15.45:0/2766112170 shutdown_connections 2024-09-15T22:26:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.838+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/2766112170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43e3d40 0x5608f43fba00 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.838+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/2766112170 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 0x5608f43fb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.838+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/2766112170 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43d8b60 0x5608f43db5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.838+0000 7feaa9c6a740 1 -- 172.21.15.45:0/2766112170 >> 172.21.15.45:0/2766112170 conn(0x5608f43d50f0 msgr2=0x5608f43dfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.838+0000 7feaa9c6a740 1 -- 172.21.15.45:0/2766112170 shutdown_connections 2024-09-15T22:26:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.838+0000 7feaa9c6a740 1 -- 172.21.15.45:0/2766112170 wait complete. 2024-09-15T22:26:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.838+0000 7feaa9c6a740 1 -- start start 2024-09-15T22:26:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.839+0000 7feaa9c6a740 1 Processor -- start 2024-09-15T22:26:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.839+0000 7feaa9c6a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d8b60 0x5608f43ebea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.839+0000 7feaa9c6a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 0x5608f43e71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.839+0000 7feaa9c6a740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43e3d40 0x5608f43e7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.839+0000 7feaa9c6a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7feaa01b0250 con 0x5608f43d8b60 2024-09-15T22:26:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.839+0000 7feaa9c6a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feaa01b16c0 con 0x5608f43d9480 2024-09-15T22:26:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.839+0000 7feaa9c6a740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7feaa01b0920 con 0x5608f43e3d40 2024-09-15T22:26:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.839+0000 7feaa9c6a740 10 client.0 _ll_register_callbacks cb 0x7fea90009d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.839+0000 7feaa562d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d8b60 0x5608f43ebea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.839+0000 7feaa562d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d8b60 0x5608f43ebea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36748/0 (socket says 172.21.15.45:36748) 2024-09-15T22:26:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.839+0000 7feaa562d640 1 -- 172.21.15.45:0/3702990373 learned_addr learned my addr 172.21.15.45:0/3702990373 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.839+0000 7feaa4e2c640 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 0x5608f43e71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.839+0000 7feaa5e2e640 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43e3d40 0x5608f43e7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7feaa562d640 1 -- 172.21.15.45:0/3702990373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43e3d40 msgr2=0x5608f43e7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:02.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7feaa562d640 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43e3d40 0x5608f43e7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7feaa562d640 1 -- 172.21.15.45:0/3702990373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 msgr2=0x5608f43e71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:02.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7feaa562d640 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 0x5608f43e71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7feaa562d640 1 -- 172.21.15.45:0/3702990373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608f43e7d50 con 0x5608f43d8b60 2024-09-15T22:26:02.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7feaa4e2c640 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 0x5608f43e71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:02.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7feaa562d640 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d8b60 0x5608f43ebea0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fea980bc260 tx=0x7fea98005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17ae10e2eb301e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:02.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7fea84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:26:02.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7fea84ff9640 1 -- 172.21.15.45:0/3702990373 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea98049040 con 0x5608f43d8b60 2024-09-15T22:26:02.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7feaa9c6a740 1 -- 172.21.15.45:0/3702990373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea90024070 con 0x5608f43d8b60 2024-09-15T22:26:02.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7fea84ff9640 1 -- 172.21.15.45:0/3702990373 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fea980ba860 con 0x5608f43d8b60 2024-09-15T22:26:02.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7fea84ff9640 1 -- 172.21.15.45:0/3702990373 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fea980056b0 con 0x5608f43d8b60 2024-09-15T22:26:02.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7feaa9c6a740 10 client.16995 fetch_fsmap learned FSMap version 21 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7feaa9c6a740 1 -- 172.21.15.45:0/3702990373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5608f445e2e0 con 0x5608f43d8b60 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7fea84ff9640 1 -- 172.21.15.45:0/3702990373 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fea90024070 con 0x5608f43d8b60 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7fea84ff9640 1 -- 172.21.15.45:0/3702990373 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fea980b8bd0 con 0x5608f43d8b60 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7feaa9c6a740 10 client.16995 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7feaa9c6a740 10 client.16995 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.840+0000 7feaa9c6a740 20 client.16995 populate_metadata read hostname 'smithi045' 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.841+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5608f445e730 0x5608f4460b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.841+0000 7feaa9c6a740 4 client.16995 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.841+0000 7feaa9c6a740 1 -- 172.21.15.45:0/3702990373 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5608f42c2110 con 0x5608f445e730 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.841+0000 7feaa4e2c640 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5608f445e730 0x5608f4460b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.841+0000 7fea84ff9640 10 client.16995 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.841+0000 7feaa4e2c640 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5608f445e730 0x5608f4460b20 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a06d6b405d98ef9 server_cookie=b52b6cac172c34be in_seq=0 out_seq=0 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.842+0000 7fea84ff9640 1 -- 172.21.15.45:0/3702990373 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5608f42c2110 con 0x5608f445e730 2024-09-15T22:26:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.842+0000 7fea84ff9640 10 client.16995 handle_command_reply: tid=0 2024-09-15T22:26:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.842+0000 7feaa9c6a740 1 client.16995 shutdown 2024-09-15T22:26:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.842+0000 7feaa9c6a740 1 -- 172.21.15.45:0/3702990373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d8b60 msgr2=0x5608f43ebea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.842+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d8b60 0x5608f43ebea0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fea980bc260 tx=0x7fea98005c90 comp rx=0 tx=0).stop 2024-09-15T22:26:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.842+0000 7feaa9c6a740 1 -- 172.21.15.45:0/3702990373 shutdown_connections 2024-09-15T22:26:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.842+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5608f445e730 0x5608f4460b20 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.842+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5608f43e3d40 0x5608f43e7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.842+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5608f43d9480 0x5608f43e71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.842+0000 7feaa9c6a740 1 --2- 172.21.15.45:0/3702990373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5608f43d8b60 0x5608f43ebea0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.842+0000 7feaa9c6a740 1 -- 172.21.15.45:0/3702990373 >> 172.21.15.45:0/3702990373 conn(0x5608f43d50f0 msgr2=0x5608f43e0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7fea84ff9640 0 client.16995 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7feaa9c6a740 1 -- 172.21.15.45:0/3702990373 shutdown_connections 2024-09-15T22:26:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7feaa9c6a740 1 -- 172.21.15.45:0/3702990373 wait complete. 2024-09-15T22:26:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7feaa9c6a740 20 client.16995 trim_cache size 0 max 16384 2024-09-15T22:26:02.857 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:26:02.857 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2024-09-15T22:26:02.857 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "d7ca38f9-5f79-4cea-b762-11947f6514fd", 2024-09-15T22:26:02.857 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2024-09-15T22:26:02.857 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:26:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7feaa7891640 1 -- 172.21.15.45:0/1355225703 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fea880a33b0 msgr2=0x7fea880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7feaa7891640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fea880a33b0 0x7fea880a5870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fea90009370 tx=0x7fea90004a40 comp rx=0 tx=0).stop 2024-09-15T22:26:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7feaa7891640 1 -- 172.21.15.45:0/1355225703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaa0100e20 msgr2=0x7feaa010e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7feaa7891640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaa0100e20 0x7feaa010e4d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fea98006010 tx=0x7fea98004c00 comp rx=0 tx=0).stop 2024-09-15T22:26:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7feaa7891640 1 -- 172.21.15.45:0/1355225703 shutdown_connections 2024-09-15T22:26:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7feaa7891640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fea880a33b0 0x7fea880a5870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7feaa7891640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feaa0102ef0 0x7feaa010ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7feaa7891640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7feaa0102570 0x7feaa010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7feaa7891640 1 --2- 172.21.15.45:0/1355225703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaa0100e20 0x7feaa010e4d0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.843+0000 7feaa7891640 1 -- 172.21.15.45:0/1355225703 >> 172.21.15.45:0/1355225703 conn(0x7feaa00fc7d0 msgr2=0x7feaa00fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:02.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.844+0000 7feaa7891640 1 -- 172.21.15.45:0/1355225703 shutdown_connections 2024-09-15T22:26:02.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:02.844+0000 7feaa7891640 1 -- 172.21.15.45:0/1355225703 wait complete. 2024-09-15T22:26:03.529 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:03 smithi045 ceph-mon[31180]: pgmap v303: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:03.563 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:26:03.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:03 smithi165 ceph-mon[35551]: pgmap v303: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:03.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:03 smithi100 ceph-mon[35319]: pgmap v303: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:03.826 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:26:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.348+0000 7fcb8739e640 1 -- 172.21.15.45:0/2546770696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb801068d0 msgr2=0x7fcb80106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.348+0000 7fcb8739e640 1 --2- 172.21.15.45:0/2546770696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb801068d0 0x7fcb80106cb0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009930 tx=0x7fcb7c02a440 comp rx=0 tx=0).stop 2024-09-15T22:26:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.348+0000 7fcb8739e640 1 -- 172.21.15.45:0/2546770696 shutdown_connections 2024-09-15T22:26:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.348+0000 7fcb8739e640 1 --2- 172.21.15.45:0/2546770696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb80101270 0x7fcb8010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.348+0000 7fcb8739e640 1 --2- 172.21.15.45:0/2546770696 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb801008d0 0x7fcb80100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.348+0000 7fcb8739e640 1 --2- 172.21.15.45:0/2546770696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb801068d0 0x7fcb80106cb0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.348+0000 7fcb8739e640 1 -- 172.21.15.45:0/2546770696 >> 172.21.15.45:0/2546770696 conn(0x7fcb800fc630 msgr2=0x7fcb800fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:04.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.348+0000 7fcb8739e640 1 -- 172.21.15.45:0/2546770696 shutdown_connections 2024-09-15T22:26:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.348+0000 7fcb8739e640 1 -- 172.21.15.45:0/2546770696 wait complete. 2024-09-15T22:26:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb8739e640 1 Processor -- start 2024-09-15T22:26:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb8739e640 1 -- start start 2024-09-15T22:26:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb8739e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb801008d0 0x7fcb80198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb8739e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb80101270 0x7fcb801987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb8739e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb801068d0 0x7fcb8019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb8739e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcb80111f10 con 0x7fcb801068d0 2024-09-15T22:26:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb8739e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb80111d90 con 0x7fcb80101270 2024-09-15T22:26:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb8739e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb80112090 con 0x7fcb801008d0 2024-09-15T22:26:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb86b9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb801068d0 0x7fcb8019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb86b9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb801068d0 0x7fcb8019cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57848/0 (socket says 172.21.15.45:57848) 2024-09-15T22:26:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb86b9d640 1 -- 172.21.15.45:0/40183213 learned_addr learned my addr 172.21.15.45:0/40183213 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb8639c640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb801008d0 0x7fcb80198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb80101270 0x7fcb801987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb86b9d640 1 -- 172.21.15.45:0/40183213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb801008d0 msgr2=0x7fcb80198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb86b9d640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb801008d0 0x7fcb80198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb86b9d640 1 -- 172.21.15.45:0/40183213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb80101270 msgr2=0x7fcb801987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb86b9d640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb80101270 0x7fcb801987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.349+0000 7fcb86b9d640 1 -- 172.21.15.45:0/40183213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8019d220 con 0x7fcb801068d0 2024-09-15T22:26:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.350+0000 7fcb86b9d640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb801068d0 0x7fcb8019cb40 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800cce0 tx=0x7fcb7800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.350+0000 7fcb777fe640 1 -- 172.21.15.45:0/40183213 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7800f450 con 0x7fcb801068d0 2024-09-15T22:26:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.350+0000 7fcb8739e640 1 -- 172.21.15.45:0/40183213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8019d510 con 0x7fcb801068d0 2024-09-15T22:26:04.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.350+0000 7fcb777fe640 1 -- 172.21.15.45:0/40183213 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb7800faf0 con 0x7fcb801068d0 2024-09-15T22:26:04.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.350+0000 7fcb777fe640 1 -- 172.21.15.45:0/40183213 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78018cc0 con 0x7fcb801068d0 2024-09-15T22:26:04.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.350+0000 7fcb8739e640 1 -- 172.21.15.45:0/40183213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb801a4df0 con 0x7fcb801068d0 2024-09-15T22:26:04.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.353+0000 7fcb8a9d9740 1 Processor -- start 2024-09-15T22:26:04.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.353+0000 7fcb777fe640 1 -- 172.21.15.45:0/40183213 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fcb7800f5f0 con 0x7fcb801068d0 2024-09-15T22:26:04.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.353+0000 7fcb8a9d9740 1 -- start start 2024-09-15T22:26:04.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.353+0000 7fcb8a9d9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581550 0x562f8d581930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.353+0000 7fcb8a9d9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581e70 0x562f8d590720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.353+0000 7fcb8a9d9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d590c60 0x562f8d593050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.353+0000 7fcb8a9d9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x562f8d4e72e0 con 0x562f8d581550 2024-09-15T22:26:04.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.353+0000 7fcb8a9d9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562f8d48ece0 con 0x562f8d581e70 2024-09-15T22:26:04.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.353+0000 7fcb8a9d9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562f8d4e32a0 con 0x562f8d590c60 2024-09-15T22:26:04.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.353+0000 7fcb85b9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581550 0x562f8d581930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.353+0000 7fcb85b9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581550 0x562f8d581930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57862/0 (socket says 172.21.15.45:57862) 2024-09-15T22:26:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.353+0000 7fcb85b9b640 1 -- 172.21.15.45:0/886398327 learned_addr learned my addr 172.21.15.45:0/886398327 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.353+0000 7fcb8639c640 1 --2- 172.21.15.45:0/886398327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581e70 0x562f8d590720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/886398327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d590c60 0x562f8d593050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb777fe640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcb6c0a33b0 0x7fcb6c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb85b9b640 1 -- 172.21.15.45:0/886398327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d590c60 msgr2=0x562f8d593050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/886398327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d590c60 0x562f8d593050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb85b9b640 1 -- 172.21.15.45:0/886398327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581e70 msgr2=0x562f8d590720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/886398327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581e70 0x562f8d590720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb85b9b640 1 -- 172.21.15.45:0/886398327 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f8d473440 con 0x562f8d581550 2024-09-15T22:26:04.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb8639c640 1 --2- 172.21.15.45:0/886398327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581e70 0x562f8d590720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb86b9d640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcb6c0a33b0 0x7fcb6c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb777fe640 1 -- 172.21.15.45:0/40183213 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fcb780d0690 con 0x7fcb801068d0 2024-09-15T22:26:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/886398327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581550 0x562f8d581930 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000cf70 tx=0x7fcb7000c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b4e14aa9954a4f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb74ff9640 1 -- 172.21.15.45:0/886398327 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70018030 con 0x562f8d581550 2024-09-15T22:26:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb74ff9640 1 -- 172.21.15.45:0/886398327 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb70005520 con 0x562f8d581550 2024-09-15T22:26:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.354+0000 7fcb74ff9640 1 -- 172.21.15.45:0/886398327 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70010960 con 0x562f8d581550 2024-09-15T22:26:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.355+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/886398327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581550 msgr2=0x562f8d581930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.355+0000 7fcb86b9d640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcb6c0a33b0 0x7fcb6c0a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcb7809c260 tx=0x7fcb780919f0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.355+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/886398327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581550 0x562f8d581930 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000cf70 tx=0x7fcb7000c620 comp rx=0 tx=0).stop 2024-09-15T22:26:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.355+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/886398327 shutdown_connections 2024-09-15T22:26:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.355+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/886398327 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d590c60 0x562f8d593050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.355+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/886398327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581e70 0x562f8d590720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.355+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/886398327 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581550 0x562f8d581930 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.355+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/886398327 >> 172.21.15.45:0/886398327 conn(0x562f8d57dc00 msgr2=0x562f8d57dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.355+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/886398327 shutdown_connections 2024-09-15T22:26:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.355+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/886398327 wait complete. 2024-09-15T22:26:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.355+0000 7fcb8a9d9740 1 -- start start 2024-09-15T22:26:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.355+0000 7fcb8a9d9740 1 Processor -- start 2024-09-15T22:26:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8a9d9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581550 0x562f8d590580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8a9d9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581e70 0x562f8d58d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8a9d9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d590c60 0x562f8d58dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8a9d9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x562f8d593830 con 0x562f8d581e70 2024-09-15T22:26:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8a9d9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x562f8d4a2050 con 0x562f8d581550 2024-09-15T22:26:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8a9d9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x562f8d5939b0 con 0x562f8d590c60 2024-09-15T22:26:04.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8639c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581e70 0x562f8d58d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8a9d9740 10 client.0 _ll_register_callbacks cb 0x562f8d4e2160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8639c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581e70 0x562f8d58d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57876/0 (socket says 172.21.15.45:57876) 2024-09-15T22:26:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8639c640 1 -- 172.21.15.45:0/1277508467 learned_addr learned my addr 172.21.15.45:0/1277508467 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581550 0x562f8d590580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d590c60 0x562f8d58dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8639c640 1 -- 172.21.15.45:0/1277508467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d590c60 msgr2=0x562f8d58dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8639c640 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d590c60 0x562f8d58dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8639c640 1 -- 172.21.15.45:0/1277508467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581550 msgr2=0x562f8d590580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8639c640 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581550 0x562f8d590580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8639c640 1 -- 172.21.15.45:0/1277508467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f8d2583c0 con 0x562f8d581e70 2024-09-15T22:26:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581550 0x562f8d590580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:26:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb8639c640 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581e70 0x562f8d58d830 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009930 tx=0x7fcb7c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae4d82460c3927a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:04.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.356+0000 7fcb69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:26:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb69ffb640 1 -- 172.21.15.45:0/1277508467 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c035070 con 0x562f8d581e70 2024-09-15T22:26:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb69ffb640 1 -- 172.21.15.45:0/1277508467 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fcb7c004430 con 0x562f8d581e70 2024-09-15T22:26:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/1277508467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb70005520 con 0x562f8d581e70 2024-09-15T22:26:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb69ffb640 1 -- 172.21.15.45:0/1277508467 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcb7c005020 con 0x562f8d581e70 2024-09-15T22:26:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb8a9d9740 10 client.17007 fetch_fsmap learned FSMap version 21 2024-09-15T22:26:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/1277508467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562f8d59f1f0 con 0x562f8d581e70 2024-09-15T22:26:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb69ffb640 1 -- 172.21.15.45:0/1277508467 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb70005520 con 0x562f8d581e70 2024-09-15T22:26:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb69ffb640 1 -- 172.21.15.45:0/1277508467 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcb7c0036d0 con 0x562f8d581e70 2024-09-15T22:26:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb8a9d9740 10 client.17007 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:26:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb8a9d9740 10 client.17007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:26:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb8a9d9740 20 client.17007 populate_metadata read hostname 'smithi045' 2024-09-15T22:26:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562f8d5a0700 0x562f8d5a2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb8a9d9740 4 client.17007 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:26:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.357+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/1277508467 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f8d4f4850 con 0x562f8d5a0700 2024-09-15T22:26:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.358+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562f8d5a0700 0x562f8d5a2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.358+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562f8d5a0700 0x562f8d5a2b40 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39fc559e62c19a18 server_cookie=7989eb6c355857c7 in_seq=0 out_seq=0 2024-09-15T22:26:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.358+0000 7fcb69ffb640 10 client.17007 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb69ffb640 1 -- 172.21.15.45:0/1277508467 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f8d4f4850 con 0x562f8d5a0700 2024-09-15T22:26:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb69ffb640 10 client.17007 handle_command_reply: tid=0 2024-09-15T22:26:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb8a9d9740 1 client.17007 shutdown 2024-09-15T22:26:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/1277508467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581e70 msgr2=0x562f8d58d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581e70 0x562f8d58d830 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009930 tx=0x7fcb7c004040 comp rx=0 tx=0).stop 2024-09-15T22:26:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/1277508467 shutdown_connections 2024-09-15T22:26:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562f8d5a0700 0x562f8d5a2b40 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d590c60 0x562f8d58dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d581e70 0x562f8d58d830 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/1277508467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581550 0x562f8d590580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb69ffb640 0 client.17007 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/1277508467 >> 172.21.15.45:0/1277508467 conn(0x562f8d57dc00 msgr2=0x562f8d583960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/1277508467 shutdown_connections 2024-09-15T22:26:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/1277508467 wait complete. 2024-09-15T22:26:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.359+0000 7fcb8a9d9740 20 client.17007 trim_cache size 0 max 16384 2024-09-15T22:26:04.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.376+0000 7fcb8a9d9740 1 Processor -- start 2024-09-15T22:26:04.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.376+0000 7fcb8a9d9740 1 -- start start 2024-09-15T22:26:04.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb8a9d9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d581550 0x562f8d59cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb8a9d9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581e70 0x562f8d5a8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb8a9d9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 0x562f8d5a8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb8a9d9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcb801aacb0 con 0x562f8d590c60 2024-09-15T22:26:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb8a9d9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb801ad530 con 0x562f8d581e70 2024-09-15T22:26:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb8a9d9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb801ab320 con 0x562f8d581550 2024-09-15T22:26:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb85b9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 0x562f8d5a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb85b9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 0x562f8d5a8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57878/0 (socket says 172.21.15.45:57878) 2024-09-15T22:26:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb85b9b640 1 -- 172.21.15.45:0/3227151310 learned_addr learned my addr 172.21.15.45:0/3227151310 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb8639c640 1 --2- 172.21.15.45:0/3227151310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581e70 0x562f8d5a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb85b9b640 1 -- 172.21.15.45:0/3227151310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d581550 msgr2=0x562f8d59cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/3227151310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d581550 0x562f8d59cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb85b9b640 1 -- 172.21.15.45:0/3227151310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581e70 msgr2=0x562f8d5a8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:04.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/3227151310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581e70 0x562f8d5a8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb85b9b640 1 -- 172.21.15.45:0/3227151310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f8d593390 con 0x562f8d590c60 2024-09-15T22:26:04.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb8639c640 1 --2- 172.21.15.45:0/3227151310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581e70 0x562f8d5a8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:26:04.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/3227151310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 0x562f8d5a8950 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fcb70004fa0 tx=0x7fcb70020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6a5b3c99705d79 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:04.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb6bfff640 1 -- 172.21.15.45:0/3227151310 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70018070 con 0x562f8d590c60 2024-09-15T22:26:04.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.377+0000 7fcb6bfff640 1 -- 172.21.15.45:0/3227151310 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb70019040 con 0x562f8d590c60 2024-09-15T22:26:04.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.378+0000 7fcb6bfff640 1 -- 172.21.15.45:0/3227151310 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70003850 con 0x562f8d590c60 2024-09-15T22:26:04.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.378+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/3227151310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 msgr2=0x562f8d5a8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:04.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.378+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/3227151310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 0x562f8d5a8950 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fcb70004fa0 tx=0x7fcb70020040 comp rx=0 tx=0).stop 2024-09-15T22:26:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.378+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/3227151310 shutdown_connections 2024-09-15T22:26:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.378+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/3227151310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 0x562f8d5a8950 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.378+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/3227151310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581e70 0x562f8d5a8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.378+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/3227151310 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d581550 0x562f8d59cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.378+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/3227151310 >> 172.21.15.45:0/3227151310 conn(0x562f8d57dc00 msgr2=0x562f8d58f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.378+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/3227151310 shutdown_connections 2024-09-15T22:26:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.378+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/3227151310 wait complete. 2024-09-15T22:26:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.378+0000 7fcb8a9d9740 1 -- start start 2024-09-15T22:26:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb8a9d9740 1 Processor -- start 2024-09-15T22:26:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb8a9d9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581550 0x562f8d594ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb8a9d9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d581e70 0x562f8d5950e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb8a9d9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 0x562f8d595620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb8a9d9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fcb801ab9f0 con 0x562f8d590c60 2024-09-15T22:26:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb8a9d9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb801ace60 con 0x562f8d581550 2024-09-15T22:26:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb8a9d9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fcb801ac0c0 con 0x562f8d581e70 2024-09-15T22:26:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb8a9d9740 10 client.0 _ll_register_callbacks cb 0x7fcb7c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb85b9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 0x562f8d595620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb85b9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 0x562f8d595620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57884/0 (socket says 172.21.15.45:57884) 2024-09-15T22:26:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb85b9b640 1 -- 172.21.15.45:0/2261332529 learned_addr learned my addr 172.21.15.45:0/2261332529 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/2261332529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581550 0x562f8d594ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb8639c640 1 --2- 172.21.15.45:0/2261332529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d581e70 0x562f8d5950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb85b9b640 1 -- 172.21.15.45:0/2261332529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d581e70 msgr2=0x562f8d5950e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/2261332529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d581e70 0x562f8d5950e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb85b9b640 1 -- 172.21.15.45:0/2261332529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581550 msgr2=0x562f8d594ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:04.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/2261332529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581550 0x562f8d594ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb85b9b640 1 -- 172.21.15.45:0/2261332529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f8d60a5e0 con 0x562f8d590c60 2024-09-15T22:26:04.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.379+0000 7fcb85b9b640 1 --2- 172.21.15.45:0/2261332529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 0x562f8d595620 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fcb70004ba0 tx=0x7fcb7002d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4dbf960f8361375 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:04.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb69ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:26:04.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb69ffb640 1 -- 172.21.15.45:0/2261332529 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70018070 con 0x562f8d590c60 2024-09-15T22:26:04.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb69ffb640 1 -- 172.21.15.45:0/2261332529 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9568+0+0 (secure 0 0 0) 0x7fcb70005320 con 0x562f8d590c60 2024-09-15T22:26:04.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/2261332529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb70019040 con 0x562f8d590c60 2024-09-15T22:26:04.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb69ffb640 1 -- 172.21.15.45:0/2261332529 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcb70044050 con 0x562f8d590c60 2024-09-15T22:26:04.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb8a9d9740 10 client.17013 fetch_fsmap learned FSMap version 21 2024-09-15T22:26:04.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/2261332529 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x562f8d60b840 con 0x562f8d590c60 2024-09-15T22:26:04.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb69ffb640 1 -- 172.21.15.45:0/2261332529 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcb70019040 con 0x562f8d590c60 2024-09-15T22:26:04.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb69ffb640 1 -- 172.21.15.45:0/2261332529 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcb70038040 con 0x562f8d590c60 2024-09-15T22:26:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb8a9d9740 10 client.17013 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:26:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb8a9d9740 10 client.17013 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:26:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb8a9d9740 20 client.17013 populate_metadata read hostname 'smithi045' 2024-09-15T22:26:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/2261332529 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562f8d60bd10 0x562f8d60e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb8a9d9740 4 client.17013 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:26:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.380+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/2261332529 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562f8d4eed60 con 0x562f8d60bd10 2024-09-15T22:26:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.381+0000 7fcb8639c640 1 --2- 172.21.15.45:0/2261332529 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562f8d60bd10 0x562f8d60e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.381+0000 7fcb69ffb640 10 client.17013 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.381+0000 7fcb8639c640 1 --2- 172.21.15.45:0/2261332529 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562f8d60bd10 0x562f8d60e100 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75b549ff4b46e357 server_cookie=c5d8f5b03673704e in_seq=0 out_seq=0 2024-09-15T22:26:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.381+0000 7fcb69ffb640 1 -- 172.21.15.45:0/2261332529 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x562f8d4eed60 con 0x562f8d60bd10 2024-09-15T22:26:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.381+0000 7fcb69ffb640 10 client.17013 handle_command_reply: tid=0 2024-09-15T22:26:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.381+0000 7fcb8a9d9740 1 client.17013 shutdown 2024-09-15T22:26:04.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.381+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/2261332529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 msgr2=0x562f8d595620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:04.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.381+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/2261332529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 0x562f8d595620 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fcb70004ba0 tx=0x7fcb7002d040 comp rx=0 tx=0).stop 2024-09-15T22:26:04.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.381+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/2261332529 shutdown_connections 2024-09-15T22:26:04.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.381+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/2261332529 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x562f8d60bd10 0x562f8d60e100 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.381+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/2261332529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562f8d590c60 0x562f8d595620 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.381+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/2261332529 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x562f8d581e70 0x562f8d5950e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.381+0000 7fcb8a9d9740 1 --2- 172.21.15.45:0/2261332529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562f8d581550 0x562f8d594ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/2261332529 >> 172.21.15.45:0/2261332529 conn(0x562f8d57dc00 msgr2=0x562f8d58bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:04.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb69ffb640 0 client.17013 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:04.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/2261332529 shutdown_connections 2024-09-15T22:26:04.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8a9d9740 1 -- 172.21.15.45:0/2261332529 wait complete. 2024-09-15T22:26:04.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8a9d9740 20 client.17013 trim_cache size 0 max 16384 2024-09-15T22:26:04.390 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:26:04.390 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T22:26:04.390 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2024-09-15T22:26:04.390 INFO:teuthology.orchestra.run.smithi045.stdout: "d7ca38f9-5f79-4cea-b762-11947f6514fd": { 2024-09-15T22:26:04.390 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2024-09-15T22:26:04.390 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "d7ca38f9-5f79-4cea-b762-11947f6514fd", 2024-09-15T22:26:04.390 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,force" 2024-09-15T22:26:04.390 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:04.390 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:04.390 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:26:04.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8739e640 1 -- 172.21.15.45:0/40183213 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcb6c0a33b0 msgr2=0x7fcb6c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:04.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8739e640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcb6c0a33b0 0x7fcb6c0a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcb7809c260 tx=0x7fcb780919f0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8739e640 1 -- 172.21.15.45:0/40183213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb801068d0 msgr2=0x7fcb8019cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:04.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8739e640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb801068d0 0x7fcb8019cb40 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800cce0 tx=0x7fcb7800a620 comp rx=0 tx=0).stop 2024-09-15T22:26:04.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8739e640 1 -- 172.21.15.45:0/40183213 shutdown_connections 2024-09-15T22:26:04.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8739e640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcb6c0a33b0 0x7fcb6c0a5870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8739e640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb801068d0 0x7fcb8019cb40 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8739e640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb80101270 0x7fcb801987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8739e640 1 --2- 172.21.15.45:0/40183213 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fcb801008d0 0x7fcb80198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:04.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8739e640 1 -- 172.21.15.45:0/40183213 >> 172.21.15.45:0/40183213 conn(0x7fcb800fc630 msgr2=0x7fcb800fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:04.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8739e640 1 -- 172.21.15.45:0/40183213 shutdown_connections 2024-09-15T22:26:04.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:04.382+0000 7fcb8739e640 1 -- 172.21.15.45:0/40183213 wait complete. 2024-09-15T22:26:04.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:04 smithi045 ceph-mon[31180]: scrub queued for path: / 2024-09-15T22:26:04.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:04 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:26:04.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:04 smithi045 ceph-mon[31180]: scrub summary: active paths [/] 2024-09-15T22:26:04.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:04 smithi045 ceph-mon[31180]: scrub summary: idle+waiting paths [/] 2024-09-15T22:26:04.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:04 smithi165 ceph-mon[35551]: scrub queued for path: / 2024-09-15T22:26:04.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:04 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:26:04.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:04 smithi165 ceph-mon[35551]: scrub summary: active paths [/] 2024-09-15T22:26:04.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:04 smithi165 ceph-mon[35551]: scrub summary: idle+waiting paths [/] 2024-09-15T22:26:04.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:04 smithi100 ceph-mon[35319]: scrub queued for path: / 2024-09-15T22:26:04.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:04 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:26:04.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:04 smithi100 ceph-mon[35319]: scrub summary: active paths [/] 2024-09-15T22:26:04.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:04 smithi100 ceph-mon[35319]: scrub summary: idle+waiting paths [/] 2024-09-15T22:26:05.086 INFO:tasks.cephfs.filesystem:scrub status for tag:d7ca38f9-5f79-4cea-b762-11947f6514fd - {'path': '/', 'tag': 'd7ca38f9-5f79-4cea-b762-11947f6514fd', 'options': 'recursive,force'} 2024-09-15T22:26:05.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:05 smithi045 ceph-mon[31180]: pgmap v304: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:26:05.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:05 smithi165 ceph-mon[35551]: pgmap v304: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:26:05.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:05 smithi100 ceph-mon[35319]: pgmap v304: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:26:07.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:07 smithi045 ceph-mon[31180]: pgmap v305: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:26:07.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:07 smithi165 ceph-mon[35551]: pgmap v305: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:26:07.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:07 smithi100 ceph-mon[35319]: pgmap v305: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:26:08.552 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:08 smithi045 ceph-mon[31180]: scrub summary: idle 2024-09-15T22:26:08.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:08 smithi165 ceph-mon[35551]: scrub summary: idle 2024-09-15T22:26:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:08 smithi100 ceph-mon[35319]: scrub summary: idle 2024-09-15T22:26:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:09 smithi045 ceph-mon[31180]: pgmap v306: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:26:09.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:09 smithi045 ceph-mon[31180]: osdmap e99: 12 total, 12 up, 12 in 2024-09-15T22:26:09.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:09 smithi165 ceph-mon[35551]: pgmap v306: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:26:09.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:09 smithi165 ceph-mon[35551]: osdmap e99: 12 total, 12 up, 12 in 2024-09-15T22:26:09.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:09 smithi100 ceph-mon[35319]: pgmap v306: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:26:09.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:09 smithi100 ceph-mon[35319]: osdmap e99: 12 total, 12 up, 12 in 2024-09-15T22:26:11.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:11 smithi045 ceph-mon[31180]: pgmap v308: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:26:11.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:11 smithi165 ceph-mon[35551]: pgmap v308: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:26:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:11 smithi100 ceph-mon[35319]: pgmap v308: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:26:13.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:13 smithi045 ceph-mon[31180]: pgmap v309: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:26:13.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:13 smithi165 ceph-mon[35551]: pgmap v309: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:26:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:13 smithi100 ceph-mon[35319]: pgmap v309: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:26:15.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:15 smithi045 ceph-mon[31180]: pgmap v310: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T22:26:15.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:15 smithi045 ceph-mon[31180]: osdmap e100: 12 total, 12 up, 12 in 2024-09-15T22:26:15.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:15 smithi165 ceph-mon[35551]: pgmap v310: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T22:26:15.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:15 smithi165 ceph-mon[35551]: osdmap e100: 12 total, 12 up, 12 in 2024-09-15T22:26:15.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:15 smithi100 ceph-mon[35319]: pgmap v310: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T22:26:15.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:15 smithi100 ceph-mon[35319]: osdmap e100: 12 total, 12 up, 12 in 2024-09-15T22:26:17.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:17 smithi045 ceph-mon[31180]: pgmap v312: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T22:26:17.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:17 smithi165 ceph-mon[35551]: pgmap v312: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T22:26:17.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:17 smithi100 ceph-mon[35319]: pgmap v312: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T22:26:19.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:19 smithi045 ceph-mon[31180]: pgmap v313: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 216 B/s wr, 2 op/s 2024-09-15T22:26:19.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:19 smithi165 ceph-mon[35551]: pgmap v313: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 216 B/s wr, 2 op/s 2024-09-15T22:26:19.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:19 smithi100 ceph-mon[35319]: pgmap v313: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 216 B/s wr, 2 op/s 2024-09-15T22:26:21.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:21 smithi045 ceph-mon[31180]: pgmap v314: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:26:21.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:21 smithi165 ceph-mon[35551]: pgmap v314: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:26:21.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:21 smithi100 ceph-mon[35319]: pgmap v314: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:26:23.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:23 smithi045 ceph-mon[31180]: pgmap v315: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:26:23.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:23 smithi165 ceph-mon[35551]: pgmap v315: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:26:23.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:23 smithi100 ceph-mon[35319]: pgmap v315: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 102 B/s wr, 2 op/s 2024-09-15T22:26:25.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:25 smithi045 ceph-mon[31180]: pgmap v316: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:26:25.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:25 smithi165 ceph-mon[35551]: pgmap v316: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:26:25.743 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:25 smithi100 ceph-mon[35319]: pgmap v316: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T22:26:27.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:27 smithi045 ceph-mon[31180]: pgmap v317: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-09-15T22:26:27.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:27 smithi165 ceph-mon[35551]: pgmap v317: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-09-15T22:26:27.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:27 smithi100 ceph-mon[35319]: pgmap v317: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 922 B/s rd, 1 op/s 2024-09-15T22:26:28.792 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-15T22:26:28.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.897+0000 7fd012053640 1 -- 172.21.15.45:0/1150042348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd00c1035e0 msgr2=0x7fd00c10bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:28.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.897+0000 7fd012053640 1 --2- 172.21.15.45:0/1150042348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd00c1035e0 0x7fd00c10bac0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009900 tx=0x7fcff402a480 comp rx=0 tx=0).stop 2024-09-15T22:26:28.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.898+0000 7fd012053640 1 -- 172.21.15.45:0/1150042348 shutdown_connections 2024-09-15T22:26:28.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.898+0000 7fd012053640 1 --2- 172.21.15.45:0/1150042348 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd00c10c110 0x7fd00c10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:28.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.898+0000 7fd012053640 1 --2- 172.21.15.45:0/1150042348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd00c1035e0 0x7fd00c10bac0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:28.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.898+0000 7fd012053640 1 --2- 172.21.15.45:0/1150042348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd00c102cc0 0x7fd00c1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.898+0000 7fd012053640 1 -- 172.21.15.45:0/1150042348 >> 172.21.15.45:0/1150042348 conn(0x7fd00c0fc6b0 msgr2=0x7fd00c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.898+0000 7fd012053640 1 -- 172.21.15.45:0/1150042348 shutdown_connections 2024-09-15T22:26:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.898+0000 7fd012053640 1 -- 172.21.15.45:0/1150042348 wait complete. 2024-09-15T22:26:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.898+0000 7fd012053640 1 Processor -- start 2024-09-15T22:26:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.898+0000 7fd012053640 1 -- start start 2024-09-15T22:26:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd012053640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd00c102cc0 0x7fd00c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd012053640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd00c1035e0 0x7fd00c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd012053640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd00c10c110 0x7fd00c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:28.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd012053640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c112010 con 0x7fd00c10c110 2024-09-15T22:26:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd012053640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c111e90 con 0x7fd00c102cc0 2024-09-15T22:26:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd012053640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fd00c112190 con 0x7fd00c1035e0 2024-09-15T22:26:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd00bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd00c10c110 0x7fd00c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd00bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd00c10c110 0x7fd00c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41670/0 (socket says 172.21.15.45:41670) 2024-09-15T22:26:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd00bfff640 1 -- 172.21.15.45:0/3704388792 learned_addr learned my addr 172.21.15.45:0/3704388792 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd00b7fe640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd00c102cc0 0x7fd00c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd00affd640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd00c1035e0 0x7fd00c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd00bfff640 1 -- 172.21.15.45:0/3704388792 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd00c1035e0 msgr2=0x7fd00c1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd00bfff640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd00c1035e0 0x7fd00c1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:28.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd00bfff640 1 -- 172.21.15.45:0/3704388792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd00c102cc0 msgr2=0x7fd00c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:28.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd00bfff640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd00c102cc0 0x7fd00c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:28.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd00bfff640 1 -- 172.21.15.45:0/3704388792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00c19d450 con 0x7fd00c10c110 2024-09-15T22:26:28.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd00bfff640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd00c10c110 0x7fd00c19cd20 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd00400eaa0 tx=0x7fd00400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:28.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd008ff9640 1 -- 172.21.15.45:0/3704388792 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00400cdb0 con 0x7fd00c10c110 2024-09-15T22:26:28.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd012053640 1 -- 172.21.15.45:0/3704388792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd00c19d740 con 0x7fd00c10c110 2024-09-15T22:26:28.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd008ff9640 1 -- 172.21.15.45:0/3704388792 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd004004b20 con 0x7fd00c10c110 2024-09-15T22:26:28.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd008ff9640 1 -- 172.21.15.45:0/3704388792 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd004011760 con 0x7fd00c10c110 2024-09-15T22:26:28.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.899+0000 7fd012053640 1 -- 172.21.15.45:0/3704388792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd00c1a4fd0 con 0x7fd00c10c110 2024-09-15T22:26:28.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.901+0000 7fd012053640 1 -- 172.21.15.45:0/3704388792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd00c1030a0 con 0x7fd00c10c110 2024-09-15T22:26:28.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.901+0000 7fd008ff9640 1 -- 172.21.15.45:0/3704388792 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd004011900 con 0x7fd00c10c110 2024-09-15T22:26:28.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.903+0000 7fd008ff9640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcff80a3460 0x7fcff80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:28.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.903+0000 7fd00b7fe640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcff80a3460 0x7fcff80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:28.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.903+0000 7fd008ff9640 1 -- 172.21.15.45:0/3704388792 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7fd0040d0280 con 0x7fd00c10c110 2024-09-15T22:26:28.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.903+0000 7fd00b7fe640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcff80a3460 0x7fcff80a5920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcffc005d00 tx=0x7fcffc00b410 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:28.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:28.907+0000 7fd008ff9640 1 -- 172.21.15.45:0/3704388792 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd004016030 con 0x7fd00c10c110 2024-09-15T22:26:29.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.103+0000 7fd012053640 1 -- 172.21.15.45:0/3704388792 --> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fd00c0fe9d0 con 0x7fcff80a3460 2024-09-15T22:26:29.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.110+0000 7fd008ff9640 1 -- 172.21.15.45:0/3704388792 <== mgr.15165 v2:172.21.15.45:6800/553298159 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fd00c0fe9d0 con 0x7fcff80a3460 2024-09-15T22:26:29.112 INFO:teuthology.orchestra.run.smithi045.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-15T00:00:00", "created": "2024-09-15T22:16:27", "first": "2024-09-15T22:17:00", "last": "2024-09-15T22:26:00", "last_pruned": "2024-09-15T22:26:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-15T22:26:29.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.112+0000 7fd012053640 1 -- 172.21.15.45:0/3704388792 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcff80a3460 msgr2=0x7fcff80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:29.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.112+0000 7fd012053640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcff80a3460 0x7fcff80a5920 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fcffc005d00 tx=0x7fcffc00b410 comp rx=0 tx=0).stop 2024-09-15T22:26:29.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.112+0000 7fd012053640 1 -- 172.21.15.45:0/3704388792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd00c10c110 msgr2=0x7fd00c19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:29.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.112+0000 7fd012053640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd00c10c110 0x7fd00c19cd20 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fd00400eaa0 tx=0x7fd00400ef60 comp rx=0 tx=0).stop 2024-09-15T22:26:29.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.112+0000 7fd012053640 1 -- 172.21.15.45:0/3704388792 shutdown_connections 2024-09-15T22:26:29.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.112+0000 7fd012053640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fcff80a3460 0x7fcff80a5920 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.112+0000 7fd012053640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd00c10c110 0x7fd00c19cd20 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.112+0000 7fd012053640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fd00c1035e0 0x7fd00c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.112+0000 7fd012053640 1 --2- 172.21.15.45:0/3704388792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd00c102cc0 0x7fd00c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.112+0000 7fd012053640 1 -- 172.21.15.45:0/3704388792 >> 172.21.15.45:0/3704388792 conn(0x7fd00c0fc6b0 msgr2=0x7fd00c0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:29.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.112+0000 7fd012053640 1 -- 172.21.15.45:0/3704388792 shutdown_connections 2024-09-15T22:26:29.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.112+0000 7fd012053640 1 -- 172.21.15.45:0/3704388792 wait complete. 2024-09-15T22:26:29.124 DEBUG:teuthology.orchestra.run.smithi045:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-15T22:26:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.228+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/4062242953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f3810c0d0 msgr2=0x7f9f3810e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.228+0000 7f9f3ebbe640 1 --2- 172.21.15.45:0/4062242953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f3810c0d0 0x7f9f3810e550 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009ca0 tx=0x7f9f3002a950 comp rx=0 tx=0).stop 2024-09-15T22:26:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.228+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/4062242953 shutdown_connections 2024-09-15T22:26:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.228+0000 7f9f3ebbe640 1 --2- 172.21.15.45:0/4062242953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f3810c0d0 0x7f9f3810e550 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.228+0000 7f9f3ebbe640 1 --2- 172.21.15.45:0/4062242953 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f381035a0 0x7f9f3810ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.228+0000 7f9f3ebbe640 1 --2- 172.21.15.45:0/4062242953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f38102c80 0x7f9f38103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.228+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/4062242953 >> 172.21.15.45:0/4062242953 conn(0x7f9f38077990 msgr2=0x7f9f380fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.228+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/4062242953 shutdown_connections 2024-09-15T22:26:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.228+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/4062242953 wait complete. 2024-09-15T22:26:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f3ebbe640 1 Processor -- start 2024-09-15T22:26:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f3ebbe640 1 -- start start 2024-09-15T22:26:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f3ebbe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f38102c80 0x7f9f381983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f3ebbe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f381035a0 0x7f9f38198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f3ebbe640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f3810c0d0 0x7f9f3819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f3ebbe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9f38111fb0 con 0x7f9f381035a0 2024-09-15T22:26:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f3ebbe640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9f38111e30 con 0x7f9f38102c80 2024-09-15T22:26:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f3ebbe640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f9f38112130 con 0x7f9f3810c0d0 2024-09-15T22:26:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f37fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f381035a0 0x7f9f38198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f37fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f381035a0 0x7f9f38198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41684/0 (socket says 172.21.15.45:41684) 2024-09-15T22:26:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f37fff640 1 -- 172.21.15.45:0/2772885963 learned_addr learned my addr 172.21.15.45:0/2772885963 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f3d15b640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f3810c0d0 0x7f9f3819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f3c95a640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f38102c80 0x7f9f381983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f37fff640 1 -- 172.21.15.45:0/2772885963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f3810c0d0 msgr2=0x7f9f3819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f37fff640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f3810c0d0 0x7f9f3819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f37fff640 1 -- 172.21.15.45:0/2772885963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f38102c80 msgr2=0x7f9f381983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f37fff640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f38102c80 0x7f9f381983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.229+0000 7f9f37fff640 1 -- 172.21.15.45:0/2772885963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3819d3d0 con 0x7f9f381035a0 2024-09-15T22:26:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.230+0000 7f9f37fff640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f381035a0 0x7f9f38198920 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400e9f0 tx=0x7f9f2400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.230+0000 7f9f35ffb640 1 -- 172.21.15.45:0/2772885963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2400ccc0 con 0x7f9f381035a0 2024-09-15T22:26:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.230+0000 7f9f35ffb640 1 -- 172.21.15.45:0/2772885963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f24010930 con 0x7f9f381035a0 2024-09-15T22:26:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.230+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/2772885963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3819d6c0 con 0x7f9f381035a0 2024-09-15T22:26:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.230+0000 7f9f35ffb640 1 -- 172.21.15.45:0/2772885963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f24018980 con 0x7f9f381035a0 2024-09-15T22:26:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.230+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/2772885963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f381a4f50 con 0x7f9f381035a0 2024-09-15T22:26:29.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.231+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/2772885963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f38103060 con 0x7f9f381035a0 2024-09-15T22:26:29.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.232+0000 7f9f35ffb640 1 -- 172.21.15.45:0/2772885963 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9f24010ae0 con 0x7f9f381035a0 2024-09-15T22:26:29.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.234+0000 7f9f35ffb640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9f280a34e0 0x7f9f280a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:29.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.234+0000 7f9f3c95a640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9f280a34e0 0x7f9f280a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:29.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.234+0000 7f9f35ffb640 1 -- 172.21.15.45:0/2772885963 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7f9f240d0760 con 0x7f9f381035a0 2024-09-15T22:26:29.237 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.234+0000 7f9f3c95a640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9f280a34e0 0x7f9f280a59a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00bbe0 tx=0x7f9f2c00b390 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.237+0000 7f9f35ffb640 1 -- 172.21.15.45:0/2772885963 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9f2409c6a0 con 0x7f9f381035a0 2024-09-15T22:26:29.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.439+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/2772885963 --> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f9f380fedd0 con 0x7f9f280a34e0 2024-09-15T22:26:29.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.446+0000 7f9f35ffb640 1 -- 172.21.15.45:0/2772885963 <== mgr.15165 v2:172.21.15.45:6800/553298159 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f9f380fedd0 con 0x7f9f280a34e0 2024-09-15T22:26:29.448 INFO:teuthology.orchestra.run.smithi045.stdout:/ 1m 6m3h 2024-09-15T22:26:29.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.449+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/2772885963 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9f280a34e0 msgr2=0x7f9f280a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:29.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.449+0000 7f9f3ebbe640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9f280a34e0 0x7f9f280a59a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00bbe0 tx=0x7f9f2c00b390 comp rx=0 tx=0).stop 2024-09-15T22:26:29.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.449+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/2772885963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f381035a0 msgr2=0x7f9f38198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:29.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.449+0000 7f9f3ebbe640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f381035a0 0x7f9f38198920 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400e9f0 tx=0x7f9f2400eeb0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.449+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/2772885963 shutdown_connections 2024-09-15T22:26:29.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.449+0000 7f9f3ebbe640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f9f280a34e0 0x7f9f280a59a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.449+0000 7f9f3ebbe640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f9f3810c0d0 0x7f9f3819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.449+0000 7f9f3ebbe640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f381035a0 0x7f9f38198920 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.449+0000 7f9f3ebbe640 1 --2- 172.21.15.45:0/2772885963 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f38102c80 0x7f9f381983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:29.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.449+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/2772885963 >> 172.21.15.45:0/2772885963 conn(0x7f9f38077990 msgr2=0x7f9f380fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:29.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.449+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/2772885963 shutdown_connections 2024-09-15T22:26:29.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:29.449+0000 7f9f3ebbe640 1 -- 172.21.15.45:0/2772885963 wait complete. 2024-09-15T22:26:29.460 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:29 smithi045 ceph-mon[31180]: pgmap v318: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:29.461 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-15T22:26:29.473 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-15T22:26:29.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:29 smithi165 ceph-mon[35551]: pgmap v318: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:29.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:29 smithi100 ceph-mon[35319]: pgmap v318: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:30.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:30 smithi165 ceph-mon[35551]: from='client.17019 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:30.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:30 smithi165 ceph-mon[35551]: from='client.17025 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:30.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:30 smithi100 ceph-mon[35319]: from='client.17019 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:30.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:30 smithi100 ceph-mon[35319]: from='client.17025 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:30.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:30 smithi045 ceph-mon[31180]: from='client.17019 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:30.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:30 smithi045 ceph-mon[31180]: from='client.17025 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T22:26:31.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:31 smithi165 ceph-mon[35551]: pgmap v319: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:26:31.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:31 smithi100 ceph-mon[35319]: pgmap v319: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:26:31.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:31 smithi045 ceph-mon[31180]: pgmap v319: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:26:33.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:33 smithi165 ceph-mon[35551]: pgmap v320: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:33.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:33 smithi100 ceph-mon[35319]: pgmap v320: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:33.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:33 smithi045 ceph-mon[31180]: pgmap v320: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:34.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:34 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:34.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:34 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:34.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:34 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T22:26:35.087 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T22:26:35.380 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:26:35.501 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: pgmap v321: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:35.501 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.502 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.503 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.503 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.503 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.503 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.503 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:35.503 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:35.503 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:35 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: pgmap v321: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:35.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:35.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:35.716 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:35 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: pgmap v321: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:35.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T22:26:35.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T22:26:35.746 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:35 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' 2024-09-15T22:26:35.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.873+0000 7f709e7e0640 1 -- 172.21.15.45:0/722514160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7098102570 msgr2=0x7f70981029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.873+0000 7f709e7e0640 1 --2- 172.21.15.45:0/722514160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7098102570 0x7f70981029b0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f7080009900 tx=0x7f708002a480 comp rx=0 tx=0).stop 2024-09-15T22:26:35.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.873+0000 7f709e7e0640 1 -- 172.21.15.45:0/722514160 shutdown_connections 2024-09-15T22:26:35.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.873+0000 7f709e7e0640 1 --2- 172.21.15.45:0/722514160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7098102ef0 0x7f709810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.873+0000 7f709e7e0640 1 --2- 172.21.15.45:0/722514160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7098102570 0x7f70981029b0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.873+0000 7f709e7e0640 1 --2- 172.21.15.45:0/722514160 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7098100e20 0x7f7098101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.873+0000 7f709e7e0640 1 -- 172.21.15.45:0/722514160 >> 172.21.15.45:0/722514160 conn(0x7f70980fc7d0 msgr2=0x7f70980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:35.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.873+0000 7f709e7e0640 1 -- 172.21.15.45:0/722514160 shutdown_connections 2024-09-15T22:26:35.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.873+0000 7f709e7e0640 1 -- 172.21.15.45:0/722514160 wait complete. 2024-09-15T22:26:35.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.874+0000 7f709e7e0640 1 Processor -- start 2024-09-15T22:26:35.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.874+0000 7f709e7e0640 1 -- start start 2024-09-15T22:26:35.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.874+0000 7f709e7e0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7098100e20 0x7f7098198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.874+0000 7f709e7e0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7098102570 0x7f7098198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.874+0000 7f709e7e0640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7098102ef0 0x7f709819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.874+0000 7f709e7e0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f70981110e0 con 0x7f7098100e20 2024-09-15T22:26:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.874+0000 7f709e7e0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7098110f60 con 0x7f7098102570 2024-09-15T22:26:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.874+0000 7f709e7e0640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f7098111260 con 0x7f7098102ef0 2024-09-15T22:26:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.874+0000 7f7097fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7098100e20 0x7f7098198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.874+0000 7f7097fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7098100e20 0x7f7098198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37188/0 (socket says 172.21.15.45:37188) 2024-09-15T22:26:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.874+0000 7f7097fff640 1 -- 172.21.15.45:0/2316703818 learned_addr learned my addr 172.21.15.45:0/2316703818 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f708ffff640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7098102570 0x7f7098198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f709cd7d640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7098102ef0 0x7f709819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f7097fff640 1 -- 172.21.15.45:0/2316703818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7098102ef0 msgr2=0x7f709819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f7097fff640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7098102ef0 0x7f709819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f7097fff640 1 -- 172.21.15.45:0/2316703818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7098102570 msgr2=0x7f7098198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f7097fff640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7098102570 0x7f7098198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f7097fff640 1 -- 172.21.15.45:0/2316703818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709819d620 con 0x7f7098100e20 2024-09-15T22:26:35.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f708ffff640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7098102570 0x7f7098198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:26:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f709cd7d640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7098102ef0 0x7f709819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:26:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f7097fff640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7098100e20 0x7f7098198670 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f708800b4a0 tx=0x7f708800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f7095ffb640 1 -- 172.21.15.45:0/2316703818 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088014070 con 0x7f7098100e20 2024-09-15T22:26:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f7095ffb640 1 -- 172.21.15.45:0/2316703818 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7088010b10 con 0x7f7098100e20 2024-09-15T22:26:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f709e7e0640 1 -- 172.21.15.45:0/2316703818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709819d910 con 0x7f7098100e20 2024-09-15T22:26:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f7095ffb640 1 -- 172.21.15.45:0/2316703818 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088017d60 con 0x7f7098100e20 2024-09-15T22:26:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.875+0000 7f709e7e0640 1 -- 172.21.15.45:0/2316703818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70981a51f0 con 0x7f7098100e20 2024-09-15T22:26:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.877+0000 7f7095ffb640 1 -- 172.21.15.45:0/2316703818 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7088017070 con 0x7f7098100e20 2024-09-15T22:26:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.877+0000 7f70a0bb9740 1 Processor -- start 2024-09-15T22:26:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f70a0bb9740 1 -- start start 2024-09-15T22:26:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f70a0bb9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953a8380 0x5633953a8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f70a0bb9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953b7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f70a0bb9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953b7a90 0x5633953b9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f70a0bb9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56339530e2e0 con 0x5633953a8ca0 2024-09-15T22:26:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f70a0bb9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5633952b5ce0 con 0x5633953b7a90 2024-09-15T22:26:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f70a0bb9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x56339530a2a0 con 0x5633953a8380 2024-09-15T22:26:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f7097fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f7097fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953b7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37194/0 (socket says 172.21.15.45:37194) 2024-09-15T22:26:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f7097fff640 1 -- 172.21.15.45:0/1385878630 learned_addr learned my addr 172.21.15.45:0/1385878630 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f709cd7d640 1 --2- 172.21.15.45:0/1385878630 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953a8380 0x5633953a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f7095ffb640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f70840a33b0 0x7f70840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f708ffff640 1 --2- 172.21.15.45:0/1385878630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953b7a90 0x5633953b9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f709cd7d640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f70840a33b0 0x7f70840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.878+0000 7f7095ffb640 1 -- 172.21.15.45:0/2316703818 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7f70880cf4b0 con 0x7f7098100e20 2024-09-15T22:26:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.879+0000 7f7097fff640 1 -- 172.21.15.45:0/1385878630 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953a8380 msgr2=0x5633953a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.879+0000 7f7097fff640 1 --2- 172.21.15.45:0/1385878630 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953a8380 0x5633953a8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.879+0000 7f7097fff640 1 -- 172.21.15.45:0/1385878630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953b7a90 msgr2=0x5633953b9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.879+0000 7f7097fff640 1 --2- 172.21.15.45:0/1385878630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953b7a90 0x5633953b9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.879+0000 7f7097fff640 1 -- 172.21.15.45:0/1385878630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56339529a440 con 0x5633953a8ca0 2024-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.879+0000 7f708ffff640 1 --2- 172.21.15.45:0/1385878630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953b7a90 0x5633953b9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.879+0000 7f7097fff640 1 --2- 172.21.15.45:0/1385878630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953b7550 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f7088097e20 tx=0x7f7088000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36d2b503abc829a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.879+0000 7f709cd7d640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f70840a33b0 0x7f70840a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7090005fd0 tx=0x7f7090004ab0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.879+0000 7f708e7fc640 1 -- 172.21.15.45:0/1385878630 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708801e070 con 0x5633953a8ca0 2024-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.879+0000 7f708e7fc640 1 -- 172.21.15.45:0/1385878630 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f708809bb50 con 0x5633953a8ca0 2024-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.879+0000 7f708e7fc640 1 -- 172.21.15.45:0/1385878630 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708809b450 con 0x5633953a8ca0 2024-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.880+0000 7f70a0bb9740 1 -- 172.21.15.45:0/1385878630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 msgr2=0x5633953b7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.880+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/1385878630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953b7550 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f7088097e20 tx=0x7f7088000bc0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.880+0000 7f70a0bb9740 1 -- 172.21.15.45:0/1385878630 shutdown_connections 2024-09-15T22:26:35.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.880+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/1385878630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953b7a90 0x5633953b9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.880+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/1385878630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953b7550 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.880+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/1385878630 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953a8380 0x5633953a8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.880+0000 7f70a0bb9740 1 -- 172.21.15.45:0/1385878630 >> 172.21.15.45:0/1385878630 conn(0x5633953a4a30 msgr2=0x5633953a4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.880+0000 7f70a0bb9740 1 -- 172.21.15.45:0/1385878630 shutdown_connections 2024-09-15T22:26:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.880+0000 7f70a0bb9740 1 -- 172.21.15.45:0/1385878630 wait complete. 2024-09-15T22:26:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.880+0000 7f70a0bb9740 1 -- start start 2024-09-15T22:26:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.880+0000 7f70a0bb9740 1 Processor -- start 2024-09-15T22:26:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70a0bb9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8380 0x5633953b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70a0bb9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953a8ca0 0x5633953b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70a0bb9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953b7a90 0x5633953b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70a0bb9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5633953ba660 con 0x5633953a8380 2024-09-15T22:26:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70a0bb9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5633952c9050 con 0x5633953a8ca0 2024-09-15T22:26:35.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70a0bb9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x5633953ba7e0 con 0x5633953b7a90 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70a0bb9740 10 client.0 _ll_register_callbacks cb 0x563395309160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f7097fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8380 0x5633953b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f7097fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8380 0x5633953b73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37210/0 (socket says 172.21.15.45:37210) 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f7097fff640 1 -- 172.21.15.45:0/929221981 learned_addr learned my addr 172.21.15.45:0/929221981 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f708ffff640 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953a8ca0 0x5633953b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f709cd7d640 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953b7a90 0x5633953b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f7097fff640 1 -- 172.21.15.45:0/929221981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953b7a90 msgr2=0x5633953b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f7097fff640 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953b7a90 0x5633953b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f7097fff640 1 -- 172.21.15.45:0/929221981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953a8ca0 msgr2=0x5633953b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f7097fff640 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953a8ca0 0x5633953b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f7097fff640 1 -- 172.21.15.45:0/929221981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56339507f3c0 con 0x5633953a8380 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f709cd7d640 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953b7a90 0x5633953b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f7097fff640 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8380 0x5633953b73f0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f7088099700 tx=0x7f70880177c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58201db1e87e19b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:35.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70777fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:26:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70777fe640 1 -- 172.21.15.45:0/929221981 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708801e050 con 0x5633953a8380 2024-09-15T22:26:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70777fe640 1 -- 172.21.15.45:0/929221981 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7f70880cf170 con 0x5633953a8380 2024-09-15T22:26:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70a0bb9740 1 -- 172.21.15.45:0/929221981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f708809bb50 con 0x5633953a8380 2024-09-15T22:26:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70777fe640 1 -- 172.21.15.45:0/929221981 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f708809adb0 con 0x5633953a8380 2024-09-15T22:26:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70a0bb9740 10 client.17037 fetch_fsmap learned FSMap version 21 2024-09-15T22:26:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.881+0000 7f70a0bb9740 1 -- 172.21.15.45:0/929221981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5633953c60b0 con 0x5633953a8380 2024-09-15T22:26:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.882+0000 7f70777fe640 1 -- 172.21.15.45:0/929221981 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f708809bb50 con 0x5633953a8380 2024-09-15T22:26:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.882+0000 7f70777fe640 1 -- 172.21.15.45:0/929221981 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f70880b4140 con 0x5633953a8380 2024-09-15T22:26:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.882+0000 7f70a0bb9740 10 client.17037 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:26:35.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.882+0000 7f70a0bb9740 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:26:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.882+0000 7f70a0bb9740 20 client.17037 populate_metadata read hostname 'smithi045' 2024-09-15T22:26:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.882+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5633953c7400 0x5633953c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.882+0000 7f70a0bb9740 4 client.17037 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:26:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.882+0000 7f70a0bb9740 1 -- 172.21.15.45:0/929221981 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56339531b850 con 0x5633953c7400 2024-09-15T22:26:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.882+0000 7f708ffff640 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5633953c7400 0x5633953c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.882+0000 7f70777fe640 10 client.17037 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.882+0000 7f708ffff640 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5633953c7400 0x5633953c97f0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f78e120c42516d2e server_cookie=1b31797fad79fc8c in_seq=0 out_seq=0 2024-09-15T22:26:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70777fe640 1 -- 172.21.15.45:0/929221981 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56339531b850 con 0x5633953c7400 2024-09-15T22:26:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70777fe640 10 client.17037 handle_command_reply: tid=0 2024-09-15T22:26:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70a0bb9740 1 client.17037 shutdown 2024-09-15T22:26:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70a0bb9740 1 -- 172.21.15.45:0/929221981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8380 msgr2=0x5633953b73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8380 0x5633953b73f0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f7088099700 tx=0x7f70880177c0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70a0bb9740 1 -- 172.21.15.45:0/929221981 shutdown_connections 2024-09-15T22:26:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x5633953c7400 0x5633953c97f0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953b7a90 0x5633953b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953a8ca0 0x5633953b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70777fe640 0 client.17037 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/929221981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8380 0x5633953b73f0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70a0bb9740 1 -- 172.21.15.45:0/929221981 >> 172.21.15.45:0/929221981 conn(0x5633953a4a30 msgr2=0x5633953aa790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70a0bb9740 1 -- 172.21.15.45:0/929221981 shutdown_connections 2024-09-15T22:26:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.883+0000 7f70a0bb9740 1 -- 172.21.15.45:0/929221981 wait complete. 2024-09-15T22:26:35.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.884+0000 7f70a0bb9740 20 client.17037 trim_cache size 0 max 16384 2024-09-15T22:26:35.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.901+0000 7f70a0bb9740 1 Processor -- start 2024-09-15T22:26:35.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.901+0000 7f70a0bb9740 1 -- start start 2024-09-15T22:26:35.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.901+0000 7f70a0bb9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953a8380 0x5633953b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f70a0bb9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f70a0bb9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953b7a90 0x5633953cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f70a0bb9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f70981ab190 con 0x5633953a8ca0 2024-09-15T22:26:35.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f70a0bb9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f70981ada10 con 0x5633953b7a90 2024-09-15T22:26:35.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f70a0bb9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f70981ab800 con 0x5633953a8380 2024-09-15T22:26:35.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f708ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f708ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953aa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37222/0 (socket says 172.21.15.45:37222) 2024-09-15T22:26:35.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f708ffff640 1 -- 172.21.15.45:0/647019383 learned_addr learned my addr 172.21.15.45:0/647019383 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:35.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f7097fff640 1 --2- 172.21.15.45:0/647019383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953a8380 0x5633953b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f709cd7d640 1 --2- 172.21.15.45:0/647019383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953b7a90 0x5633953cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f708ffff640 1 -- 172.21.15.45:0/647019383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953a8380 msgr2=0x5633953b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f708ffff640 1 --2- 172.21.15.45:0/647019383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953a8380 0x5633953b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f708ffff640 1 -- 172.21.15.45:0/647019383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953b7a90 msgr2=0x5633953cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f708ffff640 1 --2- 172.21.15.45:0/647019383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953b7a90 0x5633953cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f708ffff640 1 -- 172.21.15.45:0/647019383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633953a8a90 con 0x5633953a8ca0 2024-09-15T22:26:35.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f708ffff640 1 --2- 172.21.15.45:0/647019383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953aa6b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f7080032db0 tx=0x7f7080009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d01c7cc8bc2287d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:35.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f708dffb640 1 -- 172.21.15.45:0/647019383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080047020 con 0x5633953a8ca0 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f708dffb640 1 -- 172.21.15.45:0/647019383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f70800328c0 con 0x5633953a8ca0 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.902+0000 7f708dffb640 1 -- 172.21.15.45:0/647019383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080035040 con 0x5633953a8ca0 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.903+0000 7f70a0bb9740 1 -- 172.21.15.45:0/647019383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 msgr2=0x5633953aa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.903+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/647019383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953aa6b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f7080032db0 tx=0x7f7080009560 comp rx=0 tx=0).stop 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.903+0000 7f70a0bb9740 1 -- 172.21.15.45:0/647019383 shutdown_connections 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.903+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/647019383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953b7a90 0x5633953cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.903+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/647019383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953aa6b0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.903+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/647019383 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953a8380 0x5633953b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.903+0000 7f70a0bb9740 1 -- 172.21.15.45:0/647019383 >> 172.21.15.45:0/647019383 conn(0x5633953a4a30 msgr2=0x5633953afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.903+0000 7f70a0bb9740 1 -- 172.21.15.45:0/647019383 shutdown_connections 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.903+0000 7f70a0bb9740 1 -- 172.21.15.45:0/647019383 wait complete. 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f70a0bb9740 1 -- start start 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f70a0bb9740 1 Processor -- start 2024-09-15T22:26:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f70a0bb9740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953a8380 0x5633953cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f70a0bb9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953ca370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f70a0bb9740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953b7a90 0x5633953ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f70a0bb9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f70981abed0 con 0x5633953a8ca0 2024-09-15T22:26:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f70a0bb9740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f70981ad340 con 0x5633953a8380 2024-09-15T22:26:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f70a0bb9740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f70981ac5a0 con 0x5633953b7a90 2024-09-15T22:26:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f70a0bb9740 10 client.0 _ll_register_callbacks cb 0x7f7090008650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f708ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f708ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37228/0 (socket says 172.21.15.45:37228) 2024-09-15T22:26:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f708ffff640 1 -- 172.21.15.45:0/2806894623 learned_addr learned my addr 172.21.15.45:0/2806894623 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f7097fff640 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953a8380 0x5633953cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.904+0000 7f709cd7d640 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953b7a90 0x5633953ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f708ffff640 1 -- 172.21.15.45:0/2806894623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953b7a90 msgr2=0x5633953ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f708ffff640 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953b7a90 0x5633953ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f708ffff640 1 -- 172.21.15.45:0/2806894623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953a8380 msgr2=0x5633953cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f708ffff640 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953a8380 0x5633953cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f708ffff640 1 -- 172.21.15.45:0/2806894623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633953cb120 con 0x5633953a8ca0 2024-09-15T22:26:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f7097fff640 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953a8380 0x5633953cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f708ffff640 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953ca370 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7080005ab0 tx=0x7f70800055b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c508538fb72df093 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f70777fe640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:26:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f70777fe640 1 -- 172.21.15.45:0/2806894623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080050070 con 0x5633953a8ca0 2024-09-15T22:26:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f70777fe640 1 -- 172.21.15.45:0/2806894623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7f7080004040 con 0x5633953a8ca0 2024-09-15T22:26:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f70a0bb9740 1 -- 172.21.15.45:0/2806894623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70800328c0 con 0x5633953a8ca0 2024-09-15T22:26:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f70777fe640 1 -- 172.21.15.45:0/2806894623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f708005c050 con 0x5633953a8ca0 2024-09-15T22:26:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f70a0bb9740 10 client.17043 fetch_fsmap learned FSMap version 21 2024-09-15T22:26:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f70a0bb9740 1 -- 172.21.15.45:0/2806894623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563395431df0 con 0x5633953a8ca0 2024-09-15T22:26:35.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.905+0000 7f70777fe640 1 -- 172.21.15.45:0/2806894623 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f70800328c0 con 0x5633953a8ca0 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.906+0000 7f70777fe640 1 -- 172.21.15.45:0/2806894623 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7080055440 con 0x5633953a8ca0 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.906+0000 7f70a0bb9740 10 client.17043 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.906+0000 7f70a0bb9740 10 client.17043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.906+0000 7f70a0bb9740 20 client.17043 populate_metadata read hostname 'smithi045' 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.906+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563395432510 0x563395434930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.906+0000 7f70a0bb9740 4 client.17043 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.906+0000 7f70a0bb9740 1 -- 172.21.15.45:0/2806894623 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563395315d60 con 0x563395432510 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.906+0000 7f7097fff640 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563395432510 0x563395434930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.906+0000 7f7097fff640 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563395432510 0x563395434930 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1801a5f9c89e57d server_cookie=e9f9f47a0a5edb67 in_seq=0 out_seq=0 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.906+0000 7f70777fe640 10 client.17043 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70777fe640 1 -- 172.21.15.45:0/2806894623 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563395315d60 con 0x563395432510 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70777fe640 10 client.17043 handle_command_reply: tid=0 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70a0bb9740 1 client.17043 shutdown 2024-09-15T22:26:35.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70a0bb9740 1 -- 172.21.15.45:0/2806894623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 msgr2=0x5633953ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953ca370 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7080005ab0 tx=0x7f70800055b0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70a0bb9740 1 -- 172.21.15.45:0/2806894623 shutdown_connections 2024-09-15T22:26:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x563395432510 0x563395434930 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x5633953b7a90 0x5633953ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5633953a8ca0 0x5633953ca370 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70777fe640 0 client.17043 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70a0bb9740 1 --2- 172.21.15.45:0/2806894623 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5633953a8380 0x5633953cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70a0bb9740 1 -- 172.21.15.45:0/2806894623 >> 172.21.15.45:0/2806894623 conn(0x5633953a4a30 msgr2=0x5633953a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70a0bb9740 1 -- 172.21.15.45:0/2806894623 shutdown_connections 2024-09-15T22:26:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70a0bb9740 1 -- 172.21.15.45:0/2806894623 wait complete. 2024-09-15T22:26:35.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.907+0000 7f70a0bb9740 20 client.17043 trim_cache size 0 max 16384 2024-09-15T22:26:35.919 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:26:35.919 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2024-09-15T22:26:35.919 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2024-09-15T22:26:35.919 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:26:35.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.908+0000 7f709e7e0640 1 -- 172.21.15.45:0/2316703818 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f70840a33b0 msgr2=0x7f70840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.908+0000 7f709e7e0640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f70840a33b0 0x7f70840a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7090005fd0 tx=0x7f7090004ab0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.908+0000 7f709e7e0640 1 -- 172.21.15.45:0/2316703818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7098100e20 msgr2=0x7f7098198670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:35.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.908+0000 7f709e7e0640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7098100e20 0x7f7098198670 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f708800b4a0 tx=0x7f708800b960 comp rx=0 tx=0).stop 2024-09-15T22:26:35.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.908+0000 7f709e7e0640 1 -- 172.21.15.45:0/2316703818 shutdown_connections 2024-09-15T22:26:35.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.908+0000 7f709e7e0640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f70840a33b0 0x7f70840a5870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.908+0000 7f709e7e0640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f7098102ef0 0x7f709819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.908+0000 7f709e7e0640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7098102570 0x7f7098198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.908+0000 7f709e7e0640 1 --2- 172.21.15.45:0/2316703818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7098100e20 0x7f7098198670 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:35.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.908+0000 7f709e7e0640 1 -- 172.21.15.45:0/2316703818 >> 172.21.15.45:0/2316703818 conn(0x7f70980fc7d0 msgr2=0x7f709806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:35.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.908+0000 7f709e7e0640 1 -- 172.21.15.45:0/2316703818 shutdown_connections 2024-09-15T22:26:35.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:35.908+0000 7f709e7e0640 1 -- 172.21.15.45:0/2316703818 wait complete. 2024-09-15T22:26:36.702 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:36 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi165 to 176.0M 2024-09-15T22:26:36.702 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:36 smithi045 ceph-mon[31180]: Unable to set osd_memory_target on smithi165 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-15T22:26:36.702 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:36 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-15T22:26:36.703 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:36 smithi045 ceph-mon[31180]: Unable to set osd_memory_target on smithi100 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-15T22:26:36.703 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:36 smithi045 ceph-mon[31180]: Adjusting osd_memory_target on smithi045 to 177.0M 2024-09-15T22:26:36.703 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:36 smithi045 ceph-mon[31180]: Unable to set osd_memory_target on smithi045 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-15T22:26:36.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:36 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi165 to 176.0M 2024-09-15T22:26:36.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:36 smithi165 ceph-mon[35551]: Unable to set osd_memory_target on smithi165 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-15T22:26:36.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:36 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-15T22:26:36.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:36 smithi165 ceph-mon[35551]: Unable to set osd_memory_target on smithi100 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-15T22:26:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:36 smithi165 ceph-mon[35551]: Adjusting osd_memory_target on smithi045 to 177.0M 2024-09-15T22:26:36.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:36 smithi165 ceph-mon[35551]: Unable to set osd_memory_target on smithi045 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-15T22:26:36.734 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T22:26:36.734 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:26:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:36 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi165 to 176.0M 2024-09-15T22:26:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:36 smithi100 ceph-mon[35319]: Unable to set osd_memory_target on smithi165 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-15T22:26:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:36 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi100 to 175.9M 2024-09-15T22:26:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:36 smithi100 ceph-mon[35319]: Unable to set osd_memory_target on smithi100 to 184532275: error parsing value: Value '184532275' is below minimum 939524096 2024-09-15T22:26:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:36 smithi100 ceph-mon[35319]: Adjusting osd_memory_target on smithi045 to 177.0M 2024-09-15T22:26:36.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:36 smithi100 ceph-mon[35319]: Unable to set osd_memory_target on smithi045 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-15T22:26:36.994 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:26:37.409 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:37 smithi045 ceph-mon[31180]: pgmap v322: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.487+0000 7fdc330b6640 1 -- 172.21.15.45:0/2144058436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c10c170 msgr2=0x7fdc2c10e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.487+0000 7fdc330b6640 1 --2- 172.21.15.45:0/2144058436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c10c170 0x7fdc2c10e610 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009ca0 tx=0x7fdc2402a950 comp rx=0 tx=0).stop 2024-09-15T22:26:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.487+0000 7fdc330b6640 1 -- 172.21.15.45:0/2144058436 shutdown_connections 2024-09-15T22:26:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.487+0000 7fdc330b6640 1 --2- 172.21.15.45:0/2144058436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c10c170 0x7fdc2c10e610 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.487+0000 7fdc330b6640 1 --2- 172.21.15.45:0/2144058436 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc2c103660 0x7fdc2c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.487+0000 7fdc330b6640 1 --2- 172.21.15.45:0/2144058436 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc2c102d40 0x7fdc2c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.487+0000 7fdc330b6640 1 -- 172.21.15.45:0/2144058436 >> 172.21.15.45:0/2144058436 conn(0x7fdc2c0fc7a0 msgr2=0x7fdc2c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.487+0000 7fdc330b6640 1 -- 172.21.15.45:0/2144058436 shutdown_connections 2024-09-15T22:26:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.487+0000 7fdc330b6640 1 -- 172.21.15.45:0/2144058436 wait complete. 2024-09-15T22:26:37.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc330b6640 1 Processor -- start 2024-09-15T22:26:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc330b6640 1 -- start start 2024-09-15T22:26:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc330b6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc2c102d40 0x7fdc2c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc330b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c103660 0x7fdc2c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc330b6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc2c10c170 0x7fdc2c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc330b6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c112140 con 0x7fdc2c103660 2024-09-15T22:26:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc330b6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c111fc0 con 0x7fdc2c10c170 2024-09-15T22:26:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc330b6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fdc2c1122c0 con 0x7fdc2c102d40 2024-09-15T22:26:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc2bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c103660 0x7fdc2c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc2bfff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c103660 0x7fdc2c198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37246/0 (socket says 172.21.15.45:37246) 2024-09-15T22:26:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc2bfff640 1 -- 172.21.15.45:0/3780182226 learned_addr learned my addr 172.21.15.45:0/3780182226 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc30e52640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc2c102d40 0x7fdc2c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:37.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc2bfff640 1 -- 172.21.15.45:0/3780182226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc2c102d40 msgr2=0x7fdc2c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc2bfff640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc2c102d40 0x7fdc2c1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc31653640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc2c10c170 0x7fdc2c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc2bfff640 1 -- 172.21.15.45:0/3780182226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc2c10c170 msgr2=0x7fdc2c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc2bfff640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc2c10c170 0x7fdc2c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc2bfff640 1 -- 172.21.15.45:0/3780182226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc2c19d4d0 con 0x7fdc2c103660 2024-09-15T22:26:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc30e52640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc2c102d40 0x7fdc2c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.488+0000 7fdc31653640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc2c10c170 0x7fdc2c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:26:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.489+0000 7fdc2bfff640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c103660 0x7fdc2c198b00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800d740 tx=0x7fdc1800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.489+0000 7fdc29ffb640 1 -- 172.21.15.45:0/3780182226 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18017070 con 0x7fdc2c103660 2024-09-15T22:26:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.489+0000 7fdc29ffb640 1 -- 172.21.15.45:0/3780182226 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdc1800de50 con 0x7fdc2c103660 2024-09-15T22:26:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.489+0000 7fdc330b6640 1 -- 172.21.15.45:0/3780182226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc2c19d7c0 con 0x7fdc2c103660 2024-09-15T22:26:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.489+0000 7fdc29ffb640 1 -- 172.21.15.45:0/3780182226 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1800f620 con 0x7fdc2c103660 2024-09-15T22:26:37.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.489+0000 7fdc330b6640 1 -- 172.21.15.45:0/3780182226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc2c1a50a0 con 0x7fdc2c103660 2024-09-15T22:26:37.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.490+0000 7fdc330b6640 1 -- 172.21.15.45:0/3780182226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2c103120 con 0x7fdc2c103660 2024-09-15T22:26:37.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.491+0000 7fdc29ffb640 1 -- 172.21.15.45:0/3780182226 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fdc18009c30 con 0x7fdc2c103660 2024-09-15T22:26:37.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.492+0000 7fdc29ffb640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fdc1c0a3430 0x7fdc1c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:37.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.492+0000 7fdc30e52640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fdc1c0a3430 0x7fdc1c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:37.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.492+0000 7fdc29ffb640 1 -- 172.21.15.45:0/3780182226 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7fdc180cfe40 con 0x7fdc2c103660 2024-09-15T22:26:37.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.493+0000 7fdc30e52640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fdc1c0a3430 0x7fdc1c0a58f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009930 tx=0x7fdc20008040 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:37.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.497+0000 7fdc29ffb640 1 -- 172.21.15.45:0/3780182226 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdc1809c3d0 con 0x7fdc2c103660 2024-09-15T22:26:37.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.708+0000 7fdc330b6640 1 -- 172.21.15.45:0/3780182226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc2c1a53d0 con 0x7fdc2c103660 2024-09-15T22:26:37.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.709+0000 7fdc29ffb640 1 -- 172.21.15.45:0/3780182226 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fdc1809bcd0 con 0x7fdc2c103660 2024-09-15T22:26:37.712 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:26:37.712 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:26:37.712 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:26:37.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.712+0000 7fdc330b6640 1 -- 172.21.15.45:0/3780182226 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fdc1c0a3430 msgr2=0x7fdc1c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:37.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.712+0000 7fdc330b6640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fdc1c0a3430 0x7fdc1c0a58f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009930 tx=0x7fdc20008040 comp rx=0 tx=0).stop 2024-09-15T22:26:37.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.712+0000 7fdc330b6640 1 -- 172.21.15.45:0/3780182226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c103660 msgr2=0x7fdc2c198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:37.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.712+0000 7fdc330b6640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c103660 0x7fdc2c198b00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800d740 tx=0x7fdc1800dc00 comp rx=0 tx=0).stop 2024-09-15T22:26:37.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.712+0000 7fdc330b6640 1 -- 172.21.15.45:0/3780182226 shutdown_connections 2024-09-15T22:26:37.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.712+0000 7fdc330b6640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fdc1c0a3430 0x7fdc1c0a58f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.712+0000 7fdc330b6640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc2c10c170 0x7fdc2c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.712+0000 7fdc330b6640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc2c103660 0x7fdc2c198b00 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.712+0000 7fdc330b6640 1 --2- 172.21.15.45:0/3780182226 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fdc2c102d40 0x7fdc2c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:37.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.712+0000 7fdc330b6640 1 -- 172.21.15.45:0/3780182226 >> 172.21.15.45:0/3780182226 conn(0x7fdc2c0fc7a0 msgr2=0x7fdc2c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:37.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.712+0000 7fdc330b6640 1 -- 172.21.15.45:0/3780182226 shutdown_connections 2024-09-15T22:26:37.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:37.712+0000 7fdc330b6640 1 -- 172.21.15.45:0/3780182226 wait complete. 2024-09-15T22:26:37.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:37 smithi165 ceph-mon[35551]: pgmap v322: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:37.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:37 smithi100 ceph-mon[35319]: pgmap v322: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:38.362 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:38 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3780182226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:26:38.394 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T22:26:38.652 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:26:38.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:38 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3780182226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:26:38.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:38 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3780182226' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:26:39.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.138+0000 7f6b90f2e640 1 -- 172.21.15.45:0/537397156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8c102570 msgr2=0x7f6b8c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:39.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.138+0000 7f6b90f2e640 1 --2- 172.21.15.45:0/537397156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8c102570 0x7f6b8c1029b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009900 tx=0x7f6b7402a480 comp rx=0 tx=0).stop 2024-09-15T22:26:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.139+0000 7f6b90f2e640 1 -- 172.21.15.45:0/537397156 shutdown_connections 2024-09-15T22:26:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.139+0000 7f6b90f2e640 1 --2- 172.21.15.45:0/537397156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b8c102ef0 0x7f6b8c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.139+0000 7f6b90f2e640 1 --2- 172.21.15.45:0/537397156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8c102570 0x7f6b8c1029b0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.139+0000 7f6b90f2e640 1 --2- 172.21.15.45:0/537397156 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b8c100e20 0x7f6b8c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.139+0000 7f6b90f2e640 1 -- 172.21.15.45:0/537397156 >> 172.21.15.45:0/537397156 conn(0x7f6b8c0fc7d0 msgr2=0x7f6b8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.139+0000 7f6b90f2e640 1 -- 172.21.15.45:0/537397156 shutdown_connections 2024-09-15T22:26:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.139+0000 7f6b90f2e640 1 -- 172.21.15.45:0/537397156 wait complete. 2024-09-15T22:26:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.139+0000 7f6b90f2e640 1 Processor -- start 2024-09-15T22:26:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b90f2e640 1 -- start start 2024-09-15T22:26:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b90f2e640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b8c100e20 0x7f6b8c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b90f2e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b8c102570 0x7f6b8c10ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b90f2e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8c102ef0 0x7f6b8c10ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b90f2e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1121c0 con 0x7f6b8c102ef0 2024-09-15T22:26:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b90f2e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c112040 con 0x7f6b8c102570 2024-09-15T22:26:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b90f2e640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c112340 con 0x7f6b8c100e20 2024-09-15T22:26:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b8ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8c102ef0 0x7f6b8c10ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b8ad9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8c102ef0 0x7f6b8c10ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37260/0 (socket says 172.21.15.45:37260) 2024-09-15T22:26:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b8ad9d640 1 -- 172.21.15.45:0/3429477335 learned_addr learned my addr 172.21.15.45:0/3429477335 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b8a59c640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b8c100e20 0x7f6b8c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b8c102570 0x7f6b8c10ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b8ad9d640 1 -- 172.21.15.45:0/3429477335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b8c100e20 msgr2=0x7f6b8c10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b8ad9d640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b8c100e20 0x7f6b8c10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b8ad9d640 1 -- 172.21.15.45:0/3429477335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b8c102570 msgr2=0x7f6b8c10ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:39.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b8ad9d640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b8c102570 0x7f6b8c10ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.140+0000 7f6b8ad9d640 1 -- 172.21.15.45:0/3429477335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8c1a6ac0 con 0x7f6b8c102ef0 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.141+0000 7f6b8ad9d640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8c102ef0 0x7f6b8c10ef50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009fd0 tx=0x7f6b8400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.141+0000 7f6b83fff640 1 -- 172.21.15.45:0/3429477335 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84017070 con 0x7f6b8c102ef0 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.141+0000 7f6b90f2e640 1 -- 172.21.15.45:0/3429477335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b8c1a6db0 con 0x7f6b8c102ef0 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.141+0000 7f6b83fff640 1 -- 172.21.15.45:0/3429477335 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b84004020 con 0x7f6b8c102ef0 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.141+0000 7f6b83fff640 1 -- 172.21.15.45:0/3429477335 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b840106c0 con 0x7f6b8c102ef0 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.141+0000 7f6b90f2e640 1 -- 172.21.15.45:0/3429477335 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b8c1a7270 con 0x7f6b8c102ef0 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.143+0000 7f6b83fff640 1 -- 172.21.15.45:0/3429477335 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6b84010860 con 0x7f6b8c102ef0 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.143+0000 7f6b93307740 1 Processor -- start 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.143+0000 7f6b93307740 1 -- start start 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b93307740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 0x559f65162090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b93307740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f651625d0 0x559f65162a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b93307740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f6516d370 0x559f6516f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b93307740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559f650c82f0 con 0x559f651625d0 2024-09-15T22:26:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b93307740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559f6506fcf0 con 0x559f6516d370 2024-09-15T22:26:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b93307740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559f650c42b0 con 0x559f65163b40 2024-09-15T22:26:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b8a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f651625d0 0x559f65162a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b8a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f651625d0 0x559f65162a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37270/0 (socket says 172.21.15.45:37270) 2024-09-15T22:26:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b8a59c640 1 -- 172.21.15.45:0/1779630198 learned_addr learned my addr 172.21.15.45:0/1779630198 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/1779630198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f6516d370 0x559f6516f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/1779630198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 0x559f65162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b8a59c640 1 -- 172.21.15.45:0/1779630198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 msgr2=0x559f65162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b8a59c640 1 --2- 172.21.15.45:0/1779630198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 0x559f65162090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b8a59c640 1 -- 172.21.15.45:0/1779630198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f6516d370 msgr2=0x559f6516f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b83fff640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b780a33b0 0x7f6b780a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b8a59c640 1 --2- 172.21.15.45:0/1779630198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f6516d370 0x559f6516f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b8a59c640 1 -- 172.21.15.45:0/1779630198 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f650543a0 con 0x559f651625d0 2024-09-15T22:26:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/1779630198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 0x559f65162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:26:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b8ad9d640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b780a33b0 0x7f6b780a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b8a59c640 1 --2- 172.21.15.45:0/1779630198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f651625d0 0x559f65162a10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00b760 tx=0x7f6b7c00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438e259cc45740a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.144+0000 7f6b83fff640 1 -- 172.21.15.45:0/3429477335 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7f6b840cfe10 con 0x7f6b8c102ef0 2024-09-15T22:26:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.145+0000 7f6b80d99640 1 -- 172.21.15.45:0/1779630198 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c003dd0 con 0x559f651625d0 2024-09-15T22:26:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.145+0000 7f6b80d99640 1 -- 172.21.15.45:0/1779630198 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b7c015070 con 0x559f651625d0 2024-09-15T22:26:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.145+0000 7f6b80d99640 1 -- 172.21.15.45:0/1779630198 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c011440 con 0x559f651625d0 2024-09-15T22:26:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.145+0000 7f6b93307740 1 -- 172.21.15.45:0/1779630198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f651625d0 msgr2=0x559f65162a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.145+0000 7f6b93307740 1 --2- 172.21.15.45:0/1779630198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f651625d0 0x559f65162a10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00b760 tx=0x7f6b7c00bc20 comp rx=0 tx=0).stop 2024-09-15T22:26:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.145+0000 7f6b8ad9d640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b780a33b0 0x7f6b780a5870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6b84098140 tx=0x7f6b84086040 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.145+0000 7f6b93307740 1 -- 172.21.15.45:0/1779630198 shutdown_connections 2024-09-15T22:26:39.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.145+0000 7f6b93307740 1 --2- 172.21.15.45:0/1779630198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f6516d370 0x559f6516f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.145+0000 7f6b93307740 1 --2- 172.21.15.45:0/1779630198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f651625d0 0x559f65162a10 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.145+0000 7f6b93307740 1 --2- 172.21.15.45:0/1779630198 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 0x559f65162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.145+0000 7f6b93307740 1 -- 172.21.15.45:0/1779630198 >> 172.21.15.45:0/1779630198 conn(0x559f6512b310 msgr2=0x559f6515ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.145+0000 7f6b93307740 1 -- 172.21.15.45:0/1779630198 shutdown_connections 2024-09-15T22:26:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.145+0000 7f6b93307740 1 -- 172.21.15.45:0/1779630198 wait complete. 2024-09-15T22:26:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b93307740 1 -- start start 2024-09-15T22:26:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b93307740 1 Processor -- start 2024-09-15T22:26:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b93307740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 0x559f6516cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b93307740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 0x559f65169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b93307740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 0x559f6516a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b93307740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559f65170070 con 0x559f6516d370 2024-09-15T22:26:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b93307740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x559f65083060 con 0x559f651625d0 2024-09-15T22:26:39.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b93307740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x559f651701f0 con 0x559f65163b40 2024-09-15T22:26:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b93307740 10 client.0 _ll_register_callbacks cb 0x559f64dd68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b81d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 0x559f6516a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b81d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 0x559f6516a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37284/0 (socket says 172.21.15.45:37284) 2024-09-15T22:26:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b81d9b640 1 -- 172.21.15.45:0/3894936070 learned_addr learned my addr 172.21.15.45:0/3894936070 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/3894936070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 0x559f6516cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.146+0000 7f6b8a59c640 1 --2- 172.21.15.45:0/3894936070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 0x559f65169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b81d9b640 1 -- 172.21.15.45:0/3894936070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 msgr2=0x559f65169ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/3894936070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 0x559f65169ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b81d9b640 1 -- 172.21.15.45:0/3894936070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 msgr2=0x559f6516cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/3894936070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 0x559f6516cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b81d9b640 1 -- 172.21.15.45:0/3894936070 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f64e393c0 con 0x559f6516d370 2024-09-15T22:26:39.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/3894936070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 0x559f6516a5e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6b74005940 tx=0x7f6b740092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29439db70740e986 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:26:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b71ffb640 1 -- 172.21.15.45:0/3894936070 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74035040 con 0x559f6516d370 2024-09-15T22:26:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b71ffb640 1 -- 172.21.15.45:0/3894936070 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7f6b74004480 con 0x559f6516d370 2024-09-15T22:26:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b93307740 1 -- 172.21.15.45:0/3894936070 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b7c015070 con 0x559f6516d370 2024-09-15T22:26:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b71ffb640 1 -- 172.21.15.45:0/3894936070 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6b74054050 con 0x559f6516d370 2024-09-15T22:26:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b93307740 10 client.17061 fetch_fsmap learned FSMap version 21 2024-09-15T22:26:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b93307740 1 -- 172.21.15.45:0/3894936070 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559f6517ba50 con 0x559f6516d370 2024-09-15T22:26:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.147+0000 7f6b71ffb640 1 -- 172.21.15.45:0/3894936070 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b7c015070 con 0x559f6516d370 2024-09-15T22:26:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.148+0000 7f6b71ffb640 1 -- 172.21.15.45:0/3894936070 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6b7403a040 con 0x559f6516d370 2024-09-15T22:26:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.148+0000 7f6b93307740 10 client.17061 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:26:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.148+0000 7f6b93307740 10 client.17061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:26:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.148+0000 7f6b93307740 20 client.17061 populate_metadata read hostname 'smithi045' 2024-09-15T22:26:39.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.148+0000 7f6b93307740 1 --2- 172.21.15.45:0/3894936070 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559f6517cf10 0x559f6517f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.148+0000 7f6b93307740 4 client.17061 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:26:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.148+0000 7f6b93307740 1 -- 172.21.15.45:0/3894936070 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f650d5860 con 0x559f6517cf10 2024-09-15T22:26:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.148+0000 7f6b8a59c640 1 --2- 172.21.15.45:0/3894936070 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559f6517cf10 0x559f6517f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.148+0000 7f6b8a59c640 1 --2- 172.21.15.45:0/3894936070 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559f6517cf10 0x559f6517f300 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9998132b37c7362b server_cookie=8d15a0bfd98513c3 in_seq=0 out_seq=0 2024-09-15T22:26:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.148+0000 7f6b71ffb640 10 client.17061 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b71ffb640 1 -- 172.21.15.45:0/3894936070 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f650d5860 con 0x559f6517cf10 2024-09-15T22:26:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b71ffb640 10 client.17061 handle_command_reply: tid=0 2024-09-15T22:26:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b93307740 1 client.17061 shutdown 2024-09-15T22:26:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b93307740 1 -- 172.21.15.45:0/3894936070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 msgr2=0x559f6516a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b93307740 1 --2- 172.21.15.45:0/3894936070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 0x559f6516a5e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6b74005940 tx=0x7f6b740092d0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b93307740 1 -- 172.21.15.45:0/3894936070 shutdown_connections 2024-09-15T22:26:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b93307740 1 --2- 172.21.15.45:0/3894936070 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559f6517cf10 0x559f6517f300 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b71ffb640 0 client.17061 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b93307740 1 --2- 172.21.15.45:0/3894936070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 0x559f6516a5e0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b93307740 1 --2- 172.21.15.45:0/3894936070 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 0x559f65169ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b93307740 1 --2- 172.21.15.45:0/3894936070 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 0x559f6516cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b93307740 1 -- 172.21.15.45:0/3894936070 >> 172.21.15.45:0/3894936070 conn(0x559f6512b310 msgr2=0x559f65164960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b93307740 1 -- 172.21.15.45:0/3894936070 shutdown_connections 2024-09-15T22:26:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b93307740 1 -- 172.21.15.45:0/3894936070 wait complete. 2024-09-15T22:26:39.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.149+0000 7f6b93307740 20 client.17061 trim_cache size 0 max 16384 2024-09-15T22:26:39.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.163+0000 7f6b93307740 1 Processor -- start 2024-09-15T22:26:39.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.163+0000 7f6b93307740 1 -- start start 2024-09-15T22:26:39.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.163+0000 7f6b93307740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 0x559f6516bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.163+0000 7f6b93307740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 0x559f65165120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.163+0000 7f6b93307740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 0x559f65165660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.163+0000 7f6b93307740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1af440 con 0x559f6516d370 2024-09-15T22:26:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.163+0000 7f6b93307740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1b1cc0 con 0x559f651625d0 2024-09-15T22:26:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.163+0000 7f6b93307740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1afab0 con 0x559f65163b40 2024-09-15T22:26:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b81d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 0x559f65165660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b81d9b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 0x559f65165660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37290/0 (socket says 172.21.15.45:37290) 2024-09-15T22:26:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b81d9b640 1 -- 172.21.15.45:0/2818807755 learned_addr learned my addr 172.21.15.45:0/2818807755 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/2818807755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 0x559f6516bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b8a59c640 1 --2- 172.21.15.45:0/2818807755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 0x559f65165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b81d9b640 1 -- 172.21.15.45:0/2818807755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 msgr2=0x559f65165120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/2818807755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 0x559f65165120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b81d9b640 1 -- 172.21.15.45:0/2818807755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 msgr2=0x559f6516bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/2818807755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 0x559f6516bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b81d9b640 1 -- 172.21.15.45:0/2818807755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f65168fa0 con 0x559f6516d370 2024-09-15T22:26:39.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/2818807755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 0x559f65165660 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6b74001eb0 tx=0x7f6b74040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7ae7ec403892ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b73fff640 1 -- 172.21.15.45:0/2818807755 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b74035070 con 0x559f6516d370 2024-09-15T22:26:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b73fff640 1 -- 172.21.15.45:0/2818807755 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b74009520 con 0x559f6516d370 2024-09-15T22:26:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.164+0000 7f6b73fff640 1 -- 172.21.15.45:0/2818807755 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7403db20 con 0x559f6516d370 2024-09-15T22:26:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.165+0000 7f6b93307740 1 -- 172.21.15.45:0/2818807755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 msgr2=0x559f65165660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.165+0000 7f6b93307740 1 --2- 172.21.15.45:0/2818807755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 0x559f65165660 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6b74001eb0 tx=0x7f6b74040040 comp rx=0 tx=0).stop 2024-09-15T22:26:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.165+0000 7f6b93307740 1 -- 172.21.15.45:0/2818807755 shutdown_connections 2024-09-15T22:26:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.165+0000 7f6b93307740 1 --2- 172.21.15.45:0/2818807755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f6516d370 0x559f65165660 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.165+0000 7f6b93307740 1 --2- 172.21.15.45:0/2818807755 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f65163b40 0x559f65165120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.165+0000 7f6b93307740 1 --2- 172.21.15.45:0/2818807755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 0x559f6516bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.165+0000 7f6b93307740 1 -- 172.21.15.45:0/2818807755 >> 172.21.15.45:0/2818807755 conn(0x559f6512b310 msgr2=0x559f6516b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.165+0000 7f6b93307740 1 -- 172.21.15.45:0/2818807755 shutdown_connections 2024-09-15T22:26:39.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.165+0000 7f6b93307740 1 -- 172.21.15.45:0/2818807755 wait complete. 2024-09-15T22:26:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.165+0000 7f6b93307740 1 -- start start 2024-09-15T22:26:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.165+0000 7f6b93307740 1 Processor -- start 2024-09-15T22:26:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b93307740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 0x559f65175480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b93307740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f65163b40 0x559f651759c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b93307740 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f6516d370 0x559f65172450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b93307740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1b0180 con 0x559f65163b40 2024-09-15T22:26:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b93307740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1b15f0 con 0x559f651625d0 2024-09-15T22:26:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b93307740 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c1b0850 con 0x559f6516d370 2024-09-15T22:26:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b93307740 10 client.0 _ll_register_callbacks cb 0x7f6b74009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:26:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b8a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f65163b40 0x559f651759c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b8a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f65163b40 0x559f651759c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37296/0 (socket says 172.21.15.45:37296) 2024-09-15T22:26:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b8a59c640 1 -- 172.21.15.45:0/739075351 learned_addr learned my addr 172.21.15.45:0/739075351 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:39.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 0x559f65175480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f6516d370 0x559f65172450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b8a59c640 1 -- 172.21.15.45:0/739075351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f6516d370 msgr2=0x559f65172450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b8a59c640 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f6516d370 0x559f65172450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b8a59c640 1 -- 172.21.15.45:0/739075351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 msgr2=0x559f65175480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:26:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b8a59c640 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 0x559f65175480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b8a59c640 1 -- 172.21.15.45:0/739075351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f6516d0b0 con 0x559f65163b40 2024-09-15T22:26:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f6516d370 0x559f65172450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:26:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b8a59c640 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f65163b40 0x559f651759c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0044d0 tx=0x7f6b7c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e0808b08b01993 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-09-15T22:26:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.166+0000 7f6b71ffb640 1 -- 172.21.15.45:0/739075351 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c003dd0 con 0x559f65163b40 2024-09-15T22:26:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.167+0000 7f6b71ffb640 1 -- 172.21.15.45:0/739075351 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7f6b7c02f440 con 0x559f65163b40 2024-09-15T22:26:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.167+0000 7f6b93307740 1 -- 172.21.15.45:0/739075351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b74009520 con 0x559f65163b40 2024-09-15T22:26:39.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.167+0000 7f6b71ffb640 1 -- 172.21.15.45:0/739075351 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6b7c038050 con 0x559f65163b40 2024-09-15T22:26:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.167+0000 7f6b93307740 10 client.17067 fetch_fsmap learned FSMap version 21 2024-09-15T22:26:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.167+0000 7f6b93307740 1 -- 172.21.15.45:0/739075351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559f651e7e60 con 0x559f65163b40 2024-09-15T22:26:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.167+0000 7f6b71ffb640 1 -- 172.21.15.45:0/739075351 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b74009520 con 0x559f65163b40 2024-09-15T22:26:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.167+0000 7f6b71ffb640 1 -- 172.21.15.45:0/739075351 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6b7c02d020 con 0x559f65163b40 2024-09-15T22:26:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.167+0000 7f6b93307740 10 client.17067 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T22:26:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.167+0000 7f6b93307740 10 client.17067 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-15T22:26:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.167+0000 7f6b93307740 20 client.17067 populate_metadata read hostname 'smithi045' 2024-09-15T22:26:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.167+0000 7f6b93307740 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559f651e8450 0x559f651ea870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.167+0000 7f6b93307740 4 client.17067 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T22:26:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.167+0000 7f6b93307740 1 -- 172.21.15.45:0/739075351 --> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f650cfd70 con 0x559f651e8450 2024-09-15T22:26:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559f651e8450 0x559f651ea870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b71ffb640 10 client.17067 ms_handle_connect on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:39.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b81d9b640 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559f651e8450 0x559f651ea870 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5856e2b6ff228f1c server_cookie=85b3cbb6a7399af1 in_seq=0 out_seq=0 2024-09-15T22:26:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b71ffb640 1 -- 172.21.15.45:0/739075351 <== mds.0 v2:172.21.15.100:6838/1428203088 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f650cfd70 con 0x559f651e8450 2024-09-15T22:26:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b71ffb640 10 client.17067 handle_command_reply: tid=0 2024-09-15T22:26:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b93307740 1 client.17067 shutdown 2024-09-15T22:26:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b93307740 1 -- 172.21.15.45:0/739075351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f65163b40 msgr2=0x559f651759c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b93307740 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f65163b40 0x559f651759c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0044d0 tx=0x7f6b7c0046d0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b93307740 1 -- 172.21.15.45:0/739075351 shutdown_connections 2024-09-15T22:26:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b93307740 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.100:6838/1428203088,v1:172.21.15.100:6839/1428203088] conn(0x559f651e8450 0x559f651ea870 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b93307740 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x559f6516d370 0x559f65172450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b93307740 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559f65163b40 0x559f651759c0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b93307740 1 --2- 172.21.15.45:0/739075351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x559f651625d0 0x559f65175480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b93307740 1 -- 172.21.15.45:0/739075351 >> 172.21.15.45:0/739075351 conn(0x559f6512b310 msgr2=0x559f6516c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b71ffb640 0 client.17067 ms_handle_reset on v2:172.21.15.100:6838/1428203088 2024-09-15T22:26:39.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b93307740 1 -- 172.21.15.45:0/739075351 shutdown_connections 2024-09-15T22:26:39.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.168+0000 7f6b93307740 1 -- 172.21.15.45:0/739075351 wait complete. 2024-09-15T22:26:39.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.169+0000 7f6b93307740 20 client.17067 trim_cache size 0 max 16384 2024-09-15T22:26:39.181 INFO:teuthology.orchestra.run.smithi045.stdout:[] 2024-09-15T22:26:39.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.169+0000 7f6b90f2e640 1 -- 172.21.15.45:0/3429477335 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b780a33b0 msgr2=0x7f6b780a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:39.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.169+0000 7f6b90f2e640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b780a33b0 0x7f6b780a5870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6b84098140 tx=0x7f6b84086040 comp rx=0 tx=0).stop 2024-09-15T22:26:39.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.169+0000 7f6b90f2e640 1 -- 172.21.15.45:0/3429477335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8c102ef0 msgr2=0x7f6b8c10ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:39.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.169+0000 7f6b90f2e640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8c102ef0 0x7f6b8c10ef50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009fd0 tx=0x7f6b8400b260 comp rx=0 tx=0).stop 2024-09-15T22:26:39.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.169+0000 7f6b90f2e640 1 -- 172.21.15.45:0/3429477335 shutdown_connections 2024-09-15T22:26:39.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.169+0000 7f6b90f2e640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6b780a33b0 0x7f6b780a5870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.169+0000 7f6b90f2e640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b8c102ef0 0x7f6b8c10ef50 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.169+0000 7f6b90f2e640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b8c102570 0x7f6b8c10ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.169+0000 7f6b90f2e640 1 --2- 172.21.15.45:0/3429477335 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6b8c100e20 0x7f6b8c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:39.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.169+0000 7f6b90f2e640 1 -- 172.21.15.45:0/3429477335 >> 172.21.15.45:0/3429477335 conn(0x7f6b8c0fc7d0 msgr2=0x7f6b8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:39.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.169+0000 7f6b90f2e640 1 -- 172.21.15.45:0/3429477335 shutdown_connections 2024-09-15T22:26:39.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:39.169+0000 7f6b90f2e640 1 -- 172.21.15.45:0/3429477335 wait complete. 2024-09-15T22:26:39.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:39 smithi165 ceph-mon[35551]: pgmap v323: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:39.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:39 smithi100 ceph-mon[35319]: pgmap v323: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:39.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:39 smithi045 ceph-mon[31180]: pgmap v323: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:39.900 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-15T22:26:39.901 INFO:tasks.fwd_scrub:done joining 2024-09-15T22:26:39.901 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-15T22:26:39.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:26:40.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.018+0000 7f26e705a640 1 -- 172.21.15.45:0/1530724684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26e0107ab0 msgr2=0x7f26e0107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.018+0000 7f26e705a640 1 --2- 172.21.15.45:0/1530724684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26e0107ab0 0x7f26e0107e90 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009930 tx=0x7f26d002a420 comp rx=0 tx=0).stop 2024-09-15T22:26:40.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.018+0000 7f26e705a640 1 -- 172.21.15.45:0/1530724684 shutdown_connections 2024-09-15T22:26:40.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.018+0000 7f26e705a640 1 --2- 172.21.15.45:0/1530724684 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0102440 0x7f26e010e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.018+0000 7f26e705a640 1 --2- 172.21.15.45:0/1530724684 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26e0101aa0 0x7f26e0101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.018+0000 7f26e705a640 1 --2- 172.21.15.45:0/1530724684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26e0107ab0 0x7f26e0107e90 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.018+0000 7f26e705a640 1 -- 172.21.15.45:0/1530724684 >> 172.21.15.45:0/1530724684 conn(0x7f26e00fd7c0 msgr2=0x7f26e00ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:40.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.018+0000 7f26e705a640 1 -- 172.21.15.45:0/1530724684 shutdown_connections 2024-09-15T22:26:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.018+0000 7f26e705a640 1 -- 172.21.15.45:0/1530724684 wait complete. 2024-09-15T22:26:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.018+0000 7f26e705a640 1 Processor -- start 2024-09-15T22:26:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e705a640 1 -- start start 2024-09-15T22:26:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e705a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26e0101aa0 0x7f26e01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e705a640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26e0102440 0x7f26e01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e705a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0107ab0 0x7f26e019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e705a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0112060 con 0x7f26e0101aa0 2024-09-15T22:26:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e705a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0111ee0 con 0x7f26e0107ab0 2024-09-15T22:26:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e705a640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f26e01121e0 con 0x7f26e0102440 2024-09-15T22:26:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e4df6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26e0101aa0 0x7f26e01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e4df6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26e0101aa0 0x7f26e01984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37312/0 (socket says 172.21.15.45:37312) 2024-09-15T22:26:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e4df6640 1 -- 172.21.15.45:0/3247163838 learned_addr learned my addr 172.21.15.45:0/3247163838 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:40.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26dffff640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26e0102440 0x7f26e01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e55f7640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0107ab0 0x7f26e019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e4df6640 1 -- 172.21.15.45:0/3247163838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26e0102440 msgr2=0x7f26e01989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e4df6640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26e0102440 0x7f26e01989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e4df6640 1 -- 172.21.15.45:0/3247163838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0107ab0 msgr2=0x7f26e019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e4df6640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0107ab0 0x7f26e019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26e4df6640 1 -- 172.21.15.45:0/3247163838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e019d4a0 con 0x7f26e0101aa0 2024-09-15T22:26:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.019+0000 7f26dffff640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26e0102440 0x7f26e01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.020+0000 7f26e4df6640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26e0101aa0 0x7f26e01984b0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f26d002a940 tx=0x7f26d0032bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.020+0000 7f26ddffb640 1 -- 172.21.15.45:0/3247163838 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d003f030 con 0x7f26e0101aa0 2024-09-15T22:26:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.020+0000 7f26ddffb640 1 -- 172.21.15.45:0/3247163838 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f26d0032e10 con 0x7f26e0101aa0 2024-09-15T22:26:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.020+0000 7f26e705a640 1 -- 172.21.15.45:0/3247163838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e019d730 con 0x7f26e0101aa0 2024-09-15T22:26:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.020+0000 7f26ddffb640 1 -- 172.21.15.45:0/3247163838 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d0035070 con 0x7f26e0101aa0 2024-09-15T22:26:40.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.020+0000 7f26e705a640 1 -- 172.21.15.45:0/3247163838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e01a5020 con 0x7f26e0101aa0 2024-09-15T22:26:40.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.021+0000 7f26e705a640 1 -- 172.21.15.45:0/3247163838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e0101f00 con 0x7f26e0101aa0 2024-09-15T22:26:40.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.022+0000 7f26ddffb640 1 -- 172.21.15.45:0/3247163838 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f26d0042030 con 0x7f26e0101aa0 2024-09-15T22:26:40.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.023+0000 7f26ddffb640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f26c80a3440 0x7f26c80a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.023+0000 7f26dffff640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f26c80a3440 0x7f26c80a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.023+0000 7f26ddffb640 1 -- 172.21.15.45:0/3247163838 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7f26d00f0920 con 0x7f26e0101aa0 2024-09-15T22:26:40.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.024+0000 7f26dffff640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f26c80a3440 0x7f26c80a5900 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f26e00ffce0 tx=0x7f26d4005ec0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:40.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.027+0000 7f26ddffb640 1 -- 172.21.15.45:0/3247163838 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f26d00bceb0 con 0x7f26e0101aa0 2024-09-15T22:26:40.207 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.206+0000 7f26e705a640 1 -- 172.21.15.45:0/3247163838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26e0199800 con 0x7f26e0101aa0 2024-09-15T22:26:40.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.207+0000 7f26ddffb640 1 -- 172.21.15.45:0/3247163838 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+25481 (secure 0 0 0) 0x7f26d00bc7b0 con 0x7f26e0101aa0 2024-09-15T22:26:40.209 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:26:40.210 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":100,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:26:14.630126+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":7}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/1919238369":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/4107707607":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3286786467":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1080251242":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1461513797":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/1919238369":"2024-09-16T22:16:17.536196+0000","172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3846204427":"2024-09-16T22:16:17.536196+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:26:40.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.209+0000 7f26e705a640 1 -- 172.21.15.45:0/3247163838 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f26c80a3440 msgr2=0x7f26c80a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.209+0000 7f26e705a640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f26c80a3440 0x7f26c80a5900 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f26e00ffce0 tx=0x7f26d4005ec0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.209+0000 7f26e705a640 1 -- 172.21.15.45:0/3247163838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26e0101aa0 msgr2=0x7f26e01984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.209+0000 7f26e705a640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26e0101aa0 0x7f26e01984b0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f26d002a940 tx=0x7f26d0032bf0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.209+0000 7f26e705a640 1 -- 172.21.15.45:0/3247163838 shutdown_connections 2024-09-15T22:26:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.209+0000 7f26e705a640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f26c80a3440 0x7f26c80a5900 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.209+0000 7f26e705a640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26e0107ab0 0x7f26e019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.209+0000 7f26e705a640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f26e0102440 0x7f26e01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.209+0000 7f26e705a640 1 --2- 172.21.15.45:0/3247163838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26e0101aa0 0x7f26e01984b0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.209+0000 7f26e705a640 1 -- 172.21.15.45:0/3247163838 >> 172.21.15.45:0/3247163838 conn(0x7f26e00fd7c0 msgr2=0x7f26e00fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.209+0000 7f26e705a640 1 -- 172.21.15.45:0/3247163838 shutdown_connections 2024-09-15T22:26:40.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.209+0000 7f26e705a640 1 -- 172.21.15.45:0/3247163838 wait complete. 2024-09-15T22:26:40.223 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:09:29.838325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T22:14:03.430259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T22:14:05.780122+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 99, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-15T22:14:12.253914+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 99, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-15T22:26:40.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:26:40.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.328+0000 7f08bbb59640 1 -- 172.21.15.45:0/935559306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b4103660 msgr2=0x7f08b410bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.328+0000 7f08bbb59640 1 --2- 172.21.15.45:0/935559306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b4103660 0x7f08b410bb40 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009900 tx=0x7f08a802a480 comp rx=0 tx=0).stop 2024-09-15T22:26:40.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.328+0000 7f08bbb59640 1 -- 172.21.15.45:0/935559306 shutdown_connections 2024-09-15T22:26:40.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.328+0000 7f08bbb59640 1 --2- 172.21.15.45:0/935559306 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08b410c110 0x7f08b410e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.328+0000 7f08bbb59640 1 --2- 172.21.15.45:0/935559306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b4103660 0x7f08b410bb40 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.328+0000 7f08bbb59640 1 --2- 172.21.15.45:0/935559306 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08b4102d40 0x7f08b4103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.328+0000 7f08bbb59640 1 -- 172.21.15.45:0/935559306 >> 172.21.15.45:0/935559306 conn(0x7f08b40fc690 msgr2=0x7f08b40feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:40.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.328+0000 7f08bbb59640 1 -- 172.21.15.45:0/935559306 shutdown_connections 2024-09-15T22:26:40.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.328+0000 7f08bbb59640 1 -- 172.21.15.45:0/935559306 wait complete. 2024-09-15T22:26:40.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.328+0000 7f08bbb59640 1 Processor -- start 2024-09-15T22:26:40.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.328+0000 7f08bbb59640 1 -- start start 2024-09-15T22:26:40.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08bbb59640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08b4102d40 0x7f08b41984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08bbb59640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08b4103660 0x7f08b4198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08bbb59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b410c110 0x7f08b419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.332 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08bbb59640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f08b4111fd0 con 0x7f08b410c110 2024-09-15T22:26:40.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08bbb59640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f08b4111e50 con 0x7f08b4102d40 2024-09-15T22:26:40.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08bbb59640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f08b4112150 con 0x7f08b4103660 2024-09-15T22:26:40.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08ba0f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b410c110 0x7f08b419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08ba0f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b410c110 0x7f08b419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37342/0 (socket says 172.21.15.45:37342) 2024-09-15T22:26:40.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08ba0f6640 1 -- 172.21.15.45:0/2859333759 learned_addr learned my addr 172.21.15.45:0/2859333759 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:40.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08b98f5640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08b4102d40 0x7f08b41984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08b90f4640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08b4103660 0x7f08b4198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08ba0f6640 1 -- 172.21.15.45:0/2859333759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08b4103660 msgr2=0x7f08b4198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08ba0f6640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08b4103660 0x7f08b4198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08ba0f6640 1 -- 172.21.15.45:0/2859333759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08b4102d40 msgr2=0x7f08b41984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08ba0f6640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08b4102d40 0x7f08b41984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08ba0f6640 1 -- 172.21.15.45:0/2859333759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b419d4d0 con 0x7f08b410c110 2024-09-15T22:26:40.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08b90f4640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08b4103660 0x7f08b4198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:26:40.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.329+0000 7f08ba0f6640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b410c110 0x7f08b419cda0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00c970 tx=0x7f08ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:40.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.332+0000 7f08a6ffd640 1 -- 172.21.15.45:0/2859333759 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac007bb0 con 0x7f08b410c110 2024-09-15T22:26:40.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.332+0000 7f08a6ffd640 1 -- 172.21.15.45:0/2859333759 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f08ac007d50 con 0x7f08b410c110 2024-09-15T22:26:40.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.332+0000 7f08bbb59640 1 -- 172.21.15.45:0/2859333759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b419d7c0 con 0x7f08b410c110 2024-09-15T22:26:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.332+0000 7f08a6ffd640 1 -- 172.21.15.45:0/2859333759 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac0188a0 con 0x7f08b410c110 2024-09-15T22:26:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.332+0000 7f08bbb59640 1 -- 172.21.15.45:0/2859333759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b41a5050 con 0x7f08b410c110 2024-09-15T22:26:40.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.333+0000 7f08bbb59640 1 -- 172.21.15.45:0/2859333759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b4103120 con 0x7f08b410c110 2024-09-15T22:26:40.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.334+0000 7f08a6ffd640 1 -- 172.21.15.45:0/2859333759 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f08ac00f450 con 0x7f08b410c110 2024-09-15T22:26:40.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.335+0000 7f08a6ffd640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08a00a33c0 0x7f08a00a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.335+0000 7f08a6ffd640 1 -- 172.21.15.45:0/2859333759 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7f08ac0d01b0 con 0x7f08b410c110 2024-09-15T22:26:40.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.335+0000 7f08b98f5640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08a00a33c0 0x7f08a00a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.336+0000 7f08b98f5640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08a00a33c0 0x7f08a00a5880 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f08b0005fd0 tx=0x7f08b0009680 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:40.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.341+0000 7f08a6ffd640 1 -- 172.21.15.45:0/2859333759 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f08ac014030 con 0x7f08b410c110 2024-09-15T22:26:40.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.516+0000 7f08bbb59640 1 -- 172.21.15.45:0/2859333759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f08b41071c0 con 0x7f08b410c110 2024-09-15T22:26:40.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.517+0000 7f08a6ffd640 1 -- 172.21.15.45:0/2859333759 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) ==== 93+0+10 (secure 0 0 0) 0x7f08ac09c780 con 0x7f08b410c110 2024-09-15T22:26:40.518 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-09-15T22:26:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.519+0000 7f08bbb59640 1 -- 172.21.15.45:0/2859333759 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08a00a33c0 msgr2=0x7f08a00a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.519+0000 7f08bbb59640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08a00a33c0 0x7f08a00a5880 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f08b0005fd0 tx=0x7f08b0009680 comp rx=0 tx=0).stop 2024-09-15T22:26:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.519+0000 7f08bbb59640 1 -- 172.21.15.45:0/2859333759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b410c110 msgr2=0x7f08b419cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.519+0000 7f08bbb59640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b410c110 0x7f08b419cda0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00c970 tx=0x7f08ac00ce30 comp rx=0 tx=0).stop 2024-09-15T22:26:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.519+0000 7f08bbb59640 1 -- 172.21.15.45:0/2859333759 shutdown_connections 2024-09-15T22:26:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.519+0000 7f08bbb59640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f08a00a33c0 0x7f08a00a5880 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.519+0000 7f08bbb59640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08b410c110 0x7f08b419cda0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.519+0000 7f08bbb59640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f08b4103660 0x7f08b4198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.519+0000 7f08bbb59640 1 --2- 172.21.15.45:0/2859333759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08b4102d40 0x7f08b41984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.519+0000 7f08bbb59640 1 -- 172.21.15.45:0/2859333759 >> 172.21.15.45:0/2859333759 conn(0x7f08b40fc690 msgr2=0x7f08b40fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.519+0000 7f08bbb59640 1 -- 172.21.15.45:0/2859333759 shutdown_connections 2024-09-15T22:26:40.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.519+0000 7f08bbb59640 1 -- 172.21.15.45:0/2859333759 wait complete. 2024-09-15T22:26:40.530 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:40 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3247163838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:26:40.532 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T22:26:40.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.637+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3963163914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbf0101320 msgr2=0x7fbbf010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.637+0000 7fbbf5e15640 1 --2- 172.21.15.45:0/3963163914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbf0101320 0x7fbbf010d850 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009cd0 tx=0x7fbbe802a8e0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.637+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3963163914 shutdown_connections 2024-09-15T22:26:40.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.637+0000 7fbbf5e15640 1 --2- 172.21.15.45:0/3963163914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbf0101320 0x7fbbf010d850 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.637+0000 7fbbf5e15640 1 --2- 172.21.15.45:0/3963163914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbf0100980 0x7fbbf0100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.637+0000 7fbbf5e15640 1 --2- 172.21.15.45:0/3963163914 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbf0106990 0x7fbbf0106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.637+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3963163914 >> 172.21.15.45:0/3963163914 conn(0x7fbbf00779d0 msgr2=0x7fbbf00fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:40.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.637+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3963163914 shutdown_connections 2024-09-15T22:26:40.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.637+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3963163914 wait complete. 2024-09-15T22:26:40.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.637+0000 7fbbf5e15640 1 Processor -- start 2024-09-15T22:26:40.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbf5e15640 1 -- start start 2024-09-15T22:26:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbf5e15640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbf0100980 0x7fbbf0197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbf5e15640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbf0101320 0x7fbbf0197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbf5e15640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbf0106990 0x7fbbf019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbf5e15640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0110ef0 con 0x7fbbf0106990 2024-09-15T22:26:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbf5e15640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0110d70 con 0x7fbbf0100980 2024-09-15T22:26:40.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbf5e15640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf0111070 con 0x7fbbf0101320 2024-09-15T22:26:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbeffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbf0106990 0x7fbbf019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbeffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbf0106990 0x7fbbf019bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37364/0 (socket says 172.21.15.45:37364) 2024-09-15T22:26:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbeffff640 1 -- 172.21.15.45:0/3995311094 learned_addr learned my addr 172.21.15.45:0/3995311094 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbef7fe640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbf0100980 0x7fbbf0197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbeeffd640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbf0101320 0x7fbbf0197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbeffff640 1 -- 172.21.15.45:0/3995311094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbf0101320 msgr2=0x7fbbf0197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbeffff640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbf0101320 0x7fbbf0197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbeffff640 1 -- 172.21.15.45:0/3995311094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbf0100980 msgr2=0x7fbbf0197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbeffff640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbf0100980 0x7fbbf0197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbeffff640 1 -- 172.21.15.45:0/3995311094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf019c410 con 0x7fbbf0106990 2024-09-15T22:26:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.638+0000 7fbbeffff640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbf0106990 0x7fbbf019bce0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8006010 tx=0x7fbbe8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.639+0000 7fbbecff9640 1 -- 172.21.15.45:0/3995311094 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8031c80 con 0x7fbbf0106990 2024-09-15T22:26:40.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.639+0000 7fbbecff9640 1 -- 172.21.15.45:0/3995311094 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbbe8031e20 con 0x7fbbf0106990 2024-09-15T22:26:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.639+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3995311094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf019c6a0 con 0x7fbbf0106990 2024-09-15T22:26:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.639+0000 7fbbecff9640 1 -- 172.21.15.45:0/3995311094 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8030cb0 con 0x7fbbf0106990 2024-09-15T22:26:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.639+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3995311094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf01a3f90 con 0x7fbbf0106990 2024-09-15T22:26:40.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.640+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3995311094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf0100de0 con 0x7fbbf0106990 2024-09-15T22:26:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.641+0000 7fbbecff9640 1 -- 172.21.15.45:0/3995311094 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fbbe8004040 con 0x7fbbf0106990 2024-09-15T22:26:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.642+0000 7fbbecff9640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbbd80a3440 0x7fbbd80a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.642+0000 7fbbef7fe640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbbd80a3440 0x7fbbd80a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.642+0000 7fbbecff9640 1 -- 172.21.15.45:0/3995311094 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7fbbe802e030 con 0x7fbbf0106990 2024-09-15T22:26:40.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.642+0000 7fbbef7fe640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbbd80a3440 0x7fbbd80a5900 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009b50 tx=0x7fbbe0005f90 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:40.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.646+0000 7fbbecff9640 1 -- 172.21.15.45:0/3995311094 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbbe80bd670 con 0x7fbbf0106990 2024-09-15T22:26:40.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:40 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3247163838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:26:40.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:40 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3247163838' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:26:40.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.820+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3995311094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbbf002d7c0 con 0x7fbbf0106990 2024-09-15T22:26:40.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.821+0000 7fbbecff9640 1 -- 172.21.15.45:0/3995311094 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) ==== 104+0+11 (secure 0 0 0) 0x7fbbe80bcf70 con 0x7fbbf0106990 2024-09-15T22:26:40.823 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-09-15T22:26:40.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.823+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3995311094 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbbd80a3440 msgr2=0x7fbbd80a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.823+0000 7fbbf5e15640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbbd80a3440 0x7fbbd80a5900 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0009b50 tx=0x7fbbe0005f90 comp rx=0 tx=0).stop 2024-09-15T22:26:40.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.823+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3995311094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbf0106990 msgr2=0x7fbbf019bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.823+0000 7fbbf5e15640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbf0106990 0x7fbbf019bce0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8006010 tx=0x7fbbe8003f10 comp rx=0 tx=0).stop 2024-09-15T22:26:40.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.823+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3995311094 shutdown_connections 2024-09-15T22:26:40.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.823+0000 7fbbf5e15640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fbbd80a3440 0x7fbbd80a5900 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.823+0000 7fbbf5e15640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbf0106990 0x7fbbf019bce0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.823+0000 7fbbf5e15640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fbbf0101320 0x7fbbf0197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.823+0000 7fbbf5e15640 1 --2- 172.21.15.45:0/3995311094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbbf0100980 0x7fbbf0197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.823+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3995311094 >> 172.21.15.45:0/3995311094 conn(0x7fbbf00779d0 msgr2=0x7fbbf01038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:40.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.824+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3995311094 shutdown_connections 2024-09-15T22:26:40.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.824+0000 7fbbf5e15640 1 -- 172.21.15.45:0/3995311094 wait complete. 2024-09-15T22:26:40.836 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T22:26:40.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.941+0000 7f231e3bd640 1 -- 172.21.15.45:0/3987431380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f231810c0d0 msgr2=0x7f231810e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.941+0000 7f231e3bd640 1 --2- 172.21.15.45:0/3987431380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f231810c0d0 0x7f231810e550 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2310009ca0 tx=0x7f231002a950 comp rx=0 tx=0).stop 2024-09-15T22:26:40.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.941+0000 7f231e3bd640 1 -- 172.21.15.45:0/3987431380 shutdown_connections 2024-09-15T22:26:40.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.941+0000 7f231e3bd640 1 --2- 172.21.15.45:0/3987431380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f231810c0d0 0x7f231810e550 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.941+0000 7f231e3bd640 1 --2- 172.21.15.45:0/3987431380 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f23181035a0 0x7f231810ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.941+0000 7f231e3bd640 1 --2- 172.21.15.45:0/3987431380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2318102c80 0x7f2318103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.941+0000 7f231e3bd640 1 -- 172.21.15.45:0/3987431380 >> 172.21.15.45:0/3987431380 conn(0x7f23180fc690 msgr2=0x7f23180feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.941+0000 7f231e3bd640 1 -- 172.21.15.45:0/3987431380 shutdown_connections 2024-09-15T22:26:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.941+0000 7f231e3bd640 1 -- 172.21.15.45:0/3987431380 wait complete. 2024-09-15T22:26:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231e3bd640 1 Processor -- start 2024-09-15T22:26:40.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231e3bd640 1 -- start start 2024-09-15T22:26:40.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231e3bd640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2318102c80 0x7f23181984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231e3bd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23181035a0 0x7f2318198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231e3bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f231810c0d0 0x7f231819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231e3bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2318111fd0 con 0x7f231810c0d0 2024-09-15T22:26:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231e3bd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2318111e50 con 0x7f23181035a0 2024-09-15T22:26:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231e3bd640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2318112150 con 0x7f2318102c80 2024-09-15T22:26:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231c95a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f231810c0d0 0x7f231819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231c95a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f231810c0d0 0x7f231819cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37390/0 (socket says 172.21.15.45:37390) 2024-09-15T22:26:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231c95a640 1 -- 172.21.15.45:0/1129148661 learned_addr learned my addr 172.21.15.45:0/1129148661 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f2317fff640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2318102c80 0x7f23181984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f23177fe640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23181035a0 0x7f2318198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231c95a640 1 -- 172.21.15.45:0/1129148661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2318102c80 msgr2=0x7f23181984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231c95a640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2318102c80 0x7f23181984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231c95a640 1 -- 172.21.15.45:0/1129148661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23181035a0 msgr2=0x7f2318198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231c95a640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23181035a0 0x7f2318198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.942+0000 7f231c95a640 1 -- 172.21.15.45:0/1129148661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231819d4b0 con 0x7f231810c0d0 2024-09-15T22:26:40.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.943+0000 7f231c95a640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f231810c0d0 0x7f231819cd80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2310005cc0 tx=0x7f231002f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:40.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.943+0000 7f23157fa640 1 -- 172.21.15.45:0/1129148661 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310034040 con 0x7f231810c0d0 2024-09-15T22:26:40.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.943+0000 7f23157fa640 1 -- 172.21.15.45:0/1129148661 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2310030940 con 0x7f231810c0d0 2024-09-15T22:26:40.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.943+0000 7f231e3bd640 1 -- 172.21.15.45:0/1129148661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231819d740 con 0x7f231810c0d0 2024-09-15T22:26:40.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.943+0000 7f23157fa640 1 -- 172.21.15.45:0/1129148661 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310045480 con 0x7f231810c0d0 2024-09-15T22:26:40.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.943+0000 7f231e3bd640 1 -- 172.21.15.45:0/1129148661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23181a5030 con 0x7f231810c0d0 2024-09-15T22:26:40.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.944+0000 7f231e3bd640 1 -- 172.21.15.45:0/1129148661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2318103060 con 0x7f231810c0d0 2024-09-15T22:26:40.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.945+0000 7f23157fa640 1 -- 172.21.15.45:0/1129148661 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2310037020 con 0x7f231810c0d0 2024-09-15T22:26:40.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.946+0000 7f23157fa640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f23000a33c0 0x7f23000a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:40.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.946+0000 7f2317fff640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f23000a33c0 0x7f23000a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:40.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.946+0000 7f23157fa640 1 -- 172.21.15.45:0/1129148661 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7f23100f0fa0 con 0x7f231810c0d0 2024-09-15T22:26:40.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.946+0000 7f2317fff640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f23000a33c0 0x7f23000a5880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2308005d00 tx=0x7f230800b410 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:40.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:40.949+0000 7f23157fa640 1 -- 172.21.15.45:0/1129148661 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f23100bd640 con 0x7f231810c0d0 2024-09-15T22:26:41.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.125+0000 7f231e3bd640 1 -- 172.21.15.45:0/1129148661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f23181a5200 con 0x7f231810c0d0 2024-09-15T22:26:41.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.125+0000 7f23157fa640 1 -- 172.21.15.45:0/1129148661 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) ==== 100+0+11 (secure 0 0 0) 0x7f23100bcf40 con 0x7f231810c0d0 2024-09-15T22:26:41.127 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-09-15T22:26:41.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.127+0000 7f231e3bd640 1 -- 172.21.15.45:0/1129148661 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f23000a33c0 msgr2=0x7f23000a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:41.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.127+0000 7f231e3bd640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f23000a33c0 0x7f23000a5880 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2308005d00 tx=0x7f230800b410 comp rx=0 tx=0).stop 2024-09-15T22:26:41.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.127+0000 7f231e3bd640 1 -- 172.21.15.45:0/1129148661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f231810c0d0 msgr2=0x7f231819cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:41.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.127+0000 7f231e3bd640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f231810c0d0 0x7f231819cd80 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2310005cc0 tx=0x7f231002f790 comp rx=0 tx=0).stop 2024-09-15T22:26:41.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.127+0000 7f231e3bd640 1 -- 172.21.15.45:0/1129148661 shutdown_connections 2024-09-15T22:26:41.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.127+0000 7f231e3bd640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f23000a33c0 0x7f23000a5880 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.127+0000 7f231e3bd640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f231810c0d0 0x7f231819cd80 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.127+0000 7f231e3bd640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23181035a0 0x7f2318198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.127+0000 7f231e3bd640 1 --2- 172.21.15.45:0/1129148661 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2318102c80 0x7f23181984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.127+0000 7f231e3bd640 1 -- 172.21.15.45:0/1129148661 >> 172.21.15.45:0/1129148661 conn(0x7f23180fc690 msgr2=0x7f23180fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:41.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.127+0000 7f231e3bd640 1 -- 172.21.15.45:0/1129148661 shutdown_connections 2024-09-15T22:26:41.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.127+0000 7f231e3bd640 1 -- 172.21.15.45:0/1129148661 wait complete. 2024-09-15T22:26:41.140 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-15T22:26:41.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.245+0000 7fba3d7c4640 1 -- 172.21.15.45:0/3842060978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba381035a0 msgr2=0x7fba3810ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.245+0000 7fba3d7c4640 1 --2- 172.21.15.45:0/3842060978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba381035a0 0x7fba3810ba80 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009900 tx=0x7fba2c02a480 comp rx=0 tx=0).stop 2024-09-15T22:26:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.245+0000 7fba3d7c4640 1 -- 172.21.15.45:0/3842060978 shutdown_connections 2024-09-15T22:26:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.245+0000 7fba3d7c4640 1 --2- 172.21.15.45:0/3842060978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba3810c0d0 0x7fba3810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.245+0000 7fba3d7c4640 1 --2- 172.21.15.45:0/3842060978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba381035a0 0x7fba3810ba80 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.245+0000 7fba3d7c4640 1 --2- 172.21.15.45:0/3842060978 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba38102c80 0x7fba38103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.245+0000 7fba3d7c4640 1 -- 172.21.15.45:0/3842060978 >> 172.21.15.45:0/3842060978 conn(0x7fba380fc690 msgr2=0x7fba380feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.245+0000 7fba3d7c4640 1 -- 172.21.15.45:0/3842060978 shutdown_connections 2024-09-15T22:26:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.245+0000 7fba3d7c4640 1 -- 172.21.15.45:0/3842060978 wait complete. 2024-09-15T22:26:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.246+0000 7fba3d7c4640 1 Processor -- start 2024-09-15T22:26:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.246+0000 7fba3d7c4640 1 -- start start 2024-09-15T22:26:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.246+0000 7fba3d7c4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba38102c80 0x7fba381008d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.246+0000 7fba3d7c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba381035a0 0x7fba38100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:41.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.246+0000 7fba3d7c4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3810c0d0 0x7fba38101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba3d7c4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fba38111fd0 con 0x7fba3810c0d0 2024-09-15T22:26:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba3d7c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fba38111e50 con 0x7fba381035a0 2024-09-15T22:26:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba3d7c4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fba38112150 con 0x7fba38102c80 2024-09-15T22:26:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3810c0d0 0x7fba38101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba377fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3810c0d0 0x7fba38101350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37410/0 (socket says 172.21.15.45:37410) 2024-09-15T22:26:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba377fe640 1 -- 172.21.15.45:0/2329953870 learned_addr learned my addr 172.21.15.45:0/2329953870 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba367fc640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba381035a0 0x7fba38100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba36ffd640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba38102c80 0x7fba381008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba377fe640 1 -- 172.21.15.45:0/2329953870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba38102c80 msgr2=0x7fba381008d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba377fe640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba38102c80 0x7fba381008d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba377fe640 1 -- 172.21.15.45:0/2329953870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba381035a0 msgr2=0x7fba38100e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba377fe640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba381035a0 0x7fba38100e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba377fe640 1 -- 172.21.15.45:0/2329953870 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba381a6a40 con 0x7fba3810c0d0 2024-09-15T22:26:41.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba377fe640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3810c0d0 0x7fba38101350 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fba3000cad0 tx=0x7fba3000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:41.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba1ffff640 1 -- 172.21.15.45:0/2329953870 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3000ae20 con 0x7fba3810c0d0 2024-09-15T22:26:41.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba3d7c4640 1 -- 172.21.15.45:0/2329953870 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba381a6d30 con 0x7fba3810c0d0 2024-09-15T22:26:41.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba1ffff640 1 -- 172.21.15.45:0/2329953870 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fba30004b20 con 0x7fba3810c0d0 2024-09-15T22:26:41.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba1ffff640 1 -- 172.21.15.45:0/2329953870 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba3000f780 con 0x7fba3810c0d0 2024-09-15T22:26:41.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.247+0000 7fba3d7c4640 1 -- 172.21.15.45:0/2329953870 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba381a7200 con 0x7fba3810c0d0 2024-09-15T22:26:41.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.248+0000 7fba3d7c4640 1 -- 172.21.15.45:0/2329953870 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba38103060 con 0x7fba3810c0d0 2024-09-15T22:26:41.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.249+0000 7fba1ffff640 1 -- 172.21.15.45:0/2329953870 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fba30004cd0 con 0x7fba3810c0d0 2024-09-15T22:26:41.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.250+0000 7fba1ffff640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fba200a33c0 0x7fba200a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:41.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.250+0000 7fba1ffff640 1 -- 172.21.15.45:0/2329953870 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7fba300d01b0 con 0x7fba3810c0d0 2024-09-15T22:26:41.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.250+0000 7fba36ffd640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fba200a33c0 0x7fba200a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:41.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.251+0000 7fba36ffd640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fba200a33c0 0x7fba200a5880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba28009b60 tx=0x7fba28005f90 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:41.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.254+0000 7fba1ffff640 1 -- 172.21.15.45:0/2329953870 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fba30014030 con 0x7fba3810c0d0 2024-09-15T22:26:41.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.429+0000 7fba3d7c4640 1 -- 172.21.15.45:0/2329953870 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fba381a7490 con 0x7fba3810c0d0 2024-09-15T22:26:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.430+0000 7fba1ffff640 1 -- 172.21.15.45:0/2329953870 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v100) ==== 103+0+11 (secure 0 0 0) 0x7fba3009c740 con 0x7fba3810c0d0 2024-09-15T22:26:41.432 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-09-15T22:26:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.432+0000 7fba3d7c4640 1 -- 172.21.15.45:0/2329953870 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fba200a33c0 msgr2=0x7fba200a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.432+0000 7fba3d7c4640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fba200a33c0 0x7fba200a5880 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fba28009b60 tx=0x7fba28005f90 comp rx=0 tx=0).stop 2024-09-15T22:26:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.432+0000 7fba3d7c4640 1 -- 172.21.15.45:0/2329953870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3810c0d0 msgr2=0x7fba38101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.432+0000 7fba3d7c4640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3810c0d0 0x7fba38101350 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fba3000cad0 tx=0x7fba3000cf90 comp rx=0 tx=0).stop 2024-09-15T22:26:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.432+0000 7fba3d7c4640 1 -- 172.21.15.45:0/2329953870 shutdown_connections 2024-09-15T22:26:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.432+0000 7fba3d7c4640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fba200a33c0 0x7fba200a5880 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.432+0000 7fba3d7c4640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba3810c0d0 0x7fba38101350 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.432+0000 7fba3d7c4640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba381035a0 0x7fba38100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.432+0000 7fba3d7c4640 1 --2- 172.21.15.45:0/2329953870 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fba38102c80 0x7fba381008d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.432+0000 7fba3d7c4640 1 -- 172.21.15.45:0/2329953870 >> 172.21.15.45:0/2329953870 conn(0x7fba380fc690 msgr2=0x7fba380fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:41.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.432+0000 7fba3d7c4640 1 -- 172.21.15.45:0/2329953870 shutdown_connections 2024-09-15T22:26:41.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.432+0000 7fba3d7c4640 1 -- 172.21.15.45:0/2329953870 wait complete. 2024-09-15T22:26:41.443 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:41 smithi045 ceph-mon[31180]: pgmap v324: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:41.444 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:41 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2859333759' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:26:41.444 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:41 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3995311094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:26:41.444 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:41 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1129148661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:26:41.445 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-15T22:26:41.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.546+0000 7fc925b98640 1 -- 172.21.15.45:0/1070996361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc92010c0e0 msgr2=0x7fc92010e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.546+0000 7fc925b98640 1 --2- 172.21.15.45:0/1070996361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc92010c0e0 0x7fc92010e560 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fc918009ca0 tx=0x7fc91802a950 comp rx=0 tx=0).stop 2024-09-15T22:26:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.546+0000 7fc925b98640 1 -- 172.21.15.45:0/1070996361 shutdown_connections 2024-09-15T22:26:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.546+0000 7fc925b98640 1 --2- 172.21.15.45:0/1070996361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc92010c0e0 0x7fc92010e560 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.546+0000 7fc925b98640 1 --2- 172.21.15.45:0/1070996361 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc9201035b0 0x7fc92010ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.546+0000 7fc925b98640 1 --2- 172.21.15.45:0/1070996361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc920102c90 0x7fc920103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.546+0000 7fc925b98640 1 -- 172.21.15.45:0/1070996361 >> 172.21.15.45:0/1070996361 conn(0x7fc9200fc6a0 msgr2=0x7fc9200feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.546+0000 7fc925b98640 1 -- 172.21.15.45:0/1070996361 shutdown_connections 2024-09-15T22:26:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.546+0000 7fc925b98640 1 -- 172.21.15.45:0/1070996361 wait complete. 2024-09-15T22:26:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.547+0000 7fc925b98640 1 Processor -- start 2024-09-15T22:26:41.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.547+0000 7fc925b98640 1 -- start start 2024-09-15T22:26:41.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.547+0000 7fc925b98640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc920102c90 0x7fc9201008e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:41.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.547+0000 7fc925b98640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9201035b0 0x7fc920100e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.547+0000 7fc925b98640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc92010c0e0 0x7fc920101360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.547+0000 7fc925b98640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc920111fe0 con 0x7fc92010c0e0 2024-09-15T22:26:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.547+0000 7fc925b98640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc920111e60 con 0x7fc9201035b0 2024-09-15T22:26:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.547+0000 7fc925b98640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc920112160 con 0x7fc920102c90 2024-09-15T22:26:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.547+0000 7fc91ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc92010c0e0 0x7fc920101360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.547+0000 7fc91ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc92010c0e0 0x7fc920101360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37420/0 (socket says 172.21.15.45:37420) 2024-09-15T22:26:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.547+0000 7fc91ffff640 1 -- 172.21.15.45:0/4105779301 learned_addr learned my addr 172.21.15.45:0/4105779301 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:26:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.547+0000 7fc91effd640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9201035b0 0x7fc920100e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.547+0000 7fc91f7fe640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc920102c90 0x7fc9201008e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.548+0000 7fc91ffff640 1 -- 172.21.15.45:0/4105779301 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc920102c90 msgr2=0x7fc9201008e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.548+0000 7fc91ffff640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc920102c90 0x7fc9201008e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.548+0000 7fc91ffff640 1 -- 172.21.15.45:0/4105779301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9201035b0 msgr2=0x7fc920100e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.548+0000 7fc91ffff640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9201035b0 0x7fc920100e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.548+0000 7fc91ffff640 1 -- 172.21.15.45:0/4105779301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9201a6930 con 0x7fc92010c0e0 2024-09-15T22:26:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.548+0000 7fc91ffff640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc92010c0e0 0x7fc920101360 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fc918005cc0 tx=0x7fc91802f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.548+0000 7fc91cff9640 1 -- 172.21.15.45:0/4105779301 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918034040 con 0x7fc92010c0e0 2024-09-15T22:26:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.548+0000 7fc91cff9640 1 -- 172.21.15.45:0/4105779301 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc918030940 con 0x7fc92010c0e0 2024-09-15T22:26:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.548+0000 7fc925b98640 1 -- 172.21.15.45:0/4105779301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9201a6bc0 con 0x7fc92010c0e0 2024-09-15T22:26:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.548+0000 7fc91cff9640 1 -- 172.21.15.45:0/4105779301 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc918045480 con 0x7fc92010c0e0 2024-09-15T22:26:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.548+0000 7fc925b98640 1 -- 172.21.15.45:0/4105779301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9201a70b0 con 0x7fc92010c0e0 2024-09-15T22:26:41.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.549+0000 7fc925b98640 1 -- 172.21.15.45:0/4105779301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc920103070 con 0x7fc92010c0e0 2024-09-15T22:26:41.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.550+0000 7fc91cff9640 1 -- 172.21.15.45:0/4105779301 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc918037020 con 0x7fc92010c0e0 2024-09-15T22:26:41.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.551+0000 7fc91cff9640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc9080a33c0 0x7fc9080a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:26:41.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.551+0000 7fc91cff9640 1 -- 172.21.15.45:0/4105779301 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7fc9180f0fa0 con 0x7fc92010c0e0 2024-09-15T22:26:41.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.551+0000 7fc91f7fe640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc9080a33c0 0x7fc9080a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:26:41.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.551+0000 7fc91f7fe640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc9080a33c0 0x7fc9080a5880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc91000abe0 tx=0x7fc91000a2d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:26:41.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.555+0000 7fc91cff9640 1 -- 172.21.15.45:0/4105779301 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9180bd640 con 0x7fc92010c0e0 2024-09-15T22:26:41.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:41 smithi165 ceph-mon[35551]: pgmap v324: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:41.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:41 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2859333759' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:26:41.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:41 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3995311094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:26:41.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:41 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1129148661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:26:41.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:41 smithi100 ceph-mon[35319]: pgmap v324: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:41.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:41 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2859333759' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T22:26:41.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:41 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3995311094' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T22:26:41.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:41 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1129148661' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T22:26:41.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.777+0000 7fc925b98640 1 -- 172.21.15.45:0/4105779301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fc9201a7340 con 0x7fc92010c0e0 2024-09-15T22:26:41.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.785+0000 7fc91cff9640 1 -- 172.21.15.45:0/4105779301 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+742868 (secure 0 0 0) 0x7fc9180bcf40 con 0x7fc92010c0e0 2024-09-15T22:26:41.796 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:26:41.797 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:26:41.797 INFO:teuthology.orchestra.run.smithi045.stdout: "epoch": 25, 2024-09-15T22:26:41.797 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.797 INFO:teuthology.orchestra.run.smithi045.stdout: "active_gid": 15165, 2024-09-15T22:26:41.797 INFO:teuthology.orchestra.run.smithi045.stdout: "active_name": "x", 2024-09-15T22:26:41.797 INFO:teuthology.orchestra.run.smithi045.stdout: "active_addrs": { 2024-09-15T22:26:41.797 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-09-15T22:26:41.797 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:41.797 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-09-15T22:26:41.797 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6800", 2024-09-15T22:26:41.797 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 553298159 2024-09-15T22:26:41.797 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.797 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:41.798 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2024-09-15T22:26:41.798 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:6801", 2024-09-15T22:26:41.798 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 553298159 2024-09-15T22:26:41.798 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:41.798 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-15T22:26:41.798 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.798 INFO:teuthology.orchestra.run.smithi045.stdout: "active_addr": "172.21.15.45:6801/553298159", 2024-09-15T22:26:41.798 INFO:teuthology.orchestra.run.smithi045.stdout: "active_change": "2024-09-15T22:16:17.536422+0000", 2024-09-15T22:26:41.798 INFO:teuthology.orchestra.run.smithi045.stdout: "active_mgr_features": 4540701547738038271, 2024-09-15T22:26:41.798 INFO:teuthology.orchestra.run.smithi045.stdout: "available": true, 2024-09-15T22:26:41.798 INFO:teuthology.orchestra.run.smithi045.stdout: "standbys": [ 2024-09-15T22:26:41.798 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:41.798 INFO:teuthology.orchestra.run.smithi045.stdout: "gid": 24823, 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "z", 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_features": 4540701547738038271, 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: "available_modules": [ 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "alerts", 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.799 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:41.800 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.800 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.800 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.800 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:26:41.800 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.800 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.800 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.800 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.800 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:41.800 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:41.800 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.800 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.801 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.802 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.802 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.802 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.802 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:41.802 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:41.802 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.802 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.802 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.802 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.802 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.802 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.802 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.803 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.803 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.803 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.803 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.803 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.803 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:41.803 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:41.803 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.803 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.803 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.803 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:41.803 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.803 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.804 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:41.805 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:41.805 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.805 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.805 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.805 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.805 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.805 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.805 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.805 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.805 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.805 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.805 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.805 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_destination": { 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_destination", 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.806 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_from_name": { 2024-09-15T22:26:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_from_name", 2024-09-15T22:26:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "Ceph", 2024-09-15T22:26:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Email From: name", 2024-09-15T22:26:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.807 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_host": { 2024-09-15T22:26:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_host", 2024-09-15T22:26:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP server", 2024-09-15T22:26:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.808 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.809 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.809 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.809 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_password": { 2024-09-15T22:26:41.809 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_password", 2024-09-15T22:26:41.809 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.809 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.809 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.809 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.809 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.809 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.809 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.809 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Password to authenticate with", 2024-09-15T22:26:41.809 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.810 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.810 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.810 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.810 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_port": { 2024-09-15T22:26:41.810 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_port", 2024-09-15T22:26:41.810 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.810 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.810 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.810 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "465", 2024-09-15T22:26:41.810 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.810 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.810 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.810 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP port", 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_sender": { 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_sender", 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.811 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:26:41.812 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.812 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.812 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.812 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.812 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_ssl": { 2024-09-15T22:26:41.812 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_ssl", 2024-09-15T22:26:41.812 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.812 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.812 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.812 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.812 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_user": { 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_user", 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.813 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.814 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.814 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.814 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "User to authenticate as", 2024-09-15T22:26:41.814 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.814 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.814 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.814 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:41.814 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:41.814 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.814 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:41.814 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "balancer", 2024-09-15T22:26:41.814 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:41.815 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:41.815 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:41.815 INFO:teuthology.orchestra.run.smithi045.stdout: "active": { 2024-09-15T22:26:41.815 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "active", 2024-09-15T22:26:41.815 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.815 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.815 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.815 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.815 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.815 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.815 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.815 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: "begin_time": { 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "begin_time", 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0000", 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.816 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:26:41.817 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:26:41.817 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.817 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.817 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.817 INFO:teuthology.orchestra.run.smithi045.stdout: "begin_weekday": { 2024-09-15T22:26:41.817 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "begin_weekday", 2024-09-15T22:26:41.817 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:41.817 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.817 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.817 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:41.817 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0", 2024-09-15T22:26:41.817 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "6", 2024-09-15T22:26:41.817 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_max_iterations": { 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "25", 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "250", 2024-09-15T22:26:41.818 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.819 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:26:41.819 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.819 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.819 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.819 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.819 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_metrics": { 2024-09-15T22:26:41.819 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_metrics", 2024-09-15T22:26:41.819 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.819 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.819 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.819 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:26:41.819 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.819 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.820 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.820 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:26:41.820 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:26:41.820 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.820 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.820 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.820 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_step": { 2024-09-15T22:26:41.820 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_step", 2024-09-15T22:26:41.820 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:41.820 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.820 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.820 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0.5", 2024-09-15T22:26:41.820 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0.001", 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "0.999", 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: "end_time": { 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "end_time", 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "2359", 2024-09-15T22:26:41.821 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: "end_weekday": { 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "end_weekday", 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:41.822 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0", 2024-09-15T22:26:41.823 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "6", 2024-09-15T22:26:41.823 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.823 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:26:41.823 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:26:41.823 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.823 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.823 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.823 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:41.823 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:41.823 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.823 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.823 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.823 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.824 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.824 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.824 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.824 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:41.824 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:41.824 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:41.824 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.824 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:41.824 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:41.824 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.824 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.824 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.824 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.825 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.825 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.825 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:41.825 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:41.825 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.825 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.825 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.825 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.825 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.825 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.825 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.825 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.826 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.826 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.826 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.826 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.826 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:41.826 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:41.826 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.826 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.826 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.826 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:41.826 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.826 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.826 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.827 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:41.827 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:41.827 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:41.827 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.827 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:41.827 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:41.827 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.827 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.827 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.827 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.827 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.827 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.827 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.828 INFO:teuthology.orchestra.run.smithi045.stdout: "min_score": { 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "min_score", 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.829 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": { 2024-09-15T22:26:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mode", 2024-09-15T22:26:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "upmap", 2024-09-15T22:26:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-compat", 2024-09-15T22:26:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: "none", 2024-09-15T22:26:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: "read", 2024-09-15T22:26:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap", 2024-09-15T22:26:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap-read" 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Balancer mode", 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_ids": { 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pool_ids", 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.831 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.832 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.832 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:26:41.832 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.832 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.832 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.832 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.832 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:41.832 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:41.832 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.832 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.832 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.832 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:41.832 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.833 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.833 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.833 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:26:41.833 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.833 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.833 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.833 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.833 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap_max_deviation": { 2024-09-15T22:26:41.833 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "upmap_max_deviation", 2024-09-15T22:26:41.833 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.833 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.833 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap_max_optimizations": { 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.834 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:41.835 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.835 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.835 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.835 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:26:41.835 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.835 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.835 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.835 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:41.835 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:41.835 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.835 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:41.835 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cephadm", 2024-09-15T22:26:41.835 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:41.836 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:41.836 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:41.836 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_down_multiplier": { 2024-09-15T22:26:41.836 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_down_multiplier", 2024-09-15T22:26:41.836 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:41.836 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.836 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.836 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3.0", 2024-09-15T22:26:41.836 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.836 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.836 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.836 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:26:41.836 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_refresh_rate": { 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_refresh_rate", 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "20", 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:26:41.837 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.838 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.838 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.838 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.838 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_starting_port": { 2024-09-15T22:26:41.838 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_starting_port", 2024-09-15T22:26:41.838 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.838 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.838 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.838 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "4721", 2024-09-15T22:26:41.838 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.838 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.838 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.838 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:26:41.839 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.839 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.839 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.839 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.839 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_ptrace": { 2024-09-15T22:26:41.839 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_ptrace", 2024-09-15T22:26:41.839 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.839 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.839 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.839 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.839 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.839 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.839 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: "autotune_interval": { 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "autotune_interval", 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.840 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.841 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:26:41.841 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.841 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.841 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.841 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.841 INFO:teuthology.orchestra.run.smithi045.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:26:41.841 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:26:41.841 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:41.841 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.841 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.841 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0.7", 2024-09-15T22:26:41.841 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm_log_destination": { 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cephadm_log_destination", 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.842 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.843 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.843 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.843 INFO:teuthology.orchestra.run.smithi045.stdout: "file", 2024-09-15T22:26:41.843 INFO:teuthology.orchestra.run.smithi045.stdout: "file,syslog", 2024-09-15T22:26:41.843 INFO:teuthology.orchestra.run.smithi045.stdout: "syslog" 2024-09-15T22:26:41.843 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.843 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:26:41.843 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.843 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.843 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.843 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.843 INFO:teuthology.orchestra.run.smithi045.stdout: "cgroups_split": { 2024-09-15T22:26:41.843 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cgroups_split", 2024-09-15T22:26:41.844 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.844 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.844 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.844 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.844 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.844 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.844 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.844 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:26:41.844 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.844 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.844 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.844 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.844 INFO:teuthology.orchestra.run.smithi045.stdout: "config_checks_enabled": { 2024-09-15T22:26:41.845 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_checks_enabled", 2024-09-15T22:26:41.845 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.845 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.845 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.845 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.845 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.845 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.845 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.845 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:26:41.845 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.845 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.845 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.845 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.846 INFO:teuthology.orchestra.run.smithi045.stdout: "config_dashboard": { 2024-09-15T22:26:41.846 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_dashboard", 2024-09-15T22:26:41.846 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.846 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.846 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.846 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.846 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.846 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.846 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.846 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:26:41.846 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.846 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.846 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.847 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.847 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_alertmanager": { 2024-09-15T22:26:41.847 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_alertmanager", 2024-09-15T22:26:41.847 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.847 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.847 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.847 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:26:41.847 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.847 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.847 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.847 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-09-15T22:26:41.847 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.847 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.848 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.848 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.848 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_base": { 2024-09-15T22:26:41.848 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_base", 2024-09-15T22:26:41.848 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.848 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.848 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.848 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:26:41.848 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.848 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.848 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.848 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:26:41.848 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.849 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.849 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.849 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.849 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_elasticsearch": { 2024-09-15T22:26:41.849 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:26:41.849 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.849 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.849 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.849 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:26:41.849 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.849 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.849 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.849 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "elasticsearch container image", 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_grafana": { 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_grafana", 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.850 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-09-15T22:26:41.851 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.851 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.851 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.851 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.851 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_haproxy": { 2024-09-15T22:26:41.851 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_haproxy", 2024-09-15T22:26:41.851 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.851 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.851 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.851 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:26:41.851 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.851 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.852 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.852 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "HAproxy container image", 2024-09-15T22:26:41.852 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.852 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.852 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.852 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.852 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_agent": { 2024-09-15T22:26:41.852 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:26:41.852 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.852 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.852 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.852 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_collector": { 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.853 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:26:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:26:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_query": { 2024-09-15T22:26:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:26:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.854 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.855 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:26:41.855 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.855 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.855 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.855 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger query container image", 2024-09-15T22:26:41.855 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.855 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.855 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.855 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.855 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_keepalived": { 2024-09-15T22:26:41.855 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_keepalived", 2024-09-15T22:26:41.855 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.855 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.856 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.856 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:26:41.856 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.856 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.856 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.856 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Keepalived container image", 2024-09-15T22:26:41.856 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.856 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.856 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.856 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.856 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_loki": { 2024-09-15T22:26:41.856 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_loki", 2024-09-15T22:26:41.857 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.857 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.857 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.857 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:26:41.857 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.857 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.857 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.857 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Loki container image", 2024-09-15T22:26:41.857 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.857 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.857 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.857 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.857 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_node_exporter": { 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_node_exporter", 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_nvmeof": { 2024-09-15T22:26:41.858 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_nvmeof", 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Nvme-of container image", 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_prometheus": { 2024-09-15T22:26:41.859 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_prometheus", 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_promtail": { 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_promtail", 2024-09-15T22:26:41.860 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Promtail container image", 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_samba": { 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_samba", 2024-09-15T22:26:41.861 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_snmp_gateway": { 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.862 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.863 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.863 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:26:41.863 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.863 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.863 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.863 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:26:41.863 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.863 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.863 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.863 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.863 INFO:teuthology.orchestra.run.smithi045.stdout: "container_init": { 2024-09-15T22:26:41.863 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_init", 2024-09-15T22:26:41.863 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.864 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.864 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.864 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.864 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.864 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.864 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.864 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:26:41.864 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.864 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.864 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.864 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.864 INFO:teuthology.orchestra.run.smithi045.stdout: "daemon_cache_timeout": { 2024-09-15T22:26:41.864 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:26:41.865 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:26:41.866 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.866 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.866 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.866 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "900", 2024-09-15T22:26:41.866 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.866 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.866 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.866 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:26:41.866 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.866 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.866 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.866 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.866 INFO:teuthology.orchestra.run.smithi045.stdout: "default_registry": { 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "default_registry", 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io", 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "device_cache_timeout": { 2024-09-15T22:26:41.867 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_cache_timeout", 2024-09-15T22:26:41.868 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.868 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.868 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.868 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1800", 2024-09-15T22:26:41.868 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.868 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.868 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.868 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:26:41.868 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.868 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.868 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.868 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.868 INFO:teuthology.orchestra.run.smithi045.stdout: "device_enhanced_scan": { 2024-09-15T22:26:41.869 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_enhanced_scan", 2024-09-15T22:26:41.869 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.869 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.869 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.869 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.869 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.869 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.869 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.869 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:26:41.869 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.869 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.869 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.869 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: "facts_cache_timeout": { 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "facts_cache_timeout", 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.870 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: "grafana_dashboards_path": { 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.871 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.872 INFO:teuthology.orchestra.run.smithi045.stdout: "host_check_interval": { 2024-09-15T22:26:41.872 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "host_check_interval", 2024-09-15T22:26:41.872 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.872 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.872 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.872 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:41.872 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.872 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.872 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.872 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:26:41.872 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.872 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.872 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: "hw_monitoring": { 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "hw_monitoring", 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.873 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.874 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.874 INFO:teuthology.orchestra.run.smithi045.stdout: "inventory_list_all": { 2024-09-15T22:26:41.874 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "inventory_list_all", 2024-09-15T22:26:41.874 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.874 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.874 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.874 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.874 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.874 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.874 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.874 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:26:41.874 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.874 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:41.875 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:41.876 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.876 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:41.876 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:41.876 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.876 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.876 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.876 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.877 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.877 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.877 INFO:teuthology.orchestra.run.smithi045.stdout: "log_refresh_metadata": { 2024-09-15T22:26:41.877 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_refresh_metadata", 2024-09-15T22:26:41.877 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.877 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.877 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.877 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.877 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.878 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.878 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.878 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:26:41.878 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.878 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.878 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.878 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.878 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:41.878 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:41.878 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.878 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.878 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.878 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.879 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.879 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.879 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.879 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:26:41.879 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.879 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.879 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.879 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.879 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:41.879 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:41.879 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.879 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.879 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.880 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:41.880 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.880 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.880 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.880 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:41.880 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:41.880 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:41.880 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.880 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:41.880 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:41.880 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.880 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.881 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.882 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.882 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.882 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.882 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.882 INFO:teuthology.orchestra.run.smithi045.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:26:41.882 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:26:41.882 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.882 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.882 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.882 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.882 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.882 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.882 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.883 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:26:41.883 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.883 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.883 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.883 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.883 INFO:teuthology.orchestra.run.smithi045.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:26:41.883 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:26:41.883 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.883 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.883 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.883 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "*", 2024-09-15T22:26:41.883 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.883 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.884 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.884 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:26:41.884 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.884 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.884 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.884 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.884 INFO:teuthology.orchestra.run.smithi045.stdout: "max_count_per_host": { 2024-09-15T22:26:41.884 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_count_per_host", 2024-09-15T22:26:41.884 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.884 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.885 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.885 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:41.885 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.885 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.885 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.885 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:26:41.885 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.885 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.885 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.885 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.886 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd_draining_count": { 2024-09-15T22:26:41.886 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_osd_draining_count", 2024-09-15T22:26:41.886 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.886 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.886 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.886 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:41.886 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.886 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.886 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.886 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:26:41.886 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: "migration_current": { 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "migration_current", 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "internal - do not modify", 2024-09-15T22:26:41.887 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.888 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.888 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.888 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.888 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": { 2024-09-15T22:26:41.888 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mode", 2024-09-15T22:26:41.888 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.888 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.888 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.888 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "root", 2024-09-15T22:26:41.888 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.888 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.888 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.888 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm-package", 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: "root" 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: "oob_default_addr": { 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "oob_default_addr", 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "169.254.1.1", 2024-09-15T22:26:41.889 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.890 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.890 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.890 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:26:41.890 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.890 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.890 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.890 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.890 INFO:teuthology.orchestra.run.smithi045.stdout: "prometheus_alerts_path": { 2024-09-15T22:26:41.890 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:26:41.890 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.890 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.890 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.890 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:26:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:26:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_insecure": { 2024-09-15T22:26:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_insecure", 2024-09-15T22:26:41.891 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:26:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.892 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_password": { 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_password", 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.893 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_url": { 2024-09-15T22:26:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_url", 2024-09-15T22:26:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:26:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.894 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_username": { 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_username", 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.895 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.896 INFO:teuthology.orchestra.run.smithi045.stdout: "secure_monitoring_stack": { 2024-09-15T22:26:41.896 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:26:41.896 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.896 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.896 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.896 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.896 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.896 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.896 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.896 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:26:41.896 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.896 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.896 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.897 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.897 INFO:teuthology.orchestra.run.smithi045.stdout: "service_discovery_port": { 2024-09-15T22:26:41.897 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "service_discovery_port", 2024-09-15T22:26:41.897 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.897 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.897 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.897 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8765", 2024-09-15T22:26:41.897 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.897 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.897 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.897 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:26:41.897 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.897 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.898 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.898 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.898 INFO:teuthology.orchestra.run.smithi045.stdout: "ssh_config_file": { 2024-09-15T22:26:41.898 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssh_config_file", 2024-09-15T22:26:41.898 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.898 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.898 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.898 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.898 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.898 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.898 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.899 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:26:41.899 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.899 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.899 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.899 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.899 INFO:teuthology.orchestra.run.smithi045.stdout: "use_agent": { 2024-09-15T22:26:41.899 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "use_agent", 2024-09-15T22:26:41.899 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.899 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.899 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.899 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.899 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.900 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.900 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.900 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:26:41.900 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.900 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.900 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.900 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.900 INFO:teuthology.orchestra.run.smithi045.stdout: "use_repo_digest": { 2024-09-15T22:26:41.900 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "use_repo_digest", 2024-09-15T22:26:41.900 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.900 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.900 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_failed_host_check": { 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.901 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.902 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.902 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.902 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.902 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.902 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:26:41.902 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.902 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.902 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.902 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.902 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_stray_daemons": { 2024-09-15T22:26:41.902 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:26:41.902 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.902 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_stray_hosts": { 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.903 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.904 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.904 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.904 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.904 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.904 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.904 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:26:41.904 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.904 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.904 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.904 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:41.904 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:41.904 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.904 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:41.905 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crash", 2024-09-15T22:26:41.905 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:41.905 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:41.905 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:41.905 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:41.905 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:41.905 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.905 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.905 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.905 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.905 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.906 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.907 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:41.907 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:41.907 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.907 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.907 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.907 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.907 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.907 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.907 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.907 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.907 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.907 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.908 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.908 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.908 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:41.908 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:41.908 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.908 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.908 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.908 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:41.908 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.908 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.908 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.908 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:41.908 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.909 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.910 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.910 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.910 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.910 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.910 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.910 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.910 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.910 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.910 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.910 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.910 INFO:teuthology.orchestra.run.smithi045.stdout: "retain_interval": { 2024-09-15T22:26:41.911 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "retain_interval", 2024-09-15T22:26:41.912 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.912 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.912 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.912 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "31536000", 2024-09-15T22:26:41.912 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.912 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.912 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.912 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:26:41.912 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.912 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.912 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.912 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.912 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_recent_interval": { 2024-09-15T22:26:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_recent_interval", 2024-09-15T22:26:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1209600", 2024-09-15T22:26:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:26:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.913 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "dashboard", 2024-09-15T22:26:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:26:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:26:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.914 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:41.915 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.915 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.915 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.915 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.915 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.915 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.915 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.915 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.915 INFO:teuthology.orchestra.run.smithi045.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:26:41.915 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:26:41.915 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.915 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.915 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.916 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.916 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.916 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.916 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.916 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.916 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.916 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.916 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.916 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.916 INFO:teuthology.orchestra.run.smithi045.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:26:41.916 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:26:41.916 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.916 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.917 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.917 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.917 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.917 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.917 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.917 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.917 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.917 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.917 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.917 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.917 INFO:teuthology.orchestra.run.smithi045.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:26:41.917 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:26:41.917 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:26:41.918 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:26:41.919 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:26:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.920 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.921 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:26:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:26:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.922 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:26:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:26:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.923 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.924 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:26:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:26:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.925 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:26:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:26:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.926 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:26:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:26:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.927 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:26:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:26:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.928 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.929 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.929 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.929 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.929 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.929 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.929 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.929 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:26:41.929 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:26:41.929 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.929 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.929 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.929 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-09-15T22:26:41.930 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.930 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.930 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.930 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.930 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.930 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.930 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.930 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.930 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:26:41.930 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:26:41.930 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.930 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_URL": { 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.931 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.932 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.932 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.932 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.932 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.932 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.932 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.932 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.932 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.932 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.932 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.932 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:26:41.932 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:26:41.932 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:26:41.933 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.934 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.934 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.934 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.934 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.934 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.934 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.934 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.934 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.934 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.934 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.934 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.934 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:26:41.935 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:26:41.935 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.935 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.935 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.935 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.935 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.935 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.935 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.935 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.935 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.935 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.935 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.935 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.936 INFO:teuthology.orchestra.run.smithi045.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:26:41.936 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:26:41.936 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.936 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.936 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.936 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.936 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.936 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.936 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.936 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.936 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.936 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.937 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.937 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.937 INFO:teuthology.orchestra.run.smithi045.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:26:41.937 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:26:41.937 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.937 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.937 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.937 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.937 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.937 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.937 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.937 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.938 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.938 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.938 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.938 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.938 INFO:teuthology.orchestra.run.smithi045.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:26:41.938 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:26:41.938 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.938 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.938 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.938 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.938 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.939 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.939 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.939 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.939 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.939 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.939 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.939 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.939 INFO:teuthology.orchestra.run.smithi045.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:26:41.939 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:26:41.939 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.939 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.939 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.939 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:26:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:26:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.940 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.941 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.941 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.941 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.941 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.941 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.941 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.941 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.941 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.941 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.941 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:26:41.941 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:26:41.941 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.942 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.942 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.942 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.942 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.942 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.942 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.942 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.942 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.942 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.942 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.942 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.942 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:26:41.942 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:26:41.943 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.943 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.943 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.943 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.943 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.943 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.943 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.943 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.943 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.943 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.943 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.943 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.944 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:26:41.944 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:26:41.944 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.944 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.944 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.944 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.944 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.944 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.944 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.944 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.944 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.944 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.945 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.946 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.946 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.946 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:26:41.946 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:26:41.946 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.946 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.946 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.946 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.946 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.946 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.946 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.946 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.946 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.947 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.948 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.948 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.948 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.948 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:26:41.948 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:26:41.948 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.948 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.948 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.948 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.948 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.948 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.948 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.949 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.949 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.949 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.949 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.949 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.949 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:26:41.949 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:26:41.949 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.949 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.949 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.949 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:26:41.949 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.949 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.950 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.950 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.950 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.950 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.950 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.950 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.950 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:26:41.950 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:26:41.950 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.950 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.950 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.950 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8", 2024-09-15T22:26:41.951 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.952 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.952 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.952 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.952 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.952 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.952 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.952 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.952 INFO:teuthology.orchestra.run.smithi045.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:26:41.952 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:26:41.952 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.952 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.952 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.953 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "45", 2024-09-15T22:26:41.953 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.953 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.953 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.953 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.953 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.953 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.953 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.953 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.953 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:26:41.953 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:26:41.953 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.953 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.954 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.954 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.954 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.954 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.954 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.954 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.954 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.954 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.954 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.954 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.954 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:26:41.954 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:26:41.955 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.955 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.955 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.955 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-09-15T22:26:41.955 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.955 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.955 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.955 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.955 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.955 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.955 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.955 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.955 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:26:41.956 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:26:41.956 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.956 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.956 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.956 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.956 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.956 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.956 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.956 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.956 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.956 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.956 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.957 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.958 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.958 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:26:41.958 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:26:41.958 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.958 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.958 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.958 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:41.958 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.958 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.958 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.958 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.958 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.958 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.959 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.959 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.959 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:26:41.959 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:26:41.959 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.959 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.959 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.959 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:41.959 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.959 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.959 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.959 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.959 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.960 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.960 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.960 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.960 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:26:41.960 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:26:41.960 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.960 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.960 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.960 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:41.960 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.960 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.960 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.961 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.961 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.961 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.961 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.961 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.961 INFO:teuthology.orchestra.run.smithi045.stdout: "cross_origin_url": { 2024-09-15T22:26:41.961 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cross_origin_url", 2024-09-15T22:26:41.961 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.961 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.961 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.961 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.961 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.961 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "crt_file": { 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crt_file", 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.962 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "debug": { 2024-09-15T22:26:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "debug", 2024-09-15T22:26:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.963 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:26:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "jwt_token_ttl": { 2024-09-15T22:26:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "jwt_token_ttl", 2024-09-15T22:26:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.964 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "28800", 2024-09-15T22:26:41.965 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.965 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.965 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.965 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.965 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.965 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.965 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.965 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.965 INFO:teuthology.orchestra.run.smithi045.stdout: "key_file": { 2024-09-15T22:26:41.965 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "key_file", 2024-09-15T22:26:41.965 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.965 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.965 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.966 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.966 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.966 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.966 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.966 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.966 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.966 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.966 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.966 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.966 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:41.966 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:41.966 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.966 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.967 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.967 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.967 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.967 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.967 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.967 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:41.967 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:41.967 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:41.967 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.967 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:41.967 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:41.967 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.967 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.968 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.968 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.968 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.968 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.968 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:41.968 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:41.968 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.968 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.968 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.968 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.968 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.968 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.968 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.969 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.969 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.969 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.969 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.969 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.969 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:41.969 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:41.969 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.969 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.969 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.969 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:41.969 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.969 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.970 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.970 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:41.970 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:41.970 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:41.970 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.970 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:41.970 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:41.970 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.970 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.970 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.970 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.970 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.970 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.971 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.972 INFO:teuthology.orchestra.run.smithi045.stdout: "motd": { 2024-09-15T22:26:41.972 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "motd", 2024-09-15T22:26:41.972 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.972 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.972 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.972 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.972 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.972 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.972 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.972 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "The message of the day", 2024-09-15T22:26:41.972 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.972 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.972 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.973 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.973 INFO:teuthology.orchestra.run.smithi045.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:26:41.973 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:26:41.973 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.973 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.973 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.973 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.973 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.973 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.973 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.973 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.973 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.973 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "::", 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.974 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.975 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.975 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.975 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-09-15T22:26:41.975 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-09-15T22:26:41.975 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.975 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.975 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.975 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8080", 2024-09-15T22:26:41.975 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.975 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.975 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.975 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.975 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl": { 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl", 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.976 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.977 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.977 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.977 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.977 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl_server_port": { 2024-09-15T22:26:41.977 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl_server_port", 2024-09-15T22:26:41.977 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.977 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.977 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.977 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8443", 2024-09-15T22:26:41.977 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.977 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.977 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.978 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.978 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.978 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.978 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.978 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.978 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_behaviour": { 2024-09-15T22:26:41.978 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_behaviour", 2024-09-15T22:26:41.978 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.978 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.978 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.978 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "redirect", 2024-09-15T22:26:41.978 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.979 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.979 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.979 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.979 INFO:teuthology.orchestra.run.smithi045.stdout: "redirect" 2024-09-15T22:26:41.979 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.979 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.979 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.979 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.979 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.979 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.979 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_error_status_code": { 2024-09-15T22:26:41.979 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_error_status_code", 2024-09-15T22:26:41.980 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:41.980 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.980 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.980 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "500", 2024-09-15T22:26:41.980 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "400", 2024-09-15T22:26:41.980 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "599", 2024-09-15T22:26:41.980 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.980 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.980 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.980 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.980 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.980 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.981 INFO:teuthology.orchestra.run.smithi045.stdout: "url_prefix": { 2024-09-15T22:26:41.981 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "url_prefix", 2024-09-15T22:26:41.981 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.981 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.981 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:41.981 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.981 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.981 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.981 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.981 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.981 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.981 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.981 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "devicehealth", 2024-09-15T22:26:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: "enable_monitoring": { 2024-09-15T22:26:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enable_monitoring", 2024-09-15T22:26:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.982 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.983 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.983 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.983 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.983 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.983 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "monitor device health metrics", 2024-09-15T22:26:41.983 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.983 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.983 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.983 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.983 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:41.983 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:41.983 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.983 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.984 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.984 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.984 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.984 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.984 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.984 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:41.984 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:41.984 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:41.984 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.984 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:41.984 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:41.984 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.985 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.985 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.985 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.985 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.985 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:41.985 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:41.985 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.985 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.985 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.985 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.985 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.985 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.986 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.986 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.986 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.986 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.986 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.986 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.986 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:41.986 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:41.986 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.986 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.986 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.986 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:41.986 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.987 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.987 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.987 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:41.987 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:41.987 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:41.987 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.987 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:41.987 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:41.987 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.987 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.987 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.987 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.987 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.988 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.988 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:41.988 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:41.988 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.988 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.988 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.988 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.988 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.988 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.988 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.988 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.988 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.989 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.989 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.989 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.989 INFO:teuthology.orchestra.run.smithi045.stdout: "mark_out_threshold": { 2024-09-15T22:26:41.989 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mark_out_threshold", 2024-09-15T22:26:41.989 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.989 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.989 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.989 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "2419200", 2024-09-15T22:26:41.989 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.989 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.989 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.989 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:26:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": { 2024-09-15T22:26:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pool_name", 2024-09-15T22:26:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "device_health_metrics", 2024-09-15T22:26:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.990 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.991 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:26:41.991 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.991 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.991 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.991 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.991 INFO:teuthology.orchestra.run.smithi045.stdout: "retention_period": { 2024-09-15T22:26:41.991 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "retention_period", 2024-09-15T22:26:41.991 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.991 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.991 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.991 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15552000", 2024-09-15T22:26:41.991 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.991 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:26:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: "scrape_frequency": { 2024-09-15T22:26:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "scrape_frequency", 2024-09-15T22:26:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "86400", 2024-09-15T22:26:41.992 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.993 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.993 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.993 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:26:41.993 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.993 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.993 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.993 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.993 INFO:teuthology.orchestra.run.smithi045.stdout: "self_heal": { 2024-09-15T22:26:41.993 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "self_heal", 2024-09-15T22:26:41.993 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.993 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.993 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.994 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:41.994 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.994 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.994 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.994 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:26:41.994 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.994 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.994 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.994 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.994 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:41.994 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:41.994 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.994 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.995 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.995 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:41.995 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.995 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.995 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.995 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:26:41.995 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.995 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.995 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.995 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.995 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_threshold": { 2024-09-15T22:26:41.995 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_threshold", 2024-09-15T22:26:41.995 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:41.996 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.996 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.996 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "7257600", 2024-09-15T22:26:41.996 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.996 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.996 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.996 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:26:41.996 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.996 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.996 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.996 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:41.996 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:41.996 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.997 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:41.997 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "diskprediction_local", 2024-09-15T22:26:41.997 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:41.997 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:41.997 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:41.997 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:41.997 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:41.997 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:41.997 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.997 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.997 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:41.997 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.997 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.998 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:41.998 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:41.998 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:41.998 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:41.998 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:41.998 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:41.998 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:41.998 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:41.998 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.998 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.998 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.998 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:41.998 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:41.999 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:41.999 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:41.999 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:41.999 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:41.999 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:41.999 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:41.999 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:41.999 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:41.999 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:41.999 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:41.999 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:41.999 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:41.999 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.000 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.000 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.000 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.000 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.000 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.000 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.000 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.000 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.000 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.000 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.000 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.000 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.001 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.001 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.001 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.001 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.001 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.001 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.001 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.001 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.001 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.001 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.001 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.001 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.001 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.002 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.002 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.002 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.002 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.002 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.002 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.002 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.002 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.002 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.002 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.002 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.002 INFO:teuthology.orchestra.run.smithi045.stdout: "predict_interval": { 2024-09-15T22:26:42.003 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "predict_interval", 2024-09-15T22:26:42.003 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.003 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.003 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.003 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "86400", 2024-09-15T22:26:42.003 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.003 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.003 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.003 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.003 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.003 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.003 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.003 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: "predictor_model": { 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "predictor_model", 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "prophetstor", 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.004 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.005 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:42.005 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:42.005 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.005 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.005 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.005 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:42.005 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.005 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.005 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.005 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.005 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.005 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "influx", 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": false, 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: "batch_size": { 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "batch_size", 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.006 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5000", 2024-09-15T22:26:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:26:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: "database": { 2024-09-15T22:26:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "database", 2024-09-15T22:26:42.007 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "ceph", 2024-09-15T22:26:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:26:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": { 2024-09-15T22:26:42.008 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "hostname", 2024-09-15T22:26:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:26:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.009 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "30", 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "5", 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.010 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.011 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.012 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.013 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.014 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.014 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.014 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.014 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.014 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.014 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.014 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.014 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.014 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.014 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.014 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.014 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.014 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.015 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.016 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.016 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.016 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.016 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.016 INFO:teuthology.orchestra.run.smithi045.stdout: "password": { 2024-09-15T22:26:42.016 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "password", 2024-09-15T22:26:42.016 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.016 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.016 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.016 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.016 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.016 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.017 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.017 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:26:42.017 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.017 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.017 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.017 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.017 INFO:teuthology.orchestra.run.smithi045.stdout: "port": { 2024-09-15T22:26:42.017 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "port", 2024-09-15T22:26:42.017 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.017 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.017 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.017 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8086", 2024-09-15T22:26:42.017 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB server port", 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl": { 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl", 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "false", 2024-09-15T22:26:42.018 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.019 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.019 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.019 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:26:42.019 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.019 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.019 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.019 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.019 INFO:teuthology.orchestra.run.smithi045.stdout: "threads": { 2024-09-15T22:26:42.019 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "threads", 2024-09-15T22:26:42.019 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.019 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.019 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.019 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:42.020 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-09-15T22:26:42.020 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "32", 2024-09-15T22:26:42.020 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.020 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:26:42.020 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.020 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.020 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.020 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.020 INFO:teuthology.orchestra.run.smithi045.stdout: "username": { 2024-09-15T22:26:42.020 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "username", 2024-09-15T22:26:42.020 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.020 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.020 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.021 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.021 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.021 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.021 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.021 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:26:42.021 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.021 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.021 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.021 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.021 INFO:teuthology.orchestra.run.smithi045.stdout: "verify_ssl": { 2024-09-15T22:26:42.021 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "verify_ssl", 2024-09-15T22:26:42.021 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.022 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.022 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.022 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "true", 2024-09-15T22:26:42.022 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.022 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.022 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.022 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:26:42.022 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.022 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.022 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.022 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.022 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.022 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "insights", 2024-09-15T22:26:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.023 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.024 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.024 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.024 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.024 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.024 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.024 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.024 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.024 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.024 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.024 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.024 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.024 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.024 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.025 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.025 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.025 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.025 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.025 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.025 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.025 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.025 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.025 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.025 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.025 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.025 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.025 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.026 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.027 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.027 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.027 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.027 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.027 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.027 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.027 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.027 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.027 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.027 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.027 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.027 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.028 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.028 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.028 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.028 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.028 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.028 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.028 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.028 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.028 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.028 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.028 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.028 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "iostat", 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.029 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.030 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.031 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.031 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.031 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.031 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.031 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.031 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.031 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.031 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.031 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.031 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.031 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.031 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.032 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.032 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.032 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.032 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.032 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.032 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.032 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.032 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.032 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.032 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.032 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.032 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.032 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.033 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.034 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.034 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.034 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.034 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.034 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.034 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.034 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.034 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.034 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.034 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.034 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "k8sevents", 2024-09-15T22:26:42.034 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.034 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.035 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.035 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_event_retention_days": { 2024-09-15T22:26:42.035 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ceph_event_retention_days", 2024-09-15T22:26:42.035 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.035 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.035 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.035 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "7", 2024-09-15T22:26:42.035 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.035 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.035 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.035 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T22:26:42.035 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.035 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.036 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.036 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.036 INFO:teuthology.orchestra.run.smithi045.stdout: "config_check_secs": { 2024-09-15T22:26:42.036 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_check_secs", 2024-09-15T22:26:42.036 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.036 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.036 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.036 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.036 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "10", 2024-09-15T22:26:42.036 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.036 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.036 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T22:26:42.036 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.037 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.037 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.037 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.037 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.037 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.037 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.037 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.037 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.037 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.037 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.037 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.037 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.037 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.038 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.039 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.039 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.039 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.039 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.039 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.039 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.039 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.039 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.039 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.039 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.039 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.039 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.039 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.040 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.041 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "localpool", 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: "failure_domain": { 2024-09-15T22:26:42.042 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "failure_domain", 2024-09-15T22:26:42.043 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.043 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.043 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.043 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "host", 2024-09-15T22:26:42.043 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.043 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.043 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.043 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:26:42.043 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:26:42.043 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.043 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.043 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.043 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.044 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.044 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.044 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.044 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.044 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.044 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.044 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.044 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.044 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.044 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.044 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.044 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.044 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.045 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.045 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.045 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.045 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.045 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.045 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.045 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.045 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.045 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.045 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.045 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.045 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.045 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.046 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.047 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.048 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.049 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.049 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.049 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": { 2024-09-15T22:26:42.049 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "min_size", 2024-09-15T22:26:42.049 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.049 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.049 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.049 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.049 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.049 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.049 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.049 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:26:42.049 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:26:42.050 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.050 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.050 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.050 INFO:teuthology.orchestra.run.smithi045.stdout: "num_rep": { 2024-09-15T22:26:42.050 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "num_rep", 2024-09-15T22:26:42.050 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.050 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.050 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.050 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3", 2024-09-15T22:26:42.050 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.050 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.051 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.051 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:26:42.051 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.051 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.051 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.051 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.051 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": { 2024-09-15T22:26:42.051 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pg_num", 2024-09-15T22:26:42.051 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.051 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.051 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.051 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "128", 2024-09-15T22:26:42.051 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.052 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.052 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.052 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:26:42.052 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.052 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.052 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.052 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.052 INFO:teuthology.orchestra.run.smithi045.stdout: "prefix": { 2024-09-15T22:26:42.052 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prefix", 2024-09-15T22:26:42.052 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.052 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.052 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.053 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.053 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.053 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.053 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.053 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:26:42.053 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.053 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.053 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.053 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.053 INFO:teuthology.orchestra.run.smithi045.stdout: "subtree": { 2024-09-15T22:26:42.053 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "subtree", 2024-09-15T22:26:42.053 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.053 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.054 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.054 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "rack", 2024-09-15T22:26:42.054 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.054 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.054 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.054 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:26:42.054 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:26:42.054 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.054 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.054 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.054 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.054 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.055 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.055 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mds_autoscaler", 2024-09-15T22:26:42.055 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.055 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.055 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.055 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.055 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.055 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.055 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.055 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.055 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.055 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.055 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.056 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.056 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.056 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.056 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.056 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.056 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.056 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.056 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.056 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.056 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.056 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.056 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.056 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.057 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.058 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.059 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.059 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.059 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.059 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.059 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.059 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.059 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.059 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.059 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.059 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.059 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.059 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.059 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.060 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.060 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.060 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.060 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.060 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.060 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.060 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.060 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.060 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.060 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.060 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.060 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.060 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mirroring", 2024-09-15T22:26:42.061 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.061 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.061 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.061 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.061 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.061 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.061 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.061 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.061 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.061 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.061 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.061 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.061 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.062 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.063 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.064 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.064 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.064 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.064 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.064 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.064 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.064 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.064 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.064 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.064 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.064 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.064 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.064 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.065 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.066 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.066 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.066 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.066 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.066 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.066 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.066 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.066 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.066 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.066 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.066 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "nfs", 2024-09-15T22:26:42.066 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.066 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.067 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.067 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.067 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.067 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.067 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.067 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.067 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.067 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.067 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.067 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.067 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.067 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.067 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.068 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.069 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.069 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.069 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.069 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.069 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.069 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.069 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.069 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.069 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.069 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.069 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.069 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.069 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.070 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.070 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.070 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.070 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.070 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.070 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.070 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.070 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.070 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.070 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.070 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.070 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.070 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.071 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.071 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.071 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.071 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.071 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.071 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.071 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.071 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.071 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.071 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.071 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.071 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.071 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.072 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.072 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.072 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.072 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.072 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.072 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.072 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.072 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.072 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "orchestrator", 2024-09-15T22:26:42.072 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.072 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.072 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.072 INFO:teuthology.orchestra.run.smithi045.stdout: "fail_fs": { 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "fail_fs", 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.073 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.074 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.075 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.076 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.076 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.076 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.076 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.076 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.076 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.076 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.076 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.076 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.076 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.076 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.076 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.076 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.077 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.078 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.078 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.078 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.078 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.078 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.078 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.078 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.078 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.078 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.078 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.078 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.079 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.080 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.080 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.080 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator": { 2024-09-15T22:26:42.080 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "orchestrator", 2024-09-15T22:26:42.080 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.080 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.080 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.080 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.080 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.080 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.080 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.080 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm", 2024-09-15T22:26:42.081 INFO:teuthology.orchestra.run.smithi045.stdout: "rook", 2024-09-15T22:26:42.081 INFO:teuthology.orchestra.run.smithi045.stdout: "test_orchestrator" 2024-09-15T22:26:42.081 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.081 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Orchestrator backend", 2024-09-15T22:26:42.081 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.081 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.081 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.081 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.081 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.081 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.081 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.081 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "osd_perf_query", 2024-09-15T22:26:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.082 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.083 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.084 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.084 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.084 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.084 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.084 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.084 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.084 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.084 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.084 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.084 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.084 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.084 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.085 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.085 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.085 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.085 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.085 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.085 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.085 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.085 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.085 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.085 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.085 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.085 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.086 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.086 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.086 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.086 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.086 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.086 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.086 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.086 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.086 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.086 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.086 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.086 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.086 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.087 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.087 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.087 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.087 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.087 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.087 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.087 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.087 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.087 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.087 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.087 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.087 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.088 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.088 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.088 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "osd_support", 2024-09-15T22:26:42.088 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.088 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.088 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.088 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.088 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.088 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.088 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.088 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.088 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.089 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.089 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.089 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.089 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.089 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.089 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.089 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.089 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.089 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.089 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.089 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.089 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.089 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.090 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.091 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.092 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.093 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.093 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.093 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.093 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.093 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.093 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.093 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.093 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.093 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.093 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.093 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.093 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.093 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pg_autoscaler", 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.094 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.095 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.095 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.095 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.095 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.095 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.095 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.095 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.095 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.095 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.095 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.095 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.095 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.095 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.096 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.097 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.097 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.097 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.097 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.097 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.097 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.097 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.097 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.097 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.097 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.097 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.097 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.098 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.098 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.098 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.098 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.098 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.098 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.098 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.098 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.098 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.098 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.098 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.099 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.099 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.099 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.099 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.099 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.099 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.099 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.099 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.099 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.099 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.099 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:42.099 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:42.099 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.100 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.100 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.100 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:42.100 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.100 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.100 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.100 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.100 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.100 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.100 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.100 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.100 INFO:teuthology.orchestra.run.smithi045.stdout: "threshold": { 2024-09-15T22:26:42.100 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "threshold", 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3.0", 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1.0", 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "scaling threshold", 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.101 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.102 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.102 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "progress", 2024-09-15T22:26:42.102 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.102 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.102 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.102 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_pg_recovery_event": { 2024-09-15T22:26:42.102 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:26:42.102 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.102 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.102 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.102 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.102 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.102 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: "enabled": { 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enabled", 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.103 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.104 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.105 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.105 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.105 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.105 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.105 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.105 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.105 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.105 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.105 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.105 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.105 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.105 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.105 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.106 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.107 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.107 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.107 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.107 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.107 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.107 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.107 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.107 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.107 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.107 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.107 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.107 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.107 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.108 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.108 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.108 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.108 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.108 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.108 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.108 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.108 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.108 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.108 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.108 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.108 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.108 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.109 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.109 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.109 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.109 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.109 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.109 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.109 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.109 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.109 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.109 INFO:teuthology.orchestra.run.smithi045.stdout: "max_completed_events": { 2024-09-15T22:26:42.109 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_completed_events", 2024-09-15T22:26:42.109 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.109 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "50", 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.110 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.111 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.111 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:42.111 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.111 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.111 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.111 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:26:42.111 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.111 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.111 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.111 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.111 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prometheus", 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: "cache": { 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cache", 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.112 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.113 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.113 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.113 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.113 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.113 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.113 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.113 INFO:teuthology.orchestra.run.smithi045.stdout: "exclude_perf_counters": { 2024-09-15T22:26:42.113 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "exclude_perf_counters", 2024-09-15T22:26:42.113 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.113 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.113 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.113 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.113 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.114 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.114 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.114 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:26:42.114 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:26:42.114 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.114 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.114 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.114 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.114 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.114 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.114 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.114 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.115 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.116 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.116 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.116 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.116 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.116 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.116 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.116 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.116 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.116 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.116 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.116 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.116 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.117 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.118 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.119 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_stats_pools": { 2024-09-15T22:26:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_stats_pools", 2024-09-15T22:26:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.120 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:26:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:26:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "300", 2024-09-15T22:26:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.121 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: "scrape_interval": { 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "scrape_interval", 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15.0", 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.122 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.123 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.123 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.123 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-09-15T22:26:42.123 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-09-15T22:26:42.123 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.123 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.123 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.123 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "::", 2024-09-15T22:26:42.123 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.123 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.123 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.123 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:26:42.123 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.124 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.124 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.124 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.124 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-09-15T22:26:42.124 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-09-15T22:26:42.124 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.124 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.124 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.124 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "9283", 2024-09-15T22:26:42.124 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.124 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.124 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.124 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:26:42.125 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.125 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.125 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.125 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.125 INFO:teuthology.orchestra.run.smithi045.stdout: "stale_cache_strategy": { 2024-09-15T22:26:42.125 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "stale_cache_strategy", 2024-09-15T22:26:42.125 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.125 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.125 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.125 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "log", 2024-09-15T22:26:42.125 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_behaviour": { 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_behaviour", 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "default", 2024-09-15T22:26:42.126 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.127 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.127 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.127 INFO:teuthology.orchestra.run.smithi045.stdout: "default", 2024-09-15T22:26:42.127 INFO:teuthology.orchestra.run.smithi045.stdout: "error" 2024-09-15T22:26:42.127 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.127 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.127 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.127 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.127 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.127 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.127 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_error_status_code": { 2024-09-15T22:26:42.127 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_error_status_code", 2024-09-15T22:26:42.127 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "500", 2024-09-15T22:26:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "400", 2024-09-15T22:26:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "599", 2024-09-15T22:26:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.128 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_support", 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.129 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.130 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.130 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.130 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.130 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.130 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.130 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.130 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.130 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.130 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.130 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.130 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.130 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.130 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.131 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.131 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.131 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.131 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.131 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.131 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.131 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.131 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.131 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.131 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.131 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.131 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.131 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.132 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.132 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.132 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.132 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.132 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.132 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.132 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.132 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.132 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.132 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.132 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.132 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.132 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.133 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.134 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.134 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.134 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.134 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.134 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.134 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.134 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.134 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.134 INFO:teuthology.orchestra.run.smithi045.stdout: "max_concurrent_snap_create": { 2024-09-15T22:26:42.134 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:26:42.134 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.134 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.134 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.135 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: "trash_purge_schedule": { 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "trash_purge_schedule", 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.136 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.137 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.137 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.137 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.137 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.137 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.137 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.137 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.137 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.137 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.137 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.137 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.137 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.137 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "restful", 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "enable_auth": { 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enable_auth", 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.138 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: "key_file": { 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "key_file", 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.139 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.140 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.140 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.140 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.140 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.140 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.140 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.140 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.140 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.140 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.141 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.142 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.142 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.142 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.142 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.142 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.142 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.142 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.142 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.142 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.142 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.142 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.142 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.142 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.143 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.144 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.145 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.145 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.145 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.145 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.145 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.145 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.145 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.145 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.145 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.145 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.145 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.145 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-09-15T22:26:42.145 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-09-15T22:26:42.146 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.147 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.148 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.148 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rgw", 2024-09-15T22:26:42.148 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.148 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.148 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.148 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.148 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.148 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.148 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.148 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.148 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.148 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.148 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.149 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.150 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.151 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.152 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.152 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.152 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.152 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.152 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.152 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.152 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.152 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.152 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.152 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.152 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.152 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.152 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:42.153 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.154 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.154 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.154 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:26:42.154 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.154 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.154 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.154 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.154 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.154 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.154 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.154 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rook", 2024-09-15T22:26:42.154 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.154 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.155 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.155 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.155 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.155 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.155 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.155 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.155 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.155 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.155 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.155 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.155 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.155 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.155 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.156 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.156 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.156 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.156 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.156 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.156 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.156 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.156 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.156 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.156 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.156 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.156 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.156 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.157 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.158 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.158 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.158 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.158 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.158 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.158 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.158 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.158 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.158 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.158 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.158 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.158 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.158 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.159 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.160 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.160 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.160 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.160 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.160 INFO:teuthology.orchestra.run.smithi045.stdout: "storage_class": { 2024-09-15T22:26:42.160 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "storage_class", 2024-09-15T22:26:42.160 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.160 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.160 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.160 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "local", 2024-09-15T22:26:42.160 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.160 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "selftest", 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.161 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.162 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.162 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.162 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.162 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.162 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.162 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.162 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.162 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.162 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.162 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.162 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.162 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.162 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.163 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.164 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.164 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.164 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.164 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.164 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.164 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.164 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.164 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.164 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.164 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.164 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.164 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.165 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.166 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: "roption1": { 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "roption1", 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.167 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.168 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.168 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.168 INFO:teuthology.orchestra.run.smithi045.stdout: "roption2": { 2024-09-15T22:26:42.168 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "roption2", 2024-09-15T22:26:42.168 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.168 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.168 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.168 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "xyz", 2024-09-15T22:26:42.168 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.168 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.168 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.168 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.168 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.169 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.169 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.169 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.169 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption1": { 2024-09-15T22:26:42.169 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption1", 2024-09-15T22:26:42.169 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.169 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.169 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.169 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.169 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.169 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.169 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption2": { 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption2", 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.170 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.171 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.171 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.171 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.171 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.171 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.171 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption3": { 2024-09-15T22:26:42.171 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption3", 2024-09-15T22:26:42.171 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.171 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.171 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.171 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.171 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.171 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.172 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.172 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.172 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.172 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.172 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.172 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.172 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption4": { 2024-09-15T22:26:42.172 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption4", 2024-09-15T22:26:42.172 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.172 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.172 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.172 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.172 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption5": { 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption5", 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.173 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.174 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.174 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.174 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.174 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.174 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.174 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.174 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.174 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption6": { 2024-09-15T22:26:42.174 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption6", 2024-09-15T22:26:42.174 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.174 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.174 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.174 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption7": { 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption7", 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.175 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.176 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-09-15T22:26:42.176 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "42", 2024-09-15T22:26:42.176 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.176 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.176 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.176 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.176 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.176 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.176 INFO:teuthology.orchestra.run.smithi045.stdout: "testkey": { 2024-09-15T22:26:42.176 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testkey", 2024-09-15T22:26:42.176 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.176 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.176 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: "testlkey": { 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testlkey", 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.177 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: "testnewline": { 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testnewline", 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.178 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.179 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.179 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.179 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.179 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.179 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.179 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.179 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.179 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.179 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.179 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.179 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.179 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.179 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snap_schedule", 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_m_granularity": { 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_m_granularity", 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:26:42.180 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.181 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.181 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.181 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.181 INFO:teuthology.orchestra.run.smithi045.stdout: "dump_on_update": { 2024-09-15T22:26:42.181 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "dump_on_update", 2024-09-15T22:26:42.181 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.181 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.181 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.181 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.181 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.181 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.181 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.181 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.182 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.183 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.183 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.183 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.183 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.183 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.183 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.183 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.183 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.183 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.183 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.183 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.183 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.184 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.184 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.184 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.184 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.184 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.184 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.184 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.184 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.184 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.184 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.184 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.184 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.184 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.185 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.186 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.186 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.186 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.186 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.186 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.186 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.186 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.186 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.186 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.186 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.186 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.186 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.186 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "stats", 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.187 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.188 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.188 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.188 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.188 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.188 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.188 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.188 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.188 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.188 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.188 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.188 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.188 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.188 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.189 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.189 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.189 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.189 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.189 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.189 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.189 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.189 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.189 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.189 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.189 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.189 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.189 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.190 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.190 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.190 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.190 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.190 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.190 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.190 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.190 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.190 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.190 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.190 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.190 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.190 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.191 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.191 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.191 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.191 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.191 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.191 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.191 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.191 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.191 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.191 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.191 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.191 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.191 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.192 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.193 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.193 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.193 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.193 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.193 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.193 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.193 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.193 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.193 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "status", 2024-09-15T22:26:42.193 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.193 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.193 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.194 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.195 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.195 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.195 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.195 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.195 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.195 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.195 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.195 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.195 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.195 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.195 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.195 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.195 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.196 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.196 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.196 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.196 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.196 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.196 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.196 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.196 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.196 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.196 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.196 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.196 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.196 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.197 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.197 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.197 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.197 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.197 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.197 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.197 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.197 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.197 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.197 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.197 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.197 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.197 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.198 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.198 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.198 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.198 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.198 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.198 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.198 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.198 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.198 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.198 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.198 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.198 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.199 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.199 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.199 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.199 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.199 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.199 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.199 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.199 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.199 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "telegraf", 2024-09-15T22:26:42.199 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.199 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.199 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.200 INFO:teuthology.orchestra.run.smithi045.stdout: "address": { 2024-09-15T22:26:42.200 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "address", 2024-09-15T22:26:42.200 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.200 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.200 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.200 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:26:42.200 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.200 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.200 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.200 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.200 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.200 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.200 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.201 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.201 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:42.201 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:42.201 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.201 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.201 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.201 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15", 2024-09-15T22:26:42.201 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.201 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.201 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.201 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.201 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.201 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.202 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.203 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.203 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.203 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.203 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.203 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.203 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.203 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.203 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.203 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.203 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.203 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.203 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.204 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.204 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.204 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.204 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.204 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.204 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.204 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.204 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.204 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.204 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.204 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.204 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.205 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.205 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.205 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.205 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.205 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.205 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.205 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.205 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.205 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.205 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.205 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.205 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.205 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.206 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.207 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.207 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.207 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.207 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.207 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.207 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.207 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.207 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.207 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.207 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.207 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "telemetry", 2024-09-15T22:26:42.207 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.207 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.208 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.208 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_basic": { 2024-09-15T22:26:42.208 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_basic", 2024-09-15T22:26:42.208 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.208 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.208 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.208 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.208 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.208 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.208 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.208 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:26:42.208 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.209 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.209 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.209 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.209 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_crash": { 2024-09-15T22:26:42.209 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_crash", 2024-09-15T22:26:42.209 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.209 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.209 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.209 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.209 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.209 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.209 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.209 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_device": { 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_device", 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:26:42.210 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_ident": { 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_ident", 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:26:42.211 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.212 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.212 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.212 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.212 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_perf": { 2024-09-15T22:26:42.212 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_perf", 2024-09-15T22:26:42.212 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.212 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.212 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.212 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.212 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.212 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.212 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.212 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:26:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: "contact": { 2024-09-15T22:26:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "contact", 2024-09-15T22:26:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.213 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "description": { 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "description", 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.214 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: "device_url": { 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_url", 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.215 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: "enabled": { 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enabled", 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.216 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.217 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.217 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.217 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.217 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.217 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.217 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:42.217 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:42.217 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.217 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.217 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.217 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "24", 2024-09-15T22:26:42.217 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "8", 2024-09-15T22:26:42.217 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.218 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.218 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.218 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.218 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.218 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.218 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.218 INFO:teuthology.orchestra.run.smithi045.stdout: "last_opt_revision": { 2024-09-15T22:26:42.218 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "last_opt_revision", 2024-09-15T22:26:42.218 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.218 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.218 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.218 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1", 2024-09-15T22:26:42.219 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.219 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.219 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.219 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.219 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.219 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.219 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.219 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.219 INFO:teuthology.orchestra.run.smithi045.stdout: "leaderboard": { 2024-09-15T22:26:42.219 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "leaderboard", 2024-09-15T22:26:42.219 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.219 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.219 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout: "leaderboard_description": { 2024-09-15T22:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "leaderboard_description", 2024-09-15T22:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.220 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.221 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.222 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.223 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.223 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.223 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.223 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.223 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.223 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.223 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.223 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.223 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.223 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.223 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.223 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.223 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.224 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.225 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.225 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.225 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.225 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.225 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.225 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.225 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.225 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.225 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.225 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.225 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.225 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.225 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "organization": { 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "organization", 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.226 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: "proxy": { 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "proxy", 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.227 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.228 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.228 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.228 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.228 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.228 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.228 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.228 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.228 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.228 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.228 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.228 INFO:teuthology.orchestra.run.smithi045.stdout: "url": { 2024-09-15T22:26:42.228 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "url", 2024-09-15T22:26:42.229 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.229 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.229 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.229 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:26:42.229 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.229 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.229 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.229 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.229 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.229 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.229 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.229 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "test_orchestrator", 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.230 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.231 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.232 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.232 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.232 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.232 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.232 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.232 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.232 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.232 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.232 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.232 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.232 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.232 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.232 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.233 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.234 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.234 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.234 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.234 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.234 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.234 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.234 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.234 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.234 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.234 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.234 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.234 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.234 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.235 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.236 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "volumes", 2024-09-15T22:26:42.236 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.236 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.236 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.236 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.236 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.236 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.236 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.236 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.236 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.236 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.236 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.237 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.237 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.237 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.237 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.237 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.237 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.237 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.237 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.237 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.237 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.237 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.237 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.237 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.238 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.238 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.238 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.238 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.238 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.238 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.238 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.238 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.238 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.238 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.238 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.238 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.238 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.239 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.239 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.239 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.239 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.239 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.239 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.239 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.239 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.239 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.239 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.239 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.239 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.239 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.240 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.241 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.241 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.241 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.241 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.241 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.241 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.241 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.241 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.241 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.241 INFO:teuthology.orchestra.run.smithi045.stdout: "max_concurrent_clones": { 2024-09-15T22:26:42.241 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_concurrent_clones", 2024-09-15T22:26:42.241 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.241 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.242 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.242 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "4", 2024-09-15T22:26:42.242 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.242 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.242 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.242 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:26:42.242 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.242 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.242 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.242 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.242 INFO:teuthology.orchestra.run.smithi045.stdout: "periodic_async_work": { 2024-09-15T22:26:42.242 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "periodic_async_work", 2024-09-15T22:26:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Periodically check for async work", 2024-09-15T22:26:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.243 INFO:teuthology.orchestra.run.smithi045.stdout: "snapshot_clone_delay": { 2024-09-15T22:26:42.244 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:26:42.244 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.244 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.244 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.244 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:42.244 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.244 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.244 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.244 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:26:42.244 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.244 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.244 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.244 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.245 INFO:teuthology.orchestra.run.smithi045.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:26:42.245 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:26:42.245 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.245 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.245 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.245 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.245 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.245 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.245 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.245 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:26:42.245 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.245 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.245 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.246 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.246 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.246 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.246 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.246 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix", 2024-09-15T22:26:42.246 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.246 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.246 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.246 INFO:teuthology.orchestra.run.smithi045.stdout: "discovery_interval": { 2024-09-15T22:26:42.246 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "discovery_interval", 2024-09-15T22:26:42.246 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:42.246 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.246 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.247 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "100", 2024-09-15T22:26:42.247 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.247 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.247 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.247 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.247 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.247 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.247 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.247 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.247 INFO:teuthology.orchestra.run.smithi045.stdout: "identifier": { 2024-09-15T22:26:42.247 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "identifier", 2024-09-15T22:26:42.247 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.247 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.248 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.248 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.248 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.248 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.248 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.248 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.248 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.248 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.248 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.248 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.248 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:42.248 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.249 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.250 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.250 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.250 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.250 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.250 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.250 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.250 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.250 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.250 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.250 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.250 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.250 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.250 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.251 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.251 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.251 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.251 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.251 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.251 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.251 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.251 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.251 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.251 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.251 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.251 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.252 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.253 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.253 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.253 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.253 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.253 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.253 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.253 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.253 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.253 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.253 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.253 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.253 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.253 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.254 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.255 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.255 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.255 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_host": { 2024-09-15T22:26:42.255 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_host", 2024-09-15T22:26:42.255 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.255 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.255 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.255 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.255 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.255 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.255 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.255 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.255 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.256 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.256 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.256 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.256 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_port": { 2024-09-15T22:26:42.256 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_port", 2024-09-15T22:26:42.256 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.256 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.256 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.256 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10051", 2024-09-15T22:26:42.256 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.256 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.256 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.256 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.257 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.257 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.257 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.257 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.257 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_sender": { 2024-09-15T22:26:42.257 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_sender", 2024-09-15T22:26:42.257 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.257 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.257 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.257 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:26:42.257 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.257 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.258 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.258 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.258 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.258 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.258 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.258 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.258 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.258 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.258 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-15T22:26:42.258 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.258 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.258 INFO:teuthology.orchestra.run.smithi045.stdout: "gid": 24899, 2024-09-15T22:26:42.258 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "y", 2024-09-15T22:26:42.259 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr_features": 4540701547738038271, 2024-09-15T22:26:42.259 INFO:teuthology.orchestra.run.smithi045.stdout: "available_modules": [ 2024-09-15T22:26:42.259 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.259 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "alerts", 2024-09-15T22:26:42.259 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.259 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.259 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.259 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:42.259 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:42.259 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.259 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.259 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.259 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:42.260 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.260 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.260 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.260 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:26:42.260 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.260 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.260 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.260 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.260 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.260 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.260 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.260 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.261 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.261 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.261 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.261 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.261 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.261 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.261 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.261 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.261 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.261 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.261 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.261 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.261 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.262 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.262 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.262 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.262 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.262 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.262 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.262 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.262 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.262 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.262 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.262 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.262 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.262 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.263 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.263 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.263 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.263 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.263 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.263 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.263 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.263 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.263 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.263 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.263 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.263 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.263 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.264 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.265 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.265 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.265 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.265 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.265 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.265 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.265 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.265 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.265 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.265 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.265 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.265 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_destination": { 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_destination", 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.266 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.267 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.267 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_from_name": { 2024-09-15T22:26:42.267 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_from_name", 2024-09-15T22:26:42.267 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.267 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.267 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.267 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "Ceph", 2024-09-15T22:26:42.267 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.267 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.267 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.267 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Email From: name", 2024-09-15T22:26:42.267 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.267 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.268 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.268 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.268 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_host": { 2024-09-15T22:26:42.268 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_host", 2024-09-15T22:26:42.268 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.268 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.268 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.268 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.268 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.268 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.268 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.268 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP server", 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_password": { 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_password", 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.269 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Password to authenticate with", 2024-09-15T22:26:42.270 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.270 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.270 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.270 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.270 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_port": { 2024-09-15T22:26:42.270 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_port", 2024-09-15T22:26:42.270 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.270 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.270 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.270 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "465", 2024-09-15T22:26:42.270 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.270 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.270 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.271 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP port", 2024-09-15T22:26:42.271 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.271 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.271 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.271 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.271 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_sender": { 2024-09-15T22:26:42.271 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_sender", 2024-09-15T22:26:42.271 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.271 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.271 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.271 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.271 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.272 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.272 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.272 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:26:42.272 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.272 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.272 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.272 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.272 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_ssl": { 2024-09-15T22:26:42.272 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_ssl", 2024-09-15T22:26:42.272 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.272 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.273 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.273 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.273 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.273 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.273 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.273 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:26:42.273 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.273 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.273 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.273 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.273 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_user": { 2024-09-15T22:26:42.273 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_user", 2024-09-15T22:26:42.274 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.274 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.274 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.274 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.274 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.274 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.274 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.274 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "User to authenticate as", 2024-09-15T22:26:42.274 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.274 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.274 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.274 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.274 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.275 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.275 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.275 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "balancer", 2024-09-15T22:26:42.275 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.275 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.275 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.275 INFO:teuthology.orchestra.run.smithi045.stdout: "active": { 2024-09-15T22:26:42.275 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "active", 2024-09-15T22:26:42.275 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.275 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.275 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.275 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.276 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.276 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.276 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.276 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:26:42.276 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.276 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.276 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.276 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.276 INFO:teuthology.orchestra.run.smithi045.stdout: "begin_time": { 2024-09-15T22:26:42.276 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "begin_time", 2024-09-15T22:26:42.276 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.276 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0000", 2024-09-15T22:26:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:26:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:26:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: "begin_weekday": { 2024-09-15T22:26:42.277 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "begin_weekday", 2024-09-15T22:26:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0", 2024-09-15T22:26:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "6", 2024-09-15T22:26:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:26:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:26:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.278 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_max_iterations": { 2024-09-15T22:26:42.279 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:26:42.279 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:42.279 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.279 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.279 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "25", 2024-09-15T22:26:42.279 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-09-15T22:26:42.279 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "250", 2024-09-15T22:26:42.279 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.279 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:26:42.279 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.279 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.279 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.279 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_metrics": { 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_metrics", 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.280 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.281 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_step": { 2024-09-15T22:26:42.281 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_step", 2024-09-15T22:26:42.281 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.281 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.281 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.281 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0.5", 2024-09-15T22:26:42.281 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0.001", 2024-09-15T22:26:42.281 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "0.999", 2024-09-15T22:26:42.281 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.281 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:26:42.281 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:26:42.281 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.282 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.282 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.282 INFO:teuthology.orchestra.run.smithi045.stdout: "end_time": { 2024-09-15T22:26:42.282 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "end_time", 2024-09-15T22:26:42.282 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.282 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.282 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.282 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "2359", 2024-09-15T22:26:42.282 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.282 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.282 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.282 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:26:42.283 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:26:42.283 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.283 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.283 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.283 INFO:teuthology.orchestra.run.smithi045.stdout: "end_weekday": { 2024-09-15T22:26:42.283 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "end_weekday", 2024-09-15T22:26:42.283 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:42.283 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.283 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.283 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:42.283 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0", 2024-09-15T22:26:42.283 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "6", 2024-09-15T22:26:42.283 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:26:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:26:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.284 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.285 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.286 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.286 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.286 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.286 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.286 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.286 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.286 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.286 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.286 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.286 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.286 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.286 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.287 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.287 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.287 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.287 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.287 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.287 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.287 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.287 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.287 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.287 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.287 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.287 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.287 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.288 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.289 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.289 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.289 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.289 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.289 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.289 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.289 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.289 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.289 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.289 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.289 INFO:teuthology.orchestra.run.smithi045.stdout: "min_score": { 2024-09-15T22:26:42.289 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "min_score", 2024-09-15T22:26:42.289 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.290 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.290 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.290 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:42.290 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.290 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.290 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.290 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:26:42.290 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.290 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.290 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.290 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.290 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": { 2024-09-15T22:26:42.290 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mode", 2024-09-15T22:26:42.291 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.291 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.291 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.291 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "upmap", 2024-09-15T22:26:42.291 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.291 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.291 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.291 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-compat", 2024-09-15T22:26:42.291 INFO:teuthology.orchestra.run.smithi045.stdout: "none", 2024-09-15T22:26:42.291 INFO:teuthology.orchestra.run.smithi045.stdout: "read", 2024-09-15T22:26:42.291 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap", 2024-09-15T22:26:42.291 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap-read" 2024-09-15T22:26:42.292 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.292 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Balancer mode", 2024-09-15T22:26:42.292 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.292 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.292 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.292 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.292 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_ids": { 2024-09-15T22:26:42.292 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pool_ids", 2024-09-15T22:26:42.292 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.292 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.292 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.292 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.292 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:42.293 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.294 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.294 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.294 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:26:42.294 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.294 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.294 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.294 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.294 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap_max_deviation": { 2024-09-15T22:26:42.294 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "upmap_max_deviation", 2024-09-15T22:26:42.294 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.294 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.294 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.294 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:42.295 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-09-15T22:26:42.295 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.295 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.295 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:26:42.295 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:26:42.295 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.295 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.295 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.295 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap_max_optimizations": { 2024-09-15T22:26:42.295 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:26:42.295 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:42.295 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.296 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.296 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.296 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.296 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.296 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.296 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:26:42.296 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.296 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.296 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.296 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.296 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.296 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.296 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.297 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cephadm", 2024-09-15T22:26:42.297 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.297 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.297 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.297 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_down_multiplier": { 2024-09-15T22:26:42.297 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_down_multiplier", 2024-09-15T22:26:42.297 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.297 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.297 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.297 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3.0", 2024-09-15T22:26:42.297 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.297 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.297 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.298 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:26:42.298 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.298 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.298 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.298 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.298 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_refresh_rate": { 2024-09-15T22:26:42.298 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_refresh_rate", 2024-09-15T22:26:42.298 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.298 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.298 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.298 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "20", 2024-09-15T22:26:42.298 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.298 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_starting_port": { 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_starting_port", 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "4721", 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.299 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.300 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.300 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:26:42.300 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.300 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.300 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.300 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.300 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_ptrace": { 2024-09-15T22:26:42.300 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_ptrace", 2024-09-15T22:26:42.300 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.300 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.300 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.300 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.301 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.301 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.301 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.301 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:26:42.301 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:26:42.301 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.301 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.301 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.301 INFO:teuthology.orchestra.run.smithi045.stdout: "autotune_interval": { 2024-09-15T22:26:42.301 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "autotune_interval", 2024-09-15T22:26:42.301 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.301 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.302 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.302 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:42.302 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.302 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.302 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.302 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:26:42.302 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.302 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.302 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.302 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.302 INFO:teuthology.orchestra.run.smithi045.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:26:42.302 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:26:42.302 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0.7", 2024-09-15T22:26:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:26:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm_log_destination": { 2024-09-15T22:26:42.303 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cephadm_log_destination", 2024-09-15T22:26:42.304 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.304 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.304 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.304 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.304 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.304 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.304 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.304 INFO:teuthology.orchestra.run.smithi045.stdout: "file", 2024-09-15T22:26:42.304 INFO:teuthology.orchestra.run.smithi045.stdout: "file,syslog", 2024-09-15T22:26:42.304 INFO:teuthology.orchestra.run.smithi045.stdout: "syslog" 2024-09-15T22:26:42.304 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.304 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:26:42.304 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.305 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.305 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.305 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.305 INFO:teuthology.orchestra.run.smithi045.stdout: "cgroups_split": { 2024-09-15T22:26:42.305 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cgroups_split", 2024-09-15T22:26:42.305 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.305 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.305 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.305 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.305 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.305 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.305 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.305 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:26:42.306 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.306 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.306 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.306 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.306 INFO:teuthology.orchestra.run.smithi045.stdout: "config_checks_enabled": { 2024-09-15T22:26:42.306 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_checks_enabled", 2024-09-15T22:26:42.306 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.306 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.306 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.306 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.306 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.306 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.306 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.307 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:26:42.307 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.307 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.307 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.307 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.307 INFO:teuthology.orchestra.run.smithi045.stdout: "config_dashboard": { 2024-09-15T22:26:42.307 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_dashboard", 2024-09-15T22:26:42.307 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.307 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.307 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.307 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.307 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.308 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.308 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.308 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:26:42.308 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.308 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.308 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.308 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.308 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_alertmanager": { 2024-09-15T22:26:42.308 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_alertmanager", 2024-09-15T22:26:42.308 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.308 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.308 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.308 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:26:42.309 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.309 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.309 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.309 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-09-15T22:26:42.309 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.309 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.309 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.309 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.309 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_base": { 2024-09-15T22:26:42.309 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_base", 2024-09-15T22:26:42.309 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.309 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.309 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.310 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:26:42.310 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.310 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.310 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.310 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:26:42.310 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.310 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.310 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.310 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.310 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_elasticsearch": { 2024-09-15T22:26:42.310 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:26:42.310 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.310 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.311 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.311 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:26:42.311 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.311 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.311 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.311 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "elasticsearch container image", 2024-09-15T22:26:42.311 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.311 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.311 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.311 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.311 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_grafana": { 2024-09-15T22:26:42.311 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_grafana", 2024-09-15T22:26:42.311 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:26:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-09-15T22:26:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_haproxy": { 2024-09-15T22:26:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_haproxy", 2024-09-15T22:26:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:26:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "HAproxy container image", 2024-09-15T22:26:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_agent": { 2024-09-15T22:26:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:26:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:26:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:26:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.314 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.315 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.315 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.315 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_collector": { 2024-09-15T22:26:42.315 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:26:42.315 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.315 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.315 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.315 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:26:42.315 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.315 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.315 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.315 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:26:42.315 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.316 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.316 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.316 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.316 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_query": { 2024-09-15T22:26:42.316 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:26:42.316 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.316 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.316 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.316 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:26:42.316 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.316 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.316 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.317 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger query container image", 2024-09-15T22:26:42.317 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.317 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.317 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.317 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.317 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_keepalived": { 2024-09-15T22:26:42.317 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_keepalived", 2024-09-15T22:26:42.317 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.317 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.317 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.317 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:26:42.317 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.317 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Keepalived container image", 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_loki": { 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_loki", 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.318 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Loki container image", 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_node_exporter": { 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_node_exporter", 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.319 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.320 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.320 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-09-15T22:26:42.320 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.320 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.320 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.320 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.320 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_nvmeof": { 2024-09-15T22:26:42.320 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_nvmeof", 2024-09-15T22:26:42.320 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.320 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.320 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.320 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:26:42.321 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.321 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.321 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.321 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Nvme-of container image", 2024-09-15T22:26:42.321 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.321 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.321 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.321 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.321 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_prometheus": { 2024-09-15T22:26:42.321 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_prometheus", 2024-09-15T22:26:42.321 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.321 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.321 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_promtail": { 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_promtail", 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.322 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.323 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:26:42.323 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.323 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.323 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.323 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Promtail container image", 2024-09-15T22:26:42.323 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.323 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.323 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.323 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.323 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_samba": { 2024-09-15T22:26:42.323 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_samba", 2024-09-15T22:26:42.323 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.323 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.324 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.324 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:26:42.324 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.324 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.324 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.324 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:26:42.324 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.324 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.324 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.324 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.324 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_snmp_gateway": { 2024-09-15T22:26:42.324 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:26:42.324 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: "container_init": { 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_init", 2024-09-15T22:26:42.325 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.326 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.326 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.326 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.326 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.326 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.326 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.326 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:26:42.326 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.326 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.326 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.326 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.326 INFO:teuthology.orchestra.run.smithi045.stdout: "daemon_cache_timeout": { 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.327 INFO:teuthology.orchestra.run.smithi045.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:26:42.328 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:26:42.328 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.328 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.328 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.328 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "900", 2024-09-15T22:26:42.328 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.328 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.328 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.328 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:26:42.328 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.328 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.328 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.328 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.329 INFO:teuthology.orchestra.run.smithi045.stdout: "default_registry": { 2024-09-15T22:26:42.329 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "default_registry", 2024-09-15T22:26:42.329 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.329 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.329 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.329 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io", 2024-09-15T22:26:42.329 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.329 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.329 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.329 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:26:42.329 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.329 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.329 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.330 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.330 INFO:teuthology.orchestra.run.smithi045.stdout: "device_cache_timeout": { 2024-09-15T22:26:42.330 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_cache_timeout", 2024-09-15T22:26:42.330 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.330 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.330 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.330 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1800", 2024-09-15T22:26:42.330 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.330 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.330 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.330 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:26:42.330 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.330 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: "device_enhanced_scan": { 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_enhanced_scan", 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.331 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.332 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.332 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.332 INFO:teuthology.orchestra.run.smithi045.stdout: "facts_cache_timeout": { 2024-09-15T22:26:42.332 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "facts_cache_timeout", 2024-09-15T22:26:42.332 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.332 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.332 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.332 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:42.332 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.332 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.332 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.333 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:26:42.333 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.333 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.333 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.333 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.333 INFO:teuthology.orchestra.run.smithi045.stdout: "grafana_dashboards_path": { 2024-09-15T22:26:42.333 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:26:42.333 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.333 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.333 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.333 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:26:42.333 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.333 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: "host_check_interval": { 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "host_check_interval", 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.334 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: "hw_monitoring": { 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "hw_monitoring", 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.335 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:26:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: "inventory_list_all": { 2024-09-15T22:26:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "inventory_list_all", 2024-09-15T22:26:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.336 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.337 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.337 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.337 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:26:42.337 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.337 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.337 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.337 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.337 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.337 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.337 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.337 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.337 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.337 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.338 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.339 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.339 INFO:teuthology.orchestra.run.smithi045.stdout: "log_refresh_metadata": { 2024-09-15T22:26:42.339 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_refresh_metadata", 2024-09-15T22:26:42.339 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.339 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.339 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.339 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.339 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.339 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.339 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.339 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:26:42.339 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.340 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.340 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.340 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.340 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.340 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.340 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.340 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.340 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.340 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.340 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.340 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.340 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.340 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:26:42.341 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.341 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.341 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.341 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.341 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.341 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.341 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.341 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.341 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.341 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.341 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.341 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.341 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.342 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.342 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.342 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.342 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.342 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.342 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.342 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.342 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.342 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.342 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.342 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.342 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.342 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.343 INFO:teuthology.orchestra.run.smithi045.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:26:42.344 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:26:42.344 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.344 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.344 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.344 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.344 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.344 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.344 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.344 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:26:42.344 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.344 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.344 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.344 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.345 INFO:teuthology.orchestra.run.smithi045.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:26:42.345 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:26:42.345 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.345 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.345 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.345 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "*", 2024-09-15T22:26:42.345 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.345 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.345 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.345 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:26:42.345 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.345 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.345 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: "max_count_per_host": { 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_count_per_host", 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.346 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.347 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.347 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd_draining_count": { 2024-09-15T22:26:42.347 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_osd_draining_count", 2024-09-15T22:26:42.347 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.347 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.347 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.347 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.347 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.347 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.347 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.347 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:26:42.347 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.347 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.348 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.348 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.348 INFO:teuthology.orchestra.run.smithi045.stdout: "migration_current": { 2024-09-15T22:26:42.348 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "migration_current", 2024-09-15T22:26:42.348 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.348 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.348 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.348 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.348 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.348 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.348 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.348 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "internal - do not modify", 2024-09-15T22:26:42.348 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": { 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mode", 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "root", 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm-package", 2024-09-15T22:26:42.349 INFO:teuthology.orchestra.run.smithi045.stdout: "root" 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: "oob_default_addr": { 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "oob_default_addr", 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "169.254.1.1", 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.350 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.351 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.351 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:26:42.351 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.351 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.351 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.351 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.351 INFO:teuthology.orchestra.run.smithi045.stdout: "prometheus_alerts_path": { 2024-09-15T22:26:42.351 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:26:42.351 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.351 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.351 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.351 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:26:42.351 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.352 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.352 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.352 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:26:42.352 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.352 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.352 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.352 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.352 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_insecure": { 2024-09-15T22:26:42.352 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_insecure", 2024-09-15T22:26:42.352 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.352 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.352 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.353 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.353 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.353 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.353 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.353 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:26:42.353 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.353 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.353 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.353 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.353 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_password": { 2024-09-15T22:26:42.353 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_password", 2024-09-15T22:26:42.353 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.353 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.354 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.354 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.354 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.354 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.354 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.354 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:26:42.354 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.354 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.354 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.354 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.354 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_url": { 2024-09-15T22:26:42.354 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_url", 2024-09-15T22:26:42.354 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:26:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_username": { 2024-09-15T22:26:42.355 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_username", 2024-09-15T22:26:42.356 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.356 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.356 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.356 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.356 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.356 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.356 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.356 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:26:42.356 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.356 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.356 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.356 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.356 INFO:teuthology.orchestra.run.smithi045.stdout: "secure_monitoring_stack": { 2024-09-15T22:26:42.357 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:26:42.357 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.357 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.357 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.357 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.357 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.357 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.357 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.357 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:26:42.357 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.357 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.357 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.357 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.358 INFO:teuthology.orchestra.run.smithi045.stdout: "service_discovery_port": { 2024-09-15T22:26:42.358 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "service_discovery_port", 2024-09-15T22:26:42.358 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.358 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.358 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.358 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8765", 2024-09-15T22:26:42.358 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.358 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.358 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.358 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:26:42.358 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.358 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.358 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: "ssh_config_file": { 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssh_config_file", 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.359 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.360 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.360 INFO:teuthology.orchestra.run.smithi045.stdout: "use_agent": { 2024-09-15T22:26:42.360 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "use_agent", 2024-09-15T22:26:42.360 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.360 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.360 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.360 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.360 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.360 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.360 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.360 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:26:42.360 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.360 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.361 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.361 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.361 INFO:teuthology.orchestra.run.smithi045.stdout: "use_repo_digest": { 2024-09-15T22:26:42.361 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "use_repo_digest", 2024-09-15T22:26:42.361 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.361 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.361 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.361 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.361 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.361 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.361 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.361 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:26:42.361 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_failed_host_check": { 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:26:42.362 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.363 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.363 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.363 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.363 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_stray_daemons": { 2024-09-15T22:26:42.363 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:26:42.363 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.363 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.363 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.363 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.363 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.363 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.363 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.363 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:26:42.364 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.364 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.364 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.364 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.364 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_stray_hosts": { 2024-09-15T22:26:42.364 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:26:42.364 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.364 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.364 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.364 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.364 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.364 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.364 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.365 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:26:42.365 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.365 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.365 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.365 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.365 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.365 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.365 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.365 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crash", 2024-09-15T22:26:42.365 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.365 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.365 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.366 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.366 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.366 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.366 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.366 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.366 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.366 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.366 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.366 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.366 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.366 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.366 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.366 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.367 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.367 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.367 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.367 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.367 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.367 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.367 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.367 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.367 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.367 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.367 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.367 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.367 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.368 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.368 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.368 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.368 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.368 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.368 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.368 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.368 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.368 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.368 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.368 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.368 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.368 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.369 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.370 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.370 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.370 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.370 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.370 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.370 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.370 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.370 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.370 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.370 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.370 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.370 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.370 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.371 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.371 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.371 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.371 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.371 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.371 INFO:teuthology.orchestra.run.smithi045.stdout: "retain_interval": { 2024-09-15T22:26:42.371 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "retain_interval", 2024-09-15T22:26:42.371 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.371 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.371 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.371 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "31536000", 2024-09-15T22:26:42.371 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.371 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.372 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.372 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:26:42.372 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.372 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.372 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.372 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.372 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_recent_interval": { 2024-09-15T22:26:42.372 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_recent_interval", 2024-09-15T22:26:42.372 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.372 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.372 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.372 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1209600", 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "dashboard", 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.373 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.374 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.374 INFO:teuthology.orchestra.run.smithi045.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:26:42.374 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:26:42.374 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.374 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.374 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.374 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.374 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.374 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.374 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.374 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.374 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.374 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.375 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.375 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.375 INFO:teuthology.orchestra.run.smithi045.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:26:42.375 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:26:42.375 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.375 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.375 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.375 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.375 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.375 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.375 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.375 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.375 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.376 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.377 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.377 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.377 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.377 INFO:teuthology.orchestra.run.smithi045.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:26:42.377 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:26:42.377 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.377 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.377 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.377 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.377 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.377 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.377 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.377 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.378 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.379 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.379 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.379 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.379 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.379 INFO:teuthology.orchestra.run.smithi045.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:26:42.379 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:26:42.379 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.379 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.379 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.379 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.379 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.379 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.379 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.380 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.380 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.380 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.380 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.380 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.380 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:26:42.380 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:26:42.380 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.380 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.380 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.380 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.380 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.380 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.381 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.381 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.381 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.381 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.381 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.381 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.381 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:26:42.381 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:26:42.381 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.381 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.381 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.381 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.381 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.382 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.382 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.382 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.382 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.382 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.382 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.382 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.382 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:26:42.382 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:26:42.382 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.382 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.382 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.382 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.383 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.384 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.384 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.384 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.384 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.384 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.384 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.384 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.384 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.384 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:26:42.384 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:26:42.384 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.384 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.384 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.385 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.385 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.385 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.385 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.385 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.385 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.385 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.385 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.385 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.385 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:26:42.385 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:26:42.385 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.386 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.386 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.386 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.386 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.386 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.386 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.386 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.386 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.386 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.386 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.386 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.386 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:26:42.386 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:26:42.387 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:26:42.388 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.388 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.388 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.388 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.388 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.388 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.388 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.388 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.388 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.388 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.388 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.388 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.389 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.390 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:26:42.390 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:26:42.390 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.390 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.390 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.390 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.390 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.390 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.390 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.390 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.390 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.390 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.390 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.391 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.391 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_URL": { 2024-09-15T22:26:42.391 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:26:42.391 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.391 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.391 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.391 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.391 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.391 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.391 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.391 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.391 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.392 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:26:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:26:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.393 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.394 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.394 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.394 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.394 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.394 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:26:42.394 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:26:42.394 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.394 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.394 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.394 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.394 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.394 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.395 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.395 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.395 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.395 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.395 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.395 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.395 INFO:teuthology.orchestra.run.smithi045.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:26:42.395 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:26:42.395 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.395 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.395 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.395 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.395 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.396 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.396 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.396 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.396 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.396 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.396 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.396 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.396 INFO:teuthology.orchestra.run.smithi045.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:26:42.396 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:26:42.396 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.396 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.396 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.397 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.397 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.397 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.397 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.397 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.397 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.397 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.397 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.397 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.397 INFO:teuthology.orchestra.run.smithi045.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:26:42.397 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:26:42.397 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.397 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.398 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.399 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.399 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.399 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.399 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.399 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.399 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.399 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.399 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.399 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.399 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.399 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:26:42.399 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:26:42.400 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.400 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.400 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.400 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.400 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.400 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.400 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.400 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.400 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.400 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.400 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.400 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.400 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:26:42.401 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:26:42.401 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.401 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.401 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.401 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.401 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.401 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.401 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.401 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.401 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.401 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.401 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.402 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.403 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.403 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:26:42.403 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:26:42.403 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.403 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.403 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.403 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.403 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.403 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.403 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.403 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.403 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.404 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.404 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.404 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.404 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:26:42.404 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:26:42.404 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.404 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.404 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.404 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.404 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.404 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.404 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.404 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.405 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.405 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.405 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.405 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.405 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:26:42.405 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:26:42.405 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.405 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.405 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.405 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.405 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.405 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.406 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.407 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.407 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.407 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.407 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.407 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.407 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.407 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:26:42.407 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:26:42.407 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.407 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.407 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.407 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.407 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.408 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.408 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.408 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.408 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.408 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.408 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.408 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.408 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:26:42.408 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:26:42.408 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.408 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.408 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.409 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:26:42.409 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.409 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.409 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.409 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.409 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.409 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.409 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.409 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.409 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:26:42.409 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:26:42.409 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.409 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.410 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.410 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.410 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.410 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.410 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.410 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.410 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.410 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.410 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.410 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.410 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:26:42.410 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:26:42.410 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.411 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.411 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.411 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8", 2024-09-15T22:26:42.411 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.411 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.411 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.411 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.411 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.411 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.411 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.411 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.411 INFO:teuthology.orchestra.run.smithi045.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:26:42.411 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:26:42.412 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.412 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.412 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.412 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "45", 2024-09-15T22:26:42.412 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.412 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.412 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.412 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.412 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.412 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.412 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.412 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.412 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:26:42.413 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:26:42.413 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.413 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.413 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.413 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.413 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.413 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.413 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.413 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.413 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.413 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.413 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.413 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.414 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:26:42.414 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:26:42.414 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.414 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.414 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.414 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-09-15T22:26:42.414 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.414 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.414 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.414 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.414 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.414 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.414 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.415 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.415 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:26:42.415 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:26:42.415 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.415 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.415 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.415 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.415 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.415 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.415 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.415 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.415 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.415 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.416 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.416 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.416 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:26:42.416 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:26:42.416 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.416 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.416 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.416 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.416 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.416 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.416 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.416 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.416 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.417 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.417 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.417 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.417 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:26:42.417 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:26:42.417 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.417 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.417 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.417 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:42.417 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.417 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.417 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.417 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.418 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.419 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.419 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.419 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.419 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.419 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:26:42.419 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:26:42.419 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.419 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.419 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.419 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:42.419 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.419 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.420 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.420 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.420 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.420 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.420 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.420 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.420 INFO:teuthology.orchestra.run.smithi045.stdout: "cross_origin_url": { 2024-09-15T22:26:42.420 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cross_origin_url", 2024-09-15T22:26:42.420 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.420 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.420 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.420 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.421 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.421 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.421 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.421 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.421 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.421 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.421 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.421 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.421 INFO:teuthology.orchestra.run.smithi045.stdout: "crt_file": { 2024-09-15T22:26:42.421 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crt_file", 2024-09-15T22:26:42.421 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.421 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.421 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.422 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.422 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.422 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.422 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.422 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.422 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.422 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.422 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.422 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.422 INFO:teuthology.orchestra.run.smithi045.stdout: "debug": { 2024-09-15T22:26:42.422 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "debug", 2024-09-15T22:26:42.422 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.422 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: "jwt_token_ttl": { 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "jwt_token_ttl", 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.423 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "28800", 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: "key_file": { 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "key_file", 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.424 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.425 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.425 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.425 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.425 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.425 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.425 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.425 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.425 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.425 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.425 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.425 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.425 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.425 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.426 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.427 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.428 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.428 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.428 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.428 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.428 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.428 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.428 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.428 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.428 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.428 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.428 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.428 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.428 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.429 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.430 INFO:teuthology.orchestra.run.smithi045.stdout: "motd": { 2024-09-15T22:26:42.431 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "motd", 2024-09-15T22:26:42.431 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.431 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.431 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.431 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.431 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.431 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.431 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.431 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "The message of the day", 2024-09-15T22:26:42.431 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.431 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.431 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.431 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.432 INFO:teuthology.orchestra.run.smithi045.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:26:42.432 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:26:42.432 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.432 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.432 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.432 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.432 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.432 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.432 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.432 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.432 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.432 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.432 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "::", 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.433 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8080", 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.434 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl": { 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl", 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.435 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl_server_port": { 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl_server_port", 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8443", 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.436 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_behaviour": { 2024-09-15T22:26:42.437 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_behaviour", 2024-09-15T22:26:42.437 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.437 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.437 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.437 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "redirect", 2024-09-15T22:26:42.437 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.437 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.437 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.437 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.437 INFO:teuthology.orchestra.run.smithi045.stdout: "redirect" 2024-09-15T22:26:42.437 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.437 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.437 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.438 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.438 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.438 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.438 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_error_status_code": { 2024-09-15T22:26:42.438 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_error_status_code", 2024-09-15T22:26:42.438 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.438 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.438 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.438 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "500", 2024-09-15T22:26:42.438 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "400", 2024-09-15T22:26:42.438 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "599", 2024-09-15T22:26:42.438 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.438 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "url_prefix": { 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "url_prefix", 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.439 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.440 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.440 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.440 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.440 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.440 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.440 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.440 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "devicehealth", 2024-09-15T22:26:42.440 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.440 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.440 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.440 INFO:teuthology.orchestra.run.smithi045.stdout: "enable_monitoring": { 2024-09-15T22:26:42.440 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enable_monitoring", 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "monitor device health metrics", 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.441 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.442 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.443 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.444 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.444 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.444 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.444 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.444 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.444 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.444 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.444 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.444 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.444 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.444 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.444 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.445 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.445 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.445 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.445 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.445 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.445 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.445 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.445 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.445 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.445 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.445 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.445 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.445 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.446 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.447 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.447 INFO:teuthology.orchestra.run.smithi045.stdout: "mark_out_threshold": { 2024-09-15T22:26:42.447 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mark_out_threshold", 2024-09-15T22:26:42.447 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.447 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.447 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.447 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "2419200", 2024-09-15T22:26:42.447 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.447 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.447 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.447 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:26:42.447 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.447 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.448 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.448 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.448 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": { 2024-09-15T22:26:42.448 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pool_name", 2024-09-15T22:26:42.448 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.448 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.448 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.448 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "device_health_metrics", 2024-09-15T22:26:42.448 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.448 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.448 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.448 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: "retention_period": { 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "retention_period", 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15552000", 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.449 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:26:42.450 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.450 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.450 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.450 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.450 INFO:teuthology.orchestra.run.smithi045.stdout: "scrape_frequency": { 2024-09-15T22:26:42.450 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "scrape_frequency", 2024-09-15T22:26:42.450 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.450 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.450 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.450 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "86400", 2024-09-15T22:26:42.450 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.450 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.451 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.451 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:26:42.451 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.451 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.451 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.451 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.451 INFO:teuthology.orchestra.run.smithi045.stdout: "self_heal": { 2024-09-15T22:26:42.451 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "self_heal", 2024-09-15T22:26:42.451 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.451 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.451 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.451 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.451 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.452 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.452 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.452 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:26:42.452 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.452 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.452 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.452 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.452 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:42.452 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:42.452 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.452 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.452 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.452 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:42.453 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.453 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.453 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.453 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:26:42.453 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.453 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.453 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.453 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.453 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_threshold": { 2024-09-15T22:26:42.453 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_threshold", 2024-09-15T22:26:42.453 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.453 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.453 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.454 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "7257600", 2024-09-15T22:26:42.454 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.454 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.454 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.454 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:26:42.454 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.454 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.454 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.454 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.454 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.454 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.454 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.454 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "diskprediction_local", 2024-09-15T22:26:42.455 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.455 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.455 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.455 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.455 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.455 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.455 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.455 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.455 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.455 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.455 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.455 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.456 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.456 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.456 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.456 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.456 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.456 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.456 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.456 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.456 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.456 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.456 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.456 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.456 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.457 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.457 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.457 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.457 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.457 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.457 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.457 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.457 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.457 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.457 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.457 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.457 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.457 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.458 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.459 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.460 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.460 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.460 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.460 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.460 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.460 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.460 INFO:teuthology.orchestra.run.smithi045.stdout: "predict_interval": { 2024-09-15T22:26:42.460 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "predict_interval", 2024-09-15T22:26:42.460 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.460 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.460 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.460 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "86400", 2024-09-15T22:26:42.461 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.461 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.461 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.461 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.461 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.461 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.461 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.461 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.461 INFO:teuthology.orchestra.run.smithi045.stdout: "predictor_model": { 2024-09-15T22:26:42.461 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "predictor_model", 2024-09-15T22:26:42.461 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.461 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.461 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "prophetstor", 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.462 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.463 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:42.463 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.463 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.463 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.463 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.463 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.463 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.463 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.463 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.463 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.463 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.463 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.463 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "influx", 2024-09-15T22:26:42.464 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": false, 2024-09-15T22:26:42.464 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:26:42.464 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.464 INFO:teuthology.orchestra.run.smithi045.stdout: "batch_size": { 2024-09-15T22:26:42.464 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "batch_size", 2024-09-15T22:26:42.464 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.464 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.464 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.464 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5000", 2024-09-15T22:26:42.464 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.464 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.464 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.465 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:26:42.465 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.465 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.465 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.465 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.465 INFO:teuthology.orchestra.run.smithi045.stdout: "database": { 2024-09-15T22:26:42.465 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "database", 2024-09-15T22:26:42.465 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.465 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.465 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.465 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "ceph", 2024-09-15T22:26:42.465 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.465 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.466 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.466 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:26:42.466 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.466 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.466 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.466 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.466 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": { 2024-09-15T22:26:42.466 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "hostname", 2024-09-15T22:26:42.466 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.466 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.466 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.466 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.467 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.467 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.467 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.467 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:26:42.467 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.467 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.467 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.467 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.467 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:42.467 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:42.467 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.467 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.467 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.468 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "30", 2024-09-15T22:26:42.468 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "5", 2024-09-15T22:26:42.468 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.468 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.468 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:26:42.468 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.468 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.468 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.468 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.468 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.468 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.468 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.468 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.469 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.470 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.471 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.472 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.472 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.472 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.472 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.472 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.472 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.472 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.472 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.472 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.472 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.472 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.472 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.472 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "password": { 2024-09-15T22:26:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "password", 2024-09-15T22:26:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.473 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:26:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "port": { 2024-09-15T22:26:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "port", 2024-09-15T22:26:42.474 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8086", 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB server port", 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl": { 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl", 2024-09-15T22:26:42.475 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "false", 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "threads": { 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "threads", 2024-09-15T22:26:42.476 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "32", 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "username": { 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "username", 2024-09-15T22:26:42.477 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "verify_ssl": { 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "verify_ssl", 2024-09-15T22:26:42.478 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "true", 2024-09-15T22:26:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:26:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.479 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "insights", 2024-09-15T22:26:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.480 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.481 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.482 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.483 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.484 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "iostat", 2024-09-15T22:26:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.485 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.486 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.487 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.488 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.489 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.490 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.491 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.491 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.491 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.491 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.491 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "k8sevents", 2024-09-15T22:26:42.491 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.491 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.491 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.491 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_event_retention_days": { 2024-09-15T22:26:42.491 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ceph_event_retention_days", 2024-09-15T22:26:42.491 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.491 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.491 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "7", 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: "config_check_secs": { 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_check_secs", 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.492 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.493 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.493 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "10", 2024-09-15T22:26:42.493 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.493 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.493 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T22:26:42.493 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.493 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.493 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.493 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.493 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.493 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.493 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.494 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.495 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.496 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.496 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.496 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.496 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.496 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.496 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.496 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.496 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.496 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.496 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.496 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.496 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.496 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.497 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.497 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.497 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.497 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.497 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.497 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.497 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.497 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.497 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.497 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.497 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.497 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.497 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.498 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.499 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.499 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.499 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.499 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.499 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "localpool", 2024-09-15T22:26:42.499 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.499 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.499 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.499 INFO:teuthology.orchestra.run.smithi045.stdout: "failure_domain": { 2024-09-15T22:26:42.499 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "failure_domain", 2024-09-15T22:26:42.499 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.499 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "host", 2024-09-15T22:26:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:26:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:26:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.500 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.501 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.501 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.501 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.501 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.501 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.501 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.501 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.501 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.501 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.501 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.501 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.501 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.501 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.502 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.502 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.502 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.502 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.502 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.502 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.502 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.502 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.502 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.502 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.502 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.502 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.502 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.503 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.503 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.503 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.503 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.503 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.503 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.503 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.503 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.503 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.503 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.503 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.503 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.503 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.504 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.505 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.506 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.506 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": { 2024-09-15T22:26:42.506 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "min_size", 2024-09-15T22:26:42.506 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.506 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.506 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.506 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.506 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.506 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.506 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.506 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:26:42.506 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:26:42.506 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.507 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.507 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.507 INFO:teuthology.orchestra.run.smithi045.stdout: "num_rep": { 2024-09-15T22:26:42.507 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "num_rep", 2024-09-15T22:26:42.507 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.507 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.507 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.507 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3", 2024-09-15T22:26:42.507 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.507 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.507 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.508 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:26:42.508 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.508 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.508 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.508 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.508 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": { 2024-09-15T22:26:42.508 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pg_num", 2024-09-15T22:26:42.508 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.508 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.508 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.508 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "128", 2024-09-15T22:26:42.508 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.508 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.509 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.509 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:26:42.509 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.509 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.509 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.509 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.509 INFO:teuthology.orchestra.run.smithi045.stdout: "prefix": { 2024-09-15T22:26:42.509 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prefix", 2024-09-15T22:26:42.509 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.509 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.509 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.509 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: "subtree": { 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "subtree", 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.510 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "rack", 2024-09-15T22:26:42.511 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.511 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.511 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.511 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:26:42.511 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:26:42.511 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.511 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.511 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.511 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.511 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.511 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.511 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mds_autoscaler", 2024-09-15T22:26:42.511 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.512 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.512 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.512 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.512 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.512 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.512 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.512 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.512 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.512 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.512 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.512 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.512 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.512 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.513 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.513 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.513 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.513 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.513 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.513 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.513 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.513 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.513 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.513 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.513 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.513 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.513 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.514 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.514 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.514 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.514 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.514 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.514 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.514 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.514 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.514 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.514 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.514 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.514 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.514 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.515 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.516 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.516 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.516 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.516 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.516 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.516 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.516 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.516 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.516 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.516 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.516 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.516 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.516 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.517 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.517 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.517 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.517 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.517 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.517 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.517 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.517 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.517 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.517 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mirroring", 2024-09-15T22:26:42.517 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.517 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.517 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.518 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.519 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.519 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.519 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.519 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.519 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.519 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.519 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.519 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.519 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.519 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.519 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.519 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.519 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.520 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.520 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.520 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.520 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.520 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.520 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.520 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.520 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.520 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.520 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.520 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.520 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.520 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.521 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.522 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.522 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.522 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.522 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.522 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.522 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.522 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.522 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.522 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.522 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.522 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.522 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.523 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.523 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.523 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.523 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.523 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.523 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.523 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.523 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "nfs", 2024-09-15T22:26:42.523 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.523 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.523 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.524 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.524 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.524 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.524 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.524 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.524 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.524 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.524 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.525 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.525 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.525 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.525 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.525 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.525 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.525 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.525 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.525 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.525 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.525 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.525 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.525 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.526 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.527 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.527 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.527 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.527 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.527 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.527 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.527 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.527 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.527 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.527 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.527 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.527 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.527 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.528 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.528 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.528 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.528 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.528 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.528 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.528 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.528 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.528 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.528 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.528 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.528 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.528 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.529 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "orchestrator", 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "fail_fs": { 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "fail_fs", 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:26:42.530 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.531 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.531 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.531 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.531 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.531 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.531 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.531 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.531 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.531 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.531 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.531 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.531 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.531 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.532 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.532 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.532 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.532 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.532 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.532 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.532 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.532 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.532 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.532 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.532 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.532 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.532 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.533 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.534 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.534 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.534 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.534 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.534 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.534 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.534 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.534 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.534 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.534 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.534 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.534 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.534 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.535 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator": { 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "orchestrator", 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.536 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.537 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.537 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm", 2024-09-15T22:26:42.537 INFO:teuthology.orchestra.run.smithi045.stdout: "rook", 2024-09-15T22:26:42.537 INFO:teuthology.orchestra.run.smithi045.stdout: "test_orchestrator" 2024-09-15T22:26:42.537 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.537 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Orchestrator backend", 2024-09-15T22:26:42.537 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.537 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.537 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.537 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.537 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.537 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.538 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.538 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "osd_perf_query", 2024-09-15T22:26:42.538 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.538 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.538 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.538 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.538 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.538 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.538 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.538 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.538 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.538 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.538 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.539 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.539 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.539 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.539 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.539 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.539 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.539 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.539 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.539 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.539 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.539 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.540 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.540 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.540 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.540 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.540 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.540 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.540 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.540 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.540 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.540 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.540 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.541 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.541 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.541 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.541 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.541 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.541 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.541 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.541 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.541 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.541 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.541 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.541 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.541 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.542 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.543 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.543 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.543 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.543 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.543 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.543 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.543 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.543 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.543 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.543 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.543 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.543 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.543 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.544 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.544 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.544 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.544 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "osd_support", 2024-09-15T22:26:42.544 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.544 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.544 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.544 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.544 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.544 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.544 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.544 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.544 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.545 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.546 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.547 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.547 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.547 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.547 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.547 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.547 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.547 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.547 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.547 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.547 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.547 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.547 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.548 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.548 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.548 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.548 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.548 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.548 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.548 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.548 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.548 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.548 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.548 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.548 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.548 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.549 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.549 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.549 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.549 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.549 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.549 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.549 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.549 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.549 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.549 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.549 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.549 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pg_autoscaler", 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.550 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.551 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.552 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.552 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.552 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.552 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.552 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.552 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.552 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.552 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.552 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.552 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.552 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.552 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.552 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.553 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.553 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.553 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.553 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.553 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.553 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.553 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.553 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.553 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.553 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.553 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.553 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.554 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.555 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.555 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.555 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.555 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.555 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.555 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.555 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.555 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.555 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:42.555 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:42.555 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.555 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.555 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.556 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:42.556 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.556 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.556 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.556 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.556 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.556 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.556 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.556 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.556 INFO:teuthology.orchestra.run.smithi045.stdout: "threshold": { 2024-09-15T22:26:42.556 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "threshold", 2024-09-15T22:26:42.556 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.557 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.557 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.557 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3.0", 2024-09-15T22:26:42.557 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1.0", 2024-09-15T22:26:42.557 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.557 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.557 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "scaling threshold", 2024-09-15T22:26:42.557 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:26:42.557 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.557 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.557 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.557 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.557 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.558 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.558 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "progress", 2024-09-15T22:26:42.558 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.558 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.558 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.558 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_pg_recovery_event": { 2024-09-15T22:26:42.558 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:26:42.558 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.558 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.558 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.558 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.558 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.558 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: "enabled": { 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enabled", 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.559 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.560 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.560 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.560 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.560 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.560 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.560 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.560 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.560 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.560 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.560 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.560 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.560 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.561 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.561 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.561 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.561 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.561 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.561 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.561 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.561 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.561 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.561 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.561 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.561 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.561 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.562 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.562 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.562 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.562 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.562 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.562 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.562 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.562 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.562 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.562 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.562 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.562 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.563 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.564 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.565 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.565 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.565 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.565 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.565 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.565 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.565 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.565 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.565 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.565 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.565 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.565 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.565 INFO:teuthology.orchestra.run.smithi045.stdout: "max_completed_events": { 2024-09-15T22:26:42.566 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_completed_events", 2024-09-15T22:26:42.566 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.566 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.566 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.566 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "50", 2024-09-15T22:26:42.566 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.566 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.566 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.566 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:26:42.566 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.566 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.566 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.566 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.567 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:42.567 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:42.567 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.567 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.567 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.567 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:42.567 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.567 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.567 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.567 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:26:42.567 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.567 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.567 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.568 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.568 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.568 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.568 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.568 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prometheus", 2024-09-15T22:26:42.568 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.568 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.568 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.568 INFO:teuthology.orchestra.run.smithi045.stdout: "cache": { 2024-09-15T22:26:42.568 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cache", 2024-09-15T22:26:42.568 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.568 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.569 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.569 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.569 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.569 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.569 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.569 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.569 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.569 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.569 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.569 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.569 INFO:teuthology.orchestra.run.smithi045.stdout: "exclude_perf_counters": { 2024-09-15T22:26:42.569 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "exclude_perf_counters", 2024-09-15T22:26:42.569 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.570 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.570 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.570 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.570 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.570 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.570 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.570 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:26:42.570 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:26:42.570 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.570 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.570 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.570 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.571 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.571 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.571 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.571 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.571 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.571 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.571 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.571 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.571 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.571 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.571 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.571 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.571 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.572 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.573 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.573 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.573 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.573 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.573 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.573 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.573 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.573 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.573 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.573 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.573 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.573 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.573 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.574 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.574 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.574 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.574 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.574 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.574 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.574 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.574 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.574 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.574 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.574 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.574 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.574 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.575 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.575 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.575 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.575 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.575 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.575 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.575 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.575 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.575 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.575 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.575 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.575 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.575 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.576 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.576 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.576 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.576 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_stats_pools": { 2024-09-15T22:26:42.576 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_stats_pools", 2024-09-15T22:26:42.576 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.576 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.576 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.576 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.576 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.576 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.576 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.576 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.577 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.577 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.577 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.577 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.577 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:26:42.577 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:26:42.577 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.577 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.577 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.577 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "300", 2024-09-15T22:26:42.577 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.577 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.577 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.578 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.578 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.578 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.578 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.578 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.578 INFO:teuthology.orchestra.run.smithi045.stdout: "scrape_interval": { 2024-09-15T22:26:42.578 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "scrape_interval", 2024-09-15T22:26:42.578 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.578 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.578 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.578 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15.0", 2024-09-15T22:26:42.578 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "::", 2024-09-15T22:26:42.579 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.580 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.580 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.580 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:26:42.580 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.580 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.580 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.580 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.580 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-09-15T22:26:42.580 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-09-15T22:26:42.580 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.580 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.580 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.580 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "9283", 2024-09-15T22:26:42.581 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.581 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.581 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.581 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:26:42.581 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.581 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.581 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.581 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.581 INFO:teuthology.orchestra.run.smithi045.stdout: "stale_cache_strategy": { 2024-09-15T22:26:42.581 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "stale_cache_strategy", 2024-09-15T22:26:42.581 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.581 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "log", 2024-09-15T22:26:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_behaviour": { 2024-09-15T22:26:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_behaviour", 2024-09-15T22:26:42.582 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "default", 2024-09-15T22:26:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "default", 2024-09-15T22:26:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "error" 2024-09-15T22:26:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.583 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.584 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.584 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_error_status_code": { 2024-09-15T22:26:42.584 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_error_status_code", 2024-09-15T22:26:42.584 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.584 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.584 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.584 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "500", 2024-09-15T22:26:42.584 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "400", 2024-09-15T22:26:42.584 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "599", 2024-09-15T22:26:42.584 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.584 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.584 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.585 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.585 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.585 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.585 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.585 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.585 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.585 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_support", 2024-09-15T22:26:42.585 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.585 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.585 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.585 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.585 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.585 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.586 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.587 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.588 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.589 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.590 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "max_concurrent_snap_create": { 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.591 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:26:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:26:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.592 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "trash_purge_schedule": { 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "trash_purge_schedule", 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.593 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "restful", 2024-09-15T22:26:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: "enable_auth": { 2024-09-15T22:26:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enable_auth", 2024-09-15T22:26:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.594 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "key_file": { 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "key_file", 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.595 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.596 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.597 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.598 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.599 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.600 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.601 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.602 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-09-15T22:26:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-09-15T22:26:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.603 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rgw", 2024-09-15T22:26:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.604 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.605 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.606 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.607 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.608 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.609 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:26:42.610 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rook", 2024-09-15T22:26:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.611 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.612 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.613 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.614 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.615 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.616 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "storage_class": { 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "storage_class", 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "local", 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:26:42.617 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "selftest", 2024-09-15T22:26:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.618 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.619 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.620 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.621 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.622 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.623 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "roption1": { 2024-09-15T22:26:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "roption1", 2024-09-15T22:26:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.624 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "roption2": { 2024-09-15T22:26:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "roption2", 2024-09-15T22:26:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "xyz", 2024-09-15T22:26:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.625 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption1": { 2024-09-15T22:26:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption1", 2024-09-15T22:26:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.626 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption2": { 2024-09-15T22:26:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption2", 2024-09-15T22:26:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.627 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption3": { 2024-09-15T22:26:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption3", 2024-09-15T22:26:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.628 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption4": { 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption4", 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.629 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption5": { 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption5", 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.630 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption6": { 2024-09-15T22:26:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption6", 2024-09-15T22:26:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.631 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption7": { 2024-09-15T22:26:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption7", 2024-09-15T22:26:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.632 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "42", 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "testkey": { 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testkey", 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.633 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: "testlkey": { 2024-09-15T22:26:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testlkey", 2024-09-15T22:26:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.634 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.635 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.635 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.635 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.635 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.635 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.635 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.635 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.635 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.635 INFO:teuthology.orchestra.run.smithi045.stdout: "testnewline": { 2024-09-15T22:26:42.635 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testnewline", 2024-09-15T22:26:42.635 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.635 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.635 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.636 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.636 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.636 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.636 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.636 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.636 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.636 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.636 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.636 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.636 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.636 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.636 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.636 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snap_schedule", 2024-09-15T22:26:42.637 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.637 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.637 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.637 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_m_granularity": { 2024-09-15T22:26:42.637 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_m_granularity", 2024-09-15T22:26:42.637 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.637 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.637 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.637 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.637 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.637 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.637 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.637 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: "dump_on_update": { 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "dump_on_update", 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.638 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:26:42.639 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.639 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.639 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.639 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.639 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.639 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.639 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.639 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.639 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.639 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.639 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.639 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.639 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.640 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.640 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.640 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.640 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.640 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.640 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.640 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.640 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.640 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.640 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.640 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.640 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.641 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.641 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.641 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.641 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.641 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.641 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.641 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.641 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.641 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.641 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.641 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.641 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.641 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.642 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.642 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.642 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.642 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.642 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.642 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.642 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.642 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.642 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.642 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.642 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.642 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.643 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.643 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.643 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.643 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.643 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.643 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.643 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.643 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.643 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.643 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.643 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.643 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.643 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.644 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.644 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.644 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.644 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.644 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.644 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.644 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.644 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.644 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.644 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.644 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.644 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.644 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.645 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.645 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "stats", 2024-09-15T22:26:42.645 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.645 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.645 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.645 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.645 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.645 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.645 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.645 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.645 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.645 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.645 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.646 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.646 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.646 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.646 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.646 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.646 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.646 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.646 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.646 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.646 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.646 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.646 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.646 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.647 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.648 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.648 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.648 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.648 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.648 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.648 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.648 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.648 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.648 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.648 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.648 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.649 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.649 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.649 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.649 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.649 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.649 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.649 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.649 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.649 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.649 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.649 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.649 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.649 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.650 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "status", 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.651 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.652 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.652 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.652 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.652 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.652 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.652 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.652 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.652 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.652 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.652 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.652 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.652 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.652 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.653 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.654 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.654 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.654 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.654 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.654 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.654 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.654 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.654 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.654 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.654 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.654 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.654 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.654 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.655 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.656 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.656 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.656 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.656 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.656 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.656 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.656 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.656 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.656 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.656 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.656 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "telegraf", 2024-09-15T22:26:42.656 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.656 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.657 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.657 INFO:teuthology.orchestra.run.smithi045.stdout: "address": { 2024-09-15T22:26:42.657 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "address", 2024-09-15T22:26:42.657 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.657 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.657 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.657 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:26:42.657 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.657 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.657 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.657 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.657 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.657 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15", 2024-09-15T22:26:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.658 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.659 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.660 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.661 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.662 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.663 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.664 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "telemetry", 2024-09-15T22:26:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_basic": { 2024-09-15T22:26:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_basic", 2024-09-15T22:26:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.665 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:26:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_crash": { 2024-09-15T22:26:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_crash", 2024-09-15T22:26:42.666 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:26:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.667 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_device": { 2024-09-15T22:26:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_device", 2024-09-15T22:26:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:26:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.668 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_ident": { 2024-09-15T22:26:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_ident", 2024-09-15T22:26:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.669 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.670 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:26:42.670 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.670 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.670 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.670 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.670 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_perf": { 2024-09-15T22:26:42.670 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_perf", 2024-09-15T22:26:42.670 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.670 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.670 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.670 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.670 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.671 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.671 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.671 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:26:42.671 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.671 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.671 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.671 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.671 INFO:teuthology.orchestra.run.smithi045.stdout: "contact": { 2024-09-15T22:26:42.671 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "contact", 2024-09-15T22:26:42.671 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.672 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.672 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.672 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.672 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.672 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.672 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.672 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.672 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.672 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.672 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.672 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.673 INFO:teuthology.orchestra.run.smithi045.stdout: "description": { 2024-09-15T22:26:42.673 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "description", 2024-09-15T22:26:42.673 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.673 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.673 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.673 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.673 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.673 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.673 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.673 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.673 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.674 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.674 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.674 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.674 INFO:teuthology.orchestra.run.smithi045.stdout: "device_url": { 2024-09-15T22:26:42.674 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_url", 2024-09-15T22:26:42.674 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.674 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.674 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.674 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:26:42.674 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.674 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.675 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.675 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.675 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.675 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.675 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.675 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.675 INFO:teuthology.orchestra.run.smithi045.stdout: "enabled": { 2024-09-15T22:26:42.675 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enabled", 2024-09-15T22:26:42.675 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.675 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.675 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.676 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.676 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.676 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.676 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.676 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.676 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.676 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.676 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.676 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.676 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:42.676 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:42.676 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "24", 2024-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "8", 2024-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.677 INFO:teuthology.orchestra.run.smithi045.stdout: "last_opt_revision": { 2024-09-15T22:26:42.678 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "last_opt_revision", 2024-09-15T22:26:42.678 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.678 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.678 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.678 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1", 2024-09-15T22:26:42.678 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.678 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.678 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.678 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.678 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.678 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.678 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.679 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.679 INFO:teuthology.orchestra.run.smithi045.stdout: "leaderboard": { 2024-09-15T22:26:42.679 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "leaderboard", 2024-09-15T22:26:42.679 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.679 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.679 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.679 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.679 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.679 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.679 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.679 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.680 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.680 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.680 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.680 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.680 INFO:teuthology.orchestra.run.smithi045.stdout: "leaderboard_description": { 2024-09-15T22:26:42.680 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "leaderboard_description", 2024-09-15T22:26:42.680 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.680 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.680 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.680 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.680 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.681 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.681 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.681 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.681 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.681 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.681 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.681 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.681 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.681 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.681 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.682 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.682 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.682 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.682 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.682 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.682 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.682 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.682 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.682 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.682 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.682 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.683 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.683 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.683 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.683 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.683 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.683 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.683 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.683 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.683 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.683 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.683 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.684 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.684 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.684 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.684 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.684 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.684 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.684 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.684 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.684 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.684 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.684 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.685 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.685 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.685 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.685 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.685 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.685 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.685 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.685 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.685 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.685 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.685 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.686 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.686 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.686 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.686 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.686 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.686 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.686 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.686 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.686 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.686 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.686 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.686 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.687 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.687 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.687 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.687 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.687 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.687 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.687 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.687 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.687 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.687 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.687 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.688 INFO:teuthology.orchestra.run.smithi045.stdout: "organization": { 2024-09-15T22:26:42.688 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "organization", 2024-09-15T22:26:42.688 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.688 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.688 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.688 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.688 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.688 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.688 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.688 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.689 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.689 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.689 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.689 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.689 INFO:teuthology.orchestra.run.smithi045.stdout: "proxy": { 2024-09-15T22:26:42.689 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "proxy", 2024-09-15T22:26:42.689 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.689 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.689 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.689 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.689 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.690 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.690 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.690 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.690 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.690 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.690 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.690 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.690 INFO:teuthology.orchestra.run.smithi045.stdout: "url": { 2024-09-15T22:26:42.690 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "url", 2024-09-15T22:26:42.690 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.690 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.691 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.691 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:26:42.691 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.691 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.691 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.691 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.691 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.691 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.691 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.691 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.692 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.692 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.692 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.692 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "test_orchestrator", 2024-09-15T22:26:42.692 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.692 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.692 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.692 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.692 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.692 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.693 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.693 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.693 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.693 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.693 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.693 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.693 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.693 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.693 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.693 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.693 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.693 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.694 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.694 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.694 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.694 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.694 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.694 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.694 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.694 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.694 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.694 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.694 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.695 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.695 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.695 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.695 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.695 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.695 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.695 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.695 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.695 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.695 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.695 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.695 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.696 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.696 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.696 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.696 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.696 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.696 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.696 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.696 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.696 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.696 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.696 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.696 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.697 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.697 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.697 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.697 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.697 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.697 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.697 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.697 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.697 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.697 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.697 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.697 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.698 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.698 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.698 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.698 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.698 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.698 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.698 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.698 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.698 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.698 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.698 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.698 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "volumes", 2024-09-15T22:26:42.699 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.699 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.699 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.699 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.699 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.699 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.699 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.699 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.699 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.699 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.699 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.699 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.700 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.700 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.700 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.700 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.700 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.700 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.700 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.700 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.700 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.700 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.700 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.700 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.701 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.701 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.701 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.701 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.701 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.701 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.701 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.701 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.701 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.701 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.702 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.702 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.702 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.702 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.702 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.702 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.702 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.702 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.702 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.702 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.702 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.703 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.703 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.703 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.703 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.703 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.703 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.703 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.703 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.703 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.703 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.703 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.704 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.704 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.704 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.704 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.704 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.704 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.704 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.704 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.704 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.704 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.705 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.705 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.705 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.705 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.705 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.705 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.705 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.705 INFO:teuthology.orchestra.run.smithi045.stdout: "max_concurrent_clones": { 2024-09-15T22:26:42.705 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_concurrent_clones", 2024-09-15T22:26:42.705 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.705 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.705 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.706 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "4", 2024-09-15T22:26:42.706 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.706 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.706 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.706 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:26:42.706 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.706 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.706 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.706 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.706 INFO:teuthology.orchestra.run.smithi045.stdout: "periodic_async_work": { 2024-09-15T22:26:42.707 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "periodic_async_work", 2024-09-15T22:26:42.707 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.707 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.707 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.707 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.707 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.707 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.707 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.707 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Periodically check for async work", 2024-09-15T22:26:42.707 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.708 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.708 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.708 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.708 INFO:teuthology.orchestra.run.smithi045.stdout: "snapshot_clone_delay": { 2024-09-15T22:26:42.708 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:26:42.708 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.708 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.708 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.708 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:42.708 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.709 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.709 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.709 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:26:42.709 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.709 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.709 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.709 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.709 INFO:teuthology.orchestra.run.smithi045.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:26:42.709 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:26:42.709 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.710 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.710 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.710 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.710 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.710 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.710 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.710 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:26:42.710 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.710 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.710 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.710 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.710 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.711 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.711 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.711 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix", 2024-09-15T22:26:42.711 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.711 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.711 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.711 INFO:teuthology.orchestra.run.smithi045.stdout: "discovery_interval": { 2024-09-15T22:26:42.711 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "discovery_interval", 2024-09-15T22:26:42.711 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:42.711 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.711 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.712 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "100", 2024-09-15T22:26:42.712 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.712 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.712 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.712 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.712 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.712 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.712 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.712 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.712 INFO:teuthology.orchestra.run.smithi045.stdout: "identifier": { 2024-09-15T22:26:42.712 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "identifier", 2024-09-15T22:26:42.713 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.713 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.713 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.713 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.713 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.713 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.713 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.713 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.713 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.713 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.713 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.714 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.714 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:42.714 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:42.714 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.714 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.714 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.714 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:42.714 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.714 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.714 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.714 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.714 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.715 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.715 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.715 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.715 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.715 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.715 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.715 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.715 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.715 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.715 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.715 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.716 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.716 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.716 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.716 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.716 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.716 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.716 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.716 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.716 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.716 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.717 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.718 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.719 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.719 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.719 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.719 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.719 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.719 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.719 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.719 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.719 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.719 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.719 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.719 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.720 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.720 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.720 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.720 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.720 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.720 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.720 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.720 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.720 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.720 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.720 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.720 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.721 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.721 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.721 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.721 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.721 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.721 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_host": { 2024-09-15T22:26:42.721 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_host", 2024-09-15T22:26:42.721 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.721 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.721 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.722 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.722 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.722 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.722 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.722 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.722 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.722 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.722 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.722 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.722 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_port": { 2024-09-15T22:26:42.722 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_port", 2024-09-15T22:26:42.722 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.723 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.723 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.723 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10051", 2024-09-15T22:26:42.723 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.723 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.723 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.723 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.723 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.723 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.723 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.724 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.724 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_sender": { 2024-09-15T22:26:42.724 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_sender", 2024-09-15T22:26:42.724 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.724 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.724 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.724 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:26:42.724 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.724 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.724 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.724 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.725 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.725 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.725 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.725 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.725 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.725 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.725 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-15T22:26:42.725 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.725 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.725 INFO:teuthology.orchestra.run.smithi045.stdout: "modules": [ 2024-09-15T22:26:42.725 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm", 2024-09-15T22:26:42.726 INFO:teuthology.orchestra.run.smithi045.stdout: "dashboard", 2024-09-15T22:26:42.726 INFO:teuthology.orchestra.run.smithi045.stdout: "iostat", 2024-09-15T22:26:42.726 INFO:teuthology.orchestra.run.smithi045.stdout: "nfs", 2024-09-15T22:26:42.726 INFO:teuthology.orchestra.run.smithi045.stdout: "restful", 2024-09-15T22:26:42.726 INFO:teuthology.orchestra.run.smithi045.stdout: "snap_schedule" 2024-09-15T22:26:42.726 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.726 INFO:teuthology.orchestra.run.smithi045.stdout: "available_modules": [ 2024-09-15T22:26:42.726 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.726 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "alerts", 2024-09-15T22:26:42.726 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.726 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.727 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.727 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:42.727 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:42.727 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.727 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.727 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.727 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:42.727 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.727 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.727 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.728 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T22:26:42.728 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.728 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.728 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.728 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.728 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.728 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.728 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.728 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.728 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.729 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.729 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.729 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.729 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.729 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.729 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.729 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.729 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.729 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.729 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.729 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.729 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.730 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.730 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.730 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.730 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.730 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.730 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.730 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.730 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.730 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.730 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.730 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.731 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.731 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.731 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.731 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.731 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.731 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.731 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.731 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.731 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.731 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.731 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.732 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.732 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.732 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.732 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.732 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.732 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.732 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.732 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.732 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.732 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.732 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.733 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.733 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.733 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.733 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.733 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.733 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.733 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.733 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.733 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.733 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.733 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.734 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.734 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.734 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.734 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.734 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.734 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.734 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.734 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.734 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.734 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_destination": { 2024-09-15T22:26:42.734 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_destination", 2024-09-15T22:26:42.735 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.735 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.735 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.735 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.735 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.735 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.735 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.735 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Email address to send alerts to", 2024-09-15T22:26:42.735 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.735 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.735 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.735 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.736 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_from_name": { 2024-09-15T22:26:42.736 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_from_name", 2024-09-15T22:26:42.736 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.736 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.736 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.736 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "Ceph", 2024-09-15T22:26:42.736 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.736 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.736 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.736 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Email From: name", 2024-09-15T22:26:42.736 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.737 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.737 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.737 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.737 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_host": { 2024-09-15T22:26:42.737 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_host", 2024-09-15T22:26:42.737 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.737 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.737 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.737 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.737 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.737 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.738 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.738 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP server", 2024-09-15T22:26:42.738 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.738 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.738 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.738 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.738 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_password": { 2024-09-15T22:26:42.738 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_password", 2024-09-15T22:26:42.738 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.738 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.738 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.739 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.739 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.739 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.739 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.739 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Password to authenticate with", 2024-09-15T22:26:42.739 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.739 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.739 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.739 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.739 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_port": { 2024-09-15T22:26:42.739 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_port", 2024-09-15T22:26:42.739 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.740 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.740 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.740 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "465", 2024-09-15T22:26:42.740 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.740 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.740 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.740 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP port", 2024-09-15T22:26:42.740 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.740 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.740 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.740 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.740 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_sender": { 2024-09-15T22:26:42.741 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_sender", 2024-09-15T22:26:42.741 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.741 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.741 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.741 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.741 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.741 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.741 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.741 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SMTP envelope sender", 2024-09-15T22:26:42.741 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.741 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.742 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.742 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.742 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_ssl": { 2024-09-15T22:26:42.742 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_ssl", 2024-09-15T22:26:42.742 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.742 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.742 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.742 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.742 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.742 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.742 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.742 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T22:26:42.743 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.743 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.743 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.743 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.743 INFO:teuthology.orchestra.run.smithi045.stdout: "smtp_user": { 2024-09-15T22:26:42.743 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "smtp_user", 2024-09-15T22:26:42.743 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.743 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.743 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.743 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.743 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.744 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.744 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.744 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "User to authenticate as", 2024-09-15T22:26:42.744 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.744 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.744 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.744 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.744 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.745 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.745 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.745 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "balancer", 2024-09-15T22:26:42.745 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.745 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.745 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.745 INFO:teuthology.orchestra.run.smithi045.stdout: "active": { 2024-09-15T22:26:42.745 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "active", 2024-09-15T22:26:42.745 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.745 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.745 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.745 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.746 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.746 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.746 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.746 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T22:26:42.746 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.746 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.746 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.746 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.746 INFO:teuthology.orchestra.run.smithi045.stdout: "begin_time": { 2024-09-15T22:26:42.746 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "begin_time", 2024-09-15T22:26:42.746 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0000", 2024-09-15T22:26:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T22:26:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:26:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.747 INFO:teuthology.orchestra.run.smithi045.stdout: "begin_weekday": { 2024-09-15T22:26:42.748 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "begin_weekday", 2024-09-15T22:26:42.748 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:42.748 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.748 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.748 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:42.748 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0", 2024-09-15T22:26:42.748 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "6", 2024-09-15T22:26:42.748 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.748 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T22:26:42.748 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:26:42.749 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.749 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.749 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.749 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_max_iterations": { 2024-09-15T22:26:42.749 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_max_iterations", 2024-09-15T22:26:42.749 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:42.749 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.749 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.749 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "25", 2024-09-15T22:26:42.749 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-09-15T22:26:42.749 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "250", 2024-09-15T22:26:42.749 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.750 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T22:26:42.750 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.750 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.750 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.750 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.750 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_metrics": { 2024-09-15T22:26:42.750 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_metrics", 2024-09-15T22:26:42.750 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.750 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.750 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.750 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T22:26:42.750 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.751 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.751 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.751 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T22:26:42.751 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T22:26:42.751 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.751 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.751 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.751 INFO:teuthology.orchestra.run.smithi045.stdout: "crush_compat_step": { 2024-09-15T22:26:42.751 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crush_compat_step", 2024-09-15T22:26:42.751 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.751 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.752 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.752 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0.5", 2024-09-15T22:26:42.752 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0.001", 2024-09-15T22:26:42.752 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "0.999", 2024-09-15T22:26:42.752 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.752 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "aggressiveness of optimization", 2024-09-15T22:26:42.752 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T22:26:42.752 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.752 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.752 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.752 INFO:teuthology.orchestra.run.smithi045.stdout: "end_time": { 2024-09-15T22:26:42.752 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "end_time", 2024-09-15T22:26:42.753 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.753 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.753 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.753 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "2359", 2024-09-15T22:26:42.753 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.753 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.753 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.753 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T22:26:42.753 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T22:26:42.753 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.753 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.753 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.754 INFO:teuthology.orchestra.run.smithi045.stdout: "end_weekday": { 2024-09-15T22:26:42.754 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "end_weekday", 2024-09-15T22:26:42.754 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:42.754 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.754 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.754 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:42.754 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "0", 2024-09-15T22:26:42.754 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "6", 2024-09-15T22:26:42.754 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.754 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T22:26:42.755 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T22:26:42.755 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.755 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.755 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.755 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.755 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.755 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.755 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.755 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.755 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.755 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.755 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.756 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.756 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.756 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.756 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.756 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.756 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.756 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.756 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.756 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.756 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.756 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.757 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.757 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.757 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.757 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.757 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.757 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.757 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.757 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.757 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.757 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.757 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.757 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.758 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.758 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.758 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.758 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.758 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.758 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.758 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.758 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.758 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.758 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.758 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.758 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.759 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.759 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.759 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.759 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.759 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.759 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.759 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.759 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.759 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.759 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.759 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.760 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.760 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.760 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.760 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.760 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.760 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.760 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.760 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.760 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.760 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.760 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.760 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: "min_score": { 2024-09-15T22:26:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "min_score", 2024-09-15T22:26:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:42.761 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T22:26:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": { 2024-09-15T22:26:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mode", 2024-09-15T22:26:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.762 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "upmap", 2024-09-15T22:26:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: "crush-compat", 2024-09-15T22:26:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: "none", 2024-09-15T22:26:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: "read", 2024-09-15T22:26:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap", 2024-09-15T22:26:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap-read" 2024-09-15T22:26:42.763 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Balancer mode", 2024-09-15T22:26:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_ids": { 2024-09-15T22:26:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pool_ids", 2024-09-15T22:26:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.764 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.765 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.765 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.765 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.765 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T22:26:42.765 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.765 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.765 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.765 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.765 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:42.765 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:42.765 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.765 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.766 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.766 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:42.766 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.766 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.766 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.766 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T22:26:42.766 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.766 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.766 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.766 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.766 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap_max_deviation": { 2024-09-15T22:26:42.767 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "upmap_max_deviation", 2024-09-15T22:26:42.767 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.767 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.767 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.767 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:42.767 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-09-15T22:26:42.767 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.767 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.767 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T22:26:42.767 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T22:26:42.768 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.768 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.768 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.768 INFO:teuthology.orchestra.run.smithi045.stdout: "upmap_max_optimizations": { 2024-09-15T22:26:42.768 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "upmap_max_optimizations", 2024-09-15T22:26:42.768 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:42.768 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.768 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.768 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.768 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.768 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.769 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.769 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T22:26:42.769 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.769 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.769 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.769 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.769 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.769 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.769 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.769 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cephadm", 2024-09-15T22:26:42.769 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.770 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.770 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.770 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_down_multiplier": { 2024-09-15T22:26:42.770 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_down_multiplier", 2024-09-15T22:26:42.770 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.770 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.770 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.770 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3.0", 2024-09-15T22:26:42.770 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.770 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.771 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.771 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T22:26:42.771 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.771 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.771 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.771 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.771 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_refresh_rate": { 2024-09-15T22:26:42.771 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_refresh_rate", 2024-09-15T22:26:42.771 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.771 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.772 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.772 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "20", 2024-09-15T22:26:42.772 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.772 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.772 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.772 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T22:26:42.772 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.772 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.772 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.772 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.773 INFO:teuthology.orchestra.run.smithi045.stdout: "agent_starting_port": { 2024-09-15T22:26:42.773 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "agent_starting_port", 2024-09-15T22:26:42.773 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.773 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.773 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.773 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "4721", 2024-09-15T22:26:42.773 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.773 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.773 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.773 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T22:26:42.774 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.774 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.774 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.774 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.774 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_ptrace": { 2024-09-15T22:26:42.774 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_ptrace", 2024-09-15T22:26:42.774 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.774 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.774 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.774 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.774 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.774 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.775 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.775 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T22:26:42.775 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T22:26:42.775 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.775 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.775 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.775 INFO:teuthology.orchestra.run.smithi045.stdout: "autotune_interval": { 2024-09-15T22:26:42.775 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "autotune_interval", 2024-09-15T22:26:42.775 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.775 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.775 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.776 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:42.776 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.776 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.776 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.776 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T22:26:42.776 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.776 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.776 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.776 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.776 INFO:teuthology.orchestra.run.smithi045.stdout: "autotune_memory_target_ratio": { 2024-09-15T22:26:42.776 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T22:26:42.777 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:42.777 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.777 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.777 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0.7", 2024-09-15T22:26:42.777 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.777 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.777 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.777 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T22:26:42.777 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.777 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.777 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.778 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.778 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm_log_destination": { 2024-09-15T22:26:42.778 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cephadm_log_destination", 2024-09-15T22:26:42.778 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.778 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.778 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.778 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.778 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.778 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.778 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.778 INFO:teuthology.orchestra.run.smithi045.stdout: "file", 2024-09-15T22:26:42.778 INFO:teuthology.orchestra.run.smithi045.stdout: "file,syslog", 2024-09-15T22:26:42.779 INFO:teuthology.orchestra.run.smithi045.stdout: "syslog" 2024-09-15T22:26:42.779 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.779 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T22:26:42.779 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.779 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.779 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.779 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.779 INFO:teuthology.orchestra.run.smithi045.stdout: "cgroups_split": { 2024-09-15T22:26:42.779 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cgroups_split", 2024-09-15T22:26:42.779 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.779 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.780 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.780 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.780 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.780 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.780 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.780 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T22:26:42.780 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.780 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.780 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.780 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.780 INFO:teuthology.orchestra.run.smithi045.stdout: "config_checks_enabled": { 2024-09-15T22:26:42.780 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_checks_enabled", 2024-09-15T22:26:42.781 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.781 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.781 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.781 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.781 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.781 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.781 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.781 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T22:26:42.781 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.781 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.781 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.782 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.782 INFO:teuthology.orchestra.run.smithi045.stdout: "config_dashboard": { 2024-09-15T22:26:42.782 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_dashboard", 2024-09-15T22:26:42.782 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.782 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.782 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.782 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.782 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.782 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.782 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.782 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T22:26:42.783 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.783 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.783 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.783 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.783 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_alertmanager": { 2024-09-15T22:26:42.783 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_alertmanager", 2024-09-15T22:26:42.783 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.783 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.783 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.783 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T22:26:42.783 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.783 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.784 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.784 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-09-15T22:26:42.784 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.784 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.784 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.784 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.784 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_base": { 2024-09-15T22:26:42.784 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_base", 2024-09-15T22:26:42.784 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.784 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.785 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.785 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T22:26:42.785 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.785 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.785 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.785 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Container image name, without the tag", 2024-09-15T22:26:42.785 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.785 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.785 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.785 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.785 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_elasticsearch": { 2024-09-15T22:26:42.785 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_elasticsearch", 2024-09-15T22:26:42.786 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.786 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.786 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.786 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T22:26:42.786 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.786 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.786 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.786 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "elasticsearch container image", 2024-09-15T22:26:42.786 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.786 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.786 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.786 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.787 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_grafana": { 2024-09-15T22:26:42.787 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_grafana", 2024-09-15T22:26:42.787 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.787 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.787 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.787 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T22:26:42.787 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.787 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.787 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.787 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-09-15T22:26:42.787 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.788 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.788 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.788 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.788 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_haproxy": { 2024-09-15T22:26:42.788 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_haproxy", 2024-09-15T22:26:42.788 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.788 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.788 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.788 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T22:26:42.788 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.788 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.789 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.789 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "HAproxy container image", 2024-09-15T22:26:42.789 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.789 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.789 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.789 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.789 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_agent": { 2024-09-15T22:26:42.789 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_agent", 2024-09-15T22:26:42.789 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.789 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.789 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.789 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T22:26:42.790 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.790 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.790 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.790 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger agent container image", 2024-09-15T22:26:42.790 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.790 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.790 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.790 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.790 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_collector": { 2024-09-15T22:26:42.790 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_collector", 2024-09-15T22:26:42.790 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.791 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.791 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.791 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T22:26:42.791 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.791 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.791 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.791 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger collector container image", 2024-09-15T22:26:42.791 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.791 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.791 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.791 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.792 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_jaeger_query": { 2024-09-15T22:26:42.792 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_jaeger_query", 2024-09-15T22:26:42.792 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.792 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.792 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.792 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T22:26:42.792 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.792 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.792 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.792 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Jaeger query container image", 2024-09-15T22:26:42.793 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.793 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.793 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.793 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.793 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_keepalived": { 2024-09-15T22:26:42.793 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_keepalived", 2024-09-15T22:26:42.793 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.793 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.793 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.793 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T22:26:42.793 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.794 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.794 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.794 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Keepalived container image", 2024-09-15T22:26:42.794 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.794 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.794 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.794 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.794 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_loki": { 2024-09-15T22:26:42.794 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_loki", 2024-09-15T22:26:42.794 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.794 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.794 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.795 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T22:26:42.795 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.795 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.795 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.795 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Loki container image", 2024-09-15T22:26:42.795 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.795 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.795 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.795 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.795 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_node_exporter": { 2024-09-15T22:26:42.795 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_node_exporter", 2024-09-15T22:26:42.796 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.796 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.796 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.796 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T22:26:42.796 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.796 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.796 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.796 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-09-15T22:26:42.796 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.796 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.796 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.797 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.797 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_nvmeof": { 2024-09-15T22:26:42.797 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_nvmeof", 2024-09-15T22:26:42.797 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.797 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.797 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.797 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T22:26:42.797 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.797 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.797 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.797 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Nvme-of container image", 2024-09-15T22:26:42.798 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.798 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.798 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.798 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.798 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_prometheus": { 2024-09-15T22:26:42.798 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_prometheus", 2024-09-15T22:26:42.798 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.798 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.798 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.798 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T22:26:42.798 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.799 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.799 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.799 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Prometheus container image", 2024-09-15T22:26:42.799 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.799 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.799 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.799 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.799 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_promtail": { 2024-09-15T22:26:42.799 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_promtail", 2024-09-15T22:26:42.799 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.799 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.800 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.800 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T22:26:42.800 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.800 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.800 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.800 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Promtail container image", 2024-09-15T22:26:42.800 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.800 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.800 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.800 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.801 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_samba": { 2024-09-15T22:26:42.801 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_samba", 2024-09-15T22:26:42.801 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.801 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.801 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.801 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T22:26:42.801 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.801 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.801 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.801 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Samba/SMB container image", 2024-09-15T22:26:42.801 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.801 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.802 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.802 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.802 INFO:teuthology.orchestra.run.smithi045.stdout: "container_image_snmp_gateway": { 2024-09-15T22:26:42.802 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_image_snmp_gateway", 2024-09-15T22:26:42.802 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.802 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.802 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.802 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T22:26:42.802 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.802 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.802 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.802 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "SNMP Gateway container image", 2024-09-15T22:26:42.803 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.803 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.803 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.803 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.803 INFO:teuthology.orchestra.run.smithi045.stdout: "container_init": { 2024-09-15T22:26:42.803 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "container_init", 2024-09-15T22:26:42.803 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.803 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.803 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.803 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.803 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.804 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.804 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.804 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T22:26:42.804 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.804 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.804 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.804 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.804 INFO:teuthology.orchestra.run.smithi045.stdout: "daemon_cache_timeout": { 2024-09-15T22:26:42.804 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "daemon_cache_timeout", 2024-09-15T22:26:42.804 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.804 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.805 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.805 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:42.805 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.805 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.805 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.805 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T22:26:42.805 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.805 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.805 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.805 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.805 INFO:teuthology.orchestra.run.smithi045.stdout: "default_cephadm_command_timeout": { 2024-09-15T22:26:42.806 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T22:26:42.806 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.806 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.806 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.806 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "900", 2024-09-15T22:26:42.806 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.806 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.806 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.806 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T22:26:42.806 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.806 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.807 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.807 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.807 INFO:teuthology.orchestra.run.smithi045.stdout: "default_registry": { 2024-09-15T22:26:42.807 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "default_registry", 2024-09-15T22:26:42.807 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.807 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.807 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.807 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "docker.io", 2024-09-15T22:26:42.807 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.807 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.807 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.807 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T22:26:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: "device_cache_timeout": { 2024-09-15T22:26:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_cache_timeout", 2024-09-15T22:26:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1800", 2024-09-15T22:26:42.808 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.809 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.809 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.809 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache device inventory", 2024-09-15T22:26:42.809 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.809 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.809 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.809 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.809 INFO:teuthology.orchestra.run.smithi045.stdout: "device_enhanced_scan": { 2024-09-15T22:26:42.809 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_enhanced_scan", 2024-09-15T22:26:42.809 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.809 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.809 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.810 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.810 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.810 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.810 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.810 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T22:26:42.810 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.810 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.810 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.810 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.810 INFO:teuthology.orchestra.run.smithi045.stdout: "facts_cache_timeout": { 2024-09-15T22:26:42.810 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "facts_cache_timeout", 2024-09-15T22:26:42.811 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.811 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.811 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.811 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:42.811 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.811 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.811 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.811 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "seconds to cache host facts data", 2024-09-15T22:26:42.811 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.811 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.811 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.811 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.812 INFO:teuthology.orchestra.run.smithi045.stdout: "grafana_dashboards_path": { 2024-09-15T22:26:42.812 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "grafana_dashboards_path", 2024-09-15T22:26:42.812 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.812 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.812 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.812 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T22:26:42.812 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.812 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.812 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.812 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T22:26:42.813 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.813 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.813 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.813 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.813 INFO:teuthology.orchestra.run.smithi045.stdout: "host_check_interval": { 2024-09-15T22:26:42.813 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "host_check_interval", 2024-09-15T22:26:42.813 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.813 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.813 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.813 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:42.813 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.814 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.814 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.814 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to perform a host check", 2024-09-15T22:26:42.814 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.814 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.814 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.814 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.814 INFO:teuthology.orchestra.run.smithi045.stdout: "hw_monitoring": { 2024-09-15T22:26:42.814 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "hw_monitoring", 2024-09-15T22:26:42.814 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.814 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.814 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.815 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.815 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.815 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.815 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.815 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T22:26:42.815 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.815 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.815 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.815 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.815 INFO:teuthology.orchestra.run.smithi045.stdout: "inventory_list_all": { 2024-09-15T22:26:42.815 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "inventory_list_all", 2024-09-15T22:26:42.816 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.816 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.816 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.816 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.816 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.816 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.816 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.816 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T22:26:42.816 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.816 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.816 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.817 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.817 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.817 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.817 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.817 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.817 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.817 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.817 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.817 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.817 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.817 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.817 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.818 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.818 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.818 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.818 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.818 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.818 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.818 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.818 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.818 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.818 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.818 INFO:teuthology.orchestra.run.smithi045.stdout: "log_refresh_metadata": { 2024-09-15T22:26:42.819 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_refresh_metadata", 2024-09-15T22:26:42.819 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.819 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.819 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.819 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.819 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.819 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.819 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.819 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T22:26:42.819 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.820 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.820 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.820 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.820 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.820 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.820 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.820 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.820 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.820 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.820 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.820 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.821 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.821 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T22:26:42.821 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.821 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.821 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.821 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.821 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.821 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.821 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.821 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.821 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.822 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.822 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.822 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.822 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.822 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.822 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.822 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.822 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.822 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.822 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.822 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.823 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.823 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.823 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.823 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.823 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.823 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.823 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.823 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.823 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.823 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.823 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.824 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.824 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.824 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.824 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.824 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.824 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.824 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.824 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.824 INFO:teuthology.orchestra.run.smithi045.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T22:26:42.824 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T22:26:42.824 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.825 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.825 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.825 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.825 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.825 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.825 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.825 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T22:26:42.825 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.825 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.825 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.825 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.825 INFO:teuthology.orchestra.run.smithi045.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T22:26:42.826 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T22:26:42.826 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.826 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.826 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.826 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "*", 2024-09-15T22:26:42.826 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.826 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.826 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.826 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T22:26:42.826 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.826 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.827 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.827 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.827 INFO:teuthology.orchestra.run.smithi045.stdout: "max_count_per_host": { 2024-09-15T22:26:42.827 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_count_per_host", 2024-09-15T22:26:42.827 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.827 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.827 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.827 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.827 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.827 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.827 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.827 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "max number of daemons per service per host", 2024-09-15T22:26:42.828 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.828 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.828 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.828 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.828 INFO:teuthology.orchestra.run.smithi045.stdout: "max_osd_draining_count": { 2024-09-15T22:26:42.828 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_osd_draining_count", 2024-09-15T22:26:42.828 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.828 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.828 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.828 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.829 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.829 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.829 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.829 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T22:26:42.829 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.829 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.829 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.829 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.829 INFO:teuthology.orchestra.run.smithi045.stdout: "migration_current": { 2024-09-15T22:26:42.829 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "migration_current", 2024-09-15T22:26:42.829 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.830 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.830 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.830 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.830 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.830 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.830 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.830 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "internal - do not modify", 2024-09-15T22:26:42.830 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.830 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.830 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.831 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.831 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": { 2024-09-15T22:26:42.831 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mode", 2024-09-15T22:26:42.831 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.831 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.831 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.831 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "root", 2024-09-15T22:26:42.831 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.831 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.831 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.831 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm-package", 2024-09-15T22:26:42.832 INFO:teuthology.orchestra.run.smithi045.stdout: "root" 2024-09-15T22:26:42.832 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.832 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T22:26:42.832 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.832 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.832 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.832 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.832 INFO:teuthology.orchestra.run.smithi045.stdout: "oob_default_addr": { 2024-09-15T22:26:42.832 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "oob_default_addr", 2024-09-15T22:26:42.832 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.832 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.832 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.833 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "169.254.1.1", 2024-09-15T22:26:42.833 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.833 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.833 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.833 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T22:26:42.833 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.833 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.833 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.833 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.833 INFO:teuthology.orchestra.run.smithi045.stdout: "prometheus_alerts_path": { 2024-09-15T22:26:42.833 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prometheus_alerts_path", 2024-09-15T22:26:42.833 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.834 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.834 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.834 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T22:26:42.834 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.834 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.834 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.834 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T22:26:42.834 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.834 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.834 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.834 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.835 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_insecure": { 2024-09-15T22:26:42.835 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_insecure", 2024-09-15T22:26:42.835 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.835 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.835 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.835 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.835 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.835 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.835 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.835 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T22:26:42.835 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.836 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.836 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.836 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.836 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_password": { 2024-09-15T22:26:42.836 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_password", 2024-09-15T22:26:42.836 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.836 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.836 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.836 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.836 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.836 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.836 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.837 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T22:26:42.837 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.837 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.837 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.837 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.837 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_url": { 2024-09-15T22:26:42.837 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_url", 2024-09-15T22:26:42.837 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.837 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.837 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.838 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.838 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.838 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.838 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.838 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T22:26:42.838 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.838 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.838 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.838 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.838 INFO:teuthology.orchestra.run.smithi045.stdout: "registry_username": { 2024-09-15T22:26:42.838 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "registry_username", 2024-09-15T22:26:42.838 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.839 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.839 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.839 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.839 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.839 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.839 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.839 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T22:26:42.839 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.839 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.839 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.840 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.840 INFO:teuthology.orchestra.run.smithi045.stdout: "secure_monitoring_stack": { 2024-09-15T22:26:42.840 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "secure_monitoring_stack", 2024-09-15T22:26:42.840 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.840 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.840 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.840 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.840 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.840 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.840 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.840 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T22:26:42.841 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.841 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.841 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.841 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.841 INFO:teuthology.orchestra.run.smithi045.stdout: "service_discovery_port": { 2024-09-15T22:26:42.841 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "service_discovery_port", 2024-09-15T22:26:42.841 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.841 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.841 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.841 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8765", 2024-09-15T22:26:42.841 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.841 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.842 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.842 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "cephadm service discovery port", 2024-09-15T22:26:42.842 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.842 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.842 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.842 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.842 INFO:teuthology.orchestra.run.smithi045.stdout: "ssh_config_file": { 2024-09-15T22:26:42.842 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssh_config_file", 2024-09-15T22:26:42.842 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.842 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.842 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.842 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.843 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.843 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.843 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.843 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T22:26:42.843 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.843 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.843 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.843 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.843 INFO:teuthology.orchestra.run.smithi045.stdout: "use_agent": { 2024-09-15T22:26:42.843 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "use_agent", 2024-09-15T22:26:42.843 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.844 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.844 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.844 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.844 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.844 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.844 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.844 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T22:26:42.844 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.844 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.844 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.845 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.845 INFO:teuthology.orchestra.run.smithi045.stdout: "use_repo_digest": { 2024-09-15T22:26:42.845 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "use_repo_digest", 2024-09-15T22:26:42.845 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.845 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.845 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.845 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.845 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.845 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.845 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.845 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T22:26:42.845 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.846 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.846 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.846 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.846 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_failed_host_check": { 2024-09-15T22:26:42.846 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_failed_host_check", 2024-09-15T22:26:42.846 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.846 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.846 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.846 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.846 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.846 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.846 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.847 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T22:26:42.847 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.847 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.847 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.847 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.847 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_stray_daemons": { 2024-09-15T22:26:42.847 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_stray_daemons", 2024-09-15T22:26:42.847 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.847 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.847 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.847 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.848 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.848 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.848 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.848 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T22:26:42.848 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.848 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.848 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.848 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.848 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_on_stray_hosts": { 2024-09-15T22:26:42.848 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_on_stray_hosts", 2024-09-15T22:26:42.848 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.849 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.849 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.849 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.849 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.849 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.849 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.849 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T22:26:42.849 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.849 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.849 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.849 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.849 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.850 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.850 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.850 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crash", 2024-09-15T22:26:42.850 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.850 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.850 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.850 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.850 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.850 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.850 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.850 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.851 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.851 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.851 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.851 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.851 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.851 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.851 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.851 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.851 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.851 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.851 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.851 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.852 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.852 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.852 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.852 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.852 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.852 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.852 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.852 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.852 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.852 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.852 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.853 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.853 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.853 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.853 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.853 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.853 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.853 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.853 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.853 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.853 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.853 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.854 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.854 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.854 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.854 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.854 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.854 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.854 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.854 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.854 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.854 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.854 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.855 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.855 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.855 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.855 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.855 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.855 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.855 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.855 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.855 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.855 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.856 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.856 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.856 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.856 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.856 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.856 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.856 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.856 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.856 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.856 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.856 INFO:teuthology.orchestra.run.smithi045.stdout: "retain_interval": { 2024-09-15T22:26:42.857 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "retain_interval", 2024-09-15T22:26:42.857 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.857 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.857 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.857 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "31536000", 2024-09-15T22:26:42.857 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.857 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.857 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.857 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T22:26:42.857 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.857 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.858 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.858 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.858 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_recent_interval": { 2024-09-15T22:26:42.858 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_recent_interval", 2024-09-15T22:26:42.858 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.858 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.858 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.858 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1209600", 2024-09-15T22:26:42.858 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.858 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.858 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.859 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T22:26:42.859 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.859 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.859 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.859 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.859 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.859 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.859 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.859 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "dashboard", 2024-09-15T22:26:42.859 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.859 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.860 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.860 INFO:teuthology.orchestra.run.smithi045.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T22:26:42.860 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T22:26:42.860 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.860 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.860 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.860 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.860 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.860 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.860 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.860 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.861 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.861 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.861 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.861 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.861 INFO:teuthology.orchestra.run.smithi045.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T22:26:42.861 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T22:26:42.861 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.861 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.861 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.861 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.861 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.862 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.862 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.862 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.862 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.862 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.862 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.862 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.862 INFO:teuthology.orchestra.run.smithi045.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T22:26:42.862 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T22:26:42.862 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.862 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.863 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.863 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.863 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.863 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.863 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.863 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.863 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.863 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.863 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.863 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.863 INFO:teuthology.orchestra.run.smithi045.stdout: "AUDIT_API_ENABLED": { 2024-09-15T22:26:42.863 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T22:26:42.864 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.864 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.864 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.864 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.864 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.864 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.864 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.864 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.864 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.864 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.865 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.865 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.865 INFO:teuthology.orchestra.run.smithi045.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T22:26:42.865 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T22:26:42.865 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.865 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.865 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.865 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.865 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.865 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.865 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.865 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.866 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.866 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.866 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.866 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.866 INFO:teuthology.orchestra.run.smithi045.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T22:26:42.866 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T22:26:42.866 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.866 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.866 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.866 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.866 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.866 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.866 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.867 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.867 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.867 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.867 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.867 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.867 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T22:26:42.867 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T22:26:42.867 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.867 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.867 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.867 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.867 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.868 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.868 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.868 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.868 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.868 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.868 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.868 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.868 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T22:26:42.868 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T22:26:42.868 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.868 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.869 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.869 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.869 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.869 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.869 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.869 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.869 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.869 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.869 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.869 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.869 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T22:26:42.869 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T22:26:42.870 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.870 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.870 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.870 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.870 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.870 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.870 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.870 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.870 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.870 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.870 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.870 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.871 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T22:26:42.871 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T22:26:42.871 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.871 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.871 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.871 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.871 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.871 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.871 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.871 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.871 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.871 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.872 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.872 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.872 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T22:26:42.872 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T22:26:42.872 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.872 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.872 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.872 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.872 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.872 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.872 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.873 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.873 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.873 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.873 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.873 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.873 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T22:26:42.873 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T22:26:42.873 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.873 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.873 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.873 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.874 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.874 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.874 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.874 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.874 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.874 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.874 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.874 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.874 INFO:teuthology.orchestra.run.smithi045.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T22:26:42.874 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T22:26:42.874 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.875 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.875 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.875 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.875 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.875 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.875 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.875 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.875 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.875 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.875 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.875 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.876 INFO:teuthology.orchestra.run.smithi045.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T22:26:42.876 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T22:26:42.876 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.876 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.876 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.876 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.876 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.876 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.876 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.876 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.877 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.877 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.877 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.877 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.877 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T22:26:42.877 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T22:26:42.877 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.877 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.877 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.877 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-09-15T22:26:42.877 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.878 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.878 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.878 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.878 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.878 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.878 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.878 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.878 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T22:26:42.878 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T22:26:42.878 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.878 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.879 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.879 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.879 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.879 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.879 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.879 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.879 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.879 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.879 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.879 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.879 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_URL": { 2024-09-15T22:26:42.880 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_URL", 2024-09-15T22:26:42.880 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.880 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.880 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.880 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.880 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.880 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.880 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.880 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.880 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.880 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.881 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.881 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.881 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T22:26:42.881 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T22:26:42.881 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.881 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.881 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.881 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-09-15T22:26:42.881 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.881 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.881 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.881 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.882 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.882 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.882 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.882 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.882 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T22:26:42.882 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T22:26:42.882 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.882 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.882 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.882 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.882 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.883 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.883 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.883 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.883 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.883 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.883 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.883 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.883 INFO:teuthology.orchestra.run.smithi045.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T22:26:42.883 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T22:26:42.883 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.883 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.883 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.884 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.884 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.884 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.884 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.884 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.884 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.884 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.884 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.884 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.884 INFO:teuthology.orchestra.run.smithi045.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T22:26:42.884 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T22:26:42.884 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.885 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.885 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.885 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.885 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.885 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.885 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.885 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.885 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.885 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.885 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.885 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.886 INFO:teuthology.orchestra.run.smithi045.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T22:26:42.886 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T22:26:42.886 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.886 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.886 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.886 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.886 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.886 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.886 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.886 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.886 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.886 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.887 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.887 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.887 INFO:teuthology.orchestra.run.smithi045.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T22:26:42.887 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T22:26:42.887 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.887 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.887 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.887 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.887 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.887 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.887 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.888 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.888 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.888 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.888 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.888 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.888 INFO:teuthology.orchestra.run.smithi045.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T22:26:42.888 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T22:26:42.888 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.888 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.888 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.888 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.889 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.889 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.889 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.889 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.889 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.889 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.889 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.889 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.889 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T22:26:42.889 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T22:26:42.889 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.889 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.890 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.890 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.890 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.890 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.890 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.890 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.890 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.890 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.890 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.890 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.890 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T22:26:42.890 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T22:26:42.891 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.891 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.891 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.891 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.891 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.891 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.891 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.891 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.891 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.891 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.891 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.892 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.892 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T22:26:42.892 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T22:26:42.892 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.892 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.892 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.892 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.892 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.892 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.892 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.892 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.892 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.893 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.893 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.893 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.893 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T22:26:42.893 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T22:26:42.893 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.893 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.893 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.893 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.893 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.893 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.894 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.894 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.894 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.894 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.894 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.894 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.894 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T22:26:42.894 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T22:26:42.894 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.894 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.894 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.895 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.895 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.895 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.895 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.895 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.895 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.895 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.895 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.895 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.895 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T22:26:42.895 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T22:26:42.895 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.896 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.896 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.896 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.896 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.896 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.896 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.896 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.896 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.896 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.896 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.896 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.897 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T22:26:42.897 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T22:26:42.897 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.897 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.897 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.897 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.897 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.897 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.897 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.897 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.897 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.897 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.898 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.898 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.898 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T22:26:42.898 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T22:26:42.898 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.898 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.898 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.898 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.898 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.898 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.898 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.899 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.899 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.899 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.899 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.899 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.899 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T22:26:42.899 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T22:26:42.899 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.899 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.899 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.899 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T22:26:42.899 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T22:26:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T22:26:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.900 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.901 INFO:teuthology.orchestra.run.smithi045.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T22:26:42.902 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T22:26:42.902 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.902 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.902 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.902 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8", 2024-09-15T22:26:42.902 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.902 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.902 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.902 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.902 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.902 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.902 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.903 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.903 INFO:teuthology.orchestra.run.smithi045.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T22:26:42.903 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T22:26:42.903 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.903 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.903 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.903 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "45", 2024-09-15T22:26:42.903 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.903 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.903 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.903 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.904 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.904 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.904 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.904 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.904 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T22:26:42.904 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T22:26:42.904 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.904 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.904 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.904 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.904 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.904 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.905 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.905 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.905 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.905 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.905 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.905 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.905 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T22:26:42.905 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T22:26:42.905 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.905 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.905 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.905 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "admin", 2024-09-15T22:26:42.906 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.906 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.906 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.906 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.906 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.906 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.906 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.906 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.906 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T22:26:42.906 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T22:26:42.906 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.907 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.907 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.907 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.907 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.907 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.907 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.907 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.907 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.907 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.907 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.907 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.907 INFO:teuthology.orchestra.run.smithi045.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T22:26:42.908 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T22:26:42.908 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.908 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.908 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.908 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.908 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.908 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.908 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.908 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.908 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.908 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.908 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.909 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.909 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T22:26:42.909 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T22:26:42.909 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.909 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.909 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.909 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:42.909 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.909 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.909 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.909 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.910 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.910 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.910 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.910 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.910 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T22:26:42.910 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T22:26:42.910 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.910 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.910 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.910 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.910 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.910 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.910 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.911 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.911 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.911 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.911 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.911 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.911 INFO:teuthology.orchestra.run.smithi045.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T22:26:42.911 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T22:26:42.911 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.911 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.911 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.911 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:42.912 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.912 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.912 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.912 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.912 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.912 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.912 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.912 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.912 INFO:teuthology.orchestra.run.smithi045.stdout: "cross_origin_url": { 2024-09-15T22:26:42.912 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cross_origin_url", 2024-09-15T22:26:42.912 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.913 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.913 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.913 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.913 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.913 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.913 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.913 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.913 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.913 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.913 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.913 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.913 INFO:teuthology.orchestra.run.smithi045.stdout: "crt_file": { 2024-09-15T22:26:42.914 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "crt_file", 2024-09-15T22:26:42.914 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.914 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.914 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.914 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.914 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.914 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.914 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.914 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.914 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.914 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.915 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.915 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.915 INFO:teuthology.orchestra.run.smithi045.stdout: "debug": { 2024-09-15T22:26:42.915 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "debug", 2024-09-15T22:26:42.915 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.915 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.915 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.915 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.915 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.915 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.915 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.916 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Enable/disable debug options", 2024-09-15T22:26:42.916 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.916 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.916 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.916 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.916 INFO:teuthology.orchestra.run.smithi045.stdout: "jwt_token_ttl": { 2024-09-15T22:26:42.916 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "jwt_token_ttl", 2024-09-15T22:26:42.916 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.916 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.916 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.916 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "28800", 2024-09-15T22:26:42.917 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.917 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.917 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.917 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.917 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.917 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.917 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.917 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.917 INFO:teuthology.orchestra.run.smithi045.stdout: "key_file": { 2024-09-15T22:26:42.917 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "key_file", 2024-09-15T22:26:42.917 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.918 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.918 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.918 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.918 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.918 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.918 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.918 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.918 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.918 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.918 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.918 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.919 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.919 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.919 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.919 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.919 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.919 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.919 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.919 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.919 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.919 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.919 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.920 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.920 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.920 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.920 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.920 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.920 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.920 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.920 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.920 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.920 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.920 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.920 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.921 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.921 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.921 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.921 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.921 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.921 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.921 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.921 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.921 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.921 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.921 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.922 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.922 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.922 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.922 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.922 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.922 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.922 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.922 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.922 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.922 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.922 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.922 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.922 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.923 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.923 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.923 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.923 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.923 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.923 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.923 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.923 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.923 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.923 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.923 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.923 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.924 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.924 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.924 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.924 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.924 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.924 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.924 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.924 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.924 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.924 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.925 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.925 INFO:teuthology.orchestra.run.smithi045.stdout: "motd": { 2024-09-15T22:26:42.925 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "motd", 2024-09-15T22:26:42.925 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.925 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.925 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.925 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.925 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.925 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.925 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.925 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "The message of the day", 2024-09-15T22:26:42.926 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.926 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.926 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.926 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.926 INFO:teuthology.orchestra.run.smithi045.stdout: "redirect_resolve_ip_addr": { 2024-09-15T22:26:42.926 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T22:26:42.926 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.926 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.926 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.926 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.926 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.927 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.927 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.927 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.927 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.927 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.927 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.927 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.927 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-09-15T22:26:42.927 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-09-15T22:26:42.927 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.928 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.928 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.928 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "::", 2024-09-15T22:26:42.928 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.928 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.928 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.928 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.928 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.928 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.928 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.929 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.929 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-09-15T22:26:42.929 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-09-15T22:26:42.929 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.929 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.929 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.929 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8080", 2024-09-15T22:26:42.929 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.929 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.929 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.929 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.930 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.930 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.930 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.930 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.930 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl": { 2024-09-15T22:26:42.930 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl", 2024-09-15T22:26:42.930 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.930 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.930 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.930 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.930 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.931 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.931 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.931 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.931 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.931 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.931 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.931 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.931 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl_server_port": { 2024-09-15T22:26:42.931 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl_server_port", 2024-09-15T22:26:42.931 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.932 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.932 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.932 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8443", 2024-09-15T22:26:42.932 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.932 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.932 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.932 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.932 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.932 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.932 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.932 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.933 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_behaviour": { 2024-09-15T22:26:42.933 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_behaviour", 2024-09-15T22:26:42.933 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.933 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.933 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.933 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "redirect", 2024-09-15T22:26:42.933 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.933 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.933 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.936 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.936 INFO:teuthology.orchestra.run.smithi045.stdout: "redirect" 2024-09-15T22:26:42.936 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.936 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.936 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.936 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.936 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.936 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.936 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_error_status_code": { 2024-09-15T22:26:42.937 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_error_status_code", 2024-09-15T22:26:42.937 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.937 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.937 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.937 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "500", 2024-09-15T22:26:42.937 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "400", 2024-09-15T22:26:42.937 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "599", 2024-09-15T22:26:42.937 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.937 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.937 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.937 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.937 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.937 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: "url_prefix": { 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "url_prefix", 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.938 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "devicehealth", 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: "enable_monitoring": { 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enable_monitoring", 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.939 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.940 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.940 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.940 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "monitor device health metrics", 2024-09-15T22:26:42.940 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.940 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.940 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.940 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.940 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.940 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.940 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.940 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.940 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.940 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.941 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.942 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.942 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.942 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.942 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.942 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.942 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.942 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.942 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.942 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.942 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.942 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.942 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.943 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.944 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.944 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.944 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.944 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.944 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.944 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.944 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.944 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.944 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.944 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.944 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.944 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.944 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: "mark_out_threshold": { 2024-09-15T22:26:42.945 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mark_out_threshold", 2024-09-15T22:26:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "2419200", 2024-09-15T22:26:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T22:26:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.946 INFO:teuthology.orchestra.run.smithi045.stdout: "pool_name": { 2024-09-15T22:26:42.947 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pool_name", 2024-09-15T22:26:42.947 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.947 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.947 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.947 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "device_health_metrics", 2024-09-15T22:26:42.947 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.947 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.947 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.947 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T22:26:42.947 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.947 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.947 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.947 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.948 INFO:teuthology.orchestra.run.smithi045.stdout: "retention_period": { 2024-09-15T22:26:42.948 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "retention_period", 2024-09-15T22:26:42.948 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.948 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.948 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.948 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15552000", 2024-09-15T22:26:42.948 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.948 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.948 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.948 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long to retain device health metrics", 2024-09-15T22:26:42.948 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.948 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.949 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.949 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.949 INFO:teuthology.orchestra.run.smithi045.stdout: "scrape_frequency": { 2024-09-15T22:26:42.949 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "scrape_frequency", 2024-09-15T22:26:42.949 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.949 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.949 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.949 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "86400", 2024-09-15T22:26:42.949 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.949 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.949 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.949 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T22:26:42.949 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.950 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.950 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.950 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.950 INFO:teuthology.orchestra.run.smithi045.stdout: "self_heal": { 2024-09-15T22:26:42.950 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "self_heal", 2024-09-15T22:26:42.950 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.950 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.950 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.950 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:42.950 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.950 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.950 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.950 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.951 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T22:26:42.952 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.952 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.952 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.952 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.952 INFO:teuthology.orchestra.run.smithi045.stdout: "warn_threshold": { 2024-09-15T22:26:42.952 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "warn_threshold", 2024-09-15T22:26:42.952 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.952 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.952 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.952 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "7257600", 2024-09-15T22:26:42.952 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.952 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.952 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.953 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T22:26:42.953 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.953 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.953 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.953 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.953 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.953 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.953 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.953 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "diskprediction_local", 2024-09-15T22:26:42.953 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.953 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.953 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.953 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.954 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.955 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.955 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.955 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.955 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.955 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.955 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.955 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.955 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.955 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.955 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.955 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.955 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.955 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.956 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.956 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.956 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.956 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.956 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.956 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.956 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.956 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.956 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.956 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.958 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.959 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.959 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.959 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.959 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.959 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.959 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.959 INFO:teuthology.orchestra.run.smithi045.stdout: "predict_interval": { 2024-09-15T22:26:42.959 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "predict_interval", 2024-09-15T22:26:42.959 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.959 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.959 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.959 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "86400", 2024-09-15T22:26:42.959 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.960 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.960 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.960 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.960 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.960 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.960 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.960 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.960 INFO:teuthology.orchestra.run.smithi045.stdout: "predictor_model": { 2024-09-15T22:26:42.960 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "predictor_model", 2024-09-15T22:26:42.960 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.960 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.960 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.960 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "prophetstor", 2024-09-15T22:26:42.961 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.961 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.961 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.961 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.961 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.961 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.961 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.961 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.961 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:42.961 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:42.961 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "600", 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.962 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "influx", 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": false, 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "influxdb python module not found", 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "batch_size": { 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "batch_size", 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5000", 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T22:26:42.963 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.964 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.964 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.964 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.964 INFO:teuthology.orchestra.run.smithi045.stdout: "database": { 2024-09-15T22:26:42.964 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "database", 2024-09-15T22:26:42.964 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.964 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.964 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.964 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "ceph", 2024-09-15T22:26:42.964 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.964 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.964 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.964 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": { 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "hostname", 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.965 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB server hostname", 2024-09-15T22:26:42.966 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.966 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.966 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.966 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.966 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:42.966 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:42.966 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:42.966 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.966 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.966 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "30", 2024-09-15T22:26:42.966 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "5", 2024-09-15T22:26:42.966 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.966 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.967 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.968 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.968 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.968 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.968 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.968 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.968 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.968 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.968 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.968 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.968 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.968 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.968 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.968 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.969 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.970 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.971 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.972 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.972 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.972 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.972 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.972 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.972 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.972 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.972 INFO:teuthology.orchestra.run.smithi045.stdout: "password": { 2024-09-15T22:26:42.972 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "password", 2024-09-15T22:26:42.972 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.972 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.972 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.972 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.973 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.973 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.973 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.973 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "password of InfluxDB server user", 2024-09-15T22:26:42.973 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.973 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.973 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.973 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.973 INFO:teuthology.orchestra.run.smithi045.stdout: "port": { 2024-09-15T22:26:42.973 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "port", 2024-09-15T22:26:42.973 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.973 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.973 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.974 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "8086", 2024-09-15T22:26:42.974 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.974 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.974 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.974 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "InfluxDB server port", 2024-09-15T22:26:42.974 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.974 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.974 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.974 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.974 INFO:teuthology.orchestra.run.smithi045.stdout: "ssl": { 2024-09-15T22:26:42.974 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ssl", 2024-09-15T22:26:42.974 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.974 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.975 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.975 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "false", 2024-09-15T22:26:42.975 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.975 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.975 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.975 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:26:42.975 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.975 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.975 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.975 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.975 INFO:teuthology.orchestra.run.smithi045.stdout: "threads": { 2024-09-15T22:26:42.975 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "threads", 2024-09-15T22:26:42.975 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.976 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.976 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.976 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:42.976 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-09-15T22:26:42.976 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "32", 2024-09-15T22:26:42.976 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.976 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T22:26:42.976 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.976 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.976 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.976 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.976 INFO:teuthology.orchestra.run.smithi045.stdout: "username": { 2024-09-15T22:26:42.976 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "username", 2024-09-15T22:26:42.977 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.977 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.977 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.977 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.977 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.977 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.977 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.977 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "username of InfluxDB server user", 2024-09-15T22:26:42.977 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.977 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.977 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.977 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.977 INFO:teuthology.orchestra.run.smithi045.stdout: "verify_ssl": { 2024-09-15T22:26:42.978 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "verify_ssl", 2024-09-15T22:26:42.978 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.978 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.978 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.978 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "true", 2024-09-15T22:26:42.978 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.978 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.978 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.978 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T22:26:42.978 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.978 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.978 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "insights", 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.979 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.980 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.981 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.981 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.981 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.981 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.981 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.981 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.981 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.981 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.981 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.981 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.981 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.981 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.981 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.982 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.982 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.982 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.982 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.982 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.982 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.982 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.982 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.982 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.982 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.982 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.982 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.983 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "iostat", 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.985 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.986 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.986 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.986 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.986 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.986 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.986 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.986 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.986 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.986 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.986 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.986 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.986 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.987 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.988 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.988 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.988 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.988 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.988 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.988 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.988 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.988 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.988 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.988 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.988 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.988 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.988 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.989 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.990 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.990 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.990 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.990 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.990 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.990 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.990 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.990 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.990 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.990 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.990 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.990 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.990 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "k8sevents", 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_event_retention_days": { 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "ceph_event_retention_days", 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "7", 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T22:26:42.991 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.992 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.992 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.992 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.992 INFO:teuthology.orchestra.run.smithi045.stdout: "config_check_secs": { 2024-09-15T22:26:42.992 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "config_check_secs", 2024-09-15T22:26:42.992 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:42.992 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.992 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:42.992 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:42.992 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "10", 2024-09-15T22:26:42.992 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.992 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.993 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T22:26:42.993 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.993 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.993 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.993 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.993 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:42.993 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:42.993 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.993 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.993 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.993 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:42.993 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.993 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.994 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:42.995 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:42.995 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.995 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.995 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.995 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.995 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.995 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.995 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.995 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.995 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.995 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.995 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.995 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.996 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:42.996 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:42.996 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.996 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.996 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.996 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:42.996 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.996 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.996 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:42.996 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:42.996 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:42.996 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:42.996 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:42.997 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:42.997 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:42.997 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:42.997 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.997 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.997 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.997 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.997 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.997 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:42.997 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:42.997 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:42.997 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.997 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.998 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:42.998 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.998 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.998 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.998 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:42.998 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:42.998 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:42.998 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:42.998 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.998 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:42.998 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:42.998 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:42.998 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "localpool", 2024-09-15T22:26:42.999 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:42.999 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:42.999 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:42.999 INFO:teuthology.orchestra.run.smithi045.stdout: "failure_domain": { 2024-09-15T22:26:42.999 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "failure_domain", 2024-09-15T22:26:42.999 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:42.999 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:42.999 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:42.999 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "host", 2024-09-15T22:26:42.999 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:42.999 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:42.999 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:42.999 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "failure domain for any created local pool", 2024-09-15T22:26:43.000 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T22:26:43.000 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.000 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.000 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.000 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.000 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.000 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.000 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.000 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.000 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.000 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.000 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.000 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.001 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.001 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.001 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.001 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.001 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.001 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.001 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.001 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.001 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.001 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.001 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.001 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.001 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.002 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.002 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.002 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.002 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.002 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.002 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.002 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.002 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.002 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.002 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.002 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.002 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.002 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.003 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.003 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.003 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.003 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.003 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.003 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.003 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.003 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.003 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.003 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.003 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.003 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.003 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.004 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.004 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.004 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.004 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.004 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.004 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.004 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.004 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.004 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.004 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.004 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.004 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.004 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.005 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.005 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.005 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.005 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.005 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.005 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.005 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.005 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.005 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.005 INFO:teuthology.orchestra.run.smithi045.stdout: "min_size": { 2024-09-15T22:26:43.005 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "min_size", 2024-09-15T22:26:43.005 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.005 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.006 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.006 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.006 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.006 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.006 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.006 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default min_size for any created local pool", 2024-09-15T22:26:43.006 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T22:26:43.006 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.006 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.006 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.006 INFO:teuthology.orchestra.run.smithi045.stdout: "num_rep": { 2024-09-15T22:26:43.006 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "num_rep", 2024-09-15T22:26:43.006 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3", 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default replica count for any created local pool", 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_num": { 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pg_num", 2024-09-15T22:26:43.007 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.008 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.008 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.008 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "128", 2024-09-15T22:26:43.008 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.008 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.008 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.008 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T22:26:43.008 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.008 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.008 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.008 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.008 INFO:teuthology.orchestra.run.smithi045.stdout: "prefix": { 2024-09-15T22:26:43.008 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prefix", 2024-09-15T22:26:43.009 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.009 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.009 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.009 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.009 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.009 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.009 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.009 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "name prefix for any created local pool", 2024-09-15T22:26:43.009 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.009 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.009 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.009 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.009 INFO:teuthology.orchestra.run.smithi045.stdout: "subtree": { 2024-09-15T22:26:43.010 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "subtree", 2024-09-15T22:26:43.010 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.010 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.010 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.010 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "rack", 2024-09-15T22:26:43.010 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.010 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.010 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.010 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T22:26:43.010 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T22:26:43.010 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.010 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.010 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.011 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.011 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.011 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.011 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mds_autoscaler", 2024-09-15T22:26:43.011 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.011 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.011 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.011 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.011 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.011 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.011 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.011 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.012 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.012 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.012 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.012 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.012 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.012 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.012 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.012 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.012 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.012 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.012 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.012 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.012 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.013 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.014 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.014 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.014 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.014 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.014 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.014 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.014 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.014 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.014 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.014 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.014 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.014 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.014 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.015 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.015 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.015 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.015 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.015 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.015 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.015 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.015 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.015 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.015 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.015 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.015 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.015 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.016 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.016 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.016 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.016 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.016 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.016 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.016 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.016 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.016 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.016 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.016 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.016 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mirroring", 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.017 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.018 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.018 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.018 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.018 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.018 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.018 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.018 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.018 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.018 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.018 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.018 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.018 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.018 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.019 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.019 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.019 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.019 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.019 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.019 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.019 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.019 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.019 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.019 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.019 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.019 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.019 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.020 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.020 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.020 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.020 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.020 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.020 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.020 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.020 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.020 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.020 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.020 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.020 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.021 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.021 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.021 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.021 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.021 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.021 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.021 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.021 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.021 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.021 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.021 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.021 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.021 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.022 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.022 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.022 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.022 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.022 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.022 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.022 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.022 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.022 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.022 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.022 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.022 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.022 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.023 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.023 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.023 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "nfs", 2024-09-15T22:26:43.023 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.023 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.023 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.023 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.023 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.023 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.023 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.023 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.023 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.023 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.024 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.024 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.024 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.024 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.024 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.024 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.024 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.024 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.024 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.024 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.024 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.024 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.024 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.025 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.026 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.027 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.028 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.028 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.028 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.028 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.028 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.028 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.028 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.028 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.028 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.028 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.028 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.028 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.029 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "orchestrator", 2024-09-15T22:26:43.029 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.029 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.029 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.029 INFO:teuthology.orchestra.run.smithi045.stdout: "fail_fs": { 2024-09-15T22:26:43.029 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "fail_fs", 2024-09-15T22:26:43.029 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.029 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.029 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.029 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.029 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.029 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.029 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.030 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T22:26:43.030 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.030 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.030 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.030 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.030 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.030 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.030 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.030 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.030 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.030 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.030 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.030 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.031 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.031 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.031 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.031 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.031 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.031 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.031 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.031 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.031 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.031 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.031 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.031 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.031 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.032 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.033 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.033 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.033 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.033 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.033 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.033 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.033 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.033 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.033 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.033 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.033 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.033 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.033 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.034 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.034 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.034 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.034 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.034 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.034 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.034 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.034 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.034 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.034 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.034 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.034 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator": { 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "orchestrator", 2024-09-15T22:26:43.035 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.036 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.036 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.036 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.036 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.036 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.036 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.036 INFO:teuthology.orchestra.run.smithi045.stdout: "cephadm", 2024-09-15T22:26:43.036 INFO:teuthology.orchestra.run.smithi045.stdout: "rook", 2024-09-15T22:26:43.036 INFO:teuthology.orchestra.run.smithi045.stdout: "test_orchestrator" 2024-09-15T22:26:43.036 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.036 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Orchestrator backend", 2024-09-15T22:26:43.036 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.037 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.037 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.037 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.037 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.037 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.037 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.037 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "osd_perf_query", 2024-09-15T22:26:43.037 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.037 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.037 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.037 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.037 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.037 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.038 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.038 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.038 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.038 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.038 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.038 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.038 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.038 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.038 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.038 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.038 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.038 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.039 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.040 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.040 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.040 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.040 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.040 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.040 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.040 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.040 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.040 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.040 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.040 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.040 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.040 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.041 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.042 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.042 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.042 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.042 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.042 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.042 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.042 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.042 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.042 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.042 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.042 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.042 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.042 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "osd_support", 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.044 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.045 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.045 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.045 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.045 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.045 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.045 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.045 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.045 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.045 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.045 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.045 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.045 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.045 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.046 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.046 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.046 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.046 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.046 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.046 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.046 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.046 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.046 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.046 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.046 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.046 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.047 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.047 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.047 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.047 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.047 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.047 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.047 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.047 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.047 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.047 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.047 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.047 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.047 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.048 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.048 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.048 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.048 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.048 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.048 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.048 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.048 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.048 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.048 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.048 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.048 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.049 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.049 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.049 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.049 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "pg_autoscaler", 2024-09-15T22:26:43.049 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.049 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.049 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.049 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.049 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.049 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.049 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.049 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.049 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.050 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.050 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.050 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.050 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.050 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.050 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.050 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.050 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.050 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.050 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.050 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.050 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.050 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.051 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.051 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.051 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.051 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.051 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.051 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.051 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.051 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.051 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.051 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.051 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.051 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.051 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.052 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.052 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.052 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.052 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.052 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.052 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.052 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.052 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.052 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.052 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.052 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.052 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.053 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.053 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.053 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.053 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.053 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.053 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.053 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.053 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.053 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.053 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.053 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.053 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.053 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.054 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.055 INFO:teuthology.orchestra.run.smithi045.stdout: "threshold": { 2024-09-15T22:26:43.056 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "threshold", 2024-09-15T22:26:43.056 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:43.056 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.056 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.056 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "3.0", 2024-09-15T22:26:43.056 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1.0", 2024-09-15T22:26:43.056 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.056 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.056 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "scaling threshold", 2024-09-15T22:26:43.056 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T22:26:43.056 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.056 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "progress", 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_pg_recovery_event": { 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_pg_recovery_event", 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.057 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.058 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.058 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.058 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.058 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T22:26:43.058 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.058 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.058 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.058 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.058 INFO:teuthology.orchestra.run.smithi045.stdout: "enabled": { 2024-09-15T22:26:43.058 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enabled", 2024-09-15T22:26:43.058 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.058 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.058 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.059 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:43.059 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.059 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.059 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.059 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.059 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.059 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.059 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.059 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.059 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.059 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.059 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.059 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.060 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.061 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.061 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.061 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.061 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.061 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.061 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.061 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.061 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.061 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.061 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.061 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.061 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.061 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.062 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.062 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.062 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.062 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.062 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.062 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.062 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.062 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.062 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.062 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.062 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.062 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.062 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.063 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.063 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.063 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.063 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.063 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.063 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.063 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.063 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.063 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.063 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.063 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.063 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.063 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.064 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "max_completed_events": { 2024-09-15T22:26:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_completed_events", 2024-09-15T22:26:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "50", 2024-09-15T22:26:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "number of past completed events to remember", 2024-09-15T22:26:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.065 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "sleep_interval": { 2024-09-15T22:26:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "sleep_interval", 2024-09-15T22:26:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "how long the module is going to sleep", 2024-09-15T22:26:43.066 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "prometheus", 2024-09-15T22:26:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "cache": { 2024-09-15T22:26:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cache", 2024-09-15T22:26:43.067 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "exclude_perf_counters": { 2024-09-15T22:26:43.068 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "exclude_perf_counters", 2024-09-15T22:26:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T22:26:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T22:26:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.069 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.070 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.071 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.072 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.073 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.074 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_stats_pools": { 2024-09-15T22:26:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_stats_pools", 2024-09-15T22:26:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.075 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T22:26:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T22:26:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "300", 2024-09-15T22:26:43.076 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "scrape_interval": { 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "scrape_interval", 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15.0", 2024-09-15T22:26:43.077 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-09-15T22:26:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-09-15T22:26:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.078 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "::", 2024-09-15T22:26:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T22:26:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-09-15T22:26:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-09-15T22:26:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.079 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "9283", 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "stale_cache_strategy": { 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "stale_cache_strategy", 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.080 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "log", 2024-09-15T22:26:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_behaviour": { 2024-09-15T22:26:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_behaviour", 2024-09-15T22:26:43.081 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "default", 2024-09-15T22:26:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "default", 2024-09-15T22:26:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "error" 2024-09-15T22:26:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.082 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "standby_error_status_code": { 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "standby_error_status_code", 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "500", 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "400", 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "599", 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.083 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_support", 2024-09-15T22:26:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.084 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.085 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.086 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.087 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.088 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.089 INFO:teuthology.orchestra.run.smithi045.stdout: "max_concurrent_snap_create": { 2024-09-15T22:26:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_concurrent_snap_create", 2024-09-15T22:26:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10", 2024-09-15T22:26:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.090 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "mirror_snapshot_schedule": { 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.091 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "trash_purge_schedule": { 2024-09-15T22:26:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "trash_purge_schedule", 2024-09-15T22:26:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.092 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "restful", 2024-09-15T22:26:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "enable_auth": { 2024-09-15T22:26:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enable_auth", 2024-09-15T22:26:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.093 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "key_file": { 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "key_file", 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.094 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.095 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.096 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.097 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.098 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.099 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.100 INFO:teuthology.orchestra.run.smithi045.stdout: "server_addr": { 2024-09-15T22:26:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_addr", 2024-09-15T22:26:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.101 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "server_port": { 2024-09-15T22:26:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "server_port", 2024-09-15T22:26:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.102 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rgw", 2024-09-15T22:26:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.103 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.104 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.105 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.106 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.107 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.108 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "5", 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.109 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rook", 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.110 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.111 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.112 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.113 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.114 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.115 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "storage_class": { 2024-09-15T22:26:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "storage_class", 2024-09-15T22:26:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "local", 2024-09-15T22:26:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T22:26:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.116 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "selftest", 2024-09-15T22:26:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.117 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.118 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.119 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.120 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.121 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.122 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "roption1": { 2024-09-15T22:26:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "roption1", 2024-09-15T22:26:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.123 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "roption2": { 2024-09-15T22:26:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "roption2", 2024-09-15T22:26:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "xyz", 2024-09-15T22:26:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.124 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption1": { 2024-09-15T22:26:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption1", 2024-09-15T22:26:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.125 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption2": { 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption2", 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.126 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption3": { 2024-09-15T22:26:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption3", 2024-09-15T22:26:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "float", 2024-09-15T22:26:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.127 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption4": { 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption4", 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.128 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption5": { 2024-09-15T22:26:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption5", 2024-09-15T22:26:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.129 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption6": { 2024-09-15T22:26:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption6", 2024-09-15T22:26:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.130 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "rwoption7": { 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rwoption7", 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.131 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "1", 2024-09-15T22:26:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "42", 2024-09-15T22:26:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "testkey": { 2024-09-15T22:26:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testkey", 2024-09-15T22:26:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.132 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "testlkey": { 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testlkey", 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.133 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "testnewline": { 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "testnewline", 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.134 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.135 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snap_schedule", 2024-09-15T22:26:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "allow_m_granularity": { 2024-09-15T22:26:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "allow_m_granularity", 2024-09-15T22:26:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.136 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T22:26:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "dump_on_update": { 2024-09-15T22:26:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "dump_on_update", 2024-09-15T22:26:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.137 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "dump database to debug log on update", 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.138 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.139 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.140 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.141 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.141 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.141 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.141 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.141 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.141 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.144 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.145 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "stats", 2024-09-15T22:26:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.146 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.147 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.148 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.149 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.150 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.151 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "status", 2024-09-15T22:26:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.152 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.153 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.154 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.155 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.156 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.157 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "telegraf", 2024-09-15T22:26:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "address": { 2024-09-15T22:26:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "address", 2024-09-15T22:26:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.158 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T22:26:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.159 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "15", 2024-09-15T22:26:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.160 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.161 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.162 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.163 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.164 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.165 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "telemetry", 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_basic": { 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_basic", 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.166 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_crash": { 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_crash", 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.167 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T22:26:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_device": { 2024-09-15T22:26:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_device", 2024-09-15T22:26:43.168 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T22:26:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_ident": { 2024-09-15T22:26:43.169 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_ident", 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "channel_perf": { 2024-09-15T22:26:43.170 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "channel_perf", 2024-09-15T22:26:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T22:26:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.171 INFO:teuthology.orchestra.run.smithi045.stdout: "contact": { 2024-09-15T22:26:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "contact", 2024-09-15T22:26:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.172 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "description": { 2024-09-15T22:26:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "description", 2024-09-15T22:26:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.173 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "device_url": { 2024-09-15T22:26:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "device_url", 2024-09-15T22:26:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T22:26:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.174 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "enabled": { 2024-09-15T22:26:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "enabled", 2024-09-15T22:26:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.175 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "24", 2024-09-15T22:26:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "8", 2024-09-15T22:26:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.176 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "last_opt_revision": { 2024-09-15T22:26:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "last_opt_revision", 2024-09-15T22:26:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "1", 2024-09-15T22:26:43.177 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "leaderboard": { 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "leaderboard", 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.178 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "leaderboard_description": { 2024-09-15T22:26:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "leaderboard_description", 2024-09-15T22:26:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.179 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.180 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.181 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.182 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.183 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.184 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.185 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "organization": { 2024-09-15T22:26:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "organization", 2024-09-15T22:26:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.186 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "proxy": { 2024-09-15T22:26:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "proxy", 2024-09-15T22:26:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.187 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "url": { 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "url", 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.188 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "test_orchestrator", 2024-09-15T22:26:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.189 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.190 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.190 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.190 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.190 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.190 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.190 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.190 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.190 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.190 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.190 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.190 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.190 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.190 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.191 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.192 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.192 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.192 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.192 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.192 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.192 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.192 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.192 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.192 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.192 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.192 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.192 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.192 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.193 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.193 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.193 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.193 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.193 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.193 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.193 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.193 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.193 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.193 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.193 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.193 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.193 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.194 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.194 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.194 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.194 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.194 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.194 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.194 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.194 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.194 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.194 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.194 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.194 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.194 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.195 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.195 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.195 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.195 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "volumes", 2024-09-15T22:26:43.195 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.195 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.195 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.195 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.195 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.195 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.195 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.195 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.195 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.196 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.196 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.196 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.196 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.196 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.196 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.196 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.196 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.196 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.196 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.196 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.196 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.197 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.198 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.199 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.199 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.199 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.199 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.199 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.199 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.199 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.199 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.199 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.199 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.199 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.199 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.199 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: "max_concurrent_clones": { 2024-09-15T22:26:43.200 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "max_concurrent_clones", 2024-09-15T22:26:43.201 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.201 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.201 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.201 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "4", 2024-09-15T22:26:43.201 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.201 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.201 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.201 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T22:26:43.201 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.201 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.201 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.201 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.201 INFO:teuthology.orchestra.run.smithi045.stdout: "periodic_async_work": { 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "periodic_async_work", 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Periodically check for async work", 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.202 INFO:teuthology.orchestra.run.smithi045.stdout: "snapshot_clone_delay": { 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snapshot_clone_delay", 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "0", 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.203 INFO:teuthology.orchestra.run.smithi045.stdout: "snapshot_clone_no_wait": { 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "True", 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.204 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.205 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.205 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.205 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix", 2024-09-15T22:26:43.205 INFO:teuthology.orchestra.run.smithi045.stdout: "can_run": true, 2024-09-15T22:26:43.205 INFO:teuthology.orchestra.run.smithi045.stdout: "error_string": "", 2024-09-15T22:26:43.205 INFO:teuthology.orchestra.run.smithi045.stdout: "module_options": { 2024-09-15T22:26:43.205 INFO:teuthology.orchestra.run.smithi045.stdout: "discovery_interval": { 2024-09-15T22:26:43.205 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "discovery_interval", 2024-09-15T22:26:43.205 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "uint", 2024-09-15T22:26:43.205 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.205 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.205 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "100", 2024-09-15T22:26:43.205 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.206 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.206 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.206 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.206 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.206 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.206 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.206 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.206 INFO:teuthology.orchestra.run.smithi045.stdout: "identifier": { 2024-09-15T22:26:43.206 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "identifier", 2024-09-15T22:26:43.206 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.206 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.206 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.206 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: "interval": { 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "interval", 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "secs", 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.207 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "60", 2024-09-15T22:26:43.208 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.208 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.208 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.208 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.208 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.208 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.208 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.208 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.208 INFO:teuthology.orchestra.run.smithi045.stdout: "log_level": { 2024-09-15T22:26:43.208 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_level", 2024-09-15T22:26:43.208 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.208 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.209 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster": { 2024-09-15T22:26:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster", 2024-09-15T22:26:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.210 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.211 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.211 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.211 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.211 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.211 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_cluster_level": { 2024-09-15T22:26:43.211 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_cluster_level", 2024-09-15T22:26:43.211 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.211 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.211 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.211 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "info", 2024-09-15T22:26:43.211 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.211 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.211 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [ 2024-09-15T22:26:43.212 INFO:teuthology.orchestra.run.smithi045.stdout: "", 2024-09-15T22:26:43.212 INFO:teuthology.orchestra.run.smithi045.stdout: "critical", 2024-09-15T22:26:43.212 INFO:teuthology.orchestra.run.smithi045.stdout: "debug", 2024-09-15T22:26:43.212 INFO:teuthology.orchestra.run.smithi045.stdout: "error", 2024-09-15T22:26:43.212 INFO:teuthology.orchestra.run.smithi045.stdout: "info", 2024-09-15T22:26:43.212 INFO:teuthology.orchestra.run.smithi045.stdout: "warning" 2024-09-15T22:26:43.212 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.212 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.212 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.212 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.212 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.212 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.212 INFO:teuthology.orchestra.run.smithi045.stdout: "log_to_file": { 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "log_to_file", 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "bool", 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 1, 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "False", 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.213 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_host": { 2024-09-15T22:26:43.214 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_host", 2024-09-15T22:26:43.214 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.214 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.214 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.214 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "", 2024-09-15T22:26:43.214 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.214 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.214 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.214 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.214 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.214 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.214 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.214 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.215 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_port": { 2024-09-15T22:26:43.215 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_port", 2024-09-15T22:26:43.215 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "int", 2024-09-15T22:26:43.215 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.215 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.215 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "10051", 2024-09-15T22:26:43.215 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.215 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.215 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.215 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.215 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.215 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.216 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.216 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.216 INFO:teuthology.orchestra.run.smithi045.stdout: "zabbix_sender": { 2024-09-15T22:26:43.216 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "zabbix_sender", 2024-09-15T22:26:43.216 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "str", 2024-09-15T22:26:43.216 INFO:teuthology.orchestra.run.smithi045.stdout: "level": "advanced", 2024-09-15T22:26:43.216 INFO:teuthology.orchestra.run.smithi045.stdout: "flags": 0, 2024-09-15T22:26:43.216 INFO:teuthology.orchestra.run.smithi045.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T22:26:43.216 INFO:teuthology.orchestra.run.smithi045.stdout: "min": "", 2024-09-15T22:26:43.216 INFO:teuthology.orchestra.run.smithi045.stdout: "max": "", 2024-09-15T22:26:43.216 INFO:teuthology.orchestra.run.smithi045.stdout: "enum_allowed": [], 2024-09-15T22:26:43.216 INFO:teuthology.orchestra.run.smithi045.stdout: "desc": "", 2024-09-15T22:26:43.217 INFO:teuthology.orchestra.run.smithi045.stdout: "long_desc": "", 2024-09-15T22:26:43.217 INFO:teuthology.orchestra.run.smithi045.stdout: "tags": [], 2024-09-15T22:26:43.217 INFO:teuthology.orchestra.run.smithi045.stdout: "see_also": [] 2024-09-15T22:26:43.217 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.217 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.217 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.217 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.217 INFO:teuthology.orchestra.run.smithi045.stdout: "services": { 2024-09-15T22:26:43.217 INFO:teuthology.orchestra.run.smithi045.stdout: "dashboard": "https://172.21.15.45:8443/" 2024-09-15T22:26:43.217 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.217 INFO:teuthology.orchestra.run.smithi045.stdout: "always_on_modules": { 2024-09-15T22:26:43.217 INFO:teuthology.orchestra.run.smithi045.stdout: "octopus": [ 2024-09-15T22:26:43.217 INFO:teuthology.orchestra.run.smithi045.stdout: "balancer", 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: "crash", 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: "devicehealth", 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator", 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscaler", 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: "progress", 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_support", 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: "status", 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: "telemetry", 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: "volumes" 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: "pacific": [ 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: "balancer", 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: "crash", 2024-09-15T22:26:43.218 INFO:teuthology.orchestra.run.smithi045.stdout: "devicehealth", 2024-09-15T22:26:43.219 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator", 2024-09-15T22:26:43.219 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscaler", 2024-09-15T22:26:43.219 INFO:teuthology.orchestra.run.smithi045.stdout: "progress", 2024-09-15T22:26:43.219 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_support", 2024-09-15T22:26:43.219 INFO:teuthology.orchestra.run.smithi045.stdout: "status", 2024-09-15T22:26:43.219 INFO:teuthology.orchestra.run.smithi045.stdout: "telemetry", 2024-09-15T22:26:43.219 INFO:teuthology.orchestra.run.smithi045.stdout: "volumes" 2024-09-15T22:26:43.219 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.219 INFO:teuthology.orchestra.run.smithi045.stdout: "quincy": [ 2024-09-15T22:26:43.219 INFO:teuthology.orchestra.run.smithi045.stdout: "balancer", 2024-09-15T22:26:43.219 INFO:teuthology.orchestra.run.smithi045.stdout: "crash", 2024-09-15T22:26:43.219 INFO:teuthology.orchestra.run.smithi045.stdout: "devicehealth", 2024-09-15T22:26:43.219 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator", 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscaler", 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: "progress", 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_support", 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: "status", 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: "telemetry", 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: "volumes" 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: "reef": [ 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: "balancer", 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: "crash", 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: "devicehealth", 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator", 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscaler", 2024-09-15T22:26:43.220 INFO:teuthology.orchestra.run.smithi045.stdout: "progress", 2024-09-15T22:26:43.221 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_support", 2024-09-15T22:26:43.221 INFO:teuthology.orchestra.run.smithi045.stdout: "status", 2024-09-15T22:26:43.221 INFO:teuthology.orchestra.run.smithi045.stdout: "telemetry", 2024-09-15T22:26:43.221 INFO:teuthology.orchestra.run.smithi045.stdout: "volumes" 2024-09-15T22:26:43.221 INFO:teuthology.orchestra.run.smithi045.stdout: ], 2024-09-15T22:26:43.221 INFO:teuthology.orchestra.run.smithi045.stdout: "squid": [ 2024-09-15T22:26:43.221 INFO:teuthology.orchestra.run.smithi045.stdout: "balancer", 2024-09-15T22:26:43.221 INFO:teuthology.orchestra.run.smithi045.stdout: "crash", 2024-09-15T22:26:43.221 INFO:teuthology.orchestra.run.smithi045.stdout: "devicehealth", 2024-09-15T22:26:43.221 INFO:teuthology.orchestra.run.smithi045.stdout: "orchestrator", 2024-09-15T22:26:43.221 INFO:teuthology.orchestra.run.smithi045.stdout: "pg_autoscaler", 2024-09-15T22:26:43.221 INFO:teuthology.orchestra.run.smithi045.stdout: "progress", 2024-09-15T22:26:43.221 INFO:teuthology.orchestra.run.smithi045.stdout: "rbd_support", 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: "status", 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: "telemetry", 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: "volumes" 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: "last_failure_osd_epoch": 90, 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: "active_clients": [ 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "devicehealth", 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2024-09-15T22:26:43.222 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1685908019 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "libcephsqlite", 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 4252251326 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.223 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "rbd_support", 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3470523327 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snap_schedule", 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.224 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-09-15T22:26:43.225 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2024-09-15T22:26:43.225 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 601000636 2024-09-15T22:26:43.225 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.225 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-15T22:26:43.225 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.225 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.225 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "snap_schedule", 2024-09-15T22:26:43.225 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-09-15T22:26:43.225 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.225 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-09-15T22:26:43.225 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2024-09-15T22:26:43.225 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 207417996 2024-09-15T22:26:43.225 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "volumes", 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: "addrvec": [ 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v2", 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3880873297 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-09-15T22:26:43.226 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:26:43.228 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:42 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2329953870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T22:26:43.228 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:42 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/4105779301' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T22:26:43.228 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:42 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2329953870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T22:26:43.228 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:42 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/4105779301' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T22:26:43.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.790+0000 7fc925b98640 1 -- 172.21.15.45:0/4105779301 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc9080a33c0 msgr2=0x7fc9080a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:43.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.790+0000 7fc925b98640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc9080a33c0 0x7fc9080a5880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc91000abe0 tx=0x7fc91000a2d0 comp rx=0 tx=0).stop 2024-09-15T22:26:43.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.790+0000 7fc925b98640 1 -- 172.21.15.45:0/4105779301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc92010c0e0 msgr2=0x7fc920101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:26:43.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.790+0000 7fc925b98640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc92010c0e0 0x7fc920101360 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fc918005cc0 tx=0x7fc91802f790 comp rx=0 tx=0).stop 2024-09-15T22:26:43.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.790+0000 7fc925b98640 1 -- 172.21.15.45:0/4105779301 shutdown_connections 2024-09-15T22:26:43.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.790+0000 7fc925b98640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc9080a33c0 0x7fc9080a5880 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:43.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.790+0000 7fc925b98640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc92010c0e0 0x7fc920101360 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:43.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.790+0000 7fc925b98640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9201035b0 0x7fc920100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:43.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.790+0000 7fc925b98640 1 --2- 172.21.15.45:0/4105779301 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc920102c90 0x7fc9201008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:26:43.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.790+0000 7fc925b98640 1 -- 172.21.15.45:0/4105779301 >> 172.21.15.45:0/4105779301 conn(0x7fc9200fc6a0 msgr2=0x7fc9200fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:26:43.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.790+0000 7fc925b98640 1 -- 172.21.15.45:0/4105779301 shutdown_connections 2024-09-15T22:26:43.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:26:41.790+0000 7fc925b98640 1 -- 172.21.15.45:0/4105779301 wait complete. 2024-09-15T22:26:43.236 DEBUG:tasks.check_counter:Getting stats from a 2024-09-15T22:26:43.236 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-15T22:26:43.236 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:42 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2329953870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T22:26:43.237 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:42 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/4105779301' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T22:26:43.507 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:26:43.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:43 smithi045 ceph-mon[31180]: pgmap v325: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:43.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:43 smithi165 ceph-mon[35551]: pgmap v325: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:43.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:43 smithi100 ceph-mon[35319]: pgmap v325: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:44.041 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:26:44.041 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:26:44.041 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 4, 2024-09-15T22:26:44.041 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 4, 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 2992, 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 448, 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 4, 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 0, 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.003553942, 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.000038374, 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.002311697, 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 3, 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.004176627, 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001392209 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:44.042 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 2, 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 159, 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 320, 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 185120, 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 5, 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 3, 2024-09-15T22:26:44.043 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.013957748, 2024-09-15T22:26:44.044 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.009547246, 2024-09-15T22:26:44.044 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.002141227, 2024-09-15T22:26:44.044 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:44.044 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:44.044 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 156, 2024-09-15T22:26:44.044 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.012452940, 2024-09-15T22:26:44.044 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000079826 2024-09-15T22:26:44.044 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:44.044 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:44.044 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:44.044 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:44.044 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:44.045 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:44.045 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T22:26:44.045 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 185120 2024-09-15T22:26:44.045 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:44.045 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:26:44.045 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 217, 2024-09-15T22:26:44.045 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 207, 2024-09-15T22:26:44.045 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 1447040, 2024-09-15T22:26:44.045 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 127264, 2024-09-15T22:26:44.045 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 2, 2024-09-15T22:26:44.045 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 1, 2024-09-15T22:26:44.045 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.039219282, 2024-09-15T22:26:44.045 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.015155003, 2024-09-15T22:26:44.046 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.036121924, 2024-09-15T22:26:44.046 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:44.046 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:44.046 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 206, 2024-09-15T22:26:44.046 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.011291373, 2024-09-15T22:26:44.046 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000054812 2024-09-15T22:26:44.046 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:44.046 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:44.046 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:44.046 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:44.046 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:44.046 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:44.046 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 1447040, 2024-09-15T22:26:44.047 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 127264 2024-09-15T22:26:44.047 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:44.047 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2024-09-15T22:26:44.047 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 0, 2024-09-15T22:26:44.047 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2024-09-15T22:26:44.047 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:44.047 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2024-09-15T22:26:44.047 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:26:44.047 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2024-09-15T22:26:44.047 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:26:44.047 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:26:44.047 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:26:44.047 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:26:44.048 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:26:44.048 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:26:44.048 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:26:44.048 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:26:44.048 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:26:44.048 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:26:44.048 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:26:44.048 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:26:44.048 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:26:44.048 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2024-09-15T22:26:44.048 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:26:44.048 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2024-09-15T22:26:44.048 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:26:44.049 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:26:44.049 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:26:44.049 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:26:44.049 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:26:44.049 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:26:44.049 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:26:44.049 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2024-09-15T22:26:44.049 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:26:44.049 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:26:44.049 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:26:44.049 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2024-09-15T22:26:44.049 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2024-09-15T22:26:44.049 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2024-09-15T22:26:44.050 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:26:44.050 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:26:44.050 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:26:44.050 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:26:44.050 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 149017, 2024-09-15T22:26:44.050 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 31, 2024-09-15T22:26:44.050 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:26:44.050 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2024-09-15T22:26:44.050 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2024-09-15T22:26:44.050 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2024-09-15T22:26:44.050 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:26:44.050 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2024-09-15T22:26:44.050 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 0, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 0, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 928, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 2, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:44.051 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:26:44.052 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-15T22:26:44.052 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-09-15T22:26:44.052 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-15T22:26:44.052 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 219, 2024-09-15T22:26:44.052 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 1416425, 2024-09-15T22:26:44.052 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:44.052 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 219, 2024-09-15T22:26:44.052 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-09-15T22:26:44.052 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-09-15T22:26:44.052 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 219, 2024-09-15T22:26:44.052 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 1416425, 2024-09-15T22:26:44.052 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-15T22:26:44.052 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:44.053 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:44.053 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:44.053 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:44.053 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:44.053 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:26:44.818 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-15T22:26:44.818 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-15T22:26:44.818 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-15T22:26:44.818 DEBUG:tasks.check_counter:Getting stats from d 2024-09-15T22:26:44.818 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-15T22:26:45.077 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:26:45.492 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:45 smithi045 ceph-mon[31180]: pgmap v326: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:45.600 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:26:45.600 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:26:45.600 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 222, 2024-09-15T22:26:45.600 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 212, 2024-09-15T22:26:45.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 1448400, 2024-09-15T22:26:45.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 130464, 2024-09-15T22:26:45.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 4, 2024-09-15T22:26:45.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 0, 2024-09-15T22:26:45.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.046093396, 2024-09-15T22:26:45.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.015150113, 2024-09-15T22:26:45.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.043625354, 2024-09-15T22:26:45.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:45.601 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:45.604 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 211, 2024-09-15T22:26:45.604 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.011431056, 2024-09-15T22:26:45.604 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000054175 2024-09-15T22:26:45.604 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:45.604 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:45.604 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:45.605 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:45.605 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:45.605 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:45.605 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 1448400, 2024-09-15T22:26:45.605 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 130464 2024-09-15T22:26:45.605 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:45.605 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:26:45.605 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 2, 2024-09-15T22:26:45.605 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 163, 2024-09-15T22:26:45.605 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 320, 2024-09-15T22:26:45.605 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 185824, 2024-09-15T22:26:45.605 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 5, 2024-09-15T22:26:45.606 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 3, 2024-09-15T22:26:45.606 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.014229813, 2024-09-15T22:26:45.606 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.009599723, 2024-09-15T22:26:45.606 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.002221000, 2024-09-15T22:26:45.606 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:45.606 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:45.606 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 160, 2024-09-15T22:26:45.606 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.015930424, 2024-09-15T22:26:45.606 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000099565 2024-09-15T22:26:45.606 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:45.606 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:45.606 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:45.606 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:45.607 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:45.607 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:45.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T22:26:45.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 185824 2024-09-15T22:26:45.607 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:45.607 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:26:45.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 4, 2024-09-15T22:26:45.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 4, 2024-09-15T22:26:45.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 2992, 2024-09-15T22:26:45.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 448, 2024-09-15T22:26:45.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 2, 2024-09-15T22:26:45.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 1, 2024-09-15T22:26:45.607 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.002379100, 2024-09-15T22:26:45.608 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.000033156, 2024-09-15T22:26:45.608 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.002332625, 2024-09-15T22:26:45.608 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:45.608 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:45.608 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 3, 2024-09-15T22:26:45.608 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.004415215, 2024-09-15T22:26:45.608 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001471738 2024-09-15T22:26:45.608 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:45.608 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:45.608 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:45.608 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:45.608 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:45.608 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:45.609 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-15T22:26:45.609 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T22:26:45.609 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:45.609 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2024-09-15T22:26:45.609 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 0, 2024-09-15T22:26:45.609 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2024-09-15T22:26:45.609 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:45.609 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2024-09-15T22:26:45.609 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:26:45.609 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2024-09-15T22:26:45.609 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:26:45.609 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:26:45.609 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:26:45.610 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:26:45.610 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:26:45.610 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:26:45.610 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:26:45.610 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:26:45.610 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:26:45.610 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:26:45.610 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:26:45.610 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:26:45.610 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:26:45.610 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2024-09-15T22:26:45.611 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:26:45.611 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2024-09-15T22:26:45.611 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:26:45.611 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:26:45.611 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:26:45.611 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:26:45.611 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:26:45.611 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:26:45.611 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:26:45.611 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2024-09-15T22:26:45.611 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:26:45.611 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:26:45.611 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:26:45.612 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2024-09-15T22:26:45.612 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2024-09-15T22:26:45.612 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2024-09-15T22:26:45.612 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:26:45.612 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:26:45.612 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:26:45.612 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:26:45.612 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 148955, 2024-09-15T22:26:45.612 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 30, 2024-09-15T22:26:45.612 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:26:45.612 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2024-09-15T22:26:45.612 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2024-09-15T22:26:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2024-09-15T22:26:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:26:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2024-09-15T22:26:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:26:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2024-09-15T22:26:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 0, 2024-09-15T22:26:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 0, 2024-09-15T22:26:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:26:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:26:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2024-09-15T22:26:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2024-09-15T22:26:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 928, 2024-09-15T22:26:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 2, 2024-09-15T22:26:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2024-09-15T22:26:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2024-09-15T22:26:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2024-09-15T22:26:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2024-09-15T22:26:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:26:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-15T22:26:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-09-15T22:26:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-15T22:26:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 224, 2024-09-15T22:26:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 1417075, 2024-09-15T22:26:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 224, 2024-09-15T22:26:45.615 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-09-15T22:26:45.615 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-09-15T22:26:45.615 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 224, 2024-09-15T22:26:45.615 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 1417075, 2024-09-15T22:26:45.615 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-15T22:26:45.615 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:45.615 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:45.615 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:45.615 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:45.615 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:45.615 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:26:45.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:45 smithi165 ceph-mon[35551]: pgmap v326: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:45.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:45 smithi100 ceph-mon[35319]: pgmap v326: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-15T22:26:46.225 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-15T22:26:46.225 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-15T22:26:46.225 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-15T22:26:46.225 DEBUG:tasks.check_counter:Getting stats from g 2024-09-15T22:26:46.225 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-15T22:26:46.482 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:26:47.034 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:26:47.034 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:26:47.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 4, 2024-09-15T22:26:47.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 4, 2024-09-15T22:26:47.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 2992, 2024-09-15T22:26:47.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 448, 2024-09-15T22:26:47.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 4, 2024-09-15T22:26:47.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 0, 2024-09-15T22:26:47.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.003859309, 2024-09-15T22:26:47.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.000054296, 2024-09-15T22:26:47.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.002542690, 2024-09-15T22:26:47.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:47.035 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:47.035 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 3, 2024-09-15T22:26:47.036 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.004659458, 2024-09-15T22:26:47.036 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.001553152 2024-09-15T22:26:47.036 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:47.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:47.036 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:47.036 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:47.036 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:47.036 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:47.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-15T22:26:47.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T22:26:47.036 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:47.036 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:26:47.036 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 2, 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 160, 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 320, 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 185296, 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 5, 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 3, 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.014483865, 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.010005362, 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.002282007, 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 157, 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.012690670, 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000080832 2024-09-15T22:26:47.037 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:47.038 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:47.038 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:47.038 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T22:26:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 185296 2024-09-15T22:26:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:26:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 218, 2024-09-15T22:26:47.040 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 208, 2024-09-15T22:26:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 1447312, 2024-09-15T22:26:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 127904, 2024-09-15T22:26:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 2, 2024-09-15T22:26:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 1, 2024-09-15T22:26:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.041785425, 2024-09-15T22:26:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.013909717, 2024-09-15T22:26:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.039722416, 2024-09-15T22:26:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 207, 2024-09-15T22:26:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.011154892, 2024-09-15T22:26:47.041 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000053888 2024-09-15T22:26:47.042 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:47.042 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:47.042 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:47.042 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:47.042 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:47.042 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:47.042 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 1447312, 2024-09-15T22:26:47.042 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 127904 2024-09-15T22:26:47.042 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:47.042 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2024-09-15T22:26:47.042 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 0, 2024-09-15T22:26:47.042 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2024-09-15T22:26:47.043 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:47.043 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2024-09-15T22:26:47.043 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:26:47.043 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2024-09-15T22:26:47.043 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:26:47.043 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:26:47.043 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:26:47.043 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:26:47.043 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:26:47.044 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:26:47.044 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:26:47.044 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:26:47.044 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:26:47.044 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:26:47.044 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:26:47.044 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:26:47.044 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:26:47.044 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2024-09-15T22:26:47.045 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:26:47.045 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2024-09-15T22:26:47.045 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:26:47.045 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:26:47.045 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:26:47.045 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:26:47.045 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:26:47.045 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:26:47.045 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:26:47.045 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 149017, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 31, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:26:47.046 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 0, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 0, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 928, 2024-09-15T22:26:47.047 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 2, 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 220, 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 1416555, 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 220, 2024-09-15T22:26:47.048 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-09-15T22:26:47.049 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-09-15T22:26:47.049 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 220, 2024-09-15T22:26:47.049 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 1416555, 2024-09-15T22:26:47.049 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-15T22:26:47.049 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:47.049 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:47.049 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:47.049 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:47.049 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:47.049 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:26:47.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:47 smithi165 ceph-mon[35551]: pgmap v327: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:47.732 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:47 smithi045 ceph-mon[31180]: pgmap v327: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:47.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:47 smithi100 ceph-mon[35319]: pgmap v327: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:47.762 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-15T22:26:47.762 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-15T22:26:47.762 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-15T22:26:47.762 DEBUG:tasks.check_counter:Getting stats from j 2024-09-15T22:26:47.763 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-15T22:26:48.020 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:26:48.516 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-09-15T22:26:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:26:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 0, 2024-09-15T22:26:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 2, 2024-09-15T22:26:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:26:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 0, 2024-09-15T22:26:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 4, 2024-09-15T22:26:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 0, 2024-09-15T22:26:48.516 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.001237726, 2024-09-15T22:26:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:26:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.000242442, 2024-09-15T22:26:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:48.517 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 228, 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 216, 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 1451936, 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 132192, 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 2, 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 1, 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.043483947, 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.014733244, 2024-09-15T22:26:48.518 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.040617138, 2024-09-15T22:26:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 216, 2024-09-15T22:26:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.016613950, 2024-09-15T22:26:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000076916 2024-09-15T22:26:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 1451936, 2024-09-15T22:26:48.519 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 132192 2024-09-15T22:26:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:26:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_messages": 2, 2024-09-15T22:26:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages": 164, 2024-09-15T22:26:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_bytes": 320, 2024-09-15T22:26:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_bytes": 186000, 2024-09-15T22:26:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_created_connections": 5, 2024-09-15T22:26:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_active_connections": 3, 2024-09-15T22:26:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_total_time": 0.013748307, 2024-09-15T22:26:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_send_time": 0.009701945, 2024-09-15T22:26:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_recv_time": 0.001775845, 2024-09-15T22:26:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:48.520 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 161, 2024-09-15T22:26:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.015834611, 2024-09-15T22:26:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000098351 2024-09-15T22:26:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T22:26:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: "msgr_send_encrypted_bytes": 186000 2024-09-15T22:26:48.521 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "cct": { 2024-09-15T22:26:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "total_workers": 0, 2024-09-15T22:26:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "unhealthy_workers": 0 2024-09-15T22:26:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "mempool": { 2024-09-15T22:26:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:26:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "bloom_filter_items": 0, 2024-09-15T22:26:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:26:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:26:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:26:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:26:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:26:48.522 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:26:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:26:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:26:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:26:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:26:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:26:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:26:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:26:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_extent_items": 0, 2024-09-15T22:26:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:26:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_blob_items": 0, 2024-09-15T22:26:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:26:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:26:48.523 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:26:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:26:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:26:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:26:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:26:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_txc_items": 0, 2024-09-15T22:26:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:26:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:26:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:26:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "bluestore_writing_items": 0, 2024-09-15T22:26:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_bytes": 0, 2024-09-15T22:26:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_items": 0, 2024-09-15T22:26:48.524 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:26:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:26:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:26:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:26:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_bytes": 149017, 2024-09-15T22:26:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_anon_items": 31, 2024-09-15T22:26:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:26:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "buffer_meta_items": 0, 2024-09-15T22:26:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_bytes": 0, 2024-09-15T22:26:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_items": 0, 2024-09-15T22:26:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:26:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_mapbl_items": 0, 2024-09-15T22:26:48.525 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:26:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_pglog_items": 0, 2024-09-15T22:26:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_bytes": 0, 2024-09-15T22:26:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_items": 0, 2024-09-15T22:26:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:26:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:26:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_bytes": 0, 2024-09-15T22:26:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "pgmap_items": 0, 2024-09-15T22:26:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_bytes": 928, 2024-09-15T22:26:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_co_items": 2, 2024-09-15T22:26:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_bytes": 0, 2024-09-15T22:26:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_1_items": 0, 2024-09-15T22:26:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_bytes": 0, 2024-09-15T22:26:48.526 INFO:teuthology.orchestra.run.smithi045.stdout: "unittest_2_items": 0 2024-09-15T22:26:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-09-15T22:26:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:26:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "val": 0, 2024-09-15T22:26:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "max": 104857600, 2024-09-15T22:26:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "get_started": 0, 2024-09-15T22:26:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "get": 226, 2024-09-15T22:26:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "get_sum": 1417335, 2024-09-15T22:26:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "get_or_fail_success": 226, 2024-09-15T22:26:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "take": 0, 2024-09-15T22:26:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "take_sum": 0, 2024-09-15T22:26:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "put": 226, 2024-09-15T22:26:48.527 INFO:teuthology.orchestra.run.smithi045.stdout: "put_sum": 1417335, 2024-09-15T22:26:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "wait": { 2024-09-15T22:26:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "avgcount": 0, 2024-09-15T22:26:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "sum": 0.000000000, 2024-09-15T22:26:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: "avgtime": 0.000000000 2024-09-15T22:26:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:48.528 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-09-15T22:26:48.528 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-09-15T22:26:49.257 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-15T22:26:49.258 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-15T22:26:49.258 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-15T22:26:49.258 DEBUG:tasks.check_counter:Getting stats from b 2024-09-15T22:26:49.258 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-15T22:26:49.517 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:26:49.549 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:49 smithi045 ceph-mon[31180]: pgmap v328: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:49.637 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:49 smithi100 ceph-mon[35319]: pgmap v328: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:49.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:49 smithi165 ceph-mon[35551]: pgmap v328: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:50.026 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-15T22:26:50.026 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:26:50.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 65007, 2024-09-15T22:26:50.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 112088, 2024-09-15T22:26:50.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 22976184, 2024-09-15T22:26:50.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 81456183, 2024-09-15T22:26:50.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 37, 2024-09-15T22:26:50.026 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 5, 2024-09-15T22:26:50.027 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 3.541011297, 2024-09-15T22:26:50.027 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 1.520685121, 2024-09-15T22:26:50.027 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 10.396847366, 2024-09-15T22:26:50.027 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.300449607, 2024-09-15T22:26:50.027 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:50.027 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 112088, 2024-09-15T22:26:50.027 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 5.697118708, 2024-09-15T22:26:50.027 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000050827 2024-09-15T22:26:50.027 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.027 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:50.027 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 140149, 2024-09-15T22:26:50.027 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.023764357, 2024-09-15T22:26:50.028 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000169 2024-09-15T22:26:50.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1808352, 2024-09-15T22:26:50.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 251824 2024-09-15T22:26:50.028 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.028 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:26:50.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 15571, 2024-09-15T22:26:50.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 15514, 2024-09-15T22:26:50.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 5199931, 2024-09-15T22:26:50.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 90369896, 2024-09-15T22:26:50.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 156, 2024-09-15T22:26:50.028 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 9, 2024-09-15T22:26:50.029 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 1.322534726, 2024-09-15T22:26:50.029 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.477068271, 2024-09-15T22:26:50.029 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.274953976, 2024-09-15T22:26:50.029 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.486234460, 2024-09-15T22:26:50.029 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:50.029 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 15511, 2024-09-15T22:26:50.029 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 3.115010448, 2024-09-15T22:26:50.029 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000200825 2024-09-15T22:26:50.029 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.029 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:50.029 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 254, 2024-09-15T22:26:50.029 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000032164, 2024-09-15T22:26:50.029 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000126 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 44112, 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 137504 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 10590, 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 10556, 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 2749452, 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 36138922, 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 12, 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 5, 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.857495114, 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.337935413, 2024-09-15T22:26:50.030 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.179294282, 2024-09-15T22:26:50.031 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.280948480, 2024-09-15T22:26:50.031 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:50.031 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 10553, 2024-09-15T22:26:50.031 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 2.218575971, 2024-09-15T22:26:50.031 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000210231 2024-09-15T22:26:50.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.031 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:50.031 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 340, 2024-09-15T22:26:50.031 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000057474, 2024-09-15T22:26:50.031 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000169 2024-09-15T22:26:50.031 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.031 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 99664, 2024-09-15T22:26:50.032 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 351856 2024-09-15T22:26:50.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.032 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-15T22:26:50.032 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 1, 2024-09-15T22:26:50.032 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-15T22:26:50.032 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.032 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-MDSRank": { 2024-09-15T22:26:50.032 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-15T22:26:50.032 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-15T22:26:50.032 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 5666, 2024-09-15T22:26:50.032 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 36.119035876, 2024-09-15T22:26:50.032 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.006374697 2024-09-15T22:26:50.032 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: "finisher-PurgeQueue": { 2024-09-15T22:26:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: "queue_len": 0, 2024-09-15T22:26:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: "complete_latency": { 2024-09-15T22:26:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 13294, 2024-09-15T22:26:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 4.287558091, 2024-09-15T22:26:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000322518 2024-09-15T22:26:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": { 2024-09-15T22:26:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: "request": 28739, 2024-09-15T22:26:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: "reply": 28739, 2024-09-15T22:26:50.033 INFO:teuthology.orchestra.run.smithi100.stdout: "reply_latency": { 2024-09-15T22:26:50.034 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 28739, 2024-09-15T22:26:50.034 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 90.358515269, 2024-09-15T22:26:50.034 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.003144107 2024-09-15T22:26:50.034 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.034 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_reply": 0, 2024-09-15T22:26:50.034 INFO:teuthology.orchestra.run.smithi100.stdout: "forward": 0, 2024-09-15T22:26:50.034 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_complete": 0, 2024-09-15T22:26:50.034 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_fetch_keys": 0, 2024-09-15T22:26:50.034 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_commit": 210, 2024-09-15T22:26:50.034 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_split": 22, 2024-09-15T22:26:50.034 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_merge": 2, 2024-09-15T22:26:50.035 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes": 15901, 2024-09-15T22:26:50.035 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_top": 837, 2024-09-15T22:26:50.035 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_bottom": 15064, 2024-09-15T22:26:50.035 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pin_tail": 0, 2024-09-15T22:26:50.035 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_pinned": 14704, 2024-09-15T22:26:50.035 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_expired": 0, 2024-09-15T22:26:50.035 INFO:teuthology.orchestra.run.smithi100.stdout: "inodes_with_caps": 3, 2024-09-15T22:26:50.035 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": 4, 2024-09-15T22:26:50.035 INFO:teuthology.orchestra.run.smithi100.stdout: "subtrees": 2, 2024-09-15T22:26:50.035 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse": 32506, 2024-09-15T22:26:50.035 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_hit": 32414, 2024-09-15T22:26:50.035 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_forward": 0, 2024-09-15T22:26:50.035 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_discover": 0, 2024-09-15T22:26:50.036 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:26:50.036 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_remote_ino": 0, 2024-09-15T22:26:50.036 INFO:teuthology.orchestra.run.smithi100.stdout: "traverse_lock": 0, 2024-09-15T22:26:50.036 INFO:teuthology.orchestra.run.smithi100.stdout: "load_cent": 0, 2024-09-15T22:26:50.036 INFO:teuthology.orchestra.run.smithi100.stdout: "q": 0, 2024-09-15T22:26:50.036 INFO:teuthology.orchestra.run.smithi100.stdout: "exported": 0, 2024-09-15T22:26:50.036 INFO:teuthology.orchestra.run.smithi100.stdout: "exported_inodes": 0, 2024-09-15T22:26:50.036 INFO:teuthology.orchestra.run.smithi100.stdout: "imported": 0, 2024-09-15T22:26:50.036 INFO:teuthology.orchestra.run.smithi100.stdout: "imported_inodes": 0, 2024-09-15T22:26:50.036 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_dir_fetch": 0, 2024-09-15T22:26:50.036 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_backtrace_fetch": 4798, 2024-09-15T22:26:50.036 INFO:teuthology.orchestra.run.smithi100.stdout: "openino_peer_discover": 0, 2024-09-15T22:26:50.036 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rfiles": 4, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rbytes": 234, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "root_rsnaps": 6, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_fetch": 4798, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_set_tag": 0, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_inodes": 477, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dir_base_inodes": 21, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_dirfrag_rstats": 456, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "scrub_file_inodes": 4321, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_revoke": 10343, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_grant": 25901, 2024-09-15T22:26:50.037 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:26:50.038 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:26:50.038 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:26:50.038 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps": 26897, 2024-09-15T22:26:50.038 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_caps_dirty": 15873, 2024-09-15T22:26:50.038 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_cap_release": 1116, 2024-09-15T22:26:50.038 INFO:teuthology.orchestra.run.smithi100.stdout: "process_request_cap_release": 14057 2024-09-15T22:26:50.038 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.038 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_cache": { 2024-09-15T22:26:50.038 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update": 0, 2024-09-15T22:26:50.038 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_update_receipt": 0, 2024-09-15T22:26:50.038 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_try_discover": 0, 2024-09-15T22:26:50.038 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_send_discover": 0, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "dir_handle_discover": 0, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays": 569, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_delayed": 0, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_created": 11761, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_enqueued": 11192, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_reintegrated": 0, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "strays_migrated": 0, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_processing": 0, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_started": 0, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "recovery_completed": 0, 2024-09-15T22:26:50.039 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_path": 3, 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_quiesce_inode": 6681, 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_enqueue_scrub": 21, 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_exportdir": 0, 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_flush": 0, 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragmentdir": 26, 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_fragstats": 0, 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: "ireq_inodestats": 0 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_log": { 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: "evlrg": 0, 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: "evadd": 60695, 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: "evex": 0, 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: "evtrm": 0, 2024-09-15T22:26:50.040 INFO:teuthology.orchestra.run.smithi100.stdout: "ev": 60695, 2024-09-15T22:26:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "evexg": 0, 2024-09-15T22:26:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "evexd": 0, 2024-09-15T22:26:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "segadd": 81, 2024-09-15T22:26:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "segex": 0, 2024-09-15T22:26:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "segtrm": 0, 2024-09-15T22:26:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "seg": 81, 2024-09-15T22:26:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "segmjr": 6, 2024-09-15T22:26:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "segexg": 0, 2024-09-15T22:26:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "segexd": 0, 2024-09-15T22:26:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "expos": 4194304, 2024-09-15T22:26:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "wrpos": 157862665, 2024-09-15T22:26:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "rdpos": 0, 2024-09-15T22:26:50.041 INFO:teuthology.orchestra.run.smithi100.stdout: "jlat": { 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4891, 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 713.951449997, 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.145972490 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "replayed": 0 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_mem": { 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "ino": 7288, 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "ino+": 18501, 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "ino-": 11213, 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "dir": 720, 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "dir+": 813, 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "dir-": 93, 2024-09-15T22:26:50.042 INFO:teuthology.orchestra.run.smithi100.stdout: "dn": 15901, 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "dn+": 27097, 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "dn-": 11196, 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "cap": 4, 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "cap+": 18411, 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "cap-": 18407, 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "rss": 135048, 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "heap": 231712 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_server": { 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_client_request": 31260, 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "dispatch_server_request": 0, 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_request": 28739, 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_client_session": 34, 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "handle_peer_request": 0, 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "req_create_latency": { 2024-09-15T22:26:50.043 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 11148, 2024-09-15T22:26:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 38.142688974, 2024-09-15T22:26:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.003421482 2024-09-15T22:26:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getattr_latency": { 2024-09-15T22:26:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 116, 2024-09-15T22:26:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 2.048667458, 2024-09-15T22:26:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.017660926 2024-09-15T22:26:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getfilelock_latency": { 2024-09-15T22:26:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.044 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "req_link_latency": { 2024-09-15T22:26:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookup_latency": { 2024-09-15T22:26:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3671, 2024-09-15T22:26:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 1.745629267, 2024-09-15T22:26:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000475518 2024-09-15T22:26:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookuphash_latency": { 2024-09-15T22:26:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.045 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupino_latency": { 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000302070, 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000151035 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupname_latency": { 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupparent_latency": { 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.046 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lookupsnap_latency": { 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: "req_lssnap_latency": { 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 10, 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.001704883, 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000170488 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mkdir_latency": { 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 623, 2024-09-15T22:26:50.047 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.735947977, 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001181296 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mknod_latency": { 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: "req_mksnap_latency": { 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 10, 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.046791714, 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.004679171 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: "req_open_latency": { 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1, 2024-09-15T22:26:50.048 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000249957, 2024-09-15T22:26:50.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000249957 2024-09-15T22:26:50.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.049 INFO:teuthology.orchestra.run.smithi100.stdout: "req_readdir_latency": { 2024-09-15T22:26:50.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 1381, 2024-09-15T22:26:50.049 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 1.277176203, 2024-09-15T22:26:50.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000924819 2024-09-15T22:26:50.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.049 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rename_latency": { 2024-09-15T22:26:50.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-15T22:26:50.049 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.002175783, 2024-09-15T22:26:50.049 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001087891 2024-09-15T22:26:50.049 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: "req_renamesnap_latency": { 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: "req_snapdiff_latency": { 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmdir_latency": { 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 617, 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 8.845390331, 2024-09-15T22:26:50.050 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.014336126 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmsnap_latency": { 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 4, 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.013938594, 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.003484648 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: "req_rmxattr_latency": { 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setattr_latency": { 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 2, 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.001576075, 2024-09-15T22:26:50.051 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000788037 2024-09-15T22:26:50.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.052 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setdirlayout_latency": { 2024-09-15T22:26:50.052 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.052 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.052 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.052 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setfilelock_latency": { 2024-09-15T22:26:50.052 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.052 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.052 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.052 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.052 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setlayout_latency": { 2024-09-15T22:26:50.053 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.053 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.053 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.053 INFO:teuthology.orchestra.run.smithi100.stdout: "req_setxattr_latency": { 2024-09-15T22:26:50.053 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 8, 2024-09-15T22:26:50.053 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.020411422, 2024-09-15T22:26:50.053 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.002551427 2024-09-15T22:26:50.053 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.053 INFO:teuthology.orchestra.run.smithi100.stdout: "req_symlink_latency": { 2024-09-15T22:26:50.053 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.053 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.053 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: "req_unlink_latency": { 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 11144, 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 37.475864561, 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.003362873 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: "req_getvxattr_latency": { 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:50.054 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_sessions": { 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: "session_count": 2, 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: "session_add": 6, 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: "session_remove": 4, 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_open": 2, 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: "sessions_stale": 0, 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: "total_load": 214, 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: "average_load": 107, 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: "avg_session_uptime": 609, 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: "mdthresh_evicted": 0 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:26:50.055 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:26:50.056 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-15T22:26:50.057 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 5117089, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 8505, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 88, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 1, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:26:50.058 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 9768, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 197, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 30341038, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 486247, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "objecter": { 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "op_active": 0, 2024-09-15T22:26:50.059 INFO:teuthology.orchestra.run.smithi100.stdout: "op_laggy": 0, 2024-09-15T22:26:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send": 33262, 2024-09-15T22:26:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: "op_send_bytes": 160206841, 2024-09-15T22:26:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: "op_resend": 37, 2024-09-15T22:26:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: "op_reply": 33262, 2024-09-15T22:26:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: "op_latency": { 2024-09-15T22:26:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 33262, 2024-09-15T22:26:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 273.291925699, 2024-09-15T22:26:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.008216340 2024-09-15T22:26:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: "op_inflight": 0, 2024-09-15T22:26:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: "oplen_avg": { 2024-09-15T22:26:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 33262, 2024-09-15T22:26:50.060 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 33635 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "op": 33262, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "op_r": 4938, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "op_w": 28324, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "op_rmw": 0, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "op_pg": 0, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_stat": 0, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_create": 11, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_read": 119, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_write": 4989, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writefull": 65, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_writesame": 0, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_append": 0, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_zero": 0, 2024-09-15T22:26:50.061 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_truncate": 22, 2024-09-15T22:26:50.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_delete": 22932, 2024-09-15T22:26:50.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_mapext": 0, 2024-09-15T22:26:50.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_sparse_read": 0, 2024-09-15T22:26:50.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_clonerange": 0, 2024-09-15T22:26:50.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_getxattr": 4819, 2024-09-15T22:26:50.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_setxattr": 22, 2024-09-15T22:26:50.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:26:50.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_rmxattr": 0, 2024-09-15T22:26:50.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:26:50.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_call": 0, 2024-09-15T22:26:50.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_watch": 0, 2024-09-15T22:26:50.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_notify": 0, 2024-09-15T22:26:50.062 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "osdop_other": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_active": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_send": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_resend": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "linger_ping": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_active": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_send": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "poolop_resend": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_active": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_send": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "poolstat_resend": 0, 2024-09-15T22:26:50.063 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_active": 0, 2024-09-15T22:26:50.064 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_send": 0, 2024-09-15T22:26:50.064 INFO:teuthology.orchestra.run.smithi100.stdout: "statfs_resend": 0, 2024-09-15T22:26:50.064 INFO:teuthology.orchestra.run.smithi100.stdout: "command_active": 0, 2024-09-15T22:26:50.064 INFO:teuthology.orchestra.run.smithi100.stdout: "command_send": 0, 2024-09-15T22:26:50.064 INFO:teuthology.orchestra.run.smithi100.stdout: "command_resend": 0, 2024-09-15T22:26:50.064 INFO:teuthology.orchestra.run.smithi100.stdout: "map_epoch": 100, 2024-09-15T22:26:50.064 INFO:teuthology.orchestra.run.smithi100.stdout: "map_full": 0, 2024-09-15T22:26:50.064 INFO:teuthology.orchestra.run.smithi100.stdout: "map_inc": 19, 2024-09-15T22:26:50.064 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_sessions": 12, 2024-09-15T22:26:50.064 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_open": 12, 2024-09-15T22:26:50.064 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_session_close": 0, 2024-09-15T22:26:50.065 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_laggy": 0, 2024-09-15T22:26:50.065 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_wr": 574, 2024-09-15T22:26:50.065 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_rd": 0, 2024-09-15T22:26:50.065 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_del": 82 2024-09-15T22:26:50.065 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.065 INFO:teuthology.orchestra.run.smithi100.stdout: "oft": { 2024-09-15T22:26:50.065 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_objs": 1, 2024-09-15T22:26:50.065 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:26:50.065 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_updates": 0, 2024-09-15T22:26:50.065 INFO:teuthology.orchestra.run.smithi100.stdout: "omap_total_removes": 0 2024-09-15T22:26:50.065 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: "osd-slow-ops": { 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: "slow_ops_count": 6686 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: "purge_queue": { 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops": 0, 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_ops_high_water": 55, 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing": 0, 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executing_high_water": 27, 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed_ops": 22368, 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_executed": 11192, 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: "pq_item_in_journal": 0 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:26:50.066 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-15T22:26:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-15T22:26:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-15T22:26:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 91164, 2024-09-15T22:26:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 22654182, 2024-09-15T22:26:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 91164, 2024-09-15T22:26:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-15T22:26:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-15T22:26:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 91164, 2024-09-15T22:26:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 22654182, 2024-09-15T22:26:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-15T22:26:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.067 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.068 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.068 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:50.068 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.068 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_bytes": { 2024-09-15T22:26:50.068 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-15T22:26:50.068 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-15T22:26:50.068 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-15T22:26:50.069 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-15T22:26:50.069 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-15T22:26:50.069 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:50.069 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-15T22:26:50.069 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 33262, 2024-09-15T22:26:50.069 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 161479969, 2024-09-15T22:26:50.069 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 33262, 2024-09-15T22:26:50.069 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 161479969, 2024-09-15T22:26:50.069 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-15T22:26:50.069 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.069 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.069 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.070 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:50.070 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.070 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-objecter_ops": { 2024-09-15T22:26:50.070 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-15T22:26:50.070 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 1024, 2024-09-15T22:26:50.070 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-15T22:26:50.070 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 0, 2024-09-15T22:26:50.070 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 0, 2024-09-15T22:26:50.070 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:50.070 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 0, 2024-09-15T22:26:50.070 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 33262, 2024-09-15T22:26:50.070 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 33262, 2024-09-15T22:26:50.070 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 33262, 2024-09-15T22:26:50.071 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 33262, 2024-09-15T22:26:50.071 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-15T22:26:50.071 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.071 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.071 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.071 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:50.071 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.071 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:26:50.071 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-15T22:26:50.071 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-15T22:26:50.071 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-15T22:26:50.071 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 11192, 2024-09-15T22:26:50.072 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1273128, 2024-09-15T22:26:50.072 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:50.072 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 11192, 2024-09-15T22:26:50.072 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-15T22:26:50.072 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-15T22:26:50.072 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 98, 2024-09-15T22:26:50.072 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1273128, 2024-09-15T22:26:50.072 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-15T22:26:50.072 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.072 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.072 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.072 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:50.072 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:50.073 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-write_buf_throttle-0x55eaf4584960": { 2024-09-15T22:26:50.073 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-15T22:26:50.073 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 3758096384, 2024-09-15T22:26:50.073 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-15T22:26:50.073 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 60695, 2024-09-15T22:26:50.073 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 153668361, 2024-09-15T22:26:50.073 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:50.073 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 60695, 2024-09-15T22:26:50.073 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-15T22:26:50.073 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-15T22:26:50.073 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 4891, 2024-09-15T22:26:50.073 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 153668361, 2024-09-15T22:26:50.074 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-15T22:26:50.074 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:50.074 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:50.074 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:50.074 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:50.074 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:50.074 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-15T22:26:50.828 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-15T22:26:50.828 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-15T22:26:50.828 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-15T22:26:50.828 DEBUG:tasks.check_counter:Getting stats from e 2024-09-15T22:26:50.828 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-15T22:26:51.084 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:26:51.494 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:51 smithi100 ceph-mon[35319]: pgmap v329: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:26:51.600 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-15T22:26:51.600 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:26:51.600 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 223, 2024-09-15T22:26:51.600 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 213, 2024-09-15T22:26:51.600 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1448672, 2024-09-15T22:26:51.600 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 131104, 2024-09-15T22:26:51.601 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-15T22:26:51.601 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-09-15T22:26:51.601 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.040617804, 2024-09-15T22:26:51.601 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.014536436, 2024-09-15T22:26:51.601 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.038401484, 2024-09-15T22:26:51.601 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:51.601 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:51.601 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 212, 2024-09-15T22:26:51.601 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.013076078, 2024-09-15T22:26:51.601 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000061679 2024-09-15T22:26:51.601 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:51.602 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:51.602 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:51.602 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:51.602 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:51.602 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:51.602 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1448672, 2024-09-15T22:26:51.602 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 131104 2024-09-15T22:26:51.602 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:51.602 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:26:51.602 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 6, 2024-09-15T22:26:51.602 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 165, 2024-09-15T22:26:51.602 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 3312, 2024-09-15T22:26:51.602 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 186272, 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 5, 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 3, 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.013257809, 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.007243171, 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.003979709, 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 163, 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.026045670, 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000159789 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:51.603 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 186272 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 0, 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 2, 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 0, 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.000320354, 2024-09-15T22:26:51.604 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.000251622, 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:26:51.605 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:26:51.606 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:26:51.607 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:26:51.607 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:26:51.607 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:26:51.607 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:26:51.607 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:26:51.607 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:26:51.607 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-15T22:26:51.607 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:26:51.607 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-15T22:26:51.607 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:26:51.608 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:26:51.609 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:26:51.609 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:26:51.609 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 149017, 2024-09-15T22:26:51.609 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 31, 2024-09-15T22:26:51.609 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:26:51.609 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-15T22:26:51.609 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-15T22:26:51.609 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-15T22:26:51.609 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:26:51.609 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-15T22:26:51.609 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:26:51.609 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-15T22:26:51.609 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:26:51.610 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 225, 2024-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1417205, 2024-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 225, 2024-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 225, 2024-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1417205, 2024-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:51.611 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:51.612 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:51.612 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:51.612 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:51.612 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-15T22:26:51.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:51 smithi165 ceph-mon[35551]: pgmap v329: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:26:51.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:51 smithi045 ceph-mon[31180]: pgmap v329: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:26:52.352 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-09-15T22:26:52.352 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-09-15T22:26:52.352 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-09-15T22:26:52.352 DEBUG:tasks.check_counter:Getting stats from h 2024-09-15T22:26:52.353 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-15T22:26:52.600 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:26:53.137 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-15T22:26:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:26:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 221, 2024-09-15T22:26:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 211, 2024-09-15T22:26:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1448128, 2024-09-15T22:26:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 129824, 2024-09-15T22:26:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-15T22:26:53.137 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-09-15T22:26:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.039011764, 2024-09-15T22:26:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.014088291, 2024-09-15T22:26:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.036909331, 2024-09-15T22:26:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 210, 2024-09-15T22:26:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.011793518, 2024-09-15T22:26:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000056159 2024-09-15T22:26:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:53.138 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1448128, 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 129824 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2, 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 162, 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 320, 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 185648, 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 5, 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 3, 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.011454806, 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.007539312, 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.001791353, 2024-09-15T22:26:53.139 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 159, 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.020877994, 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000131308 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 185648 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:53.140 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 4, 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 4, 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 2992, 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 448, 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.002363158, 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000038863, 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.002300558, 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.004123494, 2024-09-15T22:26:53.141 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001374498 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-15T22:26:53.142 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:26:53.143 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:26:53.144 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 149017, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 31, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-15T22:26:53.145 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-15T22:26:53.146 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 223, 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1416945, 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 223, 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 223, 2024-09-15T22:26:53.147 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1416945, 2024-09-15T22:26:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-15T22:26:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:53.148 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:53.148 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-15T22:26:53.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:53 smithi165 ceph-mon[35551]: pgmap v330: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:53.743 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:53 smithi100 ceph-mon[35319]: pgmap v330: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:53.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:53 smithi045 ceph-mon[31180]: pgmap v330: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:53.819 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.h 2024-09-15T22:26:53.819 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.h 2024-09-15T22:26:53.819 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.h 2024-09-15T22:26:53.819 DEBUG:tasks.check_counter:Getting stats from k 2024-09-15T22:26:53.820 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-15T22:26:54.066 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T22:26:54.639 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-09-15T22:26:54.639 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:26:54.639 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 226, 2024-09-15T22:26:54.639 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 216, 2024-09-15T22:26:54.640 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 1449488, 2024-09-15T22:26:54.640 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 133024, 2024-09-15T22:26:54.640 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 4, 2024-09-15T22:26:54.640 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 0, 2024-09-15T22:26:54.640 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.041342985, 2024-09-15T22:26:54.640 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.015296573, 2024-09-15T22:26:54.640 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.037425757, 2024-09-15T22:26:54.640 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:54.640 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:54.640 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 215, 2024-09-15T22:26:54.640 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.013695554, 2024-09-15T22:26:54.640 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000063700 2024-09-15T22:26:54.640 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:54.641 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:54.641 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:54.641 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:54.641 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:54.641 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:54.641 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 1449488, 2024-09-15T22:26:54.641 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 133024 2024-09-15T22:26:54.641 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:54.641 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:26:54.641 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 2, 2024-09-15T22:26:54.641 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 166, 2024-09-15T22:26:54.641 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 320, 2024-09-15T22:26:54.641 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 186352, 2024-09-15T22:26:54.642 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 5, 2024-09-15T22:26:54.642 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 3, 2024-09-15T22:26:54.642 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.011420367, 2024-09-15T22:26:54.642 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.007466403, 2024-09-15T22:26:54.642 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.001680555, 2024-09-15T22:26:54.642 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:54.642 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:54.642 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 163, 2024-09-15T22:26:54.642 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.017957673, 2024-09-15T22:26:54.642 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000110169 2024-09-15T22:26:54.642 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:54.642 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 186352 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_messages": 4, 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages": 4, 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_bytes": 2992, 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_bytes": 448, 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_created_connections": 2, 2024-09-15T22:26:54.643 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_active_connections": 1, 2024-09-15T22:26:54.644 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_total_time": 0.002269876, 2024-09-15T22:26:54.644 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_send_time": 0.000039730, 2024-09-15T22:26:54.644 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_recv_time": 0.002206078, 2024-09-15T22:26:54.644 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:54.644 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:54.644 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 3, 2024-09-15T22:26:54.644 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.004020422, 2024-09-15T22:26:54.644 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.001340140 2024-09-15T22:26:54.644 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:54.644 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:54.644 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:54.644 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: "cct": { 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: "total_workers": 0, 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: "unhealthy_workers": 0 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: "mempool": { 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: "bloom_filter_items": 0, 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:26:54.645 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:26:54.646 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:26:54.646 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:26:54.646 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:26:54.646 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:26:54.646 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:26:54.646 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:26:54.646 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:26:54.646 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:26:54.646 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:26:54.646 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:26:54.646 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:26:54.646 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_extent_items": 0, 2024-09-15T22:26:54.646 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:26:54.647 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_blob_items": 0, 2024-09-15T22:26:54.647 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:26:54.647 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:26:54.647 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:26:54.647 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:26:54.647 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:26:54.647 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:26:54.647 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:26:54.647 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_txc_items": 0, 2024-09-15T22:26:54.647 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:26:54.647 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:26:54.647 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:26:54.647 INFO:teuthology.orchestra.run.smithi100.stdout: "bluestore_writing_items": 0, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_bytes": 0, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_items": 0, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_bytes": 148977, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_anon_items": 30, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "buffer_meta_items": 0, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_bytes": 0, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_items": 0, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:26:54.648 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_mapbl_items": 0, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "osd_pglog_items": 0, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_bytes": 0, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_items": 0, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_bytes": 0, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "pgmap_items": 0, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_bytes": 928, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "mds_co_items": 2, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_bytes": 0, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_1_items": 0, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_bytes": 0, 2024-09-15T22:26:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: "unittest_2_items": 0 2024-09-15T22:26:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-09-15T22:26:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:26:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: "val": 0, 2024-09-15T22:26:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: "max": 104857600, 2024-09-15T22:26:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: "get_started": 0, 2024-09-15T22:26:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: "get": 228, 2024-09-15T22:26:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: "get_sum": 1417595, 2024-09-15T22:26:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: "get_or_fail_success": 228, 2024-09-15T22:26:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: "take": 0, 2024-09-15T22:26:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: "take_sum": 0, 2024-09-15T22:26:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: "put": 228, 2024-09-15T22:26:54.650 INFO:teuthology.orchestra.run.smithi100.stdout: "put_sum": 1417595, 2024-09-15T22:26:54.651 INFO:teuthology.orchestra.run.smithi100.stdout: "wait": { 2024-09-15T22:26:54.651 INFO:teuthology.orchestra.run.smithi100.stdout: "avgcount": 0, 2024-09-15T22:26:54.651 INFO:teuthology.orchestra.run.smithi100.stdout: "sum": 0.000000000, 2024-09-15T22:26:54.651 INFO:teuthology.orchestra.run.smithi100.stdout: "avgtime": 0.000000000 2024-09-15T22:26:54.651 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:54.651 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-09-15T22:26:54.651 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-09-15T22:26:55.371 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-15T22:26:55.371 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-15T22:26:55.371 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-15T22:26:55.371 DEBUG:tasks.check_counter:Getting stats from c 2024-09-15T22:26:55.371 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-15T22:26:55.631 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:26:55.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:55 smithi165 ceph-mon[35551]: pgmap v331: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:26:55.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:55 smithi100 ceph-mon[35319]: pgmap v331: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:26:55.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:55 smithi045 ceph-mon[31180]: pgmap v331: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:26:56.151 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-15T22:26:56.152 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:26:56.152 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 0, 2024-09-15T22:26:56.152 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 2, 2024-09-15T22:26:56.152 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:26:56.152 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 0, 2024-09-15T22:26:56.152 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 4, 2024-09-15T22:26:56.152 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 0, 2024-09-15T22:26:56.152 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.001116397, 2024-09-15T22:26:56.152 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:26:56.152 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.000207229, 2024-09-15T22:26:56.152 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:56.152 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:56.153 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:56.153 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:56.153 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:56.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:56.153 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:56.153 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:56.153 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:56.153 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:56.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:56.153 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:26:56.153 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:26:56.153 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:56.153 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:26:56.154 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 228, 2024-09-15T22:26:56.154 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 216, 2024-09-15T22:26:56.154 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 1452000, 2024-09-15T22:26:56.154 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 131712, 2024-09-15T22:26:56.154 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 2, 2024-09-15T22:26:56.154 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 1, 2024-09-15T22:26:56.154 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.044024615, 2024-09-15T22:26:56.154 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.015751291, 2024-09-15T22:26:56.154 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.040896614, 2024-09-15T22:26:56.154 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:56.154 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:56.154 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 216, 2024-09-15T22:26:56.155 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.018122129, 2024-09-15T22:26:56.155 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000083898 2024-09-15T22:26:56.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:56.155 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:56.155 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:56.155 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:56.155 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:56.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:56.155 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 1452000, 2024-09-15T22:26:56.155 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 131712 2024-09-15T22:26:56.155 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:56.155 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:26:56.155 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 2, 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 163, 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 320, 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 185824, 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 5, 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 3, 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.011234223, 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.007570405, 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.001565767, 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 160, 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.016137981, 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000100862 2024-09-15T22:26:56.156 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 185824 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: "cct": { 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: "total_workers": 0, 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: "unhealthy_workers": 0 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: "mempool": { 2024-09-15T22:26:56.157 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:26:56.158 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_items": 0, 2024-09-15T22:26:56.158 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:26:56.158 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:26:56.158 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:26:56.158 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:26:56.158 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:26:56.158 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:26:56.158 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:26:56.158 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:26:56.158 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:26:56.158 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:26:56.158 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:26:56.158 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_items": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_items": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_items": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:26:56.159 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:26:56.160 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:26:56.160 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_items": 0, 2024-09-15T22:26:56.160 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_bytes": 0, 2024-09-15T22:26:56.160 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_items": 0, 2024-09-15T22:26:56.160 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:26:56.160 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:26:56.160 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:26:56.160 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:26:56.160 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_bytes": 148977, 2024-09-15T22:26:56.160 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_items": 30, 2024-09-15T22:26:56.160 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:26:56.160 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_items": 0, 2024-09-15T22:26:56.161 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_bytes": 0, 2024-09-15T22:26:56.161 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_items": 0, 2024-09-15T22:26:56.161 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:26:56.161 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_items": 0, 2024-09-15T22:26:56.161 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:26:56.161 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_items": 0, 2024-09-15T22:26:56.161 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_bytes": 0, 2024-09-15T22:26:56.161 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_items": 0, 2024-09-15T22:26:56.161 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:26:56.161 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:26:56.161 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_bytes": 0, 2024-09-15T22:26:56.161 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_items": 0, 2024-09-15T22:26:56.161 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_bytes": 928, 2024-09-15T22:26:56.162 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_items": 2, 2024-09-15T22:26:56.162 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_bytes": 0, 2024-09-15T22:26:56.162 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_items": 0, 2024-09-15T22:26:56.162 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_bytes": 0, 2024-09-15T22:26:56.162 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_items": 0 2024-09-15T22:26:56.162 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:56.162 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:26:56.162 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-15T22:26:56.162 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 104857600, 2024-09-15T22:26:56.163 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-15T22:26:56.163 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 226, 2024-09-15T22:26:56.163 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 1417399, 2024-09-15T22:26:56.163 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:56.163 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 226, 2024-09-15T22:26:56.163 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-15T22:26:56.163 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-15T22:26:56.163 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 226, 2024-09-15T22:26:56.163 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 1417399, 2024-09-15T22:26:56.163 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-15T22:26:56.163 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:56.163 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:56.164 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:56.164 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:26:56.164 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:26:56.164 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-15T22:26:56.976 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2024-09-15T22:26:56.976 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2024-09-15T22:26:56.976 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2024-09-15T22:26:56.976 DEBUG:tasks.check_counter:Getting stats from f 2024-09-15T22:26:56.977 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-15T22:26:57.232 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:26:57.502 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:57 smithi165 ceph-mon[35551]: pgmap v332: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:57.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:57 smithi100 ceph-mon[35319]: pgmap v332: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:57.746 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-15T22:26:57.746 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:26:57.746 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 4, 2024-09-15T22:26:57.746 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 4, 2024-09-15T22:26:57.746 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 2992, 2024-09-15T22:26:57.746 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 448, 2024-09-15T22:26:57.746 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 4, 2024-09-15T22:26:57.746 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 0, 2024-09-15T22:26:57.746 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.003354038, 2024-09-15T22:26:57.746 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.000037119, 2024-09-15T22:26:57.746 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.002267631, 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 3, 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.004044067, 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.001348022 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 448 2024-09-15T22:26:57.747 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:57.748 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:26:57.748 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 2, 2024-09-15T22:26:57.748 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 164, 2024-09-15T22:26:57.748 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 320, 2024-09-15T22:26:57.748 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 186000, 2024-09-15T22:26:57.748 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 5, 2024-09-15T22:26:57.748 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 3, 2024-09-15T22:26:57.748 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.011182985, 2024-09-15T22:26:57.748 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.007417290, 2024-09-15T22:26:57.748 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.001515317, 2024-09-15T22:26:57.748 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:57.748 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:57.748 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 161, 2024-09-15T22:26:57.749 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.020432022, 2024-09-15T22:26:57.749 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000126906 2024-09-15T22:26:57.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:57.749 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:57.749 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:57.749 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:57.749 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:57.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:57.749 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-15T22:26:57.749 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 186000 2024-09-15T22:26:57.749 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:57.749 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:26:57.749 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 225, 2024-09-15T22:26:57.750 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 215, 2024-09-15T22:26:57.750 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 1449280, 2024-09-15T22:26:57.750 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 131904, 2024-09-15T22:26:57.750 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 2, 2024-09-15T22:26:57.750 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 1, 2024-09-15T22:26:57.750 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.041792349, 2024-09-15T22:26:57.750 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.015212440, 2024-09-15T22:26:57.750 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.039617424, 2024-09-15T22:26:57.750 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:26:57.750 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:57.751 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 214, 2024-09-15T22:26:57.751 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.012421772, 2024-09-15T22:26:57.751 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000058045 2024-09-15T22:26:57.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:57.751 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:57.751 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:57.751 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:57.751 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:57.751 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:57.752 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 1449280, 2024-09-15T22:26:57.752 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 131904 2024-09-15T22:26:57.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:57.752 INFO:teuthology.orchestra.run.smithi165.stdout: "cct": { 2024-09-15T22:26:57.752 INFO:teuthology.orchestra.run.smithi165.stdout: "total_workers": 0, 2024-09-15T22:26:57.752 INFO:teuthology.orchestra.run.smithi165.stdout: "unhealthy_workers": 0 2024-09-15T22:26:57.752 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:57.752 INFO:teuthology.orchestra.run.smithi165.stdout: "mempool": { 2024-09-15T22:26:57.752 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:26:57.752 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_items": 0, 2024-09-15T22:26:57.752 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:26:57.752 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:26:57.752 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_items": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_items": 0, 2024-09-15T22:26:57.753 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:26:57.754 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:26:57.754 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:26:57.754 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:26:57.754 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:26:57.754 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:26:57.754 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:26:57.754 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_items": 0, 2024-09-15T22:26:57.754 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:26:57.754 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:26:57.754 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:26:57.754 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_items": 0, 2024-09-15T22:26:57.754 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_bytes": 0, 2024-09-15T22:26:57.754 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_items": 0, 2024-09-15T22:26:57.755 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:26:57.755 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:26:57.755 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:26:57.755 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:26:57.755 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_bytes": 149057, 2024-09-15T22:26:57.755 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_items": 32, 2024-09-15T22:26:57.755 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:26:57.755 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_items": 0, 2024-09-15T22:26:57.755 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_bytes": 0, 2024-09-15T22:26:57.755 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_items": 0, 2024-09-15T22:26:57.755 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:26:57.755 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_items": 0, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_items": 0, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_bytes": 0, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_items": 0, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_bytes": 0, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_items": 0, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_bytes": 928, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_items": 2, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_bytes": 0, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_items": 0, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_bytes": 0, 2024-09-15T22:26:57.756 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_items": 0 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 104857600, 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 227, 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 1417529, 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 227, 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 227, 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 1417529, 2024-09-15T22:26:57.757 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-15T22:26:57.758 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:57.758 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:57.758 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:57.758 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:26:57.758 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:26:57.758 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-15T22:26:57.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:57 smithi045 ceph-mon[31180]: pgmap v332: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:58.459 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-09-15T22:26:58.459 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-09-15T22:26:58.459 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-09-15T22:26:58.459 DEBUG:tasks.check_counter:Getting stats from i 2024-09-15T22:26:58.460 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-15T22:26:58.709 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:26:59.248 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-15T22:26:59.248 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:26:59.249 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 1581, 2024-09-15T22:26:59.249 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 1583, 2024-09-15T22:26:59.249 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 66062942, 2024-09-15T22:26:59.249 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 502768, 2024-09-15T22:26:59.249 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 8, 2024-09-15T22:26:59.249 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 4, 2024-09-15T22:26:59.249 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.201525244, 2024-09-15T22:26:59.249 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.052737180, 2024-09-15T22:26:59.249 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.079951843, 2024-09-15T22:26:59.249 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.052935364, 2024-09-15T22:26:59.249 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:59.249 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 1581, 2024-09-15T22:26:59.249 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.065315546, 2024-09-15T22:26:59.250 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000041312 2024-09-15T22:26:59.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.250 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:59.250 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.250 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.250 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.250 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:26:59.250 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:26:59.250 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.250 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:26:59.250 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 889, 2024-09-15T22:26:59.250 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 878, 2024-09-15T22:26:59.251 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 51979164, 2024-09-15T22:26:59.251 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 339398, 2024-09-15T22:26:59.251 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 6, 2024-09-15T22:26:59.251 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 5, 2024-09-15T22:26:59.251 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.133085344, 2024-09-15T22:26:59.251 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.034411910, 2024-09-15T22:26:59.251 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.082795076, 2024-09-15T22:26:59.251 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.023017148, 2024-09-15T22:26:59.251 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:59.251 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 877, 2024-09-15T22:26:59.251 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.041453882, 2024-09-15T22:26:59.251 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000047267 2024-09-15T22:26:59.252 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.252 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:59.252 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.252 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.252 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.252 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.252 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 1472400, 2024-09-15T22:26:59.252 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 133904 2024-09-15T22:26:59.252 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.252 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:26:59.252 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 330, 2024-09-15T22:26:59.252 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 489, 2024-09-15T22:26:59.252 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 37837337, 2024-09-15T22:26:59.253 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 545417, 2024-09-15T22:26:59.253 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 8, 2024-09-15T22:26:59.253 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 6, 2024-09-15T22:26:59.253 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.057064630, 2024-09-15T22:26:59.253 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.016340053, 2024-09-15T22:26:59.253 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.027211193, 2024-09-15T22:26:59.253 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.009060331, 2024-09-15T22:26:59.253 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:26:59.253 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 487, 2024-09-15T22:26:59.253 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.038747061, 2024-09-15T22:26:59.253 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000079562 2024-09-15T22:26:59.253 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.253 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:26:59.254 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.254 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.254 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.254 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.254 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-15T22:26:59.254 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 442384 2024-09-15T22:26:59.254 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.254 INFO:teuthology.orchestra.run.smithi165.stdout: "cct": { 2024-09-15T22:26:59.254 INFO:teuthology.orchestra.run.smithi165.stdout: "total_workers": 1, 2024-09-15T22:26:59.254 INFO:teuthology.orchestra.run.smithi165.stdout: "unhealthy_workers": 0 2024-09-15T22:26:59.254 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.254 INFO:teuthology.orchestra.run.smithi165.stdout: "finisher-MDSRank": { 2024-09-15T22:26:59.254 INFO:teuthology.orchestra.run.smithi165.stdout: "queue_len": 0, 2024-09-15T22:26:59.255 INFO:teuthology.orchestra.run.smithi165.stdout: "complete_latency": { 2024-09-15T22:26:59.255 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 4054, 2024-09-15T22:26:59.255 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.120619138, 2024-09-15T22:26:59.255 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000029753 2024-09-15T22:26:59.255 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:26:59.255 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.255 INFO:teuthology.orchestra.run.smithi165.stdout: "finisher-PurgeQueue": { 2024-09-15T22:26:59.255 INFO:teuthology.orchestra.run.smithi165.stdout: "queue_len": 0, 2024-09-15T22:26:59.255 INFO:teuthology.orchestra.run.smithi165.stdout: "complete_latency": { 2024-09-15T22:26:59.255 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.255 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.255 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.256 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:26:59.256 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.256 INFO:teuthology.orchestra.run.smithi165.stdout: "mds": { 2024-09-15T22:26:59.256 INFO:teuthology.orchestra.run.smithi165.stdout: "request": 0, 2024-09-15T22:26:59.256 INFO:teuthology.orchestra.run.smithi165.stdout: "reply": 0, 2024-09-15T22:26:59.256 INFO:teuthology.orchestra.run.smithi165.stdout: "reply_latency": { 2024-09-15T22:26:59.256 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.256 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.256 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.256 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.256 INFO:teuthology.orchestra.run.smithi165.stdout: "slow_reply": 0, 2024-09-15T22:26:59.256 INFO:teuthology.orchestra.run.smithi165.stdout: "forward": 0, 2024-09-15T22:26:59.257 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_fetch_complete": 0, 2024-09-15T22:26:59.257 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_fetch_keys": 0, 2024-09-15T22:26:59.257 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_commit": 0, 2024-09-15T22:26:59.257 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_split": 0, 2024-09-15T22:26:59.257 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_merge": 0, 2024-09-15T22:26:59.257 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes": 26408, 2024-09-15T22:26:59.257 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_top": 0, 2024-09-15T22:26:59.257 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_bottom": 26408, 2024-09-15T22:26:59.257 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_pin_tail": 0, 2024-09-15T22:26:59.257 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_pinned": 26408, 2024-09-15T22:26:59.257 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_expired": 0, 2024-09-15T22:26:59.257 INFO:teuthology.orchestra.run.smithi165.stdout: "inodes_with_caps": 0, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "caps": 0, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "subtrees": 2, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse": 0, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_hit": 0, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_forward": 0, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_discover": 0, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_dir_fetch": 0, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_remote_ino": 0, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "traverse_lock": 0, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "load_cent": 0, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "q": 0, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "exported": 0, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "exported_inodes": 0, 2024-09-15T22:26:59.258 INFO:teuthology.orchestra.run.smithi165.stdout: "imported": 0, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "imported_inodes": 0, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "openino_dir_fetch": 0, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "openino_backtrace_fetch": 0, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "openino_peer_discover": 0, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "root_rfiles": 4, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "root_rbytes": 234, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "root_rsnaps": 6, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_set_tag": 0, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_inotable_repaired": 0, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_dir_inodes": 0, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T22:26:59.259 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "scrub_file_inodes": 0, 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_inode_file_caps": 0, 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_revoke": 0, 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_grant": 0, 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_caps": 0, 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_caps_dirty": 0, 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_cap_release": 0, 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "process_request_cap_release": 0 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_cache": { 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_update": 0, 2024-09-15T22:26:59.260 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_update_receipt": 0, 2024-09-15T22:26:59.261 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_try_discover": 0, 2024-09-15T22:26:59.261 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_send_discover": 0, 2024-09-15T22:26:59.261 INFO:teuthology.orchestra.run.smithi165.stdout: "dir_handle_discover": 0, 2024-09-15T22:26:59.261 INFO:teuthology.orchestra.run.smithi165.stdout: "num_strays": 0, 2024-09-15T22:26:59.261 INFO:teuthology.orchestra.run.smithi165.stdout: "num_strays_delayed": 0, 2024-09-15T22:26:59.261 INFO:teuthology.orchestra.run.smithi165.stdout: "num_strays_enqueuing": 0, 2024-09-15T22:26:59.261 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_created": 0, 2024-09-15T22:26:59.261 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_enqueued": 0, 2024-09-15T22:26:59.261 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_reintegrated": 0, 2024-09-15T22:26:59.261 INFO:teuthology.orchestra.run.smithi165.stdout: "strays_migrated": 0, 2024-09-15T22:26:59.261 INFO:teuthology.orchestra.run.smithi165.stdout: "num_recovering_processing": 0, 2024-09-15T22:26:59.261 INFO:teuthology.orchestra.run.smithi165.stdout: "num_recovering_enqueued": 0, 2024-09-15T22:26:59.261 INFO:teuthology.orchestra.run.smithi165.stdout: "num_recovering_prioritized": 0, 2024-09-15T22:26:59.262 INFO:teuthology.orchestra.run.smithi165.stdout: "recovery_started": 0, 2024-09-15T22:26:59.262 INFO:teuthology.orchestra.run.smithi165.stdout: "recovery_completed": 0, 2024-09-15T22:26:59.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_quiesce_path": 0, 2024-09-15T22:26:59.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_quiesce_inode": 0, 2024-09-15T22:26:59.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T22:26:59.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_exportdir": 0, 2024-09-15T22:26:59.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_flush": 0, 2024-09-15T22:26:59.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_fragmentdir": 0, 2024-09-15T22:26:59.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_fragstats": 0, 2024-09-15T22:26:59.262 INFO:teuthology.orchestra.run.smithi165.stdout: "ireq_inodestats": 0 2024-09-15T22:26:59.262 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.262 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_log": { 2024-09-15T22:26:59.262 INFO:teuthology.orchestra.run.smithi165.stdout: "evlrg": 0, 2024-09-15T22:26:59.263 INFO:teuthology.orchestra.run.smithi165.stdout: "evadd": 0, 2024-09-15T22:26:59.263 INFO:teuthology.orchestra.run.smithi165.stdout: "evex": 0, 2024-09-15T22:26:59.263 INFO:teuthology.orchestra.run.smithi165.stdout: "evtrm": 0, 2024-09-15T22:26:59.263 INFO:teuthology.orchestra.run.smithi165.stdout: "ev": 60695, 2024-09-15T22:26:59.263 INFO:teuthology.orchestra.run.smithi165.stdout: "evexg": 0, 2024-09-15T22:26:59.263 INFO:teuthology.orchestra.run.smithi165.stdout: "evexd": 0, 2024-09-15T22:26:59.263 INFO:teuthology.orchestra.run.smithi165.stdout: "segadd": 0, 2024-09-15T22:26:59.263 INFO:teuthology.orchestra.run.smithi165.stdout: "segex": 0, 2024-09-15T22:26:59.263 INFO:teuthology.orchestra.run.smithi165.stdout: "segtrm": 0, 2024-09-15T22:26:59.263 INFO:teuthology.orchestra.run.smithi165.stdout: "seg": 81, 2024-09-15T22:26:59.263 INFO:teuthology.orchestra.run.smithi165.stdout: "segmjr": 6, 2024-09-15T22:26:59.263 INFO:teuthology.orchestra.run.smithi165.stdout: "segexg": 0, 2024-09-15T22:26:59.264 INFO:teuthology.orchestra.run.smithi165.stdout: "segexd": 0, 2024-09-15T22:26:59.264 INFO:teuthology.orchestra.run.smithi165.stdout: "expos": 4194304, 2024-09-15T22:26:59.264 INFO:teuthology.orchestra.run.smithi165.stdout: "wrpos": 157862665, 2024-09-15T22:26:59.264 INFO:teuthology.orchestra.run.smithi165.stdout: "rdpos": 157862529, 2024-09-15T22:26:59.264 INFO:teuthology.orchestra.run.smithi165.stdout: "jlat": { 2024-09-15T22:26:59.264 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.264 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.264 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.264 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.264 INFO:teuthology.orchestra.run.smithi165.stdout: "replayed": 60695 2024-09-15T22:26:59.264 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.264 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_mem": { 2024-09-15T22:26:59.264 INFO:teuthology.orchestra.run.smithi165.stdout: "ino": 7288, 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: "ino+": 18480, 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: "ino-": 11192, 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: "dir": 720, 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: "dir+": 813, 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: "dir-": 93, 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: "dn": 26408, 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: "dn+": 27094, 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: "dn-": 686, 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: "cap": 0, 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: "cap+": 0, 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: "cap-": 0, 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: "rss": 99604, 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: "heap": 215328 2024-09-15T22:26:59.265 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_server": { 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: "dispatch_client_request": 0, 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: "dispatch_server_request": 0, 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_request": 0, 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_client_session": 0, 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: "handle_peer_request": 0, 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: "req_create_latency": { 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: "req_getattr_latency": { 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.266 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.267 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.267 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.267 INFO:teuthology.orchestra.run.smithi165.stdout: "req_getfilelock_latency": { 2024-09-15T22:26:59.267 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.267 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.267 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.267 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.267 INFO:teuthology.orchestra.run.smithi165.stdout: "req_link_latency": { 2024-09-15T22:26:59.267 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.267 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.267 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.267 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.267 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookup_latency": { 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookuphash_latency": { 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupino_latency": { 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.268 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupname_latency": { 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupparent_latency": { 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lookupsnap_latency": { 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.269 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.270 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.270 INFO:teuthology.orchestra.run.smithi165.stdout: "req_lssnap_latency": { 2024-09-15T22:26:59.270 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.270 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.270 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.270 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.271 INFO:teuthology.orchestra.run.smithi165.stdout: "req_mkdir_latency": { 2024-09-15T22:26:59.271 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.271 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.271 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.271 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.271 INFO:teuthology.orchestra.run.smithi165.stdout: "req_mknod_latency": { 2024-09-15T22:26:59.271 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.271 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.271 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.271 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.271 INFO:teuthology.orchestra.run.smithi165.stdout: "req_mksnap_latency": { 2024-09-15T22:26:59.271 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.271 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: "req_open_latency": { 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: "req_readdir_latency": { 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rename_latency": { 2024-09-15T22:26:59.272 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.273 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.273 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.273 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.273 INFO:teuthology.orchestra.run.smithi165.stdout: "req_renamesnap_latency": { 2024-09-15T22:26:59.273 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.273 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.273 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.273 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.273 INFO:teuthology.orchestra.run.smithi165.stdout: "req_snapdiff_latency": { 2024-09-15T22:26:59.273 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.273 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.273 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.274 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.274 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rmdir_latency": { 2024-09-15T22:26:59.274 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.274 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.274 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.274 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.274 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rmsnap_latency": { 2024-09-15T22:26:59.274 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.274 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.274 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.274 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.274 INFO:teuthology.orchestra.run.smithi165.stdout: "req_rmxattr_latency": { 2024-09-15T22:26:59.274 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setattr_latency": { 2024-09-15T22:26:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setdirlayout_latency": { 2024-09-15T22:26:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.275 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setfilelock_latency": { 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setlayout_latency": { 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: "req_setxattr_latency": { 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.276 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: "req_symlink_latency": { 2024-09-15T22:26:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: "req_unlink_latency": { 2024-09-15T22:26:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: "cap_revoke_eviction": 0, 2024-09-15T22:26:59.277 INFO:teuthology.orchestra.run.smithi165.stdout: "cap_acquisition_throttle": 0, 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: "req_getvxattr_latency": { 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_sessions": { 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: "session_count": 2, 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: "session_add": 6, 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: "session_remove": 4, 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: "sessions_open": 4, 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: "sessions_stale": 0, 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: "total_load": 0, 2024-09-15T22:26:59.278 INFO:teuthology.orchestra.run.smithi165.stdout: "average_load": 0, 2024-09-15T22:26:59.279 INFO:teuthology.orchestra.run.smithi165.stdout: "avg_session_uptime": 5375, 2024-09-15T22:26:59.279 INFO:teuthology.orchestra.run.smithi165.stdout: "mdthresh_evicted": 0 2024-09-15T22:26:59.279 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.279 INFO:teuthology.orchestra.run.smithi165.stdout: "mempool": { 2024-09-15T22:26:59.279 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:26:59.279 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_items": 0, 2024-09-15T22:26:59.279 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:26:59.279 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:26:59.279 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:26:59.279 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:26:59.279 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:26:59.279 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:26:59.279 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:26:59.280 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:26:59.280 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:26:59.280 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:26:59.280 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:26:59.280 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:26:59.280 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:26:59.280 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_items": 0, 2024-09-15T22:26:59.280 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:26:59.280 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_items": 0, 2024-09-15T22:26:59.280 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:26:59.280 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:26:59.280 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:26:59.281 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:26:59.281 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:26:59.281 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:26:59.281 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:26:59.281 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_items": 0, 2024-09-15T22:26:59.281 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:26:59.281 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:26:59.281 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:26:59.281 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_items": 0, 2024-09-15T22:26:59.281 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_bytes": 0, 2024-09-15T22:26:59.281 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_items": 0, 2024-09-15T22:26:59.281 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:26:59.281 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_bytes": 528720, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_items": 7917, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_items": 0, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_bytes": 0, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_items": 0, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_items": 0, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_items": 0, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_bytes": 9768, 2024-09-15T22:26:59.282 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_items": 197, 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_bytes": 0, 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_items": 0, 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_bytes": 37235982, 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_items": 465819, 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_bytes": 0, 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_items": 0, 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_bytes": 0, 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_items": 0 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: "objecter": { 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: "op_active": 0, 2024-09-15T22:26:59.283 INFO:teuthology.orchestra.run.smithi165.stdout: "op_laggy": 0, 2024-09-15T22:26:59.284 INFO:teuthology.orchestra.run.smithi165.stdout: "op_send": 2551, 2024-09-15T22:26:59.284 INFO:teuthology.orchestra.run.smithi165.stdout: "op_send_bytes": 26, 2024-09-15T22:26:59.284 INFO:teuthology.orchestra.run.smithi165.stdout: "op_resend": 4, 2024-09-15T22:26:59.284 INFO:teuthology.orchestra.run.smithi165.stdout: "op_reply": 2551, 2024-09-15T22:26:59.284 INFO:teuthology.orchestra.run.smithi165.stdout: "op_latency": { 2024-09-15T22:26:59.284 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 2551, 2024-09-15T22:26:59.284 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 2.638958308, 2024-09-15T22:26:59.284 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.001034479 2024-09-15T22:26:59.284 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.284 INFO:teuthology.orchestra.run.smithi165.stdout: "op_inflight": 0, 2024-09-15T22:26:59.284 INFO:teuthology.orchestra.run.smithi165.stdout: "oplen_avg": { 2024-09-15T22:26:59.284 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 2551, 2024-09-15T22:26:59.284 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 2552 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: "op": 2551, 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: "op_r": 2551, 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: "op_w": 0, 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: "op_rmw": 0, 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: "op_pg": 0, 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_stat": 1659, 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_create": 0, 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_read": 889, 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_write": 0, 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_writefull": 0, 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_writesame": 0, 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_append": 0, 2024-09-15T22:26:59.285 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_zero": 0, 2024-09-15T22:26:59.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_truncate": 0, 2024-09-15T22:26:59.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_delete": 0, 2024-09-15T22:26:59.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_mapext": 0, 2024-09-15T22:26:59.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_sparse_read": 0, 2024-09-15T22:26:59.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_clonerange": 0, 2024-09-15T22:26:59.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_getxattr": 2, 2024-09-15T22:26:59.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_setxattr": 0, 2024-09-15T22:26:59.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_cmpxattr": 0, 2024-09-15T22:26:59.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_rmxattr": 0, 2024-09-15T22:26:59.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_resetxattrs": 0, 2024-09-15T22:26:59.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_call": 0, 2024-09-15T22:26:59.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_watch": 0, 2024-09-15T22:26:59.286 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_notify": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_pgls": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_pgls_filter": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "osdop_other": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_active": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_send": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_resend": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "linger_ping": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "poolop_active": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "poolop_send": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "poolop_resend": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "poolstat_active": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "poolstat_send": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "poolstat_resend": 0, 2024-09-15T22:26:59.287 INFO:teuthology.orchestra.run.smithi165.stdout: "statfs_active": 0, 2024-09-15T22:26:59.288 INFO:teuthology.orchestra.run.smithi165.stdout: "statfs_send": 0, 2024-09-15T22:26:59.288 INFO:teuthology.orchestra.run.smithi165.stdout: "statfs_resend": 0, 2024-09-15T22:26:59.288 INFO:teuthology.orchestra.run.smithi165.stdout: "command_active": 0, 2024-09-15T22:26:59.288 INFO:teuthology.orchestra.run.smithi165.stdout: "command_send": 0, 2024-09-15T22:26:59.288 INFO:teuthology.orchestra.run.smithi165.stdout: "command_resend": 0, 2024-09-15T22:26:59.288 INFO:teuthology.orchestra.run.smithi165.stdout: "map_epoch": 100, 2024-09-15T22:26:59.288 INFO:teuthology.orchestra.run.smithi165.stdout: "map_full": 0, 2024-09-15T22:26:59.288 INFO:teuthology.orchestra.run.smithi165.stdout: "map_inc": 13, 2024-09-15T22:26:59.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_sessions": 11, 2024-09-15T22:26:59.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_session_open": 11, 2024-09-15T22:26:59.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_session_close": 0, 2024-09-15T22:26:59.288 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_laggy": 0, 2024-09-15T22:26:59.288 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_wr": 0, 2024-09-15T22:26:59.289 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_rd": 2, 2024-09-15T22:26:59.289 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_del": 0 2024-09-15T22:26:59.289 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.289 INFO:teuthology.orchestra.run.smithi165.stdout: "oft": { 2024-09-15T22:26:59.289 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_objs": 0, 2024-09-15T22:26:59.289 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_kv_pairs": 0, 2024-09-15T22:26:59.289 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_updates": 0, 2024-09-15T22:26:59.289 INFO:teuthology.orchestra.run.smithi165.stdout: "omap_total_removes": 0 2024-09-15T22:26:59.289 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.289 INFO:teuthology.orchestra.run.smithi165.stdout: "osd-slow-ops": { 2024-09-15T22:26:59.289 INFO:teuthology.orchestra.run.smithi165.stdout: "slow_ops_count": 0 2024-09-15T22:26:59.289 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.289 INFO:teuthology.orchestra.run.smithi165.stdout: "purge_queue": { 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing_ops": 0, 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing_ops_high_water": 0, 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing": 0, 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executing_high_water": 0, 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executed_ops": 0, 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_executed": 0, 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: "pq_item_in_journal": 0 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 104857600, 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 2796, 2024-09-15T22:26:59.290 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 155612340, 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 2796, 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 2796, 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 155612340, 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-objecter_bytes": { 2024-09-15T22:26:59.291 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 104857600, 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 2551, 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 153693535, 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 2551, 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 153693535, 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.292 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.293 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:26:59.293 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.293 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-objecter_ops": { 2024-09-15T22:26:59.293 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-15T22:26:59.293 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 1024, 2024-09-15T22:26:59.293 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-15T22:26:59.293 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-15T22:26:59.293 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-15T22:26:59.293 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:59.293 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-15T22:26:59.293 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 2551, 2024-09-15T22:26:59.293 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 2551, 2024-09-15T22:26:59.293 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 2551, 2024-09-15T22:26:59.294 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 2551, 2024-09-15T22:26:59.294 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-15T22:26:59.294 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.294 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.294 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.294 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:26:59.294 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.294 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-write_buf_throttle": { 2024-09-15T22:26:59.294 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-15T22:26:59.294 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 3758096384, 2024-09-15T22:26:59.294 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-15T22:26:59.294 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-15T22:26:59.294 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 0, 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 0, 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-write_buf_throttle-0x555c8d612b40": { 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-15T22:26:59.295 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 3758096384, 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 0, 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 0, 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 0, 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 0, 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 0, 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:26:59.296 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:26:59.297 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:26:59.297 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-15T22:26:59.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:26:59 smithi165 ceph-mon[35551]: pgmap v333: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:59.745 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:26:59 smithi100 ceph-mon[35319]: pgmap v333: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:26:59.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:26:59 smithi045 ceph-mon[31180]: pgmap v333: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:27:00.138 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-15T22:27:00.139 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-15T22:27:00.139 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-15T22:27:00.139 DEBUG:tasks.check_counter:Getting stats from l 2024-09-15T22:27:00.139 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-15T22:27:00.385 INFO:teuthology.orchestra.run.smithi165.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T22:27:00.913 INFO:teuthology.orchestra.run.smithi165.stdout:{ 2024-09-15T22:27:00.914 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T22:27:00.914 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 0, 2024-09-15T22:27:00.914 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 2, 2024-09-15T22:27:00.914 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 0, 2024-09-15T22:27:00.914 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 0, 2024-09-15T22:27:00.914 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 4, 2024-09-15T22:27:00.914 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 0, 2024-09-15T22:27:00.914 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.000961030, 2024-09-15T22:27:00.914 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.000000000, 2024-09-15T22:27:00.914 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.000149262, 2024-09-15T22:27:00.914 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:27:00.914 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:27:00.915 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:27:00.915 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:27:00.915 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:27:00.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:27:00.915 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:27:00.915 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:27:00.915 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:27:00.915 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:27:00.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:27:00.915 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T22:27:00.915 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T22:27:00.915 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:27:00.915 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 229, 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 219, 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 1450368, 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 134464, 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 2, 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 1, 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.042851645, 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.015167013, 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.041206915, 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 218, 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.013920676, 2024-09-15T22:27:00.916 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000063856 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 1450368, 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 134464 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_messages": 6, 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages": 170, 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_bytes": 3312, 2024-09-15T22:27:00.917 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_bytes": 187152, 2024-09-15T22:27:00.918 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_created_connections": 5, 2024-09-15T22:27:00.918 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_active_connections": 3, 2024-09-15T22:27:00.918 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_total_time": 0.013913640, 2024-09-15T22:27:00.918 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_send_time": 0.008211120, 2024-09-15T22:27:00.918 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_recv_time": 0.003354461, 2024-09-15T22:27:00.918 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-15T22:27:00.918 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T22:27:00.918 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 168, 2024-09-15T22:27:00.918 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.021540173, 2024-09-15T22:27:00.918 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000128215 2024-09-15T22:27:00.918 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:27:00.918 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_handle_ack_lat": { 2024-09-15T22:27:00.918 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:27:00.919 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:27:00.919 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:27:00.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:27:00.919 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-09-15T22:27:00.919 INFO:teuthology.orchestra.run.smithi165.stdout: "msgr_send_encrypted_bytes": 187152 2024-09-15T22:27:00.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:27:00.919 INFO:teuthology.orchestra.run.smithi165.stdout: "cct": { 2024-09-15T22:27:00.919 INFO:teuthology.orchestra.run.smithi165.stdout: "total_workers": 0, 2024-09-15T22:27:00.919 INFO:teuthology.orchestra.run.smithi165.stdout: "unhealthy_workers": 0 2024-09-15T22:27:00.919 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:27:00.919 INFO:teuthology.orchestra.run.smithi165.stdout: "mempool": { 2024-09-15T22:27:00.919 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_bytes": 0, 2024-09-15T22:27:00.919 INFO:teuthology.orchestra.run.smithi165.stdout: "bloom_filter_items": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_alloc_items": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_data_items": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_other_items": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_bytes": 0, 2024-09-15T22:27:00.920 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_extent_items": 0, 2024-09-15T22:27:00.921 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_bytes": 0, 2024-09-15T22:27:00.921 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_blob_items": 0, 2024-09-15T22:27:00.921 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T22:27:00.921 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T22:27:00.921 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T22:27:00.921 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T22:27:00.921 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T22:27:00.921 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_fsck_items": 0, 2024-09-15T22:27:00.921 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_bytes": 0, 2024-09-15T22:27:00.921 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_txc_items": 0, 2024-09-15T22:27:00.921 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T22:27:00.921 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T22:27:00.921 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_bytes": 0, 2024-09-15T22:27:00.922 INFO:teuthology.orchestra.run.smithi165.stdout: "bluestore_writing_items": 0, 2024-09-15T22:27:00.922 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_bytes": 0, 2024-09-15T22:27:00.922 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_items": 0, 2024-09-15T22:27:00.922 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T22:27:00.922 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_reader_items": 0, 2024-09-15T22:27:00.922 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T22:27:00.922 INFO:teuthology.orchestra.run.smithi165.stdout: "bluefs_file_writer_items": 0, 2024-09-15T22:27:00.922 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_bytes": 148977, 2024-09-15T22:27:00.922 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_anon_items": 30, 2024-09-15T22:27:00.922 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_bytes": 0, 2024-09-15T22:27:00.922 INFO:teuthology.orchestra.run.smithi165.stdout: "buffer_meta_items": 0, 2024-09-15T22:27:00.922 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_bytes": 0, 2024-09-15T22:27:00.922 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_items": 0, 2024-09-15T22:27:00.923 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_bytes": 0, 2024-09-15T22:27:00.923 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_mapbl_items": 0, 2024-09-15T22:27:00.923 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_bytes": 0, 2024-09-15T22:27:00.923 INFO:teuthology.orchestra.run.smithi165.stdout: "osd_pglog_items": 0, 2024-09-15T22:27:00.923 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_bytes": 0, 2024-09-15T22:27:00.923 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_items": 0, 2024-09-15T22:27:00.923 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T22:27:00.923 INFO:teuthology.orchestra.run.smithi165.stdout: "osdmap_mapping_items": 0, 2024-09-15T22:27:00.923 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_bytes": 0, 2024-09-15T22:27:00.923 INFO:teuthology.orchestra.run.smithi165.stdout: "pgmap_items": 0, 2024-09-15T22:27:00.923 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_bytes": 928, 2024-09-15T22:27:00.923 INFO:teuthology.orchestra.run.smithi165.stdout: "mds_co_items": 2, 2024-09-15T22:27:00.923 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_bytes": 0, 2024-09-15T22:27:00.924 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_1_items": 0, 2024-09-15T22:27:00.924 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_bytes": 0, 2024-09-15T22:27:00.924 INFO:teuthology.orchestra.run.smithi165.stdout: "unittest_2_items": 0 2024-09-15T22:27:00.924 INFO:teuthology.orchestra.run.smithi165.stdout: }, 2024-09-15T22:27:00.924 INFO:teuthology.orchestra.run.smithi165.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T22:27:00.924 INFO:teuthology.orchestra.run.smithi165.stdout: "val": 0, 2024-09-15T22:27:00.924 INFO:teuthology.orchestra.run.smithi165.stdout: "max": 104857600, 2024-09-15T22:27:00.924 INFO:teuthology.orchestra.run.smithi165.stdout: "get_started": 0, 2024-09-15T22:27:00.924 INFO:teuthology.orchestra.run.smithi165.stdout: "get": 231, 2024-09-15T22:27:00.924 INFO:teuthology.orchestra.run.smithi165.stdout: "get_sum": 1418049, 2024-09-15T22:27:00.924 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_fail": 0, 2024-09-15T22:27:00.924 INFO:teuthology.orchestra.run.smithi165.stdout: "get_or_fail_success": 231, 2024-09-15T22:27:00.925 INFO:teuthology.orchestra.run.smithi165.stdout: "take": 0, 2024-09-15T22:27:00.925 INFO:teuthology.orchestra.run.smithi165.stdout: "take_sum": 0, 2024-09-15T22:27:00.925 INFO:teuthology.orchestra.run.smithi165.stdout: "put": 231, 2024-09-15T22:27:00.925 INFO:teuthology.orchestra.run.smithi165.stdout: "put_sum": 1418049, 2024-09-15T22:27:00.925 INFO:teuthology.orchestra.run.smithi165.stdout: "wait": { 2024-09-15T22:27:00.925 INFO:teuthology.orchestra.run.smithi165.stdout: "avgcount": 0, 2024-09-15T22:27:00.925 INFO:teuthology.orchestra.run.smithi165.stdout: "sum": 0.000000000, 2024-09-15T22:27:00.925 INFO:teuthology.orchestra.run.smithi165.stdout: "avgtime": 0.000000000 2024-09-15T22:27:00.925 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:27:00.925 INFO:teuthology.orchestra.run.smithi165.stdout: } 2024-09-15T22:27:00.925 INFO:teuthology.orchestra.run.smithi165.stdout:} 2024-09-15T22:27:01.660 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:01 smithi165 ceph-mon[35551]: pgmap v334: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:27:01.687 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-15T22:27:01.688 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-15T22:27:01.688 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-15T22:27:01.688 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-15T22:27:01.700 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-15T22:27:01.700 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:27:01.700 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:27:01.723 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-09-15T22:27:01.723 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:27:01.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:01 smithi100 ceph-mon[35319]: pgmap v334: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:27:01.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T22:27:01.799 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:01 smithi045 ceph-mon[31180]: pgmap v334: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T22:27:02.071 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:27:02.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.569+0000 7f3f11a61640 1 -- 172.21.15.45:0/4083494848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f0c101de0 msgr2=0x7f3f0c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:02.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.569+0000 7f3f11a61640 1 --2- 172.21.15.45:0/4083494848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f0c101de0 0x7f3f0c1021c0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009900 tx=0x7f3efc02a410 comp rx=0 tx=0).stop 2024-09-15T22:27:02.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.569+0000 7f3f11a61640 1 -- 172.21.15.45:0/4083494848 shutdown_connections 2024-09-15T22:27:02.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.569+0000 7f3f11a61640 1 --2- 172.21.15.45:0/4083494848 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0c106f10 0x7f3f0c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:02.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.569+0000 7f3f11a61640 1 --2- 172.21.15.45:0/4083494848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c102790 0x7f3f0c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:02.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.569+0000 7f3f11a61640 1 --2- 172.21.15.45:0/4083494848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f0c101de0 0x7f3f0c1021c0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:02.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.569+0000 7f3f11a61640 1 -- 172.21.15.45:0/4083494848 >> 172.21.15.45:0/4083494848 conn(0x7f3f0c0fd8c0 msgr2=0x7f3f0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:02.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.569+0000 7f3f11a61640 1 -- 172.21.15.45:0/4083494848 shutdown_connections 2024-09-15T22:27:02.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.569+0000 7f3f11a61640 1 -- 172.21.15.45:0/4083494848 wait complete. 2024-09-15T22:27:02.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.570+0000 7f3f11a61640 1 Processor -- start 2024-09-15T22:27:02.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.570+0000 7f3f11a61640 1 -- start start 2024-09-15T22:27:02.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.570+0000 7f3f11a61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f0c101de0 0x7f3f0c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.570+0000 7f3f11a61640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0c102790 0x7f3f0c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.570+0000 7f3f11a61640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c106f10 0x7f3f0c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.570+0000 7f3f11a61640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c112090 con 0x7f3f0c101de0 2024-09-15T22:27:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.570+0000 7f3f11a61640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c111f10 con 0x7f3f0c106f10 2024-09-15T22:27:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.570+0000 7f3f11a61640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0c112210 con 0x7f3f0c102790 2024-09-15T22:27:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.570+0000 7f3f0affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f0c101de0 0x7f3f0c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:02.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.570+0000 7f3f0affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f0c101de0 0x7f3f0c1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33150/0 (socket says 172.21.15.45:33150) 2024-09-15T22:27:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.570+0000 7f3f0affd640 1 -- 172.21.15.45:0/81566304 learned_addr learned my addr 172.21.15.45:0/81566304 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:27:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f03fff640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0c102790 0x7f3f0c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f0b7fe640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c106f10 0x7f3f0c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f0affd640 1 -- 172.21.15.45:0/81566304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0c102790 msgr2=0x7f3f0c198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f0affd640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0c102790 0x7f3f0c198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:02.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f0affd640 1 -- 172.21.15.45:0/81566304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c106f10 msgr2=0x7f3f0c19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:02.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f0affd640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c106f10 0x7f3f0c19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:02.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f0affd640 1 -- 172.21.15.45:0/81566304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0c19d4a0 con 0x7f3f0c101de0 2024-09-15T22:27:02.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f03fff640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0c102790 0x7f3f0c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:27:02.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f0b7fe640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c106f10 0x7f3f0c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:27:02.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f0affd640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f0c101de0 0x7f3f0c1984f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3efc006010 tx=0x7f3efc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:02.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f10a5f640 1 -- 172.21.15.45:0/81566304 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc03f030 con 0x7f3f0c101de0 2024-09-15T22:27:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f11a61640 1 -- 172.21.15.45:0/81566304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f0c19d730 con 0x7f3f0c101de0 2024-09-15T22:27:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f10a5f640 1 -- 172.21.15.45:0/81566304 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3efc003d00 con 0x7f3f0c101de0 2024-09-15T22:27:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f10a5f640 1 -- 172.21.15.45:0/81566304 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3efc035070 con 0x7f3f0c101de0 2024-09-15T22:27:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.571+0000 7f3f11a61640 1 -- 172.21.15.45:0/81566304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f0c1a5070 con 0x7f3f0c101de0 2024-09-15T22:27:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.572+0000 7f3f11a61640 1 -- 172.21.15.45:0/81566304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f0c1032c0 con 0x7f3f0c101de0 2024-09-15T22:27:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.573+0000 7f3f10a5f640 1 -- 172.21.15.45:0/81566304 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3efc042030 con 0x7f3f0c101de0 2024-09-15T22:27:02.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.574+0000 7f3f10a5f640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3ef80a33b0 0x7f3ef80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:02.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.574+0000 7f3f03fff640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3ef80a33b0 0x7f3ef80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:02.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.574+0000 7f3f10a5f640 1 -- 172.21.15.45:0/81566304 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7f3efc0f0520 con 0x7f3f0c101de0 2024-09-15T22:27:02.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.575+0000 7f3f03fff640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3ef80a33b0 0x7f3ef80a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0fdce0 tx=0x7f3ef4005f90 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:02.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.578+0000 7f3f10a5f640 1 -- 172.21.15.45:0/81566304 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3efc0bcb90 con 0x7f3f0c101de0 2024-09-15T22:27:02.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.764+0000 7f3f11a61640 1 -- 172.21.15.45:0/81566304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3f0c10a0f0 con 0x7f3f0c101de0 2024-09-15T22:27:02.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.765+0000 7f3f10a5f640 1 -- 172.21.15.45:0/81566304 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v100) ==== 81+0+1004 (secure 0 0 0) 0x7f3efc0bc490 con 0x7f3f0c101de0 2024-09-15T22:27:02.768 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/1919238369 2024-09-16T22:16:17.536196+0000 2024-09-15T22:27:02.768 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/4107707607 2024-09-16T22:16:17.536196+0000 2024-09-15T22:27:02.768 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3237288220 2024-09-16T22:06:51.521483+0000 2024-09-15T22:27:02.768 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/2191835021 2024-09-16T22:06:51.521483+0000 2024-09-15T22:27:02.768 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3286786467 2024-09-16T22:16:17.536196+0000 2024-09-15T22:27:02.768 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/1499253284 2024-09-16T22:06:51.521483+0000 2024-09-15T22:27:02.769 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/1080251242 2024-09-16T22:16:17.536196+0000 2024-09-15T22:27:02.769 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/2207608114 2024-09-16T22:06:51.521483+0000 2024-09-15T22:27:02.769 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/1461513797 2024-09-16T22:16:17.536196+0000 2024-09-15T22:27:02.769 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3822069605 2024-09-16T22:07:15.327784+0000 2024-09-15T22:27:02.769 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3598420664 2024-09-16T22:07:15.327784+0000 2024-09-15T22:27:02.770 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/2191835021 2024-09-16T22:06:51.521483+0000 2024-09-15T22:27:02.770 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3960156552 2024-09-16T22:07:15.327784+0000 2024-09-15T22:27:02.770 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/3319321559 2024-09-16T22:07:15.327784+0000 2024-09-15T22:27:02.770 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6800/1919238369 2024-09-16T22:16:17.536196+0000 2024-09-15T22:27:02.770 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6801/3319321559 2024-09-16T22:07:15.327784+0000 2024-09-15T22:27:02.770 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:0/3846204427 2024-09-16T22:16:17.536196+0000 2024-09-15T22:27:02.772 INFO:teuthology.orchestra.run.smithi045.stderr:listed 17 entries 2024-09-15T22:27:02.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.768+0000 7f3f11a61640 1 -- 172.21.15.45:0/81566304 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3ef80a33b0 msgr2=0x7f3ef80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:02.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.768+0000 7f3f11a61640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3ef80a33b0 0x7f3ef80a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0fdce0 tx=0x7f3ef4005f90 comp rx=0 tx=0).stop 2024-09-15T22:27:02.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.768+0000 7f3f11a61640 1 -- 172.21.15.45:0/81566304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f0c101de0 msgr2=0x7f3f0c1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:02.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.768+0000 7f3f11a61640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f0c101de0 0x7f3f0c1984f0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3efc006010 tx=0x7f3efc0042f0 comp rx=0 tx=0).stop 2024-09-15T22:27:02.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.768+0000 7f3f11a61640 1 -- 172.21.15.45:0/81566304 shutdown_connections 2024-09-15T22:27:02.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.768+0000 7f3f11a61640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f3ef80a33b0 0x7f3ef80a5870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:02.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.768+0000 7f3f11a61640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c106f10 0x7f3f0c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:02.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.768+0000 7f3f11a61640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f3f0c102790 0x7f3f0c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:02.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.768+0000 7f3f11a61640 1 --2- 172.21.15.45:0/81566304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3f0c101de0 0x7f3f0c1984f0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:02.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.768+0000 7f3f11a61640 1 -- 172.21.15.45:0/81566304 >> 172.21.15.45:0/81566304 conn(0x7f3f0c0fd8c0 msgr2=0x7f3f0c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:02.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.768+0000 7f3f11a61640 1 -- 172.21.15.45:0/81566304 shutdown_connections 2024-09-15T22:27:02.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:02.768+0000 7f3f11a61640 1 -- 172.21.15.45:0/81566304 wait complete. 2024-09-15T22:27:03.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:03 smithi045 ceph-mon[31180]: pgmap v335: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:27:03.550 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:03 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/81566304' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:27:03.703 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:27:03.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:27:03.703 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:27:03.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:03 smithi165 ceph-mon[35551]: pgmap v335: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:27:03.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:03 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/81566304' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:27:03.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:03 smithi100 ceph-mon[35319]: pgmap v335: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T22:27:03.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:03 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/81566304' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T22:27:03.752 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2024-09-15T22:27:03.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:27:03.752 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:27:03.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:27:03.786 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-09-15T22:27:03.844 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:27:03.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:27:03.845 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:27:03.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:27:03.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2024-09-15T22:27:04.017 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-15T22:27:04.030 INFO:tasks.cephadm:Teardown begin 2024-09-15T22:27:04.030 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:27:04.031 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:27:04.305 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:27:04.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.796+0000 7f5f105bc640 1 -- 172.21.15.45:0/3133397119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f0810c170 msgr2=0x7f5f0810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:04.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.796+0000 7f5f105bc640 1 --2- 172.21.15.45:0/3133397119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f0810c170 0x7f5f0810e610 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009ca0 tx=0x7f5f0002a950 comp rx=0 tx=0).stop 2024-09-15T22:27:04.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.796+0000 7f5f105bc640 1 -- 172.21.15.45:0/3133397119 shutdown_connections 2024-09-15T22:27:04.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.796+0000 7f5f105bc640 1 --2- 172.21.15.45:0/3133397119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f0810c170 0x7f5f0810e610 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.796+0000 7f5f105bc640 1 --2- 172.21.15.45:0/3133397119 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f08103660 0x7f5f0810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.796+0000 7f5f105bc640 1 --2- 172.21.15.45:0/3133397119 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f08102d40 0x7f5f08103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.796+0000 7f5f105bc640 1 -- 172.21.15.45:0/3133397119 >> 172.21.15.45:0/3133397119 conn(0x7f5f080fc7a0 msgr2=0x7f5f080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:04.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.796+0000 7f5f105bc640 1 -- 172.21.15.45:0/3133397119 shutdown_connections 2024-09-15T22:27:04.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.796+0000 7f5f105bc640 1 -- 172.21.15.45:0/3133397119 wait complete. 2024-09-15T22:27:04.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.796+0000 7f5f105bc640 1 Processor -- start 2024-09-15T22:27:04.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f105bc640 1 -- start start 2024-09-15T22:27:04.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f105bc640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f08102d40 0x7f5f081009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f105bc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f08103660 0x7f5f08100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f105bc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f0810c170 0x7f5f08101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f105bc640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5f08112070 con 0x7f5f08103660 2024-09-15T22:27:04.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f105bc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5f08111ef0 con 0x7f5f0810c170 2024-09-15T22:27:04.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f105bc640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f5f081121f0 con 0x7f5f08102d40 2024-09-15T22:27:04.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f0db57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f08103660 0x7f5f08100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f0db57640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f08103660 0x7f5f08100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52370/0 (socket says 172.21.15.45:52370) 2024-09-15T22:27:04.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f0db57640 1 -- 172.21.15.45:0/238221762 learned_addr learned my addr 172.21.15.45:0/238221762 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:27:04.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f0eb59640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f0810c170 0x7f5f08101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f0e358640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f08102d40 0x7f5f081009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f0db57640 1 -- 172.21.15.45:0/238221762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f08102d40 msgr2=0x7f5f081009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:04.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f0db57640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f08102d40 0x7f5f081009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f0db57640 1 -- 172.21.15.45:0/238221762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f0810c170 msgr2=0x7f5f08101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:04.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f0db57640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f0810c170 0x7f5f08101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:04.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f0db57640 1 -- 172.21.15.45:0/238221762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f081a6950 con 0x7f5f08103660 2024-09-15T22:27:04.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.797+0000 7f5f0db57640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f08103660 0x7f5f08100ee0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800c940 tx=0x7f5ef800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.798+0000 7f5eff7fe640 1 -- 172.21.15.45:0/238221762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8004220 con 0x7f5f08103660 2024-09-15T22:27:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.798+0000 7f5f105bc640 1 -- 172.21.15.45:0/238221762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f081a6c40 con 0x7f5f08103660 2024-09-15T22:27:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.798+0000 7f5eff7fe640 1 -- 172.21.15.45:0/238221762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ef80043c0 con 0x7f5f08103660 2024-09-15T22:27:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.798+0000 7f5eff7fe640 1 -- 172.21.15.45:0/238221762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8004a00 con 0x7f5f08103660 2024-09-15T22:27:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.798+0000 7f5f105bc640 1 -- 172.21.15.45:0/238221762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f081a7180 con 0x7f5f08103660 2024-09-15T22:27:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.799+0000 7f5f105bc640 1 -- 172.21.15.45:0/238221762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f08103120 con 0x7f5f08103660 2024-09-15T22:27:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.800+0000 7f5eff7fe640 1 -- 172.21.15.45:0/238221762 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5ef8005140 con 0x7f5f08103660 2024-09-15T22:27:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.800+0000 7f5eff7fe640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f5ef40a33b0 0x7f5ef40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.801+0000 7f5eff7fe640 1 -- 172.21.15.45:0/238221762 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7f5ef80d0100 con 0x7f5f08103660 2024-09-15T22:27:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.801+0000 7f5f0e358640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f5ef40a33b0 0x7f5ef40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.801+0000 7f5f0e358640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f5ef40a33b0 0x7f5ef40a5870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5f04005e10 tx=0x7f5f04005da0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:04.804+0000 7f5eff7fe640 1 -- 172.21.15.45:0/238221762 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ef8014030 con 0x7f5f08103660 2024-09-15T22:27:05.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.014+0000 7f5f105bc640 1 -- 172.21.15.45:0/238221762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f08101ed0 con 0x7f5f08103660 2024-09-15T22:27:05.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.015+0000 7f5eff7fe640 1 -- 172.21.15.45:0/238221762 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f5ef809c6d0 con 0x7f5f08103660 2024-09-15T22:27:05.018 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:27:05.018 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:27:05.019 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:27:05.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.017+0000 7f5f105bc640 1 -- 172.21.15.45:0/238221762 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f5ef40a33b0 msgr2=0x7f5ef40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:05.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.017+0000 7f5f105bc640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f5ef40a33b0 0x7f5ef40a5870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5f04005e10 tx=0x7f5f04005da0 comp rx=0 tx=0).stop 2024-09-15T22:27:05.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.017+0000 7f5f105bc640 1 -- 172.21.15.45:0/238221762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f08103660 msgr2=0x7f5f08100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:05.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.017+0000 7f5f105bc640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f08103660 0x7f5f08100ee0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800c940 tx=0x7f5ef800ce00 comp rx=0 tx=0).stop 2024-09-15T22:27:05.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.017+0000 7f5f105bc640 1 -- 172.21.15.45:0/238221762 shutdown_connections 2024-09-15T22:27:05.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.017+0000 7f5f105bc640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f5ef40a33b0 0x7f5ef40a5870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:05.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.017+0000 7f5f105bc640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f0810c170 0x7f5f08101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:05.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.017+0000 7f5f105bc640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f08103660 0x7f5f08100ee0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:05.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.017+0000 7f5f105bc640 1 --2- 172.21.15.45:0/238221762 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f5f08102d40 0x7f5f081009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:05.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.017+0000 7f5f105bc640 1 -- 172.21.15.45:0/238221762 >> 172.21.15.45:0/238221762 conn(0x7f5f080fc7a0 msgr2=0x7f5f080fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:05.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.017+0000 7f5f105bc640 1 -- 172.21.15.45:0/238221762 shutdown_connections 2024-09-15T22:27:05.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:05.017+0000 7f5f105bc640 1 -- 172.21.15.45:0/238221762 wait complete. 2024-09-15T22:27:05.694 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:05 smithi045 ceph-mon[31180]: pgmap v336: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:27:05.694 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:05 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/238221762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:27:05.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:05 smithi165 ceph-mon[35551]: pgmap v336: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:27:05.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:05 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/238221762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:27:05.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T22:27:05.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:05 smithi100 ceph-mon[35319]: pgmap v336: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 19 op/s 2024-09-15T22:27:05.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:05 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/238221762' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:27:05.984 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:27:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.469+0000 7fb53fb26640 1 -- 172.21.15.45:0/245647389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538102d90 msgr2=0x7fb538103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.469+0000 7fb53fb26640 1 --2- 172.21.15.45:0/245647389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538102d90 0x7fb538103170 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fb534009930 tx=0x7fb53402a420 comp rx=0 tx=0).stop 2024-09-15T22:27:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.469+0000 7fb53fb26640 1 -- 172.21.15.45:0/245647389 shutdown_connections 2024-09-15T22:27:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.469+0000 7fb53fb26640 1 --2- 172.21.15.45:0/245647389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb538108290 0x7fb53810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.469+0000 7fb53fb26640 1 --2- 172.21.15.45:0/245647389 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb538103740 0x7fb538107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.469+0000 7fb53fb26640 1 --2- 172.21.15.45:0/245647389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538102d90 0x7fb538103170 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.469+0000 7fb53fb26640 1 -- 172.21.15.45:0/245647389 >> 172.21.15.45:0/245647389 conn(0x7fb5380fc7d0 msgr2=0x7fb5380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.469+0000 7fb53fb26640 1 -- 172.21.15.45:0/245647389 shutdown_connections 2024-09-15T22:27:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.469+0000 7fb53fb26640 1 -- 172.21.15.45:0/245647389 wait complete. 2024-09-15T22:27:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.469+0000 7fb53fb26640 1 Processor -- start 2024-09-15T22:27:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53fb26640 1 -- start start 2024-09-15T22:27:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53fb26640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538102d90 0x7fb5381009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53fb26640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb538103740 0x7fb538100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53fb26640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb538108290 0x7fb538101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53fb26640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb5381121b0 con 0x7fb538102d90 2024-09-15T22:27:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53fb26640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb538112030 con 0x7fb538103740 2024-09-15T22:27:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53fb26640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fb538112330 con 0x7fb538108290 2024-09-15T22:27:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53d8c2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538102d90 0x7fb5381009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53d8c2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538102d90 0x7fb5381009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52394/0 (socket says 172.21.15.45:52394) 2024-09-15T22:27:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53d8c2640 1 -- 172.21.15.45:0/1080234 learned_addr learned my addr 172.21.15.45:0/1080234 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:27:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53e0c3640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb538108290 0x7fb538101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53d0c1640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb538103740 0x7fb538100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53d8c2640 1 -- 172.21.15.45:0/1080234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb538108290 msgr2=0x7fb538101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53d8c2640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb538108290 0x7fb538101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53d8c2640 1 -- 172.21.15.45:0/1080234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb538103740 msgr2=0x7fb538100f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53d8c2640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb538103740 0x7fb538100f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53d8c2640 1 -- 172.21.15.45:0/1080234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5381a6b10 con 0x7fb538102d90 2024-09-15T22:27:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53e0c3640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb538108290 0x7fb538101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:27:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53d0c1640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb538103740 0x7fb538100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:27:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.470+0000 7fb53d8c2640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538102d90 0x7fb5381009f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fb534009230 tx=0x7fb534004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:06.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.471+0000 7fb52effd640 1 -- 172.21.15.45:0/1080234 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53403f030 con 0x7fb538102d90 2024-09-15T22:27:06.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.471+0000 7fb52effd640 1 -- 172.21.15.45:0/1080234 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb534003af0 con 0x7fb538102d90 2024-09-15T22:27:06.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.471+0000 7fb53fb26640 1 -- 172.21.15.45:0/1080234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5381a6da0 con 0x7fb538102d90 2024-09-15T22:27:06.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.471+0000 7fb52effd640 1 -- 172.21.15.45:0/1080234 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb534035070 con 0x7fb538102d90 2024-09-15T22:27:06.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.471+0000 7fb53fb26640 1 -- 172.21.15.45:0/1080234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5381a7220 con 0x7fb538102d90 2024-09-15T22:27:06.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.472+0000 7fb53fb26640 1 -- 172.21.15.45:0/1080234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb53806a7f0 con 0x7fb538102d90 2024-09-15T22:27:06.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.473+0000 7fb52effd640 1 -- 172.21.15.45:0/1080234 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb534042030 con 0x7fb538102d90 2024-09-15T22:27:06.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.474+0000 7fb52effd640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb5240a33b0 0x7fb5240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:06.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.474+0000 7fb53d0c1640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb5240a33b0 0x7fb5240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:06.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.474+0000 7fb52effd640 1 -- 172.21.15.45:0/1080234 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9568+0+0 (secure 0 0 0) 0x7fb5340f0dc0 con 0x7fb538102d90 2024-09-15T22:27:06.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.474+0000 7fb53d0c1640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb5240a33b0 0x7fb5240a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb538102480 tx=0x7fb528005e50 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:06.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.477+0000 7fb52effd640 1 -- 172.21.15.45:0/1080234 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb5340bd450 con 0x7fb538102d90 2024-09-15T22:27:06.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.687+0000 7fb53fb26640 1 -- 172.21.15.45:0/1080234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb538103170 con 0x7fb538102d90 2024-09-15T22:27:06.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.688+0000 7fb52effd640 1 -- 172.21.15.45:0/1080234 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fb538103170 con 0x7fb538102d90 2024-09-15T22:27:06.690 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:27:06.690 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":21,"btime":"2024-09-15T22:14:45:923329+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2368971397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2368971397},{"type":"v1","addr":"172.21.15.45:6835","nonce":2368971397}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/378260478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":378260478},{"type":"v1","addr":"172.21.15.45:6837","nonce":378260478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14601,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6839/3708053507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6838","nonce":3708053507},{"type":"v1","addr":"172.21.15.45:6839","nonce":3708053507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6841/1624795277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6840","nonce":1624795277},{"type":"v1","addr":"172.21.15.45:6841","nonce":1624795277}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/3112428521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3112428521},{"type":"v1","addr":"172.21.15.100:6833","nonce":3112428521}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6833/3442116684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6832","nonce":3442116684},{"type":"v1","addr":"172.21.15.165:6833","nonce":3442116684}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24434,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/1950215908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1950215908},{"type":"v1","addr":"172.21.15.100:6835","nonce":1950215908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24445,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6835/2608811330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6834","nonce":2608811330},{"type":"v1","addr":"172.21.15.165:6835","nonce":2608811330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/864108145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":864108145},{"type":"v1","addr":"172.21.15.100:6837","nonce":864108145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24451,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.165:6837/1072928476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6836","nonce":1072928476},{"type":"v1","addr":"172.21.15.165:6837","nonce":1072928476}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T22:14:07.480609+0000","modified":"2024-09-15T22:14:45.759794+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24469":{"gid":24469,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.165:6839/2278031843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6838","nonce":2278031843},{"type":"v1","addr":"172.21.15.165:6839","nonce":2278031843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24476":{"gid":24476,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/1428203088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":1428203088},{"type":"v1","addr":"172.21.15.100:6839","nonce":1428203088}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24476,"qdb_cluster":[24476]},"id":1}]} 2024-09-15T22:27:06.690 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 21 2024-09-15T22:27:06.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.690+0000 7fb53fb26640 1 -- 172.21.15.45:0/1080234 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb5240a33b0 msgr2=0x7fb5240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:06.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.690+0000 7fb53fb26640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb5240a33b0 0x7fb5240a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb538102480 tx=0x7fb528005e50 comp rx=0 tx=0).stop 2024-09-15T22:27:06.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.690+0000 7fb53fb26640 1 -- 172.21.15.45:0/1080234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538102d90 msgr2=0x7fb5381009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:06.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.690+0000 7fb53fb26640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538102d90 0x7fb5381009f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fb534009230 tx=0x7fb534004270 comp rx=0 tx=0).stop 2024-09-15T22:27:06.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.690+0000 7fb53fb26640 1 -- 172.21.15.45:0/1080234 shutdown_connections 2024-09-15T22:27:06.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.690+0000 7fb53fb26640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fb5240a33b0 0x7fb5240a5870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:06.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.690+0000 7fb53fb26640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fb538108290 0x7fb538101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:06.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.690+0000 7fb53fb26640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb538103740 0x7fb538100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:06.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.690+0000 7fb53fb26640 1 --2- 172.21.15.45:0/1080234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb538102d90 0x7fb5381009f0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:06.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.690+0000 7fb53fb26640 1 -- 172.21.15.45:0/1080234 >> 172.21.15.45:0/1080234 conn(0x7fb5380fc7d0 msgr2=0x7fb538106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:06.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.690+0000 7fb53fb26640 1 -- 172.21.15.45:0/1080234 shutdown_connections 2024-09-15T22:27:06.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:06.690+0000 7fb53fb26640 1 -- 172.21.15.45:0/1080234 wait complete. 2024-09-15T22:27:07.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T22:27:07.676 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:27:07.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:07 smithi165 ceph-mon[35551]: pgmap v337: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-15T22:27:07.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:07 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1080234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:27:07.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:07 smithi100 ceph-mon[35319]: pgmap v337: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-15T22:27:07.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:07 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1080234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:27:07.797 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:07 smithi045 ceph-mon[31180]: pgmap v337: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 44 KiB/s wr, 18 op/s 2024-09-15T22:27:07.797 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:07 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1080234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T22:27:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.161+0000 7f6e515e4640 1 -- 172.21.15.45:0/485639618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e4c102d40 msgr2=0x7f6e4c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.161+0000 7f6e515e4640 1 --2- 172.21.15.45:0/485639618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e4c102d40 0x7f6e4c103120 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009900 tx=0x7f6e3c02a480 comp rx=0 tx=0).stop 2024-09-15T22:27:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.161+0000 7f6e515e4640 1 -- 172.21.15.45:0/485639618 shutdown_connections 2024-09-15T22:27:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.161+0000 7f6e515e4640 1 --2- 172.21.15.45:0/485639618 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e4c10c170 0x7f6e4c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.161+0000 7f6e515e4640 1 --2- 172.21.15.45:0/485639618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e4c103660 0x7f6e4c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.161+0000 7f6e515e4640 1 --2- 172.21.15.45:0/485639618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e4c102d40 0x7f6e4c103120 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.161+0000 7f6e515e4640 1 -- 172.21.15.45:0/485639618 >> 172.21.15.45:0/485639618 conn(0x7f6e4c0fc7a0 msgr2=0x7f6e4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.161+0000 7f6e515e4640 1 -- 172.21.15.45:0/485639618 shutdown_connections 2024-09-15T22:27:08.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.161+0000 7f6e515e4640 1 -- 172.21.15.45:0/485639618 wait complete. 2024-09-15T22:27:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.162+0000 7f6e515e4640 1 Processor -- start 2024-09-15T22:27:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.162+0000 7f6e515e4640 1 -- start start 2024-09-15T22:27:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.162+0000 7f6e515e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e4c102d40 0x7f6e4c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.162+0000 7f6e515e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e4c103660 0x7f6e4c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.162+0000 7f6e515e4640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e4c10c170 0x7f6e4c19ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.162+0000 7f6e515e4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c1120f0 con 0x7f6e4c102d40 2024-09-15T22:27:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.162+0000 7f6e515e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c111f70 con 0x7f6e4c103660 2024-09-15T22:27:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.162+0000 7f6e515e4640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c112270 con 0x7f6e4c10c170 2024-09-15T22:27:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.162+0000 7f6e4affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e4c102d40 0x7f6e4c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.162+0000 7f6e4affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e4c102d40 0x7f6e4c198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52422/0 (socket says 172.21.15.45:52422) 2024-09-15T22:27:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.162+0000 7f6e4affd640 1 -- 172.21.15.45:0/3164337849 learned_addr learned my addr 172.21.15.45:0/3164337849 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:27:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e4a7fc640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e4c103660 0x7f6e4c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e4b7fe640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e4c10c170 0x7f6e4c19ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e4affd640 1 -- 172.21.15.45:0/3164337849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e4c10c170 msgr2=0x7f6e4c19ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e4affd640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e4c10c170 0x7f6e4c19ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e4affd640 1 -- 172.21.15.45:0/3164337849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e4c103660 msgr2=0x7f6e4c198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e4affd640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e4c103660 0x7f6e4c198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e4affd640 1 -- 172.21.15.45:0/3164337849 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4c19d520 con 0x7f6e4c102d40 2024-09-15T22:27:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e4a7fc640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e4c103660 0x7f6e4c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:27:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e4b7fe640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e4c10c170 0x7f6e4c19ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:27:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e4affd640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e4c102d40 0x7f6e4c198570 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c006010 tx=0x7f6e3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e33fff640 1 -- 172.21.15.45:0/3164337849 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c03f030 con 0x7f6e4c102d40 2024-09-15T22:27:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e515e4640 1 -- 172.21.15.45:0/3164337849 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e4c19d7b0 con 0x7f6e4c102d40 2024-09-15T22:27:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e33fff640 1 -- 172.21.15.45:0/3164337849 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6e3c003d00 con 0x7f6e4c102d40 2024-09-15T22:27:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e33fff640 1 -- 172.21.15.45:0/3164337849 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c035070 con 0x7f6e4c102d40 2024-09-15T22:27:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.163+0000 7f6e515e4640 1 -- 172.21.15.45:0/3164337849 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e4c1a50f0 con 0x7f6e4c102d40 2024-09-15T22:27:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.164+0000 7f6e515e4640 1 -- 172.21.15.45:0/3164337849 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e4c103120 con 0x7f6e4c102d40 2024-09-15T22:27:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.165+0000 7f6e33fff640 1 -- 172.21.15.45:0/3164337849 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6e3c042030 con 0x7f6e4c102d40 2024-09-15T22:27:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.166+0000 7f6e33fff640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6e340a33b0 0x7f6e340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.166+0000 7f6e4a7fc640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6e340a33b0 0x7f6e340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.166+0000 7f6e33fff640 1 -- 172.21.15.45:0/3164337849 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9656+0+0 (secure 0 0 0) 0x7f6e3c0f0bc0 con 0x7f6e4c102d40 2024-09-15T22:27:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.167+0000 7f6e4a7fc640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6e340a33b0 0x7f6e340a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c10e9b0 tx=0x7f6e40005e30 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.170+0000 7f6e33fff640 1 -- 172.21.15.45:0/3164337849 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6e3c0bd0d0 con 0x7f6e4c102d40 2024-09-15T22:27:08.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.345+0000 7f6e515e4640 1 -- 172.21.15.45:0/3164337849 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6e4c1a52c0 con 0x7f6e4c102d40 2024-09-15T22:27:08.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.347+0000 7f6e33fff640 1 -- 172.21.15.45:0/3164337849 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+25620 (secure 0 0 0) 0x7f6e3c0bc9d0 con 0x7f6e4c102d40 2024-09-15T22:27:08.349 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-09-15T22:27:08.350 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":101,"fsid":"a1911414-73ae-11ef-bceb-c7b262605968","created":"2024-09-15T22:06:19.492307+0000","modified":"2024-09-15T22:27:07.376394+0000","last_up_change":"2024-09-15T22:13:15.444306+0000","last_in_change":"2024-09-15T22:12:52.624395+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:09:29.838325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:14:03.430259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:14:05.780122+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:14:12.253914+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":101,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b217c815-c5e4-4bee-aa74-03c8aab8be70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6803","nonce":3943337873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6805","nonce":3943337873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6809","nonce":3943337873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3943337873},{"type":"v1","addr":"172.21.15.45:6807","nonce":3943337873}]},"public_addr":"172.21.15.45:6803/3943337873","cluster_addr":"172.21.15.45:6805/3943337873","heartbeat_back_addr":"172.21.15.45:6809/3943337873","heartbeat_front_addr":"172.21.15.45:6807/3943337873","state":["exists","up"]},{"osd":1,"uuid":"611af0ab-00b8-49e8-96ed-41fcbed176ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6801","nonce":1091448440}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6803","nonce":1091448440}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6807","nonce":1091448440}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1091448440},{"type":"v1","addr":"172.21.15.100:6805","nonce":1091448440}]},"public_addr":"172.21.15.100:6801/1091448440","cluster_addr":"172.21.15.100:6803/1091448440","heartbeat_back_addr":"172.21.15.100:6807/1091448440","heartbeat_front_addr":"172.21.15.100:6805/1091448440","state":["exists","up"]},{"osd":2,"uuid":"bdf40a1b-1f33-4f51-bbed-bf9041598d50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6801","nonce":2589835014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6803","nonce":2589835014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6807","nonce":2589835014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":2589835014},{"type":"v1","addr":"172.21.15.165:6805","nonce":2589835014}]},"public_addr":"172.21.15.165:6801/2589835014","cluster_addr":"172.21.15.165:6803/2589835014","heartbeat_back_addr":"172.21.15.165:6807/2589835014","heartbeat_front_addr":"172.21.15.165:6805/2589835014","state":["exists","up"]},{"osd":3,"uuid":"20a0d21e-2952-4e0b-b875-68e206fae18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6811","nonce":3139088268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6813","nonce":3139088268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6817","nonce":3139088268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":3139088268},{"type":"v1","addr":"172.21.15.45:6815","nonce":3139088268}]},"public_addr":"172.21.15.45:6811/3139088268","cluster_addr":"172.21.15.45:6813/3139088268","heartbeat_back_addr":"172.21.15.45:6817/3139088268","heartbeat_front_addr":"172.21.15.45:6815/3139088268","state":["exists","up"]},{"osd":4,"uuid":"d6685935-6ac3-4dc3-acf3-f82480001576","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6809","nonce":3961938991}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6811","nonce":3961938991}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6815","nonce":3961938991}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":3961938991},{"type":"v1","addr":"172.21.15.100:6813","nonce":3961938991}]},"public_addr":"172.21.15.100:6809/3961938991","cluster_addr":"172.21.15.100:6811/3961938991","heartbeat_back_addr":"172.21.15.100:6815/3961938991","heartbeat_front_addr":"172.21.15.100:6813/3961938991","state":["exists","up"]},{"osd":5,"uuid":"6a2ef15e-6522-4412-903b-0ce607d86649","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6809","nonce":4262083044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6811","nonce":4262083044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6815","nonce":4262083044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":4262083044},{"type":"v1","addr":"172.21.15.165:6813","nonce":4262083044}]},"public_addr":"172.21.15.165:6809/4262083044","cluster_addr":"172.21.15.165:6811/4262083044","heartbeat_back_addr":"172.21.15.165:6815/4262083044","heartbeat_front_addr":"172.21.15.165:6813/4262083044","state":["exists","up"]},{"osd":6,"uuid":"4df95994-2453-4634-8409-c5c47d0992db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6819","nonce":480791026}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6821","nonce":480791026}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6825","nonce":480791026}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":480791026},{"type":"v1","addr":"172.21.15.45:6823","nonce":480791026}]},"public_addr":"172.21.15.45:6819/480791026","cluster_addr":"172.21.15.45:6821/480791026","heartbeat_back_addr":"172.21.15.45:6825/480791026","heartbeat_front_addr":"172.21.15.45:6823/480791026","state":["exists","up"]},{"osd":7,"uuid":"72e67807-f145-4211-a378-764b37983824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6817","nonce":9412304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6819","nonce":9412304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6823","nonce":9412304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":9412304},{"type":"v1","addr":"172.21.15.100:6821","nonce":9412304}]},"public_addr":"172.21.15.100:6817/9412304","cluster_addr":"172.21.15.100:6819/9412304","heartbeat_back_addr":"172.21.15.100:6823/9412304","heartbeat_front_addr":"172.21.15.100:6821/9412304","state":["exists","up"]},{"osd":8,"uuid":"4b7c7b0c-d48a-4b5a-9221-0aa89a7b74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6816","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6817","nonce":134921821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6818","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6819","nonce":134921821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6822","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6823","nonce":134921821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6820","nonce":134921821},{"type":"v1","addr":"172.21.15.165:6821","nonce":134921821}]},"public_addr":"172.21.15.165:6817/134921821","cluster_addr":"172.21.15.165:6819/134921821","heartbeat_back_addr":"172.21.15.165:6823/134921821","heartbeat_front_addr":"172.21.15.165:6821/134921821","state":["exists","up"]},{"osd":9,"uuid":"2a072cad-a025-4de9-ae41-97459f416a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6827","nonce":777631686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6829","nonce":777631686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6833","nonce":777631686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":777631686},{"type":"v1","addr":"172.21.15.45:6831","nonce":777631686}]},"public_addr":"172.21.15.45:6827/777631686","cluster_addr":"172.21.15.45:6829/777631686","heartbeat_back_addr":"172.21.15.45:6833/777631686","heartbeat_front_addr":"172.21.15.45:6831/777631686","state":["exists","up"]},{"osd":10,"uuid":"072c0003-c933-47ff-9866-53934143f598","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6825","nonce":1659453547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6827","nonce":1659453547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6831","nonce":1659453547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":1659453547},{"type":"v1","addr":"172.21.15.100:6829","nonce":1659453547}]},"public_addr":"172.21.15.100:6825/1659453547","cluster_addr":"172.21.15.100:6827/1659453547","heartbeat_back_addr":"172.21.15.100:6831/1659453547","heartbeat_front_addr":"172.21.15.100:6829/1659453547","state":["exists","up"]},{"osd":11,"uuid":"5ad7e570-4045-4f50-aa81-4bf73af76c1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6824","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6825","nonce":1936678054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6826","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6827","nonce":1936678054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6830","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6831","nonce":1936678054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6828","nonce":1936678054},{"type":"v1","addr":"172.21.15.165:6829","nonce":1936678054}]},"public_addr":"172.21.15.165:6825/1936678054","cluster_addr":"172.21.15.165:6827/1936678054","heartbeat_back_addr":"172.21.15.165:6831/1936678054","heartbeat_front_addr":"172.21.15.165:6829/1936678054","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:08:35.950530+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:01.643909+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:26.680923+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:09:52.823721+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:18.683797+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:10:43.123198+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:08.145261+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:32.479940+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:11:58.292688+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:23.502634+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:12:49.117697+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:13:13.618683+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":6}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.27","mappings":[{"from":4,"to":7}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]},{"pgid":"4.11","mappings":[{"from":5,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":10}]},{"pgid":"4.19","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6801/1919238369":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/4107707607":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/3237288220":"2024-09-16T22:06:51.521483+0000","172.21.15.45:6801/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3286786467":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/1499253284":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1080251242":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/2207608114":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/1461513797":"2024-09-16T22:16:17.536196+0000","172.21.15.45:0/3822069605":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3598420664":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/2191835021":"2024-09-16T22:06:51.521483+0000","172.21.15.45:0/3960156552":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:6800/1919238369":"2024-09-16T22:16:17.536196+0000","172.21.15.45:6801/3319321559":"2024-09-16T22:07:15.327784+0000","172.21.15.45:0/3846204427":"2024-09-16T22:16:17.536196+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:27:08.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.349+0000 7f6e515e4640 1 -- 172.21.15.45:0/3164337849 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6e340a33b0 msgr2=0x7f6e340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:08.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.349+0000 7f6e515e4640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6e340a33b0 0x7f6e340a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c10e9b0 tx=0x7f6e40005e30 comp rx=0 tx=0).stop 2024-09-15T22:27:08.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.349+0000 7f6e515e4640 1 -- 172.21.15.45:0/3164337849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e4c102d40 msgr2=0x7f6e4c198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:08.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.349+0000 7f6e515e4640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e4c102d40 0x7f6e4c198570 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c006010 tx=0x7f6e3c0042f0 comp rx=0 tx=0).stop 2024-09-15T22:27:08.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.349+0000 7f6e515e4640 1 -- 172.21.15.45:0/3164337849 shutdown_connections 2024-09-15T22:27:08.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.349+0000 7f6e515e4640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f6e340a33b0 0x7f6e340a5870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:08.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.349+0000 7f6e515e4640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f6e4c10c170 0x7f6e4c19ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:08.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.349+0000 7f6e515e4640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e4c103660 0x7f6e4c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:08.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.349+0000 7f6e515e4640 1 --2- 172.21.15.45:0/3164337849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e4c102d40 0x7f6e4c198570 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:08.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.349+0000 7f6e515e4640 1 -- 172.21.15.45:0/3164337849 >> 172.21.15.45:0/3164337849 conn(0x7f6e4c0fc7a0 msgr2=0x7f6e4c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:08.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.349+0000 7f6e515e4640 1 -- 172.21.15.45:0/3164337849 shutdown_connections 2024-09-15T22:27:08.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:08.349+0000 7f6e515e4640 1 -- 172.21.15.45:0/3164337849 wait complete. 2024-09-15T22:27:08.702 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:08 smithi045 ceph-mon[31180]: osdmap e101: 12 total, 12 up, 12 in 2024-09-15T22:27:08.702 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:08 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/3164337849' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:27:08.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:08 smithi165 ceph-mon[35551]: osdmap e101: 12 total, 12 up, 12 in 2024-09-15T22:27:08.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:08 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/3164337849' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:27:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:08 smithi100 ceph-mon[35319]: osdmap e101: 12 total, 12 up, 12 in 2024-09-15T22:27:08.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:08 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/3164337849' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T22:27:09.075 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-15T22:27:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:27:09.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:09 smithi165 ceph-mon[35551]: pgmap v339: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:27:09.740 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:09 smithi045 ceph-mon[31180]: pgmap v339: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:27:09.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:09 smithi100 ceph-mon[35319]: pgmap v339: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 53 KiB/s wr, 22 op/s 2024-09-15T22:27:09.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.822+0000 7fc267037640 1 -- 172.21.15.45:0/2401036667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2601036e0 msgr2=0x7fc260107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:09.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.822+0000 7fc267037640 1 --2- 172.21.15.45:0/2401036667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2601036e0 0x7fc260107b90 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fc24c009930 tx=0x7fc24c02a420 comp rx=0 tx=0).stop 2024-09-15T22:27:09.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.822+0000 7fc267037640 1 -- 172.21.15.45:0/2401036667 shutdown_connections 2024-09-15T22:27:09.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.822+0000 7fc267037640 1 --2- 172.21.15.45:0/2401036667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2601082a0 0x7fc26010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:09.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.822+0000 7fc267037640 1 --2- 172.21.15.45:0/2401036667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2601036e0 0x7fc260107b90 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:09.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.822+0000 7fc267037640 1 --2- 172.21.15.45:0/2401036667 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc260102d30 0x7fc260103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:09.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.822+0000 7fc267037640 1 -- 172.21.15.45:0/2401036667 >> 172.21.15.45:0/2401036667 conn(0x7fc2600fc7d0 msgr2=0x7fc2600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:09.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.822+0000 7fc267037640 1 -- 172.21.15.45:0/2401036667 shutdown_connections 2024-09-15T22:27:09.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.822+0000 7fc267037640 1 -- 172.21.15.45:0/2401036667 wait complete. 2024-09-15T22:27:09.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc267037640 1 Processor -- start 2024-09-15T22:27:09.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc267037640 1 -- start start 2024-09-15T22:27:09.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc267037640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc260102d30 0x7fc260198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:09.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc267037640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2601036e0 0x7fc260198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:09.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc267037640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2601082a0 0x7fc26019cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:09.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc267037640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc260112180 con 0x7fc2601082a0 2024-09-15T22:27:09.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc267037640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc260112000 con 0x7fc2601036e0 2024-09-15T22:27:09.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc267037640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fc260112300 con 0x7fc260102d30 2024-09-15T22:27:09.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc2655d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2601082a0 0x7fc26019cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:09.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc2655d4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2601082a0 0x7fc26019cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52442/0 (socket says 172.21.15.45:52442) 2024-09-15T22:27:09.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc2655d4640 1 -- 172.21.15.45:0/1701127444 learned_addr learned my addr 172.21.15.45:0/1701127444 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:27:09.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc264dd3640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc260102d30 0x7fc260198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:09.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc2655d4640 1 -- 172.21.15.45:0/1701127444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc260102d30 msgr2=0x7fc260198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:09.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc2655d4640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc260102d30 0x7fc260198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:09.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc2655d4640 1 -- 172.21.15.45:0/1701127444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2601036e0 msgr2=0x7fc260198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:09.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.823+0000 7fc2655d4640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2601036e0 0x7fc260198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:09.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.824+0000 7fc2655d4640 1 -- 172.21.15.45:0/1701127444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26019d630 con 0x7fc2601082a0 2024-09-15T22:27:09.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.824+0000 7fc264dd3640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc260102d30 0x7fc260198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:27:09.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.824+0000 7fc2655d4640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2601082a0 0x7fc26019cf50 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc25800eaa0 tx=0x7fc25800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:09.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.824+0000 7fc25dffb640 1 -- 172.21.15.45:0/1701127444 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc25800cdb0 con 0x7fc2601082a0 2024-09-15T22:27:09.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.824+0000 7fc267037640 1 -- 172.21.15.45:0/1701127444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26019d920 con 0x7fc2601082a0 2024-09-15T22:27:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.824+0000 7fc25dffb640 1 -- 172.21.15.45:0/1701127444 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc258004b20 con 0x7fc2601082a0 2024-09-15T22:27:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.824+0000 7fc25dffb640 1 -- 172.21.15.45:0/1701127444 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc258011760 con 0x7fc2601082a0 2024-09-15T22:27:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.824+0000 7fc267037640 1 -- 172.21.15.45:0/1701127444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2601a5200 con 0x7fc2601082a0 2024-09-15T22:27:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.825+0000 7fc267037640 1 -- 172.21.15.45:0/1701127444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc260103110 con 0x7fc2601082a0 2024-09-15T22:27:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.826+0000 7fc25dffb640 1 -- 172.21.15.45:0/1701127444 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc258004cd0 con 0x7fc2601082a0 2024-09-15T22:27:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.827+0000 7fc25dffb640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2500a33b0 0x7fc2500a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.827+0000 7fc264dd3640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2500a33b0 0x7fc2500a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.827+0000 7fc25dffb640 1 -- 172.21.15.45:0/1701127444 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9656+0+0 (secure 0 0 0) 0x7fc2580d04b0 con 0x7fc2601082a0 2024-09-15T22:27:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.827+0000 7fc264dd3640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2500a33b0 0x7fc2500a5870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc2540058c0 tx=0x7fc254005ec0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:09.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:09.831+0000 7fc25dffb640 1 -- 172.21.15.45:0/1701127444 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc258016030 con 0x7fc2601082a0 2024-09-15T22:27:10.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.048+0000 7fc267037640 1 -- 172.21.15.45:0/1701127444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc26010a2e0 con 0x7fc2601082a0 2024-09-15T22:27:10.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.051+0000 7fc25dffb640 1 -- 172.21.15.45:0/1701127444 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7fc25809c9c0 con 0x7fc2601082a0 2024-09-15T22:27:10.052 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:27:10.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.054+0000 7fc267037640 1 -- 172.21.15.45:0/1701127444 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2500a33b0 msgr2=0x7fc2500a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:10.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.054+0000 7fc267037640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2500a33b0 0x7fc2500a5870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc2540058c0 tx=0x7fc254005ec0 comp rx=0 tx=0).stop 2024-09-15T22:27:10.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.054+0000 7fc267037640 1 -- 172.21.15.45:0/1701127444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2601082a0 msgr2=0x7fc26019cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.054+0000 7fc267037640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2601082a0 0x7fc26019cf50 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fc25800eaa0 tx=0x7fc25800ef60 comp rx=0 tx=0).stop 2024-09-15T22:27:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.054+0000 7fc267037640 1 -- 172.21.15.45:0/1701127444 shutdown_connections 2024-09-15T22:27:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.054+0000 7fc267037640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fc2500a33b0 0x7fc2500a5870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.054+0000 7fc267037640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2601082a0 0x7fc26019cf50 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.054+0000 7fc267037640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2601036e0 0x7fc260198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.054+0000 7fc267037640 1 --2- 172.21.15.45:0/1701127444 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fc260102d30 0x7fc260198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.054+0000 7fc267037640 1 -- 172.21.15.45:0/1701127444 >> 172.21.15.45:0/1701127444 conn(0x7fc2600fc7d0 msgr2=0x7fc260105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.054+0000 7fc267037640 1 -- 172.21.15.45:0/1701127444 shutdown_connections 2024-09-15T22:27:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:10.054+0000 7fc267037640 1 -- 172.21.15.45:0/1701127444 wait complete. 2024-09-15T22:27:10.391 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:10 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a[31176]: 2024-09-15T22:27:10.049+0000 7f08570a6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:27:10.392 INFO:journalctl@ceph.mds.i.smithi165.stdout:Sep 15 22:27:10 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-i[66291]: ignoring --setuser ceph since I am not root 2024-09-15T22:27:10.392 INFO:journalctl@ceph.mds.i.smithi165.stdout:Sep 15 22:27:10 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-i[66291]: ignoring --setgroup ceph since I am not root 2024-09-15T22:27:10.392 INFO:journalctl@ceph.mds.i.smithi165.stdout:Sep 15 22:27:10 smithi165 ceph-mds[66295]: -- 172.21.15.165:0/370607723 <== mon.1 v2:172.21.15.165:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559f1bc47c20 con 0x559f1bc25000 2024-09-15T22:27:10.392 INFO:journalctl@ceph.mds.i.smithi165.stdout:Sep 15 22:27:10 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-i[66291]: starting mds.i at 2024-09-15T22:27:10.392 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:27:10 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-b[65376]: ignoring --setuser ceph since I am not root 2024-09-15T22:27:10.392 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:27:10 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-b[65376]: ignoring --setgroup ceph since I am not root 2024-09-15T22:27:10.392 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:27:10 smithi100 ceph-mds[65380]: -- 172.21.15.100:0/3867070507 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561d1d169860 con 0x561d1d147000 2024-09-15T22:27:10.392 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:27:10 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-b[65376]: starting mds.b at 2024-09-15T22:27:10.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:10 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1701127444' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:27:10.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:10 smithi165 ceph-mon[35551]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T22:27:10.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:10 smithi165 ceph-mon[35551]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:27:10.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:10 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/1701127444' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T22:27:10.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:10 smithi165 ceph-mon[35551]: osdmap e102: 12 total, 12 up, 12 in 2024-09-15T22:27:10.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:10 smithi165 ceph-mon[35551]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-15T22:27:10.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:10 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1701127444' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:27:10.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:10 smithi100 ceph-mon[35319]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T22:27:10.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:10 smithi100 ceph-mon[35319]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:27:10.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:10 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/1701127444' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T22:27:10.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:10 smithi100 ceph-mon[35319]: osdmap e102: 12 total, 12 up, 12 in 2024-09-15T22:27:10.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:10 smithi100 ceph-mon[35319]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-15T22:27:10.745 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:10 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1701127444' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T22:27:10.746 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:10 smithi045 ceph-mon[31180]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T22:27:10.746 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:10 smithi045 ceph-mon[31180]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:27:10.746 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:10 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/1701127444' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T22:27:10.746 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:10 smithi045 ceph-mon[31180]: osdmap e102: 12 total, 12 up, 12 in 2024-09-15T22:27:10.746 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:10 smithi045 ceph-mon[31180]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-15T22:27:10.775 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:27:11.035 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:27:11.424 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:11 smithi045 ceph-mon[31180]: pgmap v340: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:27:11.424 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:11 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.165:6838/787929188,v1:172.21.15.165:6839/787929188] up:boot 2024-09-15T22:27:11.424 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:11 smithi045 ceph-mon[31180]: mds.? [v2:172.21.15.100:6838/2321401801,v1:172.21.15.100:6839/2321401801] up:boot 2024-09-15T22:27:11.424 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:11 smithi045 ceph-mon[31180]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-15T22:27:11.424 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:11 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:27:11.425 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:11 smithi045 ceph-mon[31180]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:27:11.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.505+0000 7f2590580640 1 -- 172.21.15.45:0/1401723950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2588101de0 msgr2=0x7f25881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:11.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.505+0000 7f2590580640 1 --2- 172.21.15.45:0/1401723950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2588101de0 0x7f25881021c0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f2584009900 tx=0x7f258402a410 comp rx=0 tx=0).stop 2024-09-15T22:27:11.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 -- 172.21.15.45:0/1401723950 shutdown_connections 2024-09-15T22:27:11.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 --2- 172.21.15.45:0/1401723950 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588106f10 0x7f258810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 --2- 172.21.15.45:0/1401723950 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2588102790 0x7f25881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 --2- 172.21.15.45:0/1401723950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2588101de0 0x7f25881021c0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 -- 172.21.15.45:0/1401723950 >> 172.21.15.45:0/1401723950 conn(0x7f25880fd8c0 msgr2=0x7f25880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 -- 172.21.15.45:0/1401723950 shutdown_connections 2024-09-15T22:27:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 -- 172.21.15.45:0/1401723950 wait complete. 2024-09-15T22:27:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 Processor -- start 2024-09-15T22:27:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 -- start start 2024-09-15T22:27:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2588101de0 0x7f2588198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588102790 0x7f2588198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2588106f10 0x7f258819cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f25881120d0 con 0x7f2588106f10 2024-09-15T22:27:11.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2588111f50 con 0x7f2588102790 2024-09-15T22:27:11.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.506+0000 7f2590580640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f2588112250 con 0x7f2588101de0 2024-09-15T22:27:11.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f258eb1d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2588106f10 0x7f258819cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:11.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f258eb1d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2588106f10 0x7f258819cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52468/0 (socket says 172.21.15.45:52468) 2024-09-15T22:27:11.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f258eb1d640 1 -- 172.21.15.45:0/622276628 learned_addr learned my addr 172.21.15.45:0/622276628 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:27:11.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f258db1b640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588102790 0x7f2588198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:11.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f258e31c640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2588101de0 0x7f2588198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:11.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f258eb1d640 1 -- 172.21.15.45:0/622276628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2588101de0 msgr2=0x7f2588198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:11.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f258eb1d640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2588101de0 0x7f2588198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:11.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f258eb1d640 1 -- 172.21.15.45:0/622276628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588102790 msgr2=0x7f2588198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:11.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f258eb1d640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588102790 0x7f2588198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:11.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f258eb1d640 1 -- 172.21.15.45:0/622276628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258819d5c0 con 0x7f2588106f10 2024-09-15T22:27:11.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f258e31c640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2588101de0 0x7f2588198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:27:11.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f258db1b640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588102790 0x7f2588198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:27:11.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f258eb1d640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2588106f10 0x7f258819cee0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f2580009fd0 tx=0x7f258000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:11.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f257f7fe640 1 -- 172.21.15.45:0/622276628 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580017070 con 0x7f2588106f10 2024-09-15T22:27:11.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f257f7fe640 1 -- 172.21.15.45:0/622276628 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2580004020 con 0x7f2588106f10 2024-09-15T22:27:11.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f2590580640 1 -- 172.21.15.45:0/622276628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258819d8b0 con 0x7f2588106f10 2024-09-15T22:27:11.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f257f7fe640 1 -- 172.21.15.45:0/622276628 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25800106c0 con 0x7f2588106f10 2024-09-15T22:27:11.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.507+0000 7f2590580640 1 -- 172.21.15.45:0/622276628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25881a5190 con 0x7f2588106f10 2024-09-15T22:27:11.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.508+0000 7f2590580640 1 -- 172.21.15.45:0/622276628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25881021c0 con 0x7f2588106f10 2024-09-15T22:27:11.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.510+0000 7f257f7fe640 1 -- 172.21.15.45:0/622276628 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f25800041d0 con 0x7f2588106f10 2024-09-15T22:27:11.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.511+0000 7f257f7fe640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f25740a33b0 0x7f25740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:11.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.511+0000 7f258e31c640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f25740a33b0 0x7f25740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:11.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.511+0000 7f257f7fe640 1 -- 172.21.15.45:0/622276628 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9654+0+0 (secure 0 0 0) 0x7f25800d0410 con 0x7f2588106f10 2024-09-15T22:27:11.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.511+0000 7f258e31c640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f25740a33b0 0x7f25740a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2584000c00 tx=0x7f2584032c80 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:11.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.514+0000 7f257f7fe640 1 -- 172.21.15.45:0/622276628 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f258009c920 con 0x7f2588106f10 2024-09-15T22:27:11.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:11 smithi165 ceph-mon[35551]: pgmap v340: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:27:11.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:11 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.165:6838/787929188,v1:172.21.15.165:6839/787929188] up:boot 2024-09-15T22:27:11.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:11 smithi165 ceph-mon[35551]: mds.? [v2:172.21.15.100:6838/2321401801,v1:172.21.15.100:6839/2321401801] up:boot 2024-09-15T22:27:11.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:11 smithi165 ceph-mon[35551]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-15T22:27:11.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:11 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:27:11.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:11 smithi165 ceph-mon[35551]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:27:11.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:11.725+0000 7f2590580640 1 -- 172.21.15.45:0/622276628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f258810a120 con 0x7f2588106f10 2024-09-15T22:27:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:11 smithi100 ceph-mon[35319]: pgmap v340: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-09-15T22:27:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:11 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.165:6838/787929188,v1:172.21.15.165:6839/787929188] up:boot 2024-09-15T22:27:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:11 smithi100 ceph-mon[35319]: mds.? [v2:172.21.15.100:6838/2321401801,v1:172.21.15.100:6839/2321401801] up:boot 2024-09-15T22:27:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:11 smithi100 ceph-mon[35319]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-15T22:27:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:11 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T22:27:11.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:11 smithi100 ceph-mon[35319]: from='mgr.15165 172.21.15.45:0/1122269047' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T22:27:12.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:12.400+0000 7f257f7fe640 1 -- 172.21.15.45:0/622276628 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f258009c220 con 0x7f2588106f10 2024-09-15T22:27:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:12.403+0000 7f2590580640 1 -- 172.21.15.45:0/622276628 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f25740a33b0 msgr2=0x7f25740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:12.403+0000 7f2590580640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f25740a33b0 0x7f25740a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2584000c00 tx=0x7f2584032c80 comp rx=0 tx=0).stop 2024-09-15T22:27:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:12.403+0000 7f2590580640 1 -- 172.21.15.45:0/622276628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2588106f10 msgr2=0x7f258819cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:12.403+0000 7f2590580640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2588106f10 0x7f258819cee0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f2580009fd0 tx=0x7f258000b260 comp rx=0 tx=0).stop 2024-09-15T22:27:12.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:12.403+0000 7f2590580640 1 -- 172.21.15.45:0/622276628 shutdown_connections 2024-09-15T22:27:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:12.403+0000 7f2590580640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f25740a33b0 0x7f25740a5870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:12.403+0000 7f2590580640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2588106f10 0x7f258819cee0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:12.403+0000 7f2590580640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2588102790 0x7f2588198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:12.403+0000 7f2590580640 1 --2- 172.21.15.45:0/622276628 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f2588101de0 0x7f2588198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:12.403+0000 7f2590580640 1 -- 172.21.15.45:0/622276628 >> 172.21.15.45:0/622276628 conn(0x7f25880fd8c0 msgr2=0x7f25880fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:12.403+0000 7f2590580640 1 -- 172.21.15.45:0/622276628 shutdown_connections 2024-09-15T22:27:12.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:12.404+0000 7f2590580640 1 -- 172.21.15.45:0/622276628 wait complete. 2024-09-15T22:27:12.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:12 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/622276628' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:27:12.737 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:12 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/622276628' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:27:12.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:12 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/622276628' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T22:27:13.100 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:27:13.363 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:27:13.656 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:13 smithi045 ceph-mon[31180]: pgmap v342: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 383 B/s wr, 1 op/s 2024-09-15T22:27:13.656 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:13 smithi045 ceph-mon[31180]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T22:27:13.656 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:13 smithi045 ceph-mon[31180]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T22:27:13.656 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:13 smithi045 ceph-mon[31180]: Cluster is now healthy 2024-09-15T22:27:13.656 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:13 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/622276628' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:27:13.656 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:13 smithi045 ceph-mon[31180]: fsmap 12 up:standby 2024-09-15T22:27:13.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:13 smithi165 ceph-mon[35551]: pgmap v342: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 383 B/s wr, 1 op/s 2024-09-15T22:27:13.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:13 smithi165 ceph-mon[35551]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T22:27:13.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:13 smithi165 ceph-mon[35551]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T22:27:13.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:13 smithi165 ceph-mon[35551]: Cluster is now healthy 2024-09-15T22:27:13.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:13 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/622276628' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:27:13.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:13 smithi165 ceph-mon[35551]: fsmap 12 up:standby 2024-09-15T22:27:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:13 smithi100 ceph-mon[35319]: pgmap v342: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s rd, 383 B/s wr, 1 op/s 2024-09-15T22:27:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:13 smithi100 ceph-mon[35319]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T22:27:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:13 smithi100 ceph-mon[35319]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T22:27:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:13 smithi100 ceph-mon[35319]: Cluster is now healthy 2024-09-15T22:27:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:13 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/622276628' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T22:27:13.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:13 smithi100 ceph-mon[35319]: fsmap 12 up:standby 2024-09-15T22:27:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.851+0000 7ff226ce6640 1 -- 172.21.15.45:0/1593451045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff220102570 msgr2=0x7ff2201029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.851+0000 7ff226ce6640 1 --2- 172.21.15.45:0/1593451045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff220102570 0x7ff2201029b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009900 tx=0x7ff20c02a480 comp rx=0 tx=0).stop 2024-09-15T22:27:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.851+0000 7ff226ce6640 1 -- 172.21.15.45:0/1593451045 shutdown_connections 2024-09-15T22:27:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.851+0000 7ff226ce6640 1 --2- 172.21.15.45:0/1593451045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff220102ef0 0x7ff22010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.851+0000 7ff226ce6640 1 --2- 172.21.15.45:0/1593451045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff220102570 0x7ff2201029b0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.851+0000 7ff226ce6640 1 --2- 172.21.15.45:0/1593451045 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff220100e20 0x7ff220101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.851+0000 7ff226ce6640 1 -- 172.21.15.45:0/1593451045 >> 172.21.15.45:0/1593451045 conn(0x7ff2200fc7d0 msgr2=0x7ff2200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.851+0000 7ff226ce6640 1 -- 172.21.15.45:0/1593451045 shutdown_connections 2024-09-15T22:27:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.851+0000 7ff226ce6640 1 -- 172.21.15.45:0/1593451045 wait complete. 2024-09-15T22:27:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.852+0000 7ff226ce6640 1 Processor -- start 2024-09-15T22:27:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.852+0000 7ff226ce6640 1 -- start start 2024-09-15T22:27:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.852+0000 7ff226ce6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff220100e20 0x7ff2201985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.852+0000 7ff226ce6640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff220102570 0x7ff220198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.852+0000 7ff226ce6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff220102ef0 0x7ff22019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.852+0000 7ff226ce6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff2201110a0 con 0x7ff220102ef0 2024-09-15T22:27:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.852+0000 7ff226ce6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff220110f20 con 0x7ff220100e20 2024-09-15T22:27:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.852+0000 7ff226ce6640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7ff220111220 con 0x7ff220102570 2024-09-15T22:27:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.852+0000 7ff225283640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff220102ef0 0x7ff22019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.852+0000 7ff225283640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff220102ef0 0x7ff22019ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:52488/0 (socket says 172.21.15.45:52488) 2024-09-15T22:27:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.852+0000 7ff225283640 1 -- 172.21.15.45:0/4182393726 learned_addr learned my addr 172.21.15.45:0/4182393726 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:27:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.852+0000 7ff224a82640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff220100e20 0x7ff2201985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.852+0000 7ff21ffff640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff220102570 0x7ff220198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.853+0000 7ff225283640 1 -- 172.21.15.45:0/4182393726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff220102570 msgr2=0x7ff220198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.853+0000 7ff225283640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff220102570 0x7ff220198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.853+0000 7ff225283640 1 -- 172.21.15.45:0/4182393726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff220100e20 msgr2=0x7ff2201985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.853+0000 7ff225283640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff220100e20 0x7ff2201985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.853+0000 7ff225283640 1 -- 172.21.15.45:0/4182393726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22019d570 con 0x7ff220102ef0 2024-09-15T22:27:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.853+0000 7ff21ffff640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff220102570 0x7ff220198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:27:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.853+0000 7ff225283640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff220102ef0 0x7ff22019ce90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff218009fd0 tx=0x7ff21800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.853+0000 7ff21dffb640 1 -- 172.21.15.45:0/4182393726 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff218017070 con 0x7ff220102ef0 2024-09-15T22:27:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.853+0000 7ff226ce6640 1 -- 172.21.15.45:0/4182393726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22019d860 con 0x7ff220102ef0 2024-09-15T22:27:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.853+0000 7ff21dffb640 1 -- 172.21.15.45:0/4182393726 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff218004020 con 0x7ff220102ef0 2024-09-15T22:27:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.853+0000 7ff21dffb640 1 -- 172.21.15.45:0/4182393726 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2180106c0 con 0x7ff220102ef0 2024-09-15T22:27:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.853+0000 7ff226ce6640 1 -- 172.21.15.45:0/4182393726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2201a5140 con 0x7ff220102ef0 2024-09-15T22:27:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.854+0000 7ff226ce6640 1 -- 172.21.15.45:0/4182393726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff220101200 con 0x7ff220102ef0 2024-09-15T22:27:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.855+0000 7ff21dffb640 1 -- 172.21.15.45:0/4182393726 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff2180041d0 con 0x7ff220102ef0 2024-09-15T22:27:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.856+0000 7ff21dffb640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff2100a33b0 0x7ff2100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.856+0000 7ff224a82640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff2100a33b0 0x7ff2100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:13.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.856+0000 7ff21dffb640 1 -- 172.21.15.45:0/4182393726 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9654+0+0 (secure 0 0 0) 0x7ff2180cff40 con 0x7ff220102ef0 2024-09-15T22:27:13.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.856+0000 7ff224a82640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff2100a33b0 0x7ff2100a5870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff214005fd0 tx=0x7ff21400b390 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:13.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:13.860+0000 7ff21dffb640 1 -- 172.21.15.45:0/4182393726 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff21809c450 con 0x7ff220102ef0 2024-09-15T22:27:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.038+0000 7ff226ce6640 1 -- 172.21.15.45:0/4182393726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff22010a0a0 con 0x7ff220102ef0 2024-09-15T22:27:14.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.403+0000 7ff21dffb640 1 -- 172.21.15.45:0/4182393726 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v103) ==== 181+0+0 (secure 0 0 0) 0x7ff21809bd50 con 0x7ff220102ef0 2024-09-15T22:27:14.405 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:27:14.407 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:14 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/4182393726' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:27:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.406+0000 7ff226ce6640 1 -- 172.21.15.45:0/4182393726 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff2100a33b0 msgr2=0x7ff2100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.406+0000 7ff226ce6640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff2100a33b0 0x7ff2100a5870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff214005fd0 tx=0x7ff21400b390 comp rx=0 tx=0).stop 2024-09-15T22:27:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.406+0000 7ff226ce6640 1 -- 172.21.15.45:0/4182393726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff220102ef0 msgr2=0x7ff22019ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.406+0000 7ff226ce6640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff220102ef0 0x7ff22019ce90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff218009fd0 tx=0x7ff21800b260 comp rx=0 tx=0).stop 2024-09-15T22:27:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.407+0000 7ff226ce6640 1 -- 172.21.15.45:0/4182393726 shutdown_connections 2024-09-15T22:27:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.407+0000 7ff226ce6640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7ff2100a33b0 0x7ff2100a5870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:14.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.407+0000 7ff226ce6640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff220102ef0 0x7ff22019ce90 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.407+0000 7ff226ce6640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7ff220102570 0x7ff220198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.407+0000 7ff226ce6640 1 --2- 172.21.15.45:0/4182393726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff220100e20 0x7ff2201985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.407+0000 7ff226ce6640 1 -- 172.21.15.45:0/4182393726 >> 172.21.15.45:0/4182393726 conn(0x7ff2200fc7d0 msgr2=0x7ff22006a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.407+0000 7ff226ce6640 1 -- 172.21.15.45:0/4182393726 shutdown_connections 2024-09-15T22:27:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:14.407+0000 7ff226ce6640 1 -- 172.21.15.45:0/4182393726 wait complete. 2024-09-15T22:27:14.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:14 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/4182393726' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:27:14.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:14 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/4182393726' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:27:15.106 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:27:15.368 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:27:15.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:15 smithi165 ceph-mon[35551]: pgmap v343: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 383 B/s wr, 2 op/s 2024-09-15T22:27:15.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:15 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/4182393726' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:27:15.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:15 smithi165 ceph-mon[35551]: osdmap e103: 12 total, 12 up, 12 in 2024-09-15T22:27:15.715 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:15 smithi165 ceph-mon[35551]: osdmap e104: 12 total, 12 up, 12 in 2024-09-15T22:27:15.743 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:15 smithi045 ceph-mon[31180]: pgmap v343: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 383 B/s wr, 2 op/s 2024-09-15T22:27:15.743 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:15 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/4182393726' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:27:15.743 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:15 smithi045 ceph-mon[31180]: osdmap e103: 12 total, 12 up, 12 in 2024-09-15T22:27:15.743 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:15 smithi045 ceph-mon[31180]: osdmap e104: 12 total, 12 up, 12 in 2024-09-15T22:27:15.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:15 smithi100 ceph-mon[35319]: pgmap v343: 129 pgs: 129 active+clean; 149 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 383 B/s wr, 2 op/s 2024-09-15T22:27:15.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:15 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/4182393726' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:27:15.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:15 smithi100 ceph-mon[35319]: osdmap e103: 12 total, 12 up, 12 in 2024-09-15T22:27:15.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:15 smithi100 ceph-mon[35319]: osdmap e104: 12 total, 12 up, 12 in 2024-09-15T22:27:15.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.828+0000 7fa9e6fed640 1 -- 172.21.15.45:0/958473398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e0102d30 msgr2=0x7fa9e0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:15.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.828+0000 7fa9e6fed640 1 --2- 172.21.15.45:0/958473398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e0102d30 0x7fa9e0103110 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009930 tx=0x7fa9d002a420 comp rx=0 tx=0).stop 2024-09-15T22:27:15.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.828+0000 7fa9e6fed640 1 -- 172.21.15.45:0/958473398 shutdown_connections 2024-09-15T22:27:15.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.828+0000 7fa9e6fed640 1 --2- 172.21.15.45:0/958473398 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9e01082a0 0x7fa9e010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:15.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.828+0000 7fa9e6fed640 1 --2- 172.21.15.45:0/958473398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e01036e0 0x7fa9e0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.828+0000 7fa9e6fed640 1 --2- 172.21.15.45:0/958473398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e0102d30 0x7fa9e0103110 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.828+0000 7fa9e6fed640 1 -- 172.21.15.45:0/958473398 >> 172.21.15.45:0/958473398 conn(0x7fa9e00fc7d0 msgr2=0x7fa9e00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.828+0000 7fa9e6fed640 1 -- 172.21.15.45:0/958473398 shutdown_connections 2024-09-15T22:27:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.828+0000 7fa9e6fed640 1 -- 172.21.15.45:0/958473398 wait complete. 2024-09-15T22:27:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.828+0000 7fa9e6fed640 1 Processor -- start 2024-09-15T22:27:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.828+0000 7fa9e6fed640 1 -- start start 2024-09-15T22:27:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9e6fed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e0102d30 0x7fa9e01986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9e6fed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e01036e0 0x7fa9e0198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9e6fed640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9e01082a0 0x7fa9e019cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9e6fed640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e01121c0 con 0x7fa9e01036e0 2024-09-15T22:27:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9e6fed640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e0112040 con 0x7fa9e0102d30 2024-09-15T22:27:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9e6fed640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e0112340 con 0x7fa9e01082a0 2024-09-15T22:27:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9dffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e01036e0 0x7fa9e0198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9dffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e01036e0 0x7fa9e0198c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45028/0 (socket says 172.21.15.45:45028) 2024-09-15T22:27:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9e4d89640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e0102d30 0x7fa9e01986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9dffff640 1 -- 172.21.15.45:0/2480569307 learned_addr learned my addr 172.21.15.45:0/2480569307 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:27:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9e558a640 1 --2- 172.21.15.45:0/2480569307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9e01082a0 0x7fa9e019cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9dffff640 1 -- 172.21.15.45:0/2480569307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9e01082a0 msgr2=0x7fa9e019cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9dffff640 1 --2- 172.21.15.45:0/2480569307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9e01082a0 0x7fa9e019cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9dffff640 1 -- 172.21.15.45:0/2480569307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e0102d30 msgr2=0x7fa9e01986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9dffff640 1 --2- 172.21.15.45:0/2480569307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e0102d30 0x7fa9e01986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9dffff640 1 -- 172.21.15.45:0/2480569307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e019d690 con 0x7fa9e01036e0 2024-09-15T22:27:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9dffff640 1 --2- 172.21.15.45:0/2480569307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e01036e0 0x7fa9e0198c20 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800d740 tx=0x7fa9c800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.829+0000 7fa9ddffb640 1 -- 172.21.15.45:0/2480569307 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8017070 con 0x7fa9e01036e0 2024-09-15T22:27:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.830+0000 7fa9ddffb640 1 -- 172.21.15.45:0/2480569307 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa9c800de50 con 0x7fa9e01036e0 2024-09-15T22:27:15.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.830+0000 7fa9e6fed640 1 -- 172.21.15.45:0/2480569307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e019d980 con 0x7fa9e01036e0 2024-09-15T22:27:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.830+0000 7fa9ddffb640 1 -- 172.21.15.45:0/2480569307 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800f740 con 0x7fa9e01036e0 2024-09-15T22:27:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.830+0000 7fa9e6fed640 1 -- 172.21.15.45:0/2480569307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e01a5260 con 0x7fa9e01036e0 2024-09-15T22:27:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.831+0000 7fa9e6fed640 1 -- 172.21.15.45:0/2480569307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9e006a850 con 0x7fa9e01036e0 2024-09-15T22:27:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.832+0000 7fa9ddffb640 1 -- 172.21.15.45:0/2480569307 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa9c801a070 con 0x7fa9e01036e0 2024-09-15T22:27:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.833+0000 7fa9ddffb640 1 --2- 172.21.15.45:0/2480569307 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa9cc0a33b0 0x7fa9cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.833+0000 7fa9e4d89640 1 --2- 172.21.15.45:0/2480569307 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa9cc0a33b0 0x7fa9cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.833+0000 7fa9ddffb640 1 -- 172.21.15.45:0/2480569307 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9129+0+0 (secure 0 0 0) 0x7fa9c80cf9e0 con 0x7fa9e01036e0 2024-09-15T22:27:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.833+0000 7fa9e4d89640 1 --2- 172.21.15.45:0/2480569307 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa9cc0a33b0 0x7fa9cc0a5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009900 tx=0x7fa9d00058d0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:15.837+0000 7fa9ddffb640 1 -- 172.21.15.45:0/2480569307 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa9c809c100 con 0x7fa9e01036e0 2024-09-15T22:27:16.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.012+0000 7fa9e6fed640 1 -- 172.21.15.45:0/2480569307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa9e010a2b0 con 0x7fa9e01036e0 2024-09-15T22:27:16.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.410+0000 7fa9ddffb640 1 -- 172.21.15.45:0/2480569307 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) ==== 169+0+0 (secure 0 0 0) 0x7fa9c809ba00 con 0x7fa9e01036e0 2024-09-15T22:27:16.412 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2024-09-15T22:27:16.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.413+0000 7fa9e6fed640 1 -- 172.21.15.45:0/2480569307 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa9cc0a33b0 msgr2=0x7fa9cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:16.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.413+0000 7fa9e6fed640 1 --2- 172.21.15.45:0/2480569307 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa9cc0a33b0 0x7fa9cc0a5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009900 tx=0x7fa9d00058d0 comp rx=0 tx=0).stop 2024-09-15T22:27:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.413+0000 7fa9e6fed640 1 -- 172.21.15.45:0/2480569307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e01036e0 msgr2=0x7fa9e0198c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.413+0000 7fa9e6fed640 1 --2- 172.21.15.45:0/2480569307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e01036e0 0x7fa9e0198c20 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800d740 tx=0x7fa9c800dc00 comp rx=0 tx=0).stop 2024-09-15T22:27:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.413+0000 7fa9e6fed640 1 -- 172.21.15.45:0/2480569307 shutdown_connections 2024-09-15T22:27:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.413+0000 7fa9e6fed640 1 --2- 172.21.15.45:0/2480569307 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7fa9cc0a33b0 0x7fa9cc0a5870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.413+0000 7fa9e6fed640 1 --2- 172.21.15.45:0/2480569307 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7fa9e01082a0 0x7fa9e019cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.413+0000 7fa9e6fed640 1 --2- 172.21.15.45:0/2480569307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e01036e0 0x7fa9e0198c20 secure :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800d740 tx=0x7fa9c800dc00 comp rx=0 tx=0).stop 2024-09-15T22:27:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.413+0000 7fa9e6fed640 1 --2- 172.21.15.45:0/2480569307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9e0102d30 0x7fa9e01986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:16.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.413+0000 7fa9e6fed640 1 -- 172.21.15.45:0/2480569307 >> 172.21.15.45:0/2480569307 conn(0x7fa9e00fc7d0 msgr2=0x7fa9e0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:16.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.415+0000 7fa9e6fed640 1 -- 172.21.15.45:0/2480569307 shutdown_connections 2024-09-15T22:27:16.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:16.415+0000 7fa9e6fed640 1 -- 172.21.15.45:0/2480569307 wait complete. 2024-09-15T22:27:16.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:16 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2480569307' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:27:16.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:16 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2480569307' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:27:16.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:16 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2480569307' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:27:17.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid a1911414-73ae-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-15T22:27:17.542 INFO:teuthology.orchestra.run.smithi045.stderr:Inferring config /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T22:27:17.664 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:17 smithi045 ceph-mon[31180]: pgmap v346: 97 pgs: 97 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:27:17.664 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:17 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/2480569307' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:27:17.664 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:17 smithi045 ceph-mon[31180]: osdmap e105: 12 total, 12 up, 12 in 2024-09-15T22:27:17.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:17 smithi165 ceph-mon[35551]: pgmap v346: 97 pgs: 97 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:27:17.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:17 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/2480569307' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:27:17.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:17 smithi165 ceph-mon[35551]: osdmap e105: 12 total, 12 up, 12 in 2024-09-15T22:27:17.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:17 smithi100 ceph-mon[35319]: pgmap v346: 97 pgs: 97 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:27:17.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:17 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/2480569307' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:27:17.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:17 smithi100 ceph-mon[35319]: osdmap e105: 12 total, 12 up, 12 in 2024-09-15T22:27:18.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.251+0000 7f4a8cdef640 1 -- 172.21.15.45:0/954911351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a88106a80 msgr2=0x7f4a88106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:18.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.251+0000 7f4a8cdef640 1 --2- 172.21.15.45:0/954911351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a88106a80 0x7f4a88106e60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009930 tx=0x7f4a7802a420 comp rx=0 tx=0).stop 2024-09-15T22:27:18.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.251+0000 7f4a8cdef640 1 -- 172.21.15.45:0/954911351 shutdown_connections 2024-09-15T22:27:18.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.251+0000 7f4a8cdef640 1 --2- 172.21.15.45:0/954911351 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a88101420 0x7f4a8810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:18.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.251+0000 7f4a8cdef640 1 --2- 172.21.15.45:0/954911351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a88100a80 0x7f4a88100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:18.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.251+0000 7f4a8cdef640 1 --2- 172.21.15.45:0/954911351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a88106a80 0x7f4a88106e60 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:18.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.251+0000 7f4a8cdef640 1 -- 172.21.15.45:0/954911351 >> 172.21.15.45:0/954911351 conn(0x7f4a880fc7a0 msgr2=0x7f4a880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:18.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.251+0000 7f4a8cdef640 1 -- 172.21.15.45:0/954911351 shutdown_connections 2024-09-15T22:27:18.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.251+0000 7f4a8cdef640 1 -- 172.21.15.45:0/954911351 wait complete. 2024-09-15T22:27:18.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.252+0000 7f4a8cdef640 1 Processor -- start 2024-09-15T22:27:18.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.252+0000 7f4a8cdef640 1 -- start start 2024-09-15T22:27:18.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.252+0000 7f4a8cdef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a88100a80 0x7f4a8810e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:18.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.252+0000 7f4a8cdef640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a88101420 0x7f4a8810e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:18.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.252+0000 7f4a8cdef640 1 --2- >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a88106a80 0x7f4a8810ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:18.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.252+0000 7f4a8cdef640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4a881120c0 con 0x7f4a88100a80 2024-09-15T22:27:18.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.252+0000 7f4a8cdef640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a88111f40 con 0x7f4a88101420 2024-09-15T22:27:18.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.252+0000 7f4a8cdef640 1 -- --> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] -- mon_getmap magic: 0 -- 0x7f4a88112240 con 0x7f4a88106a80 2024-09-15T22:27:18.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.252+0000 7f4a8659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a88100a80 0x7f4a8810e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:18.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.252+0000 7f4a8659c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a88100a80 0x7f4a8810e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45050/0 (socket says 172.21.15.45:45050) 2024-09-15T22:27:18.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.252+0000 7f4a8659c640 1 -- 172.21.15.45:0/562689795 learned_addr learned my addr 172.21.15.45:0/562689795 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-09-15T22:27:18.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.252+0000 7f4a85d9b640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a88101420 0x7f4a8810e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:18.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.253+0000 7f4a86d9d640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a88106a80 0x7f4a8810ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:18.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.253+0000 7f4a8659c640 1 -- 172.21.15.45:0/562689795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a88106a80 msgr2=0x7f4a8810ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:18.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.253+0000 7f4a8659c640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a88106a80 0x7f4a8810ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:18.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.253+0000 7f4a8659c640 1 -- 172.21.15.45:0/562689795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a88101420 msgr2=0x7f4a8810e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:18.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.253+0000 7f4a8659c640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a88101420 0x7f4a8810e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:18.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.253+0000 7f4a8659c640 1 -- 172.21.15.45:0/562689795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a881a6a30 con 0x7f4a88100a80 2024-09-15T22:27:18.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.253+0000 7f4a86d9d640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a88106a80 0x7f4a8810ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:27:18.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.253+0000 7f4a8659c640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a88100a80 0x7f4a8810e3e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009a50 tx=0x7f4a78004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:18.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.253+0000 7f4a777fe640 1 -- 172.21.15.45:0/562689795 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7803f030 con 0x7f4a88100a80 2024-09-15T22:27:18.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.253+0000 7f4a8cdef640 1 -- 172.21.15.45:0/562689795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a881a6cc0 con 0x7f4a88100a80 2024-09-15T22:27:18.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.253+0000 7f4a777fe640 1 -- 172.21.15.45:0/562689795 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4a78003af0 con 0x7f4a88100a80 2024-09-15T22:27:18.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.253+0000 7f4a777fe640 1 -- 172.21.15.45:0/562689795 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a78035070 con 0x7f4a88100a80 2024-09-15T22:27:18.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.253+0000 7f4a8cdef640 1 -- 172.21.15.45:0/562689795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a881a71a0 con 0x7f4a88100a80 2024-09-15T22:27:18.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.254+0000 7f4a8cdef640 1 -- 172.21.15.45:0/562689795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a88100ee0 con 0x7f4a88100a80 2024-09-15T22:27:18.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.255+0000 7f4a777fe640 1 -- 172.21.15.45:0/562689795 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4a78042030 con 0x7f4a88100a80 2024-09-15T22:27:18.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.256+0000 7f4a777fe640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4a700a33b0 0x7f4a700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:27:18.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.256+0000 7f4a85d9b640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4a700a33b0 0x7f4a700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:27:18.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.256+0000 7f4a777fe640 1 -- 172.21.15.45:0/562689795 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8453+0+0 (secure 0 0 0) 0x7f4a780f0af0 con 0x7f4a88100a80 2024-09-15T22:27:18.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.256+0000 7f4a85d9b640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4a700a33b0 0x7f4a700a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4a8810fe70 tx=0x7f4a7c00a4c0 comp rx=0 tx=0).ready entity=mgr.15165 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:27:18.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.259+0000 7f4a777fe640 1 -- 172.21.15.45:0/562689795 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a780bd4b0 con 0x7f4a88100a80 2024-09-15T22:27:18.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:18.437+0000 7f4a8cdef640 1 -- 172.21.15.45:0/562689795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4a8810f910 con 0x7f4a88100a80 2024-09-15T22:27:19.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:19.422+0000 7f4a777fe640 1 -- 172.21.15.45:0/562689795 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v106) ==== 178+0+0 (secure 0 0 0) 0x7f4a8810f910 con 0x7f4a88100a80 2024-09-15T22:27:19.423 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_ec' removed 2024-09-15T22:27:19.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:19.426+0000 7f4a8cdef640 1 -- 172.21.15.45:0/562689795 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4a700a33b0 msgr2=0x7f4a700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:19.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:19.426+0000 7f4a8cdef640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4a700a33b0 0x7f4a700a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4a8810fe70 tx=0x7f4a7c00a4c0 comp rx=0 tx=0).stop 2024-09-15T22:27:19.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:19.426+0000 7f4a8cdef640 1 -- 172.21.15.45:0/562689795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a88100a80 msgr2=0x7f4a8810e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:27:19.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:19.426+0000 7f4a8cdef640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a88100a80 0x7f4a8810e3e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009a50 tx=0x7f4a78004270 comp rx=0 tx=0).stop 2024-09-15T22:27:19.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:19.426+0000 7f4a8cdef640 1 -- 172.21.15.45:0/562689795 shutdown_connections 2024-09-15T22:27:19.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:19.426+0000 7f4a8cdef640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.45:6800/553298159,v1:172.21.15.45:6801/553298159] conn(0x7f4a700a33b0 0x7f4a700a5870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:19.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:19.426+0000 7f4a8cdef640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] conn(0x7f4a88106a80 0x7f4a8810ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:19.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:19.426+0000 7f4a8cdef640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a88101420 0x7f4a8810e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:19.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:19.426+0000 7f4a8cdef640 1 --2- 172.21.15.45:0/562689795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a88100a80 0x7f4a8810e3e0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:27:19.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:19.426+0000 7f4a8cdef640 1 -- 172.21.15.45:0/562689795 >> 172.21.15.45:0/562689795 conn(0x7f4a880fc7a0 msgr2=0x7f4a880fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:27:19.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:19.427+0000 7f4a8cdef640 1 -- 172.21.15.45:0/562689795 shutdown_connections 2024-09-15T22:27:19.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-09-15T22:27:19.427+0000 7f4a8cdef640 1 -- 172.21.15.45:0/562689795 wait complete. 2024-09-15T22:27:19.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:19 smithi165 ceph-mon[35551]: pgmap v348: 33 pgs: 33 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:27:19.714 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:19 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/562689795' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:27:19.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:19 smithi100 ceph-mon[35319]: pgmap v348: 33 pgs: 33 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:27:19.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:19 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/562689795' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:27:19.764 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:19 smithi045 ceph-mon[31180]: pgmap v348: 33 pgs: 33 active+clean; 577 KiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T22:27:19.765 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:19 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/562689795' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T22:27:20.118 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:27:20.148 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:27:20.181 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:27:20.215 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-15T22:27:20.215 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:27:20.234 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:27:20.252 DEBUG:teuthology.orchestra.run.smithi165:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T22:27:20.273 INFO:tasks.cephadm:Stopping all daemons... 2024-09-15T22:27:20.273 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-15T22:27:20.273 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.a 2024-09-15T22:27:20.428 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:20 smithi045 systemd[1]: Stopping Ceph mon.a for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:27:20.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:20 smithi165 ceph-mon[35551]: from='client.? 172.21.15.45:0/562689795' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:27:20.464 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:20 smithi165 ceph-mon[35551]: osdmap e106: 12 total, 12 up, 12 in 2024-09-15T22:27:20.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:20 smithi100 ceph-mon[35319]: from='client.? 172.21.15.45:0/562689795' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:27:20.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:20 smithi100 ceph-mon[35319]: osdmap e106: 12 total, 12 up, 12 in 2024-09-15T22:27:20.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:20 smithi045 ceph-mon[31180]: from='client.? 172.21.15.45:0/562689795' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T22:27:20.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:20 smithi045 ceph-mon[31180]: osdmap e106: 12 total, 12 up, 12 in 2024-09-15T22:27:20.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a[31176]: 2024-09-15T22:27:20.584+0000 7f085c8b1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:20.800 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a[31176]: 2024-09-15T22:27:20.584+0000 7f085c8b1640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-15T22:27:21.178 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:20 smithi045 podman[107595]: 2024-09-15 22:27:20.840341443 +0000 UTC m=+0.366277413 container died 4d4f2538640b1bf5160a6dcc6e159dcddccd3aa13995f576650af785e6a43f98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:27:21.503 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:21 smithi045 podman[107595]: 2024-09-15 22:27:21.26789285 +0000 UTC m=+0.793828817 container cleanup 4d4f2538640b1bf5160a6dcc6e159dcddccd3aa13995f576650af785e6a43f98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-15T22:27:21.504 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:21 smithi045 bash[107595]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a 2024-09-15T22:27:21.732 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.a.service' 2024-09-15T22:27:21.755 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:21 smithi045 podman[107609]: 2024-09-15 22:27:21.502811908 +0000 UTC m=+0.660438742 container remove 4d4f2538640b1bf5160a6dcc6e159dcddccd3aa13995f576650af785e6a43f98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-15T22:27:21.755 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:21 smithi045 systemd[1]: ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-15T22:27:21.755 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:21 smithi045 systemd[1]: Stopped Ceph mon.a for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:27:21.755 INFO:journalctl@ceph.mon.a.smithi045.stdout:Sep 15 22:27:21 smithi045 systemd[1]: ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.a.service: Consumed 21.109s CPU time. 2024-09-15T22:27:21.803 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:21.804 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-15T22:27:21.804 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-15T22:27:21.804 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.b 2024-09-15T22:27:22.113 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:21 smithi100 systemd[1]: Stopping Ceph mon.b for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:27:22.480 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:22 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-b[35315]: 2024-09-15T22:27:22.111+0000 7ff4f5064640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:22.480 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:22 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-b[35315]: 2024-09-15T22:27:22.111+0000 7ff4f5064640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-15T22:27:22.480 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:22 smithi100 podman[70941]: 2024-09-15 22:27:22.183394672 +0000 UTC m=+0.187482520 container died c6dc590835aa082e70518a9cca9dc53ba2d4d477d502ca37f1ea28deb1bd5376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:27:22.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:22 smithi100 podman[70941]: 2024-09-15 22:27:22.5705553 +0000 UTC m=+0.574643199 container cleanup c6dc590835aa082e70518a9cca9dc53ba2d4d477d502ca37f1ea28deb1bd5376 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-b, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-15T22:27:22.744 INFO:journalctl@ceph.mon.b.smithi100.stdout:Sep 15 22:27:22 smithi100 bash[70941]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-b 2024-09-15T22:27:22.995 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.b.service' 2024-09-15T22:27:23.042 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:23.042 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-15T22:27:23.042 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-15T22:27:23.042 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.c 2024-09-15T22:27:23.363 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:23 smithi165 systemd[1]: Stopping Ceph mon.c for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:27:23.707 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:23 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-c[35547]: 2024-09-15T22:27:23.361+0000 7f413ac9e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:23.707 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:23 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-c[35547]: 2024-09-15T22:27:23.361+0000 7f413ac9e640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-15T22:27:23.707 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:23 smithi165 podman[72098]: 2024-09-15 22:27:23.393434185 +0000 UTC m=+0.155334369 container died 4efa1b799cd6b52089ba7f3827ce8e35b00fcc28385eb44bfe0b66b9b48e3bc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-15T22:27:23.964 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:23 smithi165 podman[72098]: 2024-09-15 22:27:23.82153665 +0000 UTC m=+0.583436865 container cleanup 4efa1b799cd6b52089ba7f3827ce8e35b00fcc28385eb44bfe0b66b9b48e3bc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-15T22:27:23.965 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:23 smithi165 bash[72098]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-c 2024-09-15T22:27:24.299 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.c.service' 2024-09-15T22:27:24.322 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:24 smithi165 podman[72110]: 2024-09-15 22:27:24.056154873 +0000 UTC m=+0.660855563 container remove 4efa1b799cd6b52089ba7f3827ce8e35b00fcc28385eb44bfe0b66b9b48e3bc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-15T22:27:24.322 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:24 smithi165 systemd[1]: ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.c.service: Deactivated successfully. 2024-09-15T22:27:24.322 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:24 smithi165 systemd[1]: Stopped Ceph mon.c for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:27:24.322 INFO:journalctl@ceph.mon.c.smithi165.stdout:Sep 15 22:27:24 smithi165 systemd[1]: ceph-a1911414-73ae-11ef-bceb-c7b262605968@mon.c.service: Consumed 12.650s CPU time. 2024-09-15T22:27:24.351 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:24.352 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-15T22:27:24.352 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-15T22:27:24.352 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mgr.x 2024-09-15T22:27:24.666 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:27:24 smithi045 systemd[1]: Stopping Ceph mgr.x for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:27:24.983 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:27:24 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x[31407]: 2024-09-15T22:27:24.664+0000 7fd0a6b8a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:24.983 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:27:24 smithi045 podman[107715]: 2024-09-15 22:27:24.695405688 +0000 UTC m=+0.149738393 container died 918e77660f125130f13f3efd75ec18c2242a0bc6bf3a3828b3c08cef47fe1475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-15T22:27:25.300 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:27:25 smithi045 podman[107715]: 2024-09-15 22:27:25.081627207 +0000 UTC m=+0.535959911 container cleanup 918e77660f125130f13f3efd75ec18c2242a0bc6bf3a3828b3c08cef47fe1475 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-15T22:27:25.300 INFO:journalctl@ceph.mgr.x.smithi045.stdout:Sep 15 22:27:25 smithi045 bash[107715]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-x 2024-09-15T22:27:25.515 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-15T22:27:25.552 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:25.553 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-15T22:27:25.553 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-15T22:27:25.553 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mgr.y 2024-09-15T22:27:25.888 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:27:25 smithi100 systemd[1]: Stopping Ceph mgr.y for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:27:26.194 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:27:25 smithi100 podman[71064]: 2024-09-15 22:27:25.887767755 +0000 UTC m=+0.144241312 container died bf93c6228aa9d156a6e3083949080d42a7e4a8585aef09123ac3a73dcc64e3ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-15T22:27:26.494 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:27:26 smithi100 podman[71064]: 2024-09-15 22:27:26.284559493 +0000 UTC m=+0.541033061 container cleanup bf93c6228aa9d156a6e3083949080d42a7e4a8585aef09123ac3a73dcc64e3ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-15T22:27:26.494 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Sep 15 22:27:26 smithi100 bash[71064]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-y 2024-09-15T22:27:26.718 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-15T22:27:26.752 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:26.753 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-15T22:27:26.753 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-15T22:27:26.753 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mgr.z 2024-09-15T22:27:27.097 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:27:26 smithi165 systemd[1]: Stopping Ceph mgr.z for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:27:27.361 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:27:27 smithi165 podman[72221]: 2024-09-15 22:27:27.096455217 +0000 UTC m=+0.143043474 container died 4fc695416bf10a3cc4fec1ffcd796c43c28a4ec0c77c552977c77eed3b313774 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-15T22:27:27.714 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:27:27 smithi165 podman[72221]: 2024-09-15 22:27:27.467754681 +0000 UTC m=+0.514342937 container cleanup 4fc695416bf10a3cc4fec1ffcd796c43c28a4ec0c77c552977c77eed3b313774 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-15T22:27:27.714 INFO:journalctl@ceph.mgr.z.smithi165.stdout:Sep 15 22:27:27 smithi165 bash[72221]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mgr-z 2024-09-15T22:27:27.945 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-15T22:27:27.983 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:27.983 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-15T22:27:27.983 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-15T22:27:27.983 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.0 2024-09-15T22:27:28.295 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:28 smithi045 systemd[1]: Stopping Ceph osd.0 for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:27:28.550 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:28 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0[45264]: 2024-09-15T22:27:28.294+0000 7fd3db70b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:28.550 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:28 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0[45264]: 2024-09-15T22:27:28.294+0000 7fd3db70b640 -1 osd.0 106 *** Got signal Terminated *** 2024-09-15T22:27:28.550 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:28 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0[45264]: 2024-09-15T22:27:28.294+0000 7fd3db70b640 -1 osd.0 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:27:33.997 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:33 smithi045 podman[107838]: 2024-09-15 22:27:33.694598309 +0000 UTC m=+5.510799583 container died b5cffa46a394a3ed09bb110a2cacd3943e3125c9d94c0e4c0bf5df6fd44850ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-15T22:27:34.300 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:34 smithi045 podman[107838]: 2024-09-15 22:27:34.170436708 +0000 UTC m=+5.986637989 container cleanup b5cffa46a394a3ed09bb110a2cacd3943e3125c9d94c0e4c0bf5df6fd44850ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-15T22:27:34.300 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:34 smithi045 bash[107838]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0 2024-09-15T22:27:34.798 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:34 smithi045 podman[107865]: 2024-09-15 22:27:34.447018129 +0000 UTC m=+0.750130760 container remove b5cffa46a394a3ed09bb110a2cacd3943e3125c9d94c0e4c0bf5df6fd44850ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-15T22:27:35.050 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:34 smithi045 podman[107954]: 2024-09-15 22:27:34.70007485 +0000 UTC m=+0.016222177 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:27:35.050 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:34 smithi045 podman[107954]: 2024-09-15 22:27:34.806167487 +0000 UTC m=+0.122314801 container create b7298169424efaa7ac0b1ec315dcb8991d609cae1d58c77f568d470627f11f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-15T22:27:35.549 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:35 smithi045 podman[107954]: 2024-09-15 22:27:35.095769682 +0000 UTC m=+0.411917008 container init b7298169424efaa7ac0b1ec315dcb8991d609cae1d58c77f568d470627f11f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-15T22:27:35.550 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:35 smithi045 podman[107954]: 2024-09-15 22:27:35.099569139 +0000 UTC m=+0.415716453 container start b7298169424efaa7ac0b1ec315dcb8991d609cae1d58c77f568d470627f11f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True) 2024-09-15T22:27:35.550 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:35 smithi045 podman[107954]: 2024-09-15 22:27:35.209525368 +0000 UTC m=+0.525672695 container attach b7298169424efaa7ac0b1ec315dcb8991d609cae1d58c77f568d470627f11f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-15T22:27:35.550 INFO:journalctl@ceph.osd.0.smithi045.stdout:Sep 15 22:27:35 smithi045 podman[107954]: 2024-09-15 22:27:35.297871755 +0000 UTC m=+0.614019080 container died b7298169424efaa7ac0b1ec315dcb8991d609cae1d58c77f568d470627f11f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-09-15T22:27:35.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.0.service' 2024-09-15T22:27:36.036 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:36.037 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-15T22:27:36.037 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-15T22:27:36.037 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.1 2024-09-15T22:27:36.350 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:36 smithi100 systemd[1]: Stopping Ceph osd.1 for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:27:36.744 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:36 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1[39766]: 2024-09-15T22:27:36.379+0000 7f99c42c7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:36.744 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:36 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1[39766]: 2024-09-15T22:27:36.379+0000 7f99c42c7640 -1 osd.1 106 *** Got signal Terminated *** 2024-09-15T22:27:36.744 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:36 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1[39766]: 2024-09-15T22:27:36.379+0000 7f99c42c7640 -1 osd.1 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:27:42.107 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:41 smithi100 podman[71192]: 2024-09-15 22:27:41.791322448 +0000 UTC m=+5.541298814 container died 3026304882af3c42a3d8792b444d97e833498fa424b7b6eebe83fc5c0a16a7e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e) 2024-09-15T22:27:42.441 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:42 smithi100 podman[71192]: 2024-09-15 22:27:42.205686123 +0000 UTC m=+5.955662489 container cleanup 3026304882af3c42a3d8792b444d97e833498fa424b7b6eebe83fc5c0a16a7e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:27:42.441 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:42 smithi100 bash[71192]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1 2024-09-15T22:27:42.744 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:42 smithi100 podman[71218]: 2024-09-15 22:27:42.44072028 +0000 UTC m=+0.648968810 container remove 3026304882af3c42a3d8792b444d97e833498fa424b7b6eebe83fc5c0a16a7e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-15T22:27:43.161 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:42 smithi100 podman[71308]: 2024-09-15 22:27:42.774884074 +0000 UTC m=+0.015856896 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:27:43.161 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:42 smithi100 podman[71308]: 2024-09-15 22:27:42.908360079 +0000 UTC m=+0.149332900 container create bc1c050d3bc75fe63c0a08ecbcdf76a70c75980a208207f56bf18f9b447a27bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:27:43.494 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:43 smithi100 podman[71308]: 2024-09-15 22:27:43.160892461 +0000 UTC m=+0.401865284 container init bc1c050d3bc75fe63c0a08ecbcdf76a70c75980a208207f56bf18f9b447a27bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-15T22:27:43.494 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:43 smithi100 podman[71308]: 2024-09-15 22:27:43.16462898 +0000 UTC m=+0.405601802 container start bc1c050d3bc75fe63c0a08ecbcdf76a70c75980a208207f56bf18f9b447a27bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-15T22:27:43.495 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:43 smithi100 podman[71308]: 2024-09-15 22:27:43.244316197 +0000 UTC m=+0.485289031 container attach bc1c050d3bc75fe63c0a08ecbcdf76a70c75980a208207f56bf18f9b447a27bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-15T22:27:43.495 INFO:journalctl@ceph.osd.1.smithi100.stdout:Sep 15 22:27:43 smithi100 podman[71308]: 2024-09-15 22:27:43.349043722 +0000 UTC m=+0.590016554 container died bc1c050d3bc75fe63c0a08ecbcdf76a70c75980a208207f56bf18f9b447a27bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-15T22:27:44.018 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.1.service' 2024-09-15T22:27:44.063 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:44.064 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-15T22:27:44.064 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-15T22:27:44.064 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.2 2024-09-15T22:27:44.382 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:44 smithi165 systemd[1]: Stopping Ceph osd.2 for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:27:44.714 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:44 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2[40498]: 2024-09-15T22:27:44.380+0000 7fba1a358640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:44.714 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:44 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2[40498]: 2024-09-15T22:27:44.380+0000 7fba1a358640 -1 osd.2 106 *** Got signal Terminated *** 2024-09-15T22:27:44.714 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:44 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2[40498]: 2024-09-15T22:27:44.380+0000 7fba1a358640 -1 osd.2 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:27:50.141 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:49 smithi165 podman[72358]: 2024-09-15 22:27:49.843376659 +0000 UTC m=+5.581126856 container died 6b5fd80bb3381705e00b96a6524a982b2c37250f663d77981575e4324329fc7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-15T22:27:50.464 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:50 smithi165 podman[72358]: 2024-09-15 22:27:50.238653302 +0000 UTC m=+5.976403498 container cleanup 6b5fd80bb3381705e00b96a6524a982b2c37250f663d77981575e4324329fc7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-15T22:27:50.464 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:50 smithi165 bash[72358]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2 2024-09-15T22:27:50.853 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:50 smithi165 podman[72375]: 2024-09-15 22:27:50.54014519 +0000 UTC m=+0.691209578 container remove 6b5fd80bb3381705e00b96a6524a982b2c37250f663d77981575e4324329fc7c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-15T22:27:51.153 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:50 smithi165 podman[72463]: 2024-09-15 22:27:50.755354148 +0000 UTC m=+0.015685100 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:27:51.153 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:50 smithi165 podman[72463]: 2024-09-15 22:27:50.907584951 +0000 UTC m=+0.167915897 container create b00e8892047bc5d3017c7338e991231e79f135605a08c71017f68ea8e8fa4f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-15T22:27:51.464 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:51 smithi165 podman[72463]: 2024-09-15 22:27:51.152781156 +0000 UTC m=+0.413112110 container init b00e8892047bc5d3017c7338e991231e79f135605a08c71017f68ea8e8fa4f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-15T22:27:51.465 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:51 smithi165 podman[72463]: 2024-09-15 22:27:51.156522205 +0000 UTC m=+0.416853151 container start b00e8892047bc5d3017c7338e991231e79f135605a08c71017f68ea8e8fa4f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:27:51.465 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:51 smithi165 podman[72463]: 2024-09-15 22:27:51.252337627 +0000 UTC m=+0.512668587 container attach b00e8892047bc5d3017c7338e991231e79f135605a08c71017f68ea8e8fa4f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-15T22:27:51.465 INFO:journalctl@ceph.osd.2.smithi165.stdout:Sep 15 22:27:51 smithi165 podman[72463]: 2024-09-15 22:27:51.347975336 +0000 UTC m=+0.608306280 container died b00e8892047bc5d3017c7338e991231e79f135605a08c71017f68ea8e8fa4f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-15T22:27:52.027 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.2.service' 2024-09-15T22:27:52.069 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:27:52.069 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-15T22:27:52.069 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-15T22:27:52.069 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.3 2024-09-15T22:27:52.400 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:52 smithi045 systemd[1]: Stopping Ceph osd.3 for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:27:52.799 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:52 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3[52130]: 2024-09-15T22:27:52.398+0000 7f3e6b47e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:27:52.800 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:52 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3[52130]: 2024-09-15T22:27:52.398+0000 7f3e6b47e640 -1 osd.3 106 *** Got signal Terminated *** 2024-09-15T22:27:52.800 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:52 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3[52130]: 2024-09-15T22:27:52.398+0000 7f3e6b47e640 -1 osd.3 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:27:54.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:27:54 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:27:54.474+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:27:55.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:27:55 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:27:55.341+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:27:55.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:27:55 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:27:55.489+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:27:56.464 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:27:56 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:27:56.063+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:27:56.465 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:27:56 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:27:56.110+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:27:56.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:27:56 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:27:56.392+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:27:56.799 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:27:56 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:27:56.369+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:27:56.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:27:56 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:27:56.500+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:27:57.464 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:27:57 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:27:57.017+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:27:57.465 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:27:57 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:27:57.157+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:27:57.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:27:57 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:27:57.376+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:27:57.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:27:57 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:27:57.403+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:27:57.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:27:57 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:27:57.498+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:27:58.125 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:57 smithi045 podman[108060]: 2024-09-15 22:27:57.847132736 +0000 UTC m=+5.567667485 container died b54e5ad1c735145bf5184523b4b4703de04bdf4143c752377921692ec8aaabba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-15T22:27:58.456 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:58 smithi045 podman[108060]: 2024-09-15 22:27:58.348917128 +0000 UTC m=+6.069451875 container cleanup b54e5ad1c735145bf5184523b4b4703de04bdf4143c752377921692ec8aaabba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:27:58.456 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:58 smithi045 bash[108060]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3 2024-09-15T22:27:58.464 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:27:58 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:27:58.205+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:27:58.465 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:27:57 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:27:57.994+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:27:58.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:27:58 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:27:58.381+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:27:58.799 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:58 smithi045 podman[108075]: 2024-09-15 22:27:58.583849577 +0000 UTC m=+0.731688707 container remove b54e5ad1c735145bf5184523b4b4703de04bdf4143c752377921692ec8aaabba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-15T22:27:58.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:27:58 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:27:58.454+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:27:58.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:27:58 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:27:58.502+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:27:59.179 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:58 smithi045 podman[108165]: 2024-09-15 22:27:58.828513118 +0000 UTC m=+0.016514936 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:27:59.179 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:58 smithi045 podman[108165]: 2024-09-15 22:27:58.959626015 +0000 UTC m=+0.147627820 container create 22b48d3913f5ec6850e848becaf180aac617db9ff5710ee9ff0e5b912054277c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-15T22:27:59.454 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:27:59 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:27:59.204+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:27:59.454 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:27:59 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:27:59.014+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:27:59.550 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:27:59 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:27:59.413+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:27:59.550 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:59 smithi045 podman[108165]: 2024-09-15 22:27:59.178853645 +0000 UTC m=+0.366855452 container init 22b48d3913f5ec6850e848becaf180aac617db9ff5710ee9ff0e5b912054277c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:27:59.550 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:59 smithi045 podman[108165]: 2024-09-15 22:27:59.182268314 +0000 UTC m=+0.370270125 container start 22b48d3913f5ec6850e848becaf180aac617db9ff5710ee9ff0e5b912054277c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-15T22:27:59.550 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:59 smithi045 podman[108165]: 2024-09-15 22:27:59.28711754 +0000 UTC m=+0.475119358 container attach 22b48d3913f5ec6850e848becaf180aac617db9ff5710ee9ff0e5b912054277c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-15T22:27:59.551 INFO:journalctl@ceph.osd.3.smithi045.stdout:Sep 15 22:27:59 smithi045 podman[108165]: 2024-09-15 22:27:59.376834524 +0000 UTC m=+0.564836340 container died 22b48d3913f5ec6850e848becaf180aac617db9ff5710ee9ff0e5b912054277c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T22:27:59.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:27:59 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:27:59.452+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:27:59.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:27:59 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:27:59.364+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:00.035 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.3.service' 2024-09-15T22:28:00.080 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:00.080 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-15T22:28:00.081 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-15T22:28:00.081 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.4 2024-09-15T22:28:00.359 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:00 smithi100 systemd[1]: Stopping Ceph osd.4 for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:28:00.464 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:00 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:00.055+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:00.465 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:00 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:00.211+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:00.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:00 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:00.357+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:00.744 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:00 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4[46686]: 2024-09-15T22:28:00.401+0000 7fb658874640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:28:00.744 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:00 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4[46686]: 2024-09-15T22:28:00.401+0000 7fb658874640 -1 osd.4 106 *** Got signal Terminated *** 2024-09-15T22:28:00.744 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:00 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4[46686]: 2024-09-15T22:28:00.401+0000 7fb658874640 -1 osd.4 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:28:00.799 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:00 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:00.413+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:00.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:00 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:00.495+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:01.464 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:01 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:01.018+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:01.465 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:01 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:01.184+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:01.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:01 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:01.361+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:01.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:01 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:01.425+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:01.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:01 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:01.540+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:02.464 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:02 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:02.038+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:02.465 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:02 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:02.214+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:02.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:02 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:02.395+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:02.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:02 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:02.395+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:02.799 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:02 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:02.430+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:02.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:02 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:02.508+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:03.264 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:03 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:03.009+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:03.494 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:03 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4[46686]: 2024-09-15T22:28:03.237+0000 7fb650e82640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:38.413074+0000 front 2024-09-15T22:27:38.413108+0000 (oldest deadline 2024-09-15T22:28:02.513257+0000) 2024-09-15T22:28:03.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:03 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:03.394+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:03.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:03 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:03.394+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:03.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:03 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:03.464+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:03.714 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:03 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:03.263+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:03.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:03 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:03.263+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:03.799 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:03 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:03.443+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:03.799 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:03 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:03.443+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:04.272 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:04 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:04.007+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:04.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:04 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:04.444+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:04.714 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:04 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:04.271+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:04.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:04 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:04.271+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:04.744 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:04 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4[46686]: 2024-09-15T22:28:04.257+0000 7fb650e82640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:38.413074+0000 front 2024-09-15T22:27:38.413108+0000 (oldest deadline 2024-09-15T22:28:02.513257+0000) 2024-09-15T22:28:04.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:04 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:04.382+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:04.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:04 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:04.382+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:04.799 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:04 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:04.460+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:04.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:04 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:04.460+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:05.433 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:05 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:05.006+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:05.433 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:05 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:05.006+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.362697+0000 front 2024-09-15T22:27:37.362806+0000 (oldest deadline 2024-09-15T22:28:04.363070+0000) 2024-09-15T22:28:05.433 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:05 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:05.238+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:05.433 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:05 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:05.238+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:05.494 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:05 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4[46686]: 2024-09-15T22:28:05.213+0000 7fb650e82640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:38.413074+0000 front 2024-09-15T22:27:38.413108+0000 (oldest deadline 2024-09-15T22:28:02.513257+0000) 2024-09-15T22:28:05.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:05 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:05.338+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:05.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:05 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:05.338+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:05.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:05 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:05.431+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:05.799 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:05 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:05.418+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:05.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:05 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:05.418+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:06.201 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:05 smithi100 podman[71413]: 2024-09-15 22:28:05.88668327 +0000 UTC m=+5.619150582 container died 06fbd92708cee6a3263179cdaa7fda4f1adf5296b8d421a7d25d60ade18b6ed8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=) 2024-09-15T22:28:06.265 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:05 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:05.970+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:06.265 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:05 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:05.970+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.362697+0000 front 2024-09-15T22:27:37.362806+0000 (oldest deadline 2024-09-15T22:28:04.363070+0000) 2024-09-15T22:28:06.494 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:06 smithi100 podman[71413]: 2024-09-15 22:28:06.30068026 +0000 UTC m=+6.033147562 container cleanup 06fbd92708cee6a3263179cdaa7fda4f1adf5296b8d421a7d25d60ade18b6ed8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-15T22:28:06.494 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:06 smithi100 bash[71413]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4 2024-09-15T22:28:06.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:06 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:06.322+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:06.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:06 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:06.322+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:06.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:06 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:06.406+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:06.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:06 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:06.264+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:06.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:06 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:06.264+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:06.799 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:06 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:06.460+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:06.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:06 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:06.460+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:06.968 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:06 smithi100 podman[71429]: 2024-09-15 22:28:06.535767438 +0000 UTC m=+0.645524069 container remove 06fbd92708cee6a3263179cdaa7fda4f1adf5296b8d421a7d25d60ade18b6ed8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-15T22:28:07.231 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:06 smithi100 podman[71518]: 2024-09-15 22:28:06.870199107 +0000 UTC m=+0.015917481 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:28:07.231 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:06 smithi100 podman[71518]: 2024-09-15 22:28:06.986605657 +0000 UTC m=+0.132324073 container create 20a1835175d66529c59b34c561c0318a60871bc453f768194bdc7426c9b587f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:28:07.231 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:07 smithi100 podman[71518]: 2024-09-15 22:28:07.23072609 +0000 UTC m=+0.376444466 container init 20a1835175d66529c59b34c561c0318a60871bc453f768194bdc7426c9b587f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2) 2024-09-15T22:28:07.302 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:07 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:07.015+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:07.302 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:07 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:07.015+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.362697+0000 front 2024-09-15T22:27:37.362806+0000 (oldest deadline 2024-09-15T22:28:04.363070+0000) 2024-09-15T22:28:07.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:07 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:07.283+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:07.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:07 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:07.333+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:07.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:07 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:07.333+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:07.495 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:07 smithi100 podman[71518]: 2024-09-15 22:28:07.234156365 +0000 UTC m=+0.379874739 container start 20a1835175d66529c59b34c561c0318a60871bc453f768194bdc7426c9b587f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True) 2024-09-15T22:28:07.495 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:07 smithi100 podman[71518]: 2024-09-15 22:28:07.305661084 +0000 UTC m=+0.451379475 container attach 20a1835175d66529c59b34c561c0318a60871bc453f768194bdc7426c9b587f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True) 2024-09-15T22:28:07.495 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:07 smithi100 podman[71518]: 2024-09-15 22:28:07.421426735 +0000 UTC m=+0.567145107 container died 20a1835175d66529c59b34c561c0318a60871bc453f768194bdc7426c9b587f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-15T22:28:07.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:07 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:07.363+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:07.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:07 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:07.301+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:07.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:07 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:07.301+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:07.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:07 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:07.509+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:07.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:07 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:07.509+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:07.800 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:07 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:07.613+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:07.978 INFO:journalctl@ceph.osd.4.smithi100.stdout:Sep 15 22:28:07 smithi100 podman[71541]: 2024-09-15 22:28:07.967521111 +0000 UTC m=+0.539470297 container remove 20a1835175d66529c59b34c561c0318a60871bc453f768194bdc7426c9b587f1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-15T22:28:07.984 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.4.service' 2024-09-15T22:28:08.023 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:08.023 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-15T22:28:08.023 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-15T22:28:08.023 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.5 2024-09-15T22:28:08.333 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:08 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:08.048+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:08.333 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:08 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:08.048+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.362697+0000 front 2024-09-15T22:27:37.362806+0000 (oldest deadline 2024-09-15T22:28:04.363070+0000) 2024-09-15T22:28:08.333 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:08 smithi165 systemd[1]: Stopping Ceph osd.5 for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:28:08.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:08 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:08.345+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:08.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:08 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:08.331+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:08.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:08 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:08.331+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:08.715 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:08 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:08.353+0000 7f128aab0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:28:08.715 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:08 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:08.353+0000 7f128aab0640 -1 osd.5 106 *** Got signal Terminated *** 2024-09-15T22:28:08.715 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:08 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:08.353+0000 7f128aab0640 -1 osd.5 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:28:08.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:08 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:08.256+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:08.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:08 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:08.340+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:08.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:08 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:08.340+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:08.799 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:08 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:08.596+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:08.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:08 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:08.541+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:08.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:08 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:08.541+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:09.366 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:09 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:09.033+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:09.366 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:09 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:09.033+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.362697+0000 front 2024-09-15T22:27:37.362806+0000 (oldest deadline 2024-09-15T22:28:04.363070+0000) 2024-09-15T22:28:09.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:09 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:09.382+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:09.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:09 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:09.365+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:09.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:09 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:09.365+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:09.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:09 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:09.278+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:09.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:09 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:09.297+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:09.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:09 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:09.297+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:09.799 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:09 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:09.567+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:09.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:09 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:09.543+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:09.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:09 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:09.543+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:10.363 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:10 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:10.082+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:10.363 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:10 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:10.082+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.362697+0000 front 2024-09-15T22:27:37.362806+0000 (oldest deadline 2024-09-15T22:28:04.363070+0000) 2024-09-15T22:28:10.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:10 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:10.362+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:10.714 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:10 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:10.385+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:10.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:10 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:10.385+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:10.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:10 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:10.268+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:10.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:10 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:10.268+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:10.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:10 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:10.272+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:10.800 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:10 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:10.609+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:10.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:10 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:10.546+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:10.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:10 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:10.546+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:11.390 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:11 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:11.050+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:11.390 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:11 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:11.050+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.362697+0000 front 2024-09-15T22:27:37.362806+0000 (oldest deadline 2024-09-15T22:28:04.363070+0000) 2024-09-15T22:28:11.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:11 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:11.230+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:11.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:11 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:11.236+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:11.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:11 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:11.236+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:11.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:11 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:11.410+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:11.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:11 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:11.389+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:11.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:11 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:11.389+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:11.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:11 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:11.389+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:11.800 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:11 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:11.612+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:11.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:11 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:11.551+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:11.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:11 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:11.551+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:12.363 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:12.076+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:12.364 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:12.076+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.362697+0000 front 2024-09-15T22:27:37.362806+0000 (oldest deadline 2024-09-15T22:28:04.363070+0000) 2024-09-15T22:28:12.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:12 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:12.201+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:12.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:12 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:12.243+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:12.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:12 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:12.243+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:12.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:12.430+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:12.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:12.362+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:12.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:12.362+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:12.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:12 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:12.362+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:12.801 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:12.505+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:12.801 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:12.505+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:12.801 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:12.603+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:12.801 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:12.603+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.864395+0000 front 2024-09-15T22:27:46.864378+0000 (oldest deadline 2024-09-15T22:28:12.164118+0000) 2024-09-15T22:28:13.355 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:13.074+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.761491+0000 front 2024-09-15T22:27:32.761460+0000 (oldest deadline 2024-09-15T22:27:55.661545+0000) 2024-09-15T22:28:13.355 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5[47399]: 2024-09-15T22:28:13.074+0000 7f12830be640 -1 osd.5 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.362697+0000 front 2024-09-15T22:27:37.362806+0000 (oldest deadline 2024-09-15T22:28:04.363070+0000) 2024-09-15T22:28:13.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:13 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:13.174+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:13.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:13 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:13.174+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:13.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:13 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:13.215+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:13.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:13 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:13.215+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:13.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:13.473+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:13.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:13.473+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:13.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:13.353+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:13.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:13.353+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:13.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:13 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:13.353+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:13.799 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:13.580+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:13.799 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:13.580+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.864395+0000 front 2024-09-15T22:27:46.864378+0000 (oldest deadline 2024-09-15T22:28:12.164118+0000) 2024-09-15T22:28:13.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:13.528+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:13.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:13.528+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:13.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:13 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:13.528+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:14.196 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:13 smithi165 podman[72579]: 2024-09-15 22:28:13.895754345 +0000 UTC m=+5.677924369 container died bdcaa3e2c7ddae1a1705f630ba21d276b28c2c8796e83442b9319fc5d80886e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e) 2024-09-15T22:28:14.464 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:14 smithi165 podman[72579]: 2024-09-15 22:28:14.285647397 +0000 UTC m=+6.067817419 container cleanup bdcaa3e2c7ddae1a1705f630ba21d276b28c2c8796e83442b9319fc5d80886e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:28:14.464 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:14 smithi165 bash[72579]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5 2024-09-15T22:28:14.465 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:14 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:14.323+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:14.465 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:14 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:14.323+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:14.465 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:14 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:14.323+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:14.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:14 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:14.167+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:14.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:14 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:14.167+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:14.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:14 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:14.245+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:14.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:14 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:14.245+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:14.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:14 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:14.245+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:14.800 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:14 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:14.534+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:14.800 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:14 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:14.534+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.864395+0000 front 2024-09-15T22:27:46.864378+0000 (oldest deadline 2024-09-15T22:28:12.164118+0000) 2024-09-15T22:28:14.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:14 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:14.547+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:14.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:14 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:14.547+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:14.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:14 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:14.547+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:14.905 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:14 smithi165 podman[72594]: 2024-09-15 22:28:14.562249005 +0000 UTC m=+0.668049979 container remove bdcaa3e2c7ddae1a1705f630ba21d276b28c2c8796e83442b9319fc5d80886e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-15T22:28:14.905 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:14 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:14.513+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:14.905 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:14 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:14.513+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:15.158 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:14 smithi165 podman[72687]: 2024-09-15 22:28:14.904769557 +0000 UTC m=+0.107787422 container create 6ce45777759e03a777429e4f4e7ef50418aee961f402eebe397bb6af8162eaba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-15T22:28:15.158 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:14 smithi165 podman[72687]: 2024-09-15 22:28:14.81323478 +0000 UTC m=+0.016252657 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:28:15.465 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:15.275+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:15.465 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:15.275+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:15.465 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:15.275+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:15.466 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:15 smithi165 podman[72687]: 2024-09-15 22:28:15.157707452 +0000 UTC m=+0.360725320 container init 6ce45777759e03a777429e4f4e7ef50418aee961f402eebe397bb6af8162eaba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-15T22:28:15.466 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:15 smithi165 podman[72687]: 2024-09-15 22:28:15.161264457 +0000 UTC m=+0.364282333 container start 6ce45777759e03a777429e4f4e7ef50418aee961f402eebe397bb6af8162eaba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-15T22:28:15.466 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:15 smithi165 podman[72687]: 2024-09-15 22:28:15.291391432 +0000 UTC m=+0.494409299 container attach 6ce45777759e03a777429e4f4e7ef50418aee961f402eebe397bb6af8162eaba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:28:15.466 INFO:journalctl@ceph.osd.5.smithi165.stdout:Sep 15 22:28:15 smithi165 podman[72687]: 2024-09-15 22:28:15.355836615 +0000 UTC m=+0.558854493 container died 6ce45777759e03a777429e4f4e7ef50418aee961f402eebe397bb6af8162eaba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:28:15.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:15.188+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:15.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:15.188+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:15.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:15.236+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:15.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:15.236+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:15.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:15 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:15.236+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:15.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:15.498+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:15.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:15 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:15.498+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:16.031 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.5.service' 2024-09-15T22:28:16.050 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:15 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:15.559+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:16.050 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:15 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:15.559+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.864395+0000 front 2024-09-15T22:27:46.864378+0000 (oldest deadline 2024-09-15T22:28:12.164118+0000) 2024-09-15T22:28:16.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:15 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:15.582+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:16.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:15 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:15.582+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:16.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:15 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:15.582+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:16.070 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:16.070 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-15T22:28:16.070 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-15T22:28:16.071 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.6 2024-09-15T22:28:16.397 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:16 smithi045 systemd[1]: Stopping Ceph osd.6 for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:28:16.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:16 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:16.214+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:16.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:16 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:16.214+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:16.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:16 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:16.279+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:16.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:16 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:16.279+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:16.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:16 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:16.279+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:16.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:16.460+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:16.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:16.460+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:16.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:16.317+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:16.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:16.317+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:16.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:16 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:16.317+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:16.800 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:16.395+0000 7fe9c82ad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:28:16.800 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:16.395+0000 7fe9c82ad640 -1 osd.6 106 *** Got signal Terminated *** 2024-09-15T22:28:16.800 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:16.395+0000 7fe9c82ad640 -1 osd.6 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:28:16.800 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:16.555+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:16.800 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:16.555+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.864395+0000 front 2024-09-15T22:27:46.864378+0000 (oldest deadline 2024-09-15T22:28:12.164118+0000) 2024-09-15T22:28:16.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:16.594+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:16.801 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:16.594+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:16.801 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:16 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:16.594+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:17.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:17 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:17.211+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:17.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:17 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:17.211+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:17.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:17 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:17.311+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:17.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:17 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:17.311+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:17.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:17 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:17.311+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:17.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:17 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:17.422+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:17.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:17 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:17.422+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:17.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:17 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:17.330+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:17.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:17 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:17.330+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:17.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:17 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:17.330+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:17.799 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:17.525+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:17.800 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:17.525+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.864395+0000 front 2024-09-15T22:27:46.864378+0000 (oldest deadline 2024-09-15T22:28:12.164118+0000) 2024-09-15T22:28:17.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:17.620+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:17.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:17.620+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:17.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:17.620+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:18.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:18.242+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:18.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:18.242+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:18.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:18.294+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:18.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:18.294+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:18.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:18 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:18.294+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:18.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:18 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:18.430+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:18.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:18 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:18.430+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:18.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:18 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:18.287+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:18.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:18 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:18.287+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:18.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:18 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:18.287+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:18.800 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:18 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:18.545+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:18.800 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:18 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:18.545+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.864395+0000 front 2024-09-15T22:27:46.864378+0000 (oldest deadline 2024-09-15T22:28:12.164118+0000) 2024-09-15T22:28:18.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:18 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:18.573+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:18.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:18 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:18.573+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:18.800 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:18 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:18.573+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:19.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:19 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:19.443+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:19.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:19 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:19.443+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:19.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:19 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:19.263+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:19.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:19 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:19.263+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:19.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:19 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:19.263+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:19.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:19 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:19.257+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:19.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:19 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:19.257+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:19.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:19 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:19.257+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:52.467016+0000 front 2024-09-15T22:27:52.467037+0000 (oldest deadline 2024-09-15T22:28:18.366962+0000) 2024-09-15T22:28:19.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:19 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:19.286+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:19.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:19 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:19.286+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:19.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:19 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:19.286+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:20.049 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:19 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:19.580+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:20.050 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:19 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:19.580+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.864395+0000 front 2024-09-15T22:27:46.864378+0000 (oldest deadline 2024-09-15T22:28:12.164118+0000) 2024-09-15T22:28:20.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:19 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:19.580+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:20.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:19 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:19.580+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:20.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:19 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:19.580+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:20.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:20 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:20.483+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:20.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:20 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:20.483+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:20.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:20 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:20.483+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:20.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:20 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:20.246+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:20.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:20 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:20.246+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:20.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:20 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:20.246+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:20.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:20 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:20.261+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:20.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:20 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:20.261+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:20.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:20 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:20.261+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:52.467016+0000 front 2024-09-15T22:27:52.467037+0000 (oldest deadline 2024-09-15T22:28:18.366962+0000) 2024-09-15T22:28:20.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:20 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:20.314+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:20.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:20 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:20.314+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:20.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:20 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:20.314+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:21.050 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:20.563+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.963632+0000 front 2024-09-15T22:27:40.963651+0000 (oldest deadline 2024-09-15T22:28:06.863608+0000) 2024-09-15T22:28:21.050 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:20.563+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.864395+0000 front 2024-09-15T22:27:46.864378+0000 (oldest deadline 2024-09-15T22:28:12.164118+0000) 2024-09-15T22:28:21.050 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6[58861]: 2024-09-15T22:28:20.563+0000 7fe9c08bb640 -1 osd.6 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:55.665185+0000 front 2024-09-15T22:27:55.665133+0000 (oldest deadline 2024-09-15T22:28:19.765314+0000) 2024-09-15T22:28:21.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:20.629+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:21.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:20.629+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:21.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:20.629+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:21.051 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:20 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:20.629+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:21.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:21 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:21.241+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:21.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:21 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:21.241+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:21.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:21 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:21.241+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:52.467016+0000 front 2024-09-15T22:27:52.467037+0000 (oldest deadline 2024-09-15T22:28:18.366962+0000) 2024-09-15T22:28:21.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:21 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:21.278+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:21.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:21 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:21.278+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:21.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:21 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:21.278+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:21.525 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:21 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:21.224+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:21.525 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:21 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:21.224+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:21.526 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:21 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:21.224+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:21.941 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:21 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:21.654+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:21.942 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:21 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:21.654+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:21.942 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:21 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:21.654+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:21.942 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:21 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:21.654+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:21.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:21 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:21.523+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:21.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:21 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:21.523+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:21.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:21 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:21.523+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:22.247 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:21 smithi045 podman[108279]: 2024-09-15 22:28:21.940687287 +0000 UTC m=+5.664892517 container died 82361f1c7750af7201356ccf820a7269c90ebbb23635c8a827c5ae7463da6be7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-15T22:28:22.508 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:22 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:22.238+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:22.508 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:22 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:22.238+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:22.508 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:22 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:22.238+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:22.549 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:22 smithi045 podman[108279]: 2024-09-15 22:28:22.446334334 +0000 UTC m=+6.170539561 container cleanup 82361f1c7750af7201356ccf820a7269c90ebbb23635c8a827c5ae7463da6be7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:28:22.550 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:22 smithi045 bash[108279]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6 2024-09-15T22:28:22.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:22 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:22.280+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:22.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:22 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:22.280+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:22.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:22 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:22.280+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:52.467016+0000 front 2024-09-15T22:27:52.467037+0000 (oldest deadline 2024-09-15T22:28:18.366962+0000) 2024-09-15T22:28:22.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:22 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:22.277+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:22.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:22 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:22.277+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:22.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:22 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:22.277+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:22.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:22 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:22.277+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:22.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:22 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:22.506+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:22.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:22 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:22.506+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:22.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:22 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:22.506+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:23.034 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:22 smithi045 podman[108296]: 2024-09-15 22:28:22.689452549 +0000 UTC m=+0.738784451 container remove 82361f1c7750af7201356ccf820a7269c90ebbb23635c8a827c5ae7463da6be7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-15T22:28:23.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:22 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:22.673+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:23.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:22 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:22.673+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:23.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:22 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:22.673+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:23.034 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:22 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:22.673+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:23.293 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:23 smithi045 podman[108382]: 2024-09-15 22:28:22.935953511 +0000 UTC m=+0.016225613 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:28:23.294 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:23 smithi045 podman[108382]: 2024-09-15 22:28:23.065296125 +0000 UTC m=+0.145568253 container create e30a4bebb7fbb2d496a23dd101c653823d90f208d30621e7be64e1f30aad2dfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e) 2024-09-15T22:28:23.545 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:23 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:23.246+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:23.545 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:23 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:23.246+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:23.546 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:23 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:23.246+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:23.550 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:23 smithi045 podman[108382]: 2024-09-15 22:28:23.29276119 +0000 UTC m=+0.373033284 container init e30a4bebb7fbb2d496a23dd101c653823d90f208d30621e7be64e1f30aad2dfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-15T22:28:23.550 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:23 smithi045 podman[108382]: 2024-09-15 22:28:23.296343776 +0000 UTC m=+0.376615864 container start e30a4bebb7fbb2d496a23dd101c653823d90f208d30621e7be64e1f30aad2dfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-15T22:28:23.550 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:23 smithi045 podman[108382]: 2024-09-15 22:28:23.392838169 +0000 UTC m=+0.473110265 container attach e30a4bebb7fbb2d496a23dd101c653823d90f208d30621e7be64e1f30aad2dfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:28:23.550 INFO:journalctl@ceph.osd.6.smithi045.stdout:Sep 15 22:28:23 smithi045 podman[108382]: 2024-09-15 22:28:23.491447706 +0000 UTC m=+0.571719796 container died e30a4bebb7fbb2d496a23dd101c653823d90f208d30621e7be64e1f30aad2dfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True) 2024-09-15T22:28:23.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:23 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:23.265+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:23.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:23 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:23.265+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:23.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:23 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:23.265+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:52.467016+0000 front 2024-09-15T22:27:52.467037+0000 (oldest deadline 2024-09-15T22:28:18.366962+0000) 2024-09-15T22:28:23.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:23 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:23.248+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:23.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:23 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:23.248+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:23.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:23 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:23.248+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:23.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:23 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:23.248+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:23.946 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:23 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:23.685+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:23.947 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:23 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:23.685+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:23.947 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:23 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:23.685+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:23.947 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:23 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:23.685+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:23.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:23 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:23.543+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:23.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:23 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:23.543+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:23.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:23 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:23.543+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:24.252 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.6.service' 2024-09-15T22:28:24.299 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:24.300 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-15T22:28:24.300 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-15T22:28:24.300 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.7 2024-09-15T22:28:24.464 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:24 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:24.200+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:24.465 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:24 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:24.200+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:24.465 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:24 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:24.200+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:24.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:24 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:24.291+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:24.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:24 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:24.291+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:24.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:24 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:24.291+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:52.467016+0000 front 2024-09-15T22:27:52.467037+0000 (oldest deadline 2024-09-15T22:28:18.366962+0000) 2024-09-15T22:28:24.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:24 smithi100 systemd[1]: Stopping Ceph osd.7 for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:28:24.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:24 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:24.226+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:24.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:24 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:24.226+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:24.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:24 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:24.226+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:24.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:24 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:24.226+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:24.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:24 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:24.544+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:24.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:24 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:24.544+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:24.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:24 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:24.544+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:24.994 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:24 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:24.619+0000 7f1122f69640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:28:24.994 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:24 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:24.619+0000 7f1122f69640 -1 osd.7 106 *** Got signal Terminated *** 2024-09-15T22:28:24.994 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:24 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:24.619+0000 7f1122f69640 -1 osd.7 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:28:25.049 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:24 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:24.711+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:25.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:24 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:24.711+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:25.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:24 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:24.711+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:25.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:24 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:24.711+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:25.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:25 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:25.280+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:25.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:25 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:25.280+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:25.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:25 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:25.280+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:52.467016+0000 front 2024-09-15T22:27:52.467037+0000 (oldest deadline 2024-09-15T22:28:18.366962+0000) 2024-09-15T22:28:25.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:25 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:25.190+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:25.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:25 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:25.190+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:25.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:25 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:25.190+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:25.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:25 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:25.190+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:25.551 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:25 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:25.220+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:25.551 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:25 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:25.220+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:25.552 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:25 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:25.220+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:25.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:25 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:25.550+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:25.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:25 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:25.550+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:25.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:25 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:25.550+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:26.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:25 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:25.672+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:26.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:25 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:25.672+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:26.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:25 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:25.672+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:26.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:25 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:25.672+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:26.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:26 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:26.269+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:26.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:26 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:26.269+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:26.494 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:26 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:26.269+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:52.467016+0000 front 2024-09-15T22:27:52.467037+0000 (oldest deadline 2024-09-15T22:28:18.366962+0000) 2024-09-15T22:28:26.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:26 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:26.239+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:26.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:26 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:26.239+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:26.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:26 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:26.239+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:26.495 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:26 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:26.239+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:26.542 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:26 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:26.236+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:26.542 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:26 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:26.236+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:26.543 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:26 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:26.236+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:26.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:26 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:26.540+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:26.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:26 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:26.540+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:26.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:26 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:26.540+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:27.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:26 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:26.674+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:27.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:26 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:26.674+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:27.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:26 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:26.674+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:27.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:26 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:26.674+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:27.585 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:27 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:27.273+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:27.585 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:27 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:27.273+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:27.586 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:27 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:27.273+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:27.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:27 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:27.318+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:27.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:27 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:27.318+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:27.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:27 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:27.318+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:52.467016+0000 front 2024-09-15T22:27:52.467037+0000 (oldest deadline 2024-09-15T22:28:18.366962+0000) 2024-09-15T22:28:27.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:27 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:27.318+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.568338+0000 front 2024-09-15T22:28:03.568404+0000 (oldest deadline 2024-09-15T22:28:27.068370+0000) 2024-09-15T22:28:27.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:27 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:27.261+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:27.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:27 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:27.261+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:27.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:27 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:27.261+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:27.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:27 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:27.261+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:27.857 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:27 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:27.584+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:27.857 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:27 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:27.584+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:27.857 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:27 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:27.584+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:28.049 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:27 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:27.669+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:28.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:27 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:27.669+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:28.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:27 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:27.669+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:28.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:27 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:27.669+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:28.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:28 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:28.549+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:28.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:28 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:28.549+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:28.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:28 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:28.549+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:28.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:28 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:28.549+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.140979+0000 front 2024-09-15T22:28:05.141085+0000 (oldest deadline 2024-09-15T22:28:28.040875+0000) 2024-09-15T22:28:28.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:28 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:28.313+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:28.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:28 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:28.313+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:28.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:28 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:28.313+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:28.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:28 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:28.353+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:28.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:28 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:28.353+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:28.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:28 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:28.353+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:52.467016+0000 front 2024-09-15T22:27:52.467037+0000 (oldest deadline 2024-09-15T22:28:18.366962+0000) 2024-09-15T22:28:28.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:28 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:28.353+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.568338+0000 front 2024-09-15T22:28:03.568404+0000 (oldest deadline 2024-09-15T22:28:27.068370+0000) 2024-09-15T22:28:28.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:28 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:28.265+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:28.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:28 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:28.265+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:28.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:28 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:28.265+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:28.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:28 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:28.265+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:28.951 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:28 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:28.689+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:28.951 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:28 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:28.689+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:28.951 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:28 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:28.689+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:28.951 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:28 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:28.689+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:28.951 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:28 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:28.689+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:29.578 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:29 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:29.301+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:29.578 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:29 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:29.301+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:29.579 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:29 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:29.301+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:29.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:29 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:29.359+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.665524+0000 front 2024-09-15T22:27:40.665724+0000 (oldest deadline 2024-09-15T22:28:06.565736+0000) 2024-09-15T22:28:29.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:29 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:29.359+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.566386+0000 front 2024-09-15T22:27:46.566444+0000 (oldest deadline 2024-09-15T22:28:12.466452+0000) 2024-09-15T22:28:29.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:29 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:29.359+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:52.467016+0000 front 2024-09-15T22:27:52.467037+0000 (oldest deadline 2024-09-15T22:28:18.366962+0000) 2024-09-15T22:28:29.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:29 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7[53187]: 2024-09-15T22:28:29.359+0000 7f111f57f640 -1 osd.7 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.568338+0000 front 2024-09-15T22:28:03.568404+0000 (oldest deadline 2024-09-15T22:28:27.068370+0000) 2024-09-15T22:28:29.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:29 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:29.253+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:29.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:29 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:29.253+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:29.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:29 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:29.253+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:29.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:29 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:29.253+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:29.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:29 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:29.253+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:29.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:29 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:29.577+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:29.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:29 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:29.577+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:29.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:29 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:29.577+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:29.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:29 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:29.577+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.140979+0000 front 2024-09-15T22:28:05.141085+0000 (oldest deadline 2024-09-15T22:28:28.040875+0000) 2024-09-15T22:28:30.049 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:29 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:29.699+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:30.049 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:29 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:29.699+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:30.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:29 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:29.699+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:30.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:29 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:29.699+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:30.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:29 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:29.699+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:30.337 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:30 smithi100 podman[71621]: 2024-09-15 22:28:30.020377047 +0000 UTC m=+5.524140544 container died 04c27f113d009d51d7025e4cf7b23edcb0622450fd831fe7029e711c0ae98af3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:28:30.338 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:30 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:30.220+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:30.338 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:30 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:30.220+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:30.338 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:30 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:30.220+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:30.338 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:30 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:30.220+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:30.338 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:30 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:30.220+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:30.547 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:30 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:30.263+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:30.548 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:30 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:30.263+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:30.548 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:30 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:30.263+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:30.663 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:30 smithi100 podman[71621]: 2024-09-15 22:28:30.436191059 +0000 UTC m=+5.939954551 container cleanup 04c27f113d009d51d7025e4cf7b23edcb0622450fd831fe7029e711c0ae98af3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-15T22:28:30.663 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:30 smithi100 bash[71621]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7 2024-09-15T22:28:30.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:30 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:30.545+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:30.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:30 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:30.545+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:30.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:30 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:30.545+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:30.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:30 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:30.545+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.140979+0000 front 2024-09-15T22:28:05.141085+0000 (oldest deadline 2024-09-15T22:28:28.040875+0000) 2024-09-15T22:28:30.994 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:30 smithi100 podman[71637]: 2024-09-15 22:28:30.662412506 +0000 UTC m=+0.642988220 container remove 04c27f113d009d51d7025e4cf7b23edcb0622450fd831fe7029e711c0ae98af3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-15T22:28:31.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:30 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:30.671+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:31.052 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:30 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:30.671+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:31.052 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:30 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:30.671+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:31.052 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:30 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:30.671+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:31.052 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:30 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:30.671+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:31.383 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:31 smithi100 podman[71723]: 2024-09-15 22:28:31.005572685 +0000 UTC m=+0.015978836 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:28:31.383 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:31 smithi100 podman[71723]: 2024-09-15 22:28:31.129860641 +0000 UTC m=+0.140266786 container create 74f93933698f8d3085675e93eaefe733cdfaaeaf4342b7b29854bfda52ce521c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:28:31.383 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:31 smithi100 podman[71723]: 2024-09-15 22:28:31.382568685 +0000 UTC m=+0.392974829 container init 74f93933698f8d3085675e93eaefe733cdfaaeaf4342b7b29854bfda52ce521c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:28:31.383 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:31 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:31.240+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:31.383 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:31 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:31.240+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:31.384 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:31 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:31.240+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:31.384 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:31 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:31.240+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:31.384 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:31 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:31.240+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:31.548 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:31 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:31.268+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:31.548 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:31 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:31.268+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:31.548 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:31 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:31.268+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:31.548 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:31 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:31.268+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:31.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:31 smithi100 podman[71723]: 2024-09-15 22:28:31.38613822 +0000 UTC m=+0.396544367 container start 74f93933698f8d3085675e93eaefe733cdfaaeaf4342b7b29854bfda52ce521c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e) 2024-09-15T22:28:31.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:31 smithi100 podman[71723]: 2024-09-15 22:28:31.491020629 +0000 UTC m=+0.501426787 container attach 74f93933698f8d3085675e93eaefe733cdfaaeaf4342b7b29854bfda52ce521c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-15T22:28:31.744 INFO:journalctl@ceph.osd.7.smithi100.stdout:Sep 15 22:28:31 smithi100 podman[71723]: 2024-09-15 22:28:31.574543421 +0000 UTC m=+0.584949576 container died 74f93933698f8d3085675e93eaefe733cdfaaeaf4342b7b29854bfda52ce521c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-15T22:28:31.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:31 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:31.546+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:31.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:31 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:31.546+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:31.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:31 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:31.546+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:31.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:31 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:31.546+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.140979+0000 front 2024-09-15T22:28:05.141085+0000 (oldest deadline 2024-09-15T22:28:28.040875+0000) 2024-09-15T22:28:32.049 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:31 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:31.656+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:32.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:31 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:31.656+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:32.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:31 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:31.656+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:32.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:31 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:31.656+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:32.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:31 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:31.656+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:32.211 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.7.service' 2024-09-15T22:28:32.251 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:32.251 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-15T22:28:32.251 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-15T22:28:32.251 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.8 2024-09-15T22:28:32.461 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:32 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:32.271+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:32.461 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:32 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:32.271+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:32.461 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:32 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:32.271+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:32.461 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:32 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:32.271+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:32.461 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:32 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:32.271+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:32.574 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:32 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:32.312+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:32.574 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:32 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:32.312+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:32.574 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:32 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:32.312+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:32.574 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:32 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:32.312+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:32.574 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:32 smithi165 systemd[1]: Stopping Ceph osd.8 for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:28:32.575 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:32 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:32.526+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:32.575 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:32 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:32.526+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:32.575 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:32 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:32.526+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:32.575 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:32 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:32.526+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.140979+0000 front 2024-09-15T22:28:05.141085+0000 (oldest deadline 2024-09-15T22:28:28.040875+0000) 2024-09-15T22:28:32.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:32 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:32.571+0000 7f8b586c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:28:32.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:32 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:32.571+0000 7f8b586c2640 -1 osd.8 106 *** Got signal Terminated *** 2024-09-15T22:28:32.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:32 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:32.571+0000 7f8b586c2640 -1 osd.8 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:28:33.049 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:32 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:32.684+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:33.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:32 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:32.684+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:33.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:32 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:32.684+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:33.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:32 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:32.684+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:33.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:32 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:32.684+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:33.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:33 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:33.488+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:33.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:33 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:33.488+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:33.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:33 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:33.488+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:33.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:33 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:33.488+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.140979+0000 front 2024-09-15T22:28:05.141085+0000 (oldest deadline 2024-09-15T22:28:28.040875+0000) 2024-09-15T22:28:33.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:33 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:33.279+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:33.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:33 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:33.279+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:33.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:33 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:33.279+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:33.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:33 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:33.279+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:33.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:33 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:33.309+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:33.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:33 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:33.309+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:33.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:33 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:33.309+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:33.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:33 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:33.309+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:33.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:33 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:33.309+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:34.049 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:33 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:33.663+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:34.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:33 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:33.663+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:34.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:33 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:33.663+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:34.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:33 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:33.663+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:34.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:33 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:33.663+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:34.504 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:34 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:34.238+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:34.504 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:34 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:34.238+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:34.504 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:34 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:34.238+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:34.504 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:34 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:34.238+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:34.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:34 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:34.349+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:34.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:34 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:34.349+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:34.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:34 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:34.349+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:34.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:34 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:34.349+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:34.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:34 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:34.349+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:34.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:34 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:34.502+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:34.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:34 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:34.502+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:34.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:34 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:34.502+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:34.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:34 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:34.502+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.140979+0000 front 2024-09-15T22:28:05.141085+0000 (oldest deadline 2024-09-15T22:28:28.040875+0000) 2024-09-15T22:28:35.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:34 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:34.705+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:35.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:34 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:34.705+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:35.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:34 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:34.705+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:35.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:34 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:34.705+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:35.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:34 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:34.705+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:35.645 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:35 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:35.301+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:35.646 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:35 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:35.301+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:35.646 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:35 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:35.301+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:35.646 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:35 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:35.301+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:35.646 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:35 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:35.301+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:35.646 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:35 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:35.301+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:35.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:35 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:35.505+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:35.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:35 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:35.505+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:35.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:35 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:35.505+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:35.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:35 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:35.505+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.140979+0000 front 2024-09-15T22:28:05.141085+0000 (oldest deadline 2024-09-15T22:28:28.040875+0000) 2024-09-15T22:28:35.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:35 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:35.260+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:35.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:35 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:35.260+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:35.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:35 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:35.260+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:35.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:35 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:35.260+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:36.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:35 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:35.705+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:36.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:35 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:35.705+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:36.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:35 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:35.705+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:36.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:35 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:35.705+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:36.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:35 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:35.705+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:36.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:35 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:35.705+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.450243+0000 front 2024-09-15T22:28:09.450320+0000 (oldest deadline 2024-09-15T22:28:35.250557+0000) 2024-09-15T22:28:36.544 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:36 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:36.277+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:36.544 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:36 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:36.277+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:36.544 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:36 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:36.277+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:36.545 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:36 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:36.277+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:36.545 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:36 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:36.277+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:36.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:36 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:36.282+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:36.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:36 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:36.282+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:36.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:36 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:36.282+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:36.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:36 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:36.282+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:36.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:36 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:36.282+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:36.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:36 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:36.282+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:36.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:36 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:36.542+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:36.964 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:36 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:36.542+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:36.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:36 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:36.542+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:36.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:36 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:36.542+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.140979+0000 front 2024-09-15T22:28:05.141085+0000 (oldest deadline 2024-09-15T22:28:28.040875+0000) 2024-09-15T22:28:36.965 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:36 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:36.542+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:08.541635+0000 front 2024-09-15T22:28:08.541601+0000 (oldest deadline 2024-09-15T22:28:36.142401+0000) 2024-09-15T22:28:37.049 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:36 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:36.711+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:37.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:36 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:36.711+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:37.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:36 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:36.711+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:37.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:36 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:36.711+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:37.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:36 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:36.711+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:37.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:36 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:36.711+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.450243+0000 front 2024-09-15T22:28:09.450320+0000 (oldest deadline 2024-09-15T22:28:35.250557+0000) 2024-09-15T22:28:37.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:37 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:37.537+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:28.836129+0000 front 2024-09-15T22:27:28.836034+0000 (oldest deadline 2024-09-15T22:27:54.136134+0000) 2024-09-15T22:28:37.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:37 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:37.537+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:47.638093+0000 front 2024-09-15T22:27:47.637994+0000 (oldest deadline 2024-09-15T22:28:12.938138+0000) 2024-09-15T22:28:37.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:37 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:37.537+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.039292+0000 front 2024-09-15T22:27:57.039214+0000 (oldest deadline 2024-09-15T22:28:19.939369+0000) 2024-09-15T22:28:37.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:37 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:37.537+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.140979+0000 front 2024-09-15T22:28:05.141085+0000 (oldest deadline 2024-09-15T22:28:28.040875+0000) 2024-09-15T22:28:37.715 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:37 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8[54166]: 2024-09-15T22:28:37.537+0000 7f8b50cd0640 -1 osd.8 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:08.541635+0000 front 2024-09-15T22:28:08.541601+0000 (oldest deadline 2024-09-15T22:28:36.142401+0000) 2024-09-15T22:28:37.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:37 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:37.316+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:37.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:37 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:37.316+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:37.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:37 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:37.316+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:37.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:37 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:37.316+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:37.716 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:37 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:37.316+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:37.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:37 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:37.299+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:37.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:37 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:37.299+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:37.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:37 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:37.299+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:37.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:37 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:37.299+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:37.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:37 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:37.299+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:37.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:37 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:37.299+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:38.049 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:37 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:37.689+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:38.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:37 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:37.689+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:38.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:37 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:37.689+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:38.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:37 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:37.689+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:38.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:37 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:37.689+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:38.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:37 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:37.689+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.450243+0000 front 2024-09-15T22:28:09.450320+0000 (oldest deadline 2024-09-15T22:28:35.250557+0000) 2024-09-15T22:28:38.325 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:38 smithi165 podman[72804]: 2024-09-15 22:28:38.070524285 +0000 UTC m=+5.623620875 container died e30a20598b892d4c6ef789ec608f07ab7b54d053c7a7731bee849122a4d780dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True) 2024-09-15T22:28:38.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:38 smithi165 podman[72804]: 2024-09-15 22:28:38.472784583 +0000 UTC m=+6.025881165 container cleanup e30a20598b892d4c6ef789ec608f07ab7b54d053c7a7731bee849122a4d780dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux ) 2024-09-15T22:28:38.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:38 smithi165 bash[72804]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8 2024-09-15T22:28:38.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:38 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:38.325+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:38.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:38 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:38.325+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:38.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:38 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:38.325+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:38.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:38 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:38.325+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:38.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:38 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:38.325+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:38.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:38 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:38.343+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:38.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:38 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:38.343+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:38.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:38 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:38.343+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:38.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:38 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:38.343+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:38.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:38 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:38.343+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:38.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:38 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:38.343+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:39.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:38 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:38.735+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:39.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:38 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:38.735+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:39.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:38 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:38.735+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:39.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:38 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:38.735+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:39.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:38 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:38.735+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:39.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:38 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:38.735+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.450243+0000 front 2024-09-15T22:28:09.450320+0000 (oldest deadline 2024-09-15T22:28:35.250557+0000) 2024-09-15T22:28:39.092 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:38 smithi165 podman[72819]: 2024-09-15 22:28:38.741016465 +0000 UTC m=+0.671792509 container remove e30a20598b892d4c6ef789ec608f07ab7b54d053c7a7731bee849122a4d780dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-15T22:28:39.387 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:39 smithi165 podman[72907]: 2024-09-15 22:28:39.091701389 +0000 UTC m=+0.112674354 container create 285b3ea9418ea1dcc737a45176c2094909a61d18d4001a175ba8de2a644ec830 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-09-15T22:28:39.387 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:39 smithi165 podman[72907]: 2024-09-15 22:28:38.99495374 +0000 UTC m=+0.015926722 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:28:39.387 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:39 smithi165 podman[72907]: 2024-09-15 22:28:39.286352639 +0000 UTC m=+0.307325604 container init 285b3ea9418ea1dcc737a45176c2094909a61d18d4001a175ba8de2a644ec830 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-15T22:28:39.387 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:39 smithi165 podman[72907]: 2024-09-15 22:28:39.289597524 +0000 UTC m=+0.310570494 container start 285b3ea9418ea1dcc737a45176c2094909a61d18d4001a175ba8de2a644ec830 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8-deactivate, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-15T22:28:39.388 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:39 smithi165 podman[72907]: 2024-09-15 22:28:39.386241455 +0000 UTC m=+0.407214420 container attach 285b3ea9418ea1dcc737a45176c2094909a61d18d4001a175ba8de2a644ec830 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-15T22:28:39.388 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:39 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:39.308+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:39.388 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:39 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:39.308+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:39.388 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:39 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:39.308+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:39.388 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:39 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:39.308+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:39.388 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:39 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:39.308+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:39.714 INFO:journalctl@ceph.osd.8.smithi165.stdout:Sep 15 22:28:39 smithi165 podman[72907]: 2024-09-15 22:28:39.482534689 +0000 UTC m=+0.503507666 container died 285b3ea9418ea1dcc737a45176c2094909a61d18d4001a175ba8de2a644ec830 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-15T22:28:39.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:39 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:39.322+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:39.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:39 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:39.322+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:39.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:39 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:39.322+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:39.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:39 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:39.322+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:39.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:39 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:39.322+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:39.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:39 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:39.322+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:40.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:39 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:39.710+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:40.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:39 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:39.710+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:40.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:39 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:39.710+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:40.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:39 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:39.710+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:40.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:39 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:39.710+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:40.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:39 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:39.710+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.450243+0000 front 2024-09-15T22:28:09.450320+0000 (oldest deadline 2024-09-15T22:28:35.250557+0000) 2024-09-15T22:28:40.210 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.8.service' 2024-09-15T22:28:40.251 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:40.251 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-15T22:28:40.251 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-15T22:28:40.252 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.9 2024-09-15T22:28:40.461 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:40 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:40.321+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:40.461 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:40 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:40.321+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:40.461 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:40 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:40.321+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:40.461 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:40 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:40.321+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:40.461 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:40 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:40.321+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:40.549 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:40 smithi045 systemd[1]: Stopping Ceph osd.9 for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:28:40.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:40 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:40.344+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:40.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:40 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:40.344+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:40.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:40 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:40.344+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:40.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:40 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:40.344+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:40.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:40 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:40.344+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:40.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:40 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:40.344+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:41.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:40.565+0000 7fa62cd57640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:28:41.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:40.565+0000 7fa62cd57640 -1 osd.9 106 *** Got signal Terminated *** 2024-09-15T22:28:41.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:40.565+0000 7fa62cd57640 -1 osd.9 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:28:41.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:40.726+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:41.051 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:40.726+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:41.051 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:40.726+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:41.051 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:40.726+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:41.051 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:40.726+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:41.051 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:40 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:40.726+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.450243+0000 front 2024-09-15T22:28:09.450320+0000 (oldest deadline 2024-09-15T22:28:35.250557+0000) 2024-09-15T22:28:41.714 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:41 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:41.353+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:41.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:41 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:41.353+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:41.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:41 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:41.353+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:41.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:41 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:41.353+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:41.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:41 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:41.353+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:41.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:41 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:41.316+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:41.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:41 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:41.316+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:41.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:41 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:41.316+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:41.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:41 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:41.316+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:41.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:41 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:41.316+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:41.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:41 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:41.316+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:42.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:41 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:41.688+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:42.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:41 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:41.688+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:42.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:41 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:41.688+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:42.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:41 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:41.688+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:42.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:41 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:41.688+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:42.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:41 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:41.688+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.450243+0000 front 2024-09-15T22:28:09.450320+0000 (oldest deadline 2024-09-15T22:28:35.250557+0000) 2024-09-15T22:28:42.714 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:42 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:42.403+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:42.714 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:42 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:42.403+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:42.714 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:42 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:42.403+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:42.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:42 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:42.403+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:42.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:42 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:42.403+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:42.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:42 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:42.295+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:42.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:42 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:42.295+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:42.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:42 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:42.295+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:42.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:42 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:42.295+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:42.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:42 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:42.295+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:42.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:42 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:42.295+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:42.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:42 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:42.295+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:20.513156+0000 front 2024-09-15T22:28:20.513244+0000 (oldest deadline 2024-09-15T22:28:42.213111+0000) 2024-09-15T22:28:43.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:42 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:42.699+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:43.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:42 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:42.699+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:43.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:42 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:42.699+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:43.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:42 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:42.699+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:43.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:42 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:42.699+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:43.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:42 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:42.699+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.450243+0000 front 2024-09-15T22:28:09.450320+0000 (oldest deadline 2024-09-15T22:28:35.250557+0000) 2024-09-15T22:28:43.714 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:43 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:43.436+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:43.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:43 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:43.436+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:43.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:43 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:43.436+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:43.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:43 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:43.436+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:43.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:43 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:43.436+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:43.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:43 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:43.330+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:43.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:43 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:43.330+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:43.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:43 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:43.330+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:43.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:43 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:43.330+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:43.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:43 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:43.330+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:43.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:43 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:43.330+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:43.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:43 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:43.330+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:20.513156+0000 front 2024-09-15T22:28:20.513244+0000 (oldest deadline 2024-09-15T22:28:42.213111+0000) 2024-09-15T22:28:44.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:43 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:43.748+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:44.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:43 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:43.748+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:44.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:43 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:43.748+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:44.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:43 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:43.748+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:44.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:43 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:43.748+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:44.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:43 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:43.748+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.450243+0000 front 2024-09-15T22:28:09.450320+0000 (oldest deadline 2024-09-15T22:28:35.250557+0000) 2024-09-15T22:28:44.714 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:44 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:44.416+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:44.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:44 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:44.416+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:44.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:44 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:44.416+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:44.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:44 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:44.416+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:44.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:44 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:44.416+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:44.715 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:44 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:44.416+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:44.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:44 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:44.346+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:44.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:44 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:44.346+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:44.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:44 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:44.346+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:44.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:44 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:44.346+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:44.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:44 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:44.346+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:44.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:44 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:44.346+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:44.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:44 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:44.346+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:20.513156+0000 front 2024-09-15T22:28:20.513244+0000 (oldest deadline 2024-09-15T22:28:42.213111+0000) 2024-09-15T22:28:45.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:44 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:44.742+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:29.844397+0000 front 2024-09-15T22:27:29.844257+0000 (oldest deadline 2024-09-15T22:27:55.144370+0000) 2024-09-15T22:28:45.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:44 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:44.742+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.345857+0000 front 2024-09-15T22:27:40.345821+0000 (oldest deadline 2024-09-15T22:28:02.645897+0000) 2024-09-15T22:28:45.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:44 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:44.742+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:46.747336+0000 front 2024-09-15T22:27:46.747112+0000 (oldest deadline 2024-09-15T22:28:12.647040+0000) 2024-09-15T22:28:45.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:44 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:44.742+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.348036+0000 front 2024-09-15T22:27:57.347999+0000 (oldest deadline 2024-09-15T22:28:19.648079+0000) 2024-09-15T22:28:45.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:44 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:44.742+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:03.649431+0000 front 2024-09-15T22:28:03.649549+0000 (oldest deadline 2024-09-15T22:28:28.349441+0000) 2024-09-15T22:28:45.050 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:44 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9[65546]: 2024-09-15T22:28:44.742+0000 7fa625365640 -1 osd.9 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.450243+0000 front 2024-09-15T22:28:09.450320+0000 (oldest deadline 2024-09-15T22:28:35.250557+0000) 2024-09-15T22:28:45.699 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:45 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:45.317+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:45.699 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:45 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:45.317+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:45.699 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:45 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:45.317+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:45.699 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:45 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:45.317+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:45.699 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:45 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:45.317+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:45.699 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:45 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:45.317+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:45.699 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:45 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:45.317+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:20.513156+0000 front 2024-09-15T22:28:20.513244+0000 (oldest deadline 2024-09-15T22:28:42.213111+0000) 2024-09-15T22:28:45.964 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:45 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:45.466+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:45.964 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:45 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:45.466+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:45.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:45 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:45.466+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:45.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:45 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:45.466+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:45.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:45 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:45.466+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:45.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:45 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:45.466+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:46.300 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:45 smithi045 podman[108498]: 2024-09-15 22:28:45.96073303 +0000 UTC m=+5.501777989 container died 6b40b36bd3b25e9bb4dd56cc6c26db04e275921bbd477db3e6e151f801ea2d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:28:46.675 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:46 smithi045 podman[108498]: 2024-09-15 22:28:46.431574649 +0000 UTC m=+5.972619601 container cleanup 6b40b36bd3b25e9bb4dd56cc6c26db04e275921bbd477db3e6e151f801ea2d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True) 2024-09-15T22:28:46.675 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:46 smithi045 bash[108498]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9 2024-09-15T22:28:46.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:46 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:46.335+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:46.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:46 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:46.335+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:46.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:46 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:46.335+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:46.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:46 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:46.335+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:46.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:46 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:46.335+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:46.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:46 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:46.335+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:46.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:46 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:46.335+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:20.513156+0000 front 2024-09-15T22:28:20.513244+0000 (oldest deadline 2024-09-15T22:28:42.213111+0000) 2024-09-15T22:28:46.964 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:46 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:46.481+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:46.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:46 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:46.481+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:46.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:46 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:46.481+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:46.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:46 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:46.481+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:46.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:46 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:46.481+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:46.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:46 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:46.481+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:47.009 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:46 smithi045 podman[108515]: 2024-09-15 22:28:46.674433646 +0000 UTC m=+0.710825209 container remove 6b40b36bd3b25e9bb4dd56cc6c26db04e275921bbd477db3e6e151f801ea2d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-15T22:28:47.278 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:47 smithi045 podman[108603]: 2024-09-15 22:28:47.008521163 +0000 UTC m=+0.108581437 container create 2da8c124911bf664a9e497d44557554dfc2e4c1dda6e12ff6c4a8cab01da551c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True) 2024-09-15T22:28:47.279 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:47 smithi045 podman[108603]: 2024-09-15 22:28:46.917023114 +0000 UTC m=+0.017083386 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:28:47.279 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:47 smithi045 podman[108603]: 2024-09-15 22:28:47.211850696 +0000 UTC m=+0.311910973 container init 2da8c124911bf664a9e497d44557554dfc2e4c1dda6e12ff6c4a8cab01da551c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-09-15T22:28:47.279 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:47 smithi045 podman[108603]: 2024-09-15 22:28:47.215952072 +0000 UTC m=+0.316012343 container start 2da8c124911bf664a9e497d44557554dfc2e4c1dda6e12ff6c4a8cab01da551c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-15T22:28:47.279 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:47 smithi045 podman[108603]: 2024-09-15 22:28:47.277724589 +0000 UTC m=+0.377784878 container attach 2da8c124911bf664a9e497d44557554dfc2e4c1dda6e12ff6c4a8cab01da551c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9-deactivate, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:28:47.550 INFO:journalctl@ceph.osd.9.smithi045.stdout:Sep 15 22:28:47 smithi045 podman[108603]: 2024-09-15 22:28:47.403225101 +0000 UTC m=+0.503285376 container died 2da8c124911bf664a9e497d44557554dfc2e4c1dda6e12ff6c4a8cab01da551c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:28:47.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:47 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:47.288+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:47.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:47 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:47.288+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:47.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:47 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:47.288+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:47.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:47 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:47.288+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:47.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:47 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:47.288+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:47.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:47 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:47.288+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:47.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:47 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:47.288+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:20.513156+0000 front 2024-09-15T22:28:20.513244+0000 (oldest deadline 2024-09-15T22:28:42.213111+0000) 2024-09-15T22:28:47.964 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:47 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:47.507+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:47.964 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:47 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:47.507+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:47.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:47 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:47.507+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:47.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:47 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:47.507+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:47.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:47 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:47.507+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:47.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:47 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:47.507+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:47.999 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.9.service' 2024-09-15T22:28:48.042 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:48.042 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-15T22:28:48.042 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-15T22:28:48.043 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.10 2024-09-15T22:28:48.364 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:48 smithi100 systemd[1]: Stopping Ceph osd.10 for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:28:48.364 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:48 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:48.271+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:48.364 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:48 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:48.271+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:48.365 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:48 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:48.271+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:48.365 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:48 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:48.271+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:48.365 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:48 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:48.271+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:48.365 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:48 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:48.271+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:48.365 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:48 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:48.271+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:20.513156+0000 front 2024-09-15T22:28:20.513244+0000 (oldest deadline 2024-09-15T22:28:42.213111+0000) 2024-09-15T22:28:48.365 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:48 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:48.362+0000 7fdad2fe3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:28:48.365 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:48 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:48.362+0000 7fdad2fe3640 -1 osd.10 106 *** Got signal Terminated *** 2024-09-15T22:28:48.365 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:48 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:48.362+0000 7fdad2fe3640 -1 osd.10 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:28:48.964 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:48 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:48.554+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:48.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:48 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:48.554+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:48.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:48 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:48.554+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:48.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:48 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:48.554+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:48.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:48 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:48.554+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:48.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:48 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:48.554+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:49.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:49 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:49.310+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:49.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:49 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:49.310+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:49.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:49 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:49.310+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:49.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:49 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:49.310+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:49.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:49 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:49.310+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:49.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:49 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:49.310+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:49.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:49 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:49.310+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:20.513156+0000 front 2024-09-15T22:28:20.513244+0000 (oldest deadline 2024-09-15T22:28:42.213111+0000) 2024-09-15T22:28:49.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:49 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:49.601+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:49.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:49 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:49.601+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:49.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:49 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:49.601+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:49.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:49 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:49.601+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:49.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:49 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:49.601+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:49.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:49 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:49.601+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:50.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:50 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:50.333+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:50.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:50 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:50.333+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:50.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:50 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:50.333+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:50.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:50 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:50.333+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:50.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:50 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:50.333+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:50.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:50 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:50.333+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:50.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:50 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:50.333+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:20.513156+0000 front 2024-09-15T22:28:20.513244+0000 (oldest deadline 2024-09-15T22:28:42.213111+0000) 2024-09-15T22:28:50.923 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:50 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:50.584+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:50.924 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:50 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:50.584+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:50.924 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:50 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:50.584+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:50.924 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:50 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:50.584+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:50.924 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:50 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:50.584+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:50.924 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:50 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:50.584+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:51.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:51 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:51.341+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:51.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:51 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:51.341+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:51.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:51 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:51.341+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:51.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:51 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:51.341+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:51.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:51 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:51.341+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:51.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:51 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:51.341+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:51.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:51 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:51.341+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:20.513156+0000 front 2024-09-15T22:28:20.513244+0000 (oldest deadline 2024-09-15T22:28:42.213111+0000) 2024-09-15T22:28:51.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:51 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:51.614+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:51.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:51 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:51.614+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:51.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:51 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:51.614+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:51.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:51 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:51.614+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:51.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:51 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:51.614+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:51.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:51 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:51.614+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:51.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:51 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:51.614+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-15T22:28:27.343528+0000 front 2024-09-15T22:28:27.343549+0000 (oldest deadline 2024-09-15T22:28:51.443497+0000) 2024-09-15T22:28:52.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:52 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:52.359+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:30.605467+0000 front 2024-09-15T22:27:30.605445+0000 (oldest deadline 2024-09-15T22:27:55.905637+0000) 2024-09-15T22:28:52.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:52 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:52.359+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:40.407208+0000 front 2024-09-15T22:27:40.407249+0000 (oldest deadline 2024-09-15T22:28:02.007953+0000) 2024-09-15T22:28:52.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:52 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:52.359+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.409500+0000 front 2024-09-15T22:27:48.409450+0000 (oldest deadline 2024-09-15T22:28:13.709462+0000) 2024-09-15T22:28:52.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:52 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:52.359+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6814 osd.3 since back 2024-09-15T22:27:57.210540+0000 front 2024-09-15T22:27:57.210721+0000 (oldest deadline 2024-09-15T22:28:21.910313+0000) 2024-09-15T22:28:52.744 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:52 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:52.359+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:01.910606+0000 front 2024-09-15T22:28:01.910640+0000 (oldest deadline 2024-09-15T22:28:28.911207+0000) 2024-09-15T22:28:52.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:52 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:52.359+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:09.412172+0000 front 2024-09-15T22:28:09.412064+0000 (oldest deadline 2024-09-15T22:28:34.711902+0000) 2024-09-15T22:28:52.745 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:52 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10[60156]: 2024-09-15T22:28:52.359+0000 7fdacf5f9640 -1 osd.10 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:20.513156+0000 front 2024-09-15T22:28:20.513244+0000 (oldest deadline 2024-09-15T22:28:42.213111+0000) 2024-09-15T22:28:52.964 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:52 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:52.651+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:52.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:52 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:52.651+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:52.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:52 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:52.651+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:52.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:52 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:52.651+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:52.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:52 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:52.651+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:52.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:52 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:52.651+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:52.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:52 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:52.651+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-15T22:28:27.343528+0000 front 2024-09-15T22:28:27.343549+0000 (oldest deadline 2024-09-15T22:28:51.443497+0000) 2024-09-15T22:28:53.964 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:53 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:53.646+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:53.964 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:53 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:53.646+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:53.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:53 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:53.646+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:53.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:53 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:53.646+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:53.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:53 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:53.646+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:53.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:53 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:53.646+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:53.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:53 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:53.646+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-15T22:28:27.343528+0000 front 2024-09-15T22:28:27.343549+0000 (oldest deadline 2024-09-15T22:28:51.443497+0000) 2024-09-15T22:28:53.972 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:53 smithi100 podman[71838]: 2024-09-15 22:28:53.694761635 +0000 UTC m=+5.453331504 container stop 732432cc0941bea099ca390845a0659d3cd023994bcf602f3af174d87b6f2a81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-15T22:28:53.972 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:53 smithi100 podman[71838]: 2024-09-15 22:28:53.720393158 +0000 UTC m=+5.478963032 container died 732432cc0941bea099ca390845a0659d3cd023994bcf602f3af174d87b6f2a81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-15T22:28:54.233 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:54 smithi100 podman[71838]: 2024-09-15 22:28:54.070632721 +0000 UTC m=+5.829202577 container cleanup 732432cc0941bea099ca390845a0659d3cd023994bcf602f3af174d87b6f2a81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:28:54.233 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:54 smithi100 bash[71838]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10 2024-09-15T22:28:54.494 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:54 smithi100 podman[71855]: 2024-09-15 22:28:54.230178976 +0000 UTC m=+0.528469650 container remove 732432cc0941bea099ca390845a0659d3cd023994bcf602f3af174d87b6f2a81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-15T22:28:54.942 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:54 smithi100 podman[71942]: 2024-09-15 22:28:54.630946699 +0000 UTC m=+0.111020758 container create 45111bebdd82959ce878b1a1cf37a7a4e0154cd00b112f63ebe41b9d25b266c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:28:54.942 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:54 smithi100 podman[71942]: 2024-09-15 22:28:54.536327332 +0000 UTC m=+0.016401359 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:28:54.942 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:54 smithi100 podman[71942]: 2024-09-15 22:28:54.858388798 +0000 UTC m=+0.338462834 container init 45111bebdd82959ce878b1a1cf37a7a4e0154cd00b112f63ebe41b9d25b266c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-15T22:28:54.942 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:54 smithi100 podman[71942]: 2024-09-15 22:28:54.861845704 +0000 UTC m=+0.341919721 container start 45111bebdd82959ce878b1a1cf37a7a4e0154cd00b112f63ebe41b9d25b266c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-15T22:28:54.942 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:54 smithi100 podman[71942]: 2024-09-15 22:28:54.941244876 +0000 UTC m=+0.421318899 container attach 45111bebdd82959ce878b1a1cf37a7a4e0154cd00b112f63ebe41b9d25b266c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-15T22:28:54.964 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:54 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:54.644+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:54.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:54 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:54.644+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:54.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:54 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:54.644+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:54.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:54 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:54.644+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:54.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:54 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:54.644+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:54.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:54 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:54.644+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:54.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:54 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:54.644+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-15T22:28:27.343528+0000 front 2024-09-15T22:28:27.343549+0000 (oldest deadline 2024-09-15T22:28:51.443497+0000) 2024-09-15T22:28:55.244 INFO:journalctl@ceph.osd.10.smithi100.stdout:Sep 15 22:28:55 smithi100 podman[71942]: 2024-09-15 22:28:55.051988159 +0000 UTC m=+0.532062177 container died 45111bebdd82959ce878b1a1cf37a7a4e0154cd00b112f63ebe41b9d25b266c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-15T22:28:55.680 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.10.service' 2024-09-15T22:28:55.718 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:28:55.718 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-15T22:28:55.718 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-15T22:28:55.718 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.11 2024-09-15T22:28:55.964 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:55 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:55.628+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:55.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:55 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:55.628+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:55.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:55 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:55.628+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:55.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:55 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:55.628+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:55.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:55 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:55.628+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:55.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:55 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:55.628+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:55.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:55 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:55.628+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-15T22:28:27.343528+0000 front 2024-09-15T22:28:27.343549+0000 (oldest deadline 2024-09-15T22:28:51.443497+0000) 2024-09-15T22:28:55.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:55 smithi165 systemd[1]: Stopping Ceph osd.11 for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:28:56.464 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:56 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:56.025+0000 7f2a86443640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:28:56.464 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:56 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:56.025+0000 7f2a86443640 -1 osd.11 106 *** Got signal Terminated *** 2024-09-15T22:28:56.464 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:56 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:56.025+0000 7f2a86443640 -1 osd.11 106 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T22:28:56.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:56 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:56.593+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:56.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:56 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:56.593+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:56.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:56 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:56.593+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:56.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:56 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:56.593+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:56.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:56 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:56.593+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:56.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:56 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:56.593+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:56.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:56 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:56.593+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-15T22:28:27.343528+0000 front 2024-09-15T22:28:27.343549+0000 (oldest deadline 2024-09-15T22:28:51.443497+0000) 2024-09-15T22:28:57.867 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:57 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:57.554+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:57.867 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:57 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:57.554+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:57.867 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:57 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:57.554+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:57.867 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:57 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:57.554+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:57.867 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:57 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:57.554+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:57.867 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:57 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:57.554+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:57.867 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:57 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:57.554+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-15T22:28:27.343528+0000 front 2024-09-15T22:28:27.343549+0000 (oldest deadline 2024-09-15T22:28:51.443497+0000) 2024-09-15T22:28:58.882 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:58 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:58.599+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:58.882 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:58 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:58.599+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:58.883 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:58 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:58.599+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:58.883 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:58 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:58.599+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:58.883 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:58 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:58.599+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:58.883 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:58 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:58.599+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:58.883 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:58 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:58.599+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-15T22:28:27.343528+0000 front 2024-09-15T22:28:27.343549+0000 (oldest deadline 2024-09-15T22:28:51.443497+0000) 2024-09-15T22:28:59.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:59 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:59.578+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:28:59.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:59 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:59.578+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:28:59.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:59 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:59.578+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:28:59.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:59 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:59.578+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:28:59.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:59 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:59.578+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:28:59.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:59 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:59.578+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:28:59.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:59 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:59.578+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-15T22:28:27.343528+0000 front 2024-09-15T22:28:27.343549+0000 (oldest deadline 2024-09-15T22:28:51.443497+0000) 2024-09-15T22:28:59.966 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:28:59 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:28:59.578+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6820 osd.8 since back 2024-09-15T22:28:36.744416+0000 front 2024-09-15T22:28:36.744479+0000 (oldest deadline 2024-09-15T22:28:59.044485+0000) 2024-09-15T22:29:00.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:00 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:29:00.597+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6806 osd.0 since back 2024-09-15T22:27:32.435610+0000 front 2024-09-15T22:27:32.435511+0000 (oldest deadline 2024-09-15T22:27:55.335563+0000) 2024-09-15T22:29:00.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:00 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:29:00.597+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2024-09-15T22:27:37.036705+0000 front 2024-09-15T22:27:37.036733+0000 (oldest deadline 2024-09-15T22:28:02.936808+0000) 2024-09-15T22:29:00.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:00 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:29:00.597+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6804 osd.2 since back 2024-09-15T22:27:48.138474+0000 front 2024-09-15T22:27:48.138791+0000 (oldest deadline 2024-09-15T22:28:10.438676+0000) 2024-09-15T22:29:00.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:00 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:29:00.597+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2024-09-15T22:28:05.041148+0000 front 2024-09-15T22:28:05.041124+0000 (oldest deadline 2024-09-15T22:28:30.941115+0000) 2024-09-15T22:29:00.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:00 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:29:00.597+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6812 osd.5 since back 2024-09-15T22:28:10.941690+0000 front 2024-09-15T22:28:10.941754+0000 (oldest deadline 2024-09-15T22:28:36.241685+0000) 2024-09-15T22:29:00.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:00 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:29:00.597+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.45:6822 osd.6 since back 2024-09-15T22:28:18.542702+0000 front 2024-09-15T22:28:18.542842+0000 (oldest deadline 2024-09-15T22:28:43.842504+0000) 2024-09-15T22:29:00.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:00 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:29:00.597+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2024-09-15T22:28:27.343528+0000 front 2024-09-15T22:28:27.343549+0000 (oldest deadline 2024-09-15T22:28:51.443497+0000) 2024-09-15T22:29:00.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:00 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11[60713]: 2024-09-15T22:29:00.597+0000 7f2a7ea51640 -1 osd.11 106 heartbeat_check: no reply from 172.21.15.165:6820 osd.8 since back 2024-09-15T22:28:36.744416+0000 front 2024-09-15T22:28:36.744479+0000 (oldest deadline 2024-09-15T22:28:59.044485+0000) 2024-09-15T22:29:01.644 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:01 smithi165 podman[73022]: 2024-09-15 22:29:01.36599213 +0000 UTC m=+5.453494331 container died 8d9f6e1038979d9ae9e69239b12a1a0183227c87b728ccdc08e61c5c71aed718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-09-15T22:29:01.964 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:01 smithi165 podman[73022]: 2024-09-15 22:29:01.742113895 +0000 UTC m=+5.829616095 container cleanup 8d9f6e1038979d9ae9e69239b12a1a0183227c87b728ccdc08e61c5c71aed718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:29:01.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:01 smithi165 bash[73022]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11 2024-09-15T22:29:02.359 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:02 smithi165 podman[73052]: 2024-09-15 22:29:02.018255414 +0000 UTC m=+0.649382879 container remove 8d9f6e1038979d9ae9e69239b12a1a0183227c87b728ccdc08e61c5c71aed718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-15T22:29:02.680 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:02 smithi165 podman[73138]: 2024-09-15 22:29:02.261900086 +0000 UTC m=+0.016548013 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T22:29:02.681 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:02 smithi165 podman[73138]: 2024-09-15 22:29:02.368851872 +0000 UTC m=+0.123499791 container create 77fdb526465dd6475ea39f2bdebe6b157d8d912c3ed64df9615c1bfc22aee2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:29:02.681 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:02 smithi165 podman[73138]: 2024-09-15 22:29:02.5963691 +0000 UTC m=+0.351017025 container init 77fdb526465dd6475ea39f2bdebe6b157d8d912c3ed64df9615c1bfc22aee2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:29:02.681 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:02 smithi165 podman[73138]: 2024-09-15 22:29:02.599698603 +0000 UTC m=+0.354346522 container start 77fdb526465dd6475ea39f2bdebe6b157d8d912c3ed64df9615c1bfc22aee2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-15T22:29:02.681 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:02 smithi165 podman[73138]: 2024-09-15 22:29:02.679580414 +0000 UTC m=+0.434228341 container attach 77fdb526465dd6475ea39f2bdebe6b157d8d912c3ed64df9615c1bfc22aee2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e) 2024-09-15T22:29:02.965 INFO:journalctl@ceph.osd.11.smithi165.stdout:Sep 15 22:29:02 smithi165 podman[73138]: 2024-09-15 22:29:02.784993496 +0000 UTC m=+0.539641417 container died 77fdb526465dd6475ea39f2bdebe6b157d8d912c3ed64df9615c1bfc22aee2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:29:03.369 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@osd.11.service' 2024-09-15T22:29:03.409 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:03.409 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-15T22:29:03.409 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-15T22:29:03.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.a 2024-09-15T22:29:03.709 INFO:journalctl@ceph.mds.a.smithi045.stdout:Sep 15 22:29:03 smithi045 systemd[1]: Stopping Ceph mds.a for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:29:04.049 INFO:journalctl@ceph.mds.a.smithi045.stdout:Sep 15 22:29:03 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-a[72723]: 2024-09-15T22:29:03.707+0000 7f2745540640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:04.050 INFO:journalctl@ceph.mds.a.smithi045.stdout:Sep 15 22:29:03 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-a[72723]: 2024-09-15T22:29:03.707+0000 7f2745540640 -1 mds.a *** got signal Terminated *** 2024-09-15T22:29:06.759 INFO:journalctl@ceph.mds.a.smithi045.stdout:Sep 15 22:29:06 smithi045 podman[108704]: 2024-09-15 22:29:06.502800771 +0000 UTC m=+2.894385850 container died cf5ec8b458b5ed39a609a47c9421c5c08e32538c2c995e40d76202af41b279a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-15T22:29:07.049 INFO:journalctl@ceph.mds.a.smithi045.stdout:Sep 15 22:29:06 smithi045 podman[108704]: 2024-09-15 22:29:06.907714896 +0000 UTC m=+3.299300017 container cleanup cf5ec8b458b5ed39a609a47c9421c5c08e32538c2c995e40d76202af41b279a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-15T22:29:07.050 INFO:journalctl@ceph.mds.a.smithi045.stdout:Sep 15 22:29:06 smithi045 bash[108704]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-a 2024-09-15T22:29:07.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.a.service' 2024-09-15T22:29:07.317 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:07.317 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-15T22:29:07.317 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-15T22:29:07.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.d 2024-09-15T22:29:07.646 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:29:07 smithi045 systemd[1]: Stopping Ceph mds.d for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:29:08.049 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:29:07 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-d[71496]: 2024-09-15T22:29:07.644+0000 7f3ccd064640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:08.050 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:29:07 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-d[71496]: 2024-09-15T22:29:07.644+0000 7f3ccd064640 -1 mds.d *** got signal Terminated *** 2024-09-15T22:29:11.405 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:29:11 smithi045 podman[108825]: 2024-09-15 22:29:11.135761108 +0000 UTC m=+3.598264442 container died 467840f2b6d70d383bbe8346a932f59dffec7808fd00914756752fd10ed56206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:29:11.763 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:29:11 smithi045 podman[108825]: 2024-09-15 22:29:11.49453221 +0000 UTC m=+3.957035535 container cleanup 467840f2b6d70d383bbe8346a932f59dffec7808fd00914756752fd10ed56206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T22:29:11.763 INFO:journalctl@ceph.mds.d.smithi045.stdout:Sep 15 22:29:11 smithi045 bash[108825]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-d 2024-09-15T22:29:11.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.d.service' 2024-09-15T22:29:11.970 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:11.970 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-15T22:29:11.970 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-15T22:29:11.970 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.g 2024-09-15T22:29:12.299 INFO:journalctl@ceph.mds.g.smithi045.stdout:Sep 15 22:29:12 smithi045 systemd[1]: Stopping Ceph mds.g for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:29:12.799 INFO:journalctl@ceph.mds.g.smithi045.stdout:Sep 15 22:29:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-g[72375]: 2024-09-15T22:29:12.298+0000 7f5849740640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:12.800 INFO:journalctl@ceph.mds.g.smithi045.stdout:Sep 15 22:29:12 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-g[72375]: 2024-09-15T22:29:12.298+0000 7f5849740640 -1 mds.g *** got signal Terminated *** 2024-09-15T22:29:16.275 INFO:journalctl@ceph.mds.g.smithi045.stdout:Sep 15 22:29:15 smithi045 podman[108946]: 2024-09-15 22:29:15.894222251 +0000 UTC m=+3.693024115 container died 083d3ffe532c3c32d1b26c099657da58a509a17ec29804786e046d07b0379a5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-09-15T22:29:16.549 INFO:journalctl@ceph.mds.g.smithi045.stdout:Sep 15 22:29:16 smithi045 podman[108946]: 2024-09-15 22:29:16.381963346 +0000 UTC m=+4.180765200 container cleanup 083d3ffe532c3c32d1b26c099657da58a509a17ec29804786e046d07b0379a5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-15T22:29:16.550 INFO:journalctl@ceph.mds.g.smithi045.stdout:Sep 15 22:29:16 smithi045 bash[108946]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-g 2024-09-15T22:29:16.844 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.g.service' 2024-09-15T22:29:16.877 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:16.878 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-15T22:29:16.878 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-15T22:29:16.878 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.j 2024-09-15T22:29:17.299 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:29:16 smithi045 systemd[1]: Stopping Ceph mds.j for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:29:17.300 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:29:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-j[71102]: 2024-09-15T22:29:17.218+0000 7f3882b7a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:17.300 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:29:17 smithi045 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-j[71102]: 2024-09-15T22:29:17.218+0000 7f3882b7a640 -1 mds.j *** got signal Terminated *** 2024-09-15T22:29:19.895 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:29:19 smithi045 podman[109064]: 2024-09-15 22:29:19.619348901 +0000 UTC m=+2.506228262 container died e7614a6af401a01c05634a533e4c1d92322fcc4d5aebb03bac4db421d9dd833e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-j, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-15T22:29:20.253 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:29:19 smithi045 podman[109064]: 2024-09-15 22:29:19.993668147 +0000 UTC m=+2.880547497 container cleanup e7614a6af401a01c05634a533e4c1d92322fcc4d5aebb03bac4db421d9dd833e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:29:20.253 INFO:journalctl@ceph.mds.j.smithi045.stdout:Sep 15 22:29:19 smithi045 bash[109064]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-j 2024-09-15T22:29:20.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.j.service' 2024-09-15T22:29:20.466 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:20.466 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-15T22:29:20.466 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-15T22:29:20.467 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.b 2024-09-15T22:29:20.744 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:29:20 smithi100 systemd[1]: Stopping Ceph mds.b for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:29:21.000 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:29:20 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-b[65376]: 2024-09-15T22:29:20.903+0000 7fe9a4cd4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:21.000 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:29:20 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-b[65376]: 2024-09-15T22:29:20.903+0000 7fe9a4cd4640 -1 mds.b *** got signal Terminated *** 2024-09-15T22:29:22.244 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:29:22 smithi100 podman[72043]: 2024-09-15 22:29:22.113581377 +0000 UTC m=+1.449133098 container died e5b7bff31d78c693c04a6b303d95ad6c99230cb36d351f8fd7748fd2c30667ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-15T22:29:22.994 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:29:22 smithi100 podman[72043]: 2024-09-15 22:29:22.769802716 +0000 UTC m=+2.105354449 container cleanup e5b7bff31d78c693c04a6b303d95ad6c99230cb36d351f8fd7748fd2c30667ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-b, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-15T22:29:22.994 INFO:journalctl@ceph.mds.b.smithi100.stdout:Sep 15 22:29:22 smithi100 bash[72043]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-b 2024-09-15T22:29:23.195 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.b.service' 2024-09-15T22:29:23.231 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:23.231 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-15T22:29:23.231 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-15T22:29:23.231 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.e 2024-09-15T22:29:23.558 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:29:23 smithi100 systemd[1]: Stopping Ceph mds.e for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:29:23.994 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:29:23 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-e[64762]: 2024-09-15T22:29:23.557+0000 7f033c30a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:23.994 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:29:23 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-e[64762]: 2024-09-15T22:29:23.557+0000 7f033c30a640 -1 mds.e *** got signal Terminated *** 2024-09-15T22:29:26.208 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:29:25 smithi100 podman[72176]: 2024-09-15 22:29:25.95273558 +0000 UTC m=+2.497849712 container died 4d9d404d9948e80752808551312b06637bd954c34405736844873fd21d186987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-15T22:29:26.475 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:29:26 smithi100 podman[72176]: 2024-09-15 22:29:26.290328771 +0000 UTC m=+2.835442900 container cleanup 4d9d404d9948e80752808551312b06637bd954c34405736844873fd21d186987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-15T22:29:26.475 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:29:26 smithi100 bash[72176]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-e 2024-09-15T22:29:26.723 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.e.service' 2024-09-15T22:29:26.744 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:29:26 smithi100 podman[72188]: 2024-09-15 22:29:26.474836807 +0000 UTC m=+0.523834704 container remove 4d9d404d9948e80752808551312b06637bd954c34405736844873fd21d186987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-e, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-15T22:29:26.744 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:29:26 smithi100 systemd[1]: ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.e.service: Deactivated successfully. 2024-09-15T22:29:26.744 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:29:26 smithi100 systemd[1]: Stopped Ceph mds.e for a1911414-73ae-11ef-bceb-c7b262605968. 2024-09-15T22:29:26.744 INFO:journalctl@ceph.mds.e.smithi100.stdout:Sep 15 22:29:26 smithi100 systemd[1]: ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.e.service: Consumed 1.068s CPU time. 2024-09-15T22:29:26.756 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:26.756 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-15T22:29:26.756 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-15T22:29:26.756 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.h 2024-09-15T22:29:27.086 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:29:26 smithi100 systemd[1]: Stopping Ceph mds.h for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:29:27.493 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:29:27 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-h[65066]: 2024-09-15T22:29:27.085+0000 7fbd9b7e7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:27.494 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:29:27 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-h[65066]: 2024-09-15T22:29:27.085+0000 7fbd9b7e7640 -1 mds.h *** got signal Terminated *** 2024-09-15T22:29:30.186 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:29:29 smithi100 podman[72296]: 2024-09-15 22:29:29.876492342 +0000 UTC m=+2.910262994 container died 2da772e7e96491b8b8e38af50f8208a70777e608a27f39ab39420cd4d9ed2267 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T22:29:30.186 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:29:30 smithi100 podman[72296]: 2024-09-15 22:29:30.185401111 +0000 UTC m=+3.219171773 container cleanup 2da772e7e96491b8b8e38af50f8208a70777e608a27f39ab39420cd4d9ed2267 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-15T22:29:30.494 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:29:30 smithi100 bash[72296]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-h 2024-09-15T22:29:30.494 INFO:journalctl@ceph.mds.h.smithi100.stdout:Sep 15 22:29:30 smithi100 podman[72308]: 2024-09-15 22:29:30.386674808 +0000 UTC m=+0.509012433 container remove 2da772e7e96491b8b8e38af50f8208a70777e608a27f39ab39420cd4d9ed2267 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-h, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-15T22:29:30.600 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.h.service' 2024-09-15T22:29:30.632 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:30.633 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-15T22:29:30.633 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-15T22:29:30.633 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.k 2024-09-15T22:29:30.932 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:29:30 smithi100 systemd[1]: Stopping Ceph mds.k for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:29:31.244 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:29:30 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-k[64450]: 2024-09-15T22:29:30.930+0000 7f4b48cbc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:31.244 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:29:30 smithi100 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-k[64450]: 2024-09-15T22:29:30.930+0000 7f4b48cbc640 -1 mds.k *** got signal Terminated *** 2024-09-15T22:29:32.744 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:29:32 smithi100 podman[72415]: 2024-09-15 22:29:32.43338587 +0000 UTC m=+1.587898975 container died 3354fa9b1bc6f3064e9845a516258e457865dbc48c2a30ed99b47146c3d23cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-15T22:29:33.173 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:29:32 smithi100 podman[72415]: 2024-09-15 22:29:32.764343026 +0000 UTC m=+1.918856122 container cleanup 3354fa9b1bc6f3064e9845a516258e457865dbc48c2a30ed99b47146c3d23cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-k, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-15T22:29:33.173 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:29:32 smithi100 bash[72415]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-k 2024-09-15T22:29:33.173 INFO:journalctl@ceph.mds.k.smithi100.stdout:Sep 15 22:29:32 smithi100 podman[72427]: 2024-09-15 22:29:32.956840373 +0000 UTC m=+0.517482631 container remove 3354fa9b1bc6f3064e9845a516258e457865dbc48c2a30ed99b47146c3d23cb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-15T22:29:33.191 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.k.service' 2024-09-15T22:29:33.224 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:33.224 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-15T22:29:33.224 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-15T22:29:33.225 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.c 2024-09-15T22:29:33.534 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:29:33 smithi165 systemd[1]: Stopping Ceph mds.c for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:29:33.788 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:29:33 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-c[65989]: 2024-09-15T22:29:33.531+0000 7f7bd1316640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:33.789 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:29:33 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-c[65989]: 2024-09-15T22:29:33.531+0000 7f7bd1316640 -1 mds.c *** got signal Terminated *** 2024-09-15T22:29:35.465 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:29:35 smithi165 podman[73241]: 2024-09-15 22:29:35.16061336 +0000 UTC m=+1.741179332 container died 0b145dea67f6deb2649c1520e0ab8cafe0e9efe948cb0eaa036c9a39c99fbd35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-c, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T22:29:35.950 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:29:35 smithi165 podman[73241]: 2024-09-15 22:29:35.599332407 +0000 UTC m=+2.179898373 container cleanup 0b145dea67f6deb2649c1520e0ab8cafe0e9efe948cb0eaa036c9a39c99fbd35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-15T22:29:35.951 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:29:35 smithi165 bash[73241]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-c 2024-09-15T22:29:35.951 INFO:journalctl@ceph.mds.c.smithi165.stdout:Sep 15 22:29:35 smithi165 podman[73268]: 2024-09-15 22:29:35.758811406 +0000 UTC m=+0.596382456 container remove 0b145dea67f6deb2649c1520e0ab8cafe0e9efe948cb0eaa036c9a39c99fbd35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-c, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-15T22:29:35.969 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.c.service' 2024-09-15T22:29:36.006 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:36.006 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-15T22:29:36.007 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-15T22:29:36.007 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.f 2024-09-15T22:29:36.330 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:29:36 smithi165 systemd[1]: Stopping Ceph mds.f for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:29:36.715 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:29:36 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-f[65689]: 2024-09-15T22:29:36.327+0000 7f97aaaaa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:36.715 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:29:36 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-f[65689]: 2024-09-15T22:29:36.327+0000 7f97aaaaa640 -1 mds.f *** got signal Terminated *** 2024-09-15T22:29:40.613 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:29:40 smithi165 podman[73376]: 2024-09-15 22:29:40.335527889 +0000 UTC m=+4.108706686 container died f5cdd361da5a62f728d201ffe74ebd7911e2b9d07f2508778aa892a158721293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-f, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True) 2024-09-15T22:29:40.964 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:29:40 smithi165 podman[73376]: 2024-09-15 22:29:40.7029174 +0000 UTC m=+4.476096186 container cleanup f5cdd361da5a62f728d201ffe74ebd7911e2b9d07f2508778aa892a158721293 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T22:29:40.964 INFO:journalctl@ceph.mds.f.smithi165.stdout:Sep 15 22:29:40 smithi165 bash[73376]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-f 2024-09-15T22:29:41.131 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.f.service' 2024-09-15T22:29:41.165 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:41.165 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-15T22:29:41.166 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-15T22:29:41.166 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.i 2024-09-15T22:29:41.491 INFO:journalctl@ceph.mds.i.smithi165.stdout:Sep 15 22:29:41 smithi165 systemd[1]: Stopping Ceph mds.i for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:29:41.964 INFO:journalctl@ceph.mds.i.smithi165.stdout:Sep 15 22:29:41 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-i[66291]: 2024-09-15T22:29:41.489+0000 7f4848964640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:41.965 INFO:journalctl@ceph.mds.i.smithi165.stdout:Sep 15 22:29:41 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-i[66291]: 2024-09-15T22:29:41.489+0000 7f4848964640 -1 mds.i *** got signal Terminated *** 2024-09-15T22:29:45.774 INFO:journalctl@ceph.mds.i.smithi165.stdout:Sep 15 22:29:45 smithi165 podman[73499]: 2024-09-15 22:29:45.502959287 +0000 UTC m=+4.117415032 container died cf15daafe55a586ba5522ead37404318d4602383cc8e7657d850a34350c0a99d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-i, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T22:29:46.108 INFO:journalctl@ceph.mds.i.smithi165.stdout:Sep 15 22:29:45 smithi165 podman[73499]: 2024-09-15 22:29:45.873115392 +0000 UTC m=+4.487571171 container cleanup cf15daafe55a586ba5522ead37404318d4602383cc8e7657d850a34350c0a99d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T22:29:46.109 INFO:journalctl@ceph.mds.i.smithi165.stdout:Sep 15 22:29:45 smithi165 bash[73499]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-i 2024-09-15T22:29:46.235 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.i.service' 2024-09-15T22:29:46.268 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:46.268 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-15T22:29:46.268 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-15T22:29:46.268 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.l 2024-09-15T22:29:46.464 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:29:46 smithi165 systemd[1]: Stopping Ceph mds.l for a1911414-73ae-11ef-bceb-c7b262605968... 2024-09-15T22:29:46.964 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:29:46 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-l[65387]: 2024-09-15T22:29:46.576+0000 7f8e7a940640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T22:29:46.965 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:29:46 smithi165 ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-l[65387]: 2024-09-15T22:29:46.576+0000 7f8e7a940640 -1 mds.l *** got signal Terminated *** 2024-09-15T22:29:50.036 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:29:49 smithi165 podman[73619]: 2024-09-15 22:29:49.776022497 +0000 UTC m=+3.295652050 container died 334bfe979f6a87ca1be77262b26b63861b79acae20e972979d4686ad40e0d890 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-15T22:29:50.420 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:29:50 smithi165 podman[73619]: 2024-09-15 22:29:50.126831775 +0000 UTC m=+3.646461328 container cleanup 334bfe979f6a87ca1be77262b26b63861b79acae20e972979d4686ad40e0d890 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-l, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-15T22:29:50.420 INFO:journalctl@ceph.mds.l.smithi165.stdout:Sep 15 22:29:50 smithi165 bash[73619]: ceph-a1911414-73ae-11ef-bceb-c7b262605968-mds-l 2024-09-15T22:29:50.555 DEBUG:teuthology.orchestra.run.smithi165:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a1911414-73ae-11ef-bceb-c7b262605968@mds.l.service' 2024-09-15T22:29:50.587 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T22:29:50.588 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-15T22:29:50.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a1911414-73ae-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T22:29:50.800 INFO:teuthology.orchestra.run.smithi045.stdout:Deleting cluster with fsid: a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:29:53.295 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a1911414-73ae-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T22:29:53.497 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:29:55.946 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a1911414-73ae-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T22:29:56.150 INFO:teuthology.orchestra.run.smithi165.stdout:Deleting cluster with fsid: a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:29:58.519 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:29:58.553 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:29:58.587 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T22:29:58.615 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-15T22:29:58.617 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906231/remote/smithi045/crash 2024-09-15T22:29:58.618 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/crash -- . 2024-09-15T22:29:58.648 INFO:teuthology.orchestra.run.smithi045.stderr:tar: /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T22:29:58.648 INFO:teuthology.orchestra.run.smithi045.stderr:tar: Error is not recoverable: exiting now 2024-09-15T22:29:58.650 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906231/remote/smithi100/crash 2024-09-15T22:29:58.651 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/crash -- . 2024-09-15T22:29:58.692 INFO:teuthology.orchestra.run.smithi100.stderr:tar: /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T22:29:58.692 INFO:teuthology.orchestra.run.smithi100.stderr:tar: Error is not recoverable: exiting now 2024-09-15T22:29:58.694 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906231/remote/smithi165/crash 2024-09-15T22:29:58.695 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/crash -- . 2024-09-15T22:29:58.738 INFO:teuthology.orchestra.run.smithi165.stderr:tar: /var/lib/ceph/a1911414-73ae-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T22:29:58.738 INFO:teuthology.orchestra.run.smithi165.stderr:tar: Error is not recoverable: exiting now 2024-09-15T22:29:58.739 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-15T22:29:58.739 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-15T22:29:58.781 INFO:tasks.cephadm:Compressing logs... 2024-09-15T22:29:58.781 DEBUG:teuthology.orchestra.run.smithi045:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:29:58.824 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:29:58.828 DEBUG:teuthology.orchestra.run.smithi165:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:29:58.850 INFO:teuthology.orchestra.run.smithi045.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-15T22:29:58.850 INFO:teuthology.orchestra.run.smithi045.stderr:: No such file or directory 2024-09-15T22:29:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-15T22:29:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-15T22:29:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.log: /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T22:29:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T22:29:58.866 INFO:teuthology.orchestra.run.smithi100.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-15T22:29:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:: No such file or directory 2024-09-15T22:29:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-15T22:29:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-15T22:29:58.867 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T22:29:58.868 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-15T22:29:58.868 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-15T22:29:58.868 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-15T22:29:58.868 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T22:29:58.868 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.4.log: /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T22:29:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-15T22:29:58.869 INFO:teuthology.orchestra.run.smithi100.stderr: 90.5% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T22:29:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.cephadm.log: 94.5% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-15T22:29:58.869 INFO:teuthology.orchestra.run.smithi100.stderr: 81.7% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T22:29:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.log 2024-09-15T22:29:58.869 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-15T22:29:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.log: 87.6% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T22:29:58.870 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-15T22:29:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.h.log: 91.1% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T22:29:58.875 INFO:teuthology.orchestra.run.smithi100.stderr: 91.9% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-15T22:29:58.875 INFO:teuthology.orchestra.run.smithi100.stderr: 94.6% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-15T22:29:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-15T22:29:58.875 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T22:29:58.876 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T22:29:58.879 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-15T22:29:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T22:29:58.880 INFO:teuthology.orchestra.run.smithi045.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-15T22:29:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-15T22:29:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-15T22:29:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mon.a.log: 84.4% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T22:29:58.881 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-15T22:29:58.881 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.g.log: 90.3% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T22:29:58.881 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.log 2024-09-15T22:29:58.881 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-15T22:29:58.882 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.log: 94.7% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-15T22:29:58.882 INFO:teuthology.orchestra.run.smithi045.stderr: 94.6% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-15T22:29:58.882 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-15T22:29:58.882 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-15T22:29:58.882 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mgr.x.log: 87.5% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T22:29:58.882 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-15T22:29:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.6% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-15T22:29:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T22:29:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.3.log: 94.6% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-15T22:29:58.883 INFO:teuthology.orchestra.run.smithi045.stderr: 91.0% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T22:29:58.883 INFO:teuthology.orchestra.run.smithi100.stderr: 94.6% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-15T22:29:58.889 INFO:teuthology.orchestra.run.smithi165.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T22:29:58.890 INFO:teuthology.orchestra.run.smithi165.stderr:: No such file or directory 2024-09-15T22:29:58.890 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T22:29:58.890 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-15T22:29:58.890 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-15T22:29:58.890 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T22:29:58.890 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-15T22:29:58.891 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-15T22:29:58.891 INFO:teuthology.orchestra.run.smithi165.stderr: 81.7% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T22:29:58.891 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-15T22:29:58.891 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.2.log: --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.log 2024-09-15T22:29:58.891 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-15T22:29:58.891 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.log: 90.5% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T22:29:58.892 INFO:teuthology.orchestra.run.smithi165.stderr: 87.6% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T22:29:58.892 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-15T22:29:58.892 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-15T22:29:58.892 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.5% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-15T22:29:58.893 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-15T22:29:58.893 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T22:29:58.893 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-15T22:29:58.893 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.c.log: 94.5% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-15T22:29:58.893 INFO:teuthology.orchestra.run.smithi165.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T22:29:58.893 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.f.log: 91.9% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-15T22:29:58.893 INFO:teuthology.orchestra.run.smithi165.stderr:/var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T22:29:58.893 INFO:teuthology.orchestra.run.smithi165.stderr: 94.6% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-15T22:29:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/cephadm.log: 94.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T22:29:59.157 INFO:teuthology.orchestra.run.smithi165.stderr: 91.8% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-15T22:29:59.167 INFO:teuthology.orchestra.run.smithi100.stderr: 91.8% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-15T22:29:59.230 INFO:teuthology.orchestra.run.smithi045.stderr: 90.2% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-15T22:29:59.697 INFO:teuthology.orchestra.run.smithi045.stderr: 90.5% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-15T22:30:02.136 INFO:teuthology.orchestra.run.smithi100.stderr: 92.0% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-15T22:30:03.550 INFO:teuthology.orchestra.run.smithi165.stderr: 95.5% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-15T22:30:03.682 INFO:teuthology.orchestra.run.smithi165.stderr: 91.9% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-15T22:30:03.864 INFO:teuthology.orchestra.run.smithi100.stderr: 92.0% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-15T22:30:04.574 INFO:teuthology.orchestra.run.smithi045.stderr: 91.9% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-15T22:30:04.700 INFO:teuthology.orchestra.run.smithi045.stderr: 91.5% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-15T22:30:04.882 INFO:teuthology.orchestra.run.smithi165.stderr: 91.9% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-15T22:30:05.463 INFO:teuthology.orchestra.run.smithi165.stderr: 91.9% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-15T22:30:05.573 INFO:teuthology.orchestra.run.smithi100.stderr: 91.4% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-15T22:30:06.325 INFO:teuthology.orchestra.run.smithi045.stderr: 91.5% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-15T22:30:06.497 INFO:teuthology.orchestra.run.smithi165.stderr: 91.6% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-15T22:30:06.498 INFO:teuthology.orchestra.run.smithi165.stderr: 2024-09-15T22:30:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:real 0m7.655s 2024-09-15T22:30:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:user 0m29.171s 2024-09-15T22:30:06.498 INFO:teuthology.orchestra.run.smithi165.stderr:sys 0m0.944s 2024-09-15T22:30:06.842 INFO:teuthology.orchestra.run.smithi045.stderr: 91.9% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-15T22:30:06.844 INFO:teuthology.orchestra.run.smithi045.stderr: 2024-09-15T22:30:06.844 INFO:teuthology.orchestra.run.smithi045.stderr:real 0m8.005s 2024-09-15T22:30:06.844 INFO:teuthology.orchestra.run.smithi045.stderr:user 0m27.450s 2024-09-15T22:30:06.844 INFO:teuthology.orchestra.run.smithi045.stderr:sys 0m0.821s 2024-09-15T22:30:07.858 INFO:teuthology.orchestra.run.smithi100.stderr: 91.9% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-15T22:30:42.114 INFO:teuthology.orchestra.run.smithi100.stderr: 93.3% -- replaced with /var/log/ceph/a1911414-73ae-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-15T22:30:42.116 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-09-15T22:30:42.116 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m43.274s 2024-09-15T22:30:42.116 INFO:teuthology.orchestra.run.smithi100.stderr:user 1m5.456s 2024-09-15T22:30:42.117 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m2.072s 2024-09-15T22:30:42.117 INFO:tasks.cephadm:Archiving logs... 2024-09-15T22:30:42.117 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906231/remote/smithi045/log 2024-09-15T22:30:42.119 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:30:47.169 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906231/remote/smithi100/log 2024-09-15T22:30:47.170 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:30:57.092 DEBUG:teuthology.misc:Transferring archived files from smithi165:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906231/remote/smithi165/log 2024-09-15T22:30:57.093 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:31:01.560 INFO:tasks.cephadm:Removing cluster... 2024-09-15T22:31:01.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a1911414-73ae-11ef-bceb-c7b262605968 --force 2024-09-15T22:31:01.775 INFO:teuthology.orchestra.run.smithi045.stdout:Deleting cluster with fsid: a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:31:02.085 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a1911414-73ae-11ef-bceb-c7b262605968 --force 2024-09-15T22:31:02.288 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:31:02.621 DEBUG:teuthology.orchestra.run.smithi165:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a1911414-73ae-11ef-bceb-c7b262605968 --force 2024-09-15T22:31:02.825 INFO:teuthology.orchestra.run.smithi165.stdout:Deleting cluster with fsid: a1911414-73ae-11ef-bceb-c7b262605968 2024-09-15T22:31:03.116 INFO:tasks.cephadm:Removing cephadm ... 2024-09-15T22:31:03.117 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T22:31:03.138 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T22:31:03.155 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T22:31:03.171 INFO:tasks.cephadm:Teardown complete 2024-09-15T22:31:03.172 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T22:31:03.182 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T22:31:03.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:31:03.185 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:31:03.198 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:31:03.315 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T22:31:03.326 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T22:31:03.326 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:31:03.329 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:31:03.332 DEBUG:teuthology.orchestra.run.smithi165:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:31:03.345 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:31:03.345 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:31:03.347 INFO:teuthology.orchestra.run.smithi165.stderr:bash: line 1: ntpq: command not found 2024-09-15T22:31:03.350 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:31:03.350 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-09-15T22:31:03.350 INFO:teuthology.orchestra.run.smithi045.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 +1111us[+1065us] +/- 39ms 2024-09-15T22:31:03.350 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -935us[ -935us] +/- 50ms 2024-09-15T22:31:03.350 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -635us[ -683us] +/- 61ms 2024-09-15T22:31:03.350 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:03.351 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:31:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-09-15T22:31:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 +1095us[+1045us] +/- 39ms 2024-09-15T22:31:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -947us[ -947us] +/- 50ms 2024-09-15T22:31:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -642us[ -692us] +/- 61ms 2024-09-15T22:31:03.352 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:03.353 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T22:31:03.353 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2024-09-15T22:31:03.353 INFO:teuthology.orchestra.run.smithi165.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 +1099us[ +983us] +/- 39ms 2024-09-15T22:31:03.353 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -897us[ -897us] +/- 50ms 2024-09-15T22:31:03.353 INFO:teuthology.orchestra.run.smithi165.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 -635us[ -635us] +/- 61ms 2024-09-15T22:31:03.353 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T22:31:03.354 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T22:31:03.364 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T22:31:03.364 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T22:31:03.374 DEBUG:teuthology.orchestra.run.smithi045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:31:03.483 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:31:03.553 DEBUG:teuthology.orchestra.run.smithi165:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T22:31:03.621 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:31:03.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:31:03.653 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:31:03.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:31:03.685 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T22:31:03.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:31:03.713 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T22:31:03.724 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T22:31:03.735 INFO:teuthology.task.internal:Duration was 1871.450292 seconds 2024-09-15T22:31:03.736 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T22:31:03.749 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T22:31:03.749 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:31:03.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:31:03.755 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:31:03.793 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:31:03.794 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:31:03.794 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T22:31:04.290 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T22:31:04.290 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2024-09-15T22:31:04.290 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:31:04.317 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-09-15T22:31:04.317 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:31:04.353 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi165.front.sepia.ceph.com 2024-09-15T22:31:04.354 DEBUG:teuthology.orchestra.run.smithi165:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:31:04.383 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T22:31:04.383 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:31:04.386 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:31:04.396 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:31:04.450 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T22:31:04.450 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:31:04.459 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:31:04.462 DEBUG:teuthology.orchestra.run.smithi165:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:31:05.486 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T22:31:05.497 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T22:31:05.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:31:05.524 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:31:05.554 DEBUG:teuthology.orchestra.run.smithi165:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:31:05.583 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T22:31:05.595 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:31:05.598 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:31:05.600 DEBUG:teuthology.orchestra.run.smithi165:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:31:05.620 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2024-09-15T22:31:05.625 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-09-15T22:31:05.648 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = core 2024-09-15T22:31:05.684 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:31:05.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:31:05.699 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:31:05.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:31:05.720 DEBUG:teuthology.orchestra.run.smithi165:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:31:05.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:31:05.741 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T22:31:05.754 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T22:31:05.755 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906231/remote/smithi045 2024-09-15T22:31:05.755 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:31:05.816 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906231/remote/smithi100 2024-09-15T22:31:05.816 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:31:05.857 DEBUG:teuthology.misc:Transferring archived files from smithi165:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906231/remote/smithi165 2024-09-15T22:31:05.857 DEBUG:teuthology.orchestra.run.smithi165:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:31:05.895 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T22:31:05.895 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:31:05.898 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:31:05.900 DEBUG:teuthology.orchestra.run.smithi165:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:31:05.946 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T22:31:05.959 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T22:31:05.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T22:31:05.971 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T22:31:05.971 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:31:05.974 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:31:05.976 DEBUG:teuthology.orchestra.run.smithi165:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:31:05.987 INFO:teuthology.orchestra.run.smithi045.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:31 /home/ubuntu/cephtest 2024-09-15T22:31:05.990 INFO:teuthology.orchestra.run.smithi100.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:31 /home/ubuntu/cephtest 2024-09-15T22:31:06.001 INFO:teuthology.orchestra.run.smithi165.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:31 /home/ubuntu/cephtest 2024-09-15T22:31:06.003 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T22:31:06.014 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T22:31:06.041 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/fs/norstats}} duration: 1871.4502921104431 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-15T22:31:06.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:31:06.129 INFO:teuthology.run:pass